Anyway to scrape new website links in real time ?

goodbood

Regular Member
Joined
May 7, 2014
Messages
349
Reaction score
73
Hey
Im looking to find all new links or new pages created by a website
For example every time the website sssss.com adds a new post there will be a link like sssss.com/post/zz
Is there any way to scrape the website every few seconds to find out all new zzzz posts in real time ?
Every second matters
 

Ramazan

Regular Member
Joined
Aug 19, 2018
Messages
257
Reaction score
131
Maybe you can request their sitemap.xml file.
 

MonteCarlos

Regular Member
Joined
Aug 1, 2015
Messages
494
Reaction score
794
I think that you'll need some "website watcher" app or online service.
 
Top