How to know when new links/page is added?

LJ Junior

Power Member
Joined
Nov 6, 2015
Messages
640
Reaction score
791
Is there a way to know or search for new links added on a website?

For example --- www.imdb.com IMDB added new page/link to their website every time they want to add a new Movie/Series/Episode. Now, how can I get the list of new pages added on their website, recently?


I want to use this information to stay updated on one particular website ( I don't wish to disclose )

Any help on this will be appreciated :)
 
well if imdb has a page that shows the most recent pages/movies added then you just need to track that page to see when changes have been made

but since its not imdb you might need to continually crawl the site waiting for there to be a difference from the last crawl
 
Depends on the site, but lots of sites have an RSS feed. It's an XML-file that updates on new content.
 
well if imdb has a page that shows the most recent pages/movies added then you just need to track that page to see when changes have been made

but since its not imdb you might need to continually crawl the site waiting for there to be a difference from the last crawl

Well it was easy.

All I need is LINKS.
I have done this
https://www.google.com/search?q=sit..._U8unjAhVQmI8KHQ2oBuwQpwUIKQ&biw=1440&bih=685

Tools>Results of last 24hrs. Now I have all the links added in IMDB. Is there a way to export all the google results URL's?
Let say I have 1000 results after I run the search for site:imdb.com and Google displays 1000 results. How can I get all those links exported?

Any help on this? :)
 
Depends on the site, but lots of sites have an RSS feed. It's an XML-file that updates on new content.
Well it was easy.

All I need is LINKS.
I have done this
https://www.google.com/search?q=sit..._U8unjAhVQmI8KHQ2oBuwQpwUIKQ&biw=1440&bih=685

Tools>Results of last 24hrs. Now I have all the links added in IMDB. Is there a way to export all the google results URL's?
Let say I have 1000 results after I run the search for site:imdb.com and Google displays 1000 results. How can I get all those links exported?

Any help on this? :)

@Extruser this?
 
Seoquake chrome extension is helpful.
Thanks!
 
Well, most WP sites still have RSS feeds and use Pingomatic to inform search engines and aggregators of new content.
BHW has RSS feeds too for example.
But depending on the site you are targeting, it might not be the best solution or maybe they don't even have a feed.
 
Back
Top