How to know when new links/page is added?

LJ Junior · Aug 4, 2019

Is there a way to know or search for new links added on a website?

For example --- www.imdb.com IMDB added new page/link to their website every time they want to add a new Movie/Series/Episode. Now, how can I get the list of new pages added on their website, recently?

I want to use this information to stay updated on one particular website ( I don't wish to disclose )

Any help on this will be appreciated

tomcatplayer · Aug 4, 2019

well if imdb has a page that shows the most recent pages/movies added then you just need to track that page to see when changes have been made

but since its not imdb you might need to continually crawl the site waiting for there to be a difference from the last crawl

Extruser · Aug 4, 2019

Depends on the site, but lots of sites have an RSS feed. It's an XML-file that updates on new content.

LJ Junior · Aug 4, 2019

tomcatplayer said:
well if imdb has a page that shows the most recent pages/movies added then you just need to track that page to see when changes have been made

but since its not imdb you might need to continually crawl the site waiting for there to be a difference from the last crawl

Well it was easy.

All I need is LINKS.
I have done this
https://www.google.com/search?q=sit..._U8unjAhVQmI8KHQ2oBuwQpwUIKQ&biw=1440&bih=685

Tools>Results of last 24hrs. Now I have all the links added in IMDB. Is there a way to export all the google results URL's?
Let say I have 1000 results after I run the search for site:imdb.com and Google displays 1000 results. How can I get all those links exported?

Any help on this?

LJ Junior · Aug 4, 2019

Extruser said:
Depends on the site, but lots of sites have an RSS feed. It's an XML-file that updates on new content.

LJ Junior said:
Well it was easy.

All I need is LINKS.
I have done this
https://www.google.com/search?q=sit..._U8unjAhVQmI8KHQ2oBuwQpwUIKQ&biw=1440&bih=685

Tools>Results of last 24hrs. Now I have all the links added in IMDB. Is there a way to export all the google results URL's?
Let say I have 1000 results after I run the search for site:imdb.com and Google displays 1000 results. How can I get all those links exported?

Any help on this?

@Extruser this?

LJ Junior · Aug 4, 2019

Seoquake chrome extension is helpful.
Thanks!

Extruser · Aug 4, 2019

Well, most WP sites still have RSS feeds and use Pingomatic to inform search engines and aggregators of new content.
BHW has RSS feeds too for example.
But depending on the site you are targeting, it might not be the best solution or maybe they don't even have a feed.

ThatSEO · Aug 4, 2019

Try this? https://visualping.io/?utm_source=cd&utm_medium=redirtocdlp&utm_campaign=mig1

Works great for watching competitors etc

How to know when new links/page is added?

LJ Junior

Power Member

tomcatplayer

Banned - Refused to handle a shitlist properly

Extruser

Regular Member

LJ Junior

Power Member

LJ Junior

Power Member

LJ Junior

Power Member

Extruser

Regular Member

ThatSEO

Supreme Member

Main Menu

Marketplace

Making Money

BlackHat World