Find out how many pages a site has

NLHES

Newbie
Joined
Oct 24, 2017
Messages
23
Reaction score
3
I have a list of 10k+ sites.

I would like to filter these sites on the number of pages that they have.

So basically this: "site:domain.com" and list the number of pages that the site returns.

I don't mind using Bing and the likes to avoid IP bans. Or maybe there's even a whole other way to do this.

Any ideas / tools? Can I do this with scrapebox?
 
You seem to know what to do. What you need is a bunch of proxies.
 
Well bing and google etc.. might give you different results for the same query, but scrapebox has an addon that does this.

The google competition finder does exactly this, gives you a count of results.

you could modify the bing engine in the harvester to give you this data as well and then just save the keyword query (the site:domain.com) with the result and thus you would know. So it could work for bing in scrapebox if you modify it. or it should anyway.
 
Back
Top