I have tried scrapebox, and using storm rotating proxies. However, it always show error.
I have also use GSA proxy scraper with it extension metrics checker, but it's not accurate.
What else can i use? Thanks
Which crawler should I use? ThanksThe problem with bulk indexation checking is Google captcha.
So you should use Crawler + CapMonster (or alternative) + rotating proxies. And there also should be logic.
I'll provide Tuesday a working solution.
Yes, any solution? ThanksJust to understand correctly, you're wanting to know how to check the status of a URL in Google index in bulk correct?
If so, are these all the same domain, or are these bulk URLS all different domains?
Yes, any solution? Thanks
Sorry, multiple domains, they are web 2.0You did not answer the question I asked. I asked if it was one domain or multiple domains?
Scrapebox works fine, its the proxies that are the issue. For example try a test with no proxies.I have tried scrapebox, and using storm rotating proxies. However, it always show error.
I have also use GSA proxy scraper with it extension metrics checker, but it's not accurate.
What else can i use? Thanks
Which provider is good for Google now? Should i still buy rotating proxies for crawling? ThanksScrapebox works fine, its the proxies that are the issue. For example try a test with no proxies.
you need different proxies is all, storm proxies is no longer good with googe, at least thats what many users say.
Rotating proxies are good for like scraping from search engines, but they tend to be from all sorts of sources from all sorts of locations around the world.Which provider is good for Google now? Should i still buy rotating proxies for crawling? Thanks