I have a Scrapebox question

Zher0 said:

Right, I have the xEvil setup in Scrapebox, but when scraping google i get error too many requests or whatever with my proxies and it doesn't attempt to solve the recaptcha.

Click to expand...

Fiducia said:

Sounds like the proxies are not good or you are running too many threads. Have you tried the Detailed Harvester with a single thread?

Click to expand...

Zher0 said:

I was able to connect scrapebox with xEvil, but does scrapebox not have an option to solve captchas when scraping google?

Click to expand...

loopline said:

No. They tried this in the past and it was a lost cause.

The challenge is that you very quickly go to having a captcha on basically every request. Sometimes captchas fail and you wind up spending more time solving captchas, then you do scraping. It slowed scraping to a crawl and it was more cost and time effective just to do it differently.

You can look at my youtube for a video called safely scraping google.

The concept is just go slow enough to stay under googles radar and you can scrape non stop 24/7 and just let it run. Over a 30 day period I can always get more results by doing this then by fidling around with other stuff.


Either way, it created more problems then it solved, so it was removed.

Click to expand...