I have a Scrapebox question

[Fiducia]

Right, I have the xEvil setup in Scrapebox, but when scraping google i get error too many requests or whatever with my proxies and it doesn't attempt to solve the recaptcha.

Sounds like the proxies are not good or you are running too many threads. Have you tried the Detailed Harvester with a single thread?

 

[Zher0]

Sounds like the proxies are not good or you are running too many threads. Have you tried the Detailed Harvester with a single thread?

The detailed harvester is what I'm using. I switched to IPV4 rotating proxies, but I still don't see any captchas being sent. I'm assuming Scrapebox doesn't prompt captcha services for Google captchas when scraping.

 

[loopline]

I was able to connect scrapebox with xEvil, but does scrapebox not have an option to solve captchas when scraping google?

No. They tried this in the past and it was a lost cause.

The challenge is that you very quickly go to having a captcha on basically every request. Sometimes captchas fail and you wind up spending more time solving captchas, then you do scraping. It slowed scraping to a crawl and it was more cost and time effective just to do it differently.

You can look at my youtube for a video called safely scraping google.

The concept is just go slow enough to stay under googles radar and you can scrape non stop 24/7 and just let it run. Over a 30 day period I can always get more results by doing this then by fidling around with other stuff.


Either way, it created more problems then it solved, so it was removed.

 

[Zher0]

No. They tried this in the past and it was a lost cause.

The challenge is that you very quickly go to having a captcha on basically every request. Sometimes captchas fail and you wind up spending more time solving captchas, then you do scraping. It slowed scraping to a crawl and it was more cost and time effective just to do it differently.

You can look at my youtube for a video called safely scraping google.

The concept is just go slow enough to stay under googles radar and you can scrape non stop 24/7 and just let it run. Over a 30 day period I can always get more results by doing this then by fidling around with other stuff.


Either way, it created more problems then it solved, so it was removed.

Makes sense, thanks for the input!