Scrapebox Error 302 IP Blocked

Hey guys,

I have been fiddeling around lately a little bit with Scrapebox. Still trying to master the art of footprints and how to harvest well Lately, I am experiencing a problem:

Whenever I try to harvest URLs Scrapebox says that my proxies are blocked by google. I have 10 Proxies from Squid Proxies and 10 from Yourprivateproxy to test them out and all proxies seemed to die after a little harvest (30.000 URLs).

I know I should do the heavy lifting with public proxies but was a little lazy harvesting them, however, I think private proxies should last longer.

Also, if I browse with Firefox those 'supposedly' dead proxies are working just fine, I can access Google and do my searches. So I think there might be a problem with my Scrapebox settings. I am still a newbie so definately I am missing something and thought you could give me a hint.

I tried to set different connections starting with 90 which gave me around 160URLs/s but lowering quickly to 100 and below, is that normal?

Thanks for your help.

Harvesting using private proxies is not recommended. Search engines treat both public and private in the same manner when it comes to scraping. They soft block the IP at one point when the proxies reach the maximum search queries threshold. No body knows exactly how many queries SEs accepts per day from an IP. But the count varies between SEs. For example, Yah0o allows you to do more automated searches than G0ogle.

So either use bunch of pubic proxies for harvesting or use just Yah0o alone for scraping. You can even scrape from Yah00 without proxies for longer period.

Thanks for your reply! The only thing that astounded me was that I could and still can access google manually via my browser over the blocked proxies...

But probably Google treats Scrapebox's access differently or something like that.

Is there a way to reach more than 150 URLs/s with public proxies? I have a VPS from xsserver, the $35 version so that should do it hardwarewise.