I cant get my url/second up in Scrapebox!!

rodnice1

Regular Member
Joined
Oct 1, 2011
Messages
283
Reaction score
26
I have private proxies, i adjusted the settings a million times, I think I tried everything. I am trying to harvest url's and cant get my url's/sec up beyond 9.
When I scrape without any proxy at all, they get up to 75.:1zhelp:
 
Don't use private proxies for scraping unless you have a couple hundred they are probably getting banned by google. That could be the problem. Try harvesting public proxies then filtering them by speed. Is your CPU maxing out? Is your network maxing out? I'm sure you've adjusted the number of threads it uses but crank that up. I'm getting around 10+ links/sec from google, 20+ links/second from yahoo.
 
Don't use private proxies for scraping unless you have a couple hundred they are probably getting banned by google. That could be the problem. Try harvesting public proxies then filtering them by speed. Is your CPU maxing out? Is your network maxing out? I'm sure you've adjusted the number of threads it uses but crank that up. I'm getting around 10+ links/sec from google, 20+ links/second from yahoo.

Actually, if you do a 1:5 ratio of proxies to connection, private proxies are fine. (I actually forgot this until recently because I had gotten frustrated after accidentally getting all my private proxies blocked).

Getting 10 a second? Check the proxies section here for some good, fast lists if you dunno how to find them yourself.

I got 780 a second with a list. Burning bandwidth was fun.
 
Back
Top