I cant get my url/second up in Scrapebox!!

rodnice1 · Mar 30, 2012

I have private proxies, i adjusted the settings a million times, I think I tried everything. I am trying to harvest url's and cant get my url's/sec up beyond 9.
When I scrape without any proxy at all, they get up to 75.:1zhelp:

0_00_0 · Mar 30, 2012

Don't use private proxies for scraping unless you have a couple hundred they are probably getting banned by google. That could be the problem. Try harvesting public proxies then filtering them by speed. Is your CPU maxing out? Is your network maxing out? I'm sure you've adjusted the number of threads it uses but crank that up. I'm getting around 10+ links/sec from google, 20+ links/second from yahoo.

LakeForest · Mar 30, 2012

0_00_0 said:
Don't use private proxies for scraping unless you have a couple hundred they are probably getting banned by google. That could be the problem. Try harvesting public proxies then filtering them by speed. Is your CPU maxing out? Is your network maxing out? I'm sure you've adjusted the number of threads it uses but crank that up. I'm getting around 10+ links/sec from google, 20+ links/second from yahoo.

Actually, if you do a 1:5 ratio of proxies to connection, private proxies are fine. (I actually forgot this until recently because I had gotten frustrated after accidentally getting all my private proxies blocked).

Getting 10 a second? Check the proxies section here for some good, fast lists if you dunno how to find them yourself.

I got 780 a second with a list. Burning bandwidth was fun.

I cant get my url/second up in Scrapebox!!

rodnice1

Regular Member

0_00_0

Senior Member

LakeForest

Supreme Member

Main Menu

Marketplace

Making Money

BlackHat World