Proper Settings For Scrapebox Proxy Harvester

If your having problems getting the most out of Scrapebox Proxy Harvester your not the first and won't be the last. I've noticed a lot of talk about lowering the number of connections and increasing the timeout settings, this is not proper usage. Doing this will only result in High Latency Proxies that are bound for failure. Quite the opposite, what you want to do is set your Proxy Harvester Connections to 100 & set your Proxy Harvester Timeout settings to 30 seconds. This way the proxies you do get will be in great shape for your harvesting efforts.

One more thing, for any harvesting session, you want at least 130 freshly harvested proxies found with thee above specifications and you definitely want to add more sources to get those proxies than just the default that scrapebox comes with. Do a search here, there have been some very nice contributions that will help, I'm harvesting at this moment with over 26,000 proxies in my list, most of them have come from my expanded sources.

Cheers ;]

This is wrong.

The number of connections your machine can comfortably handle is a system-specific hardware limitation, not a magic number you can just make up depending on the weather. If you set your proxy checker to too many connections you'll 404 out on perfectly good IPs just because your system's resources are already used up elsewhere.

The rest of your post is pretty suspect too, but we'll put out one fire at a time.

N

My settings for proxy harvester are: 100 connections and 20 sec timeout. I'm also using a lot of proxy sources. I get about 40k proxies to test and about 300-400 proxies per session.

Didn't mean to offend anyone, I guess this is a matter of opinion.
This strategy works for me very well, If you are working with a
sub par machine, this will not work out well, but neither will
anything else.

I use 25 connections with a 30 second time out and my machine handles it just fine. I am going to try the suggestion of 100 connections though. Never hurts to try it, right?

I use 50 connectios with 30s time out.....

apekillape said:

This is wrong.

The number of connections your machine can comfortably handle is a system-specific hardware limitation, not a magic number you can just make up depending on the weather. If you set your proxy checker to too many connections you'll 404 out on perfectly good IPs just because your system's resources are already used up elsewhere.

The rest of your post is pretty suspect too, but we'll put out one fire at a time.

N

Click to expand...

This is the answer and the correct strategy.

When you talk about connection, no matter we are talking about harvesting connection, fast posting or others what is important is to test to see how many connection your machine/your network and your proxy if is the case can handle...

So is all about testing and see the result....

how if you guys post your machine specs ?
i have a thinkpad with core i7 and 12gig RAM.
i never changed anything for the proxy harvester config before (10connections &30s timeout)
now i just updated it to 20conns and 15s timeout. is the timeout set too fast ?
for the initial setting i never change because i have a poor connection in my home. and if i get a faster & more reliable conn then i just change the config .