GSA SER - What threads/delay to use?

[samiejg]

What would be the best amount of threads and delay to use so that I do not get banned while using 25 dedicated private proxies?

I know the amount of threads you can use can depend on your computer/server. But I'm talking about specifically for not getting banned by search engines. I'm using a home PC and internet connection by they're both pretty good and I can always lower my threads from there if it overloads my PC. I just don't want to get my new private proxies banned.

 

[Zevoltai]

Use public proxies for search engines, keep your private proxies for posting.

 

[TrevorB]

I use a max of 3-4 threads per proxy and have my html time out set to 180. For the delay for searching I have that at 60.

 

[Nargil]

If you use 25 proxies and use only one copy of GSA, I wouldn't even bother with scraping to be honest.
About what Zevoltai said... I would never even bother to do anything with public proxies. Get this idea out of your head immediately. You will never ever get any result from these.
Without special and tested footprints, shittons of proxies and possibly gscraper/scrapebox and multiple instances of GSA, I wouldn't bother with scraping at all.
I use 3 GSA instances and I don't bother with scraping whatsoever, especially when links die way too fast these days. I always buy fresh lists whenever I can. There are some services offering great lists, some even providing a live synchronization with GSA. If you want, I can post them here. It's true however, that lists die pretty fast and you should also bear that in mind. With $100 investment a month, or even $50, you can get some pretty nice lists and targets. (Or send me a pm, I can give you a part of my own list for testing purposes, because I'm such a good guy).

About HTML time out, use 180. As "filter" use 50mb - I am not shitting, use 50mb. Guys on GSA forum did some testing on this and you will get far more targets and it won't hurt speed that much.
About threads... well... if you get way too much "download failed", then lower the threads. If your memory and CPU usage is way too high, lower the threads. All in all I use fairly powerful VPS, 25 semi dedicated proxies, posting to lists and I use around 500 - 600 threads. Do some testing on this and you will see yourself, it's hard to point out the right number. If you use home connection and home PC... well try to stick with maybe 200 - 300 tops for now.

 

[joe000]

With 25 proxies, I would say 5-10 threads.

 

[bartosimpsonio]

It depends on how reputable your site is.

You can blast Amazon.com with 1 billion threads and zero delay and it will never be banned. Especially not if they continue spending billions in Ads.

 

[Deleted member 254739]

With 25 proxies, I would say 5-10 threads.

So you'd have 15-20 proxies not being used? With 25 proxies, I'd use as many threads as my machine can handle. At least 300.