Scrapebox, how many threads for yelp?

[isaac ruble]

If I have 200 private proxies how many connections can I get away with while scraping yelp?

 

[dreadpixel]

Crawling yelp might not give the results you expect.

 

[isaac ruble]

I'm getting awesome results from scraping it currently.

Tons of phone numbers and websites.

 

[PeaceDoge]

I'd say test it out. Start with 50 and work your way up. Currently it would be best to test the waters, cause if you flood them all at once they might limit even more. Good luck tho.

 

[isaac ruble]

You think 50 isn't too much with only 200 proxies?

 

[Manu B]

I you're using 200 proxies and proxies are stable, you can start with minimum 200 threads. You can try 2-3 threads per proxy (400=600 threads)to see the block rate and increase or decrease appropriately.

 

[isaac ruble]

I you're using 200 proxies and proxies are stable, you can start with minimum 200 threads. You can try 2-3 threads per proxy (400=600 threads)to see the block rate and increase or decrease appropriately.

Isn't that extremely risky though? If I get my private proxies blocked by yelp I will have to purchase new ones.

 

[Aaric]

I got 10 tabs on my browser refreshed at same time and IP address was blacklisted in seconds. and IP addresses is not removed from blacklist again.