How NOT to get your IP or proxies banned.??

NewGuy586

Junior Member
Joined
Nov 19, 2013
Messages
135
Reaction score
4
So, is there any rule of thumbs on how not to get your IP or proxies banned from scraping?

I used a few public ones and I think I burned them... :(
 
Public proxies usually dies instantly so no point in using them for scraping purpose.
Best would be to try some rotating proxies you can easily find sellers over marketplace here or use private proxies with long delays with less threads.
 
Any suggestions on what should be the delays and threads per proxies?
 
Use dedicated Proxies or Rotate 4G for a low % ban rate.
You can find providers in the https://www.blackhatworld.com/forums/proxies-for-sale.112/
 
Any suggestions on what should be the delays and threads per proxies?
What are you using the proxies for? You didn't specify in your OP. Different proxies work better for different platforms.
 
Use rotating proxies, like stormproxies
 
So, is there any rule of thumbs on how not to get your IP or proxies banned from scraping?

I used a few public ones and I think I burned them... :(

There is no foolproof method of scraping Google. Sometimes it depends on what you're queries are. Advance search operators may trigger an error even if you've never once used the proxy ever. Google handles queries differently, and you will experience errors no matter what type of proxies are used.

The best proxies I've used are rotating residential. You'll have much fewer errors. I haven't used 4G, so I can't comment on those. I would avoid using data center proxies if you take Google scraping seriously.
 
Thread moved.
 
Most public proxies are already burned by users before you, so don't worry about them.

And yes, as asked above, where do you want to use your proxies?
 
Back
Top