What are the proxies that are work with scraper ?

Sanjuwa

Regular Member
Joined
Jul 23, 2019
Messages
227
Reaction score
59
I built a scraper but It doesn't scrape in VPS. I think it's because of datacenter ip.

I tried some VPNs but they are getting blocked after few requests.

What is the cheapest way to solve this problem ?

What kind of proxies should I buy ? Any recommendations ?
 
I built a scraper but It doesn't scrape in VPS. I think it's because of datacenter ip.

I tried some VPNs but they are getting blocked after few requests.

What is the cheapest way to solve this problem ?

What kind of proxies should I buy ? Any recommendations ?
Exactly, tell us what you are trying to scrape
 
I built a scraper but It doesn't scrape in VPS. I think it's because of datacenter ip.

I tried some VPNs but they are getting blocked after few requests.

What is the cheapest way to solve this problem ?

What kind of proxies should I buy ? Any recommendations ?
Are you scraping with different sessions on the same IP? What is your setup
 
Bro,Try 4 G proxies or another one I would love to share residential proxies
 
Semi-dedicated residential proxies are enough for scraping. You shouldn't scrape without proxies.
 
I tried some VPNs but they are getting blocked after few requests.

Note that VPNs aren't suited for scraping, because they allow you to use only one IP at a time. And for a scraper, you should use multiple IPs at once.

What is the cheapest way to solve this problem ?

What kind of proxies should I buy ? Any recommendations ?

If you can provide some more info on your setup/project, the community will provide better answers to you.
 
Datacenter IPs work with scraping, but only for a limited amount of time. VPNs aren't all too good. The issue with both of these is that they have shared IPs and when you send too many API calls from shared IPs, they get blocked after a while because the device signature these IPs give off are of a shared device or a modem, which is a deviation from natural user flows where every user at least has different device signatures if not the IP. The best solution here is to use dedicated, 4G mobile proxies. These proxies give real cell phone signatures, and the website you're scraping thinks that these API calls are coming from a real person using a real cell phone. This is what you'd want them to think.
 
Back
Top