- Apr 3, 2019
- 602
- 772
Looking for datacenter proxy providers, with high or unlimited concurrent connections allowed and low latency. IP quality doesn't matter much, latency and concurrency matter the most.
These can be backconnect proxies that change IP on every request or in extremely short intervals or a large set of shared proxy list, from which I can (randomly) select IPs to connect to.
I tried so far:
- stormproxies.com (backconnect): They offer high concurrency plans (nice), but their backconnect proxies that rotate IP every request have very high latency, 1-2 seconds. Their 3min and 15min sticky session IP's are much faster, but they don't allow scraping with those for obvious reasons.
- proxyscrape.com: large pool of shared static IPs available (allowed scraping with those), with under 1 second latency, but they don't allow for more than 20-30 concurrent connections from the same IP. I could work around with several servers, but I need a lot more threads than that and I don't want to spread my bots across dozens of IPs.
- sockshub.net: Only did a short free trial with them, thanks btw. Latency for the rotating proxies was pretty high, which when combined with limited concurrent threads makes packages too expensive for my use case. I was told that rotating proxy package consist of residential IPs, not datacenter IPs, which explains why the latency is high. Technically, residential IPs can work for me, but I won't be paying 1k a month to get close to the amount of threads that I want.
Not tried yet:
- smartproxy.com: I am immediately turned off by the 1.6 s average response time on the sales page. I think I will still give them a try, because big latency just means I need more concurrency, which they say, that they allow unlimited. So they are a candidate at least, as long as they allow scraping or can accommodate IP changing every request. I doubt they'll be happy, if I send a million requests from only one of their 30min session IP's.
- brightdata.com: No concurrency limits (nice), but wants to charge $0.60/IP + $0.095/GB. Too expensive to charge me for shared IP's. Would pay a low 3-digit flat rate for unlimited access to all of those IPs with unlimited threads.).
- proxy-connect.com: 100 threads limit is decent for the price they offer it for, looks good on paper. Site not inspiring me with confidence though. Hope I get surprised.
- rotatingproxies.com: Backconnect plans are not cheap, rotating every 5min, will need to email them and ask how many requests per IP I am allowed to make within the 5min rotation. Almost $300 for 100 backconncting proxies. Not the worst deal, but if I make 1000 requests per second, that is 3000 requests per end-IP per rotation. (sounds like it's not gonna work out for scraping).
I didn't list those that offer only residential or mobile proxies, because I don't need the upside that those bring and they are too expensive. Please post more recommendations and any feedback you have about them. I'll continue to test.
These can be backconnect proxies that change IP on every request or in extremely short intervals or a large set of shared proxy list, from which I can (randomly) select IPs to connect to.
I tried so far:
- stormproxies.com (backconnect): They offer high concurrency plans (nice), but their backconnect proxies that rotate IP every request have very high latency, 1-2 seconds. Their 3min and 15min sticky session IP's are much faster, but they don't allow scraping with those for obvious reasons.
- proxyscrape.com: large pool of shared static IPs available (allowed scraping with those), with under 1 second latency, but they don't allow for more than 20-30 concurrent connections from the same IP. I could work around with several servers, but I need a lot more threads than that and I don't want to spread my bots across dozens of IPs.
- sockshub.net: Only did a short free trial with them, thanks btw. Latency for the rotating proxies was pretty high, which when combined with limited concurrent threads makes packages too expensive for my use case. I was told that rotating proxy package consist of residential IPs, not datacenter IPs, which explains why the latency is high. Technically, residential IPs can work for me, but I won't be paying 1k a month to get close to the amount of threads that I want.
Not tried yet:
- smartproxy.com: I am immediately turned off by the 1.6 s average response time on the sales page. I think I will still give them a try, because big latency just means I need more concurrency, which they say, that they allow unlimited. So they are a candidate at least, as long as they allow scraping or can accommodate IP changing every request. I doubt they'll be happy, if I send a million requests from only one of their 30min session IP's.
- brightdata.com: No concurrency limits (nice), but wants to charge $0.60/IP + $0.095/GB. Too expensive to charge me for shared IP's. Would pay a low 3-digit flat rate for unlimited access to all of those IPs with unlimited threads.).
- proxy-connect.com: 100 threads limit is decent for the price they offer it for, looks good on paper. Site not inspiring me with confidence though. Hope I get surprised.
- rotatingproxies.com: Backconnect plans are not cheap, rotating every 5min, will need to email them and ask how many requests per IP I am allowed to make within the 5min rotation. Almost $300 for 100 backconncting proxies. Not the worst deal, but if I make 1000 requests per second, that is 3000 requests per end-IP per rotation. (sounds like it's not gonna work out for scraping).
I didn't list those that offer only residential or mobile proxies, because I don't need the upside that those bring and they are too expensive. Please post more recommendations and any feedback you have about them. I'll continue to test.
