How many requests per second should you expect to be able to scrape using curl in PHP with a proxy provider?

I've tested scraping the following URL with different proxy providers, using curl and PHP: https://api.ipify.org/?format=json

I'm getting very different results.

• Without any proxies, it took about .1 seconds per curl request.
• With InstantProxies, I seem to average about 0.5 seconds per request.
• With ProxyRack (private residential proxies), I seem to average about 3-4 seconds per request.
• With StormProxies backconnect rotating proxies, I seem to average 3-7 seconds per request, with wild variance. Individual requests can take .22 seconds, or 59 seconds.

What should one be expecting from a proxy provider, in terms of rate of requests per second, using curl and PHP?

Does anyone know if any provider might be faster than InstantProxies, or is that about as fast as I should expect from any proxy?

also keep in mind the higher the request rate, the more chance of the
proxy being blocked, just something to be aware of .

Snap101 said:

You should also install an own proxy environment ... for instance Squid with Linux ... to measure the results

Out of my experience using the libcurl with own proxies you can expect like 40 to 70 requests per second ... but it depends on the HTTP server destination also

Click to expand...

I was only able to get 10 requests per second without any proxies, but you can get 40-70 with proxies.

Do you have any idea why this would be slow? Are there many some server configuration issues I should look at?

My curl code was pretty basic so I don't think that should be the issue.