On a 100mbit VPS what is the max connections I should set for URL harvesting on scraped public proxies? They seem to burn out within about 10 minutes if I go much above 100 in the max connections. Should I just try to add as many proxies as I have connections, or will I really need to lower the connections to stop them burning out so fast? What about timeout settings? Some people recommend to buy private proxies and set lower max connections (e.g., 5) and timeout values to stop burn out. Will private proxies still scrape as fast on lower max connections? Eventually I want to start using a tool like yaph to portscan for my own proxies so I can just keep adding them in bulk without caring about burn-out, but it looks like it will take a lot of trial and error to go through all the known country cidrs and find some good ranges. That said, I just want to make do with public proxies for the time being.