Automatically generate AWS instances and use as proxy rotation

I'm scraping with close to a million requests every month which tend to be expensive, often costing hundreds of dollars. Then I found that Createproxy offers the service of automatically generating new instances on AWS and thereby creating a personal proxy rotation service. Unfortunately, they charge $24 every month. Not a substantial amount but I reckon a similar thing should be possible with just a simple script.

I've tried searching on all keywords I can think of but have not found anything resembling a traditional proxy rotation URL. I could usually hack something together myself but I'm a complete novice on AWS which doesn't help. Any suggestion on scripts or maybe even what to search for? I'm thinking Tinyproxy might be the way to go but it would require programming the instances myself.

I reckon there must be plenty of people doing something similar?

Easily use residential proxies or scraper API for that, It's waste time to create proxies by your own, you can easily earn more from data

You could hire someone by posting in the "Hire a Freelancer" section for programming tasks but it is again going to cost you $$$. Tbh, a more efficient, hassle-free, and time-saving solution would be to simply buy already configured proxies from a trusted source (Marketplace) or post in the "Want to Buy" section.

MoonStarz said:

You could hire someone by posting in the "Hire a Freelancer" section for programming tasks but it is again going to cost you $$$. Tbh, a more efficient, hassle-free, and time-saving solution would be to simply buy already configured proxies from a trusted source (Marketplace) or post in the "Want to Buy" section.

Click to expand...

Sadly the time-saving solution ends up costing a small fortune in the long run when costing hundreds of dollars every month. Hiring a freelancer would most likely pay for itself within only a few months. I'm mainly surprised that there seems to be no available solution considering how many people are talking about doing it.

If whatever you scrape supports IPV6, you can use something like this: https://blog.vpsville.ru/blog/howto/149.html
You just need a debian 8 cloud VPS with open IPV6 range. However, the automatic renewal of IPs and URL rotation are not included. But maybe you can add those features yourself.

You need to use residential proxies which offer new ip for every request. You can start with as low as $5/GB with proxy-cheap(dot)com