Cloud Provider for Web Scraping

Hello BlackHatters,

I am curious to hear about what kinds of setups people used to do web scraping on a web host and what provider. I heard Digital Ocean can be an affordable option but I know there must be some drawbacks. AWS is also another option but interested in what others use for their spiders as well as to host the database for their clients. Keep the data flowing.

Attractive deals are available from hostingsource.com and owned-networks.net. Can be quite right for you.

I'm also curious about web scraping setups. Digital Ocean is affordable, though AWS offers robust options. What providers and setups have you found effective for hosting both spiders and client databases? Let's keep the data flowing!

I like your attitude! I have only used local infrastructure so far. I'm very interested in the idea of hosting a database or using cloud compute. Might need a client first. Could be good for data mining due to cloud elasticity. I've heard to be weary of AWS. If you're not careful you could get charged a lot. Interested to know what setting up the infra would be like. Okay, cool you have the records, but what about putting it in Jupyter notebook and running some queries on it for analysis? I hope I can change extra for that. Happy scraping.