I'm considering using Amazon EC2 as a proxy to scrape a website's live data through PHP/cURL. The website throttles based on IP. There are thousands of requests involved.. The requests need to be made live (as users search on my site) because the data changes throughout the day.
Is Amazon EC2 a good choice for a proxy here? Will scraping on their service draw Amazon's ire?
Note: This site isn't scraped by many people, so they're definitely not setup to block Amazon IP's specifically.
Is Amazon EC2 a good choice for a proxy here? Will scraping on their service draw Amazon's ire?
Note: This site isn't scraped by many people, so they're definitely not setup to block Amazon IP's specifically.