Anyone scraping Amazon here on a large scale?
- Thread starter jamie3000
- Start date
thetrustedzone
Elite Member
- Jun 15, 2010
- 3,994
- 3,462
i coded few amazon scrapers before , that error probably due to missed http header , use fiddler to capture and simulate all headers , if failed pm me your code i will check it for you .
- Jun 30, 2014
- 13,741
- 5,218
The issue I'm having is about 70% of my proxies are being 503 blocked very quickly. Where as the other 30% work perfectly, they'll get the captcha challenge eventually then I'll solve it (my system) and they'll carry on fine.
thetrustedzone
Elite Member
- Jun 15, 2010
- 3,994
- 3,462
seems you found root of problem and already solved it !
- Mar 21, 2013
- 24,764
- 31,552
That was my money maker in 1999. With API's and shit you don't really need to scrape Amazon any more.
Automation Guru
BANNED
- May 28, 2019
- 162
- 48
I use my own custom scraper I built for amazon.. I have no issues with 503 errors and JS captcha execution as of yet..
yourdady
Power Member
- Apr 4, 2014
- 637
- 141
Would you mind sharing?
Automation Guru
BANNED
- May 28, 2019
- 162
- 48
You want me to share my custom bot? NO - That is why it is custom.. i.e for me only
yourdady
Power Member
- Apr 4, 2014
- 637
- 141
You want me to share my custom bot? NO - That is why it is custom.. i.e for me only
Share is caring...!
David AffForce
Junior Member
- Mar 6, 2019
- 117
- 38
i also have this problem