Amazon Scraping / Proxies?

S

Steve Books

Newbie
Joined
Jun 14, 2016
Messages
2
Reaction score
1
Hi
I wrote a program that searched a list of items (300K-500K) on amazon for price changes. The needs to be fast. The faster I search the more I get IP bans. Anyone here have experience with this and can give me some advice - like whether to use proxies, what kind of proxies, how many, from where to get them?
Thanks in advance.
Steve
 
Advertise on BHW
Hello,
i am searching for the same advice...
is there anyone with experiance in scraping amazon Items?
@Steve Books : i am interested in Items with Reviews only, how do you save them?
Maybe we can help each other..
 
Same issue with me, although I'm getting CAPTCHAs thrown back at me. I'm using the TOR network to anonymize my scraping.
 
Pecola said:
Same issue with me, although I'm getting CAPTCHAs thrown back at me. I'm using the TOR network to anonymize my scraping.
Click to expand...

NiceMicha said:
Hello,
i am searching for the same advice...
is there anyone with experiance in scraping amazon Items?
@Steve Books : i am interested in Items with Reviews only, how do you save them?
Maybe we can help each other..
Click to expand...
Hi
I would love to discuss this topic w/you, I have been working with this for over a year and I'm sure we can help each other. send me info how to contact dica1101 at gmail
 
Steve Books said:
Hi
I would love to discuss this topic w/you, I have been working with this for over a year and I'm sure we can help each other. send me info how to contact dica1101 at gmail
Click to expand...
Hey I just sent you an email. Let me know if you received it.
 
Is there a reason you can't use the amazon APIs instead of scraping?
 
azurous said:
Is there a reason you can't use the amazon APIs instead of scraping?
Click to expand...
For myself personally, I'm looking to scrape the Best Sellers list, as I don't have a list of ASINs available. What I remember from my research a few months ago is that doing something like this isn't possible using the Amazon API.

Also, I believe there is a daily cap on the number of requests you can make using the Amazon API, although that might be changed now.
 
I have some experience scraping with proxies and I advise you to get private, fresh ones (buyproxies.org maybe?) otherwise it'll be slow. Anyway, use a proxy, if you get banned, cut your scrape rate by half, try again. Repeat with another proxy.
 
azurous said:
I have some experience scraping with proxies and I advise you to get private, fresh ones (buyproxies.org maybe?) otherwise it'll be slow. Anyway, use a proxy, if you get banned, cut your scrape rate by half, try again. Repeat with another proxy.
Click to expand...
Precisely what I'm currently trying. I'm scraping at a rate of one request per 30 seconds, which I feel is relatively very slow. However, I'm still getting CAPTCHAs being sent my way after about 30 minutes of scarping, which indicates to me that Amazon has flagged my proxies as possible bots.
 
I meant where are the proxies located. US? are they private?
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top