Recent content by Pecola

Ah yes, they were all US west proxies, and they were all private.

Initially I bought a set of 10 proxies from ActProxy.

Precisely what I'm currently trying. I'm scraping at a rate of one request per 30 seconds, which I feel is relatively very slow. However, I'm still getting CAPTCHAs being sent my way after about 30 minutes of scarping, which indicates to me that Amazon has flagged my proxies as possible bots.

For myself personally, I'm looking to scrape the Best Sellers list, as I don't have a list of ASINs available. What I remember from my research a few months ago is that doing something like this isn't possible using the Amazon API. Also, I believe there is a daily cap on the number of requests...

Hey I just sent you an email. Let me know if you received it.

I'm interested as well, please PM me the details. I'm developing one using Python + Scrapy.

Same issue with me, although I'm getting CAPTCHAs thrown back at me. I'm using the TOR network to anonymize my scraping.

I'm using the Scrapy library from Python, and I've explicitly set the Cookies to not be enabled in my spider's/scraper's settings.

Hi guys, I created an Amazon scraper to scrape the product pages of the top selling Amazon products in a category of my choice (ex. Baby Products), including the top selling products in the subcategories. However, I've been running into an issue where Amazon keeps sending me CAPTCHAs almost as...

Whoops this was supposed to go under Programming, not BlackHat SEO. Mods can you please move this over to the appropriate sub-forum, thanks.

Hi guys, I created an Amazon scraper to scrape the product pages of the top selling Amazon products in a category of my choice (ex. Baby Products), including the top selling products in the subcategories. However, I've been running into an issue where Amazon keeps sending me CAPTCHAs almost...