is there any other amazon scraper who could scrape more than 4k product from amazon??? I am tired of the 4k limit of OPF (optimal product finder)
does anyone have a copy of optimal product finder and does it still work? If not, any alternatives. Any help appreaciated.
There is a site called WPAmanuke, that has a javascript you can run in your browser (you just set it up as a bookmark). Basically, you go to Amazon, search for a given type of product, then run the script and it will pull all the ASIN numbers off the items listed on that page. The only catch is you have to do this one page at a time. Just out of curiosity, why not just pull the products in through browse nodes, that's much simpler than gathering individual ASIN numbers?
You can scrape all links. Attack sitemaps. I will give you few links just like example how that looks and to understand how much data is there. Code: http://www.amazon.com/sitemap-manual-index.xml http://www.amazon.com/sitemap_dp_index.xml http://www.amazon.com/sitemap_vendor_videos_us.xml http://www.amazon.com/sitemap_vod_index.xml http://www.amazon.com/sitemap_entity_index.xml.gz http://www.amazon.com/sitemaps.US_detail_page_sitemap_mobile_index.xml.gz http://www.amazon.com/sitemaps.US_detail_page_sitemap_desktop_index.xml.gz Each of those sitemaps is even more compressed and you have to open them. You can use firefox plugin " DownThemAll " to download them faster. Later you have to clean the codes from xml and get clean links to each product. At the end you will have about 65 Gb of text files with links. I guess that you didn't wanted to do it on so big scale ?
What i would like to have is a php that could scrape the reviews of a product/asin from amazon. If you have one, please share Thanks
WP plugin Azon Builder is doing that, you mark what products to scrape, he is scraping pictures, reviews, prices, automatically making links with your aff ID and formatting everything like a post. If you want to make it harder (just for fun and enjoy of learning) you can do something with cUrl ,it is doable to make list with links from where you want reviews, include it in rotating and making it to save scraped html in text file or folder on server.
I've built many Amazon Scrapers that pull information directly from Amazon. I'm not willing to give out my code for free but if you guys are desperate then hit me up and we can work out deal.
some information can be pull directly from Amazon via API. but they have stopped providing the customer reviews. But i found a site that displays it same as in Amazon site. even the "stars", username, location, etc were displayed. will gonna check the WP plugin Azon Builder and see if i can get something from there. Thanks
Number of products scraped depends upon how many proxies you have.. I have created a tool for that. I can make customization in that tool according to your needs..
I got a script from one of the threads here that lets me pull a lot of products from any niche. It only works on magento and can't remember the name of the script but it really works.
HealeyV3, I saw one of your earlier posts about being able to scrape Amazon to get product data. This can be real useful data for marketers. I'd be willing to pay you for the 1.5 mil product records you initially pulled down and possible pay for your code or pay for you to produce new data periodically. Private message me to discuss.
I have my amazon scrapper which I can share if the price is right. Pm me for all those who are interested.
What data elements can you collect from Amazon, heartnet02? Is it the product data like product name, description, brand, price, etc? Also, how much data can your scraper collect?
Same question here. I also need the scraper to update previously scraped data since Amazon change pricing frequently. Awesome if it can spit out in CSV.
I'm looking to buy an Amazon scraper. I'm new to the forum (and SEO), but appears I'm in the right place. Any help will be appreciated.
I have used many, the only good one I have seen is the ZON Asin Hunter. It is my saving grace. Was able to download 800,000 items in 5 days.
