1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Amazon Scraper ???

Discussion in 'Black Hat SEO Tools' started by cro-mag, Jun 11, 2012.

  1. cro-mag

    cro-mag Power Member

    Joined:
    Nov 23, 2010
    Messages:
    544
    Likes Received:
    349
    is there any other amazon scraper who could scrape more than 4k product from amazon??? I am tired of the 4k limit of OPF (optimal product finder)
     
  2. Mr.VCC

    Mr.VCC BANNED BANNED

    Joined:
    Jun 6, 2012
    Messages:
    18
    Likes Received:
    6
    pm me with your skype, i can make a bot for you
     
  3. gash73

    gash73 Newbie

    Joined:
    Feb 19, 2012
    Messages:
    4
    Likes Received:
    1
    any success finding a scraper...I tried to pm you but I don't have enough posts to do so...
     
  4. gash73

    gash73 Newbie

    Joined:
    Feb 19, 2012
    Messages:
    4
    Likes Received:
    1
    does anyone have a copy of optimal product finder and does it still work? If not, any alternatives. Any help appreaciated.
     
  5. infierno76

    infierno76 Newbie

    Joined:
    Oct 11, 2012
    Messages:
    9
    Likes Received:
    0
    There is a site called WPAmanuke, that has a javascript you can run in your browser (you just set it up as a bookmark). Basically, you go to Amazon, search for a given type of product, then run the script and it will pull all the ASIN numbers off the items listed on that page. The only catch is you have to do this one page at a time.

    Just out of curiosity, why not just pull the products in through browse nodes, that's much simpler than gathering individual ASIN numbers?
     
  6. TZ2011

    TZ2011 Senior Member

    Joined:
    Jun 26, 2011
    Messages:
    832
    Likes Received:
    863
    Occupation:
    Cleaning servers
    You can scrape all links.
    Attack sitemaps. I will give you few links just like example how that looks and to understand how much data is there.

    Code:
    http://www.amazon.com/sitemap-manual-index.xml
    http://www.amazon.com/sitemap_dp_index.xml
    http://www.amazon.com/sitemap_vendor_videos_us.xml
    http://www.amazon.com/sitemap_vod_index.xml
    http://www.amazon.com/sitemap_entity_index.xml.gz
    http://www.amazon.com/sitemaps.US_detail_page_sitemap_mobile_index.xml.gz
    http://www.amazon.com/sitemaps.US_detail_page_sitemap_desktop_index.xml.gz
    Each of those sitemaps is even more compressed and you have to open them. You can use firefox plugin " DownThemAll " to download them faster. Later you have to clean the codes from xml and get clean links to each product. At the end you will have about 65 Gb of text files with links. I guess that you didn't wanted to do it on so big scale ?
     
  7. ScrapeboxWorker

    ScrapeboxWorker Regular Member

    Joined:
    Jul 23, 2012
    Messages:
    465
    Likes Received:
    266
    Home Page:
    If you are using wordpress try WP ROBOT its nulled somewhere
     
  8. usong725

    usong725 Regular Member

    Joined:
    Nov 7, 2011
    Messages:
    233
    Likes Received:
    35
    Location:
    Philippines
    Home Page:
    What i would like to have is a php that could scrape the reviews of a product/asin from amazon. If you have one, please share :)

    Thanks
     
  9. TZ2011

    TZ2011 Senior Member

    Joined:
    Jun 26, 2011
    Messages:
    832
    Likes Received:
    863
    Occupation:
    Cleaning servers
    WP plugin Azon Builder is doing that, you mark what products to scrape, he is scraping pictures, reviews, prices, automatically making links with your aff ID and formatting everything like a post.

    If you want to make it harder (just for fun and enjoy of learning) you can do something with cUrl ,it is doable to make list with links from where you want reviews, include it in rotating and making it to save scraped html in text file or folder on server.
     
  10. HealeyV3

    HealeyV3 Power Member

    Joined:
    Mar 4, 2009
    Messages:
    521
    Likes Received:
    344
    I've built many Amazon Scrapers that pull information directly from Amazon.

    I'm not willing to give out my code for free but if you guys are desperate then hit me up and we can work out deal.
     
  11. usong725

    usong725 Regular Member

    Joined:
    Nov 7, 2011
    Messages:
    233
    Likes Received:
    35
    Location:
    Philippines
    Home Page:
    some information can be pull directly from Amazon via API. but they have stopped providing the customer reviews. But i found a site that displays it same as in Amazon site. even the "stars", username, location, etc were displayed.

    will gonna check the WP plugin Azon Builder and see if i can get something from there.

    Thanks
     
    • Thanks Thanks x 1
  12. Mission Ashwamedh

    Mission Ashwamedh Junior Member

    Joined:
    Jul 4, 2012
    Messages:
    187
    Likes Received:
    118
    Occupation:
    Software Development and Internet Marketing
    Number of products scraped depends upon how many proxies you have..
    I have created a tool for that. I can make customization in that tool according to your needs..
     
  13. heartnet02

    heartnet02 Power Member

    Joined:
    Aug 27, 2012
    Messages:
    533
    Likes Received:
    95
    Home Page:
    I got a script from one of the threads here that lets me pull a lot of products from any niche. It only works on magento and can't remember the name of the script but it really works.
     
  14. amedia

    amedia Newbie

    Joined:
    Dec 4, 2012
    Messages:
    2
    Likes Received:
    0
    HealeyV3, I saw one of your earlier posts about being able to scrape Amazon to get product data. This can be real useful data for marketers. I'd be willing to pay you for the 1.5 mil product records you initially pulled down and possible pay for your code or pay for you to produce new data periodically. Private message me to discuss.
     
  15. heartnet02

    heartnet02 Power Member

    Joined:
    Aug 27, 2012
    Messages:
    533
    Likes Received:
    95
    Home Page:
    I have my amazon scrapper which I can share if the price is right. Pm me for all those who are interested.
     
  16. mvs2787

    mvs2787 Newbie

    Joined:
    Dec 4, 2012
    Messages:
    3
    Likes Received:
    0
    Occupation:
    Seo and Link buildings.
    Location:
    Bharatpur, Rajasthan, India.
    yes tell me what's you need
     
  17. amedia

    amedia Newbie

    Joined:
    Dec 4, 2012
    Messages:
    2
    Likes Received:
    0
    What data elements can you collect from Amazon, heartnet02? Is it the product data like product name, description, brand, price, etc? Also, how much data can your scraper collect?
     
  18. lokdster

    lokdster Newbie

    Joined:
    Jul 31, 2013
    Messages:
    12
    Likes Received:
    0
    Same question here. I also need the scraper to update previously scraped data since Amazon change pricing frequently. Awesome if it can spit out in CSV.
     
  19. dantrasy

    dantrasy Newbie

    Joined:
    Apr 3, 2014
    Messages:
    1
    Likes Received:
    0
    I'm looking to buy an Amazon scraper. I'm new to the forum (and SEO), but appears I'm in the right place. Any help will be appreciated.
     
  20. mmarek

    mmarek Newbie

    Joined:
    Apr 9, 2014
    Messages:
    25
    Likes Received:
    17
    I have used many, the only good one I have seen is the ZON Asin Hunter. It is my saving grace. Was able to download 800,000 items in 5 days.