1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Any tools for scraping this data from Amazon?

Discussion in 'BlackHat Lounge' started by mistablackhat00, Mar 28, 2012.

  1. mistablackhat00

    mistablackhat00 Jr. VIP Jr. VIP Premium Member

    Joined:
    May 4, 2009
    Messages:
    308
    Likes Received:
    135
    I need a tool that can harvest data from the upcoming CD releases section on Amazon. There's about 1500 products for every week in that section and every week I'd like to be able to download a list that has just the title of the album and the name of the artist/band.

    Is there and existing tool that can do this?

    I posted on a freelance site and they want $100+ to make a tool like this for me, which seems really high to me.
     
  2. mistablackhat00

    mistablackhat00 Jr. VIP Jr. VIP Premium Member

    Joined:
    May 4, 2009
    Messages:
    308
    Likes Received:
    135
    Anyone know of anything?
     
  3. andee

    andee Regular Member

    Joined:
    Jul 24, 2010
    Messages:
    218
    Likes Received:
    83
    sounds pretty simple.

    Imacros could easily do this, pretty simple to learn how to use it as well....

    that or im sure you can find a coder on here for 50 bucks or so
     
    • Thanks Thanks x 1
  4. pasenseoso

    pasenseoso Power Member

    Joined:
    Aug 19, 2011
    Messages:
    754
    Likes Received:
    136
    Occupation:
    hachetman
    Location:
    - - P I L I P I N A S - -
    Home Page:
    i think i saw an offer at warrior forum about a WP plugin that automatically looks for items at amazon and displays it in your blog/site. It also has filters. It was sold over $20 initially. I thought it was expensive..
     
  5. ibmblackedition

    ibmblackedition Newbie

    Joined:
    Mar 6, 2010
    Messages:
    34
    Likes Received:
    1
    WPRobot can do that as far as I know
     
  6. TZ2011

    TZ2011 Senior Member

    Joined:
    Jun 26, 2011
    Messages:
    832
    Likes Received:
    864
    Occupation:
    Cleaning servers
    You can try with Amazon rss feeds. If youu have a wp site, there is a plugin RSS Aggregator, feeds for music are
    Code:
    http://www.amazon.com/gp/rss/new-releases/dmusic/digital-music-album
    http://www.amazon.com/gp/rss/new-releases/dmusic/digital-music-track
    http://www.amazon.com/gp/rss/new-releases/dmusic
    http://www.amazon.com/gp/rss/new-releases/movies-tv/2958933011
    http://www.amazon.com/gp/rss/new-releases/movies-tv/2958935011
    http://www.amazon.com/gp/rss/new-releases/movies-tv/2958934011
    http://www.amazon.com/gp/rss/new-releases/movies-tv
    http://www.amazon.com/gp/rss/new-releases/music/30
    http://www.amazon.com/gp/rss/new-releases/music/31
    http://www.amazon.com/gp/rss/new-releases/music/291920
    http://www.amazon.com/gp/rss/new-releases/music/265640
    http://www.amazon.com/gp/rss/new-releases/music/173425
    http://www.amazon.com/gp/rss/new-releases/music/173429
    http://www.amazon.com/gp/rss/new-releases/music/67204
    http://www.amazon.com/gp/rss/new-releases/music/85
    http://www.amazon.com/gp/rss/new-releases/music/16
    http://www.amazon.com/gp/rss/new-releases/music/7
    http://www.amazon.com/gp/rss/new-releases/music/32
    http://www.amazon.com/gp/rss/new-releases/music/2231705011
    http://www.amazon.com/gp/rss/new-releases/music/67207
    http://www.amazon.com/gp/rss/new-releases/music/701208
    http://www.amazon.com/gp/rss/new-releases/music/266023
    http://www.amazon.com/gp/rss/new-releases/music/34
    http://www.amazon.com/gp/rss/new-releases/music/289122
    http://www.amazon.com/gp/rss/new-releases/music/35
    http://www.amazon.com/gp/rss/new-releases/music/13650871
    http://www.amazon.com/gp/rss/new-releases/music/36
    http://www.amazon.com/gp/rss/new-releases/music/84
    http://www.amazon.com/gp/rss/new-releases/music/37
    http://www.amazon.com/gp/rss/new-releases/music/39
    http://www.amazon.com/gp/rss/new-releases/music/38
    http://www.amazon.com/gp/rss/new-releases/music/40
    http://www.amazon.com/gp/rss/new-releases/music/42
    http://www.amazon.com/gp/rss/new-releases/music/33
    http://www.amazon.com/gp/rss/new-releases/music
    input them all and you will always have updated list of music releases.
     
  7. mistablackhat00

    mistablackhat00 Jr. VIP Jr. VIP Premium Member

    Joined:
    May 4, 2009
    Messages:
    308
    Likes Received:
    135
    Yeah, I need to be able to have the huge list in a CSV file with the artist in one column and the album title in the other, don't need it on a blog or anything like that.

    Anyone know of anything already existing or do I need this coded?
     
  8. captchadreams

    captchadreams Power Member

    Joined:
    Sep 19, 2008
    Messages:
    504
    Likes Received:
    131
    If you can't find anyone else that can do this for you.. I think I would be able to do it via mIRC.. I've made a bunch of data mining scripts for other sites using mIRC.

    if you can't find what you're looking for anywhere else.. I would be willing to do it for 50$

    I'd need to take a look at the actual page you need the data pulled from before I could commit to doing it.. but I'm about 90% sure I can do it.

    just PM me later if interested.
     
  9. spunkz

    spunkz Newbie

    Joined:
    Nov 27, 2009
    Messages:
    30
    Likes Received:
    10
    Interesting question. Please let me know if you find such plugin. I was looking for one that would scrap the AISN and image link. I bought a wordpress plugin for $40 bucks, and it's crap.
     
  10. clyde

    clyde Elite Member

    Joined:
    Dec 5, 2009
    Messages:
    1,991
    Likes Received:
    1,131
    uBot can do it but $100+ sounds about right for a custom bot.
     
  11. TZ2011

    TZ2011 Senior Member

    Joined:
    Jun 26, 2011
    Messages:
    832
    Likes Received:
    864
    Occupation:
    Cleaning servers
    I found it. You need Azon Top 100 Analyzer. Its part of AmaSuite, you can register here (no need for real email)
    Code:
    [B][B]http://www.amasuite.com/members/signup25468.php[/B][/B]
    to download Azon-Top100-Analyzer-Setup.zip and register it with
    Code:
    [B][B]AMA1234[/B][/B]
    You can scrape first 100 places for each category, options are Best Sellers, Top Rated, Hot New Releases, Movers and Shakers, Most Gifted, Most Wished for. You can download very nice formatted data and save it in csv.

    I re-read your first post, option for upcoming CD releases is not included but anyway maybe somebody find this soft useful. For me is extremely good, saving time.
     
    Last edited: Apr 2, 2012
  12. jezhead

    jezhead Newbie

    Joined:
    Mar 5, 2010
    Messages:
    20
    Likes Received:
    4
    Did you ever find such a tool?