1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

NEW Tumblr Scraping Method

Discussion in 'Social Networking Sites' started by x5050, Nov 11, 2013.

  1. x5050

    x5050 Junior Member

    Joined:
    Mar 15, 2011
    Messages:
    108
    Likes Received:
    70
    There hasn't been a good/easy/free way to scrape Tumblr for a little while now (at least not that I've been able to find). Although this isn't a bot, it takes about 30 seconds of your time to scrape ~1000 tumblr URLs.

    THINGS YOU NEED
    Mozilla Firefox
    Link Gopher (Firefox Add-On)
    Notepad++

    1. Go to Tumblr (it looks new now) and search for a term you want to scrape users for. Using the END key on the keyboard, scroll through the Tumblr posts in your tag until you reach the VERY end of the list. Tumblr will scroll "infinitely" until about 1000 recent posts.
    2. With Link Gopher installed, in Firefox go to View->Toolbars->Addons
    3. In the bottom right corner of Firefox, you'll see Link Gopher.
    4. While on the tumblr tag page, right click on Link Gopher (where it says "Links"), and choose "extract all links."
    5. A new window will pop up. Scroll down towards the bottom of the page where the subsection "Domains" is listed. (The full list is divided into bold sections titled LINKS and DOMAINS)
    6. Copy and paste all of the domain URLs into Notepad++ and remove the duplicates!

    Ta da! Now you have a scraped Tumblr user list.

    If anyone knows how to turn this process into an iMacro, it would be greatly appreciated.
     
    • Thanks Thanks x 4
  2. W9go

    W9go Jr. VIP Jr. VIP Premium Member

    Joined:
    May 16, 2011
    Messages:
    3,410
    Likes Received:
    637
    Gender:
    Male
    Occupation:
    chasing girls
    Location:
    chasing girls
    i would look for a pic downloaded from tumblr .... not only the urls ... but nice share
     
  3. tompots

    tompots Elite Member Premium Member

    Joined:
    Dec 11, 2011
    Messages:
    4,352
    Likes Received:
    3,955
    Gender:
    Male
    Occupation:
    Full Time Bot Developer
    Location:
    Professional Botters
    Home Page:
  4. atosz33

    atosz33 Junior Member

    Joined:
    Jun 2, 2012
    Messages:
    107
    Likes Received:
    52
    Location:
    Hungary, Eger
    Home Page:
    Do you want to follow these users or what? Because I can give you iMacros macro, which follow users, and user list don't necessary. It follows people (you can change how many of them) and it follows people by niche (follows people on one page like: http://tumblr.com/tagged/health)
     
  5. x5050

    x5050 Junior Member

    Joined:
    Mar 15, 2011
    Messages:
    108
    Likes Received:
    70
    I use this to scrape users because in my niche, I sent private messages using proxies to these URLs to encourage them to check out my products.

    And to download pictures, you can use Downthemall (another firefox addon) that will download pictures and URLs.
     
  6. The Mentalist

    The Mentalist Power Member

    Joined:
    May 8, 2013
    Messages:
    737
    Likes Received:
    267
    Location:
    Inside your head
    For the cheap price, if you're constantly scraping, just get PRHarvester.
     
  7. srinu0812

    srinu0812 Supreme Member

    Joined:
    Nov 1, 2012
    Messages:
    1,311
    Likes Received:
    755
    Interesting! Will try and report back.
     
  8. sxephil

    sxephil Newbie

    Joined:
    May 14, 2013
    Messages:
    15
    Likes Received:
    3
    hey, can I get that script. I really want to follow people on tumblr in an automated way
     
  9. leapyourbar

    leapyourbar Newbie

    Joined:
    Jul 6, 2013
    Messages:
    23
    Likes Received:
    2
    Oh man, I've been waiting for this.