1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape Tweets?

Discussion in 'Social Networking Sites' started by wordism, Aug 11, 2011.

  1. wordism

    wordism Junior Member

    Joined:
    Nov 18, 2009
    Messages:
    177
    Likes Received:
    40
    I've been searching for this for a few days. Can anybody recommend a way to scrape tweets other than Tweet Attacks?
     
  2. saifi2649

    saifi2649 Power Member

    Joined:
    Mar 31, 2011
    Messages:
    505
    Likes Received:
    232
    Occupation:
    jobless
    Location:
    in my gf`s heart :D
    ya im also looking for a tool with i can scrape all tweets of a particular user
    is there any tool available for this?
     
  3. suki888

    suki888 Registered Member

    Joined:
    Aug 2, 2011
    Messages:
    71
    Likes Received:
    4
    Me too!!!!! Help!!!!
     
  4. wordism

    wordism Junior Member

    Joined:
    Nov 18, 2009
    Messages:
    177
    Likes Received:
    40
    anybody out there?!
     
  5. escan

    escan Newbie

    Joined:
    Aug 9, 2011
    Messages:
    22
    Likes Received:
    18
    Me Too !!!
     
  6. wordism

    wordism Junior Member

    Joined:
    Nov 18, 2009
    Messages:
    177
    Likes Received:
    40
    I've found a way for the time being...
    1. Go to listoftweets.com
    enter a keyword where it says search tweets and search
    It gives you a 100 tweets, now click copy all as TEXT...and save the next to notepad
    or I like to use Edit Pad Pro

    2. You will know have a 100 tweets but the format will be all messed up with dates, @, etc.
    So what you do is find a program or a site that can delete certain lines that contains phrases you don't like. I found a site called hxxp://textmechanic.com/Remove-Lines-of-Text-Containing.html
    Once you get to this site you basically, paste your text file in the large box and where it says search for lines you're going to enter
    - @
    - http://twitter
    - and lastly whatever date is listed in your tweets for example.. all of the tweets I'm looking to copy now say Sun Aug 14.. so I would just search for lines containing "Sun Aug" or I could do "Aug" if I had various dates in the tweets

    3. Now you're going to have alot of whitespaces. You can delete these easily with Edit pad Pro by going to "Delete All Blank Lines" It's a little more complicated with notepad, as you have to do search and replace I believe. Edit Pad Pro is worth it anyway.. Its $5 but You should be able to find it for free.

    It seems like alot of work but its really a fast process.
     
    • Thanks Thanks x 3
  7. johndea

    johndea Regular Member

    Joined:
    Jun 23, 2011
    Messages:
    308
    Likes Received:
    35
    Install yourTwapperKeeper. It can scrape tweets easily.
    It is free and written in PHP:

    http://code.google.com/p/yourtwapperkeeper/

    It scrapes tweets into the future using the streaming interface and into the past using the search interface.
     
    • Thanks Thanks x 1
  8. wordism

    wordism Junior Member

    Joined:
    Nov 18, 2009
    Messages:
    177
    Likes Received:
    40
    Seems nice but it isn't working for me.. Maybe its because I have a shared server and not a VPS
     
  9. nathanbelomy

    nathanbelomy Newbie

    Joined:
    Aug 9, 2011
    Messages:
    29
    Likes Received:
    1
    Home Page:
    Scrape them for what purpose?
     
  10. risefromdeath

    risefromdeath Power Member

    Joined:
    Jul 1, 2009
    Messages:
    650
    Likes Received:
    107
    IF all you guys are still looking for something and willing to jointly sponsor..I can code a script for all of you to use..
    Thanks
     
  11. hatemachine

    hatemachine Regular Member

    Joined:
    Jan 14, 2011
    Messages:
    271
    Likes Received:
    1,138
    What's the purpose of this exactly?
     
  12. wordism

    wordism Junior Member

    Joined:
    Nov 18, 2009
    Messages:
    177
    Likes Received:
    40
    The purpose of scraping tweets is to have a archive of tweets to use for your multiple twitter accounts(assuming you have more than 10) If you have tons of twitter accounts its impossible to manually type tweets for them all.
     
  13. onlythabst

    onlythabst Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 28, 2010
    Messages:
    633
    Likes Received:
    89
    So you can send the same tweet out of all your accounts?
     
  14. wordism

    wordism Junior Member

    Joined:
    Nov 18, 2009
    Messages:
    177
    Likes Received:
    40
    nah not the same tweet.. you would scrape 1000s of tweets.. so you would divide them amongst the accounts.. To make the accounts seem more like real accounts
     
  15. esprikitik330

    esprikitik330 Newbie

    Joined:
    Feb 1, 2012
    Messages:
    22
    Likes Received:
    0
    hi, how to use this? how to scrape tweets list?
     
  16. rossell123

    rossell123 Registered Member

    Joined:
    Feb 21, 2012
    Messages:
    75
    Likes Received:
    6
    Try Tweet devil

    You can scrape tweets with this :)
     
  17. uniquecontent

    uniquecontent Registered Member

    Joined:
    Aug 7, 2012
    Messages:
    90
    Likes Received:
    8
    Home Page:
    Scrapping of tweets? I also want to know one effective method...
     
  18. kcollier63

    kcollier63 Registered Member

    Joined:
    Nov 23, 2010
    Messages:
    66
    Likes Received:
    28
    Just wanted to give thanks and say that I find this very useful.
     
  19. B_Fish

    B_Fish Regular Member

    Joined:
    Feb 7, 2012
    Messages:
    212
    Likes Received:
    53
    Occupation:
    Student
    Location:
    Indiana, USA
    Home Page:
    I'm able to scrape up to 3,000 at a time from any given account. Or I have a premade list of about 50,000 on fiverr.
     
  20. MrRippley

    MrRippley Newbie

    Joined:
    Apr 11, 2012
    Messages:
    14
    Likes Received:
    0
    great points