1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrape Twitter followers

Discussion in 'Social Networking Sites' started by Bamboo1, Dec 5, 2010.

  1. Bamboo1

    Bamboo1 Junior Member

    Joined:
    Oct 12, 2009
    Messages:
    163
    Likes Received:
    34
    Anyone know an efficent and fast way to scrape IDs of Twitter followers from a followers page, and save it to txt file? You know, like popular facebook bots like Facebook Blaster, and Friend adder do. I know it's basics but Twitter Blaster Pro doesn't seem to be working for me.


    Thanks! It's kind of urgent...

    (Is there a script perhaps?)
     
  2. erroronline14

    erroronline14 Regular Member

    Joined:
    Oct 16, 2009
    Messages:
    321
    Likes Received:
    922
    TweetAttacks can do that, its in the BST section
    Code:
    http://www.blackhatworld.com/blackhat-seo/buy-sell-trade/175533-tweet-attacks-ultimate-twitter-marketing-software.html
     
    • Thanks Thanks x 1
  3. hokuspokus

    hokuspokus Regular Member

    Joined:
    Aug 24, 2009
    Messages:
    211
    Likes Received:
    95
    i own tweep from
    Code:
    atomictwitter.com
    if you dont want to purchase i can help you scrape, depends on how much you need though ;)
     
    • Thanks Thanks x 1
  4. HoNeYBiRD

    HoNeYBiRD Jr. VIP Jr. VIP

    Joined:
    May 1, 2009
    Messages:
    5,904
    Likes Received:
    7,139
    Gender:
    Male
    Occupation:
    Geographer, Tourism Manager
    Location:
    Ghosted
    Code:
    http://friendorfollow.com/
    it lets you save the list of followings, fans (=followers you don't follow) and friends (=followers you follow) of any account (not just yours, any existing twitter handle) as a .csv file
    you need to clean the list (with a tool like notepad++) to be left with the handles only

    1. type the twitter handle of your choice
    2. wait a bit until the site loads the lists (meanwhile enjoy the bunny petting pic lol)
    3. select a list (followings/fans/friends)
    4. hit 'Export CSV'
    5. clean the list
     
    • Thanks Thanks x 4
  5. Aristide

    Aristide Newbie

    Joined:
    Dec 5, 2010
    Messages:
    14
    Likes Received:
    3
    Location:
    italy
    you can user a small java script with twitter4j java api. it's limited to 150 calls/hour without authentication and 350 calls/hour with authentication.

    an example of the code to print user followers:

    Code:
    import java.util.List;
    
    import twitter4j.PagableResponseList;
    import twitter4j.Twitter;
    import twitter4j.TwitterFactory;
    import twitter4j.User;
    
    public class PrintFollowers {
    
        public static void main(String[] args) throws Exception {
            Twitter twitter = new TwitterFactory().getInstance();
            User userToFollow = twitter.showUser("BarackObama");
            getFollowers(twitter, userToFollow.getId());
        }
    
        public static void getFollowers(Twitter twitter, int userid) throws Exception {
            PagableResponseList<User> tmp = twitter.getFollowersStatuses(userid);
            printFollowers(tmp);
            while (tmp.getNextCursor() > 0) {
                tmp = twitter.getFollowersStatuses(userid, tmp.getNextCursor());
                printFollowers(tmp);
            }
        }
        
        public static void printFollowers(List<User> list) {
            for (User user : list)
                System.out.println(user.getId()+"|"+user.getScreenName()+"|"+user.getName()+"|"+user.getFriendsCount()+"|"+user.getFollowersCount());
        }
    
    
    }
    
    
    the result

    Code:
    198168413|jaoceara|João Pedro|60|24
    199407936|NasaPromoTeam|Nasa|6847|7841
    224853113|Dira_chantique|Dira lawalatta|5|0
    133496420|AuntieMEK|M K|2|1
    225625821|imanii08|Lois|17|2
    225196811|ogargalhada|O Gargagalhada|144|446
    ...
    .....
    
     
  6. soho1

    soho1 Newbie

    Joined:
    Dec 31, 2010
    Messages:
    4
    Likes Received:
    0
    Occupation:
    finding a job
    Location:
    Chicago, IL
    I have a similar but different need. I just want a list of #hashtags.

    Personally, I don't really even want to do the scraping, just a the results. Sounds like a lot of programming to learn. Is there no place to just download a reasonably complete list of hashtags? No, I don't want the "most popular" stuff that other people are publishing.
     
  7. malrook

    malrook Newbie

    Joined:
    Jan 5, 2011
    Messages:
    4
    Likes Received:
    0
    These method's seem good I'll try some and if they pan out I'll state how it went.
     
  8. shehzada4

    shehzada4 Regular Member

    Joined:
    Sep 12, 2010
    Messages:
    228
    Likes Received:
    173
    You Can use Twitter spider to find and record all friends
    and/or followers for each username on a list of Twitter usernames
     
  9. rogerebert

    rogerebert Registered Member

    Joined:
    Feb 11, 2010
    Messages:
    78
    Likes Received:
    14
    I am still looking for a bookmarklet or simple java script that can just pull twitter IDs from a webpage. I have several for email addresses, links, etc, but nothing specifically for twitter.
     
  10. BlackHatRockstar

    BlackHatRockstar Registered Member

    Joined:
    Feb 12, 2010
    Messages:
    66
    Likes Received:
    8
    erroronline14, how can I export the followers or the following of a certain account in TA?
     
  11. Indiigo007

    Indiigo007 Junior Member

    Joined:
    Nov 11, 2009
    Messages:
    189
    Likes Received:
    191
    Location:
    Los Angeles
    Yeah, I'd also like to know how to export from TA. Anyone know?

    I have a winautomation bot I programmed, but Twitter locks out the API if it tries to scrape too big of a following. However, it should work to scrape a user's followers if under 10,000. If you have winautomation and Twitter plugin, I have uploaded the Job for you to use: sendspace[DOT]com/file/oebg4b
     
  12. Rmiller

    Rmiller Regular Member

    Joined:
    Oct 1, 2011
    Messages:
    216
    Likes Received:
    115
    Occupation:
    Seo Expert
    Location:
    ON GLOBE
    Home Page:
    Thanks for sharing. Now twitter can be utilized to the best!!
     
  13. Capitalmind

    Capitalmind Newbie

    Joined:
    Apr 25, 2012
    Messages:
    3
    Likes Received:
    0
    Is Tweet Attacks no longer available? All the images are down and the posts seem old. I need the same functionality to scrape, mass follow/unfollow, DM. Any tips appreciated.
     
  14. Zuckerberg

    Zuckerberg Regular Member

    Joined:
    Apr 25, 2012
    Messages:
    270
    Likes Received:
    78
    Location:
    Facebook
    Tweet attacks is being sued by twitter.
     
    • Thanks Thanks x 1
  15. Capitalmind

    Capitalmind Newbie

    Joined:
    Apr 25, 2012
    Messages:
    3
    Likes Received:
    0
    Oh! Thanks for the heads up..