1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How To Scrape Twitter Users Followers

Discussion in 'Twitter' started by Empire007, Nov 10, 2014.

  1. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    I need to scrape usernames of someone how has over 200k Followers. Does anyone know a software that could do this very fast. any help, would be appreciated.
     
  2. Pwnageboy

    Pwnageboy Regular Member

    Joined:
    Nov 9, 2014
    Messages:
    200
    Likes Received:
    53
    Location:
    The Netherlands
    Give me a minute.

    I'll try to create a tool for you.
     
    • Thanks Thanks x 1
  3. Shimoli

    Shimoli Junior Member

    Joined:
    Mar 2, 2014
    Messages:
    118
    Likes Received:
    14
    I have not seen that
     
  4. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    Cool, thanks alot if you can.

    I need it to be able to scrape the usernames of over 200k Followers in an account and save in TXT format line by line thou. That would be great. thanks
     
    Last edited: Nov 10, 2014
  5. Pwnageboy

    Pwnageboy Regular Member

    Joined:
    Nov 9, 2014
    Messages:
    200
    Likes Received:
    53
    Location:
    The Netherlands
    I want to ask a question but because my account is new somehow it get blocked.. Do you only need username or more?
     
  6. ItsBlinkHere

    ItsBlinkHere Regular Member

    Joined:
    Apr 27, 2014
    Messages:
    409
    Likes Received:
    150
    Location:
    At Large
    • Thanks Thanks x 1
  7. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    Just usernames.

    I have bots already, and wont like to stress you alot. I just need it to get all usernames of the followers of an account.
     
    Last edited: Nov 10, 2014
  8. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    just tested it on my bot, and its showing error. its using the no. as usernames and not i.d so i cant follow or make use of them. My bot wont accept that. But the speed you talked about it awesome 5k per minute. thanks for letting me know
     
    • Thanks Thanks x 1
  9. XxUnivaxX

    XxUnivaxX Jr. VIP Jr. VIP

    Joined:
    Jan 15, 2013
    Messages:
    2,066
    Likes Received:
    896
    Gender:
    Male
    Location:
    Basement
    NO bot can do that thing fast for you. Unless you plan to use proxies.
    as Twitter is not tracking down the request and its stopping to make further requests, so you need to slow down

    I dont have a custom bot its a paid one and developer have added a 15 minute delay time after a specified amount of followers
    But I am getting complete list download in 3-4 hours
     
  10. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    Is it FL?

    I tried FL, and scraped 100k Users in 6 hours. with one account no proxy. But it stopped when my internet connection cut off.

    Couldn't continue cos it either wanted to start again. or i wasn't able to send request to twitter anymore. i think it's the later thou

     
    Last edited: Nov 10, 2014
  11. avalon1981

    avalon1981 Regular Member

    Joined:
    Dec 6, 2013
    Messages:
    412
    Likes Received:
    58
    Occupation:
    Twidium Team
    You can use our Twidium apps to do this. Try it for free with trial versions: http://www.twidiumapp.com/index.shtml
     
    • Thanks Thanks x 1
  12. XxUnivaxX

    XxUnivaxX Jr. VIP Jr. VIP

    Joined:
    Jan 15, 2013
    Messages:
    2,066
    Likes Received:
    896
    Gender:
    Male
    Location:
    Basement
    Its not FL its TwtDom, But if you internet connection gets cutoff then in that case my software also wont work.
    as all the request are put to DUMP.
     
    • Thanks Thanks x 1
  13. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    twitter didn't do it. its cut off cos my laptop hibernate
     
  14. XxUnivaxX

    XxUnivaxX Jr. VIP Jr. VIP

    Joined:
    Jan 15, 2013
    Messages:
    2,066
    Likes Received:
    896
    Gender:
    Male
    Location:
    Basement
    If you are the owner of Twidium, Why are the Follow/Unfollow and Tweet/Retweet/Replies are kept in 2 different software.

    I wont be picking them differently usually.

    Didnt get what was your actual motto behind it..
     
  15. XxUnivaxX

    XxUnivaxX Jr. VIP Jr. VIP

    Joined:
    Jan 15, 2013
    Messages:
    2,066
    Likes Received:
    896
    Gender:
    Male
    Location:
    Basement
    Lol then dont put your software in Hibernate but 100k in 6 hours I will check the speed of mine and update you..
     
    • Thanks Thanks x 1
  16. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    712
    Likes Received:
    267
    Location:
    PHP Scripting ;)
    Twitter api is the way to do this. You wont get your account blocked or something. Also you can bypass the rate limiting by using multiple single signin api keys.

    if nothing works hit me up. I have done similar stuffs before. But make sure you try other exisiting softwares ad see if you can get it done.
     
    • Thanks Thanks x 1
  17. Pwnageboy

    Pwnageboy Regular Member

    Joined:
    Nov 9, 2014
    Messages:
    200
    Likes Received:
    53
    Location:
    The Netherlands
    I am actually testing my program right now for 6K+ followers. If this test is a succes ill give you the program. It's a very simple program that will create a internet explorer window, scroll to the bottom of all followers ( which indeed takes ages because it has to scroll to the bottom of 200K followers....... ) Than extracts all the usernames.

    I am really curious if my program will work because damn.. 200K is a lot.. Will let you know if my program can handle it.
     
    • Thanks Thanks x 1
  18. Empire007

    Empire007 Regular Member

    Joined:
    Jul 22, 2012
    Messages:
    426
    Likes Received:
    67
    Oh, thanks. would be waiting for the result

     
  19. prequalizer

    prequalizer Registered Member

    Joined:
    Jun 4, 2014
    Messages:
    54
    Likes Received:
    10
    Currently getting 12K scraped followers per hour in Follow Liker
     
  20. lostgringos

    lostgringos Senior Member

    Joined:
    Dec 5, 2008
    Messages:
    837
    Likes Received:
    266
    Occupation:
    Online Reputation Manager
    Location:
    Dumaguete City, Philippines
    I just downloaded over 800,00 but can't find the folder they are in. Or, maybe I have to export them to a folder. I can't figure it out. Also, what I wanted to do is clean these up a little before launching them into FL. I guess I will ahave to do this manually? 1,000 a day for a few months and maybe around 2,000 a day. I already bought a few thousand followers to help me get started.

    If any of you know how exploit the download feature in FL please pm me.

    Thanks,
    Frank
    a