seoblade
Newbie
- Dec 13, 2011
- 25
- 3
wtf are you doing to do with a bunch of twitter uid's?
[GET] Mass Twitter ID Scraper
- Thread starter ItsBlinkHere
- Start date
wtf are you doing to do with a bunch of twitter uid's?
HoNeYBiRD
Elite Member
- May 1, 2009
- 10,187
- 12,580
Try to open the file with a different text editor. If you tried the built-in Win Notepad, try it with Notepad++ or vice versa. Those two treats line breaks differently sometimes.
If it doesn't help, figure out if all IDs are the same length or no. If yes, you can split the lines after every nth character with Notepad++ using regex, so you'll have one ID per line.
Chicilikit
Supreme Member
- Dec 21, 2010
- 1,298
- 401
Hello is this still working? I have java 8 installed, but just cannot make it run on my WIN7 64.
andrew1978
Regular Member
- May 13, 2012
- 440
- 32
bottomline, is this working? so many posts and just want to know if anyone actually is using this or has a twitter bot that will find people follower people
HoNeYBiRD
Elite Member
- May 1, 2009
- 10,187
- 12,580
Yes, it's still working. You need to have Java installed on your machine. Furthermore you'll need to create a Twitter application within your own account (PVA is needed to be able to do that), so you'll have the 4 codes the tool is asking for. After that you can use it for scraping anyone's followers, it scrapes around 50k user ids per 10 minutes.
Chicilikit
Supreme Member
- Dec 21, 2010
- 1,298
- 401
I ended up creating my own scraper that scrapes usernames instead of IDs, somehow never managed to make this work.
jamespeterson
Registered Member
- Mar 29, 2018
- 85
- 20
Can i ask for your tool?
laur.laurix
Elite Member
- May 8, 2013
- 2,063
- 1,871
plugmaster
Power Member
- Mar 2, 2013
- 633
- 119
it scraped so fast... when i blinked they were there LOL! tested and working! 4/15/2018
How did you get the username from id? I didnt find a solution for that with our http based of browser based scraping. Is twitter allows it?
Chicilikit
Supreme Member
- Dec 21, 2010
- 1,298
- 401
it worked through their API.
Can you give the reference, when I tried I am getting the name on the account not the actual username which is in the profile url. Thanks
Chicilikit
Supreme Member
- Dec 21, 2010
- 1,298
- 401
This is the code I used, but I have not tested it for few years now so I have no idea if it still works, probably not.
Code:
#! /usr/bin/env ruby
require 'rubygems'
require 'csv'
require 'twitter'
@client = Twitter::REST::Client.new do |config|
config.consumer_key = ""
config.consumer_secret = ""
config.access_token = ""
config.access_token_secret = ""
end
def fetch_all_followers(twitter_username)
fname = "#{twitter_username}_friends_list.txt"
@client.follower_ids(twitter_username)
.each_slice(5000)
.with_index do |slice, i|
@client.users(slice)
.each_with_index do |f, j|
File.open(fname, "a+") do |file|
file.write [i * 5000 + j + 1, f.screen_name, "\n"].join(',')
sleep 0.08
end
end
end
end
usernames = %w{
cryptocurrency
}
usernames.each { |username| fetch_all_followers(username) }I will check it by tomorrow and let you know.
Did it work?