25k+ Twitter Tweets [Released]
- Thread starter Skizzymane
- Start date
- Apr 25, 2011
- 19,849
- 28,315
List is good. I took all spaces out so I can throw them all in to tweetadder.
Only thing is some of the tweets are a bit user specific - like some refer to the poster as being a blonde etc - so need to be carefully which ones you post.
Only thing is some of the tweets are a bit user specific - like some refer to the poster as being a blonde etc - so need to be carefully which ones you post.
machineterminator
Newbie
- Aug 9, 2012
- 9
- 0
gud information thanks 
esprikitik330
Newbie
- Feb 1, 2012
- 22
- 0
tHANKS FOR SHARING..
HoNeYBiRD
Elite Member
- May 1, 2009
- 10,187
- 12,580
this?
- Apr 25, 2011
- 19,849
- 28,315
I'll upload my raw list later.
esprikitik330
Newbie
- Feb 1, 2012
- 22
- 0
25k? mention it.. it almost 2500 tweets list. anyway thanks! how can you scrape this tweets?please help. thanks.
- Apr 25, 2011
- 19,849
- 28,315
This is my list created from the original upload, its a flat text file with only 1 tweet per line.
http://www.mediafire.com/view/?wefj6061yhw5co5
Virus Total:
https://www.virustotal.com/file/f3b...fb0e2b55b0325fd7466582bb/analysis/1345479850/
http://www.mediafire.com/view/?wefj6061yhw5co5
Virus Total:
https://www.virustotal.com/file/f3b...fb0e2b55b0325fd7466582bb/analysis/1345479850/
abs007
Junior Member
- May 16, 2010
- 195
- 85
5 years on and still relevant - Thanks given (y)
Downloaded and cleaned the list (got about 2500~ unique tweets after cleaning)
I loaded them into our software.. Most are under 140 charecters but the odd few are slightly over
I did notice some of the tweets were using adult orientated language (praying they wont be an issue with my accounts)
Great share
Downloaded and cleaned the list (got about 2500~ unique tweets after cleaning)
I loaded them into our software.. Most are under 140 charecters but the odd few are slightly over
I did notice some of the tweets were using adult orientated language (praying they wont be an issue with my accounts)
Great share
HoNeYBiRD
Elite Member
- May 1, 2009
- 10,187
- 12,580
You can remove the longer than 140 chars lines easily in Notepad++:
Open the file in Notepad++
Hit Ctrl+H, this will bring up the Replace window
Make sure that the "Regular expression" radio button under "Search mode" is selected
Find what: .{140}.+(\r?\n|\n|$)
Replace with: (empty)
Hit "Replace All"
Or another way: https://stackoverflow.com/posts/20777071/revisions
Last edited:
Cato Minor
Junior Member
- Nov 1, 2016
- 194
- 123
Can you tell me what software did you use to clean the list?
abs007
Junior Member
- May 16, 2010
- 195
- 85
same as the poster above you - I used notepadd++ and regex
I first reduced the font size as low as I could in word so to try and get all quotes to fit on a single line -
i then copy pasted them into notepad++
I then ran the following regex
.+#.+
this removed all the stuff like
Crazy #650085
I then ran the following regex
\n\r
to remove all blank lines
I didnt run the regex noted by the user above you though - would be a good idea to make sure you get your chareceters under 140 charecters
HoNeYBiRD
Elite Member
- May 1, 2009
- 10,187
- 12,580
Notepad++ with the TextFX plugin should do the automatic cleaning part: e.g. remove duplicate lines. Replace using regex to remove lines longer than 140 chars or remove lines which contain urls. If you know your way around regex a bit, these are all easy to do or you can just google it, you'll find the regex codes on stackoverflow most of the time.