Scrape Tweets??

Real78

Regular Member
Joined
Apr 19, 2012
Messages
367
Reaction score
28
Before anyone says - Do a search, I have done that and more as I posted links at the very bottom of this post explain what I have done. I know I am very close but I am just missing a step somewhere or I am just not doing something correctly.

Ok, I have been trying to figure this out and so far no luck. I am trying to scrape emails from Twitter?s ? ? TWEETS.
If I search google for example; site: Twitter.com KW I can see about 688 pages with emails that are in my niche. How can I extract those emails from their tweets using ScrapeBox?

Example with made up KW


  1. Went to google.com in search typed - site: twitter.com send me a message
Searched for last 24 hours now I copied the url - https://www.google.com/#tbs=qdr:d&sclient=psy-ab&q=site:+twitter.com+send+me+a+message&oq=site:+twitter.com+send+me+a+message&gs_l=serp.3...5276.10960.0.11221.19.18.1.0.0.0.206.2199.0j17j1.18.0...0.0...1c.1.15.psy-ab.IqZSDG2wOJY&pbx=1&bav=on.2,or.r_cp.r_qf.&fp=91cba5dc00bae567&biw=1440&bih=646
I changed the last number 646 to %KW% so it will now look like this
https://www.google.com/#tbs=qdr:d&sclient=psy-ab&q=site:+twitter.com+send+me+a+message&oq=site:+twitter.com+send+me+a+message&gs_l=serp.3...5276.10960.0.11221.19.18.1.0.0.0.206.2199.0j17j1.18.0...0.0...1c.1.15.psy-ab.IqZSDG2wOJY&pbx=1&bav=on.2,or.r_cp.r_qf.&fp=91cba5dc00bae567&biw=1440&bih=%KW%


  1. The next step I took was to generate a file from 1 to 646 which would be the total number of pages I would need to merge that way the google url which would create a 646 URL.


  1. Now my next question is how do I tell scrape box to scrape just the emails or do I need to scrape first then do a link extraction and then grab emails?

P.S. I was able to get this to work about a year ago but did not get good results using these methods. I did follow the video from the first post and even read the second post as well but so far not getting the results I need. The program that was given to me does not return enough emails and I can see more than 600 when I do a Google search.

http://www.blackhatworld.com/blackhat-seo/black-hat-seo/492986-how-scrape-emails-twitter.html
http://www.blackhatworld.com/blackh...che-targeted-email-lists-leads-scrapebox.html
 
there are plenty of tools online which helps you in scrape...
 
Well what can you recommend? I mean I am only using scrapebox because that is what I currently own.
 
I will do a search on that.
 
Does anyone have any solutions?
 
There some bots in the market fit your desire at some percentages but not any that fits 100%
a custom bot for your own maybe the best solution if this project pay back well
check bst, i remember some guys offer that ( but i dont suggest so called templates or scripts using web browser, they are slow, unreliable, not multi-threaded, not proxies support,...)
 
There some bots in the market fit your desire at some percentages but not any that fits 100%
a custom bot for your own maybe the best solution if this project pay back well
check bst, i remember some guys offer that ( but i dont suggest so called templates or scripts using web browser, they are slow, unreliable, not multi-threaded, not proxies support,...)


Thank you for your reply going to check it out.
 
Still looking for a solution as memeber did offer me a Twitter Email Extractor that worked very well but since Twitter changed up a few things it no longer works. So back to square one again and if you have any software that you know will help please tell me.
 
In Scrapebox, site:twitter.com and then add your keywords below. You can use Bing instead of Google - it might get you better results.

You can also use the footprint site:twitter "on twitter"

On the right hand side the 5th box down "Grab/Check" - click on that choose the top result "Grab emails from harvested list" and then choose a user agent and get the emails.

I see Twitter has changed things on some pages - at least the search page but it looks like profiles are still scrapeable by Scrapebox.
 
I don't want to scrape profiles I want to scrape tweets that is where the emails are for my niche. People post them requesting to send them their product. That is why I am trying to scrape the tweets to grab the emails. Thank you for your input as I will give that a try right now to see if I can make it work for what I am doing.
 
In Scrapebox, site:twitter.com and then add your keywords below. You can use Bing instead of Google - it might get you better results.

You can also use the footprint site:twitter "on twitter"

On the right hand side the 5th box down "Grab/Check" - click on that choose the top result "Grab emails from harvested list" and then choose a user agent and get the emails.

I see Twitter has changed things on some pages - at least the search page but it looks like profiles are still scrapeable by Scrapebox.

Just gave that a try with my KW and I was able to grab 155 URLs which I was amazed that it was that low. I started extracting for emails from profiles but that was all I could do. That part I know and understand how to do but extracting from Tweets is what I am trying to get done. So far no luck.
 
Back
Top