1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape Tweets??

Discussion in 'Black Hat SEO' started by Real78, May 31, 2013.

  1. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Before anyone says - Do a search, I have done that and more as I posted links at the very bottom of this post explain what I have done. I know I am very close but I am just missing a step somewhere or I am just not doing something correctly.

    Ok, I have been trying to figure this out and so far no luck. I am trying to scrape emails from Twitter?s ? ? TWEETS.
    If I search google for example; site: Twitter.com KW I can see about 688 pages with emails that are in my niche. How can I extract those emails from their tweets using ScrapeBox?

    Example with made up KW


    1. Went to google.com in search typed - site: twitter.com send me a message
    Searched for last 24 hours now I copied the url - https://www.google.com/#tbs=qdr:d&sclient=psy-ab&q=site:+twitter.com+send+me+a+message&oq=site:+twitter.com+send+me+a+message&gs_l=serp.3...5276.10960.0.11221.19.18.1.0.0.0.206.2199.0j17j1.18.0...0.0...1c.1.15.psy-ab.IqZSDG2wOJY&pbx=1&bav=on.2,or.r_cp.r_qf.&fp=91cba5dc00bae567&biw=1440&bih=646
    I changed the last number 646 to %KW% so it will now look like this
    https://www.google.com/#tbs=qdr:d&sclient=psy-ab&q=site:+twitter.com+send+me+a+message&oq=site:+twitter.com+send+me+a+message&gs_l=serp.3...5276.10960.0.11221.19.18.1.0.0.0.206.2199.0j17j1.18.0...0.0...1c.1.15.psy-ab.IqZSDG2wOJY&pbx=1&bav=on.2,or.r_cp.r_qf.&fp=91cba5dc00bae567&biw=1440&bih=%KW%


    1. The next step I took was to generate a file from 1 to 646 which would be the total number of pages I would need to merge that way the google url which would create a 646 URL.


    1. Now my next question is how do I tell scrape box to scrape just the emails or do I need to scrape first then do a link extraction and then grab emails?

    P.S. I was able to get this to work about a year ago but did not get good results using these methods. I did follow the video from the first post and even read the second post as well but so far not getting the results I need. The program that was given to me does not return enough emails and I can see more than 600 when I do a Google search.

    http://www.blackhatworld.com/blackhat-seo/black-hat-seo/492986-how-scrape-emails-twitter.html
    http://www.blackhatworld.com/blackh...che-targeted-email-lists-leads-scrapebox.html
     
  2. WayneInc

    WayneInc Senior Member

    Joined:
    Sep 20, 2012
    Messages:
    1,178
    Likes Received:
    1,099
    there are plenty of tools online which helps you in scrape...
     
  3. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Well what can you recommend? I mean I am only using scrapebox because that is what I currently own.
     
    • Thanks Thanks x 1
  4. lanbo

    lanbo Jr. VIP Jr. VIP Premium Member

    Joined:
    Aug 23, 2009
    Messages:
    3,431
    Likes Received:
    594
    Home Page:
    Try Twitter's API and search the keyword
     
  5. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    I will do a search on that.
     
  6. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Does anyone have any solutions?
     
  7. goodseoman

    goodseoman Power Member Premium Member

    Joined:
    Jul 1, 2010
    Messages:
    556
    Likes Received:
    247
    There some bots in the market fit your desire at some percentages but not any that fits 100%
    a custom bot for your own maybe the best solution if this project pay back well
    check bst, i remember some guys offer that ( but i dont suggest so called templates or scripts using web browser, they are slow, unreliable, not multi-threaded, not proxies support,...)
     
  8. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26

    Thank you for your reply going to check it out.
     
  9. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Still looking for a solution as memeber did offer me a Twitter Email Extractor that worked very well but since Twitter changed up a few things it no longer works. So back to square one again and if you have any software that you know will help please tell me.
     
  10. HelloInsomnia

    HelloInsomnia Jr. Executive VIP Jr. VIP Premium Member

    Joined:
    Mar 1, 2009
    Messages:
    1,814
    Likes Received:
    2,910
    In Scrapebox, site:twitter.com and then add your keywords below. You can use Bing instead of Google - it might get you better results.

    You can also use the footprint site:twitter "on twitter"

    On the right hand side the 5th box down "Grab/Check" - click on that choose the top result "Grab emails from harvested list" and then choose a user agent and get the emails.

    I see Twitter has changed things on some pages - at least the search page but it looks like profiles are still scrapeable by Scrapebox.
     
  11. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    I don't want to scrape profiles I want to scrape tweets that is where the emails are for my niche. People post them requesting to send them their product. That is why I am trying to scrape the tweets to grab the emails. Thank you for your input as I will give that a try right now to see if I can make it work for what I am doing.
     
  12. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Just gave that a try with my KW and I was able to grab 155 URLs which I was amazed that it was that low. I started extracting for emails from profiles but that was all I could do. That part I know and understand how to do but extracting from Tweets is what I am trying to get done. So far no luck.