1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrape emails from Twitter?

Discussion in 'Black Hat SEO' started by Real78, Oct 16, 2012.

  1. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Ok, so I was looking at something and trying to think outside the box for my niche and I notice the people are am targeting tweet their emails. I targeted my keyword within Twitter but how could I use scrape box to scrape their emails without going to my twitter and coping pasting one by one. Anyone have any ideas?

    Example: I am using HootSuite and you are able to search keywords and they show up in just that search column. I wanted to know if there is away to grab the emails from that search column :confused:
     
  2. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    222
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    Put this footprint

    Code:
    site:twitter.com "my email is" | "email me at" | "contact me at"
    Put in your keyword(s), scrape a list. Then select "Grab emails" form harvested list. People put their email in their bio, it's a freaking goldmine.

    ALTERNATIVE:

    With the harvested lsit of emails, go to Pipl and set up a scrape box %KEYWORD% with the url structure as follows:
    Code:
    https://pipl.com/search/?q=[B]EMAIL[/B]%40[B]EMAIL[/B].com
    Use this to grab a whole bunch of social profiles for other forms of direct communication.
     
    • Thanks Thanks x 4
  3. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    222
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    • Thanks Thanks x 5
  4. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Thank you very much for your information going to read what you posted after the kids homework is done.
     
  5. ibedakrse

    ibedakrse Newbie

    Joined:
    Oct 16, 2012
    Messages:
    7
    Likes Received:
    0
    Location:
    NorCal
    Home Page:
    Intense
     
  6. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Just off the two URL links I found a gold mine of emails. I am already over my target goal of making money for this month. Which was $100.00 and now my new goal is $200. With this information I should be able to convert at least 5 more people. Super Smiling right now!


    Thank you so much now I have to pull the emails out of the URL
     
  7. T3chnician

    T3chnician Regular Member

    Joined:
    Oct 26, 2011
    Messages:
    278
    Likes Received:
    88
    well you know there was actually a tool in this forum for free that did just that for you. I believe it was called "twitter email scraper" so if you type that into search chances are you will find it...
     
  8. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    I did a search and did not find anything by that name. I also did a google search and found atomic email scraper but I will keep looking to see what else I may find.
     
  9. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Ok I spent enough time searching for that tool with no luck so I am just going to do my best with SB and see what happens.
     
  10. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    @Dubious

    how would I extract the emails for the pages that I get from the mobile.twitter.com/search?
    Would I use the footprint you provided before?

    I see a lot of emails but how would I extract them correctly? I understand what you are doing with SB but would the footprint be the same for the other website?
     
  11. ihatecaptcha

    ihatecaptcha BANNED BANNED

    Joined:
    Jul 31, 2010
    Messages:
    593
    Likes Received:
    78
    i have script already that can extract emails via feeds,pm me
     
  12. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    222
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    Footprint would be the same, using the URL structure of the website, you should be able to scrape each link displayed on the page. Using the mobile site is better for scraping because twitter uses too much javascript stuff that confuses scapers sometimes.

    Below is an awesome tutorial on how to scrape emails using URL structure rules, they use Yellow Pages as an example however you can use this for directories, forums, social networks etc.

     
    • Thanks Thanks x 2
    Last edited by a moderator: May 18, 2016
  13. 0scan0

    0scan0 Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 9, 2010
    Messages:
    166
    Likes Received:
    42
    Location:
    1.1.3
    Seems that this method got some potential. How many emails do you accumulate in an hour using this method? Estimated number?
     
  14. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    222
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    Off twitter? Hard to answer, depends on the niche/targets. Things like Project Mangers is easier because business professional love waving their email out in public, but teenage girls for example would be harder.

    That's why I like to use footprints that include "my email is" or similar to target the scrapes to definitely include emails.
     
  15. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    371
    Likes Received:
    26
    Thank you for the video I figured it out by just trial and error ended up with around 400 emails just last night. I am still going to watch the video just to make sure I understand what I am doing completely.
     
  16. dudemike

    dudemike Power Member

    Joined:
    Jan 20, 2009
    Messages:
    554
    Likes Received:
    94
    is it even worth it
     
  17. moister

    moister Regular Member Premium Member

    Joined:
    Dec 29, 2011
    Messages:
    205
    Likes Received:
    76
    Location:
    35.24.45.178
    Nice info guys thanks
     
  18. T3chnician

    T3chnician Regular Member

    Joined:
    Oct 26, 2011
    Messages:
    278
    Likes Received:
    88
    I'll look around on my external hdd I might have the exe still. It was a pretty cool app, the only downside is you have to keep hittin scrape for the list to keep building. I guess you could use some automation tool to click the button every 20 minutes or so. When i was messing around with the app I scraped over 1k emails off of twitter fairly easily. I'll let you know if I find it.

     
    Last edited: Oct 19, 2012
  19. dexxtaa

    dexxtaa Regular Member

    Joined:
    Oct 4, 2012
    Messages:
    394
    Likes Received:
    178
    if you find it, let me know too please. Im extremely intersted in this!
     
  20. rodol

    rodol Regular Member

    Joined:
    Mar 10, 2010
    Messages:
    346
    Likes Received:
    67
    Location:
    Earth
    please if you find the tool post it here, i need that too.