How to scrape emails from Twitter?

Discussion in 'Black Hat SEO' started by Real78, Oct 16, 2012.

  1. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    367
    Likes Received:
    26
    Ok, so I was looking at something and trying to think outside the box for my niche and I notice the people are am targeting tweet their emails. I targeted my keyword within Twitter but how could I use scrape box to scrape their emails without going to my twitter and coping pasting one by one. Anyone have any ideas?

    Example: I am using HootSuite and you are able to search keywords and they show up in just that search column. I wanted to know if there is away to grab the emails from that search column :confused:
     
  2. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    220
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    Put this footprint

    Code:
    site:twitter.com "my email is" | "email me at" | "contact me at"
    Put in your keyword(s), scrape a list. Then select "Grab emails" form harvested list. People put their email in their bio, it's a freaking goldmine.

    ALTERNATIVE:

    With the harvested lsit of emails, go to Pipl and set up a scrape box %KEYWORD% with the url structure as follows:
    Code:
    https://pipl.com/search/?q=[B]EMAIL[/B]%40[B]EMAIL[/B].com
    Use this to grab a whole bunch of social profiles for other forms of direct communication.

    Btw, that's just how I do it.

    The method you are doing, it would be more appropriate to use twitter's URL structure.

    https://mobile.twitter.com/search/users?q=keyword
    https://mobile.twitter.com/search/users?page=2&q=keyword

    This is a nice tutorial showing how you can use URL structures to grab a nice email list

    http://www.blackhatworld.com/blackh...che-targeted-email-lists-leads-scrapebox.html
     
    • Thanks Thanks x 6
    Last edited by a moderator: Jun 20, 2018 at 8:55 AM
  3. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    367
    Likes Received:
    26
    Thank you very much for your information going to read what you posted after the kids homework is done.
     
  4. ibedakrse

    ibedakrse Newbie

    Joined:
    Oct 16, 2012
    Messages:
    7
    Likes Received:
    0
    Location:
    NorCal
    Intense
     
  5. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    367
    Likes Received:
    26
    Just off the two URL links I found a gold mine of emails. I am already over my target goal of making money for this month. Which was $100.00 and now my new goal is $200. With this information I should be able to convert at least 5 more people. Super Smiling right now!


    Thank you so much now I have to pull the emails out of the URL
     
  6. T3chnician

    T3chnician Regular Member

    Joined:
    Oct 26, 2011
    Messages:
    278
    Likes Received:
    88
    well you know there was actually a tool in this forum for free that did just that for you. I believe it was called "twitter email scraper" so if you type that into search chances are you will find it...
     
  7. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    367
    Likes Received:
    26
    I did a search and did not find anything by that name. I also did a google search and found atomic email scraper but I will keep looking to see what else I may find.

    Ok I spent enough time searching for that tool with no luck so I am just going to do my best with SB and see what happens.

    @dubious

    how would I extract the emails for the pages that I get from the mobile.twitter.com/search?
    Would I use the footprint you provided before?

    I see a lot of emails but how would I extract them correctly? I understand what you are doing with SB but would the footprint be the same for the other website?
     
    Last edited by a moderator: Jun 20, 2018 at 8:56 AM
  8. ihatecaptcha

    ihatecaptcha BANNED BANNED

    Joined:
    Jul 31, 2010
    Messages:
    593
    Likes Received:
    78
    i have script already that can extract emails via feeds,pm me
     
  9. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    220
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    Footprint would be the same, using the URL structure of the website, you should be able to scrape each link displayed on the page. Using the mobile site is better for scraping because twitter uses too much javascript stuff that confuses scapers sometimes.

    Below is an awesome tutorial on how to scrape emails using URL structure rules, they use Yellow Pages as an example however you can use this for directories, forums, social networks etc.

     
    • Thanks Thanks x 2
    Last edited by a moderator: May 18, 2016
  10. 0scan0

    0scan0 Junior Member

    Joined:
    Apr 9, 2010
    Messages:
    166
    Likes Received:
    42
    Location:
    1.1.3
    Seems that this method got some potential. How many emails do you accumulate in an hour using this method? Estimated number?
     
  11. dubious

    dubious Regular Member

    Joined:
    Apr 22, 2012
    Messages:
    235
    Likes Received:
    220
    Occupation:
    Project Manager/Business Development Manager
    Location:
    Australia
    Off twitter? Hard to answer, depends on the niche/targets. Things like Project Mangers is easier because business professional love waving their email out in public, but teenage girls for example would be harder.

    That's why I like to use footprints that include "my email is" or similar to target the scrapes to definitely include emails.
     
  12. Real78

    Real78 Regular Member

    Joined:
    Apr 19, 2012
    Messages:
    367
    Likes Received:
    26
    Thank you for the video I figured it out by just trial and error ended up with around 400 emails just last night. I am still going to watch the video just to make sure I understand what I am doing completely.
     
  13. dudemike

    dudemike Power Member

    Joined:
    Jan 20, 2009
    Messages:
    560
    Likes Received:
    94
    is it even worth it
     
  14. T3chnician

    T3chnician Regular Member

    Joined:
    Oct 26, 2011
    Messages:
    278
    Likes Received:
    88
    I'll look around on my external hdd I might have the exe still. It was a pretty cool app, the only downside is you have to keep hittin scrape for the list to keep building. I guess you could use some automation tool to click the button every 20 minutes or so. When i was messing around with the app I scraped over 1k emails off of twitter fairly easily. I'll let you know if I find it.

     
    Last edited: Oct 19, 2012
  15. dexxtaa

    dexxtaa Regular Member

    Joined:
    Oct 4, 2012
    Messages:
    394
    Likes Received:
    178
    if you find it, let me know too please. Im extremely intersted in this!
     
  16. rodol

    rodol Regular Member

    Joined:
    Mar 10, 2010
    Messages:
    417
    Likes Received:
    83
    Location:
    Earth
    please if you find the tool post it here, i need that too.

    i dont understand this, you mean we have to put on pipl each email we got before and scrape that url with scrapebox?
     
    Last edited by a moderator: Jun 20, 2018 at 8:57 AM
  17. Animgirl

    Animgirl BANNED BANNED

    Joined:
    Jul 20, 2011
    Messages:
    55
    Likes Received:
    3
    damn..didnt even know you can scrape emails from twitter, now i got some ideas.
     
  18. latinofever

    latinofever Junior Member

    Joined:
    Mar 27, 2011
    Messages:
    190
    Likes Received:
    26
    Location:
    Planet Earth
    Be careful they wont be considered opt-in.

    LOL!

    Sent from my GT-I9100 using Tapatalk 2
     
  19. T3chnician

    T3chnician Regular Member

    Joined:
    Oct 26, 2011
    Messages:
    278
    Likes Received:
    88
    found it bro, uploading and virus total on the way!
    Code:
    https://www.virustotal.com/file/41cc3eceab92d0594629a029e4dfaf05c50e3ca9219958c448c0412cf90dafd8/analysis/
    Code:
    http://www.mediafire.com/?c8813obozpcv35i
    its really easy to use. for keywords use the following...
    "gmail.com"
    "aol.com"
    ... whatever type of email you want, without quotes of course. Then hit extract and it will pull emails. Like I said before this app is fast and pretty neat but u have to keep hitting the extract button every 5-10 minutes so the use of some automation software will help you out majorly. Enjoy

    edit: I didnt make this just had it archived and since it was in need I re-uploaded it.
     
    • Thanks Thanks x 3
    Last edited: Oct 20, 2012
  20. T3chnician

    T3chnician Regular Member

    Joined:
    Oct 26, 2011
    Messages:
    278
    Likes Received:
    88
    Black Hat dont discriminate against non opt ins lol. We blast em all equally.