Twitter Email Extractor Script

**revit** · #1 (**permalink**) 07-10-2009, 05:10 PM

Here's a nice little php Twitter Email Extractor for everyone

HTML Code:

<?php
$file = file_get_contents("http://search.twitter.com/search?q=gmail.com+OR+yahoo.com+OR+msn.com+OR+aol.com+OR+hotmail.com++OR+%22email+me%22+OR+%22contact+me%22");
$file = strip_tags($file);
 
preg_match_all(
    "([a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-z0-9!#$%&'*+/=?^_`{|}~-]+)*@(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?\.)+(?:[A-Z]{2}|com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum)\b)siU",
    $file,
    $matches);
 
echo '<pre>';
print_r($matches);
echo '</pre>';
?>

The Output looks like this:

HTML Code:

            [0] => protein324@aol.com
            [1] => tendaijoe@gmail.com
            [2] => primozlpartenon@hotmail.com
            [3] => budgetamit@gmail.com
            [4] => parisstanback@tmail.com
            [5] => michaellhobart@gmail.com
            [6] => iwanttobuyamelon@gmail.com
            [7] => lordejorge@hotmail.com

**mmguru770** · #2 (**permalink**) 07-10-2009, 05:19 PM

revit you are posting very useful stuff lets see if i can get us leads with this

raicha101 · #3 (**permalink**) 07-10-2009, 06:59 PM

Thanks for regex

weaselstomp · #4 (**permalink**) 07-10-2009, 07:30 PM

I made a few quick sloppy changes to this below. To config:

-$max_results is the number of results PER PAGE, not total. Twitter caps this at 100
-$max_pages is implemented because of Twitter's pagination. Set the number of pages you'd like it to search through.
-$use_keywords is set to false by default, for use with the next option:
-$keywords should be separated by pluses (+) not spaces. I tried with a few different keyword combos, didn't find much. Of course, this script only checks to see if that keyword is in the same tweet as the email address, not the users entire history.

Code:

<?php
/************Settings*****************************/
/*set max number of results per page (max is 100)*/
$max_results = 100;
/*set number of pages to recurse through */
$max_pages = 2;
/* use keywords? */
$use_keywords = false;
/*add a keyword or two separate by +'s 
	for example this will work: $keywords="make+money";
	but this will not: $keywords="make money";
*/
$keywords="hello";



/************Loopage*****************************/
for ($i = 1; $i <= $max_pages; $i++) {
if (!$use_keywords) {
		$keywords = "";
} 
$file = file_get_contents("http://search.twitter.com/search?page=".$i."&rpp=".$max_results."&ands=".$keywords."&ors=gmail.com+yahoo.com+msn.com+aol.com+hotmail.com&lang=en");
$file = strip_tags($file);
 
preg_match_all("([a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-z0-9!#$%&'*+/=?^_`{|}~-]+)*@(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?\.)+(?:[A-Z]{2}|com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum)\b)siU", $file, $matches);


echo '<pre>';
echo 'Page '.$i.' - Keyword(s): '.$keywords.':<br>';
print_r($matches);
echo '</pre>';
}
?>

weaselstomp · #5 (**permalink**) 07-10-2009, 07:42 PM

Oh, and it returns English-only Twitterers. If you want to return any language, change "&lang=en" to just "&lang="

Or, if you want to target a specific language:

ar=Arabic (العربية)
da=Danish (dansk)
nl=Dutch (Nederlands)
en=English
fa=Farsi / Persian (فارسی)
fi=Finnish (suomen kieli)
fr=French (français)
de=German (Deutsch)
hu=Hungarian (Magyar)
is=Icelandic (Íslenska)
it=Italian (Italiano)
ja=Japanese (日本語)
no=Norwegian (Norsk)
pl=Polish (polski)
pt=Portuguese (Português)
ru=Russian (русский язык)
es=Spanish (español)
sv=Swedish (Svenska)
th=Thai (ไทย)

**revit** · #6 (**permalink**) 07-10-2009, 07:55 PM

change the search criteria. In the current search i believe there are only 2 pages in twitter.

**CasinoJack** · #7 (**permalink**) 07-10-2009, 08:00 PM

Dude

again you steal others work and make it as your own. This is twice you did so baltantly. At least say you found it and want to share it, we all knwo u did not code these

http://www.fromzerotoseo.com/twitter-email-grabber/

weaselstomp · #8 (**permalink**) 07-10-2009, 08:17 PM

Quote:

Originally Posted by casinojack

Dude

again you steal others work and make it as your own. This is twice you did so baltantly. At least say you found it and want to share it, we all knwo u did not code these

http://www.fromzerotoseo.com/twitter-email-grabber/

Hmm. That is what it looks like, but Revit didn't say he coded it. Nice of him to share it anyway. I did add the modifications by hand however

**revit** · #9 (**permalink**) 07-10-2009, 08:26 PM

What the! come on now, I just found and thought it was a cool script. What's your deal pal! Again, say thank you for posting the script or move on, why bring negativity on something good.

Some people...I tell you what

weaselstomp · #10 (**permalink**) 07-10-2009, 08:27 PM

Quote:

Originally Posted by ManKat

i dunno how to get it to work.....

i uploaded it,and see what i got....

Code:

http://appleinsider.info/bally/twitter.php

How to get more emails?

When i refresh the page,most of the emails get repeated.

To get more emails: As Revit said, you might want to change $max_pages to a higher number.

Duplicates: Do a little research

the PHP function array_unique should help. Or, if you're dumping them into an SQL database, just make whatever column you're pushing them into force unique values. :-)

**revit** · #11 (**permalink**) 07-10-2009, 08:31 PM

Quote:

Originally Posted by casinojack

Dude

again you steal others work and make it as your own. This is twice you did so baltantly. At least say you found it and want to share it, we all knwo u did not code these

http://www.fromzerotoseo.com/twitter-email-grabber/

Your complaining that I shared a code that someone else made and yet I don't see you complaining when someone shares a nulled script/program.

Your in a blackhat forum buddy!

LOL...did I bash one of your recent posts or something or are you just having a bad day and need to release some tension?

....Amusing

**revit** · #12 (**permalink**) 07-10-2009, 08:34 PM

If you want to grab just the usernames:

lol...does this make you feel better CasinoJack?

HTML Code:

<?php
$file = file_get_contents("http://search.twitter.com/search?q=gmail.com+OR+hotmail.com++OR+%22email+me%22");
 
preg_match_all(
    "/<a href=\"http:\/\/twitter.com\/([A-z]*)\"/",
    $file,
    $matches);
 
echo '<pre>';
print_r(array_unique($matches[1]));
echo '</pre>';
?>

**revit** · #13 (**permalink**) 07-10-2009, 08:45 PM

And then once you have those screennames, then you can plug them into this script:

Demo:

HTML Code:

http://demo.marcofolio.net/mass_twitter_script/

Download:

HTML Code:

http://www.mediafire.com/download.php?mzlzmyldyif

blackhat+er · #14 (**permalink**) 07-11-2009, 08:57 AM

Quote:

Originally Posted by revit

Your complaining that I shared a code that someone else made and yet I don't see you complaining when someone shares a nulled script/program.

Your in a blackhat forum buddy!

LOL...did I bash one of your recent posts or something or are you just having a bad day and need to release some tension?

....Amusing

I dont think it has anything to do with a bad day I just think that its the fact you keep posting code and not distinguishing where it came from which if you have ever written code then you want the respect of leaving the commented copywrite in the code as well as just say where you got it or who's it is instead of leaving it to asuming and trying to build up your pathetic little thank you's off shares that aren't yours. The only reason I choose to say anything is that its annoying being a coder myself to see my shit shared with copywrite yanked out and people trying to pass it as if they did it or can hang. Anyways reguardless of who actually coded it, its a decent share so your thank you, you so preciously wanted was given.

raicha101 · #15 (**permalink**) 07-11-2009, 10:10 AM

Most easy way to scrape twitter emails would be use google
search for "@gmail.com" site:twitter.com (Only last 24 hours) everyday. Your DP will grow over time

Panique · #16 (**permalink**) 07-11-2009, 10:27 AM

hmm nice one, will test this out

spikyy · #17 (**permalink**) 07-11-2009, 04:32 PM

I updated the twitter extractor script here it is

Code:

<?php
/*************************
*
* Twitter Email extractor v.1
*
* author: spikyy @ BlackHatWorld
*/
  
if(!isset($_GET['action'])) {
      
      $file = $_SERVER["SCRIPT_NAME"];
      $break = Explode('/', $file);
      $pfile = $break[count($break) - 1]; 
      
      print_r('<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html><head><title>Twitter Email Extractor</title>
</head><body bgcolor="#7DE3F9">
<center> <h1>Twitter Extractor v.1</h1> <br />
<form action="'.$pfile.'?action=do" method="post">
<table width="70%" height="70%" bgcolor="#BBEFFA" border="0">
<tr> <td width="33%" height="100%" valign="center" align="left" >
<center><b> How many Twitter pages: </b> <br /><br />
<input name="pagenr" type="text" size="2" value="10">
<br /><br /><b>Tweple country:</b><br /> (English = en, Spanish = es)
<br /><br /><input type="text" name="country" value="en" size="2">
<br /><br /> <br /><input type="submit" value="Search for Emails!" size="6">
</center></td><td width="33%" height="100%" valign="center" ><center>
<b>Are you using keywords ? </b><select name="keyword"> <option>yes</option> <option selected="selected">no</option>  </select>
<br /><br /><textarea name="keywords" rows="10" cols="20">
keyword1
keyword2
keyword3</textarea></center></td>
<td width="33%" height="100%" valign="center" >
<center><b>Domain type for searching:</b><br /><br />
<textarea name="domains" rows="10" cols="20">
gmail.com
yahoo.com
msn.com
aol.com
hotmail.com</textarea></center></td>
</tr></table></form></center> </body></html>
');
      
  } else {
      
print_r('<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html>
<head>
<title>Twitter Email Extractor</title>  
</head>
<body bgcolor="#7DE3F9">
<center> <h1>Twitter Extractor v.1</h1> 
<br />
<table width="70%" height="70%" bgcolor="#BBEFFA" border="0">
<tr> 
<td width="100%" height="100%" valign="center" align="center">
<b>Extracting ... </b><br /><br />
<textarea cols="30" rows="20">');
  
  $err = 0;
      
  if(isset($_POST['pagenr']) && $_POST['pagenr'] != "") { $pagenr = $_POST['pagenr'];
 
  } else { $err = 1; $errn = $errn."\n Number of pages is missing"; }
  
  if(isset($_POST['country']) && $_POST['country'] != "") { $country = $_POST['country']; 
  
  } else { $err = 1; $errn = $errn."\n Country is missing"; }
  
  if(isset($_POST['keyword']) && $_POST['keyword'] != "") { $keyword = $_POST['keyword']; 
  
  } else { $err = 1; $errn = $errn."\n Keyword option is missing"; }
  
  if($keyword == "yes") { if(isset($_POST['keywords']) && $_POST['keywords'] != "") { $keywords = $_POST['keywords']; 
  
  } else { $err = 1; $errn = $errn."\n Keywords missing"; } }
  
  if(isset($_POST['domains']) && $_POST['domains'] != "") {$domains = $_POST['domains']; 
  
  } else { $err = 1; $errn = $errn."\n Domains missing"; }
  
  if($err == 0)     { 
  
     $domains = nl2br($domains);
     $domains = explode('<br />', $domains);
     foreach($domains as $dd)
     {
       $domainsvar = $domainsvar.trim($dd)."+";   
     }
     $domainsvar = strrev(substr(strrev($domainsvar), 1));
     if($keyword == "yes") {
      
      $keywords = nl2br($keywords);
      $keywords = explode('<br />', $keywords); 
           
     foreach($keywords as $key) {
         
     for($i=1; $i <= $pagenr; $i++) {
     
     $file = file_get_contents("http://search.twitter.com/search?page=".$i."&rpp=100&ands=".trim($key)."&ors=".$domainsvar."&lang=".$country);
     $file = strip_tags($file);
 
     $matches = "";
     
     preg_match_all("([a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-z0-9!#$%&'*+/=?^_`{|}~-]+)*@(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?\.)+(?:[A-Z]{2}|com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum)\b)siU", $file, $matches);
     
     foreach($matches[0] as $mtt) {        
         echo trim($mtt)."\n"; ob_flush(); flush();
     }        
         
         
     }  }   }  else {
         
     for($i=1; $i <= $pagenr; $i++) {
     
     $file = file_get_contents("http://search.twitter.com/search?page=".$i."&rpp=100&ors=".$domainsvar."&lang=".$country);
     $file = strip_tags($file);
     
     $matches = ""; 
 
     preg_match_all("([a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-z0-9!#$%&'*+/=?^_`{|}~-]+)*@(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?\.)+(?:[A-Z]{2}|com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum)\b)siU", $file, $matches);
     
     foreach($matches[0] as $mtt) {        
         echo trim($mtt)."\n";ob_flush();flush();}         
         }
     
     
     }        

  
  } else {
      
      echo "Errors:".$errn;
  
  } 
  
   
  print_r('</textarea>
<br /><br />
<font color="red" size="5"><b> DONE !!! </b></font>
</td></tr>  
</body>
</html>'); 
      
      
  }
  
  
  
  
  
  
?>

Also available at http://pastie.org/542433

blackhaty · #18 (**permalink**) 07-11-2009, 06:07 PM

i think this script can be tweaked better way.....i am also getting maximum execution time error.

spikyy · #19 (**permalink**) 07-11-2009, 06:30 PM

Quote:

Originally Posted by magnumfinger

thanks for the quick update, but a

"Fatal error: Maximum execution time of 30 seconds exceeded in tweet.php on line 99<br "

if i try to change the "HOW MANY TWITTER" option to 20, I guess it works perfectly when I only set it to '1' .. LOL

i guess there's a problem with the 30second limit?

ty fo the reply..

Quote:

Originally Posted by blackhaty

i think this script this be tweaked better way.....i am also getting maximum execution time error.

You need to increase max execution time in your php.ini file

Numa68 · #20 (**permalink**) 07-11-2009, 06:31 PM

Quote:

Originally Posted by blackhaty

i think this script this be tweaked better way.....i am also getting maximum execution time error.

You will if your PHP is set up with the default, which is like 30 seconds. Try adding the following to the top of the script, right after the '<?php':

Code:

set_time_limit (900);

That should let the script run for 900 seconds (15 minutes). Adjust as necessary if you need a longer time. If you are on a shared host they may override this, but it should work.

blackhaty · #21 (**permalink**) 07-11-2009, 06:42 PM

thanks it worked. I extracted 100 pages email ids at once. But skippy is it possible to give start and end page numbers.....so that after i search for 100pages ...i can search from 101 to 200 pages

weaselstomp · #22 (**permalink**) 07-11-2009, 07:21 PM

Quote:

Originally Posted by blackhaty

thanks it worked. I extracted 100 pages email ids at once. But skippy is it possible to give start and end page numbers.....so that after i search for 100pages ...i can search from 101 to 200 pages

I've modified Spikyy's code a bit to include this. Not touching his credits, just adding in the 15minute timeout, starting page number, and button to quickly highlight the text (like the BHW "Select All" buttons).

Code:

<?php
set_time_limit (900);
/*************************
*
* Twitter Email extractor v.1
*
* author: spikyy @ BlackHatWorld
*/

if(!isset($_GET['action'])) {
      
      $file = $_SERVER["SCRIPT_NAME"];
      $break = Explode('/', $file);
      $pfile = $break[count($break) - 1]; 
      
      print_r('<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html><head><title>Twitter Email Extractor</title>
</head><body bgcolor="#7DE3F9">
<center> <h1>Twitter Extractor v.1</h1> <br />
<form action="'.$pfile.'?action=do" method="post">
<table width="70%" height="70%" bgcolor="#BBEFFA" border="0">
<tr> <td width="33%" height="100%" valign="center" align="left" >
<center><b> Starting page number: </b> <br /><br />
<input name="pagestart" type="text" size="2" value="1"><br /><br />
<b> How many Twitter pages: </b> <br /><br />
<input name="pagenr" type="text" size="2" value="10">
<br /><br /><b>Tweple country:</b><br /> (English = en, Spanish = es)
<br /><br /><input type="text" name="country" value="en" size="2">
<br /><br /> <br /><input type="submit" value="Search for Emails!" size="6">
</center></td><td width="33%" height="100%" valign="center" ><center>
<b>Are you using keywords ? </b><select name="keyword"> <option>yes</option> <option selected="selected">no</option>  </select>
<br /><br /><textarea name="keywords" rows="10" cols="20">
keyword1
keyword2
keyword3</textarea></center></td>
<td width="33%" height="100%" valign="center" >
<center><b>Domain type for searching:</b><br /><br />
<textarea name="domains" rows="10" cols="20">
gmail.com
yahoo.com
msn.com
aol.com
hotmail.com</textarea></center></td>
</tr></table></form></center> </body></html>
');
      
  } else {
      
print_r('<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html>
<head>
<title>Twitter Email Extractor</title>  
</head>
<body bgcolor="#7DE3F9">
<center> <h1>Twitter Extractor v.1</h1> 
<br />
<table width="70%" height="70%" bgcolor="#BBEFFA" border="0">
<tr> 
<td width="100%" height="100%" valign="center" align="center">
<b>Extracting ... </b><br /><br />
<form>
<textarea id="twtResults" cols="30" rows="20">');
  
  $err = 0;
  if(isset($_POST['pagestart']) && $_POST['pagestart'] != "") { $pagenr = $_POST['pagestart'];
 
  } else { $err = 1; $errn = $errn."\n Starting page number is missing"; }
  
  if(isset($_POST['pagenr']) && $_POST['pagenr'] != "") { $pagenr = $_POST['pagenr'];
 
  } else { $err = 1; $errn = $errn."\n Number of pages is missing"; }
  
  if(isset($_POST['country']) && $_POST['country'] != "") { $country = $_POST['country']; 
  
  } else { $err = 1; $errn = $errn."\n Country is missing"; }
  
  if(isset($_POST['keyword']) && $_POST['keyword'] != "") { $keyword = $_POST['keyword']; 
  
  } else { $err = 1; $errn = $errn."\n Keyword option is missing"; }
  
  if($keyword == "yes") { if(isset($_POST['keywords']) && $_POST['keywords'] != "") { $keywords = $_POST['keywords']; 
  
  } else { $err = 1; $errn = $errn."\n Keywords missing"; } }
  
  if(isset($_POST['domains']) && $_POST['domains'] != "") {$domains = $_POST['domains']; 
  
  } else { $err = 1; $errn = $errn."\n Domains missing"; }
  
  if($err == 0)     { 
  
     $domains = nl2br($domains);
     $domains = explode('<br />', $domains);
     foreach($domains as $dd)
     {
       $domainsvar = $domainsvar.trim($dd)."+";   
     }
     $domainsvar = strrev(substr(strrev($domainsvar), 1));
     if($keyword == "yes") {
      
      $keywords = nl2br($keywords);
      $keywords = explode('<br />', $keywords); 
           
     foreach($keywords as $key) {
         
     for($i=$pagestart; $i <= ($pagestart + $pagenr); $i++) {
     
     $file = file_get_contents("http://search.twitter.com/search?page=".$i."&rpp=100&ands=".trim($key)."&ors=".$domainsvar."&lang=".$country);
     $file = strip_tags($file);
 
     $matches = "";
     
     preg_match_all("([a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-z0-9!#$%&'*+/=?^_`{|}~-]+)*@(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?\.)+(?:[A-Z]{2}|com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum)\b)siU", $file, $matches);
     
     foreach($matches[0] as $mtt) {        
         echo trim($mtt)."\n"; ob_flush(); flush();
     }        
         
         
     }  }   }  else {
         
     for($i=$pagestart; $i <= ($pagestart + $pagenr); $i++) {
     
     $file = file_get_contents("http://search.twitter.com/search?page=".$i."&rpp=100&ors=".$domainsvar."&lang=".$country);
     $file = strip_tags($file);
     
     $matches = ""; 
 
     preg_match_all("([a-z0-9!#$%&'*+/=?^_`{|}~-]+(?:\.[a-z0-9!#$%&'*+/=?^_`{|}~-]+)*@(?:[a-z0-9](?:[a-z0-9-]*[a-z0-9])?\.)+(?:[A-Z]{2}|com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum)\b)siU", $file, $matches);
     
     foreach($matches[0] as $mtt) {        
         echo trim($mtt)."\n";ob_flush();flush();}         
         }
     
     
     }        

  
  } else {
      
      echo "Errors:".$errn;
  
  } 
  
   
  print_r('</textarea>
  <br>
  <input type="button" value="Select Text" onClick="javascript:this.form.twtResults.focus();this.form.twtResults.select();">
  </form>
<br />
<font color="red" size="5"><b> DONE !!! </b></font>
</td></tr>  
</body>
</html>'); 
      
      
  }
  
  
  
  
  
  
?>

**HealeyV3** · #23 (**permalink**) 07-11-2009, 07:43 PM

For anyone that wants to test it out....

http://freegamekeys.com/tmet1.php

Dont know how to do more than like 100 pages at a time tho.

Getting error timeout.

weaselstomp · #24 (**permalink**) 07-11-2009, 08:19 PM

Just an FYI - for you guys hosting this publicly, it's using your server's bandwidth and IP, not the visitor's browser. HealeyV3, DreamHost might look down on this, considering there are 23 other websites being hosted on the same server you're using.

To get past the timeout issue, you may need to adjust your server's PHP.ini file and set output_buffering to On. DreamHost lets you do this:
http://www.wiki.dreamhost.com/index.php/PHP.ini