1500 .EDU Blogs List

How did you scrape these? The way I do it is searches:
Code:
site:.edu inurl:CreateUser.aspx
site:.edu inurl:register.aspx
site:.edu inurl:"wp-signup.php"
site:.edu inurl:register.php "agree"
site:.edu "powered by expressionengine"
site:.edu "powered by vbulletin" inurl:"register.php"
site:.edu "powered by SMF" inurl:register
site:.edu "powered by drupal" inurl:"register"
site:.edu "powered by punbb"
site:.edu "powered by phpbb"
site:.edu inurl:blog "post a comment" -"comments closed" -"you must be logged
in
Is there a better way?

do the searches...scrape outwit addon on firefox, maybe?
 
Back
Top