script for url scraping of search engines

glasshalffull

Registered Member
Joined
May 30, 2008
Messages
77
Reaction score
50
Does anyone know where I can find a script that will scrape search engines (google, yahoo, msn) for all urls based on the keyword I enter?

I wold like to be able to enter more than 1 keyword or keyword phrase at a time, too.

example, I would enter "dog training" and "dog training course" into the script and it would return all of the first couple of pages of results (urls) for each of those terms from google, msn, yahoo.

I would think that this has to be out there somewhere.

thanks in advance
 

linuxgeek

Newbie
Joined
Oct 3, 2008
Messages
18
Reaction score
3
So what you want is just all of the urls from the first couple of pages of serps for a search right?
 

glasshalffull

Registered Member
Joined
May 30, 2008
Messages
77
Reaction score
50
So what you want is just all of the urls from the first couple of pages of serps for a search right?

yes, that's correct

but I want to do multiple searches and not have to do just one search at a time
 

glasshalffull

Registered Member
Joined
May 30, 2008
Messages
77
Reaction score
50
porter,

I'm not wanting to create a keyword list, I'm wanting to create a list of urls from serps from my keywords.

is that what you're showing in your post?

It looks as though Keyword Elite will only give results from Google, I need results from at least google, msn and aol at a minimum

thanks
 
Last edited by a moderator:

neta1o

Regular Member
Joined
Sep 29, 2008
Messages
388
Reaction score
318
glasshalffull, if keyword elite doesn't work for you let me know and maybe I could take a look at programming a php page for you.
 

raj564

Regular Member
Joined
Dec 6, 2007
Messages
317
Reaction score
95
serpscraper does this. its expensive, though. Are you looking for a free solution?
 

glasshalffull

Registered Member
Joined
May 30, 2008
Messages
77
Reaction score
50
serpscraper looks like what I'm looking for, there's gotta be a script out there for free that's similar

thanks
 

papadre

Regular Member
Joined
Jan 16, 2008
Messages
266
Reaction score
80
i can vouch for serpscraper. well worth the purchase!
 
Top