1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

script for url scraping of search engines

Discussion in 'Black Hat SEO Tools' started by glasshalffull, Dec 9, 2008.

  1. glasshalffull

    glasshalffull Registered Member

    Joined:
    May 30, 2008
    Messages:
    76
    Likes Received:
    50
    Does anyone know where I can find a script that will scrape search engines (google, yahoo, msn) for all urls based on the keyword I enter?

    I wold like to be able to enter more than 1 keyword or keyword phrase at a time, too.

    example, I would enter "dog training" and "dog training course" into the script and it would return all of the first couple of pages of results (urls) for each of those terms from google, msn, yahoo.

    I would think that this has to be out there somewhere.

    thanks in advance
     
  2. linuxgeek

    linuxgeek Newbie

    Joined:
    Oct 3, 2008
    Messages:
    18
    Likes Received:
    3
    Occupation:
    Systems Administrator
    Location:
    Pennsylvania
    So what you want is just all of the urls from the first couple of pages of serps for a search right?
     
  3. glasshalffull

    glasshalffull Registered Member

    Joined:
    May 30, 2008
    Messages:
    76
    Likes Received:
    50
    yes, that's correct

    but I want to do multiple searches and not have to do just one search at a time
     
  4. glasshalffull

    glasshalffull Registered Member

    Joined:
    May 30, 2008
    Messages:
    76
    Likes Received:
    50
    porter,

    I'm not wanting to create a keyword list, I'm wanting to create a list of urls from serps from my keywords.

    is that what you're showing in your post?

    It looks as though Keyword Elite will only give results from Google, I need results from at least google, msn and aol at a minimum

    thanks
     
    Last edited by a moderator: Dec 9, 2008
  5. neta1o

    neta1o Regular Member

    Joined:
    Sep 29, 2008
    Messages:
    388
    Likes Received:
    318
    Home Page:
    glasshalffull, if keyword elite doesn't work for you let me know and maybe I could take a look at programming a php page for you.
     
  6. glasshalffull

    glasshalffull Registered Member

    Joined:
    May 30, 2008
    Messages:
    76
    Likes Received:
    50
  7. raj564

    raj564 Regular Member

    Joined:
    Dec 6, 2007
    Messages:
    317
    Likes Received:
    93
    Location:
    serpscraper does this. its expensive, though. Are you looking for a free solution?
     
  8. glasshalffull

    glasshalffull Registered Member

    Joined:
    May 30, 2008
    Messages:
    76
    Likes Received:
    50
    serpscraper looks like what I'm looking for, there's gotta be a script out there for free that's similar

    thanks
     
  9. papadre

    papadre Regular Member

    Joined:
    Jan 16, 2008
    Messages:
    246
    Likes Received:
    69
    Occupation:
    Pimp
    Location:
    Bay Area, CA
    Home Page:
    i can vouch for serpscraper. well worth the purchase!