1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

tool to scrape google search url results

Discussion in 'Black Hat SEO Tools' started by goatm1lk, Dec 26, 2009.

  1. goatm1lk

    goatm1lk Newbie

    Joined:
    Dec 26, 2009
    Messages:
    10
    Likes Received:
    0
    Hi, I tried in vain to get imacros to properly harvest the top 10 results from google searches since I couldn't get the extract to work without adwords messing up extract, does anyone know of a program that can grab the URLS from within the browser? Does ubot have this capacity? seems that getting passed the dynamic adwords and youtube vids makes it hard to do. :(
     
  2. xbon869x

    xbon869x Guest

    I'm sure there is something here,try the search function.
     
  3. BLabs

    BLabs Regular Member Premium Member

    Joined:
    Oct 28, 2009
    Messages:
    232
    Likes Received:
    62
    Occupation:
    SEO
    Home Page:
    Just use Hrefer ;)
     
  4. gogetta

    gogetta Power Member

    Joined:
    Oct 4, 2008
    Messages:
    688
    Likes Received:
    1,307
    Occupation:
    Internet Hustla
    Location:
    Trapped Online
    Yes, UBot can do this very easily. But I don't think you should purchase Ubot just for scrapping links.

    Here is something I used in the past. Its called Link Gofer, but It still requires some manual work.

    If you need me to make you an extractor PM me and we can work something out.
     
    Last edited: Dec 26, 2009
  5. goatm1lk

    goatm1lk Newbie

    Joined:
    Dec 26, 2009
    Messages:
    10
    Likes Received:
    0
    link gofer is pretty good, but if you search a term like 'insurance' you get a ton of links to ads, locals, and news.. which really is the trouble in trying to scrape the google urls. Trying to get more information on Ubot because from the tutorials I watched I'm not that convinced it will work.
     
  6. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    google-scraper.squabbel.com

    just modify the code to only scrape the first page and only 10 results.
    It can detect ads (and ignore them) and is free to use&modify