tool to scrape google search url results

goatm1lk · Dec 26, 2009

Hi, I tried in vain to get imacros to properly harvest the top 10 results from google searches since I couldn't get the extract to work without adwords messing up extract, does anyone know of a program that can grab the URLS from within the browser? Does ubot have this capacity? seems that getting passed the dynamic adwords and youtube vids makes it hard to do.

xbon869x · Dec 26, 2009

I'm sure there is something here,try the search function.

BLabs · Dec 26, 2009

Just use Hrefer

gogetta · Dec 26, 2009

goatm1lk said:
Hi, I tried in vain to get imacros to properly harvest the top 10 results from google searches since I couldn't get the extract to work without adwords messing up extract, does anyone know of a program that can grab the URLS from within the browser? Does ubot have this capacity? seems that getting passed the dynamic adwords and youtube vids makes it hard to do.

Yes, UBot can do this very easily. But I don't think you should purchase Ubot just for scrapping links.

Here is something I used in the past. Its called Link Gofer, but It still requires some manual work.

If you need me to make you an extractor PM me and we can work something out.

goatm1lk · Dec 26, 2009

link gofer is pretty good, but if you search a term like 'insurance' you get a ton of links to ads, locals, and news.. which really is the trouble in trying to scrape the google urls. Trying to get more information on Ubot because from the tutorials I watched I'm not that convinced it will work.

justone · Dec 27, 2009

google-scraper.squabbel.com

just modify the code to only scrape the first page and only 10 results.
It can detect ads (and ignore them) and is free to use&modify

tool to scrape google search url results

goatm1lk

Newbie

xbon869x

Guest

BLabs

Regular Member

gogetta

Power Member

goatm1lk

Newbie

justone

BANNED

Main Menu

Marketplace

Making Money

BlackHat World