tool to scrape google search url results

goatm1lk

Newbie
Joined
Dec 26, 2009
Messages
10
Reaction score
0
Hi, I tried in vain to get imacros to properly harvest the top 10 results from google searches since I couldn't get the extract to work without adwords messing up extract, does anyone know of a program that can grab the URLS from within the browser? Does ubot have this capacity? seems that getting passed the dynamic adwords and youtube vids makes it hard to do. :(
 
Hi, I tried in vain to get imacros to properly harvest the top 10 results from google searches since I couldn't get the extract to work without adwords messing up extract, does anyone know of a program that can grab the URLS from within the browser? Does ubot have this capacity? seems that getting passed the dynamic adwords and youtube vids makes it hard to do. :(

Yes, UBot can do this very easily. But I don't think you should purchase Ubot just for scrapping links.

Here is something I used in the past. Its called Link Gofer, but It still requires some manual work.

If you need me to make you an extractor PM me and we can work something out.
 
Last edited:
link gofer is pretty good, but if you search a term like 'insurance' you get a ton of links to ads, locals, and news.. which really is the trouble in trying to scrape the google urls. Trying to get more information on Ubot because from the tutorials I watched I'm not that convinced it will work.
 
google-scraper.squabbel.com

just modify the code to only scrape the first page and only 10 results.
It can detect ads (and ignore them) and is free to use&modify
 
Back
Top