Free Url Scraper

Timbo

Regular Member
Joined
May 13, 2008
Messages
272
Reaction score
59
Attached is an Imacros Google search scraper and corresponding database. Pretty simple. Open the database and replace the terms in column one with your own then save. If you set it to loop 5 times then it grabs 500 URLs as it grabs 100 per run. I think it will potentially grab 10,000 the way it is set up. Just loop it 100 times.

It saves the file as test.csv on drive C:

You may want to tweak it with your own preferences.

And you may have to set your google preferences to 100 results per page.

It is currently configured to scrape Scuttle sites.

Any ideas for it let me know. I hope to be posting more soon.

Also have a question. Does anyone know how to turn an Imacros program into a standalone program without have to buy the Pro package?
 

Attachments

This is an old post, but I found it on G and had a suggestion (since you asked). I need a scraper that will scrape G for specific industry article directories. For example, if I go to G and type in "travel directories" or "article travel directories" a bunch come up, yea. But, I would rather be able to scrape them and then important them into my AMR.

Unless someone knows of a free scraper that can do that or offers a service :)
 
Back
Top