handmadebots
Senior Member
- Nov 8, 2012
- 1,072
- 255
Hei guys, so I'm back on track with another scraper, but this time it's a google scraper.
The bot is made in C#, and you'll need .NET 4.5 in order to be able to run it.
It's a pretty user-friendly bot, that can scrape up to 100 results per keyword (I wish it could scrape 1 million results/keyword too, but ... it's almost impossible).
You have to input this stuff before you click start:
About the google dorks, if you don't know about them, take a look here. If you want to find for example very targeted tumblr blogs that are related to the keyword stars you'll have to do something like this:
You can take a closer look at the link with the google dorks, and use those that you need. Also DON'T use the google dorks to find vulnerable websites.
The bot is returning for each result this:
Observation: Make sure your delay is at least 5 seconds, because if you abuse from it, you'll get blocked pretty quick. If you have a list of 100 keywords, I would suggest to set it to 60 seconds, and leave it running in background. I haven't tested it big time yet, but ... if you keep the delay up, I am pretty sure that it will do what you want.
Hope you guys like it
Download Link: http://www.mediafire.com/download/c75u597m8yazd2x/Google_Scraper.zip
VirusTotal Scan: https://www.virustotal.com/en/file/...007e3571a8e4e871bb10e71c/analysis/1401387149/
The bot is made in C#, and you'll need .NET 4.5 in order to be able to run it.
It's a pretty user-friendly bot, that can scrape up to 100 results per keyword (I wish it could scrape 1 million results/keyword too, but ... it's almost impossible).
You have to input this stuff before you click start:
- of course keywords
- delay
- retries if blocked (meaning that if that's set to 3, if the bot gets blocked 3 times consecutive, it will stop)
- results per keywords
- and the ability to use google dorks
About the google dorks, if you don't know about them, take a look here. If you want to find for example very targeted tumblr blogs that are related to the keyword stars you'll have to do something like this:
Code:
site:tumblr.com inurl:tumblr.com/starsThe bot is returning for each result this:
- title
- url
- description
- main domain
Observation: Make sure your delay is at least 5 seconds, because if you abuse from it, you'll get blocked pretty quick. If you have a list of 100 keywords, I would suggest to set it to 60 seconds, and leave it running in background. I haven't tested it big time yet, but ... if you keep the delay up, I am pretty sure that it will do what you want.
Hope you guys like it
Here is a screenshot:
Download Link: http://www.mediafire.com/download/c75u597m8yazd2x/Google_Scraper.zip
VirusTotal Scan: https://www.virustotal.com/en/file/...007e3571a8e4e871bb10e71c/analysis/1401387149/
Last edited:
