Update
Ok, the first version of the SERP scraper is now released.. If you are somewhat familiar with BECPoster, it should be pretty straight forward..
Base Query
This is where you type in your base keywords i.e.:
+"Notify me when new comments are added" +"powered by blogengine.net"
Wordlist File
Your text file with words to append to your base query, words are seperated by line break
- 'delete word from file after each scrape' - this will delete the word from your wordlist file, helping you keep track of how far you came in case you wanna abort the scrape.
Search Google for inurl:wordlist.txt and see if you can find some good wordlists - I am not going to release a wordlist together with the program for obvious reasons
Save To
Just create a new text file and choose it. This is where the scraped urls get saved.
User Agents File
Very important file to confuse Google -
download one here
Timeout Between Requests
The program will pick a random value between the values you set here.. I've tested with 12-24 seconds, ran the program for 8 hours straight, and didn't get banned, I recieved a 403 (forbidden) for some keywords at like page 8 or 9 from google, but when the program went to the next word with a new user agent, the ban was gone...
Proxies
The program runs without proxies as you don't get banned when using realistic timeout values.
Download the program
Dont forget to register your client id here
Once again I will leave it up to somebody else to virus test it. Please report any bugs you may find, and let me know what you think.. Thanks..
