How can I automate a google query in bulk

I want an automated way to scrape Google for several commands such as intitle:keyword

For example I have a list of 500 potential keywords and I want to see how many results are in Google for each particular command.

I need to find a way to automate this as I'm spending too much time doing it manually.

Well you can always code it

its so easy......... just look at the html and parse it...

php you can use DOM
python BeautifulSoup
C# htmlagility something...

William Rufino said:

Well you can always code it

its so easy......... just look at the html and parse it...

php you can use DOM
python BeautifulSoup
C# htmlagility something...

Click to expand...

anyone capable of doing this for me? what's your price?

Php using curl, i coded a tool to retrieve how many adwords advertisers of every keyword from a list, using a delay you wont need proxies but it will be slow as hell

do it on your own!
here some example autoit code, all you need to do is load your keywordfile and loop through it using the code i have written for you to query qoogle for the count of results.

I could finish your job with a price of $20. If you are interested, PM me.
And I will give you the source code, modify the code is easy and I can teach you everything you need.
BTW: It's quite easy.

I want to do something simliar, but won't google block the IP where the queries are comeing from?

For example,
Let say I have a website that I manage to get a lot of people to use. They run a search of my site, and let's say in this particular instance, only a few results that are on my site, or maybe no results, come up. At that point, I want to display Google search results, as if they were part of my own search results, but shown below the results that are on my site (if any).

I think Google would eventually block my sites IP because if I get a lot of traffic and they are doing searches (which ultimately query Google), google will think its some kind of automated thing and block it.


similar real world example:
PicClick does queries of Craigslist, eBay, etsy. Apparantly, CL blocked PicClick at one point. I can't post links but there is a post on thesundaytimesmarket about this.

So, is thier some solution to this that won't slow down the searches?
I think using proxies might slow it down.

Does Google offer a plan so I can pay them to be "powered by Google"?

I ended up purchasing a bot from http://www.blackhatworld.com/blackhat-seo/buy-sell-services/249789-get-your-custom-made-bots-we-can-automate-almost-anything.html and it works great.

Use the tool allinscraper

If you want to be clever about the queries so that you don't get bounced, do two things:
First, spoof your tool to say that the queries are from Firefox or chrome.
Second, use the IP range 74.125.0.1 to 74.125.0.57 instead of Google.com. That is all of their servers (as far as I know) and they keep track of repeat queries separately. Going to Google.com simply auto-assigns one, which is inefficient for mass queries.

ScrapeBox can do this.

Fathom said:

I want an automated way to scrape Google for several commands such as intitle:keyword

For example I have a list of 500 potential keywords and I want to see how many results are in Google for each particular command.

I need to find a way to automate this as I?m spending too much time doing it manually.

Click to expand...

Rank Tracker can do this, too
Besides, you can use such commands as allintitle, allinurl, allinanchor, allintext, inanchor, intext, inurl, and some sequences of these commands.

market samurai is free, and it does this too. It works super well.

bumping this old ass thread. Looking for a tool that does exactly what the OP has described but im struggeling to find anything good.