AdWords Ads Scraper

[macmastermike]

i want to develop a little tool where i can get all the ads shown for a special searchterm in google/msn/yahoo.

you all know the problem: if you scrape google several times a day google will block your ip. and it's also breaking googles TOS.

so how does ppcbully or keywordspy get their data? are they breaking googles TOS? or is there somekind of webservice from google where you can get all the data?

or can you call google and make a contract with them so you can build tools using the serps?

maybe someone has an idea or made a tool like this before...

 

[macmastermike]

Sorry the "double-post"... got an Error500 while sending this post so now there's an empty thread with the same title...

 

[xxMP3xx]

May be they are usign some sort of proxy service in the server, to which u r requesting the keyword.

 

[Innercore]

Hi
I used keyword spy and it has 2 options to scrape.
1.Using built in proxies
2.Without proxies but after sometime,you will get a temp ban on your Ip.

I hope this info will help you in someway

thanks

 

[nipester]

PPC bully is most likely using thousands of premium proxy IPs scattered all across the world and most densely concentrated in the US. There is not other way that they can scrape all that data and get away with it.

 

[macmastermike]

hmm guess so too... so a tool like ppc bully is actually completely against googles TOS ? why doesn't google sue that companys then?

 

[195471]

hmm guess so too... so a tool like ppc bully is actually completely against googles TOS ? why doesn't google sue that companys then?

Google tends to turn a blind eye to such things if they somehow benefit financially from them. (Read the blogs of Aaron Wall and Michael Gray if in doubt.) If these types of software programs and services encourage more people to spend money on AdWords (by making it seem easy to profit), then it's good for Google. I'm sure the number of people scraping Google is tiny in comparison to the number of people using their search engine every day. The anti-scraping part of the TOS might only be there to deter people and won't necessarily be enforced.