Scraping google - clicks vs direct links question

amailman

Newbie
Joined
Jul 20, 2014
Messages
20
Reaction score
4
So I am attempting to scrape some information from google. I know after 50ish urls i get a CAPTCHA. I am curious if this will show up less if I am actually writing a script that navigates through their website via clicking their links, like clicking the "next" button instead of using the url for the next page. Does anyone have suggestions or experience with this?
 
IP issue is 99% the culprit.

Are you using public proxies or a VPN of some kind?
 
Use a VPN. I get this when I am using keyword tools. When I reach the first captcha, I change the VPN location and then carry on.
 
Back
Top