How to use proxy and bypass google captcha to scrape search results ?

[st1ng81]

I am trying to scrape google search results. But when I try to use a proxy, the google search page displays captcha. I am trying to scrape related questions section hence I am using Selenium for it.

After researching I found out that I need some private proxy ips which google allows. Which is the best service where I can buy these ips?

 

[Deleted member 657006]

have you looked on this forum under proxys yet....

 

[Deleted member 657006]

https://www.blackhatworld.com/forums/proxies-for-sale.112/

i think you might be ok cheap ipv6 proxys

 

[stressfree]

You might be better looking at rotating proxies rather than private proxies. These just change the IP provided to you every 15 minutes or so, this means when your proxy is banned you get a new one without having to manually do anything.

 

[st1ng81]

have you looked on this forum under proxys yet....

Yes, and I am totally confused as which would work for google. Any recommendations?

 

[stressfree]

Yes, and I am totally confused as which would work for google. Any recommendations?

He just likes to post a lot, I don't think he actually knows anything or has tried to scrape google results.

In my experience, you want rotating proxies.

 

[Gogol]

Even free proxies will do the work (but they stay for a few seconds and become dead) if they are google passed proxies.

If you use paid ones, those will remain longer. Go to the marketplace -> proxies for sale section and see which seller supports that. Ask in the bst first if unsure.