How to use proxy and bypass google captcha to scrape search results ?

st1ng81

st1ng81

Registered Member
Joined
May 15, 2011
Messages
61
Reaction score
6
I am trying to scrape google search results. But when I try to use a proxy, the google search page displays captcha. I am trying to scrape related questions section hence I am using Selenium for it.

After researching I found out that I need some private proxy ips which google allows. Which is the best service where I can buy these ips?
 
Advertise on BHW
have you looked on this forum under proxys yet....
 
You might be better looking at rotating proxies rather than private proxies. These just change the IP provided to you every 15 minutes or so, this means when your proxy is banned you get a new one without having to manually do anything.
 
st1ng81 said:
Yes, and I am totally confused as which would work for google. Any recommendations?
Click to expand...

He just likes to post a lot, I don't think he actually knows anything or has tried to scrape google results.

In my experience, you want rotating proxies.
 
Even free proxies will do the work (but they stay for a few seconds and become dead) if they are google passed proxies.

If you use paid ones, those will remain longer. Go to the marketplace -> proxies for sale section and see which seller supports that. Ask in the bst first if unsure.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top