Scraping Google with public proxies?

BeerMe

Junior Member
Joined
Dec 20, 2014
Messages
153
Reaction score
18
Is this possible? I just wasted a bunch of time searching and testing public proxies. None of them worked when trying to scrape Google.
 
Is this possible? I just wasted a bunch of time searching and testing public proxies. None of them worked when trying to scrape Google.

Make sure your user agent is one that throws results.
 
I'd say no, don't use public proxies. They are always super burn't out.
 
Using Public proxies is a total waste of time.... Buy shared proxies ! They cheap to get you what you want.
 
Is this possible? I just wasted a bunch of time searching and testing public proxies. None of them worked when trying to scrape Google.
You will get captcha every time
 
You will get captcha every time

This isn't accurate. You can do it in a controlled manner. Make sure to wait a few seconds between requests and not have all your searches be incremental (ie. very similar but with a few tweaks). For a scalable solution, you really should go with a shared proxy.
 
Back
Top