Decent Google query for proxy lists?

macdonjo3 · Aug 15, 2014

Does anyone know a decent Google query/dork that yields some nice proxy lists for a crawler?

I'm not talking a simple query like "free proxy lists", but something a bit more advanced, that actually checks for IP

ort proxies on the page.

I wonder what queries Scrapebox uses.

proxygo · Aug 16, 2014

problem is not all software vendors will give away there methods mate
hell i scan thousands google proxies everday but dont need to check them as
i no there google passed...

Repulsor · Aug 16, 2014

I would say your best bet is to find a list of proxy sites which provides fresh proxies on a daily basis, write a script to pull the file link from each of them, and then crank it up

I would move that way. Well, each site would be different. Seems like you are a coder, so you know how to handle it right?

bartosimpsonio · Aug 16, 2014

macdonjo3 said:
I wonder what queries Scrapebox uses.

That's easy to find out.

Download Wireshark and set it to sniff on all traffic. Run scrapebox and let it scrape proxies. Close scrapebox. Open wireshark and see what it captured - it'll reveal all of scrapebox's queries.

macdonjo3 · Aug 16, 2014

Repulsor said:
I would say your best bet is to find a list of proxy sites which provides fresh proxies on a daily basis, write a script to pull the file link from each of them, and then crank it up

I would move that way. Well, each site would be different. Seems like you are a coder, so you know how to handle it right?

Yeah, I could do that. I'm doing the scraping with just simple regex to find the proxies in the HTML, looking to keep it simple.

bartosimpsonio said:
That's easy to find out.

Download Wireshark and set it to sniff on all traffic. Run scrapebox and let it scrape proxies. Close scrapebox. Open wireshark and see what it captured - it'll reveal all of scrapebox's queries.

Yeah I know. Figured I'd ask around before bothering to do that lol

akacash · Aug 17, 2014

https://www.google.com/#q=":8080"+":3128"&tbs=qdr:d. You can add/edit things as you see fit, but that will return everything within the last week. It's not the holy grail or anything, but I think it'll point you in the right direction at least. Hope it helps and have a good day.

macdonjo3 · Aug 17, 2014

akacash said:
https://www.google.com/#q=":8080"+":3128"&tbs=qdr:d. You can add/edit things as you see fit, but that will return everything within the last week. It's not the holy grail or anything, but I think it'll point you in the right direction at least. Hope it helps and have a good day.

Yeah, I've found some queries like this. They work not too bad.

Decent Google query for proxy lists?

macdonjo3

Elite Member

proxygo

Elite Member

Repulsor

Senior Member

bartosimpsonio

Elite Member

macdonjo3

Elite Member

akacash

Senior Member

macdonjo3

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World