Decent Google query for proxy lists?

macdonjo3

Elite Member
Jr. VIP
Joined
Nov 8, 2009
Messages
8,887
Reaction score
9,192
Does anyone know a decent Google query/dork that yields some nice proxy lists for a crawler?

I'm not talking a simple query like "free proxy lists", but something a bit more advanced, that actually checks for IP:port proxies on the page.

I wonder what queries Scrapebox uses.
 
I would say your best bet is to find a list of proxy sites which provides fresh proxies on a daily basis, write a script to pull the file link from each of them, and then crank it up :D

I would move that way. Well, each site would be different. Seems like you are a coder, so you know how to handle it right?
 
I wonder what queries Scrapebox uses.

That's easy to find out.

Download Wireshark and set it to sniff on all traffic. Run scrapebox and let it scrape proxies. Close scrapebox. Open wireshark and see what it captured - it'll reveal all of scrapebox's queries.
 
I would say your best bet is to find a list of proxy sites which provides fresh proxies on a daily basis, write a script to pull the file link from each of them, and then crank it up :D

I would move that way. Well, each site would be different. Seems like you are a coder, so you know how to handle it right?
Yeah, I could do that. I'm doing the scraping with just simple regex to find the proxies in the HTML, looking to keep it simple.

That's easy to find out.

Download Wireshark and set it to sniff on all traffic. Run scrapebox and let it scrape proxies. Close scrapebox. Open wireshark and see what it captured - it'll reveal all of scrapebox's queries.
Yeah I know. Figured I'd ask around before bothering to do that lol
 
Back
Top