1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Decent Google query for proxy lists?

Discussion in 'Proxies' started by macdonjo3, Aug 15, 2014.

  1. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,563
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    Does anyone know a decent Google query/dork that yields some nice proxy lists for a crawler?

    I'm not talking a simple query like "free proxy lists", but something a bit more advanced, that actually checks for IP:port proxies on the page.

    I wonder what queries Scrapebox uses.
     
  2. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,228
    Likes Received:
    8,693
    problem is not all software vendors will give away there methods mate
    hell i scan thousands google proxies everday but dont need to check them as
    i no there google passed...
     
  3. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    708
    Likes Received:
    267
    Location:
    PHP Scripting ;)
    I would say your best bet is to find a list of proxy sites which provides fresh proxies on a daily basis, write a script to pull the file link from each of them, and then crank it up :D

    I would move that way. Well, each site would be different. Seems like you are a coder, so you know how to handle it right?
     
  4. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    8,862
    Likes Received:
    7,467
    Occupation:
    ZLinky2Buy SEO Services
    Location:
    ⇩⇩⇩⇩⇩⇩⇩⇩⇩⇩⇩⇩
    Home Page:
    That's easy to find out.

    Download Wireshark and set it to sniff on all traffic. Run scrapebox and let it scrape proxies. Close scrapebox. Open wireshark and see what it captured - it'll reveal all of scrapebox's queries.
     
  5. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,563
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    Yeah, I could do that. I'm doing the scraping with just simple regex to find the proxies in the HTML, looking to keep it simple.

    Yeah I know. Figured I'd ask around before bothering to do that lol
     
  6. akacash

    akacash Jr. VIP Jr. VIP

    Joined:
    Jan 16, 2010
    Messages:
    807
    Likes Received:
    576
    Location:
    The Beach, USA
    https://www.google.com/#q=":8080"+":3128"&tbs=qdr:d. You can add/edit things as you see fit, but that will return everything within the last week. It's not the holy grail or anything, but I think it'll point you in the right direction at least. Hope it helps and have a good day.
     
  7. macdonjo3

    macdonjo3 Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 8, 2009
    Messages:
    5,563
    Likes Received:
    4,317
    Location:
    Toronto
    Home Page:
    Yeah, I've found some queries like this. They work not too bad.