1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to detect valid proxy server?

Discussion in 'Proxies' started by livelybrowser, Dec 15, 2008.

  1. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    Hello everyone,

    I want to create an appilcation to automatically detect valid proxy servers.
    However, now I don't have a good idea on how to implement it in detail.
    The only one method that I can use is detecting random IP and port.
    Is there any good idea? Thanks.

    Sincerely,

    Lively Browser
     
  2. mjayson

    mjayson Junior Member

    Joined:
    Jun 7, 2008
    Messages:
    108
    Likes Received:
    10
    A simple solution would be using a service like maxmind - they got a proxy score service but ya gotta pay a few pennies.
     
    • Thanks Thanks x 1
  3. flow

    flow Regular Member

    Joined:
    Oct 3, 2008
    Messages:
    356
    Likes Received:
    112
    Check ping time ?
     
  4. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    I want to build a proxy model in my own appilcation. The main purpose is detecting valid proxy server. Then I can use this proxy automatically for my users. So I don't want a proxy list, I want a random detected proxies.
     
  5. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    Could you tell me a little more detail? Thanks.
     
  6. mjayson

    mjayson Junior Member

    Joined:
    Jun 7, 2008
    Messages:
    108
    Likes Received:
    10
    In that case just find a list with standard proxy ports and try to fetch ex. google.com through these ports - maybe also through socks5. However you should probably get some BP hosting for that.
     
    • Thanks Thanks x 1
  7. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    I found most proxies using 80 and 8080 as port.
    So I think I can only detect these two ports.
    Do you think so?

    And I can use random IP to fetch google.com.
    If it success, then found a valid proxy, else checking next.
    Do you think this method would work?

    BTW:
    Could you tell me what does "get some BP hosting" mean?
    Thank you very much for your help. :)
     
  8. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    Are you sure you know what anonymity is about ?
    How proxies work, what makes the difference of the anonymity levels etc ?

    To be honest: You sound a bit confused, maybe better get more knowhow about it. Use the different proxies and see differences for yourself.
    If you create an app early with so little background knowledge it's likely not to be a success.

    Play around, test socks, http, web proxies.
    also learn about the various http server headers
     
    • Thanks Thanks x 1
  9. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    Hi, thanks for your suggestion.

    In fact, I only want http proxy.
    I have already used http proxy in my application currently.
    Now the problem is I don't know how to get such a http proxy list.
    The only method I can use is detecting random IP and port.

    I know there is different proxy type, socks, http, web proxies.
    They are basing on different network level.
    However, I only need http proxy now.
     
  10. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    Thanks very very much. :D

    Yes. you give you just the idea which I want.

    1) Finding proxies can be considered an illigal activity for your ISP? This may be a problem. Have you encounted this issue before?

    2) Using muti-threads. This is sure. I think using 100-500 threads to check. However, I am afraid the problem in 1), may be banned by ISP.

    3) Selecting an IP range. Good idea.
     
  11. livelybrowser

    livelybrowser Senior Member

    Joined:
    Nov 20, 2008
    Messages:
    935
    Likes Received:
    371
    Home Page:
    I don't think 100-500 threads just for detecting proxy will cost a lot of bandwidth. However, I will test it. :D
     
  12. justone

    justone Elite Member

    Joined:
    Oct 12, 2008
    Messages:
    1,516
    Likes Received:
    1,037
    Occupation:
    -
    Location:
    Europe
    Actually 500 threads is a complete overkill.
    I've scanned billions of IPs within a few days with 0 threads :)

    500 threads would probably lag your cpu half dead and reduce the performance ,no ?
     
  13. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,747
    Likes Received:
    5,039
    Location:
    ScrapeBox v2.0
    Home Page:
    I have got a proxy list verifier tool, this one:

    Code:
    http://www.anonymousproxylist.net/
    Is that what you are after, something like that?