1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Proxy Leeching By Hand - Because FPL is stupid

Discussion in 'Proxies' started by apekillape, Aug 19, 2008.

  1. apekillape

    apekillape Senior Member Premium Member

    Joined:
    Dec 13, 2007
    Messages:
    1,077
    Likes Received:
    1,441
    Occupation:
    Basically, I just walk the Earth.
    Location:
    The Layer Cake
    Note: If you don't yet know how to run a proxy checker, check this thread (http://www.blackhatworld.com/blackh...rty-guide-charon-free-good-proxy-checker.html) for a quickstart guide to using Charon 6.
    -------------------------------------------------------------------

    There are several proxy leeching tools around, and in my personal experience (I'd never say I'm not biased, so take everything with that modifier) they're invariably hot garbage. For one thing, you need to know enough to be able to build your own leech list or you're stuck using the one provided with the program. Which means every scrub using that program will be using the same list, you'll all have the same garbage/outdated proxies, and everything goes to pot.

    On top of that, you often end up with massive lists of dead or barely-responsive proxies, which take forever to check (assuming anyone ever bothers in the first place) as 100,000 dead proxies still have to be pinged individually. It's ridiculous to bother with all those dead-ends when you could just stick to 2-3 main sources and harvest your own personalized, fresh off the vine lists.

    These are the top 5 forums from which I would recommend grabbing your proxy lists from. The reason I prefer these to (your friend's random shitty samair scrape) is that by and large, many proxy posts on other forums are just cross-posted or outright copied from the posters on these. You could really make do with just one or two of the forums here, but as the idea is to start with as realistically large a number of working proxies to check (3,000 that were reported up in the last 24 hours are much more reliable than 100,000 that you randomly scraped from a year-old chinese proxy site) you might as well grab every unique post from the subforum you're after (HTTP, Socks, etcetera) and paste them all into your preferred checking tool until you start getting too many duplicates to be bothered.

    This is gonna be real simple:

    1) Join the forum. If you're after HTTP proxies, go to the HTTP area. If you're after Socks proxies, go to the Socks area.

    2) Click every post in that area (HTTP or Socks) in the last 24 hours, and copy the IP list into your Proxy Checker.

    3) Move to the next forum. Repeat.

    When you've got a couple thousand pasted in or you're not getting more than a few unique IPs per post, run your checker and reap the rewards. Congratulations, you've got a proxy list of your very own to use for whatever civically-minded (I'm sure) purpose you had in mind.

    Forums:
    Proxyfire.net
    HTTP Area
    Socks Area

    Proxie Central
    HTTP Area
    Socks Area

    DCS Proxy
    HTTP Area
    Socks Area

    Proxy Hispano
    HTTP Area
    Socks Area

    Remember to join the forums first. And don't just grab one post and think "Oh, it didn't work!". Grab all the posts in that area in each forum for the last 24 hours at least.

    Also, it couldn't hurt to actually dick around on the forums and become a decent member. You might learn a few things and end up sticking around.

    N

    PS: Seriously, don't piss off Lorissa. She'll kill you.
     
    • Thanks Thanks x 152
    Last edited: Jan 25, 2009
  2. apekillape

    apekillape Senior Member Premium Member

    Joined:
    Dec 13, 2007
    Messages:
    1,077
    Likes Received:
    1,441
    Occupation:
    Basically, I just walk the Earth.
    Location:
    The Layer Cake
    • Thanks Thanks x 1
  3. erickjes

    erickjes Registered Member

    Joined:
    Aug 12, 2008
    Messages:
    76
    Likes Received:
    11
    I have been reading your posts to try to understand proxies as best as possible...now you said to "run your checker"...would my "checker" be Charon that you talked about in another post....this is probably a dumb question, and I'm a noob :)
     
  4. erickjes

    erickjes Registered Member

    Joined:
    Aug 12, 2008
    Messages:
    76
    Likes Received:
    11
    OK I just re-read the Charon post...nevermind about what I just asked lol
     
  5. aliskorn

    aliskorn Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 21, 2008
    Messages:
    484
    Likes Received:
    459
    Occupation:
    Psychologist & programmer
    Great post apekillape,you`re my hero now that tubeincreaser proxy list doesn`t work anymore :D
     
  6. veni

    veni Junior Member

    Joined:
    Nov 23, 2008
    Messages:
    141
    Likes Received:
    11
    thanks for another great post. Very detailed.:)
     
  7. ShadeDream

    ShadeDream Elite Member

    Joined:
    Nov 27, 2008
    Messages:
    2,209
    Likes Received:
    5,230
    Location:
    He who laughs last, laughs longest.
    Great share and very detailed. Thanks. :)
     
  8. fulcanelli

    fulcanelli Jr. VIP Jr. VIP

    Joined:
    Jan 10, 2009
    Messages:
    247
    Likes Received:
    163
    Location:
    USA
    This tutorial works for me and helped a lot. Even this method does get you some dead/slow proxies but works really well regardless.. thank you.
     
  9. flow

    flow Regular Member

    Joined:
    Oct 3, 2008
    Messages:
    356
    Likes Received:
    112
    What's a normal ratio for good proxies? I compiled 2300 and only got 360 working proxies. Lists were less than day old, some were very recently posted. I changed from internal judge to external judge halfway through.. and the list was reduced at some point to 1300 proxies to be scanned for some reason

    On a side note I'm getting good results from Samair list...
     
    Last edited: Jan 26, 2009
  10. apekillape

    apekillape Senior Member Premium Member

    Joined:
    Dec 13, 2007
    Messages:
    1,077
    Likes Received:
    1,441
    Occupation:
    Basically, I just walk the Earth.
    Location:
    The Layer Cake
    Depends on a lot of factors, though 2300 out of 360 makes sense in a lot of cases.

    You might have gotten half of the working ones from the same list even. I tell people to start this way so they can get the hang of the whole thing, ideally one can figure out what sources work best for them after doing this for a while and won't have to grab every single list ever.

    N
     
  11. garciabogard

    garciabogard Regular Member

    Joined:
    Sep 18, 2008
    Messages:
    231
    Likes Received:
    127
    hey apekillape ..first of all thanks for taking time to write such a wonderful and informative post! well what i want to know is.. isn't there a scanner? like we can scan a whole A class. 64.1.1.1 - 64.255.255.255 for port 80 and 8080. it will take a few hours but then, we will end up with a list of our own, and after running a check we will have goldmine :>

    Is there any scanner like that which is fast?
     
  12. apekillape

    apekillape Senior Member Premium Member

    Joined:
    Dec 13, 2007
    Messages:
    1,077
    Likes Received:
    1,441
    Occupation:
    Basically, I just walk the Earth.
    Location:
    The Layer Cake
    First and foremost, scanning ranges willy-nilly is not for the faint of heart. Most ISPs will give you the boot for it, and if you scan the wrong ones worse could happen.

    Secondly, for most uses I have I wouldn't want to be in the same IP block anyway. If I wanted to post from 64.***.***.*** over and over again, I'd just buy a block myself.

    N
     
  13. sinewave

    sinewave Senior Member Premium Member

    Joined:
    Aug 25, 2007
    Messages:
    972
    Likes Received:
    503
    I've a quick question: Do you have any idea what would cause Proxy Firewall to find all "bad" links on one machine on my network, but not another.

    I like to keep proxy activity confined to only one machine at a time so that I can use the other for normal activities and communications, but PF turned up goose eggs on a fairly fresh list today on that PC. It *appeared* to be operating as it had before. It worked fine on another.

    I know this isn't a PF support forum, but thanks in advance for any insight.
     
    Last edited: Feb 23, 2009
  14. apekillape

    apekillape Senior Member Premium Member

    Joined:
    Dec 13, 2007
    Messages:
    1,077
    Likes Received:
    1,441
    Occupation:
    Basically, I just walk the Earth.
    Location:
    The Layer Cake
    Could be something in the port settings and all. Are the machines identical?

    N
     
  15. sinewave

    sinewave Senior Member Premium Member

    Joined:
    Aug 25, 2007
    Messages:
    972
    Likes Received:
    503
    Not identical exactly, but they're close. I didn't have a problem on the machine in question previously.
     
  16. ibnorm

    ibnorm Newbie

    Joined:
    May 25, 2008
    Messages:
    32
    Likes Received:
    5
    Location:
    High Dessert
    Thanks, this really will help. Great post.
     
  17. sinewave

    sinewave Senior Member Premium Member

    Joined:
    Aug 25, 2007
    Messages:
    972
    Likes Received:
    503
    I got my PF issue sorta resolved by uninstalling and reinstalling. Not very elegant, but effective.

    Hey, I was wondering about your opinion of ProxyFire Master Suite.

    Thanks again.
     
  18. yarjar

    yarjar Junior Member

    Joined:
    Feb 13, 2009
    Messages:
    132
    Likes Received:
    183
    Occupation:
    Student...
    Location:
    Madison, WI, USA
    Incredibly awesome info, thanks for the tip. Especially since proxy checkers on Linux appear to be non-existent, this is very helpful. P.S. if anyone DOES know of any proxy checkers for Linux, drop me a note...
     
  19. A_Tjuh

    A_Tjuh Regular Member

    Joined:
    Mar 16, 2009
    Messages:
    227
    Likes Received:
    50
    Occupation:
    Technical IT Specialist
    Location:
    @ My Place
    Home Page:
    Thanks for sharing the information. Its a good read and detailed. Now getting it automated with a little vb and .net :)
     
  20. willamsjoy

    willamsjoy Newbie

    Joined:
    Mar 11, 2009
    Messages:
    41
    Likes Received:
    1
    but bro.. i want to know what's fpl? thanks