Note: If you don't yet know how to run a proxy checker, check this thread (http://www.blackhatworld.com/blackha...y-checker.html) for a quickstart guide to using Charon 6.
-------------------------------------------------------------------

There are several proxy leeching tools around, and in my personal experience (I'd never say I'm not biased, so take everything with that modifier) they're invariably hot garbage. For one thing, you need to know enough to be able to build your own leech list or you're stuck using the one provided with the program. Which means every scrub using that program will be using the same list, you'll all have the same garbage/outdated proxies, and everything goes to pot.

On top of that, you often end up with massive lists of dead or barely-responsive proxies, which take forever to check (assuming anyone ever bothers in the first place) as 100,000 dead proxies still have to be pinged individually. It's ridiculous to bother with all those dead-ends when you could just stick to 2-3 main sources and harvest your own personalized, fresh off the vine lists.

These are the top 5 forums from which I would recommend grabbing your proxy lists from. The reason I prefer these to (your friend's random shitty samair scrape) is that by and large, many proxy posts on other forums are just cross-posted or outright copied from the posters on these. You could really make do with just one or two of the forums here, but as the idea is to start with as realistically large a number of working proxies to check (3,000 that were reported up in the last 24 hours are much more reliable than 100,000 that you randomly scraped from a year-old chinese proxy site) you might as well grab every unique post from the subforum you're after (HTTP, Socks, etcetera) and paste them all into your preferred checking tool until you start getting too many duplicates to be bothered.

This is gonna be real simple:

1) Join the forum. If you're after HTTP proxies, go to the HTTP area. If you're after Socks proxies, go to the Socks area.

2) Click every post in that area (HTTP or Socks) in the last 24 hours, and copy the IP list into your Proxy Checker.

3) Move to the next forum. Repeat.

When you've got a couple thousand pasted in or you're not getting more than a few unique IPs per post, run your checker and reap the rewards. Congratulations, you've got a proxy list of your very own to use for whatever civically-minded (I'm sure) purpose you had in mind.

Forums:
Proxyfire.net
HTTP Area
Socks Area

Proxie Central
HTTP Area
Socks Area

DCS Proxy
HTTP Area
Socks Area

Proxy Hispano
HTTP Area
Socks Area

Remember to join the forums first. And don't just grab one post and think "Oh, it didn't work!". Grab all the posts in that area in each forum for the last 24 hours at least.

Also, it couldn't hurt to actually dick around on the forums and become a decent member. You might learn a few things and end up sticking around.

N

PS: Seriously, don't piss off Lorissa. She'll kill you.

Can't edit, this is the aforementioned thread:

http://www.blackhatworld.com/blackha...y-checker.html

Leech with this post, check with that one.

N

I have been reading your posts to try to understand proxies as best as possible...now you said to "run your checker"...would my "checker" be Charon that you talked about in another post....this is probably a dumb question, and I'm a noob

OK I just re-read the Charon post...nevermind about what I just asked lol

Great post apekillape,you`re my hero now that tubeincreaser proxy list doesn`t work anymore

thanks for another great post. Very detailed.

Great share and very detailed. Thanks.

This tutorial works for me and helped a lot. Even this method does get you some dead/slow proxies but works really well regardless.. thank you.

What's a normal ratio for good proxies? I compiled 2300 and only got 360 working proxies. Lists were less than day old, some were very recently posted. I changed from internal judge to external judge halfway through.. and the list was reduced at some point to 1300 proxies to be scanned for some reason

On a side note I'm getting good results from Samair list...

Depends on a lot of factors, though 2300 out of 360 makes sense in a lot of cases.

You might have gotten half of the working ones from the same list even. I tell people to start this way so they can get the hang of the whole thing, ideally one can figure out what sources work best for them after doing this for a while and won't have to grab every single list ever.

N

hey apekillape ..first of all thanks for taking time to write such a wonderful and informative post! well what i want to know is.. isn't there a scanner? like we can scan a whole A class. 64.1.1.1 - 64.255.255.255 for port 80 and 8080. it will take a few hours but then, we will end up with a list of our own, and after running a check we will have goldmine :>

Is there any scanner like that which is fast?

First and foremost, scanning ranges willy-nilly is not for the faint of heart. Most ISPs will give you the boot for it, and if you scan the wrong ones worse could happen.

Secondly, for most uses I have I wouldn't want to be in the same IP block anyway. If I wanted to post from 64.***.***.*** over and over again, I'd just buy a block myself.

N

I've a quick question: Do you have any idea what would cause Proxy Firewall to find all "bad" links on one machine on my network, but not another.

I like to keep proxy activity confined to only one machine at a time so that I can use the other for normal activities and communications, but PF turned up goose eggs on a fairly fresh list today on that PC. It *appeared* to be operating as it had before. It worked fine on another.

I know this isn't a PF support forum, but thanks in advance for any insight.

Could be something in the port settings and all. Are the machines identical?

N

Originally Posted by apekillape

Are the machines identical?

N

Not identical exactly, but they're close. I didn't have a problem on the machine in question previously.

Thanks, this really will help. Great post.

I got my PF issue sorta resolved by uninstalling and reinstalling. Not very elegant, but effective.

Hey, I was wondering about your opinion of ProxyFire Master Suite.

Thanks again.

Incredibly awesome info, thanks for the tip. Especially since proxy checkers on Linux appear to be non-existent, this is very helpful. P.S. if anyone DOES know of any proxy checkers for Linux, drop me a note...

Thanks for sharing the information. Its a good read and detailed. Now getting it automated with a little vb and .net

but bro.. i want to know what's fpl? thanks

and now i know the fpl..

anyways thanks for the share good stuff.. thumbs up.

Forum Proxy Leecher. It may or may not work for some people, I've just always felt it's completely inferior to more manual and direct methods.

N

I've been searching for proxy for past 2 weeks with no avail. Thanks for this.

The possibility is boundless if I can find reliable proxies to use to drive traffic. I'm so excited! here comes money!

@Apekillape: Thanks for introducing me to all things proxy.

I'm getting lists of thousands of sock proxy IP addresses from forum's, washing them in Charon and importing the successful IP's into ProxyFirewall.

The issue is speed. Whichever IP I use crawls when using it to browse. Some pages are just unresponsive, others take minutes to load. I've set the rule to "change proxy on time out", but this hasn't helped.

Would appreciate your feedback

Hi,
I followed the tut for Charon, and this one for leeching by hand. I got a good list of socks proxies from 3 forums you listed for today, and when I paste them into Charon, I guess Charon automatically starts filtering out the bad ones, and I am left with 5. Is that typical for socks 4 & 5 proxies from checking just the ones from today?

Since I have the same question as the post above I'll go ahead and bump this

I'm a bit confused by the use of the word "automatically". Unless you post the same IP/port twice it doesn't normally remove anything until you start hitting buttons.

John, where exactly are you stuck? You just have a low count after the check?

N

I need a very good proxy to post ads on craigslist....Can anyone be of good help??

Originally Posted by simplyford

I need a very good proxy to post ads on craigslist....Can anyone be of good help??

If only someone wrote a extensive and good method for finding proxies.

Originally Posted by yarjar

Incredibly awesome info, thanks for the tip. Especially since proxy checkers on Linux appear to be non-existent, this is very helpful. P.S. if anyone DOES know of any proxy checkers for Linux, drop me a note...

just search for a web based one, there seem to be a lot

I just use AccessDiver, it has a list of pages it extracts the proxies from, I was able to get 5k working proxies or so by running it once.

Originally Posted by temporary

@Apekillape: Thanks for introducing me to all things proxy.

I'm getting lists of thousands of sock proxy IP addresses from forum's, washing them in Charon and importing the successful IP's into ProxyFirewall.

The issue is speed. Whichever IP I use crawls when using it to browse. Some pages are just unresponsive, others take minutes to load. I've set the rule to "change proxy on time out", but this hasn't helped.

Would appreciate your feedback

Its kind of tough to find the good ones, I think it takes a good sized proxy scraping automated script and then software to filter through this since I have the same issue with most being really slow....

Also, setting it to just change on timeout wouldn't be the best solution because a lot of times it doesn't time out but just goes really slow, I think to really test if its a good proxy, or not, once connecting to it you need to make it do some sort of speed test. I am sure there is a way to integrate this within a script, through a web service or something that offers speed testing.

Originally Posted by ruler0fall

I just use AccessDiver, it has a list of pages it extracts the proxies from, I was able to get 5k working proxies or so by running it once.

where can you get this software? I did a few google searches but nothing specific came up that I could tell.... any other similar softwares that are good, does it scrape lists or do you have to import that? Thanks for any info

Originally Posted by madblacker

Originally Posted by temporary

@Apekillape: Thanks for introducing me to all things proxy.

I'm getting lists of thousands of sock proxy IP addresses from forum's, washing them in Charon and importing the successful IP's into ProxyFirewall.

The issue is speed. Whichever IP I use crawls when using it to browse. Some pages are just unresponsive, others take minutes to load. I've set the rule to "change proxy on time out", but this hasn't helped.

Would appreciate your feedback

Its kind of tough to find the good ones, I think it takes a good sized proxy scraping automated script and then software to filter through this since I have the same issue with most being really slow....

Also, setting it to just change on timeout wouldn't be the best solution because a lot of times it doesn't time out but just goes really slow, I think to really test if its a good proxy, or not, once connecting to it you need to make it do some sort of speed test. I am sure there is a way to integrate this within a script, through a web service or something that offers speed testing.

This is the main issue I have with proxies as well. Many of them are slow as hell.

Does anyone know of any scripts that can take the final list of good proxies and run them through some kind of speedtest and then eliminate the ones that are too slow?

This would be a pretty useful script. If there isn't something already like that, then some of you coders out there who keep asking for ideas on what to make.... here you go. Run a scraped proxy list through a validator and then run the results through a speedtest and then output a decent list of good proxies. Even better if the script could filter by location as well, many things I need proxies for require some geotargeting as well.

Does anyone have any suggestions?

Thanks,
Wolf


@apekillape - good job on the first post. This is a really good tutorial on how to find proxies.

@Greywolf, i used to use a program for proxy speed test
it isn't free, it's a pretty good one, it also leeches the web for proxies if you want or you can load your custom list into the prog and order the list by speed while it's checking the proxies

i'll let you know, if i can find out the name of the program

Originally Posted by HoNeYBiRD

@Greywolf, i used to use a program for proxy speed test
it isn't free, it's a pretty good one, it also leeches the web for proxies if you want or you can load your custom list into the prog and order the list by speed while it's checking the proxies

i'll let you know, if i can find out the name of the program

Cool, that would help a lot.

i know now, it was Proxy Switcher Pro:

Code:

http://www.proxyswitcher.com/

as you can see, you can order the proxies by response in ms, so maybe that's what you're looking for

it has a free lite version, a standard version (with 15 days free trial) and a pro version

i've used a portable pro version, but i've just checked the rar on virustotal and it came up with 2 positive, so i won't upload it here
it worked well tho

but i think you can also do this with charon for example

Great post.
thank you

Checking the speed of the proxy is possible with Scrapebox also.

Man, 5+ years ago proxy leeching was so much more fruitful than today, even just leeching from Google...

Thanks for the help.

Great info...It works excellent...Thanks

very useful information thanks

wow, having joined this forum today, there is so much to learn. good info guys and gals

tks for the great resources apekillape!! It's helped out a lot!