BozoClown
Junior Member
- Jan 4, 2009
- 150
- 110
Bolt celebrated early, why can't I.
I mark my 2nd centenary post and Jr. VIP status with a perl script to grab
proxies from sam*air.ru, which according to many has the most
comprehensive and up to date proxy list. I am sure anybody who has used
this site would wish there was an easier way of sorting through those
proxies. This is what the script does, gives you a simple standard list in the
form of ip
ort and nothing else.
You need to have perl installed. I wrote it on a gentoo linux machine and also
tested it to make sure it works on windows.
Linux users
You will need to download and install these additional modules
which should be very easy using your distributions main package installer.
*Data-Dumper
*File-Slurp
*HTML-TableExtract
*libwww-perl
No need to download those that I provide in required_modules.zip
(I have not tested this, but I see no reason why it should not work)
If you cannot install those modules then you can download
required_modules.zip open up the .bat file add #!/usr/bin/sh at the top of
the file, change all occurrences of "nmake" to "make", and "cd.." to "cd ..",
change the file extension to .sh and make it executable then run it to
compile and install the modules.
Windows users
You can get perl from http://www.activestate.com/Products/activeperl/index.mhtml, get the
standard distribution. Since it is not so easy to download and install the required modules,
I decided to include them together with a simple .bat installer. After you have installed
perl, run the .bat file in the required_modules.zip folder. It should compile and install the
modules for you in about a minute or two. You can then delete it afterwards.
Using the script.
Go to the folder that contains the script and from the terminal or commandline run
This should give you a list of all proxies on sam*air.ru
If you want only proxies from china
To get proxies minus those from pakistan
To get transparent proxies from Italy
If you want to leave out codeen proxies
For countries with two separate words you will have to attach a - to each of the words eg
Redirect output to a text file
This gets high anonymous proxies from the micro nation of ladonia and saves
the list in filename.txt
Remember: No space between the - and the command line argument. You
can use partial country names eg swit for switzeland, ir of iraq and iran, etc.
To filter united states proxies, the words are separate as you can see on the
samair website.
Be kind to the sam*air.ru server
I noticed while writing the script that the sam*air server does some kind of
load balancing by shutting down for up to one minute when it senses a
heavy load. So do not run this script repeatedly. The owner also made it
hard for other people to create scripts that scrape proxies off his site by
encrypting part of the ips. If this script is abused and sam*air.ru
changes the encryption method even the slightest, the script will not work
any more.
PS: For those using the modules I have included, they are downloaded from
the cpan website on the date of this posting. Either way, run a virus scan
against all the files.
Cheers,
BozoClown
I mark my 2nd centenary post and Jr. VIP status with a perl script to grab
proxies from sam*air.ru, which according to many has the most
comprehensive and up to date proxy list. I am sure anybody who has used
this site would wish there was an easier way of sorting through those
proxies. This is what the script does, gives you a simple standard list in the
form of ip
You need to have perl installed. I wrote it on a gentoo linux machine and also
tested it to make sure it works on windows.
Linux users
You will need to download and install these additional modules
which should be very easy using your distributions main package installer.
*Data-Dumper
*File-Slurp
*HTML-TableExtract
*libwww-perl
No need to download those that I provide in required_modules.zip
(I have not tested this, but I see no reason why it should not work)
If you cannot install those modules then you can download
required_modules.zip open up the .bat file add #!/usr/bin/sh at the top of
the file, change all occurrences of "nmake" to "make", and "cd.." to "cd ..",
change the file extension to .sh and make it executable then run it to
compile and install the modules.
Windows users
You can get perl from http://www.activestate.com/Products/activeperl/index.mhtml, get the
standard distribution. Since it is not so easy to download and install the required modules,
I decided to include them together with a simple .bat installer. After you have installed
perl, run the .bat file in the required_modules.zip folder. It should compile and install the
modules for you in about a minute or two. You can then delete it afterwards.
Using the script.
Go to the folder that contains the script and from the terminal or commandline run
Code:
getproxies.pl
If you want only proxies from china
Code:
getproxies.pl china
To get proxies minus those from pakistan
Code:
getproxies.pl -pakistan
To get transparent proxies from Italy
Code:
getproxies.pl transparent italy
If you want to leave out codeen proxies
Code:
getproxies.pl -codeen
For countries with two separate words you will have to attach a - to each of the words eg
Code:
getproxies.pl -united -states
Redirect output to a text file
Code:
getproxies.pl high anonymous ladonia >> filename.txt
the list in filename.txt
Remember: No space between the - and the command line argument. You
can use partial country names eg swit for switzeland, ir of iraq and iran, etc.
To filter united states proxies, the words are separate as you can see on the
samair website.
Be kind to the sam*air.ru server
I noticed while writing the script that the sam*air server does some kind of
load balancing by shutting down for up to one minute when it senses a
heavy load. So do not run this script repeatedly. The owner also made it
hard for other people to create scripts that scrape proxies off his site by
encrypting part of the ips. If this script is abused and sam*air.ru
changes the encryption method even the slightest, the script will not work
any more.
PS: For those using the modules I have included, they are downloaded from
the cpan website on the date of this posting. Either way, run a virus scan
against all the files.
Cheers,
BozoClown
