Best public proxy scraper?

[nYXem]

Hello everyone!

It's been quite a while since I haven't done anything that has involved public proxies. Earlier, I used Proxy Goblin that gave me amazing results. So did a software called Proxy Multiply that was sold here on BHW. But that was of course a very long time back.

What are the best alternatives these days? GSA Proxy Scraper? Anything else that you'd recommend?

I want to use it mostly to scrape Google once in a while. Not looking for paid proxies.

Thanks in advance.

 

[proxygo]

as a proxy seller / tool maker since 2002 - retired 2020
tools like gsa and scrapebox will get you a few hundred scraped
proxies, but the undisputed king of getting public proxies
is by using a PORT SCANNER.

but this requires knowing the ip ranges you wanna scan and
the corresponding ports to scan those ip ranges on.
Port Scanner wins if you have the time to learn ip ranges
and ports you wanna scan.

 

[nYXem]

as a proxy seller / tool maker since 2002 - retired 2020
tools like gsa and scrapebox will get you a few hundred scraped
proxies, but the undisputed king of getting public proxies
is by using a PORT SCANNER.

but this requires knowing the ip ranges you wanna scan and
the corresponding ports to scan those ip ranges on.
Port Scanner wins if you have the time to learn ip ranges
and ports you wanna scan.

Thanks!

Of course port scanning is the best option.

I'm not a fan of Scrapebox proxy scraper as the default sources are useless and finding own sources is not that easy.

Doesn't GSA Proxy Scraper have an inbuilt port scanner? Can it not find good proxies by default, or you must bring your own IP ranges?

If GSA can get me the kind of proxies Proxy Goblin used to out of the box (I'd assume you've used it too, given you're a proxy pro), that would be good enough for me. On top of that, if it can find some more using port scanning, that'll be the cherry on the top.

 

[proxygo]

In the past when i couldnt be bothered to port scan yes i used gsa / scrape box
there great tools for scraping a few hundred proxies. BUT

remember both these tools require an updated list of urls to scrape proxies
from which is why over time with many people still using those tools
even today, the thing you will need most is constant new urls to scrape from
as the proxies on those urls burn out .

put simple - using GSA proxy scraper or Scrape box will get you a few hundred
proxys everyday, no problem at all............

port scanning will get you tens of thousands of public proxies, but only
if you have the IP ranges and ports in a list to scan through .
and ill admit its time consuming making a port scan list .

 

[Anne-Maree]

Can proxy scraper get residential proxy

 

[JasonS]

I'm curious to know the name of this tool?

 

[uncutu]

nice of @proxygo the proxy king to give insight into his configurations

my set up is easy
get charon
find a list of working charon judges
next google "github proxy list" -- find one updated hourly. there's TON of them.
copy/paste it into charon....and let it do its thing.
in fact @proxygo even wrote up a guide on how to use charon many years ago. still works great.

 

[proxygo]

I'm curious to know the name of this tool?

@JasonS the tool is called proxyfire , it was built between
2007 - 2018 , i know i was with the team that built it, but i
left them in 2009 and came to BHW,

now they are no more, there forum is long gone
and i have the only unlocked version of proxyfire gifted to me as a thanks
when i left them,

Can proxy scraper get residential proxy

@Anne-Maree some can but there of little use as most will
be locked behind a password.

nice of @proxygo the proxy king to give insight into his configurations

my set up is easy
get charon
find a list of working charon judges
next google "github proxy list" -- find one updated hourly. there's TON of them.
copy/paste it into charon....and let it do its thing.
in fact @proxygo even wrote up a guide on how to use
charon many years ago. still works great.

ya making me feel old......lol

 

[nYXem]

Does Proxyfire still work? I remember using the Master Suite long ago. Not sure if that exe will work anymore.

Is a working unlocked version available for download anywhere?

@JasonS the tool is called proxyfire , it was built between
2007 - 2018 , i know i was with the team that built it, but i
left them in 2009 and came to BHW,

now they are no more, there forum is long gone
and i have the only unlocked version of proxyfire gifted to me as a thanks
when i left them,



@Anne-Maree some can but there of little use as most will
be locked behind a password.



ya making me feel old......lol

This is a nice simlpe method, thanks!

nice of @proxygo the proxy king to give insight into his configurations

my set up is easy
get charon
find a list of working charon judges
next google "github proxy list" -- find one updated hourly. there's TON of them.
copy/paste it into charon....and let it do its thing.
in fact @proxygo even wrote up a guide on how to use charon many years ago. still works great.

 

[proxygo]

Does Proxyfire still work? I remember using the Master Suite long ago.
Not sure if that exe will work anymore.
Is a working unlocked version available for download anywhere?

This is a nice simlpe method, thanks!

@nYXem all versions of proxyfire master suite where locked
behind a demo and a key , 1 version was made for me privately
set as perma unlocked when i left the team . and it still works today
as good as it did 15 years ago. some things age cant beat ,

the great thing about port scanning public proxies is there
are hundreds of thousands out there, but its knowing where
and how to search across 0.0.0.0 - 255.255.255.255 + port
you could spend months and find nothing without an
exact ip address and port - your firing in the dark.

also most port scanned public proxies cant be scraped
so finding them = unique public proxys.
just for fun i scanned up half a million port scanned proxies
took me 2 hrs - just over 3k worked - but you will never
scrape them........................................................................

 

[uncutu]

any tools out there that come close to proxyfire suite's scanning capabilities?

 

[proxygo]

@uncutu there many small port scanners out there, but 1 with all
the feature proxyfire has, probably not. it was a swiss army knife
proxy tool.

it scanned for proxies
tested them
used proxy judges
can leech proxies from custom url list

i often thought about Giving it away as the tool is no longer
sold and the site is gone, and i have the only unlocked version

the nice thing about proxyfire was once activated you where
on your own. now there activation servers are gone the tool is
pretty much dead.....UNLESS you have what i have, an unlocked
version req no key no activation .

but know this - a lot if ISPS do not like people port scanning
some isps will throw you out , also to run this on win 7/10
you need a TCP patch to allow more threads as most windows
block tcp scanning without using an unlock patch .

 

[Incognito]

@proxygohow does Charon stack up to proxy fire? I'd imagine it's also way more effective than scrapebox and gsa because of the method it scans.

 

[proxygo]

Charon another well known proxy tool from the 2000s
was probably 1 of the best FREE proxy testers using proxy judges -
https://www.blackhatworld.com/seo/charon-proxie-tester-tutorial.522077/

 

[proxygo]

public proxy scrapers can vary greatly, and some may be used for malicious
purposes such as hacking or spamming.

I feel like my 13 post moma just gave me a lecture
so there you have it folks all those years tools like gsa / scrapebox using
public proxies, and guys like me inventing tools to get them , im some kinda
spooky guy after hacking your desktop so i can see your porn stash.

guess he missed the part im retired - i dont look at peoples porn
stashes any more. peek abooo

 

[imccafey]

Can proxy scraper get residential proxy

If reading this right, then the answer is possibly. Provided you meet the exact required configuration for scraping the URL, yeah that should be doable. Depending on the tools, you'll also probably specific IP ranges. Of course getting it is one thing, knowing the proxy's login credentials is a whole different ball game.

 

[Doree_maniya]

try nexusnet man, their residential proxies work fine for web scraping too. i got a promocode for $20 that's no use for me 'cause i already activated one in my account. there you go dude KNVOLM it's not referral so no profit for me at all, just sharing

 

[darlyaliaszed]

Really nice thread, i am definitly falling in love with this community.

Please a small question, can we use public proxies for scappers, when using tools such as jarvee (su social) without too many risks?

Thanks in advance

 

[turelink]

Really nice thread, i am definitly falling in love with this community.

Please a small question, can we use public proxies for scappers, when using tools such as jarvee (su social) without too many risks?

Thanks in advance

Yes, can not works

 

[ATuringtest]

I've used GSA proxy scraper for years ,its a great bit of kit TBH.