Calculating proxies cost per month - help?

Let's assume I have a high volume of scraping that I need to do. (I do)
I'm kind of a newbie to this so, please, bear with me.

The first thing I'll think about is dividing the volume into three sectors:
Two will be operated through private proxies. Both on physical CPU.
One will be on a VPS, working with public proxies. VPS + Proxies cost = $0

All I'm aiming for is to minimize the monthly cost behind proxies (and my endeavor in general), and maximize my scraping results. I'm willing to add more machines into this, but the cost of proxies is just... I don't know, insane? I'm still new to this, and the whole calculation of expenses is quite overwhelming.

Do I just buy more private proxies? Get backconnect ones?
Do I add more machines, pay for licenses, and just work with a high volume of public proxies?
What is the most cost-effective way to do it?

Also, please, is there a software that could help me get more proxies for free? (even if it's a paid software) Aside from SB, I mean.

I'd really appreciate your help with this.
Thanks!

Go residential and pay by the GB, public proxies are never going to be a scale-able viable solution.

GoTRooT said:

Go residential and pay by the GB, public proxies are never going to be a scale-able viable solution.

Click to expand...

Yeah, I'm starting to realize it's better with GBs.
How about using GSA's proxy scraper along with SB's multiple instances? Would that cut the costs a little bit, and still scale using public proxies?

I'm giving it a try at the moment and will fire up SB with as much good public ones as I can.

For every 1000 proxies I get from GSA's tool, and run them through SB's testing, I end up with 25% Anon and only 4 Google passed.
I think it has to be done on a really massive scale to get proper working ones.

What are you trying to scrape, google?

If it is google, 100% forget public proxies, I have "Proxy Switcher Pro" running on a dedicated 10GB line which I use for other things.

Of the 150.000 proxies which are currently in the database 400 are "elite" now to be clear I never use public proxies for google, but I am going to run the elites through scrapebox right now and check which ones pass google search:

Annon: 358
Google: 272

This running, 5 months, 24/7 10gb line and you get 272 google proxies of various speed/location.

If I had buult this setup for google scrape proxy finding it would have been the worst investment ever

Just find a cheap proxy provider.

There are proxy sellers on BHW that sell residential rotating proxy ports. 5 ports is 12 bucks I think. With those 5 ports you will get access to thousands of proxies that can access google, linkedin or whatever else you're scraping.

GoTRooT said:

What are you trying to scrape, google?

If it is google, 100% forget public proxies, I have "Proxy Switcher Pro" running on a dedicated 10GB line which I use for other things.

Of the 150.000 proxies which are currently in the database 400 are "elite" now to be clear I never use public proxies for google, but I am going to run the elites through scrapebox right now and check which ones pass google search:

Annon: 358
Google: 272

This running, 5 months, 24/7 10gb line and you get 272 google proxies of various speed/location.

If I had buult this setup for google scrape proxy finding it would have been the worst investment ever

Click to expand...

I get that. The idea of just using freebies for this is too tempting tho. I keep testing, really.
I know the amount of errors you get with public ones are just insane. Maybe it might work for my purposes.

I tried this:
I put 2400 proxies from GSA's tool into SB, didn't test them with the latter.
Added 1000 keywords pulled from Ahrefs and started harvesting.
Got around 4000 errors, and 18k links.
Trimmed and removed duplicates, ended up with 4000.

Ran through vanity and ended up with 30 available web 2.0's in a competitive niche.

To me, this can be scaled up. It's only one machine, not with optimal settings, and with GSA's free trial.... and really, just a simple quick test.
I think private proxies would be better for other tasks, not this. I would use them for the vanity name check, as it's really slow with public ones.
I don't know, what do you think?

Swagmonster said:

Just find a cheap proxy provider.

There are proxy sellers on BHW that sell residential rotating proxy ports. 5 ports is 12 bucks I think. With those 5 ports you will get access to thousands of proxies that can access google, linkedin or whatever else you're scraping.

Click to expand...

Thing is, I'm still not sure what are the limitations on those private proxies. I'm not experienced, and yet to calculate my usage per each proxy.
Any help on this would be appreciated.

Ahhh that all sounds good, thought you were data-mining, sounds like a solid plan.

If you take a humanized approach with browser scraper, maybe you wont need the proxies?