Need some proxy advice for ultra high thread google scraping, unlimited bandwidth and thread limits? Does something like this exist?

[hostie]

I'm trying to do some very high volume google scraping, but keep getting limited with current proxies I run. I tried proxy storm back connecting, but they are SO slow with the thread limits, I run 10 dedicated 20 semi dedicated proxies from buyproxies, but they get blocked by google pretty quickly. I also tried iproyal rotating, but they charge per gb, and it gets SO expensive so fast with the volume I'm trying to scrape...

Ideally I need some no limit rotating proxy unlimited bandwidth and thread limits, if this even exists...

Kinda finding myself in a proxy rabbit hole, now confusing myself way more than I need to with all of the options and services out there. I appreciate any advice here!

 

[Grelmoss]

Does google block IP? If not, use headless browsers, solve the captcha and scale it on computing instead of network.
So you will not need any proxy

 

[BlogPro]

I'm trying to do some very high volume google scraping, but keep getting limited with current proxies I run. I tried proxy storm back connecting, but they are SO slow with the thread limits, I run 10 dedicated 20 semi dedicated proxies from buyproxies, but they get blocked by google pretty quickly. I also tried iproyal rotating, but they charge per gb, and it gets SO expensive so fast with the volume I'm trying to scrape...

Ideally I need some no limit rotating proxy unlimited bandwidth and thread limits, if this even exists...

Kinda finding myself in a proxy rabbit hole, now confusing myself way more than I need to with all of the options and services out there. I appreciate any advice here!

Proxies are only half the battle with Google.

What's your setup like? How high of a load are you running into with every scrape session?

Are you using a headless browser? Or a multi-profile browser? Are you changing your session entries and browser profiles with every scrape? Are you scraping in the same vicinity back to back?

 

[proxygo]

I'm trying to do some very high volume google scraping, but keep getting limited with current proxies I run. I tried proxy storm back connecting, but they are SO slow with the thread limits, I run 10 dedicated 20 semi dedicated proxies from buyproxies, but they get blocked by google pretty quickly. I also tried iproyal rotating, but they charge per gb, and it gets SO expensive so fast with the volume I'm trying to scrape...

the days you could scrape with 100+ threads without getting proxys banned are GONE,
you need to set your scrape threads around 10-20 to cut the fast ip bans

 

[ristoriel]

You can use 4G/5G mobile proxies with IP rotation since they work great with web scrapping. Make sure that your IP address is continuously rotating so that the chances of getting blocked are decreased. Best of luck!

 

[vasi36]

Go with mobile proxies to scrape the big G. There are sellers who offer mobile proxies with unlimited bandwidth. Ask for a trial and test if it fits your needs

 

[t4nk78]

For such high volume scraping you're probably better off just buying serp data from a reputable source.

 

[turelink]

I used to use soax.io to scrape google, which working good, faster than other rotating residential proxies, but really not cheap.
If no much data, I would suggest you use Serp API, that much easy to use.

 

[vincaslt]

I am using ProxyScrape.com to scrape Google. You get a list of proxies (no rotating proxy nonsense), and then I implemented my own rotating proxy with rate limiting of 8 req per hour per proxy and concurrency limits, to comply with ProxyScrape rules of max 10. So with 1k proxies I can scrape around 200k google pages (keywords) per day. They're datacenter proxies, but error rate is very low probably around 2-5% at most, so a retry on another proxy usually solves it.

They offer plans of up to 40k proxies afaik. 1k proxies is around 25 bucks and has no GB limit.

Oh and this worker is spinning 24/7 on a $5 Digital Ocean server. DM me if you'd like to talk about what you need exactly mb I could help.

 

[miasmith]

I'm trying to do some very high volume google scraping, but keep getting limited with current proxies I run. I tried proxy storm back connecting, but they are SO slow with the thread limits, I run 10 dedicated 20 semi dedicated proxies from buyproxies, but they get blocked by google pretty quickly. I also tried iproyal rotating, but they charge per gb, and it gets SO expensive so fast with the volume I'm trying to scrape...

Ideally I need some no limit rotating proxy unlimited bandwidth and thread limits, if this even exists...

Kinda finding myself in a proxy rabbit hole, now confusing myself way more than I need to with all of the options and services out there. I appreciate any advice here!

Use a 4g/5g mobile proxy with rotation feature and rotate the IPs in every 30 mins.. and if you want more security use an antidetect browser.

 

[Proxy Cake]

This is going to be hard to find, I'd suggest setting up a custom scraping bot that uses as little data as possible then using a cheap but quality residential provider.

 

[AllOutAnime]

If you have a larger budget, use those options https://oxylabs.io/products/scraper-api/serp https://brightdata.com/products/serp-api
They can extact using different technologies and only charge for successful results.
For example you could specify you need mobile results from united states new york and they could provide it.
They can also handle any number of threads you would throw at them.

 

[ProxyWiz]

Hello there, https://www.omegaproxy.com/?keyword=BHW provides services with unlimited bandwidth.

To its blackhatworld thread: https://www.blackhatworld.com/seo/omegaproxy-residential-proxies-worldwide-unlimited-bandwidth-up-to-50-discount-mega-sale-60m-ips.1541788/page-3.

If you would like to have a trial, let me know. Let's sort it out via dm.

 

[hostie]

Hello there, Omegaproxy provides services with unlimited bandwidth.

To its blackhatworld thread: https://www.blackhatworld.com/seo/o...-50-discount-mega-sale-60m-ips.1541788/page-3.

If you would like to have a trial, let me know. Let's sort it out via dm.
View attachment 301255

That's really confusing to me. Unlimited bandwidth - but $3.00 per GB? That's exactly the opposite of unlimited Bandwidth.

I need some solid proxies for GSA Contact Form sender
Then I need totally separate IPV6 proxies for xevil to solve google recaptcha's..

and i do not want to pay per gb lol that's the opposite of what i want - i am doing millions of requests per month - and it's not profitable to pay per gb...

please explain to me the meaning of unlimited bandwidth if you're charging per gb... lol why has the proxy game become such a rabbit hole these days?

 

[sonyd]

Try back connect from private proxy, it's unlimited thread and bandwidth

 

[ProxyWiz]

That's really confusing to me. Unlimited bandwidth - but $3.00 per GB? That's exactly the opposite of unlimited Bandwidth.

I need some solid proxies for GSA Contact Form sender
Then I need totally separate IPV6 proxies for xevil to solve google recaptcha's..

and i do not want to pay per gb lol that's the opposite of what i want - i am doing millions of requests per month - and it's not profitable to pay per gb...

please explain to me the meaning of unlimited bandwidth if you're charging per gb... lol why has the proxy game become such a rabbit hole these days?

Unlimited bandwidth means Omegaproxy does not limit the speed of your connections. It is not unlimited traffic.

Any residential proxy plans on Omegaproxy are coming with Unlimited Bandwidth, they won't limit your speed of connection if you have a large-scale operation to deal with. Please note, the plans aren't include the unlimited traffic option. So basically, we will have to consider how many GBs we need.

 

[hostie]

Unlimited bandwidth means Omegaproxy does not limit the speed of your connections. It is not unlimited traffic.

Any residential proxy plans on Omegaproxy are coming with Unlimited Bandwidth, they won't limit your speed of connection if you have a large-scale operation to deal with. Please note, the plans aren't include the unlimited traffic option. So basically, we will have to consider how many GBs we need.

I appreciate you clarifying that for me.

I need rotating private proxies, ipv6 or socks5 - with unlimited traffic... why does this solution seem to not exists haha