Proxies for Instagram public data scraping

nagyfero113 · Mar 16, 2021

Hello,

Problem in nutshell:
I have to scrape 50k-100k profiles (almost) daily. No authentication required because I only scrape public data.
I used datacenter proxies with success for years, but it started to fail a few months ago (half year) so i switched to mobile proxies based on the forums recommendations here.

Mobile proxies works fairly well, but the number of profiles grows and before I buy new mobile proxies I just wanted to do some research for alternatives, what is the best for this kind of use case.

Are there any good alternatives or I just had to scale it to reach the numbers we need?

Thanks in advance

proxygo · Mar 16, 2021

have you checked into bhw proxy sales section
https://www.blackhatworld.com/forums/proxies-for-sale.112/

sugarfreelobster · Mar 16, 2021

interesting following this thread

Gaurav Joshi · Mar 17, 2021

Have you tried using private proxies? how was the scrapping result using them?

nagyfero113 · Mar 17, 2021

proxygo said:
have you checked into bhw proxy sales section
https://www.blackhatworld.com/forums/proxies-for-sale.112/

Yes, thank you. I found/chose all the providers from there. But currently I'm not sure what should I look for there.

Gaurav Joshi said:
Have you tried using private proxies? how was the scrapping result using them?

Yes, the proxies I used in the past (for years) were private datacenter proxies.
I also tried rotating residential proxies because 'on paper' it sounded right for the job.

But the results for both were less convincing than the mobile proxies.

Maybe I have tried bad providers for residential, because i went with cheaper ones.

biopy · Mar 17, 2021

nagyfero113 said:
Mobile proxies works fairly well, but the number of profiles grows and before I buy new mobile proxies I just wanted to do some research for alternatives, what is the best for this kind of use case.

I think you will have continue using mobile proxies, because it works best

turelink · Mar 17, 2021

For public easily use rotating residential proxies that work better.

Mi C · Mar 20, 2021

Based on experience, avoid any residential or data center proxies that detected by 3rd party detection service like IP2PROXY. You should be able to bypass instagram filter.

billywatson · Mar 21, 2021

nagyfero113 said:
Hello,

Problem in nutshell:
I have to scrape 50k-100k profiles (almost) daily. No authentication required because I only scrape public data.
I used datacenter proxies with success for years, but it started to fail a few months ago (half year) so i switched to mobile proxies based on the forums recommendations here.

Mobile proxies works fairly well, but the number of profiles grows and before I buy new mobile proxies I just wanted to do some research for alternatives, what is the best for this kind of use case.

Are there any good alternatives or I just had to scale it to reach the numbers we need?

Thanks in advance

Datacenter proxies are shared proxies at after a certain level of use, they wear out because someone else can be using the same IP as well and the cross-use has impacts on others. For scraping 4G mobile proxies offer the best value and with rotating IPs, the volume of scraping is maximum. Alternatives aren't worth the money imho.

nagyfero113 · Mar 24, 2021

Thank you for the responses, i will probably check out a few other residential rotating proxy and mobile proxy providers, then go with the better ones.

Proxies for Instagram public data scraping

nagyfero113

Newbie

proxygo

Elite Member

sugarfreelobster

Newbie

Gaurav Joshi

Regular Member

nagyfero113

Newbie

biopy

Regular Member

turelink

Elite Member

Mi C

Regular Member

billywatson

Junior Member

nagyfero113

Newbie

Main Menu

Marketplace

Making Money

BlackHat World