Instagram scraper with proxies

[Thibault]

No you are not. It is NOT possible to scrape 16k profiles in an hour from a single IP. Probably you don't realise it, but the request is being redirected to the IG login page instead of the profile page. Check the logs of the program you are using which should output the final response url and status during the request and it will confirm what I say

Never said I wasn't using accounts / logged in And I've corrected that I'm effectively doing 5k /hour /IP & account

 

[rootjazz]

Never said I wasn't using accounts / logged in And I've corrected that I'm effectively doing 5k /hour /IP & account

Still sounds like a lot, that's a 120k profile page requests per day, but if it is working it is working.

 

[ssc]

I had posted on this a while back asking for information on a tool/program that would do this and was going to post again but this thread seems to be addressing this so I'll post here.

I have been using Risto's Instagram Manager to scrape

I've been scraping IG biographies for a couple of years, looking for emails when projects I was working on needed some emails lists.
Recent IG update makes it much slower to get a decent amount of emails.

I'm looking for a tool that would work with proxies so I can get back to normal speed, and scrape 2-5 millions profiles per day (vs. 150k per day with one account/IP)?

I've used risto tool, his instagram scraper, it's great but the proxy part doesn't work.

How are you scraping for IG data, in particular biographies?

I had been using Instagram Manager to scrape for bios and other account information and then take the CSV output and filter/analyze it in Excel, and get extracted lists from that to run in marketing projects. I have gotten some errors with the program halting while doing that though recently even when I slow the scraping rate down to 3-5 seconds between scrape. I have tried switching proxies, etc, reinstalling the program, etc, with the same results. I'm not sure if this program is currently being maintained, I haven't seen any posts on it in many months either her or on the program website.

Is Instagram Manager still working for you to do this kind of scraping, or are you using another program to do this? I'd be glad to continue using Instagram Manager if I could get it to work reliably, and I'd consider others, but I'd want something that will be maintained and updated as we know IG often makes changes to how they display profiles, etc, so the program would need to be updated periodically to keep up with that.

 

[Thibault]

I had been using Instagram Manager to scrape for bios and other account information and then take the CSV output and filter/analyze it in Excel, and get extracted lists from that to run in marketing projects. I have gotten some errors with the program halting while doing that though recently even when I slow the scraping rate down to 3-5 seconds between scrape. I have tried switching proxies, etc, reinstalling the program, etc, with the same results. I'm not sure if this program is currently being maintained, I haven't seen any posts on it in many months either her or on the program website.

Is Instagram Manager still working for you to do this kind of scraping, or are you using another program to do this? I'd be glad to continue using Instagram Manager if I could get it to work reliably, and I'd consider others, but I'd want something that will be maintained and updated as we know IG often makes changes to how they display profiles, etc, so the program would need to be updated periodically to keep up with that.

Yes Risto is still maintaining the software and available to answer questions on Discord. You may have to update the software and pay for the annual subscription to do so.
It's the software I'm currently using.

 

[ssc]

Yes Risto is still maintaining the software and available to answer questions on Discord. You may have to update the software and pay for the annual subscription to do so.
It's the software I'm currently using.

Thanks, I'll try to message him there.