Instagram data scraping

igorth

Newbie
Joined
Dec 21, 2022
Messages
12
Reaction score
0
Hi everyone,

I'm building an Instagram data scraper and I'm going to scrape some data that requires being logged in. I noticed that there are very strict limits for certain Instagram endpoints.

How can I know the hourly request limits for each endpoint, especially the /followers and /following endpoints?
 
Hi, I have questions along these lines as well -- I use Ninjagram, Instadub, and occasionally other programs to scrape followers, followings, and occasionally likers and commenter IDs for marketing analysis, and I've noticed in the last couple weeks a restriction apparently placed on all accounts (and I think this is affecting everyone or a lot of people as it's happening on all of the accounts I use) where I can only see or scrape the most recent 100 IDs for all of the above except commenter IDs (I suppose because it has to display the ID to display a comment properly). This is occurring on IDs I don't use at all for botting, and friends I know who don't bot at all are reporting to me the same thing, so it seems to be maybe something that is affecting everyone, or many accounts, at least.

As far as hourly limits go, I've never known of any known set hourly limits for viewing or scraping (same thing, as far as IG is concerned), except that if it's obviously something that a social media obsessed human wouldn't do, it's risky for a bot to do -- like scrape 24/7 as fast as one can. Better to add pauses and scrape maybe a few hundred an hour, and increase from there as one feels safe until one encounters blocks or errors.

On the apparent absolute limit on scraping anything but comment IDs I don't know if this is a new restriction for everyone or if it's been going on for a while and I haven't noticed it (I haven't been doing any scraping for a couple months).

No telling when or if this may change but has anyone else noticed a similar restriction, and any ideas for workarounds?
 
Back
Top