Instagram scraping off jarvee

[Sam Letchford]

Hey guys.
I’ve got a list of followers 97k.
And I’d like to find out the engagement of each user.
Ideally to target the inactive users with likes to attempt at re-engaging them.
If this fails then I would block the users.
At the moment my content gets 2-6k likes, however, i’d Be much more happy with 50k follower and that kind of engagement for a travel nieche.

At the moment I can use followers plus (an iPhone app) which can give me all this data (who hasn’t liked) however, with the api how it is, I’m worried I am potentially flagging my account as after I use it, any user I try and look at on my phone afterwards I receive a message along the lines of ‘cannot load user details, try again in a few minutes’ I notice my reach also decreases by approximately a third after using this app and then increases back up to where it normally is after 3-4 days without using the app.

I’ve tried Instagram manager V2 however it doesn’t seem to work...

I’ve tried Jarvee however it could not handle the 97k followers and shut itself down at around 30k.

Within the scrape of users I have there is also a mix of private accounts also which need sifting out.

Cheers for the help!

 

[Sam Letchford]

Also if anyone has any ideas on how I could track to see if the targeted inactive account had liked any of my content (possibly up to a week) and if they haven’t I could remove them as a follower that would be super helpful too

 

[kantaenos]

I've scraped 31k at most because thats my current best and it worked so maybe you are right that 30k is max Jarvee can do.

TBH, at 97k you have to be more patient and probably scrape just the username list, then get 10k of the details like...twice a day so it will take you 5 days to get ur data. (if you do it all by one acc) These scraping behaviors stress the servers and the algo will fuck you up like It did me if you arent careful. (lost all access to my acc for 2 days)

You will become an excel pro like me.

 

[dotc0m]

I have had the best scraping success with Gramdominator,

Although the request limits have changed you just need rotating proxies and more scrape accounts

I used to scrape like 10,000 users day from one account!!

 

[rootjazz]

If I understand you, you have a list of 97k profiles. You want to pull the details for each account and analyse those details.
So basically 97k requests - 1 per profile.
You will have to pool that across multiple accounts, one account is just not going to handle it these days.

If I have misunderstand and you want to scrape 97k followers from an account then process them, this is slightly easier as the followers results should give you enough information in the response to not need to do a full user_details scrape on each profile. But still, scraping 100k from a single account is gong to be problematic so pooling is the way togo

 

[Sam Letchford]

I've scraped 31k at most because thats my current best and it worked so maybe you are right that 30k is max Jarvee can do.

TBH, at 97k you have to be more patient and probably scrape just the username list, then get 10k of the details like...twice a day so it will take you 5 days to get ur data. (if you do it all by one acc) These scraping behaviors stress the servers and the algo will fuck you up like It did me if you arent careful. (lost all access to my acc for 2 days)

You will become an excel pro like me.

Thanks for the tip! Yeah I am very cautious with it all! Last thing I want is to seriously harm my account. But the only way I can see my engagement with other accounts seems to be through this way Would be good if there was a paid service out there that would do this that you don’t have to log your details in to so there would be no way of tracking it back to your account

I have had the best scraping success with Gramdominator,

Although the request limits have changed you just need rotating proxies and more scrape accounts

I used to scrape like 10,000 users day from one account!!

Okay i’ll give gramdominator a go! Is it free?

If I understand you, you have a list of 97k profiles. You want to pull the details for each account and analyse those details.
So basically 97k requests - 1 per profile.
You will have to pool that across multiple accounts, one account is just not going to handle it these days.

If I have misunderstand and you want to scrape 97k followers from an account then process them, this is slightly easier as the followers results should give you enough information in the response to not need to do a full user_details scrape on each profile. But still, scraping 100k from a single account is gong to be problematic so pooling is the way togo

The only issue with pooling is that I won’t really be able to see engagement with my account though will I? I already have the list of 97k users scraped, I just want to find the engagement from those 97k users of that makes sense

 

[kantaenos]

Yeah I currently have moved ALL scraping to a separate account / separate phone / separate proxy; because I noticed that if one account got the 'you are doing this too much' error, then ALL of my accounts on that same phone would suffer.

However, what it seems like is happening, is that dividing scraping/actions between accounts makes both accounts not hit the Algorithms limits. So neither accounts are getting that error.

 

[rootjazz]

The only issue with pooling is that I won’t really be able to see engagement with my account though will I? I already have the list of 97k users scraped, I just want to find the engagement from those 97k users of that makes sense

Depends what you mean by "engagement". II thought you meant an engagement score of these profiles on your account

If you mean this, then you can pool as you need to scrape your most recent X images (or images per last X days), then scrape all likers / commenters from those images and store it. This can be pooled.
You then map the results to your 97k to get the highest engagers with you