How do you scrape Instagram these days?

[Captain_Nothing]

Since the Instagram API is long gone, scraping has become really hard. I am guessing the best way to scrape Instagram would be to use several accounts to login and check accounts and scrape what is needed.

Anyone have any other workarounds or a method I am overlooking?

 

[Mastey577]

Search engine scrape is slow but you'll always have that as a fall back option.

Like "@gmail.com" "Niche" site:instagram.com

 

[lucky.sparks]

You can use this type of link to gain information about account:

https://www.instagram.com/therock/?__a=1

(open it from clean IP and without existing IG session in your browser)

You will need a good amount of proxies and some simple scraping script.

Other option is to imitate mobile rest API and then use your accounts to scrape other accounts, its more stable but will require some serious setup as without other actions - if you will use your accounts only for scraping, they will be action locked quite fast.

 

[Mastey577]

You can use this type of link to gain information about account:

https://www.instagram.com/therock/?__a=1

(open it from clean IP and without existing IG session in your browser)

You will need a good amount of proxies and some simple scraping script.

Other option is to imitate mobile rest API and then use your accounts to scrape other accounts, its more stable but will require some serious setup as without other actions - if you will use your accounts only for scraping, they will be action locked quite fast.

That's for someone with some programming skills at least.

Do you know of any software that does similar?

 

[lucky.sparks]

That's for someone with some programming skills at least.

Do you know of any software that does similar?

Even with a very small budget, you can find a developer that will change this data to your preferred, spreadsheets for example.

 

[Mastey577]

Okay great, I'll save this post for future reuse. Thanks

Even with a very small budget, you can find a developer that will change this data to your preferred, spreadsheets for example

 

[Captain_Nothing]

You can use this type of link to gain information about account:

https://www.instagram.com/therock/?__a=1

(open it from clean IP and without existing IG session in your browser)

You will need a good amount of proxies and some simple scraping script.

Other option is to imitate mobile rest API and then use your accounts to scrape other accounts, its more stable but will require some serious setup as without other actions - if you will use your accounts only for scraping, they will be action locked quite fast.

Hmm yea, that was the method I used before when the API was working. You can get around 3 profile loads before it asks you to login, I guess it would be a cheaper solution to scrape 3rd party websites for the data.

 

[faruq_72_786]

Since the Instagram API is long gone, scraping has become really hard. I am guessing the best way to scrape Instagram would be to use several accounts to login and check accounts and scrape what is needed.

Anyone have any other workarounds or a method I am overlooking?

I will give you my own script using instagram Api that does the job pretty well without getting blocked.

 

[shuttershades]

Use rapidapi.

 

[Captain_Nothing]

Use rapidapi.

https://rapidapi.com/search/instagram
Thanks, I will look through these.

 

[socialdude]

Anyone have any other workarounds or a method I am overlooking?

What data are you interested in? There are at least two methods depending on the type of data

 

[Captain_Nothing]

What data are you interested in? There are at least two methods depending on the type of data

Follower/following count and avatar.

 

[sanane.ulan]

You can use this type of link to gain information about account:

https://www.instagram.com/therock/?__a=1

(open it from clean IP and without existing IG session in your browser)

You will need a good amount of proxies and some simple scraping script.

Other option is to imitate mobile rest API and then use your accounts to scrape other accounts, its more stable but will require some serious setup as without other actions - if you will use your accounts only for scraping, they will be action locked quite fast.

I am new to these seo things, so forgive me is I ask silly question pls.

I did not get the concept of imitating mobile REST API, can you explain it further?

Thanks

 

[SportsPredict]

Follower/following count and avatar.

DOM parsing & a lot of unique proxies would do the trick

 

[carizmali]

I'll save this post for future reuse.

 

[yellowcat]

You can use this type of link to gain information about account:

https://www.instagram.com/therock/?__a=1

This method hasn't worked for a while. (IG is weird i've seen them open n close that ?__a=1 endpoint a few times)

Here's a current working version without requiring logins

import requests
import json
target = "cats"
url = "https://www.instagram.com/" + target
params = {'__a': 1, '__d': 'dis'}
s = requests.Session()
r = s.get(url, params=params, headers=None)
data = r.json()
print (json.dumps(data,indent=4))
print (data['graphql']['user']['id'])

 

[jmbjlg]

Scraping publicly available data is legal, but you need to be careful not to extract content that is protected by copyright or contains personal information. So, after scraping Instagram, double-check your output for data that would go against GDPR, CCPA, or could be considered intellectual property.