Instagram Scraping Problems

Fluu

Newbie
Joined
May 13, 2022
Messages
5
Reaction score
2
Hey,

I am scraping stories and posts of many IG accounts, using internal endpoints (and so bot accounts and ofc proxies). Currently I do about 2-3 requests per hour per account, but since Friedayabout 1400 of my 1700 story scraping accounts and 1450 of my 1700 post scraping accounts got blocked (Phone Number Verify Screen which means permanent block). Blocks came at the same time for both endpoints a scrape, so its something "overall API related" and came with status code response status code 302.

Everything ran stable the last weeks and I did not do any changes.

Some "configuration/details:
  • Endpoins I use;
    • https://i.instagram.com/api/v1/feed/reels_media/?reel_ids
    • https://i.instagram.com/api/v1/feed/reels_media/?reel_idshttps://y1/users/web_profile_info/?username={username}
  • Custom scraper
  • one proxy per account (1:1)
  • chached login information
  • seperate account for post and story scraping
  • 2-3 api calls per hour

Does anybody experience similar problems or do you have any suggestions for me to avoid blocks?
 
Last edited:
Hey! We are having the same issue. All our proxies now get redirect 302 to login with and without scraping bot accounts. Did you make any progress with this?
 
We tried all 4 proxies. We determined it’s something with the iPhone api endpoint we are calling perhaps.
 
I also have a similar issue. It began around the 27/07

Did you find what was the problem ?
The only thing that I found was to use headers that I did not use in the past. It is a bit better now, but still not that much stable

  • 2-3 api calls per hour
It is few, I was at 30 calls per hour. It means that decreasing my rate limit wont do the trick.

I dont have a feeling that it is related to proxies
 
It's definitely on your end, most likely due to proxies. I am running about 5 API requests per hour on 10K+ accounts and everything is working smoothly.
 
@conversation

Did you implemented your own scrapper or do you use made ones ?
What kind of proxy do you use ( ipv4, ipv6, 4g, res, datacenter)? How many account do you use by proxy ?
Which http protocol version do you use, http1 or 2 ?

For 2 years, I run 8k+ accounts on ipv4 datacenter proxies (easily red flagged but it worked smoothly !), with max 3 accounts by ip, with http1 request on the endpoint given by @Fluu
I only use accounts for story scrapping, I scrap posts anonymously with other proxies.

If I'm asking too much information, just say it !
 
I am facing a similar issue for private requests. I am using residential proxies. Tried changing proxies and bigger timeouts between requests. The majority of account get phishing challenge. Also started happening around 27/07.
 
Up, same problem here : scraping and downloading stories from logged in account (reels_days and reels_media) and i get challenge/302 log out errors. Resi proxies from the country of the accounts and sleep time
 
Up, same problem here : scraping and downloading stories from logged in account (reels_days and reels_media) and i get challenge/302 log out errors. Resi proxies from the country of the accounts and sleep time
Man, already 2 year
 
Back
Top