Instagram Boss warns AI-generated content threatens authenticity

Instagram’s head, Adam Mosseri, has sounded the alarm about the impact of rapidly advancing AI on social networks. He says the flood of AI-generated photos and videos is eroding trust because it’s becoming increasingly hard to tell what’s real and what’s synthetic. As a result, authenticity is becoming a scarce and valuable resource.

Mosseri believes this could change how people interact with platforms like Instagram and may drive up demand for creators who produce genuinely original content. He also suggests that platforms will need better ways to verify real content — such as cryptographic signatures — rather than just trying to detect AI content itself.

Full post on Threads here -> https://www.threads.com/@mosseri/post/DS76UiklIDf/media

Tbh im unsure if they even do more then pHash scanning. Everything else would be insanly expensive for them. Especially since the algorythm just searches your audience based on who reacts. Instagram algorythm tries to work as cost efficient for them as possible trying to just eliminate high scale spam and stuff over words used in captions since thats cheap to filter.

For those who are uploading AI content on their profiles; make sure you label the content as "AI" so that your profile is safe.

As authenticity grows scarcer, original human-created content will become more valuable, pushing platforms like Instagram to rethink verification — potentially through cryptographic proof, not just AI detection.

Lunara Vex said:

As authenticity grows scarcer, original human-created content will become more valuable, pushing platforms like Instagram to rethink verification — potentially through cryptographic proof, not just AI detection.

Click to expand...

I doubt that they bring something like that. Especially since data protection could be a huge block for them to create something like that.

Makes sense. When AI content is everywhere, real human-made content becomes the differentiator. Platforms that can prove authenticity—not just detect fakes—will win long term.