That's a very common observation. The X algorithm, like many other social platforms, is designed to keep users on its site, so it often reduces the reach of posts that contain external links. There's no "SEO" fix on the platform itself, as it's an algorithm preference, not a technical SEO issue.
The best strategy is to avoid putting the link directly in the main post. Instead, share your photo or video, and then put the link in the first comment as a reply to your own post. You can also create a compelling thread that leads to a link at the end. This method allows the post to gain initial momentum without the algorithm's suppression, leading to higher overall engagement and clicks.