Block IG from crawling/spidering website in .htaccess

Spinethetic

Junior Member
Joined
Dec 10, 2015
Messages
111
Reaction score
104
Anybody have a code for .htaccess and robots.txt to block the Instagram crawl spider from crawling a website or redirect them?

I ask because I'm using the same root domain across my IG accounts to track click performance for individual ig profiles but they all redirect to the same url.

Best regards and stay blessed! :)
 
Last edited:
Figure out their IP range and or UAstring, then redirect based on those signals.
 
Back
Top