Discussion in 'Cloaking and Content Generators' started by rpkrocks, Feb 15, 2017.
Hello, Does anyone has a list of IG crawlers/bots to block them via robots.txt/.htaccess?
Do they use the same crawlers for IG too?
Yes, its the same company after all.
I dont think its gonna be that simple
Separate names with a comma.