Block Semrush, Moz...

[radichone]

Hello guys
Can you please tell me the easiest way to block most of website analytic platforms like semrush & moz

 

[ThopHayt]

Just use the search box in the upper right corner, click into it, click the "more..." button and search block bots. Constrain your search to the Black Hat SEO section and you'll find dozens of guides and threads that walk you through it. This problem has been talked about a lot and there have been detailed solutions posted.

-ThopHayt

 

[macdonjo3]

It's all done in robots.txt

See here: https://moz.com/community/q/moz-crawling-bot

 

[michaelr1988]

In addition to the above, some would argue using .htaccess way is better as it doesn't leave a footprint.

 

[ThopHayt]

Lets be honest, both leave a footprint. I'm sure Google can figure out who is blocking bots that claim to be Moz in their .htaccess as well. Which is why honestly if you're building large scale you need to mix up how/which/if you block various bots.

-ThopHayt

 

[andrew1978]

Use Spider Spanker
if you dont want bots to crawl your site

 

[pelangi]

Lets be honest, both leave a footprint. I'm sure Google can figure out who is blocking bots that claim to be Moz in their .htaccess as well. Which is why honestly if you're building large scale you need to mix up how/which/if you block various bots.

-ThopHayt

thats right, you can make some diversify/mixing to it.
or, just leave them...

Use Spider Spanker
if you dont want bots to crawl your site

i just heard about it, how it works?