I want to learn how to stop ahrefs and other bots to not crawl my website - or how to hide my PBN from them

OhSEO

Junior Member
Joined
Dec 10, 2021
Messages
108
Reaction score
18
Hi,

As I mentioned in the title, I would love to learn how to hide my PBN to get crawled by Ahrefs or other analysis bots ? any help please ? or any articles in this site already published? thank you
 

Nargil

Jr. Executive VIP
Jr. VIP
Joined
May 10, 2012
Messages
8,692
Reaction score
6,580
Website
bit.ly
 

Teeto

Regular Member
Joined
Oct 19, 2014
Messages
298
Reaction score
141
Awesome resource list. You can't go wrong with them.
 

Sofiamartinez

Jr. VIP
Jr. VIP
Joined
Mar 3, 2017
Messages
2,761
Reaction score
494

Wow, that's a great list buddy :)
 

BuY PBN LinKs

Jr. VIP
Jr. VIP
Joined
Mar 26, 2019
Messages
1,191
Reaction score
181
Website
buypbnlinks.com
Login to cPanel
and open public_html in File Manager
and create a robots.txt file inside public_html
Using this rule, you can prevent search engines from crawling your website:

User-agent: *******

Disallow: /

It is necessary to modify this rule within the robots.txt file
 

Alexion

Banned - Shitlisted and did not do the right thing
Joined
Sep 9, 2021
Messages
1,455
Reaction score
3,707
Age
34
Website
join.skype.com
Login to cPanel
and open public_html in File Manager
and create a robots.txt file inside public_html
Using this rule, you can prevent search engines from crawling your website:

User-agent: *******

Disallow: /

It is necessary to modify this rule within the robots.txt file
You're messing with the guy, he will block google as well
 
Top