Remove link which allready indexed in backlink checker ?

i forgot to block back link checker spider on my small network and they pop op in Majority back link checker service (ahrefs, Majestic. etc)

Is there anyway to remove my link from their database? i recon there a thread similar to this where the fix is by adding robotx txt and then removing it , but cant find that thread...

Block their spiders through .htaccess and change the url structure. For ex, yourdomain.com/your-already-indexed-url.html to yourdomain.com/my-indexed-url.html. Problem solved. They'll eventually drop the dead urls from their index as they try to crawl the page/url again. If you're talking about a domain, then permanent redirecting it to another domain is the only way to take it off of their index and it's going to take quite a few months to completely exit their index.

SpoonFeeder said:

Block their spiders through .htaccess and change the url structure. For ex, yourdomain.com/your-already-indexed-url.html to yourdomain.com/my-indexed-url.html. Problem solved. They'll eventually drop the dead urls from their index as they try to crawl the page/url again. If you're talking about a domain, then permanent redirecting it to another domain is the only way to take it off of their index and it's going to take quite a few months to completely exit their index.

Click to expand...

shiiit..that's going to be a lot of work..man this suck

lendir said:

shiiit..that's going to be a lot of work..man this suck

Click to expand...

Majority don't use these guys often .. You could just let it sleep

You can add the below code in .htaccess file to restrict website like ahrefs, magestic, moz to crawl your website data

Code:

SetEnvIfNoCase User-Agent .*rogerbot.* bad_bot
SetEnvIfNoCase User-Agent .*exabot.* bad_bot
SetEnvIfNoCase User-Agent .*mj12bot.* bad_bot
SetEnvIfNoCase User-Agent .*dotbot.* bad_bot
SetEnvIfNoCase User-Agent .*gigabot.* bad_bot
SetEnvIfNoCase User-Agent .*ahrefsbot.* bad_bot
SetEnvIfNoCase User-Agent .*sitebot.* bad_bot
<Limit GET POST HEAD>
Order Allow,Deny
Allow from all
Deny from env=bad_bot
</Limit>

Also, even if you hide them now, they will still be visible forever in the historic index.