ColonelSoldier
Junior Member
- May 18, 2011
- 189
- 83
Hey guys,
I believe this plugin is new (not mine).
https://wordpress.org/plugins/antibot/
Comes already installed with a comprehensive list of crawling bots to block.
Supposedly blocks spiders from crawling, however I needed to add the following bots in settings (semrush, moz, ahrefs):
Posting this as a free alternative to paid bot "spankers".
TESTED via adding Googlebot to banned bots, using https://addons.mozilla.org/en-US/firefox/addon/random-agent-spoofer/ for firefox, and refreshing page as Googlebot. I don't have any other tools to test crawl with other major crawlers.
In order to keep mixing up plugins between my PBN sites, I have added this plugin to a few sites.
This is a free alternative to a spider spanking plugin which is at a ridiculous price.
Cheers
I believe this plugin is new (not mine).
https://wordpress.org/plugins/antibot/
Comes already installed with a comprehensive list of crawling bots to block.
Supposedly blocks spiders from crawling, however I needed to add the following bots in settings (semrush, moz, ahrefs):
Code:
SemrushBot,rogerbot,AhrefsBot
Posting this as a free alternative to paid bot "spankers".
TESTED via adding Googlebot to banned bots, using https://addons.mozilla.org/en-US/firefox/addon/random-agent-spoofer/ for firefox, and refreshing page as Googlebot. I don't have any other tools to test crawl with other major crawlers.
In order to keep mixing up plugins between my PBN sites, I have added this plugin to a few sites.
This is a free alternative to a spider spanking plugin which is at a ridiculous price.
Cheers
Last edited: