I just recently set up my first blog network of 10 sites and noticed when I checked my backlinks in majesticseo, the links that had already indexed were not only showing the main homepage url, but also the feed, category and author pages. Because this is my own network and only intend to keep the articles on the homepage is there any way to block majesticseo or the search engines from indexing . The best example I can find is here https://www.majesticseo.com/reports...rce=F&q=http://www.vinylsidingpricesguide.com. Is there a plugin I need to use to block the google bots?
Question about setting up a blog network
- Thread starter cmw333
- Start date
nichelinks
Junior Member
- Jan 11, 2013
- 117
- 37
here's some code you can apply to your .htaccess file to block some bad bots. Basically it blocks Ahrefs and Majestic and a couple of others.
Code:
SetEnvIfNoCase User-Agent .*rogerbot.* bad_bot
SetEnvIfNoCase User-Agent .*exabot.* bad_bot
SetEnvIfNoCase User-Agent .*mj12bot.* bad_bot
SetEnvIfNoCase User-Agent .*dotbot.* bad_bot
SetEnvIfNoCase User-Agent .*gigabot.* bad_bot
SetEnvIfNoCase User-Agent .*ahrefsbot.* bad_bot
SetEnvIfNoCase User-Agent .*sitebot.* bad_bot
<Limit GET POST HEAD>
Order Allow,Deny
Allow from all
Deny from env=bad_bot
</Limit>
Last edited:
- May 10, 2011
- 6,104
- 534
Best bet is to place directly on the root htaccess file. Take a backup before doing anything as well.
nichelinks
Junior Member
- Jan 11, 2013
- 117
- 37
You can directly paste the code via cpanel or ftp.
jstevenson
Newbie
- Sep 11, 2013
- 17
- 4
I'd recommend backing up your data frequently. There's this one backup plugin available in the wordpress plugin search utility. I can't remember the one i used to use but there should be a ton. Sort it by ratings and you should find your winner.
iglow
Elite Member
- Feb 20, 2009
- 2,254
- 870
i made full ebook about protecting sites for mbots and spammer - 100% free of course. http://ebook.igl00.biz