1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Question about setting up a blog network

Discussion in 'Black Hat SEO' started by cmw333, Sep 11, 2013.

  1. cmw333

    cmw333 Registered Member

    Joined:
    Oct 13, 2011
    Messages:
    52
    Likes Received:
    6
    I just recently set up my first blog network of 10 sites and noticed when I checked my backlinks in majesticseo, the links that had already indexed were not only showing the main homepage url, but also the feed, category and author pages. Because this is my own network and only intend to keep the articles on the homepage is there any way to block majesticseo or the search engines from indexing . The best example I can find is here https://www.majesticseo.com/reports...rce=F&q=http://www.vinylsidingpricesguide.com. Is there a plugin I need to use to block the google bots?
     
  2. nichelinks

    nichelinks Junior Member

    Joined:
    Jan 11, 2013
    Messages:
    118
    Likes Received:
    37
    Occupation:
    SEO Analyst
    Location:
    IM
    here's some code you can apply to your .htaccess file to block some bad bots. Basically it blocks Ahrefs and Majestic and a couple of others.
    Code:
    SetEnvIfNoCase User-Agent .*rogerbot.* bad_bot
    SetEnvIfNoCase User-Agent .*exabot.* bad_bot
    SetEnvIfNoCase User-Agent .*mj12bot.* bad_bot
    SetEnvIfNoCase User-Agent .*dotbot.* bad_bot
    SetEnvIfNoCase User-Agent .*gigabot.* bad_bot
    SetEnvIfNoCase User-Agent .*ahrefsbot.* bad_bot
    SetEnvIfNoCase User-Agent .*sitebot.* bad_bot
    <Limit GET POST HEAD>
    Order Allow,Deny
    Allow from all
    Deny from env=bad_bot
    </Limit>
     
    • Thanks Thanks x 2
    Last edited: Sep 11, 2013
  3. cmw333

    cmw333 Registered Member

    Joined:
    Oct 13, 2011
    Messages:
    52
    Likes Received:
    6
    thanks alot for your help. Do I use a wordpress plugin or directly paste in that code for each of my sites via cpanel
     
  4. nanavlad

    nanavlad Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 2, 2009
    Messages:
    2,419
    Likes Received:
    892
    Gender:
    Male
    Occupation:
    SEO Consultant
    Location:
    Proxy Central
  5. masterjani

    masterjani Jr. VIP Jr. VIP

    Joined:
    May 10, 2011
    Messages:
    3,183
    Likes Received:
    372
    Occupation:
    seo professional
    Home Page:
    Best bet is to place directly on the root htaccess file. Take a backup before doing anything as well.
     
  6. nichelinks

    nichelinks Junior Member

    Joined:
    Jan 11, 2013
    Messages:
    118
    Likes Received:
    37
    Occupation:
    SEO Analyst
    Location:
    IM
    You can directly paste the code via cpanel or ftp.
     
  7. jstevenson

    jstevenson Newbie

    Joined:
    Sep 11, 2013
    Messages:
    17
    Likes Received:
    4
    I'd recommend backing up your data frequently. There's this one backup plugin available in the wordpress plugin search utility. I can't remember the one i used to use but there should be a ton. Sort it by ratings and you should find your winner.
     
  8. iglow

    iglow Elite Member

    Joined:
    Feb 20, 2009
    Messages:
    2,081
    Likes Received:
    856
    Home Page:
    i made full ebook about protecting sites for mbots and spammer - 100% free of course. http://ebook.igl00.biz