1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to block Ahrefs, Raven Tools & SEOMoz by robots.txt?

Discussion in 'White Hat SEO' started by NLhead38, Jan 9, 2013.

  1. NLhead38

    NLhead38 Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 10, 2010
    Messages:
    547
    Likes Received:
    383
    Location:
    Western Europe
    I heard that it's possible to block the robots of Ahrefs, Raven Tools and SEOMoz. This way, they will not enter your website and will index (less) backlinks to use in their backlinking analyses. I have found the way to block Ahrefs, but does anyone know the name of the robots of the other 2?

    Ahrefs block robot:
    Code:
    user-agent: AhrefsBot disallow: /
     
  2. notyourmatey

    notyourmatey Power Member

    Joined:
    Jul 7, 2011
    Messages:
    573
    Likes Received:
    324
    Location:
    TOP3
    those bots dont respect commands from robots.txt. maybe you will find this thread helpful:

    Code:
    http://www.blackhatworld.com/blackhat-seo/black-hat-seo/497725-method-how-stop-competitors-spying-your-links.html
     
    • Thanks Thanks x 2
  3. Scripteen

    Scripteen Elite Member

    Joined:
    Sep 19, 2009
    Messages:
    1,811
    Likes Received:
    1,918
    Home Page:
    Use htaccess for more forced control.