1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

blocking access of ahrefs/majestic etc

Discussion in 'Black Hat SEO' started by GTRM3, Nov 7, 2013.

  1. GTRM3

    GTRM3 Junior Member

    Joined:
    Jan 27, 2012
    Messages:
    137
    Likes Received:
    8
    Is it possible to block ahrefs/majestic seo to picked up your links? For example ahrefs, can't find wordpress web 2.0's and some others. Can we add a code to our own sites (private network) so when competition is looking at our money site links will find nothing?
     
  2. ChokeStone

    ChokeStone Registered Member

    Joined:
    Mar 31, 2013
    Messages:
    55
    Likes Received:
    14
    you can block the bots from crawling your own sites. this only blocks them from discovering your own links on sites you control, not other random links.
     
  3. 1+1=2

    1+1=2 Junior Member

    Joined:
    Jul 14, 2009
    Messages:
    198
    Likes Received:
    29
    You need to have access to server of the tier 1 or private network. Then add these lines to robots.txt


    Code:
    User-agent: MJ12bot
    Disallow: /
    
    
    user-agent: AhrefsBot
    Disallow: /
    
    
    User-agent: rogerbot
    Disallow: /
    
     
    Last edited: Nov 8, 2013
  4. Rua999

    Rua999 Power Member

    Joined:
    Jun 25, 2011
    Messages:
    630
    Likes Received:
    407