1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

how to hide backlinks from competitors?

Discussion in 'Black Hat SEO' started by nonai, Oct 11, 2013.

  1. nonai

    nonai Power Member

    Joined:
    Oct 10, 2013
    Messages:
    524
    Likes Received:
    63
    I have been doing a lot of research online and I am not sure how to implement this.
    So I will point all my backlinks to a back up site, and then block internet crawlers from back up site.
    Then, I redirect the back up site to money site.
    according to my research, it is not a good idea to do this using robots.txt because that is open to the public and anyone can see it. So it is better to do it via htaccess.

    to block internet crawlers, I found 2 codes:

    Code:
    RewriteEngine On
    RewriteCond %{HTTP_USER_AGENT} ^rogerbot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^exabot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^MJ12bot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^dotbot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^gigabot [OR]
    RewriteCond %{HTTP_USER_AGENT} ^AhrefsBot
    RewriteRule .* - [F]
    
    And
    Code:
    SetEnvIfNoCase User-Agent .*rogerbot.* bad_bot
    SetEnvIfNoCase User-Agent .*exabot.* bad_bot
    SetEnvIfNoCase User-Agent .*mj12bot.* bad_bot
    SetEnvIfNoCase User-Agent .*dotbot.* bad_bot
    SetEnvIfNoCase User-Agent .*gigabot.* bad_bot
    SetEnvIfNoCase User-Agent .*ahrefsbot.* bad_bot
    SetEnvIfNoCase User-Agent .*sitebot.* bad_bot
    <Limit GET POST HEAD>
    Order Allow,Deny
    Allow from all
    Deny from env=bad_bot
    </Limit>
    
    which one is better?
    And what about the redirect code? What would it be, and where would it go?
     
  2. originalposter

    originalposter Jr. VIP Jr. VIP

    Joined:
    Jul 22, 2013
    Messages:
    564
    Likes Received:
    516
    If you block internet crawlers crawling your back up site (with all the backlinks), wouldn't that block them for knowing you have backlinks as well?

    Why not send all backlinks to your 'backup site', then 301 redirect them your money site?
     
  3. keyser

    keyser Junior Member

    Joined:
    Oct 10, 2008
    Messages:
    100
    Likes Received:
    151
    Occupation:
    Full time bum
    Location:
    UK
    Put this code in your .htaccess in your site root (usually public_html)

    RewriteEngine on
    RewriteCond %{HTTP_USER_AGENT} rogerbot [OR]
    RewriteCond %{HTTP_USER_AGENT} exabot [OR]
    RewriteCond %{HTTP_USER_AGENT} mj12bot [OR]
    RewriteCond %{HTTP_USER_AGENT} dotbot [OR]
    RewriteCond %{HTTP_USER_AGENT} gigabot [OR]
    RewriteCond %{HTTP_USER_AGENT} ahrefsbot [OR]
    RewriteCond %{HTTP_USER_AGENT} sitebot
    RewriteRule .* - [F]

    However this will only block them from crawling your site, it won't block them from crawling other peoples sites with your links on them. Hiding your links from competitors can be tricky if not impossible. The only thing you can do is make them harder to find. If your doing something really cool you could point your links to numerous domains then 301 those domains to your main site, that way if someone wants to know what links you have they have to look up the links pointing at all your redirected domains.

    Hope that helps.
     
  4. nonai

    nonai Power Member

    Joined:
    Oct 10, 2013
    Messages:
    524
    Likes Received:
    63
    to the 2 guys replying to my post - and everybody else - YES, I am aware that I will need to do 301 redirect, that's exactly what my post says, point all backlinks to "back up site" then redirect backup site to main site.

    I do not know htaccess language at all. The following code takes care of the blocking. Now what do I need to add to it to make backup sites redirect to main site?
    Code:
    RewriteEngine on
    RewriteCond %{HTTP_USER_AGENT} rogerbot [OR]
    RewriteCond %{HTTP_USER_AGENT} exabot [OR]
    RewriteCond %{HTTP_USER_AGENT} mj12bot [OR]
    RewriteCond %{HTTP_USER_AGENT} dotbot [OR]
    RewriteCond %{HTTP_USER_AGENT} gigabot [OR]
    RewriteCond %{HTTP_USER_AGENT} ahrefsbot [OR]
    RewriteCond %{HTTP_USER_AGENT} sitebot
    RewriteRule .* - [F]
    
     
  5. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    527
    Likes Received:
    35
    Hello Guys,

    Does anyone know the name of the crawler that SEO Spyglass use for its old software and new beta they are launching?

    Is there another other software to that competitors can check backlinks?
     
  6. codeman1234

    codeman1234 Power Member

    Joined:
    Sep 13, 2011
    Messages:
    527
    Likes Received:
    35
    Can anyone let me know spyglass crawler name, please? Because is not on list provided by keyser and nonai.