1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Can blocking crawlers in the .htaccess harm your blogs

Discussion in 'Black Hat SEO' started by Brad12, Mar 10, 2015.

  1. Brad12

    Brad12 Registered Member

    Joined:
    Aug 16, 2013
    Messages:
    70
    Likes Received:
    3
    If you do this will this prevent sites that need to crawl your site to rank anchors from achieving this goal? Do you really need to block crawlers like Ahrefs/Majestic, etc? Whats the point. If you have nice blogs with great content and you own it who cares who crawls it.
     
  2. bokeboke

    bokeboke Junior Member

    Joined:
    Mar 21, 2010
    Messages:
    132
    Likes Received:
    31
    Your competitors can sniff out your PBN and then tell Google. So there is a possibilty of having your PBN deindexed. That's the idea at least. Some say its going overboard. I do it just to be safe. It only takes a couple of seconds to upload a plugin to do this.
     
  3. Brad12

    Brad12 Registered Member

    Joined:
    Aug 16, 2013
    Messages:
    70
    Likes Received:
    3
    Oh you can do a plugin? I thought you had to manually go in and do this. What plugin does this?
     
  4. diesel1

    diesel1 Senior Member

    Joined:
    May 22, 2013
    Messages:
    934
    Likes Received:
    226
    .

    If your network wasn?t made for links/inter linking then it isn?t necessary to block third party crawlers.

    But, that said, I know of networks that are intelligently interlinked (not for link juice, for visitors), and they all rank without any problems.

    Think in terms of something like a site that sell tickets, linked to different games sites, linked to different venue sites.