blocking bots

Discussion in 'Black Hat SEO' started by Geasy, Feb 13, 2017.

  1. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    971
    Likes Received:
    250
    Is it good or not to block ahrefs, majestic to crawl PBNs?
     
  2. asap1

    asap1 BANNED BANNED

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,190
    Good.
     
  3. iisark

    iisark Jr. VIP Jr. VIP

    Joined:
    Dec 27, 2009
    Messages:
    111
    Likes Received:
    30
    It is not "good" to block backlink checkers, YOU MUST block them or your competitors will find your PBN's and will report them to Google. And in case you are wondering - use htaccess rather than robots.txt, because many bots are ignoring robots.txt.
     
    • Thanks Thanks x 1
  4. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    971
    Likes Received:
    250
    Thanks for the reply.

    I'm wondering if Google sees something suspicious here, since it's not that legal sites make?
     
  5. WP_Monster

    WP_Monster Newbie

    Joined:
    Feb 13, 2017
    Messages:
    28
    Likes Received:
    4
    Gender:
    Male
    its good to block PBN crawls bro .....
     
  6. TheLinkGuy

    TheLinkGuy Power Member

    Joined:
    Nov 20, 2010
    Messages:
    634
    Likes Received:
    130
    Location:
    EU
    There may be a footprint sure, but a lot of time people block bots not because they are hiding their PBN but blocking aggressive bots from wasting resources and bandwidth. I wouldn't use the stock default block list found by many PBN people but create something custom.