1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

blocking bots

Discussion in 'Black Hat SEO' started by Geasy, Feb 13, 2017.

  1. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    618
    Likes Received:
    94
    Is it good or not to block ahrefs, majestic to crawl PBNs?
     
  2. asap1

    asap1 BANNED BANNED Jr. VIP

    Joined:
    Mar 25, 2013
    Messages:
    4,961
    Likes Received:
    3,179
    Good.
     
  3. iisark

    iisark Jr. VIP Jr. VIP

    Joined:
    Dec 27, 2009
    Messages:
    109
    Likes Received:
    28
    It is not "good" to block backlink checkers, YOU MUST block them or your competitors will find your PBN's and will report them to Google. And in case you are wondering - use htaccess rather than robots.txt, because many bots are ignoring robots.txt.
     
    • Thanks Thanks x 1
  4. Geasy

    Geasy Jr. VIP Jr. VIP

    Joined:
    Jul 26, 2016
    Messages:
    618
    Likes Received:
    94
    Thanks for the reply.

    I'm wondering if Google sees something suspicious here, since it's not that legal sites make?
     
  5. WP_Monster

    WP_Monster Newbie

    Joined:
    Feb 13, 2017
    Messages:
    27
    Likes Received:
    4
    Gender:
    Male
    its good to block PBN crawls bro .....
     
  6. TheLinkGuy

    TheLinkGuy Power Member

    Joined:
    Nov 20, 2010
    Messages:
    634
    Likes Received:
    130
    Location:
    EU
    There may be a footprint sure, but a lot of time people block bots not because they are hiding their PBN but blocking aggressive bots from wasting resources and bandwidth. I wouldn't use the stock default block list found by many PBN people but create something custom.