1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Block crawlers

Discussion in 'Black Hat SEO' started by spider4567, Sep 15, 2016.

  1. spider4567

    spider4567 Power Member

    Joined:
    Jan 5, 2016
    Messages:
    645
    Likes Received:
    59
    A bit confuse with blocking crawlers...let's say my site has PBN backlinks..if i want to block ahref from crawling my site..i should use htacess on pbn or on money site
     
  2. Gyuman82

    Gyuman82 Elite Member

    Joined:
    Nov 15, 2011
    Messages:
    1,834
    Likes Received:
    1,123
    Occupation:
    SEO Specialist
    Location:
    Los Angeles
    Home Page:
    The htaccess that you modify has to be on the PBN sites. The PBNs are what you want to block backlink checkers from crawling.
     
    • Thanks Thanks x 1
  3. spider4567

    spider4567 Power Member

    Joined:
    Jan 5, 2016
    Messages:
    645
    Likes Received:
    59
    thank you =)
     
  4. rumah

    rumah Newbie

    Joined:
    Dec 23, 2017
    Messages:
    3
    Likes Received:
    0
    Gender:
    Female
    hello is there anybody can help me to block ahrefs from being able to crawl my website?