1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to create .htaccess and robots.txt to protect PBN?

Discussion in 'Black Hat SEO' started by Gold Rush, Sep 1, 2014.

  1. Gold Rush

    Gold Rush Newbie

    Joined:
    Jul 29, 2014
    Messages:
    20
    Likes Received:
    3
    Hi,

    Can I know how to create .htaccess and robots.txt to protect PBN from unwanted crawler?

    Is it we just create a new notepad file and type in the related command, then upload to root directory via FTP?

    Please help. Thanks.
     
  2. aka sam

    aka sam Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 15, 2011
    Messages:
    4,260
    Likes Received:
    907
    Gender:
    Male
    Occupation:
    Internet Marketer
    Location:
    Black Hat World
    Home Page:
    I think you can have a look at one wordpress plugin called Spider Spanker ..it would help you for the WordPress sites in your network.
     
  3. SEO Power

    SEO Power Elite Member

    Joined:
    Jul 14, 2014
    Messages:
    2,642
    Likes Received:
    683
    Occupation:
    Self employed
    Location:
    Houston, TX
  4. M4XW3LL

    M4XW3LL Jr. VIP Jr. VIP

    Joined:
    Feb 5, 2013
    Messages:
    1,094
    Likes Received:
    1,275
    There is an awesome post around here regarding this but I can't find it. Search the forum and you'll find it.
     
  5. HiruCIA

    HiruCIA Newbie

    Joined:
    Mar 11, 2015
    Messages:
    1
    Likes Received:
    0
    I am going to create pbn