1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to create .htaccess and robots.txt to protect PBN?

Discussion in 'Black Hat SEO' started by Gold Rush, Sep 1, 2014.

  1. Gold Rush

    Gold Rush Newbie

    Joined:
    Jul 29, 2014
    Messages:
    20
    Likes Received:
    3
    Hi,

    Can I know how to create .htaccess and robots.txt to protect PBN from unwanted crawler?

    Is it we just create a new notepad file and type in the related command, then upload to root directory via FTP?

    Please help. Thanks.
     
  2. aka sam

    aka sam Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 15, 2011
    Messages:
    3,802
    Likes Received:
    894
    Gender:
    Male
    Occupation:
    Internet Marketer
    Location:
    Black Hat World
    Home Page:
    I think you can have a look at one wordpress plugin called Spider Spanker ..it would help you for the WordPress sites in your network.
     
  3. SEO Power

    SEO Power Elite Member

    Joined:
    Jul 14, 2014
    Messages:
    2,637
    Likes Received:
    680
    Occupation:
    Self employed
    Location:
    Houston, TX
  4. M4XW3LL

    M4XW3LL Senior Member

    Joined:
    Feb 5, 2013
    Messages:
    1,052
    Likes Received:
    1,247
    There is an awesome post around here regarding this but I can't find it. Search the forum and you'll find it.