1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

How to create .htaccess and robots.txt to protect PBN?

Discussion in 'Black Hat SEO' started by Gold Rush, Sep 1, 2014.

  1. Gold Rush

    Gold Rush Newbie

    Joined:
    Jul 29, 2014
    Messages:
    20
    Likes Received:
    3
    Hi,

    Can I know how to create .htaccess and robots.txt to protect PBN from unwanted crawler?

    Is it we just create a new notepad file and type in the related command, then upload to root directory via FTP?

    Please help. Thanks.
     
  2. aka sam

    aka sam Jr. VIP Jr. VIP

    Joined:
    Sep 15, 2011
    Messages:
    4,619
    Likes Received:
    939
    Gender:
    Male
    Occupation:
    Internet Marketer
    Location:
    Black Hat World
    Home Page:
    I think you can have a look at one wordpress plugin called Spider Spanker ..it would help you for the WordPress sites in your network.
     
  3. SEO Power

    SEO Power Elite Member

    Joined:
    Jul 14, 2014
    Messages:
    2,642
    Likes Received:
    683
    Occupation:
    Self employed
    Location:
    Houston, TX
  4. M4XW3LL

    M4XW3LL Senior Member

    Joined:
    Feb 5, 2013
    Messages:
    1,193
    Likes Received:
    1,402
    There is an awesome post around here regarding this but I can't find it. Search the forum and you'll find it.
     
  5. HiruCIA

    HiruCIA Newbie

    Joined:
    Mar 11, 2015
    Messages:
    1
    Likes Received:
    0
    I am going to create pbn