Do not want to be Indexed

Discussion in 'Black Hat SEO' started by CiscoKid, Nov 9, 2008.

  1. CiscoKid

    CiscoKid Registered Member

    Joined:
    Jan 8, 2008
    Messages:
    61
    Likes Received:
    31
    Found several different ways in search to do this - but in some ways too many ways..

    What is the best way to stop any search engine from indexing anything on your site? Is it:
    <meta name="robots" content="noindex" />

    Going to do this to a brand new site so do not need to worry about history showing up.


    Thanks..
     
    • Thanks Thanks x 1
  2. Profit

    Profit Regular Member

    Joined:
    Jul 27, 2008
    Messages:
    208
    Likes Received:
    158
    Occupation:
    Money Maker
    Location:
    Atlanta
    create a robot.txt file and add the directories or pages you don't want indexed. e.g.,

    User-agent: *
    Disallow: /thisdirectory
    Disallow: /thispage.html

    Edit:

    I just noticed you said anything on your site so it would be:

    User-agent: *
    Disallow: /
     
    Last edited: Nov 9, 2008