1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

set up robots.txt

Discussion in 'White Hat SEO' started by wseo12, Jun 20, 2009.

  1. wseo12

    wseo12 Regular Member

    Joined:
    May 23, 2009
    Messages:
    221
    Likes Received:
    7
    Occupation:
    FUll TIME IM
    hi whats up every body can some one please help me need help on setting up a robots.txt basicly what i am trying to is only allow the index page and disolow all other pages from being crawled by the SE can you please explain to me how i set this up and were it should be uploaded thanks
     
  2. wseo12

    wseo12 Regular Member

    Joined:
    May 23, 2009
    Messages:
    221
    Likes Received:
    7
    Occupation:
    FUll TIME IM
    thanks man just checked it out i really appriciate it bro
     
  3. wseo12

    wseo12 Regular Member

    Joined:
    May 23, 2009
    Messages:
    221
    Likes Received:
    7
    Occupation:
    FUll TIME IM
    yea im cool for now im probly gonna set up a robts txt in the morning if i run into any problems will let you know