1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

robots.txt not working

Discussion in 'White Hat SEO' started by misteryou., Feb 1, 2012.

Tags:
  1. misteryou.

    misteryou. Power Member

    Joined:
    Feb 1, 2012
    Messages:
    573
    Likes Received:
    109
    Hi there:)

    I have a newbie question

    I am tired to search what i am doing wrongwith my robot txt :confused:

    Trying to set up my robots.txt i installed pluggin in my WP but each of these pluggins seems to don't work for me when i check for mywpsite/robots.txt
    i only got a 404 not fund
    I aslo tried to install it myself with a txt file via file manager and still the same

    Can you tell me what i am doing wrong please cause its cause me big headeache
     
  2. whosays

    whosays Newbie

    Joined:
    Jul 25, 2011
    Messages:
    33
    Likes Received:
    9
    try to add the following to your .htaccess file


    Code:
    AddType text/html .txt
    Had this problem when I was starting out, using free webhosting. Some do not allow txt files. This might be the fix you need.
     
  3. misteryou.

    misteryou. Power Member

    Joined:
    Feb 1, 2012
    Messages:
    573
    Likes Received:
    109
    Hi thank for your help

    But still the same
     
  4. misteryou.

    misteryou. Power Member

    Joined:
    Feb 1, 2012
    Messages:
    573
    Likes Received:
    109
    i fixed it
    it was because i deleted the update service in my dashboard :)