1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need Help About robots

Discussion in 'White Hat SEO' started by leckie, Feb 13, 2012.

  1. leckie

    leckie Regular Member

    Joined:
    Oct 17, 2011
    Messages:
    219
    Likes Received:
    9
    Occupation:
    Software engineer
    Location:
    China
    my robots.txt is like this
    User-agent: *
    Allow: /
    but when i use google webmaster tool .i find 9 Unreachable error :"robots.txt unreachable Feb 10, 2012"
    each page can be open normally and 8 extension filename is .html 1 is .asp
    so i don't konw why this happen,is that normal?
    what can i do? Thanks
     
  2. leckie

    leckie Regular Member

    Joined:
    Oct 17, 2011
    Messages:
    219
    Likes Received:
    9
    Occupation:
    Software engineer
    Location:
    China
    is there anyone meet same question?
     
  3. sitecontact

    sitecontact Junior Member

    Joined:
    May 14, 2010
    Messages:
    179
    Likes Received:
    36
    Home Page:
  4. leckie

    leckie Regular Member

    Joined:
    Oct 17, 2011
    Messages:
    219
    Likes Received:
    9
    Occupation:
    Software engineer
    Location:
    China
    yes i'm sure rebots.txt can be open.and i run google webmaster tool robots.txt test .The results:
    Allowed by line 2: Allow: /
    Detected as a directory; specific files may have different restrictions
    i think all pass