Need Help About robots

Discussion in 'White Hat SEO' started by leckie, Feb 13, 2012.

  1. leckie

    leckie Regular Member

    Joined:
    Oct 17, 2011
    Messages:
    219
    Likes Received:
    9
    Occupation:
    Software engineer
    Location:
    China
    my robots.txt is like this
    User-agent: *
    Allow: /
    but when i use google webmaster tool .i find 9 Unreachable error :"robots.txt unreachable Feb 10, 2012"
    each page can be open normally and 8 extension filename is .html 1 is .asp
    so i don't konw why this happen,is that normal?
    what can i do? Thanks
     
  2. leckie

    leckie Regular Member

    Joined:
    Oct 17, 2011
    Messages:
    219
    Likes Received:
    9
    Occupation:
    Software engineer
    Location:
    China
    is there anyone meet same question?
     
  3. sitecontact

    sitecontact Junior Member

    Joined:
    May 14, 2010
    Messages:
    179
    Likes Received:
    36
  4. leckie

    leckie Regular Member

    Joined:
    Oct 17, 2011
    Messages:
    219
    Likes Received:
    9
    Occupation:
    Software engineer
    Location:
    China
    yes i'm sure rebots.txt can be open.and i run google webmaster tool robots.txt test .The results:
    Allowed by line 2: Allow: /
    Detected as a directory; specific files may have different restrictions
    i think all pass