Need Help About robots

L

leckie

Regular Member

Oct 17, 2011

219

9

• Feb 13, 2012

• #1

my robots.txt is like this
User-agent: *
Allow: /
but when i use google webmaster tool .i find 9 Unreachable error :"robots.txt unreachable Feb 10, 2012"
each page can be open normally and 8 extension filename is .html 1 is .asp
so i don't konw why this happen,is that normal?
what can i do? Thanks

 

L

leckie

Regular Member

Oct 17, 2011

219

9

• Feb 13, 2012
• Thread Starter Thread Starter

• #2

is there anyone meet same question?

 

S

sitecontact

Junior Member

May 14, 2010

179

36

• Feb 13, 2012

• #3

Make sure your robots.txt is in your root dir. Try to open it www.yoursite.com/robots.txt and see if it is available

 

L

leckie

Regular Member

Oct 17, 2011

219

9

• Feb 13, 2012
• Thread Starter Thread Starter

• #4

sitecontact said:

Make sure your robots.txt is in your root dir. Try to open it wwwyoursitecXm/robots.txt and see if it is available

Click to expand...

yes i'm sure rebots.txt can be open.and i run google webmaster tool robots.txt test .The results:
Allowed by line 2: Allow: /
Detected as a directory; specific files may have different restrictions
i think all pass