1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

robot.txt question

Discussion in 'Blogging' started by RavenX, Apr 10, 2010.

  1. RavenX

    RavenX Newbie

    Joined:
    Oct 11, 2009
    Messages:
    38
    Likes Received:
    5
    I have never touched the robot.txt file, it was generated automatically and the sitemap was added in by a plugin....but does this mean the sitemap is not indexed by any spider? or is it good because it's not on the same line as disallow??
    Code:
    User-agent: *
    Disallow:
    
    Sitemap: http://www.siteexample.com/sitemap.xml.gz
    
     
  2. Tseng

    Tseng Regular Member

    Joined:
    Mar 16, 2010
    Messages:
    289
    Likes Received:
    33
    Occupation:
    lampin
    Location:
    outerspace
    ^ this. everything looks in order to me unless you're attempting to cloak or deindexfrom google.