robot.txt question

Discussion in 'Blogging' started by RavenX, Apr 10, 2010.

  1. RavenX

    RavenX Newbie

    Joined:
    Oct 11, 2009
    Messages:
    38
    Likes Received:
    5
    I have never touched the robot.txt file, it was generated automatically and the sitemap was added in by a plugin....but does this mean the sitemap is not indexed by any spider? or is it good because it's not on the same line as disallow??
    Code:
    User-agent: *
    Disallow:
    
    Sitemap: http://www.siteexample.com/sitemap.xml.gz
    
     
  2. Tseng

    Tseng Regular Member

    Joined:
    Mar 16, 2010
    Messages:
    289
    Likes Received:
    33
    Occupation:
    lampin
    Location:
    outerspace
    ^ this. everything looks in order to me unless you're attempting to cloak or deindexfrom google.