question about robot.txt file

Hi, i just did a check at http://www.seocentro.com/tools/search-engines/metatag-analyzer.html of my site and at Robots it says:

Spider robots are not allowed to spider the web page.

what does this mean and how can i fix it? I didn;t change anything myself to robot.txt (i guess?) but it might bne a plugin of my wordpress who made it? i use all in SEO, seo tag cloud en analytics plugin.

can somebody help me?

check that your wordpress is set up to allow indexing

verify if you have noindex in your source code

and check your www.domain.com/robots.txt to see in noindex is present for the root folder

you robot*txt file should contains this, anything extra is really up to you

Sitemap: /sitemap.xml

User-agent: *
Disallow: /wp-content/cache/
Disallow: /wp-content/themes/
Disallow: /wp-content/plugins/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-login.php

Click to expand...