What is the type of the website? How it is made? By yourself, or you use wordpress/blogspot/etc.?
Check like this : www.yourdomain.com/robots.txt, is something there?
You can remove it by deleting robots.txt in your web directory, use FTP such as Filezilla for this.
Sometimes in blogger the archives show up as blocked by robots.txt.
I had a widget at the sidebar to allow anyone to find all posts from the archive this is what was registering as the problem. I removed that widget and replaced it with a similar article widget and it solved that problem.
Probably just all the crap that does not need indexing like tags and archives and other shit. As long as the content which you want indexing is indexed then don't worry.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.