1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Webmaster Tools - Blocked URLs - Why?

Discussion in 'White Hat SEO' started by Scorpion Ghost, Feb 1, 2014.

  1. Scorpion Ghost

    Scorpion Ghost Senior Member

    Joined:
    Mar 22, 2013
    Messages:
    865
    Likes Received:
    171
    I entered webmaster tools to take a look around for a few things for this blogger blog i have. Anyway, i'm not very experienced with the webmaster tools.

    So at some point i landed on Crawl --> Blocked URLs, and i see this:

    Webmaster tools blocked URLs.GIF

    Why are there 13 Blocked URLs?? That's not possible because for one i googled a few of my blog's pages and they can be found in the search results. And also i haven't changed the Robots.txt at all, it's exactly the way it was by default from blogger...

    And i just checked the same thing for 2 more blogs i have (a humor one and a testing one), and they both have a number under Blocked URLs.

    Why? What the fuck is this?
     
  2. Scorpion Ghost

    Scorpion Ghost Senior Member

    Joined:
    Mar 22, 2013
    Messages:
    865
    Likes Received:
    171
    Well, i may have figured it out...

    Apparently this part of code:

    Disallow:/search

    Means that the Label pages will not be crawled. And i counted the Labels i have on this blog and it's exactly 13.

    Then i went to check my Testing blog and it's the same thing. I have 7 labels on the blog, and i have 7 blocked URLs.

    Just as i thought i figured it out, i go to my humor blog, and i find i have 19 Blocked URLs. Then i check the labels on that blog, and i only have 8. Even if i include the Label pages from my navigation bar it comes up to 13, so what the fuck...?