1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

GOOGLE Employee Explains Sitemap Usage

Discussion in 'White Hat SEO' started by MrBlue, May 30, 2012.

  1. MrBlue

    MrBlue Senior Member

    Joined:
    Dec 18, 2009
    Messages:
    950
    Likes Received:
    662
    Occupation:
    Web/Bot Developer
    A Sitemap file helps search engines to discover new and updated URLs on your website. In particular, if your website is fairly large, then this can help them to be able to focus on the new & updated content, instead of having to blindly crawl through everything to see if anything has changed. That can result in new content being found much faster, which can be quite noticeable especially if the site is larger or more complex.

    With Google in particular (I work at Google; I don't know how other search engines handle these), it also does the following:

    1- Find the number of indexed URLs for your website: These statistics are recalculated daily and very accurate. You can find these in the Sitemaps detail page.

    2- Discover canonicalization issues: If the numbers there don't match up, that's frequently a sign that you're specifying URLs in the Sitemap file that don't match what we find during our crawling. That's usually a sign that you need to work on canonicalization.

    3- Help with canonicalization: When we find multiple URLs on your site that show identical content, we will give any URL that's listed in a Sitemap an extra edge, even if you don't use other canonicalization methods.

    4- Find badly-indexed parts of your site: These counts are supplied per Sitemap file, so you can create separate Sitemap files for logical sections of your site, to discover areas where Google isn't indexing as much as you'd like.

    5- Prioritize crawl errors: In the crawl errors section, URLs that were specified in Sitemaps files are listed separately. Since you specifically supplied these URLs, we assume that you want them indexed, and that any crawl errors there are important.

    Additionally, you can use several extensions in Sitemaps files (eg for images, video, News, or internationalization), should you choose to do that. These extensions are all optional.

    For most websites, the most visible element of Sitemaps files is that you can see the indexed URL count. It can take a day or so to appear, so if you just submitted a Sitemap for the first time, you may need to be a bit patient. While other ways (eg a site:-query) are very, very rough approximations, this count is extremely acccurate.

    Full conversation here:
    Code:
    http://webmasters.stackexchange.com/questions/30186/are-there-any-clear-indicators-that-my-sitemap-file-is-beneficial
     
    • Thanks Thanks x 6
  2. JerrickYeoh

    JerrickYeoh Junior Member

    Joined:
    Mar 10, 2011
    Messages:
    110
    Likes Received:
    4
    Home Page:
    Great Explanation . Submit and sitemap in google webmastertool is important whenever we have new content , new website , new sub page , sitemap would help our site to get index faster.
     
  3. poweronics

    poweronics Jr. VIP Jr. VIP Premium Member

    Joined:
    May 1, 2011
    Messages:
    3,117
    Likes Received:
    353
    Occupation:
    Freelancer
    Home Page:
    Nice share. Very informative post.
    Thanks.
     
  4. artlocke

    artlocke Regular Member

    Joined:
    May 28, 2010
    Messages:
    474
    Likes Received:
    120
    Now I know why sitemap is important. I was just installing if because I thought it was part of using wordpress and having a website.
     
  5. wejee

    wejee Junior Member

    Joined:
    Jan 20, 2010
    Messages:
    110
    Likes Received:
    23
    Occupation:
    Keeping it Real.
    Location:
    Parallel Universe
    I've reduced the number of outgoing links on my site, more than a month ago, and also updated the sitemaps, maybe 10 days ago, but nothing has changed on my Google webmaster panel. Should I delete and resubmit the site maps? I'm trying to recover from Penguin.
     
  6. kaif0346

    kaif0346 Power Member

    Joined:
    Jul 13, 2011
    Messages:
    734
    Likes Received:
    93
    Occupation:
    free lancer, SEO, VA
    Location:
    battle field
    Home Page:
    great info buddy .. thanks
     
  7. infoasian

    infoasian Supreme Member

    Joined:
    May 12, 2011
    Messages:
    1,335
    Likes Received:
    421
    Occupation:
    retired
    Location:
    Singapore
    Home Page:
    In other words: sitemaps are a waste of time for smaller sites.
     
  8. meannn

    meannn Supreme Member

    Joined:
    Apr 22, 2009
    Messages:
    1,461
    Likes Received:
    1,896
    Occupation:
    Unemployed Winner
    Location:
    TR
     
    Last edited by a moderator: May 18, 2016
  9. realbusiness

    realbusiness Newbie

    Joined:
    Feb 9, 2009
    Messages:
    11
    Likes Received:
    1
    great info you got here buddy... i used to have a sitemap on my old site but not on the new one.. time to get put it back then.. thanks for the great info..
     
  10. partymarty4870

    partymarty4870 Elite Member

    Joined:
    Jul 7, 2010
    Messages:
    2,034
    Likes Received:
    1,690
    Location:
    I come from a land downunder
    it wouldn't hurt to delete old sitemaps