1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google Using RSS/Atom Feeds To Discover New URLs

Discussion in 'Social Networking Sites' started by sokol, Nov 7, 2009.

  1. sokol

    sokol Registered Member

    Joined:
    Sep 30, 2008
    Messages:
    56
    Likes Received:
    9
    Occupation:
    Web designer
    Google announced a new feature last week that uses RSS and Atom feeds for the discovery of new webpages.

    Using feeds for discovery allows Google to index new pages more quickly than traditional crawling methods. According to the announcement, Google may use ?many potential sources to access updates from feeds including Reader, notifications services, or direct crawls of feeds.

    If you?re publishing an RSS/Atom feed, make sure that those files are not disallowed by your robots.txt file. If you?re unsure whether your feeds are crawlable, use the robots.txt tester in Google Webmaster Tools.
    http://www.websitemagazine.com/cont...sing-rss-atom-feeds-to-discover-new-urls.aspx
     
  2. moneyrocks

    moneyrocks Supreme Member

    Joined:
    May 22, 2009
    Messages:
    1,205
    Likes Received:
    135
    thanks for the info.. highly usefull info...