Search Central Live is coming to New York City on March 20, 2025! Learn more and
apply for an invite.
Research study of Sitemaps
Monday, April 27, 2009
We've been tracking the growth of
Sitemaps
on the web. It's been just 2 years since Google, Yahoo and Microsoft co-announced the
Sitemaps rule in robots.txt,
and it is already supported in many millions of websites including educational and
government
websites! At the WWW'09 conference in Madrid, Uri Schonfeld presented his summer internship work
studying Sitemaps from a coverage and freshness perspective. If you're interested in how some
popular websites are using Sitemaps, and how Sitemaps complement "classic" webcrawling, take a
look:
Sitemaps: Above and Beyond the Crawl of Duty
At Google, we care deeply about getting increased coverage and freshness of the content we index.
We are excited about open standards that help webmasters open up their content automatically to
search engines, so users can find relevant content for their searches.
Written by Narayanan Shivakumar, VP Engineering
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
[null,null,[],[[["Google, Yahoo, and Microsoft announced the Sitemaps protocol two years ago, and it's now implemented on millions of websites."],["A study presented at WWW'09 conference analyzes how Sitemaps impact website coverage and content freshness."],["Google supports open standards like Sitemaps to enhance content coverage and freshness for better search results."],["Sitemaps complement traditional web crawling methods to make web content more accessible to search engines."]]],[]]