Search Central Live is coming to New York City on March 20, 2025! Learn more and
apply for an invite.
What URLs should a Sitemap include?
August 26, 2005
So, what URLs from your site should you put in your Sitemap?
Put in everything! List the URLs that contain your content, images, media, and anything else in
your site.
If you want to include only a subset of items, you can, but we'd like as much information about
your site as you can give us.
Remember that we respect robots.txt, so if you include any URLs in your Sitemap that are
restricted in robots.txt, we won't crawl those.
Posted by Vanessa Fox
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
[null,null,[],[[["Submit all URLs containing website content, including images and media, to your Sitemap for Google to crawl."],["While submitting a subset of URLs is possible, providing comprehensive information about your site is recommended."],["Google's crawler respects robots.txt directives, preventing access to restricted URLs even if listed in the Sitemap."]]],["Sitemaps should list all URLs from a website, including content, images, and media. While a subset is acceptable, providing comprehensive information is preferred. It is important to know that URLs restricted by the site's robots.txt file, even if included in the Sitemap, will not be crawled. The Sitemaps should contain the maximum information possible about your site.\n"]]