What URLs should a Sitemap include?

August 26, 2005

So, what URLs from your site should you put in your Sitemap?

Put in everything! List the URLs that contain your content, images, media, and anything else in your site.

If you want to include only a subset of items, you can, but we'd like as much information about your site as you can give us.

Remember that we respect robots.txt, so if you include any URLs in your Sitemap that are restricted in robots.txt, we won't crawl those.