Tuesday, November 24, 2020
To help website owners better understand how Googlebot crawls their sites, we're launching a brand new version of the Crawl stats report in Search Console.
The new Crawl Stats report brings the following exciting new features:
- Total number of requests grouped by response code, crawled file type, crawl purpose, and Googlebot type.
- Detailed information on host status
- URL examples to show where in your site requests occurred
- Comprehensive summary for properties with multiple hosts and support for domain properties
Over-time charts
The Crawl Stats report enables website owners to see Google crawl data totals and overtime charts for: total requests, total download size and average response time.
Grouped crawl data
The new version of the report also provides data on crawl requests broken down by response, file type of the fetched URL, purpose of the crawl request, and Googlebot agent. See example URLs of each type by clicking on a row in the grouping table:
High level and detailed information on host status issues
Host status details in the report let you check