Can’t make the #ChromeDevSummit this year? Catch all the content (and more!) on the livestream, or join your peers for a CDS Extended event at a hosted location nearby. To learn more, check out the Chrome Dev Summit 2019 website.
Search engines crawl your page in order to understand your content. If you don't
give them permission to crawl your page, they can't know what your page
contains, and therefore are unable to list your page in search results.
If you want search engines to crawl your page, remove the HTTP headers or meta
tags that are preventing crawlers from doing so. Your Lighthouse report lists the
problematic headers or tags. Lighthouse only checks for the general headers or
tags that affect all crawlers. It doesn't flag headers or tags that block
specific search engine bots.