Google Search Central
  • Google Search Central
Documentation
  • Not much time?
  • Quickstart
  • Get on Google
  • Optimize your site for search engines
  • Measuring your performance on Google
  • Beginner SEO
  • Get started
  • SEO starter guide
  • Do you need an SEO?
  • Beginners guide to Search Console
  • Advanced SEO
  • Get started
  • Guidelines
  • Control crawling and indexing
  • Change your Search appearance
  • Optimize page experience
What's new
  • Blog
  • Events
  • Documentation updates
Case studies Help
  • Documentation
Go to Search Console
Introduction Just the basics Beginner SEO Advanced SEO
Google Search Central
  • Google Search Central
  • Documentation
    • More
    • Introduction
    • Just the basics
    • Beginner SEO
    • Advanced SEO
  • What's new
    • More
  • Case studies
  • Help
  • Get started
  • Developer's guide to Search
  • Advanced guide to Search Console
  • Guidelines
    • Overview of guidelines
    • Webmaster guidelines
    • General guidelines
      • Keep a simple URL structure
      • Qualify your outbound links to Google
      • Tag site for child-directed treatment
      • Browser compatibility
      • Avoid creating duplicate content
      • Make your links crawlable
      • Make sure Googlebot is not blocked
      • Best practices for website testing with Google Search
    • Content-specific guidelines
      • Images and video
        • Google Images best practices
        • Video best practices
        • Rich media file best practices
      • Best practices for bloggers
      • Free web hosters
      • AMP on Google Search guidelines
      • AJAX-enhanced sites
      • AJAX Frequently asked questions
      • COVID-19 resources and tips
        • For all sites
        • For education sites
        • For health and government sites
    • Quality guidelines
      • Automatically generated content
      • Sneaky redirects
      • Link schemes
      • Paid links
      • Cloaking
      • Hidden text and links
      • Doorway pages
      • Scraped content
      • Affiliate programs
      • Irrelevant keywords
      • Creating pages with malicious behavior
      • User-generated spam
      • Ways to Prevent Comment Spam
      • Report spam, paid links, or malware
  • Control crawling and indexing
    • Overview of crawling and indexing topics
    • Introduction to indexing
    • Create a list of URLs
    • Submit URLs to Google
    • Manage your sitemaps
      • Learn about sitemaps
      • Build and submit a sitemap
      • Split up your large sitemaps
      • Sitemap extensions
        • Video sitemaps and alternatives
        • Image sitemaps
        • Google News sitemaps
    • Block access to your content
      • Overview
      • Control what you share with Google
      • Block search indexing with noindex
      • Block access with robots.txt
        • Introduction to robots.txt
        • Create a robots.txt file
        • Submit your updated robots.txt to Google
        • Robots FAQs
        • Robots.txt Specifications
      • Prevent images on your page from appearing in search results
      • Keep redacted information out of Search
    • Remove information from Google
    • Pause your business online
    • Consolidate duplicate URLs
    • Create custom 404 pages
    • Soft 404 errors
    • Transfer, move, or migrate your site
      • Change page URLs with 301 redirects
      • What is a site move?
      • Move a site without URL changes
      • Move a site with URL changes
    • Manage international and multilingual sites
      • Overview
      • Managing multi-regional and multilingual sites
      • Tell Google about localized versions of your page
      • How Google crawls locale-adaptive pages
      • Cross-language search results
    • Special tags that Google understands
    • Robots meta tag, data-nosnippet, and X-Robots-Tag specifications
    • Managing crawl rate
      • Ask Google to recrawl your URLs
      • Reduce the Googlebot crawl rate
      • Verifying Googlebot
      • Large site owner's guide to managing your crawl budget
      • Google crawlers
        • Overview
        • Googlebot
        • Google Read Aloud user agent
        • APIs-Google user agent
        • Feedfetcher
        • Duplex on the web user agent
    • Manage JavaScript content
      • Understand the JavaScript SEO basics
      • Fix search-related JavaScript problems
      • Fix lazy-loaded content
      • Implement dynamic rendering
  • Change your Search appearance
    • Overview of Search appearance topics
    • Create good titles and snippets in Search Results
    • Enable Search result features for your site
    • Featured snippets and your website
    • Provide a publication date to Google Search
    • Define a favicon to show in search results
    • Using structured data
      • Explore the search gallery
      • Understand how structured data works
      • Try the structured data codelab
      • Structured data general guidelines
      • Generate structured data with JavaScript
      • Feature guides
        • Article
        • Book
        • Breadcrumb
        • Carousel
        • Course
        • COVID-19 announcements
        • Critic review
        • Dataset
        • Employer Aggregate Rating
        • Estimated salary
        • Event
        • Fact Check
        • FAQ
        • Home Activities
        • How-to
        • Image License
        • Job Posting
        • Job Training
        • Local Business
        • Logo
        • Movie
        • Product
        • Q&A
        • Recipe
        • Review snippet
        • Sitelinks search box
        • Software App
        • Speakable
        • Subscription and paywalled content
        • Video
    • Enriched search results
    • Flexible Sampling general guidance
    • Enable Google Podcasts in Search results
    • Enable Top Places List
    • Opt out of display in local search results and other Google properties
    • Use Image Rights Metadata in Google Images
    • Web Stories
      • Enable Web Stories on Google
      • Best practices for creating Web Stories
      • Web Story content policy
    • Early Adopters Program
      • 3D and AR results
      • Package tracking
      • Mobile recharge
  • Optimize your page experience
    • Understanding page experience
    • Mobile
      • Overview of mobile topics
      • Mobile-friendliness
        • Overview
        • Getting started
        • Mobile-first indexing best practices
        • Choose a configuration
          • Overview
          • Responsive Web Design
          • Dynamic Serving
          • Separate URLs
          • Tablets and Feature phones
        • Avoid common mistakes when designing for mobile
        • Customize your website software to be mobile-friendly
        • Resources for developing mobile-friendly pages
        • Mobile FAQs
      • Announce mobile billing charges clearly
      • Mobile viewing on feature phones
      • Web Light: Faster and lighter pages from Search
      • Ad network support for Web Light pages in Google Search
      • Google Discover and your website
    • Security
      • Overview of security topics
      • Secure your site with HTTPS
      • What is hacking or hacked content?
      • Malware and unwanted software
      • Preventing malware infection
      • Social Engineering (Phishing and Deceptive Sites)
      • Google Safe Browsing Repeat Offenders Policy
    • AMP
      • Understand how AMP looks in search results
      • Enhance AMP content
      • Validate AMP content
      • Remove AMP content
  • Search APIs
    • Site Verification API
    • Search Console API
    • URL Testing Tools API
    • Indexing API
  • Not much time?
  • Quickstart
  • Get on Google
  • Optimize your site for search engines
  • Measuring your performance on Google
  • Beginner SEO
  • Get started
  • SEO starter guide
  • Do you need an SEO?
  • Beginners guide to Search Console
  • Advanced SEO
  • Get started
  • Guidelines
  • Control crawling and indexing
  • Change your Search appearance
  • Optimize page experience
  • Blog
  • Events
  • Documentation updates
  • Home
  • Google Search Central
  • Documentation
  • Advanced SEO

Make sure Googlebot is not blocked

Blocking Googlebot from accessing a site can directly affect Googlebot's ability to crawl and index the site's content, and may lead to a loss of ranking in Google's search results.

When Google detects this issue, we may notify you that Googlebot is being blocked.

You can see all pages blocked on your site in the Index Coverage report, or test a specific page using the URL Inspection tool.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2021-01-12 UTC.

  • Ask questions

    • Post in our help community
    • Join SEO office hours
    • Help documentation
  • Get updates

    • Blog
    • Twitter
    • YouTube
  • Resources

    • Do you need an SEO?
    • SEO Starter Guide
    • Search Console documentation
    • Case Studies
  • Tools

    • Search Console
    • Mobile-Friendly Test
    • Rich Results Test
    • PageSpeed Insights
    • AMP Test
Google Developers
  • Android
  • Chrome
  • Firebase
  • Google Cloud Platform
  • All products
  • Terms
  • Privacy
  • ICP证合字B2-20070004号
  • Sign up for the Google Developers newsletter Subscribe