Search Central Live is coming to New York City on March 20, 2025! Learn more and
apply for an invite.
Do I need a robots.txt if I don't want to block crawlers?
2011-10-01
We published a blog post in German, however it's not translated to English.
Start reading in German.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
[null,null,[],[[["A German blog post was published on October 1, 2011, discussing robots.txt."],["The blog post is only available in German and has not been translated into English."]]],["A German blog post was published on October 1st, 2011, and it has not been translated into English. The provided link directs users to the German version of the post, titled \"Brauche ich eine robots.txt, wenn ich?\" (Do I need a robots.txt if I?). The post is only accessible in German.\n"]]