docs site: serve a robots.txt at the site root
This commit is contained in:
1 parent
44f040c27f
commit
fa1f38ced2
2 files changed
+6
No files matched your search
@@ -0,0 +1,3 @@
|
||||
# Documentation site crawler rules
|
||||
User-agent: *
|
||||
Allow: /
|
||||
Reference in new issue
Block a user