diff options
Diffstat (limited to 'bskyweb/static')
| -rw-r--r-- | bskyweb/static/robots-disallow-all.txt | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/bskyweb/static/robots-disallow-all.txt b/bskyweb/static/robots-disallow-all.txt new file mode 100644 index 000000000..65400a08c --- /dev/null +++ b/bskyweb/static/robots-disallow-all.txt @@ -0,0 +1,3 @@ +# This is an development or self-hosted instance of the bsky web app, and crawling has been disallowed by the operator team. +User-Agent: * +Disallow: / |