[GNUnet-SVN] [www] branch master updated: stage robots

[gnunet]

This is an automated email from the git hooks/post-receive script.

grothoff pushed a commit to branch master
in repository www.

The following commit(s) were added to refs/heads/master by this push:
     new 05eab47  stage robots
05eab47 is described below

commit 05eab47e54f768bcad4ed363a5cde6a32cbb91ba
Author: Christian Grothoff <address@hidden>
AuthorDate: Sun Jul 7 21:04:59 2019 +0200

    stage robots
---
 static/stage.robots.txt | 21 +++++++++++++++++++++
 1 file changed, 21 insertions(+)

diff --git a/static/stage.robots.txt b/static/stage.robots.txt
new file mode 100644
index 0000000..c708b60
--- /dev/null
+++ b/static/stage.robots.txt
@@ -0,0 +1,21 @@
+#
+# robots.txt
+#
+# This file is to prevent the crawling and indexing of certain parts
+# of your site by web crawlers and spiders run by sites like Yahoo!
+# and Google. By telling these "robots" where not to go on your site,
+# you save bandwidth and server resources.
+#
+# This file will be ignored unless it is at the root of your host:
+# Used:    http://example.com/robots.txt
+# Ignored: http://example.com/site/robots.txt
+#
+# For more information about the robots.txt standard, see:
+# http://www.robotstxt.org/robotstxt.html
+#
+# For syntax checking, see:
+# http://www.frobee.com/robots-txt-check
+
+User-agent: *
+Disallow: /
+

-- 
To stop receiving notification emails like this one, please contact
address@hidden.