diff options
| author | Thomas Schwinge <thomas@schwinge.name> | 2010-04-01 10:34:24 +0200 |
|---|---|---|
| committer | Thomas Schwinge <thomas@schwinge.name> | 2010-04-01 10:34:24 +0200 |
| commit | 04866256970d04ba76f9c94e2cc74fed025776a9 (patch) | |
| tree | 1e9c1b53f2894ed24bbfb560b10f554e606ae48c /public_hurd_boxen | |
| parent | 645805cf8dfadfe23bbcab981a8696febb0c18ef (diff) | |
public_hurd_boxen/installation/snubber: Talk about /var/www/robots.txt.
Diffstat (limited to 'public_hurd_boxen')
| -rw-r--r-- | public_hurd_boxen/installation/snubber.mdwn | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/public_hurd_boxen/installation/snubber.mdwn b/public_hurd_boxen/installation/snubber.mdwn index f9542a9f..dbbade9f 100644 --- a/public_hurd_boxen/installation/snubber.mdwn +++ b/public_hurd_boxen/installation/snubber.mdwn @@ -30,6 +30,24 @@ License|/fdl]]."]]"""]] $ mkdir tmp/backup && chmod 0733 tmp/backup +# `/var/www/robots.txt` + +This file used to contain: + + User-agent: * + Disallow: /gitweb/ + Disallow: /cgi-bin/ + +... which I've now changed to: + + User-agent: * + Disallow: / + +The goal is that robots rather index the official pages, +<http://www.gnu.org/software/hurd/>, instead of the staging area on +<http://www.bddebian.com:8888/~hurd-web/>. + + # Restore Backup ## `/etc/apache2/mods-enabled/` |