diff options
| author | Samuel Thibault <samuel.thibault@ens-lyon.org> | 2010-04-25 23:49:36 +0200 |
|---|---|---|
| committer | Samuel Thibault <samuel.thibault@ens-lyon.org> | 2010-04-25 23:49:36 +0200 |
| commit | eda73e27396543ffdcff83f011cb021e4dbcd3d6 (patch) | |
| tree | a42671546e3d1ffa59a99a51c32e0367326b7ba4 /public_hurd_boxen | |
| parent | 0eb2429e4084bfe1ce13eb73feff1f18df8f4614 (diff) | |
| parent | ca159a6393b8dbb103fdd2cb9d818ba50f4e11f6 (diff) | |
Merge branch 'master' of flubber:~hurd-web/hurd-web
Diffstat (limited to 'public_hurd_boxen')
| -rw-r--r-- | public_hurd_boxen/installation/snubber.mdwn | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/public_hurd_boxen/installation/snubber.mdwn b/public_hurd_boxen/installation/snubber.mdwn index f9542a9f..dbbade9f 100644 --- a/public_hurd_boxen/installation/snubber.mdwn +++ b/public_hurd_boxen/installation/snubber.mdwn @@ -30,6 +30,24 @@ License|/fdl]]."]]"""]] $ mkdir tmp/backup && chmod 0733 tmp/backup +# `/var/www/robots.txt` + +This file used to contain: + + User-agent: * + Disallow: /gitweb/ + Disallow: /cgi-bin/ + +... which I've now changed to: + + User-agent: * + Disallow: / + +The goal is that robots rather index the official pages, +<http://www.gnu.org/software/hurd/>, instead of the staging area on +<http://www.bddebian.com:8888/~hurd-web/>. + + # Restore Backup ## `/etc/apache2/mods-enabled/` |