diff options
Diffstat (limited to 'public_hurd_boxen/installation/snubber.mdwn')
| -rw-r--r-- | public_hurd_boxen/installation/snubber.mdwn | 18 |
1 files changed, 18 insertions, 0 deletions
diff --git a/public_hurd_boxen/installation/snubber.mdwn b/public_hurd_boxen/installation/snubber.mdwn index f9542a9f..dbbade9f 100644 --- a/public_hurd_boxen/installation/snubber.mdwn +++ b/public_hurd_boxen/installation/snubber.mdwn @@ -30,6 +30,24 @@ License|/fdl]]."]]"""]] $ mkdir tmp/backup && chmod 0733 tmp/backup +# `/var/www/robots.txt` + +This file used to contain: + + User-agent: * + Disallow: /gitweb/ + Disallow: /cgi-bin/ + +... which I've now changed to: + + User-agent: * + Disallow: / + +The goal is that robots rather index the official pages, +<http://www.gnu.org/software/hurd/>, instead of the staging area on +<http://www.bddebian.com:8888/~hurd-web/>. + + # Restore Backup ## `/etc/apache2/mods-enabled/` |