Webionite/haste-server
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Added non-standard but desirable robots.txt

Browse Source
This commit is contained in:
John Crepezzi
2011-12-16 08:18:04 -05:00
parent 44f7ab3f33
commit 14a23388a8
1 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
static/robots.txt
View File

@@ -1,3 +1,4 @@
User-agent: * User-agent: *
Allow: /about Disallow: /*
Disallow: / Allow: /?okparam=
Allow: /$