Webionite
/
haste-server
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Added robots.txt

This commit is contained in:
John Crepezzi 2011-11-22 19:59:03 -05:00
parent 5b66695ca6
commit 2299819781
2 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
TODO
View File

@ -6,7 +6,6 @@ add link to about page
allow power users to force highlight lang - by supplying an extension!!!!!! allow power users to force highlight lang - by supplying an extension!!!!!!
maybe start serving highlighting on the other end to save transfer on highlight.js maybe start serving highlighting on the other end to save transfer on highlight.js
start using CDNs for most assets start using CDNs for most assets
robots.txt nofollow
kick expiration back by increment on each view kick expiration back by increment on each view
# shared version only # shared version only

2
static/robots.txt Normal file
View File

@ -0,0 +1,2 @@
User-agent: *
Disallow: /