t_a/cavepaintingsFork
1
Fork 0
forked from Cavemanon/cavepaintings
Code Issues Pull Requests Packages Projects Releases Wiki Activity

rename handle_static to static_files - stop confusing it with file handlers

Browse Source
This commit is contained in:
Shish
2020-02-23 18:48:25 +00:00
parent 9dcc8b7da1
commit e1e161759e
19 changed files with 14 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
ext/static_files/static/robots.txt Normal file
View File

@@ -0,0 +1,11 @@
User-agent: *
# comment lists change all the time, crawlers should
# index individual image's comments
Disallow: /comment/
# next and prev are just CPU-heavier ways of getting
# to the same images that the index shows
Disallow: /post/next/
Disallow: /post/prev/
# Site is rate limited to 1 request / sec,
# returns 503 for more than that
Crawl-delay: 3