Add robots.txt for search crawler
This commit is contained in:
9
robots.txt
Normal file
9
robots.txt
Normal file
@@ -0,0 +1,9 @@
|
||||
User-agent: *
|
||||
Disallow: /templates
|
||||
Disallow: /templates/
|
||||
Disallow: /ikiwiki
|
||||
Disallow: /ikiwiki/
|
||||
Disallow: /sandbox
|
||||
Disallow: /sandbox/
|
||||
Disallow: /smileys/
|
||||
Disallow: /wikiicons/
|
||||
Reference in New Issue
Block a user