3dadaa4432
Add default robots.txt that allows bots access to all paths. Add mix task to generate robots.txt taht allows bots access to no paths. Document custom emojis, MRF and static_dir static_dir documentation includes docs for the robots.txt Mix task.
3 lines
25 B
Plaintext
3 lines
25 B
Plaintext
User-Agent: *
|
|
Disallow:
|