Generate permissive or restrictive robots.txt in the config generator

This commit is contained in:
Sachin Joshi 2019-04-03 00:54:16 +05:45
commit cd41584ac4
2 changed files with 36 additions and 0 deletions

View file

@ -0,0 +1,2 @@
User-Agent: *
Disallow: <%= if indexable, do: "", else: "/" %>