Silverstripe Version: 4
How do I implement a robots.txt?
Thank you.
Just create a text file called robots.txt with the relevant content in (there are generators online if you need help):
User-Agent: *
Disallow:
Sitemap: https://example.com/sitemap.xml
Put that file in the web root (eg. the public directory in SS4)