Robots.txt generator
AI crawler presets and sitemap lines. Based on OpenRobots (MIT).
Enable JavaScript to use the SEO generators; legal pages include readable summaries where provided.