User-Agent Rules
Crawl-delay:
Sitemaps (Global)
AI Crawler Details (llms.txt)
Define structural content for LLM parsers seeking markdown-based reference indexes.
Generated Outputs
Standard Search & AI Bot Rules
AI Index Profile (llms.txt)
Full AI Context File (llms-full.txt)
Note: Changes to form fields are compiled into the previews in real-time. Make sure to download and upload these to your site's root directory.
Access Resolution
Enter settings and click "Test Path Access" to run validation check.
Matching Rule Details
-