LLMs Toolkit

Generate llms.txt configuration and analyze website content

Advanced Options & LLMs Settings

📄 Output Format

Standard llms.txtllms-full.txt (Comprehensive)

Follow links (depth: 2)Include metadataPublic access

🔍 Crawl Settings

Max Depth

Crawl Delay (sec)

💡 Higher depth = more pages. Increase delay if getting blocked.

🤖 Model Types

📋 Content License

🔗 LLM Policy URL

⏳ Data Retention

📝 Attribution Required

🎯 Prompt Usage