The Website Specification
Joost de Valk's sourced reference of web standards from HTML head tags to robots.txt, llms.txt and security.txt, also queryable through an MCP server.
For intermediate–advanced readers. A guide from Joost de Valk; catalog added 2026-10-19, last verified 2026-10-19.
- Level
- Intermediate–Advanced
- Category
- AI search visibility (SEO/GEO/AEO)
- Tags
- ai-search-visibility-seo-geo-aeo, llms-txt-and-agent-readable-sites
- Added
- 2026-10-19
- Last verified
- 2026-10-19
- Status
- ok
- Resource kind
- learning_resource
- Type
- guide
- Region
- West
- Original language
- en
- Access
- free
- Last modified
- 2026-10-19
- Subcategory
- llms.txt and agent-readable sites
- Verification basis
- Supplier-reported import check. Subsequent source corrections and content reviews are recorded separately.
- Access evidence
- Supplier-approved free inventory; not independently verified by this site.
- Source domain
- AI search visibility (SEO/GEO/AEO)
- Source subdomain
- llms.txt and agent-readable sites
Summary in our own words. Rights remain with the original creator. Credit and correction policy.