llms.txt and agent-readable sites: 13 curated resources
llms.txt and agent-readable sites: 13 curated resources brings together 13 resources with credited original sources. Use prerequisite levels to find learning material; unrated entities remain available in the full collection.
llms.txt and agent-readable sites
13 resources · page 1 of 1
agentmarkup
by agentmarkup
Build-time generator of llms.txt, JSON-LD, Markdown mirrors and AI crawler rules, with validation, for Vite, Astro, Next.js and Nuxt sites.
llms-txt
by Answer.AI
Source repo of the llms.txt proposal by Jeremy Howard, with the Python parser and llms_txt2ctx tool that expands an llms.txt into model context.
actor-llmstxt-generator
by Apify
Apify Actor that crawls a documentation site and writes an llms.txt index, plus an optional llms-full.txt with each page's content.
dualmark
Library that serves a Markdown version of each page at the same URL through content negotiation, with adapters for Astro, Next.js, SvelteKit and Cloudflare.
sphinx-llms-txt
Sphinx extension that writes an llms.txt summary and a combined llms-full.txt file during a documentation build.
NLWeb
by nlweb.ai
Reference implementation of NLWeb, which turns a site's schema.org and RSS data into a natural-language query endpoint that also answers MCP clients.
vitepress-plugin-llms
by Okinea Dev
VitePress plugin that generates llms.txt, llms-full.txt and per-page Markdown files from a documentation site.
llms-txt-hub
by David Dias
Directory of projects and companies that publish an llms.txt file, with a link to each file and related tools.
Universal Commerce Protocol (UCP) GitHub repo
by Universal Commerce Protocol (UCP)
Spec and docs for the Universal Commerce Protocol, an open standard for agents to discover what a merchant offers and complete checkout.
Markdown for Agents
by Cloudflare
Cloudflare feature that converts a page's HTML to Markdown at the edge when a client asks for text/markdown in the Accept header.
llms.txt in Mintlify
by Mintlify
Mintlify docs on the llms.txt and llms-full.txt files it hosts automatically for every documentation site, and how to override them.
Product feed specification
by OpenAI
OpenAI's list of required and optional product feed fields that merchants submit so their products can be shown and bought inside ChatGPT.
The Website Specification
Joost de Valk's sourced reference of web standards from HTML head tags to robots.txt, llms.txt and security.txt, also queryable through an MCP server.