Introducing pay per crawl
Cloudflare's July 2025 post on pay per crawl, where site owners set a per-request price and AI crawlers get a payment-required response until they pay.
For intermediate readers. A blog from Cloudflare; catalog added 2026-10-19, last verified 2026-10-19.
by Cloudflare
- Level
- Intermediate
- Category
- AI search visibility (SEO/GEO/AEO)
- Tags
- ai-crawler-access-and-robots, ai-search-visibility-seo-geo-aeo
- Added
- 2026-10-19
- Last verified
- 2026-10-19
- Status
- ok
- Resource kind
- learning_resource
- Type
- blog
- Region
- West
- Original language
- en
- Access
- free
- Last modified
- 2026-10-19
- Subcategory
- AI crawler access and robots
- Verification basis
- Supplier-reported import check. Subsequent source corrections and content reviews are recorded separately.
- Access evidence
- Supplier-approved free inventory; not independently verified by this site.
- Source domain
- AI search visibility (SEO/GEO/AEO)
- Source subdomain
- AI crawler access and robots
Summary in our own words. Rights remain with the original creator. Credit and correction policy.