Cloudflare evolves Pay Per Crawl into usage-based AI search payments
Cloudflare announced two initiatives on July 1, 2026 to reshape AI-era crawling economics. A research program shares freshness and content-quality signals from its network so answer engines can skip re-crawling unchanged pages; Cloudflare says it’s open to “every answer engine willing to play fair” and plans broader availability later this year. Separately, Pay Per Use evolves the company’s Pay Per Crawl program by basing compensation on how content is actually used in AI search results rather than per-crawl fees, with reporting on which queries drive traffic; Cloudflare is testing it now with partners including Ceramic.ai and You.com.
Why it matters: Cloudflare is trying to fix AI crawling's two-sided problem at once — cutting redundant fetches for publishers while tying payment to actual usage instead of raw crawl volume.
Posted to the wire August 1, 2026.