Cloudflare, OpenAI pilot adds pages to ChatGPT Search
Cloudflare and OpenAI ran a research pilot on about 1% of Cloudflare’s network, starting in July 2026, using Cloudflare signals such as page-update recency and traffic quality to help OpenAI’s crawler find pages for ChatGPT Search, per a joint Cloudflare post co-authored with OpenAI staff on October 15. The result: “hundreds of millions” of previously undiscovered pages indexed, though neither company gave an exact count. The companies stress a signal does not grant crawl access: sites can still block OAI-SearchBot through robots.txt, and that permission is separate from whether a page’s content can be used for model training.
Why it matters: Network-level signals about page freshness and traffic quality give OpenAI a way to find pages that ordinary crawling can miss, adding a new, largely invisible factor — how a site performs on Cloudflare's network — to whether ChatGPT Search finds it at all.
The record: OpenAIChatGPTCloudflare
Via Cloudflare ↗ · Search Engine Journal ↗
Posted to the wire October 20, 2026. Edited by Joe Balewski.