Cloudflare's AI-crawler default did not reach this site's existing zone

Cloudflare’s September 15 change to its AI-crawler defaults did not reach this publication’s own site, an existing domain on Cloudflare’s Free plan, according to snapshots of the zone’s settings taken through Cloudflare’s API on September 10 and October 9. Cloudflare said Training and Agent crawlers would be “blocked by default on the pages that display ads” for “all new domains onboarding to Cloudflare”; several third-party summaries said the change reached existing free customers as well, and Cloudflare did not address the difference.

The API records the choice in more than one place, and each accepts a value of only_on_ad_pages. ai_bots_protection is the rule that blocks AI crawlers; ai_training, ai_search and ai_user set the robots.txt policy for training, search and assistant-or-agent bots. A zone that took the ad-page default would show it in those fields whether or not it runs ads. On anythingengineoptimization.com all four read disabled on both dates. The zone never set the flag Cloudflare’s schema describes as tracking “zones opted out of AI bots managed-rule updates,” and received no update anyway.

This is one zone, and it already had every bot protection switched off. The second snapshot came three weeks after the change, so a setting changed and reversed in between would not show. The result is consistent with Cloudflare’s own wording, new domains only, and says nothing about any other existing zone.