Corrections
Every correction the wire has run, in one place. Corrections are appended to the item and dated — never silently edited. This log exists whether it's empty or not.
Sites with OpenAI deals let ChatGPT's search in and keep Claude's out
- 2026-10-19: This item's summary first said which assistant someone uses "now decides which publishers it can read." robots.txt rules govern a company's own crawlers, not every route to a publisher's content: licensed partners often receive feeds or APIs, and AI search tools can draw headlines and snippets from other search indexes. The summary now says what the data shows, and the item adds the training-bot and Google-Extended counts and the check that the Claude blocks are named, not blanket.
Chartbeat: Google traffic to publishers fell 40% in a year
- 2026-10-17: This item originally said small publishers lost about 60% of their search referral traffic, medium publishers 47% and large publishers 22%, and attributed that breakdown to Chartbeat's 2026 Publisher Playbook. The playbook gives no breakdown by publisher size. The 60% figure comes from earlier Chartbeat data that Axios reported in March, and Search Engine Journal says the playbook doesn't break down its data by size. The breakdown has been removed from the item, its Q&A and its summary.
Ahrefs: AI Overviews now appear on 83% of branded searches
- 2026-10-09: This item originally said 76.2% of "the branded AI Overviews Ahrefs sampled" sat in first position, and that Wikipedia drew 71.9% of citations. Both figures come from a separate Ahrefs panel of 100 bare brand names, not from the 82.91% branded-keyword sample: 63 of those 100 names showed an AI Overview by September 30, 48 of them (76.2%) in first position, and Wikipedia was cited in 41 of the 57 AI Overviews whose sources were visible (71.9%).
ChatGPT-5.6 Luna shifts to site: search, cites fewer sources
- 2026-09-28: This item originally said Luna used the site: operator in "76% of searches" and that "total search volume held roughly steady." Seer measured fan-out queries — the sub-queries ChatGPT runs while answering — not searches: 76% of Luna's fan-out queries used site:, against 21.6% for GPT-5.5, and the total number of fan-out queries held steady (729 versus 733).
Cloudflare syncs robots.txt, sets four conditions for crawlers that also train
- 2026-08-27: This item originally said Cloudflare "rewrites" a site's robots.txt and that Bot Preference Sync "auto-generates" the file. It does neither. Cloudflare prepends a managed block and, in its own words, any existing Disallow directives are maintained; the sync is opt-in and can be turned off at any time. The headline has been changed from "Cloudflare rewrites robots.txt, gates access on disclosure", which also implied the disclosure conditions apply to crawling generally when they apply only to crawlers that both search and train, seeking access to sites that disallow training. The URL is unchanged.