Common Crawl: two-thirds of llms.txt files are templates
Common Crawl analyzed 584,107 llms.txt files gathered in its July 2026 crawl archive and found 68% were produced by templates or SEO plugins — Wix alone accounts for 41% of the corpus, with All in One SEO and Yoast contributing smaller shares — while only about half fully follow the specification’s structure of a title, summary line, and link sections. Automated screening flagged 3,793 files for steering language aimed at AI crawlers and 10 for “classic prompt injection” severity, but manual review confirmed only 4 files contained a genuine injection attempt.
Why it matters: The count suggests llms.txt adoption is running mostly on CMS-plugin autopilot rather than deliberate authoring — one more reason to doubt the file format is doing much to shape what AI crawlers see.
The record: llms.txt
Glossary: SEOAI crawlersllms.txt
Posted to the wire August 31, 2026.