Claude-SearchBot blocked far more than OAI-SearchBot, study finds

OpenAEO, an AI-visibility vendor, measured 131 publisher, SaaS, ecommerce and agency domains for how they treat AI crawlers by name, narrowing to 12 sites after a correction removed a parked domain. OpenAI’s OAI-SearchBot was allowed by 11 of the 12; Anthropic’s Claude-SearchBot by only 4, with AP, Forbes, The Guardian, The New Yorker, The Verge and Vox among those blocking Claude’s crawler while permitting OpenAI’s. OpenAEO attributes the gap to publishers having learned OpenAI runs separate search and training crawlers, and not having learned the same about Anthropic.