
Most Major News Publishers Block AI Training & Retrieval Bots via @sejournal, @MattGSouthern
- ●79% of top news publishers block at least one AI training bot, and 71% block at least one retrieval bot, which could limit their visibility in AI-generated answers.
- ●Common Crawl's CCBot and OpenAI's OAI-SearchBot are among the most frequently blocked bots, affecting how news content is accessed by AI tools.
- ●Robots.txt is a directive rather than a barrier, meaning determined bots can bypass these rules; thus, more advanced measures may be needed for effective bot blocking.
![Why Your Small Business’s Google Visibility in 2026 Depends on AEO [Webinar] via @sejournal, @hethr_campbell](https://cdn.searchenginejournal.com/wp-content/uploads/2026/01/2-497.png)









