AI crawler profile
What is cohere-ai? How to allow or block Cohere's crawler
Operator
Cohere
Purpose
AI model training
robots.txt
Compliance unknown
Official docs
None published
cohere-ai is the user agent associated with Cohere, whose Command models focus on enterprise use cases. The crawler is undocumented, which makes its exact behavior hard to verify — most site owners treat it as a training crawler and decide on blocking accordingly.
Does cohere-ai respect robots.txt?
Cohere publishes no official crawler documentation, so robots.txt compliance can't be verified; use firewall rules if blocking it matters to you.
Block cohere-ai with robots.txt
User-agent: cohere-ai Disallow: /
⚠ Because cohere-ai's robots.txt compliance is unreliable, pair this with a firewall or CDN rule matching the user-agent string if blocking actually matters to you.
Explicitly allow cohere-ai
User-agent: cohere-ai Allow: /
Should you block cohere-ai?
Blocking cohere-ai opts your content out of Cohere's model training — a legitimate choice for original content you don't want reproduced by AI. The trade-off: models trained without your content are less likely to know your brand or recommend it unprompted. There is no direct traffic loss today, since training crawlers don't send visitors. See our guide on whether to block AI bots for the full decision framework.
Check and monitor cohere-ai on your site
- AI Crawler Access Checker — see whether your current robots.txt allows or blocks cohere-ai.
- robots.txt Generator for AI Bots — build a robots.txt with per-bot rules for all 15 known AI crawlers.
- AI Bot Log Analyzer — paste server logs and count real cohere-ai hits, entirely in your browser.
Frequently asked questions
What is cohere-ai?
cohere-ai is Cohere's web crawler for collecting AI training data. Cohere's crawler used for training and grounding its models.
Does cohere-ai respect robots.txt?
Cohere publishes no official crawler documentation, so robots.txt compliance can't be verified; use firewall rules if blocking it matters to you.
How do I block cohere-ai?
Add "User-agent: cohere-ai" followed by "Disallow: /" to your robots.txt file. Because this bot's robots.txt compliance is not reliable, enforce the block with firewall or CDN rules (for example a Cloudflare WAF rule matching the user agent) if it matters to you.
Does blocking cohere-ai hurt my Google rankings?
No. cohere-ai is separate from Googlebot, which handles Google Search indexing. Blocking cohere-ai has no effect on your traditional search rankings.
How can I tell if cohere-ai is crawling my site?
Search your server access logs for the string "cohere-ai". Our free AI Bot Log Analyzer does this in your browser: paste a log file and it counts hits per AI crawler, including cohere-ai, with per-path breakdowns.
Part of our directory of every known AI crawler, refreshed monthly. Last verified: 2026-07-15.