Operator
Anthropic
Anthropic runs 12 bots across 6 agent types. Each one is a separate user-agent so you can allow or block them independently.
Anthropic-Agent is operated by Anthropic. Autonomous browser agent specifically running shopping or checkout flows on behalf of a buyer. Volume is small today but growing fast as AI shopping assistants ship.
anthropic-ai is operated by Anthropic. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.
Anthropic-Claude is operated by Anthropic. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.
Anthropic-ComputerUse is operated by Anthropic. Autonomously navigates websites, fills forms, and takes actions on behalf of a human user. Often runs a full headless browser and can perform any interaction a person could.
Claude-Code is operated by Anthropic. AI-powered developer tool that fetches docs, code samples, and package metadata to ground code suggestions. Usually identifies itself with a Coding Agent or model-specific user-agent.
Claude-Commerce is operated by Anthropic. Autonomous browser agent specifically running shopping or checkout flows on behalf of a buyer. Volume is small today but growing fast as AI shopping assistants ship.
Claude-Researcher is operated by Anthropic. Autonomously navigates websites, fills forms, and takes actions on behalf of a human user. Often runs a full headless browser and can perform any interaction a person could.
Claude-SearchBot is operated by Anthropic. Indexes pages for AI-powered search products that cite and link back to sources. Allowing it is typically how a site becomes citable inside answer engines and LLM search.
Claude-User is operated by Anthropic. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.
Claude-Web is operated by Anthropic. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.
ClaudeBot is operated by Anthropic. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.
ClaudeBot-User is operated by Anthropic. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.
Live data · via Cloudflare Radar
See how Anthropic's bots show up in real internet traffic
Cloudflare Radar publishes a continuously-updating view of AI bot activity across the websites Cloudflare protects. You can see which user-agents drive the most requests, how that share shifts week to week, and which industries each bot crawls hardest. The data refreshes on Cloudflare's side, so the link below is always current.
Open Cloudflare Radar AI InsightsWhat you'll find there
- ·User-agent share for every tracked AI bot, including Anthropic's
- ·Robots.txt and crawl-purpose breakdowns per operator
- ·Industry and content-type targets for each crawler
- ·Time-series trends going back several months