Operator
Cloudflare
Cloudflare runs 35 bots across 9 agent types. Each one is a separate user-agent so you can allow or block them independently.
AI Search is operated by Cloudflare. Indexes pages for AI-powered search products that cite and link back to sources. Allowing it is typically how a site becomes citable inside answer engines and LLM search.
bushbaby is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
CloudFlare Always Online is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
CloudFlare AMP Fetcher is operated by Cloudflare. Single-page fetch triggered by a user action, link previews, social unfurlers, RSS readers. Volume tracks shares and clicks rather than crawl schedules.
Cloudflare Browser Rendering is operated by Cloudflare. General-purpose automated agent without a more specific classification. Behavior varies, review the user-agent string and request pattern before allow/block decisions.
Cloudflare Crawler is operated by Cloudflare. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.
Cloudflare CSUP is operated by Cloudflare. Generic programmatic data extraction with intent that varies case-by-case. Worth checking the operator before blocking, some are legitimate research, some are abusive.
Cloudflare Custom Error Page Crawler is operated by Cloudflare. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.
Cloudflare Diagnostics is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare Digicert DCV is operated by Cloudflare. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.
Cloudflare Healthchecks is operated by Cloudflare. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.
Cloudflare Observatory is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare Observatory Curly is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare Prefetch is operated by Cloudflare. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.
Cloudflare Purge is operated by Cloudflare. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.
Cloudflare Radar URL Scanner is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare Security Insights is operated by Cloudflare. Probes websites for vulnerabilities, exposed credentials, or compliance issues. Sometimes legitimate (your own pentest vendor) and sometimes hostile reconnaissance.
Cloudflare Smart Transit is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare SpeedTest is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare SSL Detector is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare SSLDetector is operated by Cloudflare. Maps link graphs, ranking signals, and audit data for SEO tooling. Typically run by SaaS platforms on behalf of marketers monitoring their own or competitor sites.
Cloudflare Traffic Manager is operated by Cloudflare. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.
Cloudflare Validator is operated by Cloudflare. Generic programmatic data extraction with intent that varies case-by-case. Worth checking the operator before blocking, some are legitimate research, some are abusive.
CloudFlare-AlwaysOnline is operated by Cloudflare. Internal CDN bot performing health checks, prefetch, or SSL probes from Cloudflare, Fastly, AWS, or similar. Almost never user-facing, usually safe to allow.
Cloudflare-AutoRAG is operated by Cloudflare. Indexes pages for AI-powered search products that cite and link back to sources. Allowing it is typically how a site becomes citable inside answer engines and LLM search.
Cloudflare-Healthchecks is operated by Cloudflare. Internal CDN bot performing health checks, prefetch, or SSL probes from Cloudflare, Fastly, AWS, or similar. Almost never user-facing, usually safe to allow.
CloudFlare-Prefetch is operated by Cloudflare. Internal CDN bot performing health checks, prefetch, or SSL probes from Cloudflare, Fastly, AWS, or similar. Almost never user-facing, usually safe to allow.
Cloudflare-SSLDetector is operated by Cloudflare. Internal CDN bot performing health checks, prefetch, or SSL probes from Cloudflare, Fastly, AWS, or similar. Almost never user-facing, usually safe to allow.
Cloudflare-Traffic-Manager is operated by Cloudflare. Internal CDN bot performing health checks, prefetch, or SSL probes from Cloudflare, Fastly, AWS, or similar. Almost never user-facing, usually safe to allow.
Cloudflare-Validator is operated by Cloudflare. Probes websites for vulnerabilities, exposed credentials, or compliance issues. Sometimes legitimate (your own pentest vendor) and sometimes hostile reconnaissance.
Collapsify is operated by Cloudflare. Single-page fetch triggered by a user action, link previews, social unfurlers, RSS readers. Volume tracks shares and clicks rather than crawl schedules.
Daric2 is operated by Cloudflare. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.
Daric3 is operated by Cloudflare. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.
Daric4 is operated by Cloudflare. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.
Digicert DCV is operated by Cloudflare. Probes websites for vulnerabilities, exposed credentials, or compliance issues. Sometimes legitimate (your own pentest vendor) and sometimes hostile reconnaissance.
Live data · via Cloudflare Radar
See how Cloudflare's bots show up in real internet traffic
Cloudflare Radar publishes a continuously-updating view of AI bot activity across the websites Cloudflare protects. You can see which user-agents drive the most requests, how that share shifts week to week, and which industries each bot crawls hardest. The data refreshes on Cloudflare's side, so the link below is always current.
Open Cloudflare Radar AI InsightsWhat you'll find there
- ·User-agent share for every tracked AI bot, including Cloudflare's
- ·Robots.txt and crawl-purpose breakdowns per operator
- ·Industry and content-type targets for each crawler
- ·Time-series trends going back several months