Amazon

alexa site audit is operated by Amazon. Traditional search-engine crawler that indexes pages for organic-search results. Blocking this almost always reduces visibility in the corresponding search engine.

Amazon AdBot is operated by Amazon. Competitive, marketing, or threat-intelligence data collection. Often crawls competitor pages, ad creatives, or pricing pages on behalf of a buyer.

Amazon Bedrock AgentCore Browser is operated by Amazon. General-purpose automated agent without a more specific classification. Behavior varies, review the user-agent string and request pattern before allow/block decisions.

Amazon Bedrock AgentCore Browser (AP Northeast) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (AP South) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (AP Southeast 1) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (AP Southeast) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (EU Central 1) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (EU West 1) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (US East 1) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (US East 2) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Bedrock AgentCore Browser (US West 2) is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Buy For Me is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

Amazon Contxbot is operated by Amazon. Ad-platform crawler that fetches landing pages for quality, policy, and creative checks. Blocking it typically breaks ad serving on the affected URLs.

Amazon ELB is operated by Amazon. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.

Amazon Kendra is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

Amazon Route53 Health Check is operated by Amazon. Site-monitoring, uptime, performance, or QA tooling, usually run by a third-party SaaS on behalf of someone who manages the site. Rarely affects rankings or visibility.

Amazon-Bedrock-AgentCore is operated by Amazon. Autonomously navigates websites, fills forms, and takes actions on behalf of a human user. Often runs a full headless browser and can perform any interaction a person could.

amazon-kendra is operated by Amazon. Indexes pages for AI-powered search products that cite and link back to sources. Allowing it is typically how a site becomes citable inside answer engines and LLM search.

Amazon-Product-API is operated by Amazon. Catalog crawler that indexes product feeds for AI-powered shopping experiences and answer engines. Allowing it is how products become discoverable inside agentic commerce.

Amazon-Rufus is operated by Amazon. Catalog crawler that indexes product feeds for AI-powered shopping experiences and answer engines. Allowing it is how products become discoverable inside agentic commerce.

AmazonAdBot is operated by Amazon. Competitive, marketing, or threat-intelligence data collection. Often crawls competitor pages, ad creatives, or pricing pages on behalf of a buyer.

Amazonbot is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

Amazonbot-Video is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

AmazonBuyForMe is operated by Amazon. Autonomously navigates websites, fills forms, and takes actions on behalf of a human user. Often runs a full headless browser and can perform any interaction a person could.

AmazonProductDiscovery is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

AmazonSellerInitiatedListing is operated by Amazon. Generic programmatic data extraction with intent that varies case-by-case. Worth checking the operator before blocking, some are legitimate research, some are abusive.

Amzn-SearchBot is operated by Amazon. Indexes pages for AI-powered search products that cite and link back to sources. Allowing it is typically how a site becomes citable inside answer engines and LLM search.

Amzn-User is operated by Amazon. Fetches a page in real time when an LLM is mid-answer to a user question. Traffic spikes correlate with question volume rather than crawl schedules, so it shows up unpredictably.

AWS Lambda is operated by Amazon. Single-page fetch triggered by a user action, link previews, social unfurlers, RSS readers. Volume tracks shares and clicks rather than crawl schedules.

bedrockbot is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

Bedrockbot-UA is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

CloudFront is operated by Amazon. Generic programmatic data extraction with intent that varies case-by-case. Worth checking the operator before blocking, some are legitimate research, some are abusive.

contxbot is operated by Amazon. Competitive, marketing, or threat-intelligence data collection. Often crawls competitor pages, ad creatives, or pricing pages on behalf of a buyer.

Kiro is operated by Amazon. AI-powered developer tool that fetches docs, code samples, and package metadata to ground code suggestions. Usually identifies itself with a Coding Agent or model-specific user-agent.

NovaAct is operated by Amazon. Autonomously navigates websites, fills forms, and takes actions on behalf of a human user. Often runs a full headless browser and can perform any interaction a person could.

Rufus-Bot is operated by Amazon. Crawls broadly across the public web to gather content for training new model versions. Site owners can opt out via robots.txt, though enforcement varies by operator.

Sizmek (Amazon) is operated by Amazon. Brand-safety and ad-quality crawler, DoubleVerify, Moat, IAS, Criteo and similar, verifying that ads render in safe contexts. Allowed by default in most ad stacks.