# Introducing Rankly Agent Directory

> A free public catalog of 4,171 AI bots, crawlers, and agents hitting websites today. What each one wants, how to identify it, and whether to allow or block it.

**Published:** 2026-05-11  
**Category:** Product  
**URL:** https://www.tryrankly.com/blogs/introducing-agent-directory  

## In this article

1. Why we built the Agent Directory
2. What the directory shows for each bot
3. How to filter and find what matters
4. Per-bot detail pages: identification, control, expected behavior
5. Operator roll-ups: every bot from one vendor in a single table
6. Data sources (BuzzStream, Cloudflare Radar AI Insights, Vercel)
7. Lead-in to Agent Analytics + Agent Experience

---

Read the full article with screenshots and the live directory at [https://www.tryrankly.com/blogs/introducing-agent-directory](https://www.tryrankly.com/blogs/introducing-agent-directory).

**Keywords:** Agent Directory, AI bot directory, AI crawler list, GPTBot, ClaudeBot, PerplexityBot, robots.txt, block AI crawlers, AEO, agent analytics