Directory · live counts update hourly
AI Bot & Crawler Directory
The AI crawlers that visit real websites: who runs them, what they collect, and how active each one is across the sites NeverDrafts tracks. Full picture on the AI Crawler Traffic Report.
Training bots
Bulk crawlers collecting your content to train AI models. Their visits mean your content can shape what future models know.
GPTBot383 hits / 30d
OpenAI
ClaudeBot1,671 hits / 30d
Anthropic
anthropic-ai0 hits / 30d
Anthropic
GoogleOther648 hits / 30d
Google
Meta-ExternalAgent10,288 hits / 30d
Meta
FacebookBot0 hits / 30d
Meta
Bytespider450 hits / 30d
ByteDance
DeepSeekBot359 hits / 30d
DeepSeek
CCBot708 hits / 30d
Common Crawl
Cohere Training Crawler0 hits / 30d
Cohere
cohere-ai362 hits / 30d
Cohere
AI2Bot1 hits / 30d
Allen Institute for AI
Diffbot0 hits / 30d
Diffbot
PanguBot85 hits / 30d
Huawei
Omgili0 hits / 30d
Webz.io
Timpibot0 hits / 30d
Timpi
img2dataset2 hits / 30d
Open datasets
AI search index bots
Crawlers building the retrieval indexes behind AI search products. Being crawled here is a prerequisite for being cited.
Live answer fetch bots
Real-time fetches made while an assistant answers a specific user. These are the closest thing to an AI "pageview" of your site.
ChatGPT-User1,329 hits / 30d
OpenAI
Claude-User418 hits / 30d
Anthropic
Claude-Web0 hits / 30d
Anthropic
Perplexity-User244 hits / 30d
Perplexity
Google-CloudVertexBot0 hits / 30d
Google
Meta-ExternalFetcher273 hits / 30d
Meta
MicrosoftPreview0 hits / 30d
Microsoft
MistralAI-User91 hits / 30d
Mistral
DuckAssistBot368 hits / 30d
DuckDuckGo
Want to know which of these bots visit your site — and whether ChatGPT recommends you when your buyers ask?
Start monitoring