AI Demand identifies these AI crawlers and fetchers on your site:
- OpenAI: GPTBot, OAI-SearchBot, ChatGPT-User
- Anthropic: ClaudeBot, Claude-SearchBot, Claude-User, Claude-Web, anthropic-ai, Claude Code
- Google: Google-Agent, Google-NotebookLM, Google-CloudVertexBot, Gemini CLI
- Perplexity: PerplexityBot, Perplexity-User
- Microsoft: bingbot
- Apple: Applebot
- Amazon: Amazonbot, Amzn-SearchBot, Amzn-User
- Meta: Meta-ExternalAgent
- Mistral: MistralAI-User, MistralAI-Index
- DuckDuckGo: DuckAssistBot
- ByteDance: Bytespider
- OpenCode
Where an operator publishes its crawler addresses and your sensor passes the request's address, DevTune checks the request against them to verify the crawler's identity. Requests it can't check are shown as unverified.