AI agent directory
AI agents
The AI crawlers, answer fetchers and coding agents that request pages from your site: who runs each one, what it does there, and whether DevTune can check a request really came from it.
27 agents
Answer fetchers
Fetches pages to answer a question
- Amzn-UserOperatorAmazonVerificationPublished networks
- ChatGPT-UserOperatorOpenAIVerificationPublished networks
- Claude-UserOperatorAnthropicVerificationPublished networks
- DuckAssistBotOperatorDuckDuckGoVerificationPublished networksWeb Bot Auth
- Google-NotebookLMOperatorGoogleVerificationPublished networks
- MistralAI-UserOperatorMistral AIVerificationPublished networks
- Perplexity-UserOperatorPerplexityVerificationPublished networks
Coding agents
Coding agent fetching docs
- AiderOperatorIts user, on their own machineVerificationUser agent only
- Claude CodeOperatorIts user, on their own machine. Made by Anthropic.VerificationUser agent only
- CrushOperatorIts user, on their own machineVerificationUser agent only
- Gemini CLIOperatorIts user, on their own machine. Made by Google.VerificationUser agent only
- OpenCodeOperatorIts user, on their own machineVerificationUser agent only
- Qwen CodeOperatorIts user, on their own machineVerificationUser agent only
Acting agents
Browses and acts for a person
- Google-AgentOperatorGoogleVerificationPublished networksWeb Bot Auth
Search indexing crawlers
Crawls to index pages for search
- Amzn-SearchBotOperatorAmazonVerificationPublished networks
- ApplebotOperatorAppleVerificationPublished networks
- bingbotOperatorMicrosoftVerificationPublished networks
- Claude-SearchBotOperatorAnthropicVerificationPublished networks
- Google-CloudVertexBotOperatorGoogleVerificationPublished networks
- MistralAI-IndexOperatorMistral AIVerificationPublished networks
- OAI-SearchBotOperatorOpenAIVerificationPublished networks
- PerplexityBotOperatorPerplexityVerificationPublished networks
Training crawlers
Crawls pages that can be used to train AI
- AmazonbotOperatorAmazonVerificationPublished networks
- BytespiderOperatorByteDanceVerificationUser agent only
- ClaudeBotOperatorAnthropicVerificationPublished networks
- GPTBotOperatorOpenAIVerificationPublished networks
- Meta-ExternalAgentOperatorMetaVerificationPublished networks