What is Claude-SearchBot?
Claude-SearchBot is Anthropic's search crawler. It indexes pages so Claude can find and cite them when it searches the web.
- Operator
- Anthropic
- Class
- Crawls to index pages for search
- Verification
- Published networksDevTune checks that each request comes from Anthropic's own network, using the address ranges, DNS names or network routes Anthropic publishes. A request it can't match isn't counted as verified.
On your site
It requests pages to keep an index current, not to answer a question someone is asking right now. AI Traffic recognises and verifies its requests, and keeps them out of the training-crawl and answer-fetch counts.
AI Traffic setup
Connect a crawler sensor (Cloudflare pull, edge middleware or a Vercel log drain) to see which pages Claude-SearchBot requests on your site.
Set up AI Traffic