What is GPTBot?
GPTBot is OpenAI's web crawler. OpenAI uses the content it collects to train its generative AI foundation models.
- Operator
- OpenAI
- Class
- Crawls pages that can be used to train AI
- Verification
- Published networksDevTune checks that each request comes from OpenAI's own network, using the address ranges, DNS names or network routes OpenAI publishes. A request it can't match isn't counted as verified.
On your site
It requests pages to collect content, not to answer a question someone is asking right now. What it collects can be used to train AI models. AI Traffic counts its requests as training crawls.
AI Traffic setup
Connect a crawler sensor (Cloudflare pull, edge middleware or a Vercel log drain) to see which pages GPTBot requests on your site.
Set up AI Traffic