Learning Center · Answers · Access

Does blocking GPTBot remove my site from ChatGPT?

Short answer

No. GPTBot only collects pages that may be used to train OpenAI's models. ChatGPT search uses OAI-SearchBot, and ChatGPT-User fetches pages when a person asks about you. Block GPTBot if you want to opt out of training, and keep the other two allowed so ChatGPT can still read, cite and link to you.

Answer · Last checked November 12, 2026 · Based on robots.txt for AI agents: who to allow and who to block, Should you block AI crawlers? A decision guide for leaders

In more detail

OpenAI runs several agents, and each has its own robots.txt name so you can treat them differently. GPTBot is the training crawler. OAI-SearchBot crawls the web so ChatGPT can show and link to sites in its search results, and OpenAI says it isn't used to train its models. ChatGPT-User fetches a page in real time when someone using ChatGPT, or a custom GPT, asks about it or clicks through to it.

The risk lies in how the block is written. A crawler follows only the most specific group that names it, so a group for GPTBot affects GPTBot alone. A copied "block all AI" list usually names OAI-SearchBot and ChatGPT-User too, and that does take you out of ChatGPT's answers. A leftover Disallow: / for every user agent, often carried over from a staging site, blocks them as well.

Check your CDN as well. A one-click "block AI bots" setting or a firewall rule can stop ChatGPT-User or OAI-SearchBot before they ever read robots.txt. Ask whoever runs your bot protection which agents the setting covers, and make sure AI assistants and AI search are allowed by verified identity.

What to do

  1. Open yourdomain.com/robots.txt and find every group that names an OpenAI agent.
  2. Keep GPTBot blocked only if you want to opt out of training.
  3. Make sure no rule, including a leftover Disallow: /, blocks OAI-SearchBot or ChatGPT-User.
  4. Ask your CDN admin which agents any "block AI" setting covers.

Read more

All answers

How does your own site do?

AgentScore checks your site in about a minute and ranks what to fix first.