Learning Center · Answers · Access

How do I spot a fake Googlebot or GPTBot?

Short answer

Check where the request came from, because anyone can copy a crawler's name. Confirm Googlebot with forward-confirmed reverse DNS or Google's published IP lists, and GPTBot against OpenAI's published IP ranges. A request that claims the name but fails the check is an impostor, so challenge or block it.

Answer · Last checked November 12, 2026 · Based on How to tell if an AI crawler is real

In more detail

Every request names its sender in the User-Agent header, and scrapers routinely borrow well-known names because many sites let those crawlers through without a challenge. Trust the name and impostors get in. Distrust it and you block real agents along with the fakes. Verification checks whether a request really came from the company it names, so you can let one through and stop the other.

For Googlebot, look up the host name for the request's IP address and check it ends in googlebot.com, google.com or googleusercontent.com. Then look up that host name and check it points back to the same address. Both steps matter, because whoever controls an IP address can make its reverse lookup say anything. Google also publishes IP lists. For GPTBot, OpenAI publishes its ranges at openai.com/gptbot.json.

Refresh IP lists at least daily, and match the list to the agent. An address in OpenAI's GPTBot list doesn't verify a request claiming to be ChatGPT-User. When an operator publishes no proof, treat the request as unknown rather than fake, and handle it with ordinary rate limits. Many CDNs already verify bots, so ask yours first.

What to do

  1. Ask whether your CDN or bot protection already verifies bots.
  2. Check Googlebot claims with forward-confirmed reverse DNS.
  3. Check GPTBot claims against openai.com/gptbot.json, refreshed at least daily.
  4. Challenge or block requests that claim a name but fail the check.
  5. Handle requests you can't verify with rate limits, never a hard block.

Read more

All answers

How does your own site do?

AgentScore checks your site in about a minute and ranks what to fix first.