Agent directory ยท AI assistant

PhindBot

Fetches pages for Phind, an AI search engine for developers.

Run by
Phind
Type
AI assistant
Robots.txt name
PhindBot
Verifiable
Not yet

What PhindBot does

Fetches pages for Phind, an AI search engine for developers.

As an AI assistant, it fetches pages for a person, in real time, while they use an AI assistant. The kinds of AI agent that visit websites.

Should you allow it?

Almost always allow it. Blocking it means the assistant can't read your pages when a customer asks about you, so it answers from somewhere else. A decision guide for blocking or allowing AI crawlers.

How to allow or block PhindBot

PhindBot reads the PhindBot group in your robots.txt. To block it everywhere:

User-agent: PhindBot
Disallow: /

To allow it everywhere, even if another rule blocks other bots:

User-agent: PhindBot
Allow: /

Robots.txt is a request, not a lock: well-behaved crawlers follow it, impostors don't. Robots.txt for AI agents.

How to tell if it's really PhindBot

Our registry doesn't verify PhindBot against published IP ranges yet, so treat a request that uses the name as a claim, not proof: anyone can send its user agent. Check Phind's documentation for how to verify it.

Does PhindBot visit your site? Ghost Agent Lab reads your CDN or server logs and shows every request from PhindBot and 1,566+ other known agents: what they read, what your site sent back, and whether each request was genuine. See agent traffic, or check whether AI agents can use your site for free.