Agent directory ยท AI assistant
kagi-fetcher
Fetches pages to answer questions in Kagi's AI search features.
- Run by
- Kagi
- Type
- AI assistant
- Robots.txt name
kagi-fetcher- Verifiable
- Not yet
What kagi-fetcher does
Fetches pages to answer questions in Kagi's AI search features.
As an AI assistant, it fetches pages for a person, in real time, while they use an AI assistant. The kinds of AI agent that visit websites.
Should you allow it?
Almost always allow it. Blocking it means the assistant can't read your pages when a customer asks about you, so it answers from somewhere else. A decision guide for blocking or allowing AI crawlers.
How to allow or block kagi-fetcher
kagi-fetcher reads the kagi-fetcher group in your robots.txt. To block it everywhere:
User-agent: kagi-fetcher
Disallow: /To allow it everywhere, even if another rule blocks other bots:
User-agent: kagi-fetcher
Allow: /Robots.txt is a request, not a lock: well-behaved crawlers follow it, impostors don't. Robots.txt for AI agents.
How to tell if it's really kagi-fetcher
Our registry doesn't verify kagi-fetcher against published IP ranges yet, so treat a request that uses the name as a claim, not proof: anyone can send its user agent. Check Kagi's documentation for how to verify it.
Does kagi-fetcher visit your site? Ghost Agent Lab reads your CDN or server logs and shows every request from kagi-fetcher and 1,566+ other known agents: what they read, what your site sent back, and whether each request was genuine. See agent traffic, or check whether AI agents can use your site for free.