XML sitemap

A file listing the pages you want found, so crawlers and agents don't depend on following links. See XML sitemaps for AI agents.

Why it matters

A sitemap makes sure agents can find every page you want found, not just the ones linked from your home page. That matters most for large catalogues, where new or deep product pages are easy to miss. Keep it complete and up to date, and list it in robots.txt so agents know where it is.

Read the guide XML sitemaps for AI agents How AI agents and crawlers use your sitemap, what AgentScore checks, what to include and how to keep it accurate. Read it

More terms in understanding pages

• Raw HTML The page exactly as your server sends it, before any JavaScript runs.
• Server-side rendering (SSR) and static generation Ways of building pages so the content is already in the raw HTML, rather than added afterwards by JavaScript.
• Structured data (schema.org, JSON-LD) Machine-readable facts in your page code, such as a product's name, price and stock, written in the shared schema.org vocabulary, usually as JSON-LD.
• Canonical URL The one address you name as the main version of a page that can be reached in several ways.
• Alt text A short text description of an image.

Every term, A to Z → · Read the glossary in full →