Bot protection checklist: adding or changing a CDN, firewall or bot protection
Use it before and after you add or switch a CDN, firewall or bot protection product, or change its rules. Usually run by: Security or CDN admin, with the e-commerce lead.
0 of 17 done
Decide before you configure
- Guide: Setting up your CDN for AI agents
- Guide: robots.txt for AI agents: who to allow and who to block
Set the rules
- Guide: How to tell if an AI crawler is real
- Guide: Setting up your CDN for AI agents
- Guide: Setting up your CDN for AI agents
- Guide: Setting up your CDN for AI agents
- Guide: Bot protection and CAPTCHAs: stop blocking the agents you want
- Guide: Bot protection and CAPTCHAs: stop blocking the agents you want
- Guide: Rate limits for AI agents: fair limits that don't turn customers away
Roll out safely
Check from the outside
- Guide: Bot protection and CAPTCHAs: stop blocking the agents you want
- Guide: Setting up your CDN for AI agents
- Guide: How to tell if an AI crawler is real
- Guide: Finding the errors AI agents hit, in your server and CDN logs
Ticks are kept in this browser only. Based on Setting up your CDN for AI agents, Bot protection and CAPTCHAs: stop blocking the agents you want, How to tell if an AI crawler is real, Rate limits for AI agents: fair limits that don't turn customers away, robots.txt for AI agents: who to allow and who to block, Finding the errors AI agents hit, in your server and CDN logs, Why your analytics can't see AI agents, and how to measure agent traffic, Geo-blocking, VPN blocks and AI agents, Questions to ask your CDN or bot protection vendor, Should you block AI crawlers? A decision guide for leaders, Why our scanner sometimes wears other agents' names, Who owns agent readiness?, Is this bot real? Verify GPTBot, Googlebot and other AI crawlers, robots.txt tester for AI agents, AgentScore: Can AI agents use your website?.