Integrations ยท Traffic data

AWS CloudFront

See every AI agent that reaches your CloudFront distribution, through Amazon Data Firehose.

Type
Traffic data
Setup time
About 15 minutes
Plans
Every plan

If your site is served by AWS CloudFront, its access logs travel through Amazon Data Firehose, which forwards them to us every few minutes. AWS bills Firehose for the data it carries.

What you need

  • Permission to create an Amazon Data Firehose stream
  • Permission to change the CloudFront distribution's logging
  • A Ghost Agent Lab site, which gives you its private ingest URL

How to connect it

  1. In Ghost Agent Lab, add your site and open Settings โ†’ Data sources โ†’ AWS CloudFront to copy its ingest URL.
  2. In the AWS console, create an Amazon Data Firehose stream with Direct PUT as the source and HTTP endpoint as the destination.
  3. Paste the ingest URL as the HTTP endpoint URL, set Content encoding to GZIP, and leave the access key empty.
  4. In CloudFront, open your distribution's Logging tab, choose Add โ†’ Amazon Data Firehose, pick that stream, and set the output format to JSON.
  5. Include timestamp(ms), c-ip, cs-method, x-host-header, cs-uri-stem, cs-uri-query, sc-status, sc-bytes, cs(User-Agent) and cs(Referer). The first logs arrive within about five minutes.

Privacy: IP addresses are hashed on arrival and query strings are dropped. People are counted, never stored. Keep the ingest URL private; you can replace it in Settings at any time.

What you get

  • Every agent request CloudFront served or blocked
  • Which blocked requests came from genuine AI assistants
  • Verification against each operator's published IP ranges
  • Agent traffic, journeys and alerts within minutes

Try it on your site. Every plan starts with a 30-day trial. Start your trial, or take the two-minute tour first.