AWS CloudFront crawler logs

Forward CloudFront logs through Firehose, Lambda, or a scheduled shipper to identify AI crawler requests.

Endpoint

POST /api/events/cloudfront

curl -X POST "https://your-watchllm-host.com/api/events/cloudfront" \
  -H "Authorization: Bearer $WATCHLLM_API_KEY" \
  -H "content-type: application/json" \
  --data '[{"timestamp":"2026-05-01T12:00:00Z","statusCode":200,"path":"/","host":"example.com","userAgent":"Mozilla/5.0 PerplexityBot"}]'

Supported bodies

WatchLLM accepts normalized JSON, CloudFront standard access-log lines, and Firehose records[].data envelopes. Include status, method, host, path, query string, content type, client IP, referrer, and user agent where available.

Verify

Open /workspace/settings/crawler-logs?provider=cloudfront, then inspect top pages and event rows in /workspace/crawlers.