Streams LLM response tokens directly to the client browser over a persistent event connection.
Token Chunking: Delivers tokens in real time without buffering delay.EventStream Resiliency: Auto-reconnects on stream interruption.Evaluates real-time prompt inspection to block malicious jailbreak attempts.
Keyword Interception: Detects prompt injection triggers.WAF Rule Execution: Returns HTTP 403 Security Interception status.Designed to compare origin LLM proxying against Akamai Edge AI execution.
Edge Token Caching: Evaluates caching common prompt responses.Origin Pass-Through: Measures streaming latency over persistent sockets.