Envoy Today: What’s New In Managing Cloud-Native And AI Workl...
summary
Summary of current Envoy work: core Envoy adds native protocol support, MCP and agent-to-agent, plus request buffering and cross-service failover for long‑lived AI inference streams; Kubernetes control via Envoy Gateway targets Gateway API v1.5 conformance and new load‑balancing features; Envoy AI Gateway introduces CRDs, OpenResponses API, token‑budget and rate‑limit policies and richer LM telemetry. Claims include adoption metrics—about 2.1 million Helm chart pulls in 30 days, 5 million image pulls, 27,000 stars and 300+ gateway contributors.
AI-written summary · about
related talks
15mTaming AI Sprawl: Your First Look at the Envoy AI Gateway
17mThe Future of AI Traffic: What's New in Envoy AI Tra...
37mEvolution of Envoy AI Gateway
17mSeamless AI-as-a-Service across Kubernetes Clusters With Envoy AI Gate...
31mWhen LLMs Hit Production: Why You Need an AI Gateway
26mAI Traffic Is Different: Rethinking Proxy Arc...
38mAI Engineering Stack: Assisted to Delegated
40mIn AI We Trust? Securing the Future, One Agent at a Time