Building Multi-Tenant Routing And Scaling With Envoy
Talkat KubeCon + CloudNativeCon North America 2022 · on Friday, 2022-10-28· at 16:00· Virtual Platform Only·
summary
AWS App Runner uses Envoy + xDS as the runtime control plane to implement multi-region, multi-tenant HTTP routing, load balancing and auto scaling for a platform serving hundreds of millions of customers. The system wires listeners, HCM routes, CDS/EDS clusters and endpoints into runtime updates, applies active and passive health checks, circuit breakers and retries, and exports metrics to CloudWatch and OpenTelemetry; the Envoy-based router runs in production and supports safe deployments and autoscaling.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 2:15Motivation and Envoy community
- 5:53Product requirements and challenges
- 8:03Choosing Envoy as router
- 10:11Envoy architecture and components
- 16:21Load balancing and health checks
- 19:14Control plane and discovery
- 22:35Production readiness
- 24:01Envoy features and AWS roadmap
- 25:28Q&A
related talks
38mEnvoy Deep Dive
06mManaging Tens of Thousands of Envoy: How We Do It
28mEnvoy Project Intro
33mGet to know Envoy - the modern proxy for cloud-native infrastructure - Baptiste Collard
29mSpanning the Globe with Envoy at Stripe
31mEnvoy Project Intro – Matt Klein & Jose Nino, Lyft
27mEnvoy Gateway: An in-Depth Guide of Its Benefits, Use Ca...
26mIntegrating Stateful Load Balancing At Scale In Envoy