Building the Multi-Cluster L7 Load Balancer

on YouTube ↗37m

" summary

A programmatically controlled L7 load balancer runs across 14 Kubernetes clusters in 5 regions and uses Istio/Envoy proxy for L7 routing, circuit breaking and rate limiting. The system detects IDC failures via a Dynamic DNS + healthcheck mesh (hidden primary/secondary DNS, notifications every 10s) and uses GSLB with region-specific CNAMEs for client locality. Declarative APIs, a declarative APIs and reconciliation loop with producer/consumer patterns handle async Kubernetes state, and migration APIs plus a sync command make schema and operation changes safe.

AI-written summary · about

" chapters (11)

1. 0:00Intro
2. 2:45Catastrophic Disaster
3. 5:10L7 Load Balancer
4. 5:47IDC-level Failover
5. 6:28Layer 7 Features
6. 8:39ELB Architecture
7. 10:44Address Challenges - IDC Failover
8. 14:30Address Challenges - L7 Features
9. 18:31Address Challenges - Programmability
10. 24:14Address Challenges - Globally Available
11. 28:52Address Challenges - Data Migration

" related talks

• 22mCloud Native Multi Cluster/Multicloud Global Load Balancer for KubernetesTamil Vanan Karuppannan · Kubernetes Community Days Bengaluru 2023
• 27mExtending Kubernetes - Lessons Learned From an L4 Ingress ImplementationSrinivas Brahmaroutu · Kubernetes Forum Bengaluru 2020
• 23mDemystifying Load Balancing in IstioShivanshu Raj Shrivastava, Jimmy Song · IstioCon 2023
• 35mIntelligent Load Balancing in KubernetesGaurav Nanda, Vincent Cheng · SREcon26 Americas
• 23mBuilding Unified Global Load Balancing for the Edge With k8gbYury Tsarev, Bradley Andersen · Kubernetes on Edge Day Europe 2026
• 32mCloud Native Global Load Balancer for KubernetesYury Tsarev, Zak Anderson · KubeCon + CloudNativeCon North America 2021
• 41mLoad Balancing and Traffic Management in OCP Multi-Cluster EnvironmentsAndrea Vivaldi · Incontro DevOps Italia 2022
• 33mCloud Native Load Balancing From ScratchFangyuan Li · KubeCon + CloudNativeCon China 2019