Case Study: Integrating Azure IPv6 PrivateLink with Kubernetes
Talkat KubeCon + CloudNativeCon North America 2020 Virtual · on Wednesday, 2020-11-18· at 16:55· Intrado Virtual Event Platform,·
summary
Databricks integrates Azure PrivateLink IPv6 by deploying an IPv6-to-IPv4 proxy pods into a dedicated node pool backed by an IPv6-enabled Azure VMSS and a dual‑stack Azure load balancer, avoiding enabling Kubernetes dual‑stack clusterwide. The proxy runs as an nginx pod with hostNetwork on dedicated IPv6-enabled VMSS, proxies incoming IPv6 PrivateLink traffic to existing IPv4 services, is deployed and monitored via Kubernetes, and is in private preview for Databricks control plane clusters (Databricks runs 2,000+ clusters globally).
AI-written summary · about
chapters (22)
- 0:00Introduction
- 0:17Agenda
- 0:40About Databricks
- 2:06Why is Databricks popular
- 2:53How do we build this platform
- 4:02Databricks operates over 2000 Kubernetes clusters
- 4:17Databricks manages hundreds of thousands of Spark clusters
- 4:33What is PrivateLink
- 6:24Presentation Introduction
- 7:27User to Web Application Traffic
- 8:12Challenges
- 11:38Background
- 13:11Proxy Solution
- 15:32Native IPv6
- 17:27Dual Stack on Kubernetes
- 20:00Proxy on Kubernetes
- 21:29Implementation
- 24:50Demo
- 25:17Port Level
- 25:44Host VM
- 25:55Azure Load balancer
- 26:22Recap
related talks
32mIPv6 / Dual-Stack in Kubernetes - Why, When, Where and How?
35mIntelligent Load Balancing in Kubernetes
32mA Case Study for Improving Network Isolation in a Multitenant Kubernetes Cluster
33mTo IPv6 - The Dual-stack Adoption Advisory Panel
40mOur Experiences Deploying Kubernetes with IPv6
17mThe Long Road to IPv4/IPv6 Dual-stack Kubernetes
36mDeep Dive: Azure SIG
18mThe Road to IPv6 Support in...