How Asana serves millions of customers using Amazon EKS
summary
Asana runs 80+ EKS clusters with about 15,000 pods total and largest clusters hosting ~3,500 and ~3,000 pods; each service gets one service per cluster isolation and KubeApps generates Kubernetes YAML from Python, builds images, updates Route53, and spawns telemetry and Chaos Monkey. Deployments use a full update with DNS switch (create new cluster, wait ~13–30 minutes, then flip DNS) or faster rolling updates; 679 cluster creations/month, $900/year per control plane, Envoy sidecars implement service mesh, and limits like 50 AWS tags force AZ reduction.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 5:49What is Asana
- 12:01Benefits of Isolation
- 13:13Cons of Isolation
- 14:05Full Update
- 16:24Rolling Update
- 18:44Why we moved to EKS
related talks
11mAmazon EKS Roadmap
35mKubernetes on AWS: Practices & Opinions
17mKeynote: Kubernetes: Lessons from the Trenches
17mKeynote: Kubernetes: Lessons from the Trenches
33mSpace Invaders for Kubernetes: Consolidating 50 Clusters at Scale
32mScaling Kubernetes Application to 1M Users
29mAmazon Elastic Container Service for Kubernetes (EKS): A case study - M. Re Ferre' and G. Carabelli
35mLiving with the Pathology of the Cloud: How AWS Runs Lots of Clusters