Global Capacity Management With Flux
summary
Flux automates regional capacity allocation using RPC tracing to build per-service capacity models, then runs a joint capacity and traffic solver that optimizes placement across tens of regions with heterogeneous hardware. Plans span thousands of services and tens of products, sometimes moving up to 300,000 servers per plan and operating on millions of servers overall. A sequenced capacity orchestrator safely enacts plans, reduces DR buffer needs and capex, and has run nearly autonomously in production for three years.
AI-written summary · about
chapters (12)
- 0:00Global capacity management intro
- 1:30Regional capacity challenges
- 3:16Service dependency graphs
- 5:21Heterogeneous hardware issues
- 7:27Capacity management Gordian knot
- 8:30Manual processes failed at Meta
- 9:53Introducing Flux and pillars
- 11:17Service modeling with RPC tracing
- 12:21Traffic and capacity optimization
- 13:24Safe capacity orchestration
- 14:27Flux's 3-year impact
- 15:31Flux capabilities summary
related talks
20mGlobal Capacity Management with Flux
20mGlobal Capacity Management
18mAvoiding and Breaking Out of Capacity Prison
05mFluxCapacitor: A Highly-scalable, Highly-available Distributed Reference App
10m10x Network Design Engineer
38mAutoscaling Flink at Netflix
16mNetwork Flow Data in the Cloud
21mTransparent and Flexible Network Management for Big Data Processing in the Cloud
