Unified Cluster Federation: A Hyperscaled Architecture of...
summary
Flipkart describes a hyperscaled storage architecture built on Ceph RADOS Gateway nodes fronted by load balancers and an OpenResty/Nginx Lua layer. They explain federating multiple heterogeneous Ceph clusters under a single programmable Nginx endpoint to scale IOPS, capacity and availability, replicate traffic for testing new hardware or Ceph releases, and transparently redirect users when a cluster is unavailable.
AI-written summary · about
chapters (15)
- 0:00Start
- 1:34Data and Access Patterns
- 3:01Flipkart Cloud Platform Object Storage Service
- 5:17Challenges
- 6:52Path to
- 9:09Cluster Templates
- 13:46Policy driven programmable Nginx
- 15:49Nginx Openresty (Luajit + Nginx)
- 16:30Federation, R6
- 22:36Possible Entities for Policy Engine
- 23:18Cluster Model (CM)
- 26:55User Model (UM)
- 28:14Bucket Model
- 40:32Important Observations
- 43:26Performance Latencies and Scale Numbers
related talks
23mFederated Services: Straightforward Multicluster
09mMulti-Cluster Networking: A Technology-Agnostic Network Operator for K8 Federation
34mNVMeoF in Ceph - What's New and Performance Best Practices
27mCilium Cluster Mesh: The eBPF-Powered Multicluster Solution for Kubernetes
49mPetabyte CephFS for Satellite Data Processing
32mBreaking Boundaries: Multi-cluster with Cilium cluster mesh
10mLightning Talk: Connecting Klusters on the Edge with Deep Dive into Cilium Cluster Mesh
18mAbstracting Multi-Cluster Topologies With CAPI and Linkerd for Internal Developer Platforms