Building a global-scale data platform with Kubernetes, MongoDB, and HashiCorp tools
summary
A global geo-redundant platform is built with three clusters (OpenShift on‑prem, GKE, ROSA on AWS) using Helm charts and the MongoDB Kubernetes Operator to run a multi‑cluster sharded MongoDB with config servers and mongos routers; Consul provides Consul Connect with sidecar proxies and two mesh gateways per cluster plus federation for cross‑cluster service discovery; Vault runs with Raft across three nodes and leader DNS via Consul for HA; the setup achieves secure cross‑cluster connectivity, secret injection, and resilient replica sets.
AI-written summary · about
chapters (13)
- 0:00Introduction and motivation
- 1:15Challenges of self-hosting
- 4:22The role of Kubernetes
- 9:18Architecture overview
- 10:55Introducing HashiCorp Consul
- 12:14Configuring Consul
- 16:40Introducing HashiCorp Vault
- 17:47Deploying and managing Vault
- 22:37MongoDB on Kubernetes
- 26:09Multi-cluster sharded setup
- 27:07Operator configuration
- 28:10Deploying sharded clusters
- 29:49Conclusion and wrap-up
related talks
31mAn Adventure in Multi Cloud with Kubernetes and Distributed Data
27mDIY DBaaS with Percona Kubernetes Operators
25mLessons Learned from Building a Database Operator
27mDatabase Infrastructure with Open Source Kubernetes Database Operators
28mOvercoming the Challenges of Centralizing Container and Kubernetes Operations
43mMulti-Cloud Magic: Leveraging Multi-Cloud Clusters in Real-World Scenarios
45mChallenges in Building Multi-Cloud-Provider Platform With Managed Kubernetes
23mMore Power, Less Pain: Building an Internal Platform with CNCF Tools