Big News for Big Data in Kubernetes #bbuzz
summary
Kubernetes now supports running a full software-defined storage layer as a cluster-managed service via a new plugin so containers can hold large state without external appliances. It mounts volumes into pods as a Kubernetes operation with zero changes to pods and lets compute and storage scale independently. The stack exposes files, streams and tables uniformly across regions, enables software-defined storage inside containers, and delivers performance up to gigabytes to tens of gigabytes per second per node.
AI-written summary · about
chapters (8)
- 0:00The rise of kubernetes
- 4:20Containers vs VMs
- 9:01Engineering with containers
- 13:21Freezing state for deployments
- 17:48The challenge of state
- 21:29Service and streaming models
- 26:36The need for a data platform
- 33:10Cloud neutrality and conclusions
related talks
28mProgress For Big Data In Kubernetes
19mKeynote: Debunking the Myth: Kubernetes Storage is Hard
24mDynamic Big Data in the Cloud with Kubernetes
35mModern Big Data Pipelines over Kubernetes [I]
07mLightning Talk - Say what? You're Running the Storage Platform IN Kubernetes?
35mKubernetes Storage Lingo 101
07mData Gravity and Kubernetes: Managing Large-Scale Data Ingest With Minimal Latency
28mKubernetes Storage Evolution: Enabling High Performance Distributed Datastores