Torus: Focusing Storage for Kubernetes

on YouTube ↗26m

" summary

A prototype distributed storage layer for Kubernetes that uses etcd for metadata and a Torus server to present immutable inodes made of 512k blocks (default) replicated and sharded with a configurable ring function stored in etcd. Integration uses FlexVolumes and nodes run as a daemonset (data directory mints node identity). Rebalance happens by replacing the hash function and peer-to-peer copying until three replicas exist; raw throughput saturates gigabit in tests while small IOPS sit ~100–200. Not yet production stable; repo: github.com/torus.

AI-written summary · about

" chapters (16)

1. 0:00Introduction
2. 0:18Agenda
3. 0:50Who is this for
4. 1:19Computer Networking Storage
5. 2:11Storage
6. 2:35What do we need
7. 3:11Right block storage
8. 4:26Replication controller deployment
9. 5:06What we want
10. 5:45Why we created Taurus
11. 6:40General overview
12. 8:40File pointer
13. 10:01Updating
14. 11:33Distribute
15. 13:04Rebalance
16. 18:21Wrapping Up

" related talks

• 28mPersistent Storage with Kubernetes in Production - Which Solution and Why?Cheryl Hung · ContainerDays Hamburg 2018
• 29mReliable and Cost-Effective: Open Storage Strategies for KubernetesShriya Mulay · Open Source Summit Europe 2025
• 33mPiraeus Datastore - Persistent Volumes for KubernetesPhilipp Reisner · ContainerDays Conference 2024
• 36mPersistent Storage with Kubernetes in Production - Which Solution and Why?Cheryl Hung · KubeCon + CloudNativeCon North America 2017
• 37mBuild a Kubernetes Based Cloud Native Storage Solution From ScratchSheng Yang · KubeCon + CloudNativeCon Europe 2019
• 25mContainer Attached Storage: Open Source Extensions: Kubernetes + DataEvan Powell · Distributed SQL Summit 2020
• 19mPersistent Storage for Containers using GlusterRaghavendra Talur · DevConf 2017
• 48mIntro to Longhorn: Open Source Cloud-Native Distributed Block Storage Built On and For K8sSheng Yang · KubeCon + CloudNativeCon North America 2019