How advancements in storage are triggering innovations in open-source and vice-versa
summary
Survey of concrete changes in storage and system software: PCIe NVMe SSDs drive kernel rewrites (block-mq, polled queues) and user-space stacks (SPDK) that hit 10 million IOPS on one core; io_uring adds async submission, shared buffers and now io_uring passthrough to issue NVMe commands directly. New device classes—ZNS and multi-stream—reduce GC and endurance loss, KV-SSDs and computational SSDs expose object and compute offloads, and libraries like liburing, xnvme and photon let databases and filesystems switch backends and actually use those features.
AI-written summary · about
chapters (6)
- 0:00Start
- 1:35Device side advancements
- 5:01Advancement at the interface
- 6:32Multi-stream
- 7:25Zoned NameSpace (ZNS)
- 10:30Computational SSD
related talks
50mOptimizing for NVMe Drives: The 10 Microsecond Challenge
45mLinux Storage Stack Explained
19mI/O Passthru: Upstreaming a flexible and efficient I/O Path in Linux
24mOptimizing Storage Performance for 4–5 Million IOPs
46mRevamping ioctl with io_uring
14mZNS+: Advanced Zoned Namespace Interface for Supporting In-Storage Zone Compaction
42mUnderstanding the Linux Block Layer-From Single Queue to Multi-Queue Architecture
24mLatest storage status on Arm