SPDK Under the Hood: Diving into the Disk Subsystem in User Space

on YouTube ↗48m

" summary

Explains what SPDK (Storage Performance Development Kit) is and why to use it for delivering guest I/O from virtual machines to storage systems. Describes an approach used at MWS: implementing user-space disk subsystem handling with SPDK to optimize I/O path and performance in cloud environments.

AI-written summary · about

" chapters (15)

1. 0:00Introduction
2. 1:09Virtual disks problem
3. 3:41What is SPDK
4. 5:52SPDK architecture
5. 8:42Block devices and modules
6. 10:30Frontend and interfaces
7. 11:59Final schema assembly
8. 13:25Performance testing
9. 15:52QoS and lock issues
10. 18:01Low performance causes
11. 21:54Why issues were missed
12. 23:20Fixing lock problems
13. 24:47Final results and updates
14. 26:53Conclusions and SPDK experience
15. 28:38Q&A

" related talks

• 42mUserspace Block Services Based on Ublk and Vduse in SPDKChangpeng Liu, Xiaodong Liu · KubeCon + CloudNativeCon + Open Source Summit China 2023
• 21mVirtio Devices Emulation in SPDK Based on Vfio-User ProtocolChangpeng Liu, Xiaodong Liu · KVM Forum 2022
• 21mSpool: Reliable Virtualized NVMe Storage Pool in Public Cloud InfrastructureTao Ma, Jie Zhang, Quan Chen, Minyi Guo, Yanbo Zhou, Zheng Liu, Zhuo Song, Yong Yang, Keqiang Niu, Shuai Xue, Shang Zhao, Gang Deng, Sijie Sun · USENIX ATC '20
• 24mLatest storage status on ArmJun He · Linaro Connect Bangkok 2019
• 23mHyperscale vDPAJason Wang · KVM Forum 2021
• 48mSoftware Defined Storage the Linux wayPhilipp Reisner · HighLoad++ Moscow 2018
• 39mThe Power of the Device Mapper - From Dm-cache To Dm-zonedWerner Fischer · Open Source Summit Europe 2025
• 15mRearchitecting Linux Storage Stack for µs Latency and High ThroughputRachit Agarwal, Simon Peter, Jaehyun Hwang, Midhul Vuppalapati · 15th USENIX Symposium on Operating Systems Design and Implementation (OSDI '21)