GearDB: A GC-free Key-Value Store on HM-SMR Drives with Gear Compaction
summary
GearDB builds a GC-free LSM-style key-value store for host-managed SMR drives using a new on-disk layout, compaction windows, and a recursive gear compaction algorithm that confines cleanup to a small set of zones. Implemented on a real 13 TB Seagate HM-SMR drive and compared to LevelDB, it eliminates on-disk garbage collection, reduces compactions by thousands, cuts compaction latency to ~55% of LevelDB, and achieves 1.71× faster random writes with ~90% space efficiency.
AI-written summary · about
chapters (5)
- 0:00Background and motivation
- 4:08Problem analysis
- 8:11GearDB design
- 14:04Evaluation and results
- 17:57Conclusion and Q&A
related talks
15mKVIMR: Key-Value Store Aware Data Management Middleware for Interlaced Magnetic...
33mSSDFS: Flash-friendly File System with Highly Minimized GC Activity, Diff-on-write, & Deduplication
20mPacman: An Efficient Compaction Approach for Log-Structured Key-Value Store...
16mAegonKV: A High Bandwidth, Low Tail Latency, and Low Storage Cost KV-Separated LSM Store
14mRe-think Data Management Software Design Upon the Arrival of Storage Hardware with
13mClosing the B+-tree vs. LSM-tree Write Amplification Gap on Modern Storage Hardware...
15mImproving Performance of Flash Based Key-Value Stores Using Storage Class Memory...
01h 02mBuilding state-of-art LSM-tree compaction in ScyllaDB