Don't Maintain Twice, It's Alright: Merged Metadata Management in Deduplication File...
summary
Deduplication metadata causes up to 38% I/O-path overhead; this work merges fingerprint-to-physical and L2P into a single on-disk entry so metadata persists with file-system metadata in one I/O. Implementation GOGETAFS adds an overflow fingerprint table for variable LFP entries and an in-memory global LFP table for fast lookup, runs on Intel persistent memory and F2FS, and outperforms prior DedupFSes (9–35% throughput gains) while cutting metadata maintenance by about 75–92%, achieving nearly zero metadata I/O overhead.
AI-written summary · about
chapters (9)
- 0:00Deduplication file systems intro
- 2:48Deduplication metadata structures
- 6:00Metadata maintenance overhead
- 8:14Merged metadata with LF mapping
- 9:19Generic deduplication with Goa FS
- 11:27Global LF table deduplication
- 13:17Goa FS on persistent memory
- 16:54Goa FS for storage devices
- 17:15Conclusion & Q&A
related talks
12mThe Dilemma between Deduplication and Locality: Can Both be Achieved?
17mLight-Dedup: A Light-weight Inline Deduplication Framework for Non-Volatile...
05mExploring Data Deduplication in LSM Tree-based Key-Value Stores (Work-in-Progress Report)
20mTiDedup: A New Distributed Deduplication Architecture for Ceph4
47mMerkle Forest, or How We Reduced Metadata Size and Also Speeded Up Duplicate Search
42mCan File Systems Survive in Data-centric World?
19mFlatFS: Flatten Hierarchical File System Namespace on Non-volatile Memories
30mHybrid XFS: Idea to Exabytes in 12 Months