Erasure Codes in a nutshell

on YouTube ↗42m

" summary

An overview of standard erasure-code implementations (EC) with a focus on the low-level mathematics and algorithms that power them, plus practical examples. Covers concrete EC implementations and their underlying math details; aimed at people who already know EC concepts rather than EC developers.

AI-written summary · about

" chapters (10)

1. 0:00Intro
2. 0:19Getting Started
3. 7:37Data Replication
4. 10:48Erasure Codes 3
5. 21:03Erasure Codes 5. Further reading
6. 22:41Erasure Code 86. Storage consumption & EC cons
7. 31:26EC & CEPH. Jerasure 1
8. 34:27EC & CEPH. Jerasure Failures
9. 36:08EC & CEPH. LRC
10. 37:54References

" related talks

• 24mOpenEC: Toward Unified and Configurable Erasure Coding Management...Xiaolu Li · FAST '19
• 01h 14mErasure Coding at ScaleMaxim Babenko · Hydra 2020
• 26mFast Erasure Coding for Data Storage: A Comprehensive Study of the Acceleration...Tianli Zhou · FAST '19
• 22mELECT: Enabling Erasure Coding Tiering for LSM-tree-based StorageJingwei Li, Yanjing Ren, Patrick P. C. Lee, Yuanming Ren, Yuchong Hu, Xiaolu Li · 22nd USENIX Conference on File and Storage Technologies (FAST '24)
• 25mErasure-Resilient Sublinear-Time Graph AlgorithmsSofya Raskhodnikova, Nithin Varma, Amit Levi, Ramesh Krishnan S. Pallavoor · ITCS 2021
• 28mSpEQ: Translation of Sparse Codes using EquivalencesNikolaj Bjørner, Avery Laird, Bangtian Liu, Maryam Mehri Dehnavi · EGRAPHS 2024
• 27mA Student's View of Locally Repairable CodesArya Mazumdar · Coding: From Practice to Theory
• 23mEncrypted Search PartyFiona McCawley · RubyConf AU 2023