Riak Ensemble A Paxos based Framework for Scalable, Consistent Systems
summary
Riak Ensemble is a Paxos‑based library that gives per-key atomic updates by treating each key as a microstate and running multi‑Paxos with leader leases, so the common case is one‑round‑trip common case and the worst case falls back to two round‑trips. It integrates with Riak as a backend, supports dynamic membership (three, five or seven‑node ensembles), does leader election and epoch sequencing, and resolves partial‑write ambiguities at read time. The implementation is production‑oriented and designed to scale by adding ensembles.
AI-written summary · about
chapters (20)
- 0:00Introduction to Ryokan
- 0:48The Need for Consistency
- 2:46CAP Theorem Explained
- 4:18Eventual Consistency
- 5:50Handling Conflicts
- 7:43Consensus Algorithms
- 9:03Paxos Fundamentals
- 12:32Multi-Paxos Optimization
- 14:43Challenges in Implementation
- 17:01Alternative Consensus Approaches
- 19:26Ryokan Ensemble Architecture
- 22:38Atomic Updates in Ryokan
- 24:05Managing Ensembles
- 26:46Write and Read Operations
- 30:06Handling Partial Write Failure
- 33:59Consistency Semantics
- 37:03Ryokan System Architecture
- 38:25Peer Behavior and Backend
- 41:49Clustering and State Transfer
- 44:20Conclusion and Membership
related talks
19mPineapple: Unifying Multi-Paxos and Atomic Shared Registers
01h 13mPaxos vs Raft: Have we reached consensus on distributed consensus?
20mHigh Throughput Replication with Integrated Membership Management
47mDistributed Systems: When Democracy and Computer Science Come Together
40mConsensus Algorithms in Distributed Systems
23mLightning Talks on Distributed Systems
50mDo Distributed Systems they said. It'll be fun
51mDo Not Reimplement Distributed Consensus Algorithms