Aeron: Open-source high-performance messaging
summary
Aeron is an open-source, Java-first messaging stack (C++ interop planned) that builds a persistent replicated log in mapped log buffers and uses a conductor/driver split so senders and receivers are single-threaded, nonblocking agents. Data structures are lock-free, wait-free, copy-free; protocol uses heartbeats, NAKs and windowed status for flow and retransmit. Small-message throughput hits 6M messages/sec in early tests, 90th-percentile latency matches top commercial products, and work continues on C++ port, Inifiniband and IPC.
AI-written summary · about
chapters (24)
- 0:00Start
- 2:45Feature Bloat & Complexity
- 3:18Not Fast Enough
- 3:56Low-Latency is key
- 4:26We are in a new world
- 5:44The Team
- 6:35Messaging
- 7:32OSI Layer 4 (Transport) Services
- 7:58Reliability
- 8:14Flow Control
- 8:31Congestion Avoidance/Control
- 9:19Multiplexing
- 9:52Multi-Everything World
- 10:46Design Principles
- 11:04It's all about 3 things
- 12:04Architecture
- 15:32Data Structures
- 16:44What does Aeron do?
- 23:33Data Message Header
- 35:28Some parts of Java really suck!
- 37:54Some parts of Java are really nice!
- 41:51Summary
- 42:03Where can I find it?
- 42:19Questions?
related talks
37mLet's build our own message streaming platform
15mAurogon: Taming Aborts in All Phases for Distributed In-Memory Transactions
33mBoost.Asio and Boost.Serialization, Part II
40mPerformance Improvements
09mBrian Bulkowski (Aerospike) Interview - OSCON 2014
33mArrow in Flight - New Developments in Data Connectivity
15mAWS On Air Voice of the Customer ft. Aerospike, Inc.
50mAerospike Technical Overview