A Tale of Two Paths: Toward a Hybrid Data Plane for Efficient Far-Memory Applications
Talkat 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24) · 2024-07-10..07-12·
summary
Atlas implements a hybrid data plane that picks per‑page transfer mode using always‑on profiling (a per‑page card table measuring card access ratio) and a one‑bit pass flag to choose paging or object fetch at each access. Object fetching compacts hot objects into contiguous local space, the unified eviction policy moves pages back efficiently, and cross‑component invariants prevent races. Evaluation vs AFM and Fastswap shows average throughput gains of about 1.5× and 3.2× and tail‑latency reductions of one to two orders of magnitude when using remote memory.
AI-written summary · about
chapters (8)
- 0:00Introduction to far memory
- 1:38Data access challenges
- 2:13Paging vs object paths
- 5:15The need for a hybrid approach
- 8:04Atlas design overview
- 9:28Profiling and path selection
- 11:57Synchronization and invariants
- 14:06Evaluation and conclusion
related talks
45mBeyond Machine Boundaries: Experience with Memory Disaggregation
20mUniMem: Redesigning Disaggregated Memory within A Unified Local-Remote Memory...
14mMultitenancy for Fast and Programmable Networks in the Cloud
18mEthane: An Asymmetric File System for Disaggregated Persistent Memory
25mDisaggregating Persistent Memory and Controlling Them Remotely
17mThemis: Scheduling-Aware Buffer Management for HBM-Based Hybrid Buffers
18mHermit: Low-Latency, High-Throughput, and Transparent Remote Memory...
22mEffectively Prefetching Remote Memory with Leap