MemSweeper: Virtualizing Cluster Memory Management for High Memory Utilization

on YouTube ↗37m

" summary

MemSweeper virtualizes a shared memcached heap so pages move across tenants and slab classes based on measured reuse rather than static partitions, implemented as a tracker plus per-tenant shadow queues and an AVL tree reuse-distance method to get O(log n) misses (avoiding the linear slowdown that made tenants unresponsive). It computes marginal utility per-page and runs MaxSweeper (maximize system hit rate) or FairSweeper (limit victim loss), evaluated on memcached with CloudSuite; MaxSweeper raises overall hit rate but FairSweeper prevents aggressive tenants from starving others.

AI-written summary · about

" chapters (4)

1. 0:00Start
2. 13:07What Is the Reuse Distance
3. 20:27Avl Tree
4. 22:09Pseudocode

" related talks

• 20mUniMem: Redesigning Disaggregated Memory within A Unified Local-Remote Memory...Jiwu Shu, Zhirong Shen, Yijie Zhong, Minqiang Zhou · USENIX ATC 2024
• 18mHermit: Low-Latency, High-Throughput, and Transparent Remote Memory...Chenxi Wang, Guoqing Harry Xu, Miryung Kim, Adam Belay, Yifan Qiao, Yiying Zhang, Zhenyuan Ruan, Qingda Lu · NSDI 2023
• 16mCacheSack: Admission Optimization for Google Datacenter Flash CachesTzu-Wei Yang, Seth Pollen, Mustafa Uysal, Arif Merchant, Homer Wolfmeister, Tzu-Wei Yang · USENIX ATC '22
• 19mFineMem: Breaking the Allocation Overhead vs. Memory Waste Dilemma in Fine-Grained...Kan Wu, Yongkun Li, Yinlong Xu, Xiaoyang Wang, Wenzhe Zhu, Yuqi Li · OSDI '25
• 45mBeyond Machine Boundaries: Experience with Memory DisaggregationFelix Eberhardt, Andreas Grapentin · OpenPOWER Summit NA 2021
• 16mDisaggregation and the ApplicationSebastian Angel, Siddhartha Sen, Mihir Nanavati · HotCloud '20
• 17mDuhu: Shared Disaggregated Memory for Distributed Data Processing FrameworksAurojit Panda, Jongryool Kim, Tao Wang, Qiutong Men, Hane (Stella) Yie, Emmanuel Amaro, Marcos K. Aguilera · 20th USENIX Symposium on Operating Systems Design and Implementation (OSDI '26)
• 16mA Tale of Two Paths: Toward a Hybrid Data Plane for Efficient Far-Memory ApplicationsChenxi Wang, Chenggang Wu, Shan Lu, Xiaobing Feng, Huimin Cui, Yifan Qiao, Haoran Ma, Shi Liu, Harry Xu, Youyou Lu, Zhe Wang, Lei Chen · 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI '24)