I Need More Space, It's Not You It's BlueStore

on YouTube ↗06m

" summary

Cluster-report mismatch: ceph df shows 76 GB max and 17 GB stored but 92% used because one OSD is 94% full; solution is rebalance with upmap balancer. Thin-provisioning example: a 1 TB RBD with XFS and 500 files of 6 MB (≈3 GB) shows 3.4 GB used, deleting half leaves 1.5 GB live data but 3.4 GB reported until running fstrim to reclaim blocks. Small-object overhead: 100 objects × 100 B stores 10 KB but BlueStore allocates 64 KB chunks so used ≈6.2 MB. Compression reports show original, compressed, and allocated sizes can differ for small objects.

AI-written summary · about

" chapters (7)

1. 0:00Introduction
2. 0:28What is BlueStore
3. 1:11First example
4. 1:42Data distribution
5. 2:21Create RBD
6. 2:45Create files
7. 4:03Small Objects

" related talks

• 46mBlueStore V2 - an Evolutionary Step ForwardMark Nelson, Adam Kupczyk · Cephalocon 2023
• 33mThe Challenge of Storing Small Objects on a Large ScaleLuis Domingues, Ján Senko · Cephalocon 2024
• 43mCeph and FlashAllen Samuels · LinuxCon + ContainerCon Europe 2016
• 24mPerformance tuning in BlueStore & RocksDBLi Xiaoyan · Cephalocon APAC 2018
• 30mHybrid XFS: Idea to Exabytes in 12 MonthsRichard Wareing · Open Source Summit + Embedded Linux Conference North America 2019
• 36mStorage WarsSeán C McCord · KubeCon + CloudNativeCon North America 2022
• 14mRe-think Data Management Software Design Upon the Arrival of Storage Hardware withTong Zhang, Yang Liu, Qi Wu, Xubin Chen, Ning Zheng, Jiangpeng Li, Yong Peng, Fei Sun, Hao Zhong · 12th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage '20)
• 16mPolarStore: High-Performance Data Compression for Large-Scale Cloud-Native DatabasesJunwei Zhang, Junru Li, Feifei Li, Yuqi Zhou, Wenchao Zhou, Qingda Hu, Xinjun Yang, Ya Lin, Yicong Zhu, Rongbiao Xie, Ling Zhou, Bin Wu · FAST '26