Our Own Distributed S3 on MinIO — Practical Experience Stepping on Rakes
summary
A practical report about building a self-hosted S3-compatible storage using MinIO, describing why projects need reliable, fault-tolerant, and performant object storage and how MinIO was used to meet those requirements. Covers implementation details and operational experience (pitfalls encountered) running a distributed MinIO deployment for production workloads.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 5:49MinIO documentation issues
- 8:58MinIO fault tolerance setup
- 13:14MinIO scaling
- 17:28Distributed storage architecture
- 20:19MinIO operational issues
- 23:54ZFS-based solution
- 26:01Summary and recommendations
related talks
36mStorage Wars
08mRapid Design and Effective Operating of a General Purpose Object Storage at RWTH
29mReliable and Cost-Effective: Open Storage Strategies for Kubernetes
47mBuilding Resilience
31mScaling Autonomous-Driving R&D: A 100 PB, 100 Billion-File Open-Source Elastic File...
39mHow we learned to love the Data Center Operating System
33mBuilding Reproducible ML Processes with an Open Source Stack
13mLessons learned in production