Testing Ceph for the Cloud, in the Cloud
summary
DigitalOcean runs Ceph for block and S3-compatible object storage across ~21 clusters in 9 datacenters (~40 PB) and automates integration testing by provisioning ephemeral labs on DigitalOcean VMs. Uses Teuthology with a custom head node, Terraform and Ansible for droplet and disk provisioning, and workarounds for DNS (dnsmasq), scratch_devs, problematic ceph-ansible roles, and package path assumptions. Tests own builds by bypassing Shaymin and adding a flag to skip Git SHA check.
AI-written summary · about
chapters (9)
- 0:00Introduction and speaker background
- 3:55Why test Ceph in-house
- 7:29Initial testing approach and challenges
- 11:45Demo of automated lab setup
- 15:47Key challenges with Ceph testing
- 22:02Testing custom Ceph builds
- 25:39Live demo results and verification
- 28:49Takeaways and future work
- 30:38Q&A and closing remarks
related talks
38mTesting Ceph: Pains & Pleasures
24mOrchestrating automation tests for Continuous testing
25mCloud Testing Without the Wait: K8 development experience
01h 08mPerformance testing in the cloud
46mInfrastructure testing - it's a real thing!
52mTest Driven Delivery of Infrastructure-As-Code
22mBuilding a Flexible, Scalable Infrastructure to Test Dolby.IO at Scale
33mTake Your Tests to the Cloud with Testkube