A Hitchhiker's Guide to Ceph RGW PubSub & Cats vs. Dogs - a Hybrid Cloud Storage Story
summary
A Ceph RGW sync-module implements pub/sub that stores events in Ceph and forwards them via HTTP and AMQP to existing brokers; configuration uses topics and subscriptions with bucket association and filters, supporting pull mode today and a planned push-only mode. The demo wires a private Ceph cluster + Kubernetes + Knative eventing to AWS Lambda and a Knative service, with two buckets (cats, dogs), two topics, on-demand functions that scale up to fetch objects and run classification, and the live demo works end-to-end.
AI-written summary · about
chapters (16)
- 0:00Intro
- 0:27Openness
- 1:09Native Canada
- 2:03Serverless
- 3:32Architecture
- 5:42Protocols
- 8:10Data Model
- 11:07Multisite
- 14:26Background Story
- 16:01Setup
- 19:10Create two buckets
- 19:34Native support
- 20:08Other cloud providers
- 21:13Live Demo
- 23:32Fetching Events
- 28:18Testing
related talks
15mSync modules of Ceph Rados Gateway
41mBeyond Particle Physics: The Impact of Ceph and OpenStack on CERN's Multi-D...
26mPetabyte Scale Object Storage Service Using Ceph in A Private Cloud
47mTackling Cloud Complexity - Recipes From Real World Projects
33mEnhancing Ceph for Infinite Scalability at LINE
32mDeploying Stand-alone Ceph and Integrating with K8/OpenShift and OpenStack
26mMulti-Cloud Native Data with Spring and VMware Data Solutions
05mIgnite: Enabling multi-cloud and breaking vendor lock-in with Cloud Sidecar