Spinning Your Drones with Cadence Workflows and Apache Kafka
summary
Demonstrates a runnable drone-delivery system built with Cadence workflows orchestrating two stateful workflows (drone and order) and integrated with Apache Kafka topics for choreography and matching; uses Cassandra (or Postgres) for history and optional OpenSearch, Java/Go workers, and at-most-once activities so replaying via event sourcing is safe. Benchmarks show it works: a simple test hits ~2 orders/sec with 50 drones, a realistic simulation scales to 2,000 drones (~4,000 concurrent workflows, ~125 workflows/core).
AI-written summary · about
chapters (8)
- 0:00Start
- 2:00Workflow Orchestration with Cadence
- 6:52Good Use Cases for Using Cadence Form
- 8:42Example of Drone Delivery Flight
- 10:08The Drone Workflow
- 11:20What's Kafka
- 14:24Step Five in the Drone Workflow
- 18:33Scalability and Performance Discoveries
related talks
26mDataEngBytes 2023 - MEL-T2-05 - Paul Brebner
44mCadence: The New Open Source Project for Building Complex...
32mUsing k8s, Bare Metal, & 5G to achieve autonomous drone delivery!
27mEmpowering Resilient Scalability: The Power of Choreography in Distributed Systems
44mGetting started with Orchestration and Choreography in Distributed Applications
53mBuilding Event Driven Services with Apache Kafka and Kafka Streams
51mComplex Event Flows in Distributed Systems
01h 31mDeveloping Real-Time Data Pipelines with Apache Kafka