State is Hard: An SDK for Building Stateful Applications

on YouTube ↗38m

" summary

DC/OS SDK provides a framework generator on Mesos that codifies the shared 95% of stateful-service code and ships working frameworks for Kafka, Cassandra, Elastic, HDFS and Edge-LB. It uses pods and plans with goal state semantics (finished vs running), lets a prepare task write persistent volumes consumed later, injects sidecar tasks into running executors for online maintenance, and leverages multi-role + reservation refinement to create clean offer streams. Demos show YAML services (45 lines to 355 lines), REST APIs, Java hooks for custom recovery, S3 backup/restore and working readiness checks.

AI-written summary · about

" chapters (11)

1. 0:00Intro
2. 1:53Stateful Problems
3. 4:00Frameworks
4. 6:42SDK Features
5. 8:32General Design: Pods
6. 10:20Stateful Design: Resource Sets
7. 15:00Sidecars
8. 16:37Sidecar Demo
9. 22:24Extensibility: Failure Recovery
10. 30:28The Future
11. 33:24Questions?

" related talks

• 46mWriting Stateful FrameworksJörg Schad, Ken Sipe · MesosCon Asia 2016
• 51mExploring Stateful Microservices in the Cloud Native WorldMary Grygleski · Build Stuff 2021
• 25mCloudstate—Towards Stateful ServerlessJonas Bonér, James Roper · Ray Summit 2020
• 25mElastic Scaling of Stateful Network FunctionsScott Shenker, Sylvia Ratnasamy, Justine Sherry, Shinae Woo, Sangjin Han, Sue Moon · NSDI '18
• 21mDDD and FSM: tackling complexity with state machinesIlya Kaznacheev · Conf42 Golang 2021
• 33mCloudstate Towards Stateful ServerlessJonas Bonér, James Roper · Code Mesh LDN 2020
• 45mThe simplest way to build resilient applicationsGiselle van Dongen · Jfokus 2025
• 38mExploring Stateful Microservices in the Cloud Native WorldMary Grygleski, Grace Jansen · Voxxed Days Zürich 2022