When Performance, Scalability and Robustness Upset Your Architecture
summary
The talk gives a post-mortem on building a system that must ingest and process hundreds of millions of events per day, focusing on performance, scalability and robustness. It covers architectural patterns for partitioning and organizing processing, decoupling the domain model from the storage model, and defining testing strategies and operational considerations to allow the system to auto-scale and handle load variations.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:06Bank accounting project
- 3:13Component definition
- 8:09Business processing pipeline
- 12:24Database choices
- 16:43Decoupling business model and storage
- 20:38Component tests and performance
- 24:16Performance testing methodology
- 31:44Analysis and optimization
- 37:21Scaling and robustness
- 43:18Validation and recommendations
- 46:07Conclusion
related talks
56mMastering Cloud Scalability and System Designs Deep dive
54mSoftware architecture evolution, what to expect? Panel Discussion
49mHow Data Architectures Break and How to Fix Them
31mMastering the Balancing Act: Scaling Infrastructure for Growth and Stability
42mApplication Architectures: The shadows and highlights of Event Driven Design
45mKeeping Up with the Times: Flexible Architectures
44mThe Art of Architecting for Scale
29mFollowing the Data: A Deeper Look into Distributed Applications