Make Haste Slowly: Balancing SRE Diligence in Urgency...
summary
Shopify frames speed versus risk by quantifying a system’s cost of failure with a disaster matrix and an availability matrix that drives prioritization and tracks progress over time. Teams simulate outages with Toxiproxy, run tests that enforce regressions, and control their own Datadog alerting to reduce phantom pages. Operational gains include chatops-enabled failover demos and routine blameless root cause analysis to turn incidents into measurable resiliency improvements.
AI-written summary · about
chapters (14)
- 0:00Intro
- 0:52Make Haste Slowly
- 3:12Cost of Failure
- 4:15Disaster Matrix
- 9:49Speed
- 12:57Scale
- 13:57Humans
- 14:36Direct Control
- 15:08Phantom Pages
- 16:05Fail
- 17:59Root Cause Analysis
- 19:24Summary
- 19:44How do you deal with the humans
- 20:28Conclusion
related talks
28mThink Backstage! Beyond Plugins
26mBreaking Systems for Resilience
21mThe Multi Layered Cake of Resilience
13mOptimizing System Performance: O11y in Distributed Environments
48mRevisiting Performance Budgets
56mStabilising eccentric systems
47mDeprecating Simplicity 3.0
26mBeyond the Hype: Facing Micro Frontend Challenges in Large Scale