Catching Every Bug: Integrating Testing, Observability, Determinism & then what?
summary
Claim: use a deterministic hypervisor plus build determinism (Docker, Nix, Bazel), fuzzers/property-based generators and snapshottable existential assertions to turn end-to-end and production inputs into reproducible, adversarial tests. Companies like Antithesis ship such hypervisors and State Graph ingests Terraform state; the setup raises hit rates from one-in-a-million to one-in-a-thousand by starting from interesting snapshots, cuts flaky tests, enables metaverse debugging across months of runs, and lets teams take bigger risks while finding rare distributed-system bugs.
AI-written summary · about
chapters (10)
- 0:00Introduction to testing
- 1:05Basics of testing techniques
- 3:53Observability and adversarial testing
- 5:18End-to-end testing challenges
- 7:25Importance of determinism
- 11:14Autonomous testing overview
- 15:49Assertions and snapshots
- 19:02Exploring system states
- 21:12Metaverse debugging
- 22:57Benefits and conclusion
related talks
15mTransforming Testing: The Power of TestOps
26mThe missing piece of testing
25mBad Behaviour: Automating System-level Safety Testing Using Open Source Tools
16mAre companies chasing a quality mirage in the era of cloud, devops, SaaS & others
01h 19mYou Can't Test This? Hammertime!
20mTest like it's 2017
59m.NET Testing Techniques You Didn’t Know You Needed
27mAutomating Resilience Testing with Clojure and Docker