Stop Automating, Start Investigating: Slow Down 2 Speed Up
summary
Argues that indiscriminate automation fails to catch real problems and shows concrete alternatives used at Pushpay: a risk-based testing approach, shift left collaboration with product to catch missing requirements, and regular bug bashes and warming sessions. Pushpay runs ~20 deploys a day (target 25 minutes dev→live), keeps unit tests and a pre-tested component library, drops low-value scripted suites, and focuses manual investigative sessions — one rebuild led to a release where customers reported no bugs. Example: a 4,500-item dropdown exposed a design risk early.
AI-written summary · about
chapters (15)
- 0:00Introduction
- 3:42Software quality problems
- 8:45Requirements testing limits
- 10:52Automation hammer fallacy
- 13:20Building quality in
- 15:09Shift left and risk testing
- 18:25Speed versus risk balance
- 21:42Investigation over documentation
- 22:06Warming and peer testing
- 23:51Bug bashes and perspectives
- 26:42Automation as tool
- 27:25Testing as measurement
- 28:30Proving value to survive
- 29:33Communication skills role
- 30:14Closing and resources
related talks
01h 03mMoving Fast - without crashing
21mThe Essential Pillars of Automation Testing for Success
45mAccelerating Software Delivery: Why Your Team Is Slowing Down
23mThe Cost of Speed: Rethinking "Move Fast" in DevOps
10mBeyond “try harder”: Effective strategies to tackle bugs
01h 06mDecisions, Decisions — Dan North on Trade-offs in Software
36m5 Ways to Boost Automation Effectiveness
19mBusiness Impact Delivery Using Test Automation
