Crash and test failure analysis with AI... no wait, ehm, with regexes!
summary
A homegrown regex-based classifier evolves from a 2011 shell script into a web service with about 10,000 commits that replaces unreliable automatic grouping, classifies crashes and test failures with ordered regex signatures, and integrates with CI to surface scope and Jira links. It handles roughly 60,000 integration tests a day, turns vague failures into actionable signatures, reduces cross-team chatter, and catches practical issues like the privacy shutter example where hardware state—not code—causes no-video test failures.
AI-written summary · about
chapters (14)
- 0:00Crash and test failure analysis
- 2:52Crash classification tool origins
- 8:32Early script development
- 15:26Rules for known and unknown issues
- 22:37Manual to semi-automated service
- 23:26Modern crash classification system
- 28:26Tool beyond crash reports
- 29:31Build master challenges
- 34:35Regex in test pipelines
- 37:32Regex excels at classification
- 38:15Real-world example: Privacy shutter in Desk Pro
- 41:23Cultural shift improvements
- 44:57Engineers writing regex patterns
- 47:03Trust and future automation
related talks
50mEffective test scrubbing
33mUnifying and improving test regression reporting and tracking
44mThe Future is Today: Leveraging AI in Software Testing
28mBuilding an automated testing suite...
38mEscape from Planet Regex - Kotlin to the Rescue
30mApplying AI to testing
55mThe art of living with broken things
01h 00mContinuous Regression Testing for Safer and Faster Refactoring in C++