Blink and you’ll miss it: Stories from discovering most annoying bugs and test flakes
summary
Uses Replay.io time-travel debugger to jump to exact executions and cut debugging from hours to minutes, working with Metabase’s hundreds of end-to-end tests to drive flakes to zero on main. Shows concrete fixes: replace a network throttle → delay fix so a spinner stays detectable, diagnose a font-caused layout shift that breaks coordinate-based selection, and eliminate a race by disabling the add-to-cart button until quantity updates. Demonstrations use Cypress but techniques apply to Playwright.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 3:14Outdated end-to-end testing
- 7:33Metabase spinner test mystery
- 11:53Font change causing test failure
- 14:45Race condition in purchase test
- 24:43Fixing flaky tests
- 26:52Debugging time importance
- 28:18Closing
related talks
46mBlink and You’ll Miss It: Stories From Discovering Most Annoying Bugs and Test Flakes
15mHow to Fix Flakiness in Tests | Using Time Machines to Debug #FlakyTest
24mFighting Test Flakiness with Time Machines
50mAutomate Finding & Fixing Bugs with Replay QA
17mBe Kind Rewind with Test Replay
27mFantastic Bugs And Where To Find Them by Iris Schaffer (Eng) | JSConfAM19
48mFlaky Tests 2.0
34mFantastic Bugs and Where to Find Them