Supercharging CI: Test Suite Optimization for Speed, Stability, and Savings
summary
Test suite shrinks from 35 minutes for ~4,000 tests to ~10 minutes for 15,000 tests and can hit 5 minutes by using faster VMs and cores, with pass rate rising from ~33% to ~95%. Key moves are package caching and compiling assets once then distributing, scaling from 4 to 20 VMs with knapsack Pro to balance shards, then using multicore vertical scaling plus switching Selenium to Cypress, adding RSpec retry for temporary flakes, and trimming slow specs to control cost.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 3:15Facing the challenge
- 5:25Blueprint for success
- 7:10Pre-optimizations
- 11:25Horizontal scaling
- 15:22Vertical scaling
- 17:47Taming flaky tests
- 20:32Maintaining stability and cost
related talks
58mSpeed up your test suite by throwing computers at it
26mKeeping Your Tests Lean
26mFaster, Cheaper, Leaner: Horizontally Scaling a CI Pipeline
20mDevelopment efficiency with expert CI/CD strategies
35mScalable Testing Strategies
23mAdaptive Testing
35mElevate your testing: testing smarter, not harder, in the cloud!
21mScaling Test Automation: Building Reusability for 10x Speed and Efficiency