Wayfair Same-day Delivery: A Narrative in Painful Anecdotes about CI at Scale
summary
Wayfair describes concrete fixes: integrator batches once merging 40–50 branches block developers for hours until tests finish, so unit tests are split across many small machines to cut pre-merge test time to ~5 minutes and end-to-end to ~10 minutes; Buildkite dynamic pipelines and reusable plugins replace a 2,000-line YAML and brittle shell scripts; Terraform + Puppet make snowflake build agents reproducible while autoscaling kills agents that fail 5 jobs; CLI tool mamba shrinks new-app setup from days to minutes. dynamic pipelines treat infra like cattle Buildkite plugins
AI-written summary · about
chapters (9)
- 0:00Start
- 3:54The Integrator
- 11:06Snowflake Build Infrastructure
- 26:20Dynamic Pipeline
- 31:23Vocab Plugins
- 34:32Automated Deployments and Using Configuration Management
- 36:47The End-to-End Process for Creating a New Application from Scratch
- 38:59Storage
- 44:32Infrastructure Stability
related talks
28mHow Wayfair tests software. Shift left
47mHow to win in software development with tighter feedback loops
41mContinuous Integration Tips & Tricks
38mScaling Automated Testing & Architecture from Startup to Enterprise
21mTesting Rails at Scale
27mOptimizing CI/CD Pipelines for Faster Time to Market
32mBuilding Continuous Integration and Feedback
32mBuilding Confidence Together: Continuous Integration & Testing