The Road to Full Automation: How We Implemented Continuous Delivery at Signal
summary
Two‑year case study of moving from TestCafe → Cypress (later migrated toward Playwright), wiring TeamCity + Azure DevOps into a CD pipeline, and reducing UI-suite runtime to about 9 minutes for over 600 UI tests by using Azure Batch and dynamically provisioned VMs. Concrete additions include 220 front/back UI tests, 620 mock visual tests, API sanity checks from Swagger, per‑PR dynamic environments with a UI panel, and improved observability; each change is measured and deployed, and the mechanisms work in production.
AI-written summary · about
chapters (12)
- 0:00Continuous delivery at Signal
- 1:12Signal Ocean platform overview
- 2:58Legacy testing challenges
- 8:12Migrating to Cypress
- 11:25Test coverage and parallel execution
- 13:35Azure Batch optimization
- 16:10Visual regression testing
- 17:33API integration tests with Postman
- 18:38Monitoring for observability
- 19:19Dynamic PR environments
- 19:41CD process flow
- 21:33Q&A: Playwright vs Cypress
related talks
20mThe Road to Continuous Testing
30mOur Continuous Delivery Journey
47mArchitecting for DevOps and Continuous Delivery
38mScaling Automated Testing & Architecture from Startup to Enterprise
49mThe Whole Team Approach to Testing in Continuous Delivery
01h 01mA team's transition to Continuous Delivery
34mUsing Test Automation for Continuous Integration, Delivery and Quality
18mEffective Test Automation Framework Design