Navigating the shop merchant eligibility data pipeline migration
summary
Shopify moves merchant eligibility off a monolithic Legacy data pipeline into the Shopify Data Platform by dismantling the old system piece by piece, using the strangler fig pattern instead of rip‑and‑replace, breaking one giant pipeline into many smaller pipelines that emit events, and implementing a signal factory plus independent signal classes via the factory method to cut merge conflicts and speed delivery. A circuit breaker trips repeatedly and prevents outages, architectural decision records with team annotations and a stakeholder map plus daily/weekly/monthly cadence keep cross‑team coordination tight.
AI-written summary · about
chapters (9)
- 0:00Legacy migration challenges
- 3:40Merchant eligibility system
- 6:52Strangler fig migration
- 8:59Legacy maintenance costs
- 11:49Blocked innovations
- 13:12API server refactoring
- 16:10Social vs technical balance
- 18:22Communicating migration plans
- 21:54Legacy migration learnings
related talks
33mShopify in Multiple Datacenters
41mDeconstructing the Monolith
33mHigh availability by offloading work
45mE-commerce platform. Core build principles, problems and guidelines.
24mModernise your monolith using strangler pattern
32mHow to migrate some of Europe's biggest online shops to ONE platform
19mZero-Downtime by Design: High-Availability Migration Patterns
54mTechnology constraints drive automation