How interfaces saved our life
summary
Arduino Create migrates half a million users and ~11–12 million tiny files (≈100–130 GB) from S3 to an NFS/EFS-backed filesystem with zero downtime by implementing a file system interface and a migration table in Postgres that drives a rolling update per user. Code checks the DB at read time to choose S3 or EFS, enabling gradual fixes, integration testing on developer accounts, Datadog logging, and shared compile caches; initial DB lookup adds latency but overall performance and build caching improve and the migration succeeds.
AI-written summary · about
chapters (5)
- 0:00Start
- 5:25NAIVE IMPLEMENTATION
- 6:36ROLLING RELEASE
- 8:56FILESYSTEM INTERFACE
- 11:22MIGRATION IMPLEMENTATION
related talks
01h 19mKeynote: I Can Write the Code But Getting Something Done Is Another Matter
01h 01mLegacy Architecture Migration Patterns with DDD
43mLegacy Architecture Migration Patterns
48mThe Great Migration
43mNVM Software Interfaces New Direction
40mModernizing the Legacy
42mCatastrophes and Atrophies
01h 07mThe Well Tempered API