Space Django: Migrating and Redesigning a Database while Hunting for Satellites.

on YouTube ↗31m

" summary

A startup migrates a messy JSON-backed Postgres schema by copying rows with Django ORM into a redesigned relational schema, running as a CI-invoked management command and tracking progress per-table. The migration keeps a two-database setup (internal vs customer) and uses a mapping dictionary to transform columns plus Django signals for near-real-time sync; scripts handle bulk tables. The approach works for this dataset and deadlines but is sequential, cache-dependent, and not a universal solution.

AI-written summary · about

" chapters (19)

1. 0:00Space Django project
2. 1:54Hunting satellites meaning
3. 5:08Initial database challenges
4. 9:26Migration goals and time
5. 10:30Off-the-shelf migration tools
6. 11:34Raw SQL mistake
7. 12:20Django ORM for migration
8. 13:47Risks in migration files
9. 14:52Dual DB access with signals
10. 16:18API abstraction layer
11. 17:00Database redesign plan
12. 18:04Data migration approach
13. 21:18Migration logic classes
14. 22:22Simple vs complex data
15. 23:27Migration performance
16. 24:56Sequential loops unavoidable
17. 25:41Migration progress tracking
18. 26:44Next steps after migration
19. 27:47Q&A: Field mapping

" related talks

• 23mDjango with PostgreSQL superpowersPaolo Melchiorre · Citus Con: An Event for Postgres 2022
• 24mOf Django, PostgreSQL schemas, and your multi-million dollar ideaLorenzo Peña · PyConline AU 2020
• 22mDjango with PostgreSQL superpowersPaolo Melchiorre · Python Web Conf 2023
• 33mAdding zero-downtime migrations strategy in SaaS projectIga Karbowiak · PyCon Italia 2024
• 21mDjango's Migrations: A RetrospectiveAndrew Godwin · DjangoCon AU 2014
• 29mMigrating Data Quickly and SafelyAaron Webber · Dash 2019
• 57mDjangoCon 2008 Panel: Schema EvolutionSimon Willison, Andrew Godwin, Russell Keith-Magee, Michael Trier · DjangoCon US 2008
• 33mPeaceful Django Migrations with Efe ÖgeEfe Öge · DjangoCon US 2025