Karaage Gardening

on YouTube ↗18m

" summary

Karaage is an open source Python/Django app that replaces hand‑managed cluster accounts; the migration yields concrete fixes: an aggregating daily table cuts an 11 million‑row problem to a workable size and closes a cache race that was crashing pages, a custom talap library replaces a brittle plard layer, and data stores are rewritten to be backend‑agnostic so the system now talks to Moab and Slurm and can write to ALeP; decisions, numbers and the things that were rebuilt and whether they work are all spelled out.

AI-written summary · about

" chapters (23)

1. 0:00Start
2. 0:59Disclaimer
3. 1:19Deep Fried Chicken
4. 1:46Features
5. 2:14Account Management
6. 2:29Usage Management
7. 4:56Karaage 4
8. 5:40Machine Categories
9. 5:55People vs Accounts
10. 6:48OpenLDAP lock
11. 7:32Generic lock
12. 7:53The Layers
13. 8:41Solution?
14. 9:22Andrew Bartlett - LCA2015
15. 10:19Patch
16. 10:46OpenLDAP documentation
17. 10:57Debian Installs
18. 11:25Redhat Installs
19. 11:48Committing Changes
20. 12:26Another mistake
21. 13:36V3 Alliance/VLSCI
22. 13:59Outline
23. 14:33Things we got wrong

" related talks

• 36mA Python TakeoverMark Ramm-Christensen · EuroPython 2011
• 29mForklifting Django: Migrating A Complex Django App To KubernetesNoah Kantrowitz · DjangoCon US 2019
• 47mBuilding Scalable Web AppsDavid Cramer · EuroPython 2011
• 22mGovernment dashboards and open data.Paul Haesler · PyCon Australia 2015
• 29mSwiss Army Django: Small Footprint ETLNoah Kantrowitz · PyCon AU 2023
• 30mSlow Food Digests Better - or how to maintain a 8.5 year old Python project withoutChristopher Grebs · DjangoCon Europe 2018
• 31m"Notes on Over-Engineering: A Project Post-Mortem"Sam Bishop · PyCon AU 2024
• 40mPython and pandas as back end to real-time data driven applicationsGiovanni Lanzani · PyData Berlin 2014