Large Scale Teaching Infrastructure with Kubernetes

on YouTube ↗35m

" summary

UC Berkeley runs a Kubernetes-backed JupyterHub that serves 1,200–3,500 students in semester courses and is being readied for a MOOC with ~100,000 signups (≈25k active). Deployment uses GKE and Azure, Helm charts extracted as Zero to JupyterHub, kubeSpawner, and automated CI/CD with git-crypt + Travis CI so TAs can merge and create hubs without deep Kubernetes knowledge. Persistent storage proved hardest: per-PVC SSDs were cost-prohibitive, so the setup evolves through NFS mounts, hostPath nodes, and a custom flex volume NFS provider with throttling for isolation.

AI-written summary · about

" chapters (16)

1. 0:00Introduction
2. 1:12Challenges
3. 3:41Scale
4. 5:40Student Experience
5. 8:02Technology
6. 12:20Summer 2017
7. 20:25Fall 2017
8. 21:35Online Course
9. 22:20Automated Deployment
10. 24:30Deployment Workflow
11. 25:50Automatic Deployment
12. 27:40Storage
13. 29:25NFS
14. 30:10NFS Server
15. 31:10Flex Volumes
16. 33:20Open Source Projects

" related talks

• 27mDeploying JupyterHub with KubernetesCamilla Montonen · PyData Amsterdam 2018
• 37mJupyterHub from the Ground Up with KubernetesCamilla Montonen · PyData London 2018
• 31mManaged Kubernetes — Next Gen Academic Infrastructure?Lukáš Hejtmánek, Viktória Spišaková · Kubernetes Batch + HPC Day North America 2022
• 39mHow We Hosted 200+ Data Scientists in a K8S ClusterAleksey Kuznetsov, Mikhail Lepeshkin · Saint HighLoad++ 2022
• 40mStreet fighting techniques for multi tenant machine learning...Sky Thomas · Scale By The Bay 2018
• 36mBuilding a Scalable Data Science & Machine Learning cloud using KubernetesMurali Paluru · Big Data Conference Europe 2019
• 30mEducation as a Service: Containerization and Orchestration of CS50 IDEKareem Zidane, David J. Malan · KubeCon + CloudNativeCon North America 2019
• 23mImplementation Challenges: From HPC to Containers in the AcademyLukáš Hejtmánek, V Spišaková · KubeCon + CloudNativeCon North America 2021