Lightning Talk: Improve Data Science Collaboration with CI/CD!
Lightningat Kubeflow Summit Europe 2024 · on Tuesday, 2024-03-19· at 14:45· Pavilion 7 | Level 7.3 | Room S02·
summary
Automated CI/CD uses GitHub Actions to detect notebook adds/updates, builds container images on notebook change using Buildah/Podman/Docker under the hood, tags images with both latest and commit SHA, and pushes to any container registry so collaborators can pull and run the exact environment via Kubeflow Notebook Controller or locally. Demo runs in Act, shows the workflow filtering for notebook diffs, building the image, pushing it, and launching JupyterLab from the image to reproduce the notebook state.
AI-written summary · about
related talks
28mDevOps for Data Science With Kubernetes
22mDock Your Jupyter Notebook
05mLightning Talk: Build a Reproducible ML Workflow with Kubeflow Pipelines
05mCI/CD Pipelines and Machine Learning
18mDeveloper Workflow Automation with GitHub Actions (CI/CD)
48mCICD with Github Actions
37mGitHub Actions + K8S to level up software dev
39mNotebook To Production