SkyPilot: Simple Orchestration of Workloads

on YouTube ↗11m

" summary

SkyPilot offers cloud-agnostic GPU orchestration that selects providers with cost awareness and uses simple YAML manifests. The tooling includes Sky Launch to start ephemeral clusters (example: one H200 and two L40S GPUs), a Sky Dashboard for multitenant visibility, and a manifest YAML with setup and run sections; the demo shows launching containers (Ollama and Open Web UI) and connecting via VS Code within minutes, with a brief connectivity hiccup.

AI-written summary · about

" chapters (8)

1. 0:00GPU orchestration
2. 1:15What is SkyPilot
3. 3:24SkyPilot architecture
4. 4:27Defining and launching job
5. 5:09Demo: cluster management
6. 6:55Dashboard and multitenancy
7. 8:00Demo: Ollama and Open Web UI
8. 10:37Summary

" related talks

• 17mSkyPilot: An Intercloud Broker for Sky ComputingWei-Lin Chiang, Ion Stoica, Scott Shenker, Zhanghao Wu, Zongheng Yang, Michael Luo, Romil Bhardwaj, Woosuk Kwon, Siyuan Zhuang, Frank Sifei Luan, Gautam Mittal · NSDI 2023
• 16mSky Computing: Charting a New Course in AI Cloud InfrastructureBrian Irish · Conf42 MLOps 2025
• 52mSky ComputingIon Stoica · USENIX ATC '23
• 52mJoint Keynote AddressIon Stoica · OSDI 2023
• 22mBeyond Single-Cluster Limits: Scaling GPU Workloads Across Kubernetes With…K. Das, E. Bayramova · KubeCon + CloudNativeCon Japan 2026
• 33mAI Workspaces for the Modern Era – Kubeflow Notebooks v2Siyuan Zhang, Mathew Wicks · Kubeflow Community Showcase 2026: GenAI and MLOps in Action
• 27mFrom Supercomputing to Serving: A Case Study Delivering Cloud Native Foundation ModelsAutumn Moulder · Cloud Native + Kubernetes AI Day NA 2024
• 01h 24mRobust and End-to-End Cloud Native Machine Learning & Data Processing PlatformEduardo Apolinario · PyData Seattle 2023