Sponsored Keynote: Production AI Runs on Open Sou...

on YouTube ↗09m

" summary

Nebius runs an AI platform built on Kubernetes, Slurm, Ray, PyTorch and DeepSpeed that combines cloud‑native orchestration with HPC batch scheduling to support large‑scale training and inference. The team designs and provisions bare‑metal and VM infrastructure, ships an open‑source Soperator that implements Slurm over Kubernetes for topology‑aware scheduling with cloud elasticity, and reports customer metrics like tokens per hour to show improved reliability and utilization in production.

AI-written summary · about

" related talks

• 43mKeynote: Building AI in the Open: How the Cloud Native Community Shapes What Comes NextMario Fahlandt · Maintainer Summit Europe 2026
• 10mKeynote: Enabling AI with Cloud NativeJorge Castro · Cassandra Summit 2023
• 09mKeynote: Kubernetes for GenAI: The New Operating System of the AI-First WorldJanakiram MSV · KubeCon + CloudNativeCon India 2025
• 29mOpen Source Sovereign AI: Building Enterprise GenAI Platforms for Control & Comp...Raghuram Sripada · Open Source Summit India 2025
• 16mKeynote: Accelerating AI/ML Development with Open Source SoftwareBrian E. Granger · AI.dev: Open Source GenAI & ML Summit North America 2023
• 12mKeynote: AI InfrastructureRajesh Nishtala · Product @Scale 2024
• 16mKeynote: An Open-Source Stack for AI Compute: Kubernetes + Ray + PyTorch + vLLMRobert Nishihara · Open Source Summit North America 2025
• 17mKeynote: Open Source × AI: Shaping the Future of kt cloudJaesuk Ahn · Open Source Summit Korea 2025