WG-Batch Updates: What’s New and What Is Next?
Talkat KubeCon + CloudNativeCon Europe 2025 · on Thursday, 2025-04-03· at 11:45· Level 3 | ICC Capital Suite 14-16·
summary
WG-Batch reports concrete progress: Kueue hits about 50 releases and offers workload-level scheduling with topology-aware placement, two fair-sharing modes (preemption and admission-based historical weighting) and hierarchical quotas for multitenant clusters; MultiQ is evolving for multicluster job distribution; kubectl plugin kueuectl provides day-to-day queue ops; JobSet is gaining adoption (Kubeflow Trainer v2, Metaflow) and KJob supplies reusable job templates and a Slurm-like CLI to launch hundreds of similar jobs.
AI-written summary · about
chapters (12)
- 0:00Batch Working Group intro
- 2:05What is Q in Kubernetes
- 6:15Recent Q features: Topology scheduling
- 9:10Fair sharing in Q: Preemption & admission
- 14:57Hierarchical quotas & controls
- 16:06Q improvements & multi-cluster
- 17:38QCTL: CLI for Q operations
- 18:21Job API & JobSet adoption
- 20:33KJob: Simplifying batch workloads
- 24:49Batch ecosystem with K8s
- 26:16Q&A: Fair scheduling & usage
- 28:06Q&A: Argo Workflows & HPC
related talks
30mWG-Batch Updates: What’s New and What Is Next?
37mIntroduction to the Kubernetes WG Batch
33mBatch Systems in Production with Kueue: Multi-Tenancy and Fungibility
28mMultitenancy and Fairness at Scale with Kueue: A Case Study
29mBuilding a Batch System for the Cloud with Kueue
31mSIG Scheduling Update: Transition From Pod To Workload Scheduling
35mKueue: A Kubernetes-native Job Queueing
05mClosing Remarks