Panel: Beyond the Clouds: Charting the Course for AI in the CloudNative World
Panelat Cloud Native AI Day Europe 2024 · on Tuesday, 2024-03-19· at 12:05· Pavilion 7 | Level 7.3 | Room S03·
summary
CNCF working group releases a white paper (≈20 pages) and commits to a targeted reference architecture and a CloudNative AI landscape that uses OCI registries to store model artifacts alongside container images; plans include a constrained cuFlow-style playground, a GPU topology-aware scheduler plus fractional‑GPU sharing and real‑time GPU‑metric autoscaling, and wasmEdge at the edge to split inference between small local models and centralized LLMs. Time to converge is urgent—industry risk of bespoke stacks within months.
AI-written summary · about
chapters (16)
- 0:00Panelist introductions
- 1:44AI workload challenges
- 2:52Open source AI infrastructure
- 6:36OCI artifacts for AI
- 8:46Profiling AI apps
- 12:00AI platform market trends
- 14:05Working Group goals
- 16:31Observability for AI workloads
- 20:49Open source AI innovations
- 24:26End user priorities
- 25:11Building AI-cloud projects
- 26:37WebAssembly at edge
- 28:25Edge and core AI infrastructure
- 30:33Standards for AI workloads
- 30:57Hardware vendor collaboration Q&A
- 34:31Summary
related talks
10mKeynote: Enabling AI with Cloud Native
23mThe State of Cloud Native: The Shift Towards AI
28mCloud Native AI Year in Review
05mSponsored Keynote: Towards Clouds of AI Clusters
43mKeynote: Building AI in the Open: How the Cloud Native Community Shapes What Comes Next
15mCloud Native Theater | Cloud Native University... Cansu Kavili Örnek and Anneli Sara Banderby- 10mKeynote: Enabling AI with Cloud Native
07mKeynote: Exploring the Frontiers of Cloud Native