The State of GenAI & ML in the Cloud Native Ecosystem
Talkat Cloud Native + Kubernetes AI Day Europe 2025 · on Tuesday, 2025-04-01· at 09:10· Level 1 | Hall Entrance N10 | Room G·
summary
Overview of production GenAI and ML at scale with concrete claims: enterprises like Zalando run forecasting, pricing, search and a conversational fashion assistant and face real gaps in tooling and skills from recent surveys. Practical tooling discussed includes RAG and agentic workflows, LangChain/lang-graph, vector stores (Milvus/Postgres for retrieval), orchestration (Ray, Airflow, Kubeflow), observability (Langfuse, Prometheus) and hardware schedulers. Key risks are memory/data poisoning, identity and RCE exploits; recommended fixes are edge moderation, CRD-based model interfaces and standardized guardrails.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 1:38Motivations
- 8:51Best Practices
- 15:35Storage
- 17:15Security
- 18:28Observability
- 19:47Roles Responsibilities
- 21:01Conclusion
- 22:06Resources
related talks
24mScalable GenAI in Production
21mRun GenAI Projects at Scale Securely: From the Operating System to the MLOps Platform
11mOpen source GenAI vs. enterprise GenAI: Navigating the future of AI innovation
18mNavigating the growth frontiers of generative AI
02h 35mBringing GenAI to the Modern Enterprise. A production use-case. In Serverless Java!
24mSoftware 3.0 and the AI Engineering Landscape
26mInnovate faster with generative AI
30mBeyond Monolithic AI: Cloud Native Patterns for Dynami...