Keynote: How LLMs Have Changed the Way Organizations Do AI
Talkat Cassandra Summit 2023 · on Wednesday, 2023-12-13· at 09:00· Grand Ballroom BC (Concourse Exhibit Level)·
summary
Notes on LLM adoption: organizations move from a fast build-and-learn phase into a scale-and-optimize phase, shifting priorities from quality to cost, latency and privacy. Production deployments routinely use dozens to thousands of GPUs and distributed stacks like Ray to manage them. Teams use multiple models per app, model routing, and multimodal data; many report fine-tuned LLaMA outperforming GPT‑4 at a fraction of the cost. Developers, not just ML researchers, now build AI.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 0:40Anyscale
- 1:30Challenges
- 6:00Phases
- 9:07Dimensions
- 11:00Fine Tuning
- 11:27Massive Expansion
related talks
12mKeynote: How LLMs Have Changed the Way Organizations Do AI
46mPlaying the long game
08mKeynote: Plug in and Scale: Serving LLM Models on Kubernetes Ma...
42mOpen Source LLMs — Powering AI Accessibility and Innovation
33mAccelerating the LLM Lifecycle on the Cloud
36mLLMs and AI agents demystified
40mKeynote
33mOpening Keynote: LLMs, between fantasy and reality - the poin...