~/talk

Mark Lohmeyer, Google Cloud | Red Hat Summit 2025

links:none on file
slides:none on file

2025 is framed as the year of inference with a push from training to multi-step reasoning models and agentic workflows that create wildly dynamic loads. Google Cloud says it ports VLLM on TPUs to cut cost-per-token and offers LLMD as an open-source routing layer that disaggregates prefill versus decode, storage tiers, and inference engines across GPUs and TPUs. It also ships accelerator-tuned features like Hyperdisk ML and promotes agent-to-agent interoperability across a growing partner ecosystem.

AI-written summary · about

  1. 0:00Introduction and welcome
  2. 1:14AI workloads and market trends
  3. 2:39Open source and AI at Google
  4. 4:24Balancing cost and performance
  5. 5:49LLMD and distributed inference
  6. 6:55Enterprise bottlenecks in AI
  7. 8:23Ecosystem and future vision
  8. 10:09Customer experience and flexibility
  9. 11:56Openness across the stack
  10. 13:00Infrastructure innovations for AI
  11. 14:25Memory efficiency and VLLM
  12. 15:50Closing remarks and summary
~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.