~/talk

Luis Ceze, OctoML | Cube Conversation

name:Luis Ceze
links:none on file
slides:none on file

OctoML explains how an Apache TVM–based compiler and runtime pipeline automates turning models into deployable containers, optimizes them for specific CPUs/GPUs, and preserves model behavior while cutting inference cost. A customer case shows 4x reduction in deployment costs. The platform manages hardware independence so models run on cloud or edge and copes with limited GPU supply, and it stresses that inference is the majority of cost that scales to millions per month if unchecked.

AI-written summary · about

~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.