~/talk

Andy Pernsteiner, Vast | NVIDIA GTC '26

Talkat NVIDIA GTC San Jose 2026 · 2026-03-16..03-19· [large-language-models]
links:none on file
slides:none on file

Claims a 10X improvement in inference from a single GPU server by offloading KV cache attention data from HBM to storage using NVIDIA’s Dynamo inference engine and tuned KV caching, built on GPUDirect Storage and NFS over RDMA. Describes open-source pipelines based on NVIDIA blueprints for document and video ingestion, cites tripling exabyte deployments year over year, an integrated policy model for security and multi-tenancy, and a global namespace plus data engine that orchestrates compute near data.

AI-written summary · about

~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.