~/talk

Brian Stevens, Neural Magic | Cube Conversation

Talkat AWS Startup Showcase S3 E1 · on Thursday, 2023-03-09· [machine-learning, web-performance]
links:none on file
slides:none on file

Neural Magic presents techniques that make trained models 90–95% smaller while preserving accuracy and run them on commodity x86 and ARM CPUs using a software inference runtime. It combines fine‑tuning and unstructured sparsification to skip unused math, keeps working sets in cache, and claims order‑of‑magnitude faster CPU inference and ~95% cost savings versus GPU instances. Developer flow is a PIP install then two simple API calls to create a model and predict with it, deployable as a Docker microservice.

AI-written summary · about

~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.