~/talk

Jay Marshall, Neural Magic | AWS Startup Showcase S3E1

links:none on file
slides:none on file

Neural Magic shows software that decouples model execution from expensive accelerators: SparseML optimizes and sparsifies models, SparseZoo publishes pre-optimized models, and the DeepSparse runtime runs them on x86 CPUs and now AWS Graviton ARM (early access). Claim: OPT-style LLMs can be sparsified >50% to run on a single GPU; a retail customer doubles camera count on the same compute. Tooling is open source and DeepSparse is in the AWS Marketplace.

AI-written summary · about

~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.