~/lightning

Lightning Talk: Accelerate WebAssembly AI with Backend Graph Compliers on a Wide Variety of AI HW Accelerators

Lightningat Container Plumbing Days 2024 · on Monday, 2024-04-15· at 12:15· 335-336 (Level 3)· [webassembly, machine-learning]
slides:none on file

Prototype WebAssembly runtime injects a transparent backend interposer that intercepts ML framework calls (it hijack load_model/predict) and redirects models into mainstream graph compilers (TVM, XLA, OpenVINO et al.) so WASM binaries run on CPU, GPU, FPGA, or other AI accelerators without source changes. Implementation builds graph-compiler libraries into the runtime, converts models to compiler IR at load time, runs inference via the compiler backend, and demonstrably executes end-to-end demos from cloud to edge with improved accelerator utilization.

AI-written summary · about

~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.