What on earth is ONNX and ONNXRUNTIME
summary
Explains ONNX as a standardized ONNX model format and ONNXRuntime as a lightweight inference engine, shows concrete export commands for converting PyTorch and TensorFlow models, uses ONNXRuntime with CPU and GPU execution providers, measures end-to-end inference latency and memory footprint on a real sample model, compares tradeoffs between accuracy and performance, and walks through a small demo deployment for mobile and server that actually runs and validates results.
AI-written summary · about
chapters (6)
- 0:00Introduction and agenda
- 4:16What is ONNX and why it matters
- 16:02Demo of ONNX Runtime
- 20:55Key benefits of ONNX Runtime
- 27:25Common use cases and examples
- 31:07Q&A and closing remarks
related talks
05mONNX Runtime
30mScalable ML acceleration with ONNX Runtime
45mLeverage Power of Machine Learning with ONNX
30mThe Evolution of ONNX: Driving Interoperability in AI...
05mPyTorch ONNX Export Support
41mLeverage Power of Machine Learning with ONNX
51mMaking neural networks run in browser with ONNX
10mLightning Talk: Streamlining Model Export with the New ONNX Exporter