The art of programmatic videos with Rust
summary
Release of fframes.studio: an end-to-end Rust pipeline that uses libav/ffmpeg for encoding, a custom SVG parser + CPU and GPU renderers, and proc-macros that precompile SVG into vertices for caching. It parallelizes by spawning 12 encoders (rendering chunks then concatenating) and renders a 30s 1080p demo faster than a browser while GPU wins at 4K with blurs/gradients. Includes programmatic audio mixing and spectrum data for visualization; public beta and source access exist.
AI-written summary · about
chapters (11)
- 0:00Programmatic video in Rust
- 1:02Why Rust for video
- 3:07Video structure and codecs
- 8:26Rendering challenges
- 10:56EverFrames framework
- 14:50Rendering pipeline
- 18:22CPU vs GPU trade-offs
- 20:28Optimizing SVG with Rust
- 22:35Adding audio
- 24:21Art of programmatic videos
- 24:42EverFrames beta release
related talks
34mStreaming video analysis in Rust using Pravega
23mCreating Videos Programmatically in React
24mArtisanal Rendering: Make Your Own Computer Art!
25mFearless Multimedia Programming
37mCode Your Videos: Programmatic Video Creation with Javascript
31mBuilding a rendering engine in Rust for Flutter
29mWebAssembly Zone
33mBuilding a pair-programming app in public with Rust