An Open Source, Cross-platform Communications Layer for the Metaverse
summary
LiveKit provides a concrete stack: a custom libwebrtc distribution plus a shared Rust core and platform SDKs (Unity, iOS, Android, React) that reduce developers’ boilerplate. The media router is an SFU implemented in Go using Pion, supporting vertical scale (2–3 orders of magnitude over peer‑to‑peer) and a managed LiveKit Cloud mesh that claims global low‑latency and sessions up to ~100k simultaneous participants. Features include spatial audio, screen sharing, protobuf signaling, and recently rolled out end‑to‑end encryption in JS and Flutter. The SFU and SDKs are open source; the multi‑home cloud orchestration is proprietary.
AI-written summary · about
chapters (11)
- 0:00Defining the metaverse
- 4:00WebRTC and LiveKit
- 6:49Core API primitives
- 9:13Scaling with SFUs
- 11:52Go and Pion infrastructure
- 14:16Challenges of scale
- 17:09LiveKit Cloud architecture
- 20:22SDK compatibility issues
- 24:13The rust common core
- 29:42Unity SDK introduction
- 31:25Q&A and technical discussion
related talks
32mBuilding Real-Time Audio/Video Apps with Flutter and WebRTC
44mSeamless mobile real-time communication with WebRTC
45mElement Call
23mMoQ: Not Another Tech Demo
38mReal-time Communication on Mobile
44mSeamless mobile real-time communication with WebRTC
06mJerry Chabolla (Xirsys) and Lisa Larson-Kelley (LearnFromLisa.com) interviewed at Fluent 2014
09mDiscussion on StereoKit