MatrixRTC: The (not anymore) missing piece to enable great video conferences

on YouTube ↗44m

" summary

Matrix RTC standardizes call state as per-device call_member state events, uses an interchangeable RTC backend (currently LiveKit SFU per home server replacing TURN), and adds a server-held delayed-event mechanism where clients refresh a delay ID so a leave is posted after ~5s without a heartbeat (delayed events with 5s heartbeat). Encryption starts with full‑mesh key exchange and rotates keys on join/leave (plans for sender-shared salts, electors or MLS later). Element Call demos scale to roughly 500 participants on modest AWS and initial implementations are stabilizing.

AI-written summary · about

" chapters (9)

1. 0:00Introduction to Matrix RTC
2. 2:34Matrix RTC architecture
3. 5:25Room state and signaling
4. 8:51Call member events
5. 10:42Focus selection algorithms
6. 14:08Reliable state and delayed events
7. 19:06Metadata and signaling features
8. 22:49Encryption implementation
9. 27:20Summary and Q&A

" related talks

• 38mReal-time Communication on MobileThomas Gorissen · Meta Refresh 2015
• 21mWebRTC A Quick IntroductionGERMAN GOLDENSTEIN · Kranky Geek WebRTC Brazil 2016
• 23mMoQ: Not Another Tech DemoLuke Curley · Demuxed 2025
• 24mMaking WebRTC awesomeHenrik Joreteg · CascadiaJS 2013
• 33mWebRTC Change Communcations ForeverGreg Baugues · RailsConf 2014
• 58mRealtime Communication with WebRTCSam Dutton · GOTO Aarhus 2013
• 22mBringing RTC to MetaverseRaman Walia, Shreyas Basarge · RTC @Scale 2023
• 08h 44mRTC.On Conference 2023Jonny Burger, Dan Jenkins, Michał Śledź, Ritvi Mishra, Saúl Ibarra Corretgé, Lorenzo Miniero, Marcin Skotniczny, Paula Oses, Rob Pickering, Wojciech Jasiński, Łukasz Wala, Bartosz Studnik, Rishit Bansal, Javi B, Wojtek Barczyński · RTC.On 2023