Now Hear This! Putting Real-Time Voice, Video and Text into Rails

on YouTube ↗43m

" summary

Argues that WebRTC peer-to-peer media with ICE/STUN/TURN and codecs like Opus/VP8 enable real in‑app voice, video and text; shows a working demo: Firefox and Chrome share video, Google Speech API recognizes commands and a Sinatra backend fires curl requests to steer a demo rocket. Covers DTLS‑SRTP encryption, fallback via TURN, and identity/auth flows for medical billing and ops incident rooms, plus features: transcriptable recordings, URLs for conversations, adaptive UI, and a claim of ~1 billion browsers supporting WebRTC.

AI-written summary · about

" chapters (16)

1. 0:00Introduction
2. 7:41Communication Architecture
3. 14:18Applications
4. 14:38Tenant
5. 15:26What does it mean
6. 17:23Being fluid
7. 18:44Being contextual
8. 20:57Trustworthiness
9. 24:04Referenceability
10. 25:28Application Examples
11. 25:48Privacy
12. 27:21Instant Response
13. 30:15Medical Records
14. 32:03Security Authentication
15. 32:56WebRTC Demo
16. 37:28Resources

" related talks

• 38mReal-time Communication on MobileThomas Gorissen · Meta Refresh 2015
• 36mWebRTC Use CasesTsahi Levent-Levi · Kranky Geek WebRTC Brazil 2016
• 34mReal-Time Communication for EveryoneLisa Larson-Kelley · GoRuCo 2014
• 31mWebRTC: Real-time communication without pluginsSam Dutton · JSConf EU 2012
• 33mWebRTC Change Communcations ForeverGreg Baugues · RailsConf 2014
• 26m#javascript Audio/Video Streaming: #WebRTC APIs 101 explainedAlessandro Polidori · CityJS Athens 2023
• 19mAudio Streaming - Using WebRTC for building your own Voice AIsLee Boonstra · Frontend Love 2020
• 55mReal Time DataScott Jensen · Edge Conference 2013 New York