Mixing voice & data

on YouTube ↗19m

" summary

A live demo wires a Twilio Video API WebRTC call into a Node.js backend on Bluemix that streams browser audio over WebSockets to IBM Watson Speech to Text for real-time transcription, then uses Alchemy API to extract the product and sentiment after the call, updates a 0–100 feedback score, and triggers Business Rules plus Bluemix Workflow to open a review task. Client-side code converts audio to PCM16 (painful), requires careful WebSocket handling and browser workarounds (Firefox 35, Chrome limitations).

AI-written summary · about

" chapters (6)

1. 0:00Start
2. 3:34What is Bluemix?
3. 6:52Record the local stream
4. 8:24Convert the audio to PCM
5. 9:20Emit a web socket message
6. 9:39Initiate a websocket connection from Node to IBM Watson

" related talks

• 19mAudio Streaming - Using WebRTC for building your own Voice AIsLee Boonstra · Frontend Love 2020
• 43mNow Hear This! Putting Real-Time Voice, Video and Text into RailsBen Klang · RailsConf 2015
• 10mA Day in the Life: An Immersive Data ExperienceDavid Boloker · Velocity Conference Amsterdam 2015
• 01h 25mUsing Nexmo Voice WebSockets with IBM WatsonAaron Bassett, Dave Nugent · Vonage Campus 2019
• 05mLive Voice Transformations For Web Conferencing Using The BrowserGerard Llorach, Mattes Ohlenbusch, Thomas Brand · Web Audio Conference 2021
• 28mLet's Get Chatty with Conversational Interface in JavaScriptTomomi Imura · Render Conference 2018
• 38mBuilding Smarter Applications Using Cognitive ComputingJustin Lee · iOS Conference SG 2015
• 01h 04m“Hello, AI?!” – Real-Time Voice Interactions with LLMsChristian Liebel · International PHP Conference 2025 Munich