The Web Audio Phenomenon that Shall Not Be Named
summary
Demonstrates the McGurk effect with a DIY web tool and explains how the illusion is produced by visual-auditory mismatch then built make-mcgurk.com using getUserMedia, Web Audio and the media recorder API, and finally falling back to node + ffmpeg via video converter jas for server encoding. Shows splicing audio into video, struggles with Web Audio clock sync, conversion takes seconds to minutes depending on load, and the tool works about 70–75% on first try and is Chrome only.
AI-written summary · about
chapters (11)
- 0:00Start
- 8:34Programming and Linguistics
- 10:33Syntax for a linguist sentence
- 12:14Semantics for a linguist
- 17:43Pragmatics for a linguist
- 25:26The McGurk effect - Harry McGurk
- 29:47How I wanted to do it
- 31:41How I ended up doing it
- 33:15Web Audio is frustrating
- 35:20My Infinite Todo list
- 38:18You Can Too
related talks
22mAudio Jedi, May the Sound be with You
28mChannel your inner rockstar with the web audio API
22mChanging Live Audio with the Web-Audio-Api
34mTools for the 21st century musician
25mHow to be a Web A/V Artist
26mHow To Be a Web AV Artist
30mBuilding a musical instrument with the Web Audio API
19mChanging live audio with the web-audio-api