What is multimodal design? An interview with John Alderman and Christine Park
summary
Multimodal design treats senses as input channels and claims the web is already multimodal but narrowly constrained, with IoT and driverless cars shifting control from mechanical affordances to information flows. Practical hurdles are device energy and growing sensory overload that fragments attention; research tools include fMRI for user research and semantic processing to surface latent patterns. Examples built: wooden sensor instruments (Madrona Labs, Ableton Push, Lynnstrument) and interactive sine-wave egg devices that enable audience participation and actually work.
AI-written summary · about
chapters (6)
- 0:00Start
- 0:33Multimodal Design
- 0:51How Does Multimodal Design Apply to Something like the Web
- 2:52How Do We Use Our Senses in Driving
- 4:19The Role of Designers
- 16:11Sine Wave Orchestra
related talks
51mMultimodal interfaces: don't shout at me, I can't see you
38mEmbrace Multisensory & Accessible Design
25mMeet the Founder of Openstream.ai Which started Multimodal
21mMulti modal interfaces and the future of voice
08mCrossing the multimodal chasm
08mChris Hass - UXPA 2017
34mThe eye of the beholder
36mPositive Multi-Device Experience of the Future