Multimodal interfaces: don't shout at me, I can't see you
summary
The talk examines multimodal interfaces—conversational (voice/chat), graphical, and touch—across multiple devices and simultaneous channels. It explains the design challenges and trade-offs of each interaction mode and discusses how to combine them to create usable experiences that work for people in different contexts and physical or mental states.
AI-written summary · about
chapters (14)
- 0:00Introduction
- 5:24What is multimodal interaction
- 12:23Multimodality history
- 17:54Unimodal interface problems
- 20:04Graphical interface examples
- 22:52Command and touch interfaces
- 25:24Voice pros and cons
- 29:17Multimodal interaction design
- 32:50Multimodality practical example
- 37:17Design environment and context
- 39:04Voice in design
- 40:29AI and voice opportunities
- 43:45Conclusion
- 44:10Q&A
related talks
17mWhat is multimodal design? An interview with John Alderman and Christine Park
21mMulti modal interfaces and the future of voice
43mHi, Want to Chat? When Conversation Is the Interface, the Challenge Is Designing Personalities
01h 20mDesigning Non-Visual Interfaces: Foundations, Meaning, Examples
08mCrossing the multimodal chasm
17mReimagining Customer Experiences Integrating Voice into Digital Strategy
55mConversation Is the Next Big Interface
36mPositive Multi-Device Experience of the Future