Designing digital assistants for those who need it most
summary
Concrete examples and outcomes: voice control of Nest thermostat, Nest Hello doorbell and smart lights works (unlocking door and streaming feed to Chromecast), Routines run multiple actions, and Read It uses TTS to read webpages in 40+ languages with adjustable speed; Action Blocks creates one‑tap home screen buttons to trigger Assistant routines; Euphonia collects atypical speech data to improve recognition for conditions like ALS and stuttering; Live Transcribe and Live Caption run on Android/Pixel; Vodafone hotline brings Assistant to 2G phones. Word error rate cited ~5%.
AI-written summary · about
chapters (18)
- 0:00Start
- 4:24Accessibility is Relevant for Billions of Users
- 5:26Accessibility is a wider Field Than You Might Think
- 6:16Top Smart Speaker Use Cases
- 8:45Control Your Environment Independently
- 10:51Control your Smart Home with Google Assistant
- 14:29Easier access to web pages: Ask Google Assistant to read
- 17:13Action Blocks
- 18:55In what other ways can voice technology help people?
- 19:31But what about helping people whose speech is not easily understood by
- 22:03Live Transcribe
- 23:32Live Caption
- 30:27Some Best Practices
- 33:42Customizability of Speech
- 34:45Designing for Multi-Modal Interfaces
- 37:08Get Out of the "Niche" Mindset: You're Really Designing for
- 39:19Accessibility with the Google Assistant Video Series
- 40:18Resources
related talks
55mDesigning for speech
53mBuilding Conversational Experiences with Actions on Google
45mKeynote: Conversations with Machines
51mBuilding an AI assistant that makes phone calls
47mBuilding Voice-First Android Apps
11mMedia Interview
15mDicio voice assistant — Libre, multilanguage and offline assistant for Android
50mSpeak To Me: Voice App Conversation Practices