Accessible charts using music and haptics

on YouTube ↗23m

" summary

Yahoo Finance converts chart y-values into pitched tones (higher price = higher pitch), adds haptic pulses for high/low/previous close/current, and supports two-finger scrubbing with TalkBack on Android; the chart view uses Canvas plus a RecyclerView of accessible point descriptions. Discovery tests use eight blind participants and about 80% could draw the overall trend from audio. The Android implementation is open sourced as Songbird (GitHub), and a piano-tone update makes playback more pleasant.

AI-written summary · about

" chapters (6)

1. 0:00Introduction
2. 1:00Agenda
3. 1:57Context
4. 5:11Design Considerations
5. 12:06Implementation
6. 16:33Future plans

" related talks

• 21mMusical Charts: Using OSS to Make Data Visualizations Accessible to Visually Impaired UsersJulianna Langston · Open Source in Finance Forum New York 2022
• 01h 02mSenses Working OvertimeDoug Schepers · OZeWAI 2020
• 33mMaking Data Visualizations More AccessibleEeva-Jonna Panula · Android Worldwide January 2024
• 41mAccessible Charts Done RightSergei Kriger · Inclusive Design 24 (#id24) 2018
• 37mMaking Data Visualizations More Accessible - Lessons LearnedEeva-Jonna Panula · Droidcon London 2023
• 35mAccessible Charts Done RightSergei Kriger · FrontEnd Con 2018
• 34mAccessible Charts Done Right: Myth or RealitySergei Kriger · CSS-Minsk-JS 2018
• 24mAccessible charts done rightSergei Kriger · WebCamp Zagreb 2018