~/talk

Exploring the Potential of the Web Speech API in Karaoke

Talkat ffconf 2023 · on Friday, 2023-11-10· [web-platform, creative-coding]
slides:none on file

Built a browser karaoke prototype that uses Web Speech API speech recognition plus the HTMLMediaElement timing to match live transcripts to lyric time ranges. Implementation uses vanilla JavaScript and CSS over HTTPS, no libraries, and requires vendor server processing (Chrome/Safari) so it is not offline and Firefox lacks support. Demo correctly matches simple nursery-rhyme lines but recognition auto-stops, mis-segments sung words, and proves reliable only for short voice notes, not robust singing or rap.

AI-written summary · about

  1. 0:00Introduction
  2. 3:13Web Speech API overview
  3. 6:07Karaoke demo
  4. 11:38Building the demo
  5. 15:17Verdict on API
  6. 17:27Web Speech API future
  7. 18:33Why useless projects
  8. 20:45Closing thoughts
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.