~/talk

The Sound Sketchpad: Expressively Combining Large and Diverse Audio Collections

Talkat IUI 2021 · 2021-04-13..04-17· [creative-coding, data-visualization]
links:none on file
slides:none on file

An algorithm-in-the-loop audio–graphical tool that turns a sung or whistled guide plus drawn paths into collaged music, extracting time-varying features (pitch default) and searching up to 100 candidates from large audio collections. Graphical controls map to energy density weight variance and to audio-processing functions; two reconstruction modes are implemented: sparse (greedy selection minimizing Euclidean distance) and dense (simulated annealing optimizing multi-feature KL divergence, with a density threshold to drop low-amplitude sounds), producing mixable collages that scale beyond DAW workflows.

AI-written summary · about

  1. 0:00Introduction
  2. 0:14Abstract
  3. 0:58Implementation
  4. 1:47Processing
  5. 3:14Collage
  6. 3:49Conclusion
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.