Home Multimedia and Automation Systems with GStreamer
Talkat Open Source Summit Europe + Embedded Linux Conference Europe 2019 · on Wednesday, 2019-10-30· at 11:30· Forum 2·
summary
Uses GStreamer network clocking to sync distributed audio playback (Arena distributed player) and reverses that to stream synchronized mic inputs for beamforming and triangulation. Achieves under 1 ms sync over Ethernet, typically 10–20 ms on Wi‑Fi; uses ReSpeaker/SoC mic arrays and ODAS for direction finding and source separation. Calibration runs by playing coded sounds between nodes; prototype libquiet acoustic modem currently decodes reliably to ~0.5 m, aiming for ~100 bits/s with timestamped packets.
AI-written summary · about
chapters (15)
- 0:00Start
- 1:54Smart Assistants
- 2:40Free Software!
- 5:50GStreamer: Audio Conversion
- 6:28Idea 1: Music Playback
- 7:37Synchronisation
- 8:31Synchronising Clocks
- 9:08Aurena Architecture
- 13:45Home Automation Cameras
- 15:29GStreamer WebRTC Pipeline
- 16:36Secret Plan
- 21:11Hardware Options
- 21:54Distributed Microphone Arrays
- 28:59Problems
- 29:28Calibration So Far
related talks
22mSynchronised Playback with GStreamer
51mUsing GStreamer for Seamless Off-loading Audio Processing
29mGNU Radio Enhancements for Space-Based Research
17mMonday Lightning Talks
55mEtherify, sonify: soft tempest at home and on the farm
22mWebRTC: Connecting Embedded, Mobile and Desktop with the Lowest Latencies
50mNerd sniping myself into a rabbit hole. Streaming online audio to a Sonos speaker
40mTime-Sensitive Networking (TSN) with Mainline Embedded Linux