~/talk

Flying a drone with gestures, bananas & Web APIs

Talkat NDC Oslo 2026 · 2026-09-14..09-18· [web-platform, javascript]
links:none on file
slides:none on file

Hacked an SG900S then bought a Parrot Mambo Mini and reverse‑engineered its traffic (Wireshark → abandoned) to control it from the browser via Web Bluetooth. Maps phone accelerometer X/Y/Z with the MDN Sensors API, wires gestures to movement, and implements hand tracking with Leap Motion. Builds a banana controller using a Makey Makey (voltage drops through fruit) and a cheap Arduino Uno; banana demo works, gesture demo works, Bluetooth/speech demos suffer flaky connections, batteries and permissions. Five approaches: JavaScript, Sensors, Bananas, No‑touch, Speech.

AI-written summary · about

  1. 0:00Introduction and background
  2. 2:12Professional role and context
  3. 6:17Motivation for the drone project
  4. 10:38Technical exploration and research
  5. 17:32Drone control via web APIs
  6. 20:58Creative control methods
  7. 34:58HCI and advanced control
  8. 40:04Accessibility and responsibility
  9. 44:38Learning through play and conclusion
~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.