Luis Montes - SeattleJS Conference 2017
summary
Argues browsers can control robots using existing Web APIs and PWAs, showing concrete tech: Johnny-Five running over node-serialport, MIDI-over-USB to emulate devices, WebUSB (Chrome flag), Web Bluetooth (noble → Web Bluetooth shim), and NFC for short messages. Demonstrates a working prototype: an Arduino sending accelerometer-to-MIDI bytes, a browser detecting a QR code via the shape-detection API, computing 3D pose and rendering AR HUD on a canvas — all done live and functional. Slides link provided.
AI-written summary · about
chapters (14)
- 0:00Introduction and setup
- 1:05History of JavaScript robotics
- 3:13From bytes to Johnny-Five
- 5:42NodeBots community
- 7:07Web interactivity with robots
- 9:15Johnny-Five in the browser
- 10:42Progressive web apps for robotics
- 12:06MIDI protocol for robotics
- 17:03WebUSB for direct hardware access
- 20:16Bluetooth Low Energy basics
- 24:30Near-field communication APIs
- 25:56Hardware demo introduction
- 28:06Augmented reality demo setup
- 30:58Demo results and future steps
related talks
32mProgressive Web Apps and the Internet of Things
55mThe Universal Serial Web
32mI'm afraid your browser has been talking to the robots again a gentle intro to WebUSB
32mBridging the Web and the Physical world
42mAdventures in reinventing interfaces
37mA taste of hardware connectivity on the web with Vue
35mI'm Afraid Your Browser Has Been Talking to the Robots Again - A Gentle Intro to WebUSB
44mTiny Computers, JavaScript and MIDI