Building AI + XR apps faster with XR Blocks
summary
Announces XR Blocks, an open‑source WebAI + WebXR SDK that reduces prototypes to 39 lines of code for a pinch-to-change-color demo, integrates Gemini Canvas and on-device models, and lists contributions from over 20 Googlers. Implements depth-aware physics, geometry occlusion, lighting estimation, spatial audio, hand-gesture ML and a simulator that fakes depth maps and gestures so the same JS runs on desktop, mobile and Android XR headsets.
AI-written summary · about
chapters (10)
- 0:00XR Blocks introduction
- 1:06What XR Blocks offers
- 3:37AI plus XR challenges
- 5:24Goal: simplify XR
- 6:48XR Blocks code example
- 8:14Vision for interactive primitives
- 9:39XR Blocks SDK features
- 11:49Real-world demos on Android XR
- 12:53Community contributions
- 13:13Inspirational demos
related talks
43mWebXR, if X = how?
33mWebXR: Introducing Mixed Reality and the Immersive Web
26mExploring Augmented Reality on the Web
43mInstant XR: Just Add Browser
20mBuilding the Holodeck: XR for Designers
29mIs XR the Next Big Thing? Immersion, Collaboration, and More!
32mWriting Virtual and Augmented Reality Apps with Web Technology
23mBuilding Engaging Immersive Experiences