From Zero to Immersive Hero: Practical Techniques to Glow Up Your Immersive Content
summary
Program builds a draggable 3D speaker in VisionOS using RealityKit + SwiftUI with a working attachment with play + slider that controls an AudioPlaybackController (initial gain set to -30 dB) and a looping model animation. Uses a programmatic AnchorEntity for horizontal table surfaces, trial-and-error scaling to scale 0.0075 and initial Z = -1, adds ImageBasedLight and castShadow for realism, and enables Collision/InputTargetComponent plus direct drag gestures. Spatial audio and slider-controlled volume work in the demo; presenter says it’s doable in ~20 minutes but took two weeks.
AI-written summary · about
chapters (12)
- 0:00Introduction and setup
- 1:28Building the 3D speaker demo
- 3:13Cleaning up the project
- 4:37Loading and scaling the 3D model
- 6:03Adding lighting and shadows
- 8:11Enabling drag interaction
- 11:11Anchoring to a table surface
- 13:16Adding animation and audio
- 16:53Spatial audio demonstration
- 17:36Creating attachments for controls
- 21:09Final demo and summary
- 22:39Q&A on lighting and shadows
related talks
21mBuilding Intuitive AR Experiences on VisionOS
47mCreating XR Stories
09mAdvanced Augmented Reality interactions
03mSoundTrek: A Virtual Reality Audio Perspective-Switching Game
01h 15mKeynote
43mGetting Started with Augmented Reality Using RealityKit
39mDesigning for the Living Room: The Spatial Architecture of Mixed Reality
20mDesigning Experiences With Augmented Reality