Rendering techniques for augmented reality and a look ahead at AR foundation
summary
Adds concrete AR Foundation features: 2D image tracking via Unity image assets and databases, and 3D object tracking using a supplied scanning app that produces detectable models; face tracking returns a mesh plus 52 blend‑shape coefficients to drive skinned meshes; camera image API exposes background texture for real‑time CV and post‑processing; environment probes supply cubemaps for image‑based lighting (auto or manual) that update over time. Editor tools include remoting & simulation—streaming, recording, and mocked AR data—and LWRP/Shader Graph support; demos run live in the editor and on device.
AI-written summary · about
chapters (10)
- 0:00Intro
- 1:552D IMAGE TRACKING
- 7:35FACE TRACKING
- 13:34CAMERA IMAGE API
- 18:22ENVIRONMENT PROBES
- 24:34TOOLS - MOCK BACKEND
- 25:38TOOLS - REMOTING
- 30:32TOOLS - SIMULATION
- 32:05LWRP SUPPORT
- 37:01Questions?
related talks
44mDiscovering Augmented Reality with ARCore
33mDesigning AR Applications
15mARCore: Augmented Reality at Android scale
01h 16mAugmented Reality For The Masses
38mThe "R" in AR means data and Augmented Images makes it happen
20mGetting StARted with AR Foundation
41mAUGMENTED REALITY FOR EVERYONE, EVERYWHERE WITH ARCORE
43mBeyond The Printed Page