DepthLab: Real-time 3D Interaction with Depth Maps for Mobile Augmented Reality
summary
DepthLab is an open-source library that turns ARCore depth-from-motion maps into three runtime structures—depth array (16-bit, e.g. 160×120), real-time depth mesh, and GPU-interpolated depth texture—and exposes localized, surface, and dense depth APIs. It targets depth-16 up to 8 meters (best 0.5–5 m), runs a simple demo at 100+ FPS, cooks mesh colliders on demand, and recommends 4–8 samples per ray for relighting on Pixel 3 and aperture kernels of 11–21. Several apps (Snapchat, Measure App) already reuse components.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 3:06Related Work
- 4:06Motivation
- 4:34Design Process
- 5:16Data Structure
- 6:01Localized Depth
- 7:48Surface Depth
- 10:49Dense Depth
- 12:26Experiments
- 13:22Limitations
- 13:39Envision
related talks
12mIncrease AR realism and precision with Depth API
43mInto the Deep – or what would the 80s have done with depth sensing technology?
31mARCore
18mDeep-dive on ARCore | Fundamentals of designing AR apps with machine learning models
37mExploring Augmented Reality with ARCore
37mMobiconf 2018: Tobias Due Munk, Developmunk
01h 16mAugmented Reality For The Masses
14mHow to AR