Augmenting Augmented Reality with Non-Line-of-Sight Perception
summary
An integrated AR headset prototype augments Hololens 2 with an AR-conformal antenna on a thin Kapton substrate, BladeRF radios and a Raspberry Pi to sense commodity RFID tags and localize them with a 200 MHz RF bandwidth. An RF-visual synthetic aperture fuses headset visual odometry and RF measurements to reach a median 9.8 cm localization and needs about 1.2 m of user motion; a reverse-SAR using hand tracking verifies picks with >95% F-score (decimeter-level occluded-item locating).
AI-written summary · about
chapters (6)
- 0:00Start
- 4:37We need an Antenna for RF sensing
- 6:14Synthetic Aperture Radar
- 13:14Implementation
- 13:54How accurate X-AR is in locating RFID tags?
- 14:28How much does the user need to walk?
related talks
20mFoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based ...
42mHow to Augment Your Reality
12mHow Augmented Reality is Building the World Around You
10mInside-Out Instrument Tracking for Surgical Navigation in Augmented Reality
10mAR for Optimization of Processes in Intralogistics
16mAugmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays
44mBetween Two Realities: Testing AR / MR
43mFrom Flatland to Spaceland