At a Glance to Your Fingertips: Enabling Direct Manipulation of Distant Objects Through SightWarp
summary
SightWarp summons a scaled near-space proxy of a looked-at object whenever users align gaze and hand, supporting two modes gaze-to-hand and hand-to-gaze that let users immediately perform 6DOF direct gestures on distant items. Implemented in Unity with the Meta XR Interaction SDK on a Meta Quest Pro headset using eye and hand tracking, a 6DOF bunny-docking study shows faster completion, fewer clutching and fewer failed selections for proxy use, with no significant change in acquisition time. world-in-miniature and occlusion workflows are demonstrated.
AI-written summary · about
chapters (8)
- 0:00Introduction
- 0:46SideWarp concept overview
- 1:30Proxy-based interaction techniques
- 2:32Gaze-hand alignment modes
- 4:37Implementation and demos
- 6:25User study setup
- 7:50Results and conclusion
- 8:32Q&A session
related talks
09mRetargeted Self-Haptics for Increased Immersion in VR without Hand Instrumentation
19mProjective Windows: Bringing Windows in Space to the Fingertip
19mHaptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences
17mFaceWidgets: Exploring Tangible Interaction on Face with Head-Mounted Displays
18mWall-based Space Manipulation Technique for Efficient Placement of Distant Objects in Augmented ...
14mTransform intent into action through your eyes
16mMagicalHands: Mid-Air Hand Gestures for Animating in VR
20mSpatial Computing and the Future of Enterprise