Portal-ble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented Reality
summary
A portable smartphone system called Portal-ble prototype uses a Leap Motion + Intel stick feeding hand poses into Unity/ARCore, implements gesture recognition at 98% gesture accuracy, and adds visual, audio, haptic and expanded collision-region mechanics plus a moving-window filter. A 12-participant study on picking up stationary and 20 cm/s moving targets and assembling blocks shows Portal-ble is ~20% more successful for static objects and nearly doubles success for moving ones, lowers NASA-TLX scores, and yields higher user preference.
AI-written summary · about
chapters (11)
- 0:00Introduction to Portal-ble
- 0:28Motivation for free-hand AR
- 3:20Prototype hardware setup
- 4:49Gesture recognition model
- 5:33User study design
- 6:59Identified interaction issues
- 7:44Feedback mechanisms
- 8:49Manipulation redesign
- 9:41Evaluation tasks
- 12:59Study results and takeaways
- 13:22Q&A session
related talks
10mPAIR: Phone as an Augmented Immersive Reality Controller
09mAdvanced Augmented Reality interactions
43mDesigning for Hands, Gestures, and VR
08mGesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications
11mStabilizAR: Enabling Hands-Free Head Pointing while Mobile
17mLearnings & Challenges for the Integration of Touchless Interaction
16mGetting hands on with VR
19mProjective Windows: Bringing Windows in Space to the Fingertip