iText: Hands-free Text Entry on an Imaginary Keyboard for Augmented Reality Systems
summary
iText implements a hands-free imaginary keyboard for AR HMDs and evaluates three selection methods: E-Type (eye blinks), D-Type (dwell), and G-Type (head gestures). A Wizard-of-Oz pilot maps user key endpoints to build a statistical decoder for D/E and a gesture decoder using Euler-distance matching for G. E-Type reaches ~12 WPM in study 2 and 13.76 WPM with 1.5% WER after five days, with lower reported fatigue and less visual occlusion.
AI-written summary · about
chapters (12)
- 0:00Intro
- 0:26Text Entry in AR HMDS
- 0:44Challenges in Text Entry
- 1:31iText: Three Selection Mechanisms
- 2:03Goals
- 2:34User Study 1 (results)
- 2:56Typing Decoders
- 4:14metrics)
- 4:31User Study 2 (results)
- 5:10User Study 3
- 5:55Potential Application Scenarios
- 6:54Conclusion
related talks
10mEyeSwipe: Dwell-free Text Entry Using Gaze Paths
12mTyping Haptically: Towards Enabling Non-auditory Smartphone Text Entry with Haptic Feedback for B...
40m"Learn to Touch Type" Glove
20mHybrid-Brailler: Combining Physical and Gestural Interaction for Mobile Braille Input and Editing
20mEdgeVib: Effective Alphanumeric Character Output Using a Wrist-Worn Tactile Display
24mGaze and Touch Interaction on Tablets
20mNonvisual Interaction Techniques at the Keyboard Surface
10mPressing a Button You Cannot See: Evaluating Visual Designs to Assist Persons with Low Vision ...