Teaching American Sign Language in Mixed Reality
summary
System uses mixed-reality headset plus a front-facing camera and AR-tagged sensing gloves with flex and force sensors to capture finger joint angles and contact, and maps motions into the Hamburg Notation System to generate interpretable, per-feature feedback. Study trains 60 participants across four groups on 12 ASL signs and reports statistically significant gains: the MR + real-time feedback condition outperforms 2D interactive, 2D non-interactive, and online video baselines on handshape, orientation, and movement ratings.
AI-written summary · about
related talks
10mSignGlass: First-Person View Comprehensive and Generalizable ASL Translation Using Wearable Glass
35mHow deep learning can help interpret American Sign Language
51mSign Language as a Catalyst for Inclusive Language Education
06mmmASL: Environment-Independent ASL Gesture Recognition Using 60 GHz Millimeter-wave Signals
20mDevelop with Purpose – Building Sign Language Recognition for VisionPro
08mGesturAR: An Authoring System for Creating Freehand Interactive Augmented Reality Applications
17mLearnings & Challenges for the Integration of Touchless Interaction
15mVideo-Annotated Augmented Reality Assembly Tutorials