Gaze+Mouth: Gaze-Directed Tongue Input with Intraoral Device for Selection in XR
Extended reality (XR) headsets featuring gaze-tracking enable hands-free selection via explicit dwell or integration with other modalities. This paper demonstrates the novel hands-free interaction technique Gaze+Mouth, which combines eye-gaze for pointing with an intraoral tongue gesture for selection. We implement the technique using a wearable mouthpiece and conduct a user study (N=16) comparing Gaze+Mouth to the established Gaze+Pinch technique. Results show that while Gaze+Pinch is significantly faster, Gaze+Mouth achieved a comparable level of accuracy. This suggests that intraoral input is a viable channel for reliable hands-free selection in XR, offering a new modality for situations where users’ hands are occupied or when an alternative is desired.
Authors
- Yijing Jiang (ORCID: https://orcid.org/0000-0002-3680-9579)
- Michael Wessely (ORCID: https://orcid.org/0000-0003-0597-4659)
- Ken Pfeuffer (ORCID: https://orcid.org/0000-0002-5870-1120)
- B. Coskun (ORCID: https://orcid.org/0000-0002-7299-6455)
- Thorbjørn Mikkelsen (ORCID: https://orcid.org/0009-0003-3753-4153)
Institutions
- Aarhus University (DK)
Publication Details
- Published
- 2025-10-08
- DOI
- https://doi.org/10.1109/ismar-adjunct68609.2025.00017
- Primary Topic
- Gaze Tracking and Assistive Technology
- Type
- article
- Field-Weighted Citation Impact
- 0.00