TonguePlay: Non-invasive Tongue Pressure Input for Gaming
Physiological input enables hands-free, embodied interaction in games, but its inherent signal variability complicates precise control. Most systems suppress this variability to achieve stability, leaving fine-grained variability of user effort underutilized. In this paper, we propose a dual-stream architecture that uses physiological signals for action control and residual effort-coupled variability as perceptual feedback to shape game feel. We investigate this approach using tongue-based input sensed via non-invasive surface electromyography (sEMG) in two studies. In Study 1 (n = 24), we evaluated the feasibility of tongue pressure in primary and modifier roles. Integrating head-gaze for selection with tongue pressure for confirmation significantly outperformed tongue-only input on performance measures, suggesting that separating spatial intent from physical effort can yield more stable control. In Study 2 (n = 12), we examined the experiential impact of residual variability in tongue pressure control as feedback. Rendering this residual jitter as a perceptual response led participants to misattribute their own effort to external resistance or animacy, a phenomenon we describe as physiological ventriloquism, where one’s effort feels externally owned. We contribute a design perspective that reframes physiological variability not as error to be eliminated, but as expressive material when architecturally separated from control.
Authors
- Florian Müller (ORCID: https://orcid.org/0000-0002-9621-6214)
- Xiaoyan Zhou (ORCID: https://orcid.org/0000-0002-1650-8314)
- Asreen Rostami (ORCID: https://orcid.org/0000-0003-0594-3027)
- Martin Hedlund (ORCID: https://orcid.org/0009-0002-0080-3113)
- Andrii Matviienko (ORCID: https://orcid.org/0000-0002-6571-0623)
- Natalia Sempere (ORCID: https://orcid.org/0009-0003-5336-4860)
- Pooria Ghavamian (ORCID: https://orcid.org/0009-0009-8146-2744)
- Oskar Hokkanen Eriksson (ORCID: https://orcid.org/0009-0001-0733-3348)
Institutions
- Stockholm University (SE)
- RISE Research Institutes of Sweden (SE)
- Technische Universität Darmstadt (DE)
- Interaction Design (United Kingdom) (GB)
- KTH Royal Institute of Technology (SE)
Publication Details
- Journal
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2026-11-03
- DOI
- https://doi.org/10.1145/3831314
- Primary Topic
- Interactive and Immersive Displays
- Type
- article
- Field-Weighted Citation Impact
- 0.00