HaloTouch++: Towards Portable and Condition-Tolerant Surface Touch Input for Mixed Reality
Touch interaction on everyday surfaces has long been envisioned as an extension of mixed-reality input, offering tactile feedback and proprioceptive cues that enhance user comfort and precision. However, most existing mixed-reality touch-sensing techniques are designed for static, dry, and large surfaces, making them unsuitable for real-world use where surfaces may be handheld, wet, or smaller in size. We introduce HaloTouch++, a mixed-reality touch input technique that enables low lift-off, water-tolerant and finger profile modified interactions on handheld surfaces. The system harnesses multi-path interference from time-of-flight depth sensing as a stable optical cue for detecting physical contact. A lightweight, plastic reflector attached to the surface amplifies these interference patterns, forming a distinctive “Halo” signature around touch points that remains consistent across surfaces and under varying poses and moisture conditions. In a 15-participant evaluation spanning multiple materials, user poses, and water conditions, HaloTouch++ achieved 97.3% touch-down accuracy and 93.3% gesture recognition accuracy.
Authors
- Ziyi Xia (ORCID: https://orcid.org/0000-0002-9856-9101)
- Robert Xiao (ORCID: https://orcid.org/0000-0003-4306-8825)
- Xincheng Huang (ORCID: https://orcid.org/0000-0001-6923-6490)
- Sidney Fels (ORCID: https://orcid.org/0000-0001-9279-9021)
Institutions
- University of British Columbia (CA)
Publication Details
- Journal
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2026-11-20
- DOI
- https://doi.org/10.1145/3859336
- Primary Topic
- Interactive and Immersive Displays
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Natural Sciences and Engineering Research Council of Canada