Usable Without Touch? Revealing the Relationship Between Usability and Mid-Air Gestures

Mid-air gestures are an interaction method where the participant uses their hand(s) to perform a movement or sequence that represents control. This method of interaction is becoming more common for public use, yet the impact on usability lacks summarization. This systematic review explores themes of usability testing methods, applications, gesture design, multimodal combinations, input comparisons, and the participants. Findings reveal that the usability outcomes (effectiveness, efficiency, and user satisfaction) vary based on the type of evaluation method, application, design of gestures, and testing methods used. Furthermore, participant differences such as prior experience, training, and physical ability affect perceived usability. These insights reveal the need for inclusive, adaptive, and context-aware design strategies. Future research should standardize usability evaluation practices and prioritize user-centered approaches to mid-air gesture development. We propose guidelines for future research that will improve gesture systems, feedback, contextual fit, and usability evaluations.

Authors

Institutions

Publication Details

Journal
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Published
2025-09-01
DOI
https://doi.org/10.1177/10711813251369780
Primary Topic
Usability and User Interface Design
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Usable Without Touch? Revealing the Relationship Between Usability and Mid-Air Gestures

Yue Gang Luo, Justin Catalano
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Usability and User Interface Design
article

Usable Without Touch? Revealing the Relationship Between Usability and Mid-Air Gestures

Yue Gang Luo, Justin Catalano
article en

Abstract

Mid-air gestures are an interaction method where the participant uses their hand(s) to perform a movement or sequence that represents control. This method of interaction is becoming more common for public use, yet the impact on usability lacks summarization. This systematic review explores themes of usability testing methods, applications, gesture design, multimodal combinations, input comparisons, and the participants. Findings reveal that the usability outcomes (effectiveness, efficiency, and user satisfaction) vary based on the type of evaluation method, application, design of gestures, and testing methods used. Furthermore, participant differences such as prior experience, training, and physical ability affect perceived usability. These insights reveal the need for inclusive, adaptive, and context-aware design strategies. Future research should standardize usability evaluation practices and prioritize user-centered approaches to mid-air gesture development. We propose guidelines for future research that will improve gesture systems, feedback, contextual fit, and usability evaluations.

Proceedings of the Human Factors and Ergonomics Society Annual MeetingVol. 69(1)
San Jose State University (US)
Openalex Percentile: Top 77%
Usability and User Interface Design
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.