Eyes-Free, Touch-Free, and Worry-Free: Repurposing Wireless Chargers for Safer In-Car Gesture Interaction

As vehicles evolve into digital living spaces, the demand for seamless human-vehicle interaction has surged. However, traditional interaction modalities impose critical safety and usability burdens. Touchscreens require visual attention (eyes-on), compromising driving safety, while voice assistants, although eyes-free, suffer from inherent latency, high cognitive load, and the intrusive disruption of cabin audio and social conversations. Mid-air gestures offer a promising shortcut for silent, immediate, and eyes-free control. Yet, enabling robust gesture sensing remains a challenge. Vision-based solutions can raise privacy and illumination concerns in some in-cabin deployments; millimeter-wave radar often increases hardware cost and integration complexity; and acoustic sensing can be affected by cabin noise and multipath interference in the in-cabin environment. To bridge this gap, we present MagHarp , a novel system that repurposes the ubiquitous in-car wireless charging pad for active gesture recognition. We observe that the human hand acts as a capacitive bridge within the near-field region, subtly modulating the charging signals. By treating the existing Wireless Power Transfer (WPT) hardware as a near-field electromagnetic sensor, we avoid modifying the charger or smartphone. MagHarp captures these minute impedance perturbations without modifying the transmitter. We design a robust pipeline featuring a lightweight CNN-BiLSTM network that helps distinguish driver gestures from vehicle-related disturbances and environmental interference. Extensive experiments across 5 chargers and 4 phones demonstrate that MagHarp achieves an average gesture recognition accuracy of 97.6% on a 3,500-sample dataset, effective up to 20 cm (recommended within 15 cm for robustness).

Authors

Institutions

Publication Details

Journal
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
Published
2026-09-30
DOI
https://doi.org/10.1145/3831984
Primary Topic
Indoor and Outdoor Localization Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Eyes-Free, Touch-Free, and Worry-Free: Repurposing Wireless Chargers for Safer In-Car Gesture Interaction

范琴斐, Weiyi Wang, Lanqing Yang, Guangtao Xue et al.
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
Indoor and Outdoor Localization Technologies
article

Eyes-Free, Touch-Free, and Worry-Free: Repurposing Wireless Chargers for Safer In-Car Gesture Interaction

范琴斐, Weiyi Wang, Lanqing Yang, Guangtao Xue, Longyuan Ge, Leo Linqian Gan, Guo Yu, Jeffery Wu
article en

Abstract

As vehicles evolve into digital living spaces, the demand for seamless human-vehicle interaction has surged. However, traditional interaction modalities impose critical safety and usability burdens. Touchscreens require visual attention (eyes-on), compromising driving safety, while voice assistants, although eyes-free, suffer from inherent latency, high cognitive load, and the intrusive disruption of cabin audio and social conversations. Mid-air gestures offer a promising shortcut for silent, immediate, and eyes-free control. Yet, enabling robust gesture sensing remains a challenge. Vision-based solutions can raise privacy and illumination concerns in some in-cabin deployments; millimeter-wave radar often increases hardware cost and integration complexity; and acoustic sensing can be affected by cabin noise and multipath interference in the in-cabin environment. To bridge this gap, we present MagHarp , a novel system that repurposes the ubiquitous in-car wireless charging pad for active gesture recognition. We observe that the human hand acts as a capacitive bridge within the near-field region, subtly modulating the charging signals. By treating the existing Wireless Power Transfer (WPT) hardware as a near-field electromagnetic sensor, we avoid modifying the charger or smartphone. MagHarp captures these minute impedance perturbations without modifying the transmitter. We design a robust pipeline featuring a lightweight CNN-BiLSTM network that helps distinguish driver gestures from vehicle-related disturbances and environmental interference. Extensive experiments across 5 chargers and 4 phones demonstrate that MagHarp achieves an average gesture recognition accuracy of 97.6% on a 3,500-sample dataset, effective up to 20 cm (recommended within 15 cm for robustness).

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous TechnologiesVol. 10(3)
Shanghai Jiao Tong University (CN)
Openalex Percentile: Top 22%
Indoor and Outdoor Localization Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.