Skin-Conformal Inertial Sensing Interface for Continuous Silent Speech Recognition

Silent speech interfaces offer a promising route for restoring communication without phonation; however, existing approaches are often limited by environmental sensitivity, rigid sensor mechanics, and dependence on fixed sentence classes. Here, we present a skin-conformal inertial sensing interface for continuous silent speech recognition from lip articulation. Commercial inertial measurement units are integrated onto a soft substrate through laser-patterned oxidized gallium-indium interconnects, enabling stable electrical performance under mechanical deformation and intimate coupling to dynamic facial skin. This conformal architecture mitigates motion artifacts to ensure high signal fidelity during dynamic articulation and supports robust operation in acoustically noisy and visually constrained environments. Combined with a data-efficient sliding-window decoding strategy, the system generalizes from isolated-word training to recognition of previously untrained sequences of different lengths composed of words from the trained vocabulary, with an average accuracy of 92.5%. Discrete word recognition reaches 99.6% across a 25-word daily vocabulary. These results establish a wearable silent speech sensing platform that supports continuous fixed-lexicon communication for assistive human-machine interaction.

Authors

Institutions

Publication Details

Journal
ACS Sensors
Published
2026-09-18
DOI
https://doi.org/10.1021/acssensors.6c01556
Primary Topic
Advanced Sensor and Energy Harvesting Materials
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Skin-Conformal Inertial Sensing Interface for Continuous Silent Speech Recognition

Lu‐Qi Tao, Tian‐Ling Ren, Yi Liu, Ding Li et al.
ACS Sensors
Advanced Sensor and Energy Harvesting Materials
article

Skin-Conformal Inertial Sensing Interface for Continuous Silent Speech Recognition

Lu‐Qi Tao, Tian‐Ling Ren, Yi Liu, Ding Li, Zixu Wang, Yi Yang, Y. Xie, Zijia Su, Chengrui Xue, Yufeng Wang, Junchao Yan
article en

Abstract

Silent speech interfaces offer a promising route for restoring communication without phonation; however, existing approaches are often limited by environmental sensitivity, rigid sensor mechanics, and dependence on fixed sentence classes. Here, we present a skin-conformal inertial sensing interface for continuous silent speech recognition from lip articulation. Commercial inertial measurement units are integrated onto a soft substrate through laser-patterned oxidized gallium-indium interconnects, enabling stable electrical performance under mechanical deformation and intimate coupling to dynamic facial skin. This conformal architecture mitigates motion artifacts to ensure high signal fidelity during dynamic articulation and supports robust operation in acoustically noisy and visually constrained environments. Combined with a data-efficient sliding-window decoding strategy, the system generalizes from isolated-word training to recognition of previously untrained sequences of different lengths composed of words from the trained vocabulary, with an average accuracy of 92.5%. Discrete word recognition reaches 99.6% across a 25-word daily vocabulary. These results establish a wearable silent speech sensing platform that supports continuous fixed-lexicon communication for assistive human-machine interaction.

ACS Sensors
Innovative Research (United States) (US), Tsinghua University (CN)
National Natural Science Foundation of China, Chinese Academy of Sciences, National Key Research and Development Program of China
Openalex Percentile: Top 21%
Advanced Sensor and Energy Harvesting Materials
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.