Wireless Silent Speech Interface Using Multichannel Textile EMG Sensors Integrated Into Headphones
This paper presents a novel wireless silent speech interface (SSI) integrating multi-channel textile-based EMG electrodes into headphone earmuff for real-time, hands-free communication. Unlike conventional patch-based EMG systems, which require large-area electrodes on the face or neck, our approach ensures comfort, discretion, and wearability while maintaining robust silent speech decoding. The system utilizes four graphene/PEDOT:PSS-coated textile electrodes to capture speech-related neuromuscular activity, with signals processed via a compact ESP32-S3-based wireless readout module. To address the challenge of variable skin-electrode coupling, we propose a 1D SE-ResNet architecture incorporating squeeze-and-excitation (SE) blocks to dynamically adjust per-channel attention weights, enhancing robustness against motion-induced impedance variations. The proposed system achieves 96% accuracy on 10 commonly used voice-free control words, outperforming conventional single-channel and non-adaptive baselines. Experimental validation, including XAI-based attention analysis and t-SNE feature visualization, confirms the adaptive channel selection capability and effective feature extraction of the model. This work advances wearable EMG-based SSIs, demonstrating a scalable, low-power, and user-friendly platform for silent communication, assistive technologies, and human-computer interaction.
Authors
- Luigi G. Occhipinti (ORCID: https://orcid.org/0000-0002-9067-2534)
- Tharun Reddy Kandukuri (ORCID: https://orcid.org/0009-0006-3053-8102)
- Chenyu Tang (ORCID: https://orcid.org/0000-0002-6368-5639)
- Edoardo Occhipinti (ORCID: https://orcid.org/0000-0003-4691-9007)
- J Mallah (ORCID: https://orcid.org/0009-0001-3814-825X)
- Wentian Yi (ORCID: https://orcid.org/0000-0002-4044-3063)
- Sunita Mehta (ORCID: https://orcid.org/0000-0002-8059-4034)
- Bhaskar Mishra (ORCID: https://orcid.org/0000-0002-1421-3985)
- Dominika Kazieczko
Institutions
- Imperial College Healthcare NHS Trust (GB)
- University of Cambridge (GB)
- Bridge University (SS)
- Imperial College London (GB)
- Panjab University (IN)
- Chitkara University (IN)
Publication Details
- Journal
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tim.2025.3583386
- Citations
- 2
- Primary Topic
- Modular Robots and Swarm Intelligence
- Type
- article
- Field-Weighted Citation Impact
- 1.43
Funders
- Wellcome Trust