3D‐Printed Ion‐Conductive Hydrogels with Tunable Mechanical–Electrical Properties for Multimodal Sign Language Recognition
Sign language recognition technology holds significant importance for eliminating communication barriers faced by the hearing-impaired population. To address the limitations of current wearable sensors‒such as complex fabrication or materials incompatibility within an integrated system, this study designed a 3D printed ion-conductive hydrogel with tunable electromechanical performances for versatile wearable sensing. The hydrogel is primarily based on a polyampholyte network interpenetrated with a polyacrylamide (PAAM) framework and synergistically integrated with LiCl and a covalent organic framework (COF) to enhance its electromechanical performance. It exhibits low hysteresis (90.25% recovery ratio) with high elongation (550%) and large compressive strain tolerance (90%) for strain/pressure sensing, while its low modulus (0.09 MPa) and high conductivity (0.23 S m<sup>-</sup> <sup>1</sup>) enabled high-fidelity surface electromyography (sEMG) sensing. Leveraging these multifunctional hydrogels, we developed a multimodal sign language recognition system consisting of a pair of digital gloves, each embedded with 12 strain sensors and 5 pressure sensors, together with a flexible armband integrated with a 10-channel differential sEMG electrode array. Coupled with a bidirectional long short-term memory (Bi-LSTM) multimodal fusion model, the system achieved a classification accuracy of 99.65% across 24 Chinese sign language gestures.
Authors
- Qun-Ye Zhang
- Zhuhui Yin
- Hongjie Jiang (ORCID: https://orcid.org/0000-0002-6756-704X)
- Longya Xiao (ORCID: https://orcid.org/0009-0004-2010-2183)
- Quan Hu (ORCID: https://orcid.org/0000-0003-3328-7856)
- Peiqi Zhang (ORCID: https://orcid.org/0009-0009-1286-4328)
- Xinglin Qin
- Yuling Wang
- Xian Li
- Guangsen Liu
Institutions
- Sun Yat-sen University (CN)
- Sixth Affiliated Hospital of Sun Yat-sen University (CN)
- Guangdong Polytechnic Normal University (CN)
- Guangdong Provincial Center for Disease Control and Prevention (CN)
- Guangdong Provincial People's Hospital (CN)
- South China University of Technology (CN)
Publication Details
- Journal
- Advanced Science
- Published
- 2026-01-20
- DOI
- https://doi.org/10.1002/advs.202520586
- Primary Topic
- Advanced Sensor and Energy Harvesting Materials
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China