An AI-driven, wearable, conformal ring system for real-time and user-independent sign language interpretation
Sign language translation systems have long aimed to bridge the communication between signers and nonsigners. However, preliminary systems rely on glove-type wearables or wired sensor arrays, which constrain hand movement, reduce comfort, and require nonpersonalized sensor positions that limit adaptability across users. Here, we introduce a wirelessly connected, ring-type sign language translator (WRSLT) designed to overcome these limitations by enabling full finger mobility through independent sensor rings and multilink communication. The system supports static and dynamic gesture detection using selected fingers via quantitative relevance analysis and achieves robust user-independent performance without per-user calibration. WRSLT demonstrated high recognition accuracy on large-scale datasets comprising 100 American Sign Language and 100 International Sign Language words, achieving 88.3 and 88.5% accuracy, respectively, under unseen-user conditions (i.e., test users not included in model training). Furthermore, a custom sequential word detection framework enables sentence-level translation from continuous signing input without requiring separate training on entire sentence structures.
Authors
- Ki Jun Yu (ORCID: https://orcid.org/0000-0002-2922-2702)
- T Kim
- Yejee Shin (ORCID: https://orcid.org/0009-0008-0678-6354)
- Doyun Kim (ORCID: https://orcid.org/0009-0007-0378-9448)
- Yeonsik Choi (ORCID: https://orcid.org/0000-0003-2438-2712)
- 백준형
- Yunkyu Park (ORCID: https://orcid.org/0000-0002-9217-2023)
- In Sik Min (ORCID: https://orcid.org/0009-0003-0314-4915)
- Kyubeen Kim (ORCID: https://orcid.org/0000-0002-7425-2871)
- Sang Hoon Park (ORCID: https://orcid.org/0000-0002-9085-6667)
- Byunghwan Jeon (ORCID: https://orcid.org/0000-0002-0414-1762)
- Jongyoo Kim (ORCID: https://orcid.org/0000-0002-2435-9195)
- Young Uk Cho (ORCID: https://orcid.org/0000-0003-2578-5177)
- Kyowon Kang (ORCID: https://orcid.org/0000-0002-6892-3069)
- D K Hwang
- Yeeun Lee (ORCID: https://orcid.org/0000-0002-8740-7529)
- J Hong
- Jiwon Lee
- Jaejin Park
- Sunho Park
Institutions
- Georgia Institute of Technology (US)
- Incheon National University (KR)
- Yonsei University (KR)
- Washington University in St. Louis (US)
- Korean Association Of Science and Technology Studies (KR)
- Yonsei University College of Dentistry
- University of Virginia (US)
- Ajou University (KR)
- Korea Institute of Science and Technology (KR)
- Hankuk University of Foreign Studies (KR)
Publication Details
- Journal
- Science Advances
- Published
- 2026-05-01
- DOI
- https://doi.org/10.1126/sciadv.aec8995
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Research Foundation of Korea