SignMeet AI: Real-Time Sign Language Translation for Inclusive Video Communication
This paper reviews recent work on webcam-based sign language recognition and proposes SignMeet AI, a browserbased meeting prototype aimed at some of the gaps in that work. Calls run peer to peer over Web Real-Time Communication (WebRTC) and PeerJS. MediaPipe Hands extracts 21 hand landmarks from each webcam frame, a machine-learning (ML) classifier maps them to American Sign Language (ASL) gestures, and a temporal stability filter (a confidence threshold, a fiveframe consistency check and debouncing) keeps flickering predictions out of the output. Spoken words are transcribed in parallel, and Django Channels merges both streams into one timestamped transcript for everyone in the room. A meeting starts from a room ID, with no account needed. In sample tests, the stability filter cut unwanted predictions from 18 to 6 and repeated characters from 24 to 8 per session. Overall recognition accuracy was 87%, and text appeared after about 320 ms for signs and 342 ms for speech. These numbers come from a small prototype evaluation and should be read as indicative. The vocabulary is limited to static ASL gestures. Continuous signing, Indian Sign Language and a user study with signers remain future work
Authors
- Anam Inamdar
- Om Gore
- Deepika Sarwate
Institutions
- Savitribai Phule Pune University (IN)
Publication Details
- Journal
- International Journal for Research in Applied Science and Engineering Technology
- Published
- 2026-11-16
- DOI
- https://doi.org/10.22214/ijraset.2026.85697
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00