SignMeet AI: Real-Time Sign Language Translation for Inclusive Video Communication

This paper reviews recent work on webcam-based sign language recognition and proposes SignMeet AI, a browserbased meeting prototype aimed at some of the gaps in that work. Calls run peer to peer over Web Real-Time Communication (WebRTC) and PeerJS. MediaPipe Hands extracts 21 hand landmarks from each webcam frame, a machine-learning (ML) classifier maps them to American Sign Language (ASL) gestures, and a temporal stability filter (a confidence threshold, a fiveframe consistency check and debouncing) keeps flickering predictions out of the output. Spoken words are transcribed in parallel, and Django Channels merges both streams into one timestamped transcript for everyone in the room. A meeting starts from a room ID, with no account needed. In sample tests, the stability filter cut unwanted predictions from 18 to 6 and repeated characters from 24 to 8 per session. Overall recognition accuracy was 87%, and text appeared after about 320 ms for signs and 342 ms for speech. These numbers come from a small prototype evaluation and should be read as indicative. The vocabulary is limited to static ASL gestures. Continuous signing, Indian Sign Language and a user study with signers remain future work

Authors

Institutions

Publication Details

Journal
International Journal for Research in Applied Science and Engineering Technology
Published
2026-11-16
DOI
https://doi.org/10.22214/ijraset.2026.85697
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

SignMeet AI: Real-Time Sign Language Translation for Inclusive Video Communication

Anam Inamdar, Om Gore, Deepika Sarwate
1 links
International Journal for Research in Applied Science and Engineering Technology
Hand Gesture Recognition Systems
article

SignMeet AI: Real-Time Sign Language Translation for Inclusive Video Communication

Anam Inamdar, Om Gore, Deepika Sarwate
article en

Abstract

This paper reviews recent work on webcam-based sign language recognition and proposes SignMeet AI, a browserbased meeting prototype aimed at some of the gaps in that work. Calls run peer to peer over Web Real-Time Communication (WebRTC) and PeerJS. MediaPipe Hands extracts 21 hand landmarks from each webcam frame, a machine-learning (ML) classifier maps them to American Sign Language (ASL) gestures, and a temporal stability filter (a confidence threshold, a fiveframe consistency check and debouncing) keeps flickering predictions out of the output. Spoken words are transcribed in parallel, and Django Channels merges both streams into one timestamped transcript for everyone in the room. A meeting starts from a room ID, with no account needed. In sample tests, the stability filter cut unwanted predictions from 18 to 6 and repeated characters from 24 to 8 per session. Overall recognition accuracy was 87%, and text appeared after about 320 ms for signs and 342 ms for speech. These numbers come from a small prototype evaluation and should be read as indicative. The vocabulary is limited to static ASL gestures. Continuous signing, Indian Sign Language and a user study with signers remain future work

International Journal for Research in Applied Science and Engineering TechnologyVol. 14(11)
Savitribai Phule Pune University (IN)
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon