Sign Language Recognition in Real-Time: A Deep Learning Framework for Human-Computer Interaction

Sign language serves as a vital means of communication for individuals who are deaf, hard of hearing, or unable to speak verbally, enabling them to connect with the world through a structured system of visual and manual gestures. This project addresses the challenge of real-time sign language recognition. A custom dataset was created featuring 11 specific gestures representing commonly used symbols, captured using a webcam. The system processes these gestures in real-time, instantly displaying their corresponding letters on a screen. This initiative, rooted in human-computer interaction (HCI), focuses on enabling seamless communication through real-time hand gesture interpretation. The primary objective of this research is to analyze multiple deep learning models, including the Pre-Trained SSD MobileNet V2 architecture, Convolutional Neural Networks (CNNs), Hybrid models, and YOLO, to determine the most effective model for sign language recognition

Authors

Publication Details

Journal
Journal of Information Systems Engineering & Management
Published
2025-05-07
DOI
https://doi.org/10.52783/jisem.v10i44s.8609
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sign Language Recognition in Real-Time: A Deep Learning Framework for Human-Computer Interaction

L Madhan
Journal of Information Systems Engineering & Management
Hand Gesture Recognition Systems
article

Sign Language Recognition in Real-Time: A Deep Learning Framework for Human-Computer Interaction

L Madhan
article en

Abstract

Sign language serves as a vital means of communication for individuals who are deaf, hard of hearing, or unable to speak verbally, enabling them to connect with the world through a structured system of visual and manual gestures. This project addresses the challenge of real-time sign language recognition. A custom dataset was created featuring 11 specific gestures representing commonly used symbols, captured using a webcam. The system processes these gestures in real-time, instantly displaying their corresponding letters on a screen. This initiative, rooted in human-computer interaction (HCI), focuses on enabling seamless communication through real-time hand gesture interpretation. The primary objective of this research is to analyze multiple deep learning models, including the Pre-Trained SSD MobileNet V2 architecture, Convolutional Neural Networks (CNNs), Hybrid models, and YOLO, to determine the most effective model for sign language recognition

Journal of Information Systems Engineering & ManagementVol. 10(44s)
Openalex Percentile: Top 91%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.