AI-driven hand signs and face feel recognition system

With the growing need for intelligent human-computer interaction systems, recognizing human emotions and interpreting sign language have become essential components in bridging communication gaps.This research presents a unified deep learning-based system that integrates both facial emotion recognition and sign language translation.The proposed model utilizes pre-trained VGG16 and VGG19 architectures to extract high-level spatial features from facial images and sign language gestures.For facial emotion recognition, the FER2013 dataset is used, and real-time emotion prediction is achieved using live webcam input.In parallel, sign language gestures are interpreted using the American Sign Language (ASL) dataset, where the temporal dynamics are captured and processed.The extracted features are used to train classifiers to enhance recognition accuracy.Experimental evaluations demonstrate the effectiveness of the combined approach, showing promising performance in accurately detecting emotions and translating sign gestures.This integrated system offers a valuable tool for enhancing communication, especially for individuals with speech impairments and in emotionally aware interactive systems.

Publication Details

Journal
IARJSET
Published
2025-04-29
DOI
https://doi.org/10.17148/iarjset.2025.12467
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-driven hand signs and face feel recognition system

IARJSET
Hand Gesture Recognition Systems
article

AI-driven hand signs and face feel recognition system

article en

Abstract

With the growing need for intelligent human-computer interaction systems, recognizing human emotions and interpreting sign language have become essential components in bridging communication gaps.This research presents a unified deep learning-based system that integrates both facial emotion recognition and sign language translation.The proposed model utilizes pre-trained VGG16 and VGG19 architectures to extract high-level spatial features from facial images and sign language gestures.For facial emotion recognition, the FER2013 dataset is used, and real-time emotion prediction is achieved using live webcam input.In parallel, sign language gestures are interpreted using the American Sign Language (ASL) dataset, where the temporal dynamics are captured and processed.The extracted features are used to train classifiers to enhance recognition accuracy.Experimental evaluations demonstrate the effectiveness of the combined approach, showing promising performance in accurately detecting emotions and translating sign gestures.This integrated system offers a valuable tool for enhancing communication, especially for individuals with speech impairments and in emotionally aware interactive systems.

IARJSETVol. 12(4)
Gender equality
Openalex Percentile: Top 92%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.