Deep Learning-based Classification for Gesture Detection using Xception Model

Gesture language functions as a communication medium for individuals who are dumb and deaf, utilizing recognized signs or bodily movements to convey messages. It incorporates various elements such as shapes, hand motions, directions, and facial expressions. Each sign not only represents a word but also conveys a specific tone. For many deaf individuals, verbal communication is not feasible, and they may encounter difficulties in reading and writing. Thus, the creation of a sign language translation system, specifically a sign language recognition (SLR) system, holds significant importance in their lives. To address this challenge, we utilized the Xception Model. Our approach involved training the Xception Model using a dataset representing the ASL Alphabet, which comprises 24 classes corresponding to English sign language letters (excluding J and Z, which involve motion). The training dataset consisted of 27,455 instances, while the test dataset contained 7,172 instances. The results of our proposed model were highly promising, achieving an impressive accuracy rate of 99.9% with a validation accuracy of 100%. This success highlights the potential effectiveness of our model in automatically recognizing American Sign Language gestures, thus improving Interaction and accessibility for people with hearing impairments.

Authors

Institutions

Publication Details

Published
2024-10-04
DOI
https://doi.org/10.1109/mac61551.2024.10837394
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Learning-based Classification for Gesture Detection using Xception Model

Hamad Ali Abosaq, Basel A. Dabwan
Hand Gesture Recognition Systems
article

Deep Learning-based Classification for Gesture Detection using Xception Model

Hamad Ali Abosaq, Basel A. Dabwan
article en

Abstract

Gesture language functions as a communication medium for individuals who are dumb and deaf, utilizing recognized signs or bodily movements to convey messages. It incorporates various elements such as shapes, hand motions, directions, and facial expressions. Each sign not only represents a word but also conveys a specific tone. For many deaf individuals, verbal communication is not feasible, and they may encounter difficulties in reading and writing. Thus, the creation of a sign language translation system, specifically a sign language recognition (SLR) system, holds significant importance in their lives. To address this challenge, we utilized the Xception Model. Our approach involved training the Xception Model using a dataset representing the ASL Alphabet, which comprises 24 classes corresponding to English sign language letters (excluding J and Z, which involve motion). The training dataset consisted of 27,455 instances, while the test dataset contained 7,172 instances. The results of our proposed model were highly promising, achieving an impressive accuracy rate of 99.9% with a validation accuracy of 100%. This success highlights the potential effectiveness of our model in automatically recognizing American Sign Language gestures, thus improving Interaction and accessibility for people with hearing impairments.

Najran University (SA)
Openalex Percentile: Top 74%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Deep Learning-based Classification for Gesture Detection using Xception Model — Hamad Ali Abosaq, Basel A. Dabwan · (2024) | TGRS Research Map | TGRS