Continuous Sign Language Translation Using Deep Learning

This research focuses on developing an end-to-end deep learning framework for Continuous Sign Language Translation (CSL T), addressing the challenge of converting sign language videos into coherent textual output. Our approach integrates spatial and temporal feature extraction techniques to effectively capture hand movements and linguistic structures. Initially, a Convolutional Neural Network (CNN) extracts spatial features from video frames, while a Recurrent Neural Network (RNN) models temporal dependencies across consecutive frames. To enhance translation fluency, we incorporate a Transformer-based Neural Machine Translation (NMT) model, improving the conversion of sign glosses into natural language.

Authors

Institutions

Publication Details

Published
2025-06-05
DOI
https://doi.org/10.1109/icetea64585.2025.11099750
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Continuous Sign Language Translation Using Deep Learning

G. Balamurugan, U Karthikeyan, S. Dhamodaran, J Jagathguru
Hand Gesture Recognition Systems
article

Continuous Sign Language Translation Using Deep Learning

G. Balamurugan, U Karthikeyan, S. Dhamodaran, J Jagathguru
article en

Abstract

This research focuses on developing an end-to-end deep learning framework for Continuous Sign Language Translation (CSL T), addressing the challenge of converting sign language videos into coherent textual output. Our approach integrates spatial and temporal feature extraction techniques to effectively capture hand movements and linguistic structures. Initially, a Convolutional Neural Network (CNN) extracts spatial features from video frames, while a Recurrent Neural Network (RNN) models temporal dependencies across consecutive frames. To enhance translation fluency, we incorporate a Transformer-based Neural Machine Translation (NMT) model, improving the conversion of sign glosses into natural language.

SRM Institute of Science and Technology (IN)
Quality Education
Openalex Percentile: Top 80%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.