Continuous Sign Language Translation Using Deep Learning
This research focuses on developing an end-to-end deep learning framework for Continuous Sign Language Translation (CSL T), addressing the challenge of converting sign language videos into coherent textual output. Our approach integrates spatial and temporal feature extraction techniques to effectively capture hand movements and linguistic structures. Initially, a Convolutional Neural Network (CNN) extracts spatial features from video frames, while a Recurrent Neural Network (RNN) models temporal dependencies across consecutive frames. To enhance translation fluency, we incorporate a Transformer-based Neural Machine Translation (NMT) model, improving the conversion of sign glosses into natural language.
Authors
- G. Balamurugan
- U Karthikeyan
- S. Dhamodaran (ORCID: https://orcid.org/0000-0001-5852-610X)
- J Jagathguru
Institutions
- SRM Institute of Science and Technology (IN)
Publication Details
- Published
- 2025-06-05
- DOI
- https://doi.org/10.1109/icetea64585.2025.11099750
- Primary Topic
- Hand Gesture Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00