Real Time English to British Sign Language Translation for Accessible Banking

This paper presents a mobile-based framework for real-time English text-to-British Sign Language (BSL) translation, designed for accessible banking. The system uses a linguistically informed transformer model to translate English sentences into BSL gloss sequences, which are then converted into HamNoSys for avatar animation. The framework is optimized for handheld devices, enabling applications like bank notifications for the Deaf community. To support experimentation, an English-BSL parallel dataset was created, covering multiple domains. The proposed model achieved a 87.31% ROUGE-L score for text-to-gloss translation, demonstrating its effectiveness across domains. The system outputs were subjected to a user-based evaluation with BSL experts, providing valuable qualitative insights.

Authors

Institutions

Publication Details

Published
2025-03-17
DOI
https://doi.org/10.1109/percomworkshops65533.2025.00136
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Real Time English to British Sign Language Translation for Accessible Banking

Manjira Sinha, Charudatta Jadhav, Tirthankar Dasgupta, Abhishek Bharadwaj Varanasi
Hand Gesture Recognition Systems
article

Real Time English to British Sign Language Translation for Accessible Banking

Manjira Sinha, Charudatta Jadhav, Tirthankar Dasgupta, Abhishek Bharadwaj Varanasi
article en

Abstract

This paper presents a mobile-based framework for real-time English text-to-British Sign Language (BSL) translation, designed for accessible banking. The system uses a linguistically informed transformer model to translate English sentences into BSL gloss sequences, which are then converted into HamNoSys for avatar animation. The framework is optimized for handheld devices, enabling applications like bank notifications for the Deaf community. To support experimentation, an English-BSL parallel dataset was created, covering multiple domains. The proposed model achieved a 87.31% ROUGE-L score for text-to-gloss translation, demonstrating its effectiveness across domains. The system outputs were subjected to a user-based evaluation with BSL experts, providing valuable qualitative insights.

Tennessee Cancer Specialists (US)
Openalex Percentile: Top 87%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Real Time English to British Sign Language Translation for Accessible Banking — Manjira Sinha, Charudatta Jadhav, et al. · (2025) | TGRS Research Map | TGRS