BAUST Lipi: A BdSL Dataset with Deep Learning Based Bangla Sign Language Recognition

People commonly communicate in English, Arabic, and Bengali spoken languages through various mediums.However, deaf and hard-of-hearing individuals primarily use body language and sign language to express their needs and achieve independence.Sign language research is burgeoning to enhance communication with the deaf community.While many researchers have made strides in recognizing sign languages such as French, British, Arabic, Turkish, and American, there has been limited research on Bangla sign language (BdSL) with less-than-satisfactory results.One significant barrier has been the lack of a comprehensive Bangla sign language dataset.In our work, we introduced a new BdSL dataset comprising alphabets totaling 18,000 images, with each image being 224x224 pixels in size.Our dataset encompasses 36 Bengali symbols, of which 30 are consonants and the remaining six are vowels.Despite our dataset contribution, many existing systems continue to grapple with achieving high-performance accuracy for BdSL.To address this, we devised a hybrid Convolutional Neural Network (CNN) model, integrating multiple convolutional layers, activation functions, dropout techniques, and LSTM layers.Upon evaluating our hybrid-CNN model with the newly created BdSL dataset, we achieved an accuracy rate of 97.92%.We are confident that both our BdSL dataset and hybrid CNN model will be recognized as significant milestones in BdSL research.

Authors

Institutions

Publication Details

Published
2024-10-17
DOI
https://doi.org/10.1145/3723178.3723215
Citations
5
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
1.86
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

BAUST Lipi: A BdSL Dataset with Deep Learning Based Bangla Sign Language Recognition

Jungpil Shin, Abu Saleh Musa Miah, Mohammed Ali, A. Shafi et al.
5 citations
Hand Gesture Recognition Systems
1.86
article

BAUST Lipi: A BdSL Dataset with Deep Learning Based Bangla Sign Language Recognition

Jungpil Shin, Abu Saleh Musa Miah, Mohammed Ali, A. Shafi, Md Hadiuzzaman
article en
5 citations

Abstract

People commonly communicate in English, Arabic, and Bengali spoken languages through various mediums.However, deaf and hard-of-hearing individuals primarily use body language and sign language to express their needs and achieve independence.Sign language research is burgeoning to enhance communication with the deaf community.While many researchers have made strides in recognizing sign languages such as French, British, Arabic, Turkish, and American, there has been limited research on Bangla sign language (BdSL) with less-than-satisfactory results.One significant barrier has been the lack of a comprehensive Bangla sign language dataset.In our work, we introduced a new BdSL dataset comprising alphabets totaling 18,000 images, with each image being 224x224 pixels in size.Our dataset encompasses 36 Bengali symbols, of which 30 are consonants and the remaining six are vowels.Despite our dataset contribution, many existing systems continue to grapple with achieving high-performance accuracy for BdSL.To address this, we devised a hybrid Convolutional Neural Network (CNN) model, integrating multiple convolutional layers, activation functions, dropout techniques, and LSTM layers.Upon evaluating our hybrid-CNN model with the newly created BdSL dataset, we achieved an accuracy rate of 97.92%.We are confident that both our BdSL dataset and hybrid CNN model will be recognized as significant milestones in BdSL research.

University of Aizu (JP), Bangladesh University of Engineering and Technology (BD), Bangladesh Army University of Science and Technology
Quality Education
Openalex Percentile: Top 14%
Hand Gesture Recognition Systems
1.86
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.