Sign Language Translator for SIBI

Deaf people face communication barriers and sign language is essential for them, especially in Indonesia. Indonesia has two main sign languages: BISINDO and SIBI. BISINDO is community developed, while SIBI is adapted from American Sign Language for standardization. In this study, we develop a gesture recognition system to translate SIBI using a convolutional neural network (CNN). Utilizing MobileNetV2, our model achieved over 99.7<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">%</sup> accuracy in controlled tests and over 99.9% accuracy on mobile devices. However, live camera tests revealed challenges with accuracy across different scripts. Further optimization is needed. This work advances SIBI sign language recognition and enhances communication tools for the deaf community in Indonesia.

Authors

Institutions

Publication Details

Published
2024-11-29
DOI
https://doi.org/10.1109/icoris63540.2024.10903922
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Sign Language Translator for SIBI

Muhammad Fadlan Hidayat, Irene Anindaputri Iswanto, Ezra Arya Wijaya, Samuel Benediktus Meliala
Hand Gesture Recognition Systems
article

Sign Language Translator for SIBI

Muhammad Fadlan Hidayat, Irene Anindaputri Iswanto, Ezra Arya Wijaya, Samuel Benediktus Meliala
article en

Abstract

Deaf people face communication barriers and sign language is essential for them, especially in Indonesia. Indonesia has two main sign languages: BISINDO and SIBI. BISINDO is community developed, while SIBI is adapted from American Sign Language for standardization. In this study, we develop a gesture recognition system to translate SIBI using a convolutional neural network (CNN). Utilizing MobileNetV2, our model achieved over 99.7<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">%</sup> accuracy in controlled tests and over 99.9% accuracy on mobile devices. However, live camera tests revealed challenges with accuracy across different scripts. Further optimization is needed. This work advances SIBI sign language recognition and enhances communication tools for the deaf community in Indonesia.

Binus University (ID)
Quality Education
Openalex Percentile: Top 72%
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Sign Language Translator for SIBI — Muhammad Fadlan Hidayat, Irene Anindaputri Iswanto, et al. · (2024) | TGRS Research Map | TGRS