Recognitions of Bahasa Isyarat Indonesia (BISINDO) Alphabets Using SVM and Mediapipe

Bahasa Isyarat Indonesia (BISINDO), Indonesia's national sign language, serves as a primary mode of communication for a large portion of the population. This study explores a novel approach to BISINDO sign language recognition by leveraging Support Vector Machine (SVM) in conjunction with MediaPipe, a framework for real-time machine learning. MediaPipe has demonstrated strong performance on other datasets, and in this application, it extracts features from hand gesture images that are then classified by the SVM algorithm. Our model achieved an impressive average accuracy score of 98.82%, with an average precision of 97.34%, recall of 99.00%, and F1-score of 97.76%. In comparison to previous studies using HMM (which achieved an accuracy of 76.25%) and CNN (with an accuracy of 75.83%), our model demonstrates a significant improvement in recognizing BISINDO. Our model offers several distinct advantages. MediaPipe's robust feature extraction capabilities are particularly well-suited to capturing complex hand movements, allowing SVM to focus on high-quality input features that enhance classification accuracy. Unlike deep learning models such as CNN, which require substantial computational resources, our model remains lightweight and efficient, making it ideal for deployment on mobile and low-resource devices. This efficiency ensures that BISINDO recognition can be achieved in real-time and in practical applications, enabling a more accessible and reliable communication tool for the BISINDO-used community.

Authors

Institutions

Publication Details

Published
2024-11-29
DOI
https://doi.org/10.1109/icoris63540.2024.10903898
Citations
1
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.35
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Recognitions of Bahasa Isyarat Indonesia (BISINDO) Alphabets Using SVM and Mediapipe

Meiliana Meiliana, Alfi Yusrotis Zakiyyah, Robert Wiliam, Charlie Lufian
1 citations
Natural Language Processing Techniques
0.35
article

Recognitions of Bahasa Isyarat Indonesia (BISINDO) Alphabets Using SVM and Mediapipe

Meiliana Meiliana, Alfi Yusrotis Zakiyyah, Robert Wiliam, Charlie Lufian
article en
1 citations

Abstract

Bahasa Isyarat Indonesia (BISINDO), Indonesia's national sign language, serves as a primary mode of communication for a large portion of the population. This study explores a novel approach to BISINDO sign language recognition by leveraging Support Vector Machine (SVM) in conjunction with MediaPipe, a framework for real-time machine learning. MediaPipe has demonstrated strong performance on other datasets, and in this application, it extracts features from hand gesture images that are then classified by the SVM algorithm. Our model achieved an impressive average accuracy score of 98.82%, with an average precision of 97.34%, recall of 99.00%, and F1-score of 97.76%. In comparison to previous studies using HMM (which achieved an accuracy of 76.25%) and CNN (with an accuracy of 75.83%), our model demonstrates a significant improvement in recognizing BISINDO. Our model offers several distinct advantages. MediaPipe's robust feature extraction capabilities are particularly well-suited to capturing complex hand movements, allowing SVM to focus on high-quality input features that enhance classification accuracy. Unlike deep learning models such as CNN, which require substantial computational resources, our model remains lightweight and efficient, making it ideal for deployment on mobile and low-resource devices. This efficiency ensures that BISINDO recognition can be achieved in real-time and in practical applications, enabling a more accessible and reliable communication tool for the BISINDO-used community.

Binus University (ID)
Quality Education
Openalex Percentile: Top 29%
Natural Language Processing Techniques
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.