An Edge-AI System for Arabic Sign Language Detection Using YOLOv8m and Raspberry Pi 5

Language is fundamental to social interaction and communication, and assistive technologies can help reduce barriers between Deaf and hard-of-hearing individuals and hearing communities. This study presents a standalone edge-AI device based on Raspberry Pi 5 for detecting selected Arabic Sign Language (ArSL) gestures and displaying corresponding written text. The system integrates an autofocus camera, YOLO-based gesture detection, text buffering, and a 128 × 64 OLED display capable of presenting Arabic text. YOLOv5m, YOLOv8m, and YOLOv9m were compared as candidate detectors, and a custom dataset of 1881 images was developed for nine gesture classes and background examples. The dataset was partitioned by signer, with three signers used for training, one for validation, and one held out for testing. Across three YOLOv8m training runs, the mean [email protected] was 0.9583. On Raspberry Pi 5, the completed pipeline achieved a measured throughput of 3.52 frames per second (FPS). Live-camera experiments assessed performance across distance, illumination, background, viewpoint, hand orientation, and signing speed, identifying conditions that most affected detection. The results demonstrate the feasibility of a self-contained, interactive edge system for detecting predefined ArSL gestures and displaying buffered text, providing a practical foundation for expanding the vocabulary and developing continuous-sign recognition.

Authors

Institutions

Publication Details

Journal
Future Internet
Published
2026-11-10
DOI
https://doi.org/10.3390/fi18110618
Primary Topic
Hand Gesture Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

An Edge-AI System for Arabic Sign Language Detection Using YOLOv8m and Raspberry Pi 5

Adnan Mohammad Salem Manasreh, Dinara Kassymova, Abdelrahman Radwan, Ala’a Alshubbak et al.
Future Internet
Hand Gesture Recognition Systems
article

An Edge-AI System for Arabic Sign Language Detection Using YOLOv8m and Raspberry Pi 5

Adnan Mohammad Salem Manasreh, Dinara Kassymova, Abdelrahman Radwan, Ala’a Alshubbak, Mohammad Khaleel Sallam Ma’aitah, Sama Armouti, Mohammad Hamdan, Salih Alwassiti
article en

Abstract

Language is fundamental to social interaction and communication, and assistive technologies can help reduce barriers between Deaf and hard-of-hearing individuals and hearing communities. This study presents a standalone edge-AI device based on Raspberry Pi 5 for detecting selected Arabic Sign Language (ArSL) gestures and displaying corresponding written text. The system integrates an autofocus camera, YOLO-based gesture detection, text buffering, and a 128 × 64 OLED display capable of presenting Arabic text. YOLOv5m, YOLOv8m, and YOLOv9m were compared as candidate detectors, and a custom dataset of 1881 images was developed for nine gesture classes and background examples. The dataset was partitioned by signer, with three signers used for training, one for validation, and one held out for testing. Across three YOLOv8m training runs, the mean [email protected] was 0.9583. On Raspberry Pi 5, the completed pipeline achieved a measured throughput of 3.52 frames per second (FPS). Live-camera experiments assessed performance across distance, illumination, background, viewpoint, hand orientation, and signing speed, identifying conditions that most affected detection. The results demonstrate the feasibility of a self-contained, interactive edge system for detecting predefined ArSL gestures and displaying buffered text, providing a practical foundation for expanding the vocabulary and developing continuous-sign recognition.

Future InternetVol. 18(11)
Applied Science Private University (JO), Mukhametzhan Tynyshbayev ALT University (KZ)
Hand Gesture Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon