Deteksi Objek Boneka Korban pada Kontes Robot SAR Indonesia Menggunakan ESP32-cam

The 2024 Indonesian SAR Robot Contest demands the ability of robots to differentiate between dummy dolls and victim dolls in emergency situations. This SAR robot has the main goal of rescuing victims and bringing them to a safe zone, so the author explores the implementation of object detection on SAR robots using ESP32-cam to detect victim dolls. The authors used the Edge Impulse platform, a TinyML platform, to train an object detection model using the Faster Objects, More Objects (FOMO) architecture. This model is optimized to run efficiently on resource-limited devices such as the ESP32-cam microcontroller. Training data was obtained by taking pictures of dummy dolls and victim dolls in various angles, lighting conditions and backgrounds using a camera from the ESP32-cam. The confusion matrix results from the model training process showed that the F1 score reached 100% and when testing the model, the object detection model was able to detect the victim doll with adequate accuracy, even though there were challenges such as variations in position and environmental conditions so the researchers used additional algorithms to increase detection accuracy. . The use of FOMO allows faster object detection and is able to detect more objects in one frame. This implementation shows great potential in the development of more efficient and autonomous SAR robots for rescue missions. These findings contribute to improving robotic technology, one of which is in SAR operations and provide a basis for further research in the application of object detection.

Authors

Institutions

Publication Details

Journal
Building of Informatics Technology and Science (BITS)
Published
2024-12-30
DOI
https://doi.org/10.47065/bits.v6i3.5979
Primary Topic
Industrial Automation and Control Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deteksi Objek Boneka Korban pada Kontes Robot SAR Indonesia Menggunakan ESP32-cam

Yovi Pratama, M Irwan Bustami, Arahmad Taupiq
Building of Informatics Technology and Science (BITS)
Industrial Automation and Control Systems
article

Deteksi Objek Boneka Korban pada Kontes Robot SAR Indonesia Menggunakan ESP32-cam

Yovi Pratama, M Irwan Bustami, Arahmad Taupiq
article en

Abstract

The 2024 Indonesian SAR Robot Contest demands the ability of robots to differentiate between dummy dolls and victim dolls in emergency situations. This SAR robot has the main goal of rescuing victims and bringing them to a safe zone, so the author explores the implementation of object detection on SAR robots using ESP32-cam to detect victim dolls. The authors used the Edge Impulse platform, a TinyML platform, to train an object detection model using the Faster Objects, More Objects (FOMO) architecture. This model is optimized to run efficiently on resource-limited devices such as the ESP32-cam microcontroller. Training data was obtained by taking pictures of dummy dolls and victim dolls in various angles, lighting conditions and backgrounds using a camera from the ESP32-cam. The confusion matrix results from the model training process showed that the F1 score reached 100% and when testing the model, the object detection model was able to detect the victim doll with adequate accuracy, even though there were challenges such as variations in position and environmental conditions so the researchers used additional algorithms to increase detection accuracy. . The use of FOMO allows faster object detection and is able to detect more objects in one frame. This implementation shows great potential in the development of more efficient and autonomous SAR robots for rescue missions. These findings contribute to improving robotic technology, one of which is in SAR operations and provide a basis for further research in the application of object detection.

Building of Informatics Technology and Science (BITS)Vol. 6(3)
Universitas Nusa Bangsa (ID)
Openalex Percentile: Top 63%
Industrial Automation and Control Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.