Automated Classification of Indonesian Candi Structures Using Advanced Machine Learning Models: YOLOv7, YOLOv8, and DeepSORT

Indonesia is a culturally rich country, with converging tradition and technology mainly through integrating AI and computer vision. This research investigates advanced deep learning models for the detection and tracking of Indonesian temple structures using the YOLOv7, YOLOv8, and DeepSORT methods. The models are trained and evaluated for their effectiveness in accurately identifying and classifying those very cultural landmarks, done on a unique dataset of temple images. The results indicate that both the YOLOv7 and YOLOv8 models performed very similarly with regard to precision, recall, accuracy, and the F1 score, thus proving that improvements to the architecture in YOLOv8 did not greatly improve this scenario. However, this was very effective when integrated into DeepSORT for the robust maintenance of consistent obj ect identification and tracking across video frames under changes in different conditions. Future work may be focused on training models with a more balanced dataset to mitigate class-based limitations and further experiments with other pre-trained models to improve the model's accuracy and application potential in real-world cultural heritage preservation.

Authors

Institutions

Publication Details

Published
2024-08-29
DOI
https://doi.org/10.1109/icitisee63424.2024.10730037
Primary Topic
Geological and Geophysical Studies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated Classification of Indonesian Candi Structures Using Advanced Machine Learning Models: YOLOv7, YOLOv8, and DeepSORT

Budi Juarto, William Geremia Abraham, Haickal Alfarizzi, Theofilus Adhi Septian et al.
Geological and Geophysical Studies
article

Automated Classification of Indonesian Candi Structures Using Advanced Machine Learning Models: YOLOv7, YOLOv8, and DeepSORT

Budi Juarto, William Geremia Abraham, Haickal Alfarizzi, Theofilus Adhi Septian, Vincentius Harikrisna Wyasaputra
article en

Abstract

Indonesia is a culturally rich country, with converging tradition and technology mainly through integrating AI and computer vision. This research investigates advanced deep learning models for the detection and tracking of Indonesian temple structures using the YOLOv7, YOLOv8, and DeepSORT methods. The models are trained and evaluated for their effectiveness in accurately identifying and classifying those very cultural landmarks, done on a unique dataset of temple images. The results indicate that both the YOLOv7 and YOLOv8 models performed very similarly with regard to precision, recall, accuracy, and the F1 score, thus proving that improvements to the architecture in YOLOv8 did not greatly improve this scenario. However, this was very effective when integrated into DeepSORT for the robust maintenance of consistent obj ect identification and tracking across video frames under changes in different conditions. Future work may be focused on training models with a more balanced dataset to mitigate class-based limitations and further experiments with other pre-trained models to improve the model's accuracy and application potential in real-world cultural heritage preservation.

Binus University (ID)
Openalex Percentile: Top 77%
Geological and Geophysical Studies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.