Performance Evaluation of an Object Detection Model Using Drone Imagery in Urban Areas for Semi-Automatic Artificial Intelligence Dataset Construction

Modern image processing technologies, such as deep learning techniques, are increasingly used to detect changes in various image media (e.g., CCTV and satellite) and understand their social and scientific significance. Drone-based traffic monitoring involves the detection and classification of moving objects within a city using deep learning-based models, which requires extensive training data. Therefore, the creation of training data consumes a significant portion of the resources required to develop these models, which is a major obstacle in artificial intelligence (AI)-based urban environment management. In this study, a performance evaluation method for semi-moving object detection is proposed using an existing AI-based object detection model, which is used to construct AI training datasets. The tasks to refine the results of AI-model-based object detection are analyzed, and an efficient evaluation method is proposed for the semi-automatic construction of AI training data. Different F_Beta scores are tested as metrics for performance evaluation, and it is found that the F₂ score could improve the completeness of the dataset with 26.5% less effort compared to the F_0.5 score and 7.1% less effort compared to the F1 score. Resource requirements for future AI model development can be reduced, enabling the efficient creation of AI training data.