Application of Drone Images Analysis to Predict the Damage of Streets in HCMC

This study introduces a novel framework leveraging drone-based image analysis to improve urban street infrastructure management. With urbanization accelerating, effective street maintenance is critical for sustainable development. The study focuses on streets 6–8 meters wide and 1–20 years old, as defined by 22TCVN 4054-2005 standards. This study <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">aims</i> to develop an integrated analytical framework for urban street infrastructure management, combining drone-based image analysis, ML predictive modeling, and financial assessment. The <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">purpose</i> is to enhance decision-making for street maintenance and sustainability through the application of advanced technologies. The <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">methodology</i> involves three key phases: (1) collecting drone images of urban streets and developing a deep learning classifier to assess street conditions; (2) constructing a Markov model to predict street longevity and usage based on classified data; and (3) creating a financial model to estimate maintenance and reconstruction costs. These three models are designed to work in unison, forming a comprehensive system that transitions seamlessly through condition assessment, prediction, and cost estimation. Using a combined dataset of nearly 2,000 images from Ho Chi Minh City (HCMC) and the public RSXD dataset, deep learning classifiers were trained to evaluate road conditions. Outputs are then fed into a Markov model for usage and lifespan predictions, alongside financial projections for maintenance or reconstruction. The <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">findings</i> reveal a critical disparity in performance: while the models achieved moderate success in assessing the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">damage severity level</i>, they failed to generalize for the more complex task of classifying the specific <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">damage type</i>, where validation accuracies were low despite high training accuracies. The framework features a Markov model that effectively predicts street longevity, and a cost model aiding financial planning. The framework demonstrates robust performance metrics, validating its applicability in urban street management. This study’s <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">originality</i> lies in its integration of advanced vision recognition, predictive modeling, and cost analysis for infrastructure planning. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Limitations</i> include a restricted geographical scope and reliance on specific street dimensions. Future research should extend the approach to broader contexts and refine the models for diverse urban conditions.