TinyML pipeline for efficient crack classification in UAV-based structural health inspections
Structural health monitoring (SHM) of civil, aerospace, and energy infrastructure increasingly relies on UAVs with vision sensors for efficient inspections. Crack classification is a central task, yet cloud-based inference introduces bandwidth, power, connectivity, and privacy challenges that limit its practicality. This study presents a fully self-contained Tiny Machine Learning (TinyML) pipeline for onboard crack classification on a milliwatt-level STM32H7 microcontroller. Using MobileNetV1x0.25 as the baseline, we systematically evaluate the full measurement pipeline, including image capture, preprocessing, and inference on a low-power embedded system. Two preprocessing strategies, a handcrafted sequence (grayscale, contrast, denoise, median, binarization) and a greedy algorithm-based composite method, are compared. Four compression techniques, namely post-training quantization (PTQ), quantization-aware training (QAT), pruning, and weight clustering, are assessed individually and in combination. The optimized pipeline achieves an F1-score of 0.938, an improvement of 11.4% over state-of-the-art deployments. At the same time, it requires only 2.9 MB RAM and 309 KB flash, with an end-to-end latency of 461.6 ms and an energy cost of 623.16 mJ per inference. On a DJI Mini 4 Pro UAV, continuous operation reduces flight time by just 1.31 minutes (4%), compared to 8 minutes (24%) when using Jetson-based platforms. Overall, this work delivers a reproducible benchmark for UAV-based SHM, demonstrating a practical balance of accuracy, resource efficiency, and energy consumption, and advancing the feasibility of on-device crack classification in highly resource-constrained environments.
Authors
- Bengt Oelmann (ORCID: https://orcid.org/0000-0001-9572-3639)
- Arne Nürnberg
- Quynh Nguyen Phuong Vu (ORCID: https://orcid.org/0009-0005-6783-3650)
- Yuchen Lu
- Yuxuan Zhang
- Luciano Sebastian Martinez Rau
- Sebastian Bader
Institutions
- Consejo Nacional de Investigaciones Científicas y Técnicas (AR)
- Harbin Engineering University (CN)
- Yantai University (CN)
- Centro de Investigación de Métodos Computacionales (AR)
- Beijing University of Agriculture (CN)
- Mid Sweden University (SE)
Publication Details
- Journal
- Scientific Reports
- Published
- 2026-03-12
- DOI
- https://doi.org/10.1038/s41598-026-43534-4
- Primary Topic
- Infrastructure Maintenance and Monitoring
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Mittuniversitetet
- Nanjing Institute of Industry Technology