An Innovative Crack Detection Algorithm Based on Efficient Feature Fusion and Progressive Transfer Learning

Detecting cracks is a crucial task to ensure the safety of engineering. However, the complexity of the crack background and the highly uneven pixel ratio between the crack and the background significantly limit the effectiveness of detection algorithms. Therefore, an efficient and innovative algorithm for crack detection is proposed, which utilizes a transformer and a multilevel cross-scale weighted feature fusion module, as well as a progressive transfer learning (TL) strategy. Firstly, in terms of existing algorithms, there are limitations in terms of high leakage and false detection rates, as well as a lack of generalization ability, therefore, a F2N-CrackNet model is proposed, which consists of two efficient feature fusion modules and a Nested Multi-level Attention with Atrous Spatial Pyramid Pooling (NMA-ASPP). Secondly, to tackle sparse and unevenly distributed bridge crack data, enhance model detection capabilities, and expedite convergence, a progressive three-stage hybrid TL strategy incorporating across-domain, inter-domain, and inner-domain transferring is proposed, by migrating knowledge from related domains. Finally, to enrich experimental data supporting and validating the proposed model and the transfer learning approach, a new group of experimental data set is offered, comprising hundreds of high-resolution bridge crack images collecting in Shanghai by using a digital camera. Additionally, an efficient human-computer interactive labeling approach combined with morphological processing is devised. Experiments conducted on both open-source and private datasets reveal substantial performance improvements in crack detection achieved by the proposed model and TL strategy. On private data, the model achieves an 81.28% MIoU, exceeding or approaching the performance of state-of-the-art (SOTA) methods, while simultaneously reducing training time by 5–8 seconds per round compared to SOTA. Meanwhile, the performance on multiple sets of open-source data is similarly elevated.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Intelligent Transportation Systems
Published
2024-10-16
DOI
https://doi.org/10.1109/tits.2024.3474704
Citations
3
Primary Topic
Infrastructure Maintenance and Monitoring
Type
article
Field-Weighted Citation Impact
0.78

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Innovative Crack Detection Algorithm Based on Efficient Feature Fusion and Progressive Transfer Learning

J. Y. Shi, Yi Wen, Shuguang Zhao, Xiaochen Lu et al.
3 citations
IEEE Transactions on Intelligent Transportation Systems
Infrastructure Maintenance and Monitoring
0.78
article

An Innovative Crack Detection Algorithm Based on Efficient Feature Fusion and Progressive Transfer Learning

J. Y. Shi, Yi Wen, Shuguang Zhao, Xiaochen Lu, Zihao Jiang
article en
3 citations

Abstract

Detecting cracks is a crucial task to ensure the safety of engineering. However, the complexity of the crack background and the highly uneven pixel ratio between the crack and the background significantly limit the effectiveness of detection algorithms. Therefore, an efficient and innovative algorithm for crack detection is proposed, which utilizes a transformer and a multilevel cross-scale weighted feature fusion module, as well as a progressive transfer learning (TL) strategy. Firstly, in terms of existing algorithms, there are limitations in terms of high leakage and false detection rates, as well as a lack of generalization ability, therefore, a F2N-CrackNet model is proposed, which consists of two efficient feature fusion modules and a Nested Multi-level Attention with Atrous Spatial Pyramid Pooling (NMA-ASPP). Secondly, to tackle sparse and unevenly distributed bridge crack data, enhance model detection capabilities, and expedite convergence, a progressive three-stage hybrid TL strategy incorporating across-domain, inter-domain, and inner-domain transferring is proposed, by migrating knowledge from related domains. Finally, to enrich experimental data supporting and validating the proposed model and the transfer learning approach, a new group of experimental data set is offered, comprising hundreds of high-resolution bridge crack images collecting in Shanghai by using a digital camera. Additionally, an efficient human-computer interactive labeling approach combined with morphological processing is devised. Experiments conducted on both open-source and private datasets reveal substantial performance improvements in crack detection achieved by the proposed model and TL strategy. On private data, the model achieves an 81.28% MIoU, exceeding or approaching the performance of state-of-the-art (SOTA) methods, while simultaneously reducing training time by 5–8 seconds per round compared to SOTA. Meanwhile, the performance on multiple sets of open-source data is similarly elevated.

IEEE Transactions on Intelligent Transportation SystemsVol. 25(12)
Donghua University (CN), Wind Power Engineering (Japan) (JP)
Fundamental Research Funds for the Central Universities
Openalex Percentile: Top 30%
Infrastructure Maintenance and Monitoring
0.78
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.