Enhanced Defect Detection in Airport Runway Infrastructure Using Image-Text Pairing

Maintaining runway infrastructure is vital for air transport safety, with defects like cracks and tire marks posing significant risks to take-off and landing. Researchers have proposed various methods for automatic surface defect detection using computer vision and machine learning. However, they often require explicitly annotated datasets that demand significant workload and field expertise. Additionally, detection outcomes usually follow the low-level training labels scheme to describe the detected defects, requiring post-processing for high-level semantic information extraction such as damage severity. In this work, we present a novel method for defect detection and damage severity estimation on runway surfaces, leveraging the Contrastive Language-Image Pre-training (CLIP) architecture for imagetext pairing. Our model processes runway images and attaches text descriptions mentioning detected defects and severity level, identifying three defect types (crack, joint, and tire mark) and categorizing damage severity into three levels (low, medium, and high). Utilizing natural language annotations simplifies the labeling process, eliminating the need for labor-intensive lowlevel image-based annotations. The model exploits the natural language labels for direct estimation of damage severity and delivers high-level semantic information to the end-user as text, providing a comprehensive runway condition assessment tool. The proposed method demonstrates high performance across various test sets, posing a valuable human-centric approach for efficient defect detection and damage estimation on runway surfaces.