Skewed Pins Detection of Aviation Connectors Based on Multi-Modal Cooperative Perception

Aviation electrical connectors are critically important components in electrical wiring interconnection systems. Currently, connector defect detection relies entirely on manual inspection, which is error-prone and time-consuming. Due to the unique structural characteristics of aviation connectors, single-modality sensors often struggle to simultaneously detect both pins and holes. To address this issue, we propose a 3D skewed pins detection (3D-SPD) algorithm that integrates both 2D and 3D modals features. Due to the low quality of the raw connector data, we propose a connector point cloud enhancement (CPCE) algorithm that combines multi-view point clouds for point cloud fusion enhancement. Based on enhanced data, we perform skewed pin detection. Experimental results indicate that CPCE and 3D-SPD are effective in detecting skewed pins, achieving an accuracy rate exceeding 99%. Our algorithm can be deployed as an AI assistant on the edge device for the skewed pin detection.