VLCIM: A Vision-Language Cyclic Interaction Model for Industrial Defect Detection
Accurate defect detection is an important element in ensuring product quality and safe equipment operation. However, due to the lack of deep cross-modal interactions during vision feature extraction, existing methods often suffer from attention bias, which ultimately limits detection accuracy. To address this issue, this paper proposes a Vision-Language Cyclic Interaction Model (VLCIM), which progressively optimizes vision feature extraction by integrating domain prior knowledge and generic large model, effectively bridging the dual-domain barrier between “generic-specific” and “vision-language”. Specifically, progressive cyclic interaction learning is proposed for the first time, which integrates a recursive guidance module (RGM) and cross-modal interaction (CMI) strategy to realize bidirectional dynamic fusion and collaborative optimization of vision and language features. Furthermore, the proposed dual-view synergistic detection mechanism enhances discriminative decision responses, significantly improving the model’s boundary perception ability and decision-making accuracy in complex scenarios. VLCIM achieves high-precision defect detection by establishing a cyclic interaction mechanism between domain-specific language features and vision representations. Experimental results on three industrial datasets demonstrate that VLCIM achieves improvements of 5.9%, 5.6%, and 4.1% in mIoU over the state-of-the-art (SOTA) methods, indicating its validity and generalization in different scenarios.
Authors
- Yushan Ma
- Xiangkai Shen (ORCID: https://orcid.org/0000-0003-3164-2156)
- Yan Shi (ORCID: https://orcid.org/0000-0002-9390-2163)
- Lei Li (ORCID: https://orcid.org/0000-0001-8982-8063)
- Shaofeng Xu (ORCID: https://orcid.org/0000-0003-3535-8742)
- Jinhai Liu (ORCID: https://orcid.org/0000-0002-1256-1337)
- Zhiming Yang (ORCID: https://orcid.org/0009-0009-2154-8343)
Institutions
- State Key Laboratory of Synthetical Automation for Process Industries
- Beihang University (CN)
Publication Details
- Journal
- IEEE Transactions on Instrumentation and Measurement
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tim.2025.3583364
- Citations
- 40
- Primary Topic
- Industrial Vision Systems and Defect Detection
- Type
- article
- Field-Weighted Citation Impact
- 49.70
Funders
- National Key Research and Development Program of China