MFF-SDD: A Bidirectional Guidance and Multiscale Multimodal Fusion Model for Small Defect Detection in Industrial Films

Detecting small defects in industrial biaxially oriented polypropylene (BOPP) films is challenging due to their limited visual cues, low contrast, and high similarity to background textures. Existing deep learning-based methods, which rely solely on visual data, often suffer from high miss rates and poor classification accuracy in such complex scenarios. To address these limitations, we propose the multimodal fusion-based film small defect detection (MFF-SDD) model, specifically designed for small defect detection in BOPP film production. Unlike conventional language-image models that neglect the bidirectional interaction between modalities, MFF-SDD introduces the bidirectional guidance multimodal cross-fusion module, which enhances visual–textual integration through mutual guidance and attention mechanisms, enabling more effective foreground focus and background suppression. Furthermore, the text and image cross-modality neighbors multiscale fusion module employs multiscale cross-modal fusion to preserve fine-grained details and exploit complementary features from both modalities, improving detection accuracy and reducing misclassification of small defects. We also present the film small defect (FSD) dataset, comprising 10 385 annotated bounding boxes across seven defect categories. Experimental results show that MFF-SDD surpasses state-of-the-art methods by 2.31% in average precision and 3.75% in recall on the FSD dataset and achieves leading performance on public benchmarks, such as PASCAL VOC and TinyPerson. These findings demonstrate the effectiveness and robustness of our approach in multimodal small defect detection. Our dataset and code will be made publicly available upon acceptance of this article for publication.

Institutions

Publication Details

Journal
IEEE Transactions on Industrial Informatics
Published
2025-09-25
DOI
https://doi.org/10.1109/tii.2025.3606880
Primary Topic
Library Science and Administration
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MFF-SDD: A Bidirectional Guidance and Multiscale Multimodal Fusion Model for Small Defect Detection in Industrial Films

IEEE Transactions on Industrial Informatics
Library Science and Administration
article

MFF-SDD: A Bidirectional Guidance and Multiscale Multimodal Fusion Model for Small Defect Detection in Industrial Films

article en

Abstract

Detecting small defects in industrial biaxially oriented polypropylene (BOPP) films is challenging due to their limited visual cues, low contrast, and high similarity to background textures. Existing deep learning-based methods, which rely solely on visual data, often suffer from high miss rates and poor classification accuracy in such complex scenarios. To address these limitations, we propose the multimodal fusion-based film small defect detection (MFF-SDD) model, specifically designed for small defect detection in BOPP film production. Unlike conventional language-image models that neglect the bidirectional interaction between modalities, MFF-SDD introduces the bidirectional guidance multimodal cross-fusion module, which enhances visual–textual integration through mutual guidance and attention mechanisms, enabling more effective foreground focus and background suppression. Furthermore, the text and image cross-modality neighbors multiscale fusion module employs multiscale cross-modal fusion to preserve fine-grained details and exploit complementary features from both modalities, improving detection accuracy and reducing misclassification of small defects. We also present the film small defect (FSD) dataset, comprising 10 385 annotated bounding boxes across seven defect categories. Experimental results show that MFF-SDD surpasses state-of-the-art methods by 2.31% in average precision and 3.75% in recall on the FSD dataset and achieves leading performance on public benchmarks, such as PASCAL VOC and TinyPerson. These findings demonstrate the effectiveness and robustness of our approach in multimodal small defect detection. Our dataset and code will be made publicly available upon acceptance of this article for publication.

IEEE Transactions on Industrial InformaticsVol. 21(12)
Zhejiang Gongshang University (CN), Zhejiang University (CN)
Openalex Percentile: Top 52%
Library Science and Administration
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

MFF-SDD: A Bidirectional Guidance and Multiscale Multimodal Fusion Model for Small Defect Detection in Industrial Films · IEEE Transactions on Industrial Informatics (2025) | TGRS Research Map | TGRS