Dbrm-net: a dual-branch residual multimodal framework for intelligent visual inspection of insulator anomalies
Fine-grained insulator anomaly detection remains challenging because abnormal regions are often small, weakly contrasted, morphologically diverse, and embedded in repetitive structures or cluttered outdoor backgrounds. Conventional RGB-based detectors may fail to preserve subtle structural discontinuities, while direct feature fusion can introduce redundant or conflicting information. To address these issues, this study proposes DBRM-Net, a dual-branch residual framework that jointly processes RGB images and an RGB-derived Surface Structural Modality (SSM). Rather than introducing a new sensing modality or new low-level operators, SSM organizes complementary luminance, gradient, directional, Laplacian, roughness, and local-residual descriptors into a strictly aligned six-channel structural representation. This task-driven representation provides supplementary evidence for weak boundaries, local roughness variations, and subtle surface disturbances without requiring additional sensing hardware or cross-sensor registration. The Prior-Aware Mixture Fusion (PAMF) module models cross-branch agreement, discrepancy, and residual priors to improve forward feature integration, whereas the Adaptive Contextual Topology Injection Fusion (ACTIF) module selectively reuses anomaly-relevant structural evidence while preserving RGB semantic continuity. Experiments on two insulator anomaly datasets show that DBRM-Net achieves $$AP_{50}$$ and $$AP_{50:95}$$ values of 88.7 and 65.4, respectively, on the primary IFD dataset. Compared with the strongest SSM-based baseline, the improvement is modest but consistent, while DBRM-Net uses fewer parameters, lower computational cost, and higher detector-side inference speed. Repeated-run, ablation, robustness, and visualization analyses further demonstrate stable optimization and complementary contributions from the structural representation and staged interaction modules. Overall, DBRM-Net provides a favorable accuracy-efficiency trade-off for fine-grained insulator anomaly detection under complex imaging conditions.
Authors
- Kexiang Liu (ORCID: https://orcid.org/0000-0002-9350-4499)
- Lulu Zhu (ORCID: https://orcid.org/0009-0008-2704-6021)
- Changsheng Zhu (ORCID: https://orcid.org/0000-0003-0471-2710)
- Zhiyuan Xia (ORCID: https://orcid.org/0000-0002-1202-8305)
- Hui Chen
- Hongwei Bai
Institutions
- Lanzhou University of Technology (CN)
- Shanghai Electric (China) (CN)
Publication Details
- Journal
- Journal of Intelligent Manufacturing
- Published
- 2026-09-01
- DOI
- https://doi.org/10.1007/s10845-026-02965-6
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00