CMFGP-Net: RGBT salient object detection based on cross-modal feature global perception and multi-scale deformable convolution fusion

Aiming at the challenges of insufficient multi-modal feature interaction, spatial-spectral misalignment, and poor robustness to target deformation and occlusion in RGB-T salient object detection, this paper proposes a detection framework (CMFGP-Net) based on cross-modal global perception and multi-scale cross-fusion. The framework adopts Swin Transformer with a hierarchical window attention mechanism as the backbone network, which significantly enhances the global context modeling capability. A cross-modal feature global perception (CMFGP) module is designed; through temporal correlation modeling and dynamic feature calibration mechanisms, it effectively alleviates the spatial and spectral misalignment between visible light and thermal infrared modalities. Furthermore, a multi-scale deformable convolutional cross-fusion (MSDCIF) module is introduced, which uses deformable convolution kernels to adaptively adjust the receptive field, enhancing the model's adaptability to target deformation, occlusion, and complex backgrounds. Experiments on three mainstream RGB-T datasets (VT821, VT1000 and VT5000) demonstrate that CMFGP-Net outperforms existing state-of-the-art methods in key metrics such as E-measure, weighted F-measure and MAE. Ablation experiments further verify the effectiveness of each module and its contribution to performance improvement, and the model exhibits stronger robustness and generalization ability especially in complex scenarios.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-22
DOI
https://doi.org/10.1038/s41598-026-54309-2
Primary Topic
Visual Attention and Saliency Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CMFGP-Net: RGBT salient object detection based on cross-modal feature global perception and multi-scale deformable convolution fusion

Haitang Li, Lijuan Shi, Qiuju Liu
Scientific Reports
Visual Attention and Saliency Detection
article

CMFGP-Net: RGBT salient object detection based on cross-modal feature global perception and multi-scale deformable convolution fusion

Haitang Li, Lijuan Shi, Qiuju Liu
article en

Abstract

Aiming at the challenges of insufficient multi-modal feature interaction, spatial-spectral misalignment, and poor robustness to target deformation and occlusion in RGB-T salient object detection, this paper proposes a detection framework (CMFGP-Net) based on cross-modal global perception and multi-scale cross-fusion. The framework adopts Swin Transformer with a hierarchical window attention mechanism as the backbone network, which significantly enhances the global context modeling capability. A cross-modal feature global perception (CMFGP) module is designed; through temporal correlation modeling and dynamic feature calibration mechanisms, it effectively alleviates the spatial and spectral misalignment between visible light and thermal infrared modalities. Furthermore, a multi-scale deformable convolutional cross-fusion (MSDCIF) module is introduced, which uses deformable convolution kernels to adaptively adjust the receptive field, enhancing the model's adaptability to target deformation, occlusion, and complex backgrounds. Experiments on three mainstream RGB-T datasets (VT821, VT1000 and VT5000) demonstrate that CMFGP-Net outperforms existing state-of-the-art methods in key metrics such as E-measure, weighted F-measure and MAE. Ablation experiments further verify the effectiveness of each module and its contribution to performance improvement, and the model exhibits stronger robustness and generalization ability especially in complex scenarios.

Scientific Reports
PLA Information Engineering University (CN), Zhengzhou University (CN), Zhengzhou University of Science and Technology (CN), Zhoukou Normal University (CN), Research Applications (United States) (US)
Reduced inequalities
Openalex Percentile: Top 4%
Visual Attention and Saliency Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

CMFGP-Net: RGBT salient object detection based on cross-modal feature global perception and multi-scale deformable convolution fusion — Haitang Li, Lijuan Shi, et al. · Scientific Reports (2026) | TGRS Research Map | TGRS