See other, focus self: local-to-global cross-modal guidance for infrared and visible image fusion

Infrared and visible image fusion (IVIF) plays an important role in robust scene perception by combining complementary thermal and texture information. However, many existing methods extract modality-specific features independently and rely on general-purpose global modeling, which limits fine-grained cross-modal interaction and weakens global consistency. Moreover, their fusion mechanisms remain difficult to interpret. To this end, we propose S2Fusion, a local-to-global collaborative framework for IVIF. The framework captures fine-grained cross-modal complementarity at the local level and further coordinates the enhanced features through long-range dependency modeling to achieve globally consistent fusion. Specifically, to strengthen fine-grained local interaction, we introduce the See-Other-Focus (SOF) block. Inspired by human visual perception, SOF uses context from the complementary modality to generate dynamic kernels for adaptive local aggregation, thereby facilitating the selection and preservation of complementary information. To enhance global consistency and interpretability, we further develop the Shared Heat Conduction Operator (SHCO), inspired by the physical principle of heat conduction. SHCO models long-range cross-modal correlations in the frequency domain using shared frequency value embeddings, thereby integrating local complementary information into a coherent global representation. Extensive experiments on benchmark datasets demonstrate that S2Fusion consistently outperforms state-of-the-art methods in terms of information fidelity, structural preservation, and visual consistency.

Authors

Institutions

Publication Details

Journal
Complex & Intelligent Systems
Published
2026-10-14
DOI
https://doi.org/10.1007/s40747-026-02547-2
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

See other, focus self: local-to-global cross-modal guidance for infrared and visible image fusion

Chenghu Ma, Shuang Ma, Yang Li, Jiangbin Zheng
Complex & Intelligent Systems
Advanced Image Fusion Techniques
article

See other, focus self: local-to-global cross-modal guidance for infrared and visible image fusion

Chenghu Ma, Shuang Ma, Yang Li, Jiangbin Zheng
article en

Abstract

Infrared and visible image fusion (IVIF) plays an important role in robust scene perception by combining complementary thermal and texture information. However, many existing methods extract modality-specific features independently and rely on general-purpose global modeling, which limits fine-grained cross-modal interaction and weakens global consistency. Moreover, their fusion mechanisms remain difficult to interpret. To this end, we propose S2Fusion, a local-to-global collaborative framework for IVIF. The framework captures fine-grained cross-modal complementarity at the local level and further coordinates the enhanced features through long-range dependency modeling to achieve globally consistent fusion. Specifically, to strengthen fine-grained local interaction, we introduce the See-Other-Focus (SOF) block. Inspired by human visual perception, SOF uses context from the complementary modality to generate dynamic kernels for adaptive local aggregation, thereby facilitating the selection and preservation of complementary information. To enhance global consistency and interpretability, we further develop the Shared Heat Conduction Operator (SHCO), inspired by the physical principle of heat conduction. SHCO models long-range cross-modal correlations in the frequency domain using shared frequency value embeddings, thereby integrating local complementary information into a coherent global representation. Extensive experiments on benchmark datasets demonstrate that S2Fusion consistently outperforms state-of-the-art methods in terms of information fidelity, structural preservation, and visual consistency.

Complex & Intelligent Systems
Xidian University (CN), Northwestern Polytechnical University (CN), Beijing Microelectronics Technology Institute (CN)
Openalex Percentile: Top 14%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.