Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion

Infrared and visible image fusion needs to preserve visible texture details and infrared thermal saliency, yet emphasizing one modality may suppress or distort useful information from the other, while cross-modal differences may also contain noise, pseudo-textures, or locally incompatible boundaries. We propose ARC3Fusion, which reformulates image fusion as a reliability-calibrated consensus–complementarity–conflict process to achieve a more effective balance between visible texture detail and infrared target saliency. A progressive shared encoder and a modality-specific residual adapter first produce comparable yet modality-aware features. Cross-Modal Explainable Residual Decomposition then estimates jointly supported consensus and represents the information unexplained by the opposite modality as candidate residuals. Trustworthy Complementarity Verification evaluates infrared residuals using source intensity and edge evidence, while visible residuals are examined using source cues and learnable frequency-pattern evidence. Cross-Modal Conflict Estimation further characterizes local incompatibility through co-activation, reliability, amplitude imbalance, edge-strength mismatch, and orientation mismatch. Conflict-Aware Routing finally coordinates consensus and verified residuals according to these relation cues. Unlike conventional shared–private decomposition that directly preserves private features, ARC3Fusion treats modality-specific residuals as candidates that must be verified and conflict-coordinated before fusion. Experiments on LLVIP, MSRS, and TNO demonstrate consistent fusion performance. On LLVIP, ARC3Fusion achieves the best EN, SF, AG, VIF, and SCD values of 7.158, 14.467, 4.331, 1.136, and 1.229, respectively. These results indicate that verifying modality-specific residuals and coordinating local conflicts improves the joint preservation of visible texture details and infrared thermal saliency.

Authors

Institutions

Publication Details

Journal
Sensors
Published
2026-07-26
DOI
https://doi.org/10.3390/s26154745
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion

Changqing Zhang, Tong Qin, Bowen Tian, Jihao Luo et al.
Sensors
Advanced Image Fusion Techniques
article

Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion

Changqing Zhang, Tong Qin, Bowen Tian, Jihao Luo, Ke Lin
article en

Abstract

Infrared and visible image fusion needs to preserve visible texture details and infrared thermal saliency, yet emphasizing one modality may suppress or distort useful information from the other, while cross-modal differences may also contain noise, pseudo-textures, or locally incompatible boundaries. We propose ARC3Fusion, which reformulates image fusion as a reliability-calibrated consensus–complementarity–conflict process to achieve a more effective balance between visible texture detail and infrared target saliency. A progressive shared encoder and a modality-specific residual adapter first produce comparable yet modality-aware features. Cross-Modal Explainable Residual Decomposition then estimates jointly supported consensus and represents the information unexplained by the opposite modality as candidate residuals. Trustworthy Complementarity Verification evaluates infrared residuals using source intensity and edge evidence, while visible residuals are examined using source cues and learnable frequency-pattern evidence. Cross-Modal Conflict Estimation further characterizes local incompatibility through co-activation, reliability, amplitude imbalance, edge-strength mismatch, and orientation mismatch. Conflict-Aware Routing finally coordinates consensus and verified residuals according to these relation cues. Unlike conventional shared–private decomposition that directly preserves private features, ARC3Fusion treats modality-specific residuals as candidates that must be verified and conflict-coordinated before fusion. Experiments on LLVIP, MSRS, and TNO demonstrate consistent fusion performance. On LLVIP, ARC3Fusion achieves the best EN, SF, AG, VIF, and SCD values of 7.158, 14.467, 4.331, 1.136, and 1.229, respectively. These results indicate that verifying modality-specific residuals and coordinating local conflicts improves the joint preservation of visible texture details and infrared thermal saliency.

SensorsVol. 26(15)
Beijing Institute of Technology (CN)
Openalex Percentile: Top 9%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.