CASE-GANet : Context-aware and semantic-enhanced generative adversarial network for infrared and visible image fusion

Infrared-visible (IR-VI) image fusion attempts to combine complementary thermal saliency and rich visual detail into a single valuable representation. However, contemporary fusion algorithms frequently rely primarily on low-level feature similarity or modality-agnostic attention, which results in inadequate retention of semantic relevance and object-level importance especially in complex scenarios. This research suggests Context-Aware and Semantic-Enhanced Generative Adversarial Network (CASE-GANet) that explicitly integrates semantic knowledge into the fusion process in order to overcome these constraints. Modality-specific feature extractors are used, such as an attentional MobileNet-V2 with Coordinate Attention for visible image data to capture texture-rich spatial information and a Residual Dense Block (RDB) network for infrared images to preserve weak thermal structures. A Context Score Generator uses the high-level scene comprehension produced by a semantic segmentation branch to evaluate class-wise modality relevance. Semantically guided and spatially adaptive cross-modal feature fusion is made possible by injecting this contextual information into a unique Context-Aware Multi-Head Attention (C-MHA) module via a learnable bias map. In both qualitative and quantitative assessments, extensive experiments on the TNO and Road Scene, show that the proposed strategy outperforms the latest fusion techniques. The findings verify that integrating semantic context to attention-based fusion improves overall perceptual quality, structural fidelity, and thermal target visibility.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-06-28
DOI
https://doi.org/10.1038/s41598-026-59063-z
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

CASE-GANet : Context-aware and semantic-enhanced generative adversarial network for infrared and visible image fusion

J. Bineeshia, B. Vinoth Kumar
Scientific Reports
Advanced Image Fusion Techniques
article

CASE-GANet : Context-aware and semantic-enhanced generative adversarial network for infrared and visible image fusion

J. Bineeshia, B. Vinoth Kumar
article en

Abstract

Infrared-visible (IR-VI) image fusion attempts to combine complementary thermal saliency and rich visual detail into a single valuable representation. However, contemporary fusion algorithms frequently rely primarily on low-level feature similarity or modality-agnostic attention, which results in inadequate retention of semantic relevance and object-level importance especially in complex scenarios. This research suggests Context-Aware and Semantic-Enhanced Generative Adversarial Network (CASE-GANet) that explicitly integrates semantic knowledge into the fusion process in order to overcome these constraints. Modality-specific feature extractors are used, such as an attentional MobileNet-V2 with Coordinate Attention for visible image data to capture texture-rich spatial information and a Residual Dense Block (RDB) network for infrared images to preserve weak thermal structures. A Context Score Generator uses the high-level scene comprehension produced by a semantic segmentation branch to evaluate class-wise modality relevance. Semantically guided and spatially adaptive cross-modal feature fusion is made possible by injecting this contextual information into a unique Context-Aware Multi-Head Attention (C-MHA) module via a learnable bias map. In both qualitative and quantitative assessments, extensive experiments on the TNO and Road Scene, show that the proposed strategy outperforms the latest fusion techniques. The findings verify that integrating semantic context to attention-based fusion improves overall perceptual quality, structural fidelity, and thermal target visibility.

Scientific Reports
PSG INSTITUTE OF TECHNOLOGY AND APPLIED RESEARCH (IN)
Openalex Percentile: Top 7%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.