Cross-Conditioned Spectral Diffusion Fusion for Symmetry-Aware Mirror Segmentation

Mirror segmentation aims to identify mirror pixels from a single RGB image, yet remains challenging because mirrors provide weak intrinsic texture cues and their appearance is dominated by scene-dependent reflections under varying illumination and viewpoints. While recent models improve performance by leveraging contextual contrast, symmetry priors, frequency/spectral cues, or additional modalities (e.g., depth), many cross-cue or symmetry-aware designs still rely on direct spatial-domain fusion, such as concatenation, addition, or attention. Such fusion can amplify reflection-induced high-frequency variations and lead to leakage, shape distortion, and unstable boundaries. In this paper, we propose a symmetry-aware mirror segmentation framework that stabilizes cross-branch interaction via a frequency-domain cross-conditioned fusion mechanism. We build a dual-path Siamese encoder using the original image and its horizontally flipped counterpart, and introduce Heat Conduction Operator-based Cross Fusion (HCOCF), which performs heat-conduction-inspired spectral attenuation in the DCT domain. Unlike conventional fusion, HCOCF generates a nonnegative cross-conditioned attenuation coefficient map from the opposite branch and applies it to the DCT coefficient grid of the target branch. This produces a DCT-domain attenuation mask that controls the spectral refinement strength of each target feature stream, enabling global context propagation while suppressing unstable reflection-induced high-frequency responses without aggressive direct feature mixing. For multi-scale decoding, we adapt the cross-scale decoder of the baseline symmetry-aware architecture by replacing simple addition with conditional feature aggregation, which refines the HCOCF-enhanced features and improves boundary recovery. Extensive experiments on MSD, PMD, and RGBD-Mirror demonstrate competitive performance against representative supervised mirror segmentation methods. In particular, our RGB-only model achieves 88.47% IoU on MSD and 73.72% IoU on PMD, and remains competitive on RGBD-Mirror without using depth input.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-09-11
DOI
https://doi.org/10.3390/app16189031
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Cross-Conditioned Spectral Diffusion Fusion for Symmetry-Aware Mirror Segmentation

Yunjae Cheon, Yong Ju Jung
Applied Sciences
Advanced Image Fusion Techniques
article

Cross-Conditioned Spectral Diffusion Fusion for Symmetry-Aware Mirror Segmentation

Yunjae Cheon, Yong Ju Jung
article en

Abstract

Mirror segmentation aims to identify mirror pixels from a single RGB image, yet remains challenging because mirrors provide weak intrinsic texture cues and their appearance is dominated by scene-dependent reflections under varying illumination and viewpoints. While recent models improve performance by leveraging contextual contrast, symmetry priors, frequency/spectral cues, or additional modalities (e.g., depth), many cross-cue or symmetry-aware designs still rely on direct spatial-domain fusion, such as concatenation, addition, or attention. Such fusion can amplify reflection-induced high-frequency variations and lead to leakage, shape distortion, and unstable boundaries. In this paper, we propose a symmetry-aware mirror segmentation framework that stabilizes cross-branch interaction via a frequency-domain cross-conditioned fusion mechanism. We build a dual-path Siamese encoder using the original image and its horizontally flipped counterpart, and introduce Heat Conduction Operator-based Cross Fusion (HCOCF), which performs heat-conduction-inspired spectral attenuation in the DCT domain. Unlike conventional fusion, HCOCF generates a nonnegative cross-conditioned attenuation coefficient map from the opposite branch and applies it to the DCT coefficient grid of the target branch. This produces a DCT-domain attenuation mask that controls the spectral refinement strength of each target feature stream, enabling global context propagation while suppressing unstable reflection-induced high-frequency responses without aggressive direct feature mixing. For multi-scale decoding, we adapt the cross-scale decoder of the baseline symmetry-aware architecture by replacing simple addition with conditional feature aggregation, which refines the HCOCF-enhanced features and improves boundary recovery. Extensive experiments on MSD, PMD, and RGBD-Mirror demonstrate competitive performance against representative supervised mirror segmentation methods. In particular, our RGB-only model achieves 88.47% IoU on MSD and 73.72% IoU on PMD, and remains competitive on RGBD-Mirror without using depth input.

Applied SciencesVol. 16(18)
Gachon University (KR)
Openalex Percentile: Top 13%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.