Cross-Conditioned Spectral Diffusion Fusion for Symmetry-Aware Mirror Segmentation
Mirror segmentation aims to identify mirror pixels from a single RGB image, yet remains challenging because mirrors provide weak intrinsic texture cues and their appearance is dominated by scene-dependent reflections under varying illumination and viewpoints. While recent models improve performance by leveraging contextual contrast, symmetry priors, frequency/spectral cues, or additional modalities (e.g., depth), many cross-cue or symmetry-aware designs still rely on direct spatial-domain fusion, such as concatenation, addition, or attention. Such fusion can amplify reflection-induced high-frequency variations and lead to leakage, shape distortion, and unstable boundaries. In this paper, we propose a symmetry-aware mirror segmentation framework that stabilizes cross-branch interaction via a frequency-domain cross-conditioned fusion mechanism. We build a dual-path Siamese encoder using the original image and its horizontally flipped counterpart, and introduce Heat Conduction Operator-based Cross Fusion (HCOCF), which performs heat-conduction-inspired spectral attenuation in the DCT domain. Unlike conventional fusion, HCOCF generates a nonnegative cross-conditioned attenuation coefficient map from the opposite branch and applies it to the DCT coefficient grid of the target branch. This produces a DCT-domain attenuation mask that controls the spectral refinement strength of each target feature stream, enabling global context propagation while suppressing unstable reflection-induced high-frequency responses without aggressive direct feature mixing. For multi-scale decoding, we adapt the cross-scale decoder of the baseline symmetry-aware architecture by replacing simple addition with conditional feature aggregation, which refines the HCOCF-enhanced features and improves boundary recovery. Extensive experiments on MSD, PMD, and RGBD-Mirror demonstrate competitive performance against representative supervised mirror segmentation methods. In particular, our RGB-only model achieves 88.47% IoU on MSD and 73.72% IoU on PMD, and remains competitive on RGBD-Mirror without using depth input.
Authors
- Yunjae Cheon
- Yong Ju Jung (ORCID: https://orcid.org/0000-0001-6173-0857)
Institutions
- Gachon University (KR)
Publication Details
- Journal
- Applied Sciences
- Published
- 2026-09-11
- DOI
- https://doi.org/10.3390/app16189031
- Primary Topic
- Advanced Image Fusion Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00