Multi-Scale Cross-Modal Collaborative Reconstruction Network
Few-shot fine-grained image classification faces significant challenges due to subtle inter-class distinctions and limited annotated samples, where conventional methods often struggle to comprehensively exploit multi-granularity semantic cues under single-scale feature fusion or unimodal representation constraints. To address this, this paper proposes a Multi-Scale Cross-Modal Collaborative Reconstruction Network (MSCMCRN), which synergistically integrates hierarchical feature aggregation, cross-modal interaction, and contrastive-guided optimization. Our framework first introduces a pyramid feature adaptation module that dynamically fuses multi-scale representations through channel-wise and spatial self-attention mechanisms, enabling joint modeling of local discriminative patterns and global structural coherence. A bidirectional crossmodal attention mechanism is then designed to explicitly capture interdependencies between channel-specific attributes and spatialaware contours, effectively enhancing feature discriminability through mutual reinforcement. Furthermore, this paper proposes a collaborative optimization paradigm that unifies bidirectional feature reconstruction consistency with contrastive metric learning, simultaneously ensuring intra-class compactness and inter-class separability in the embedding space. Extensive evaluations on three challenging fine-grained benchmarks (CUB-200-2011, Stanford Cars, NABirds) demonstrate that MSCMCRN consistently surpasses state-of-the-art approaches in classification tasks. The results underscore the effectiveness of hierarchical multi-modal fusion in mitigating information underutilization and the critical role of contrastive constraints in alleviating few-shot overfitting, providing new insights for openenvironment fine-grained recognition scenarios.
Authors
- Yan Tian (ORCID: https://orcid.org/0000-0003-0596-1209)
- Jianmin Fu (ORCID: https://orcid.org/0000-0002-7368-0751)
- Taotao Chen (ORCID: https://orcid.org/0000-0002-8831-0534)
- Jun Zheng (ORCID: https://orcid.org/0000-0002-5270-5809)
- Sun Jie (ORCID: https://orcid.org/0000-0003-1743-5513)
- Xiaoyu Li (ORCID: https://orcid.org/0000-0003-0778-092X)
- Huamao Gu (ORCID: https://orcid.org/0000-0002-1216-4278)
- T. Luo
Institutions
- Gezhouba Group (China) (CN)
- Dahua Technology (China) (CN)
- Zhejiang Gongshang University (CN)
Publication Details
- Published
- 2025-08-15
- DOI
- https://doi.org/10.1109/cvaa66438.2025.11193155
- Primary Topic
- Brain Tumor Detection and Classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00