A multi-stage feature alignment framework with cross-modality collaborative fusion for visible-infrared person re-identification

Efficient implementation of Visible-Infrared Person Re-identification (VI-ReID) is important for intelligent transportation and surveillance systems, where the primary challenge lies in the semantic discrepancy between visible and infrared modalities. Although existing methods have made progress in mitigating modality discrepancies, single-stage feature alignment remains prone to semantic shifts. We argue that hierarchical transitions in the feature alignment process can alleviate this issue. Based on this observation, we propose a Multi-Stage Feature Alignment and Cross-Modality Collaborative Fusion (MS-CF) framework, which performs multi-dimensional modality discrepancy optimization and suppresses redundant information, thereby ensuring cross-modality consistency and intra-modality stability. The MS-CF framework consists of three modules. The Dual-Path Cross-Layer Attention (DCA) module enhances semantic and structural representations of intermediate features. The Balanced Feature Normalization (BFN) module improves feature distribution consistency and discriminability by incorporating modality constraints and feature sparsification. The Multi-Stage Hybrid-Modality Alignment (MS-HMA) strategy applies collaborative constraints to hybrid modalities after initial single-modality alignment, enabling coarse-to-fine semantic convergence. Extensive experiments on the SYSU-MM01 and RegDB datasets demonstrate that the MS-CF framework outperforms state-of-the-art methods. In particular, under the indoor-search setting of SYSU-MM01, MS-CF achieves improvements of 5.75% in Rank-1 accuracy and 3.97% in mAP, validating its effectiveness in enhancing robustness and recognition performance.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-04-28
DOI
https://doi.org/10.1038/s41598-026-50904-5
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A multi-stage feature alignment framework with cross-modality collaborative fusion for visible-infrared person re-identification

Wanping Yang, Yingwen Zhang, Xiutao Zhao, Guangjie Liu
Scientific Reports
Advanced Neural Network Applications
article

A multi-stage feature alignment framework with cross-modality collaborative fusion for visible-infrared person re-identification

Wanping Yang, Yingwen Zhang, Xiutao Zhao, Guangjie Liu
article en

Abstract

Efficient implementation of Visible-Infrared Person Re-identification (VI-ReID) is important for intelligent transportation and surveillance systems, where the primary challenge lies in the semantic discrepancy between visible and infrared modalities. Although existing methods have made progress in mitigating modality discrepancies, single-stage feature alignment remains prone to semantic shifts. We argue that hierarchical transitions in the feature alignment process can alleviate this issue. Based on this observation, we propose a Multi-Stage Feature Alignment and Cross-Modality Collaborative Fusion (MS-CF) framework, which performs multi-dimensional modality discrepancy optimization and suppresses redundant information, thereby ensuring cross-modality consistency and intra-modality stability. The MS-CF framework consists of three modules. The Dual-Path Cross-Layer Attention (DCA) module enhances semantic and structural representations of intermediate features. The Balanced Feature Normalization (BFN) module improves feature distribution consistency and discriminability by incorporating modality constraints and feature sparsification. The Multi-Stage Hybrid-Modality Alignment (MS-HMA) strategy applies collaborative constraints to hybrid modalities after initial single-modality alignment, enabling coarse-to-fine semantic convergence. Extensive experiments on the SYSU-MM01 and RegDB datasets demonstrate that the MS-CF framework outperforms state-of-the-art methods. In particular, under the indoor-search setting of SYSU-MM01, MS-CF achieves improvements of 5.75% in Rank-1 accuracy and 3.97% in mAP, validating its effectiveness in enhancing robustness and recognition performance.

Scientific Reports
Changchun Normal University (CN)
Reduced inequalities
Openalex Percentile: Top 5%
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.