Discovering Multi-Frequency Embedding for Visible-Infrared Person Re-Identification
Visible-Infrared Person Re-identification (VI-ReID) is critical for round-the-clock surveillance systems yet is hindered by significant modality discrepancies. Existing methods often fail to fully exploit frequency domain information, focusing predominantly on spatial domain feature learning or limited frequency decompositions. To address this, we propose the Multi-Frequency Embedding Network (MFENet), a feature-level method that operates in the frequency domain through multi-frequency decomposition to learn discriminative and modality-invariant features. Specifically, the HiLo-Frequency Modulation (HiLo-FM) module efficiently extracts low-frequency features via frequency-domain filtering and high-frequency details through lightweight multiscale convolutions, followed by attention-based fusion. The Frequency-Aware Diversity Enhancer (FADE) module further enriches feature discriminability by weighting multi-frequency components and learning diverse features through multi-branch architectures. To further enhance the performance of our method, we introduce two innovative loss functions. The Cross-Modality Soft Retrieval (CMSR) loss prioritizes cross-modality consistency over intra-modality similarity, while the Cross-Modality Ranking Regularization (CMRR) loss enhances feature diversity through differentiable rank correlation optimization. Extensive experiments demonstrate the state-of-the-art performance of our method, achieving 61.06% Rank-1 and 67.75% mAP in the challenging IR to VIS mode on the largest VI-ReID benchmark LLCM, surpassing existing methods by significant margins without resorting to reranking or additional labeled data. Code is available at https://github.com/GuHY777/MFENet-VIReID.
Authors
- Lei Pu (ORCID: https://orcid.org/0000-0002-4397-2155)
- Ruitao Lu (ORCID: https://orcid.org/0000-0002-7527-4298)
- Hongyang Gu (ORCID: https://orcid.org/0000-0002-4987-5022)
- Xiaogang Yang (ORCID: https://orcid.org/0000-0002-4419-1334)
- Ming Wu (ORCID: https://orcid.org/0000-0002-6993-1431)
- Siming Han (ORCID: https://orcid.org/0009-0002-3887-3846)
Institutions
- PLA Rocket Force University of Engineering (CN)
Publication Details
- Journal
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2025-09-22
- DOI
- https://doi.org/10.1109/tcsvt.2025.3612751
- Primary Topic
- Video Surveillance and Tracking Methods
- Type
- article
- Field-Weighted Citation Impact
- 0.00