Text-Guided Visual Representation Learning via Cross-Modal Fusion for Person Re-Identification
Person Re-identification (Re-ID) aims at accurately querying pedestrians across multiple non-overlapping cameras system, playing an essential role in computer vision applications. While CNN-based methods leverage feature aggregation and attention mechanisms to achieve competitive performance, their limitations in capturing long-range dependencies have motivated the research of transformer-based architectures, which excel in the evolution of person Re-ID research. Despite leveraging pretrained vision-language models to facilitate visual encoder training, current methods suffer from fragmented optimization procedures, complexity increasing, and inadequate semantic guidance from textual prompts. To address these limitations, we propose an end-to-end method named Text-Guided Fusion Transformer (TGFT). TGFT applies the fixed but semantically enriched texts to guide visual training with a novel Gated Cross Attention (GCA) fusion module. The GCA module adaptively modulates the integration of textual information and visual features, effectively enhancing cross-modal feature alignment and semantic consistency. Without significantly increasing computational complexity or parameter count, TGFT achieves superior performance, demonstrating strong effectiveness and scalability on multiple major Re-ID benchmarks.
Authors
- Adri Priadana (ORCID: https://orcid.org/0000-0002-1553-7631)
- G. F. Cao (ORCID: https://orcid.org/0000-0001-9135-3888)
- Kang-Hyun Jo (ORCID: https://orcid.org/0000-0002-4937-7082)
- Xuan-Thuy Vo (ORCID: https://orcid.org/0000-0002-7411-0697)
- Tien-Dat Tran (ORCID: https://orcid.org/0000-0001-8266-0536)
- Qing Tang (ORCID: https://orcid.org/0000-0003-4194-8597)
Institutions
- University of Ulsan (KR)
Publication Details
- Journal
- IEEE Access
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/access.2025.3584377
- Citations
- 1
- Primary Topic
- Video Surveillance and Tracking Methods
- Type
- article
- Field-Weighted Citation Impact
- 1.28
Funders
- National Research Foundation