Text-Guided Cross-Modal Alignment with Attribute and Contour Prototypes for Visible-Infrared Person Re-Identification

Visible-infrared person re-identification (VI-ReID) aims to match pedestrian images captured under visible and infrared modalities, which suffer from significant domain discrepancies. Existing approaches either synthesize cross-modal images or learn modality-invariant representations, yet often encounter semantic degradation or limited alignment capacity. Recent vision-language models leverage textual semantics for modality bridging; however, CLIP-based frameworks typically rely on learnable token proxies with limited expressiveness. In this article, we propose a novel semantic-driven framework that explicitly generates rich, modality-agnostic textual descriptions from images as alignment cues. Specifically, we design a dual-branch Text Semantic Generation Module that includes: (1) an Attribute-Aware text description Generation module using prompt-based templates to capture modality-invariant identity cues, and (2) a Contour-Aware text prompt Module that provides complementary structural information often missing in textual descriptions. To reconcile semantic heterogeneity, a Text Re-definition Module (TRM) fuses instance-level and class-level semantics into unified representations, enabling fine-grained alignment with image features. Furthermore, we construct category-level textual prototypes as global semantic anchors to enhance cross-modal consistency. Extensive experiments on two standard VI-ReID benchmarks demonstrate that our method achieves superior performance, validating its effectiveness in semantic-guided modality alignment.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Multimedia Computing Communications and Applications
Published
2026-02-14
DOI
https://doi.org/10.1145/3796720
Primary Topic
Video Surveillance and Tracking Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Text-Guided Cross-Modal Alignment with Attribute and Contour Prototypes for Visible-Infrared Person Re-Identification

Xingming Zhang, Yong Tao
ACM Transactions on Multimedia Computing Communications and Applications
Video Surveillance and Tracking Methods
article

Text-Guided Cross-Modal Alignment with Attribute and Contour Prototypes for Visible-Infrared Person Re-Identification

Xingming Zhang, Yong Tao
article en

Abstract

Visible-infrared person re-identification (VI-ReID) aims to match pedestrian images captured under visible and infrared modalities, which suffer from significant domain discrepancies. Existing approaches either synthesize cross-modal images or learn modality-invariant representations, yet often encounter semantic degradation or limited alignment capacity. Recent vision-language models leverage textual semantics for modality bridging; however, CLIP-based frameworks typically rely on learnable token proxies with limited expressiveness. In this article, we propose a novel semantic-driven framework that explicitly generates rich, modality-agnostic textual descriptions from images as alignment cues. Specifically, we design a dual-branch Text Semantic Generation Module that includes: (1) an Attribute-Aware text description Generation module using prompt-based templates to capture modality-invariant identity cues, and (2) a Contour-Aware text prompt Module that provides complementary structural information often missing in textual descriptions. To reconcile semantic heterogeneity, a Text Re-definition Module (TRM) fuses instance-level and class-level semantics into unified representations, enabling fine-grained alignment with image features. Furthermore, we construct category-level textual prototypes as global semantic anchors to enhance cross-modal consistency. Extensive experiments on two standard VI-ReID benchmarks demonstrate that our method achieves superior performance, validating its effectiveness in semantic-guided modality alignment.

ACM Transactions on Multimedia Computing Communications and ApplicationsVol. 22(4)
University of Science and Technology of China (CN)
Openalex Percentile: Top 56%
Video Surveillance and Tracking Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.