Generative Augmentation Hashing for Few-Shot Cross-Modal Retrieval
Deep cross-modal hashing has demonstrated strong performance in large-scale retrieval but remains challenging in few-shot scenarios due to limited data and weak cross-modal alignment. We propose Generative Augmentation Hashing (GAH), a new framework that synergizes Visual-Language Models (VLMs) and generation-driven hashing to address these limitations. GAH first introduces a cycle generative augmentation mechanism: VLMs generate descriptive textual captions for images, which, combined with label semantics, guide diffusion models to synthesize semantically aligned images via inconsistency filtering. These images then regenerate coherent textual descriptions through VLMs, forming a self-reinforcing cycle that iteratively expands cross-modal data. To resolve the diversity-alignment trade-off in augmentation, we design cross-modal perturbation enhancement, injecting synchronized perturbations with controlled noise to preserve inter-modal semantic relationships while enhancing robustness. Finally, GAH employs dual-level adversarial hash learning, where adversarial alignment of modality-specific and shared latent spaces optimizes both cross-modal consistency and discriminative hash code generation, effectively bridging heterogeneous gaps. Extensive experiments on benchmark datasets show that GAH outperforms state-of-the-art methods in few-shot cross-modal retrieval, achieving significant improvements in retrieval accuracy. Our source codes and datasets are available at https://github.com/xiaolaohuuu/GAH.
Authors
- Tianshi Wang (ORCID: https://orcid.org/0000-0002-8013-5188)
- Xiaojun Chang (ORCID: https://orcid.org/0000-0002-7778-8807)
- Zequn Wang (ORCID: https://orcid.org/0000-0002-1569-9948)
- Fengling Li (ORCID: https://orcid.org/0000-0002-3432-6215)
- Lei Zhu (ORCID: https://orcid.org/0000-0002-2993-7142)
Institutions
- University of Technology Sydney (AU)
- Tongji University (CN)
- Shandong Normal University (CN)
Publication Details
- Journal
- IEEE Transactions on Circuits and Systems for Video Technology
- Published
- 2025-07-14
- DOI
- https://doi.org/10.1109/tcsvt.2025.3588769
- Citations
- 1
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.28
Funders
- National Natural Science Foundation of China