StructVPR++: Distill Structural and Semantic Knowledge With Weighting Samples for Visual Place Recognition
Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-ranking using patch-level descriptors. Most deep learning-based methods in an end-to-end manner cannot extract global features with sufficient semantic information from RGB images. In contrast, re-ranking can utilize more explicit structural and semantic information in one-to-one matching process, but it is time-consuming. To bridge the gap between global retrieval and re-ranking and achieve a good trade-off between accuracy and efficiency, we propose StructVPR++, a framework that embeds structural and semantic knowledge into RGB global representations via segmentation-guided distillation. Our key innovation lies in decoupling label-specific features from global descriptors, enabling explicit semantic alignment between image pairs without requiring segmentation during deployment. Furthermore, we introduce a sample-wise weighted distillation strategy that prioritizes reliable training pairs while suppressing noisy ones. Experiments on four benchmarks demonstrate that StructVPR++ surpasses state-of-the-art global methods by 5-23% in Recall@1 and even outperforms many two-stage approaches, achieving real-time efficiency with a single RGB input.
Authors
- Jingwen Fu (ORCID: https://orcid.org/0000-0003-3256-1497)
- Nanning Zheng
- Ruotong Wang (ORCID: https://orcid.org/0009-0003-7661-8974)
- Shitao Chen (ORCID: https://orcid.org/0000-0002-9422-3058)
- Yanqing Shen (ORCID: https://orcid.org/0000-0002-7826-2700)
- Sanping Zhou (ORCID: https://orcid.org/0000-0003-4100-2304)
Publication Details
- Journal
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2025-04-01
- DOI
- https://doi.org/10.1109/tpami.2025.3556859
- Citations
- 3
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 3.83