StructVPR++: Distill Structural and Semantic Knowledge With Weighting Samples for Visual Place Recognition

Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-ranking using patch-level descriptors. Most deep learning-based methods in an end-to-end manner cannot extract global features with sufficient semantic information from RGB images. In contrast, re-ranking can utilize more explicit structural and semantic information in one-to-one matching process, but it is time-consuming. To bridge the gap between global retrieval and re-ranking and achieve a good trade-off between accuracy and efficiency, we propose StructVPR++, a framework that embeds structural and semantic knowledge into RGB global representations via segmentation-guided distillation. Our key innovation lies in decoupling label-specific features from global descriptors, enabling explicit semantic alignment between image pairs without requiring segmentation during deployment. Furthermore, we introduce a sample-wise weighted distillation strategy that prioritizes reliable training pairs while suppressing noisy ones. Experiments on four benchmarks demonstrate that StructVPR++ surpasses state-of-the-art global methods by 5-23% in Recall@1 and even outperforms many two-stage approaches, achieving real-time efficiency with a single RGB input.

Authors

Publication Details

Journal
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2025-04-01
DOI
https://doi.org/10.1109/tpami.2025.3556859
Citations
3
Primary Topic
Advanced Image and Video Retrieval Techniques
Type
article
Field-Weighted Citation Impact
3.83
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

StructVPR++: Distill Structural and Semantic Knowledge With Weighting Samples for Visual Place Recognition

Jingwen Fu, Nanning Zheng, Ruotong Wang, Shitao Chen et al.
3 citations
IEEE Transactions on Pattern Analysis and Machine Intelligence
Advanced Image and Video Retrieval Techniques
3.83
article

StructVPR++: Distill Structural and Semantic Knowledge With Weighting Samples for Visual Place Recognition

Jingwen Fu, Nanning Zheng, Ruotong Wang, Shitao Chen, Yanqing Shen, Sanping Zhou
article en
3 citations

Abstract

Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-ranking using patch-level descriptors. Most deep learning-based methods in an end-to-end manner cannot extract global features with sufficient semantic information from RGB images. In contrast, re-ranking can utilize more explicit structural and semantic information in one-to-one matching process, but it is time-consuming. To bridge the gap between global retrieval and re-ranking and achieve a good trade-off between accuracy and efficiency, we propose StructVPR++, a framework that embeds structural and semantic knowledge into RGB global representations via segmentation-guided distillation. Our key innovation lies in decoupling label-specific features from global descriptors, enabling explicit semantic alignment between image pairs without requiring segmentation during deployment. Furthermore, we introduce a sample-wise weighted distillation strategy that prioritizes reliable training pairs while suppressing noisy ones. Experiments on four benchmarks demonstrate that StructVPR++ surpasses state-of-the-art global methods by 5-23% in Recall@1 and even outperforms many two-stage approaches, achieving real-time efficiency with a single RGB input.

IEEE Transactions on Pattern Analysis and Machine IntelligenceVol. 47(8)
Openalex Percentile: Top 7%
Advanced Image and Video Retrieval Techniques
3.83
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

StructVPR++: Distill Structural and Semantic Knowledge With Weighting Samples for Visual Place Recognition — Jingwen Fu, Nanning Zheng, et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence (2025) | TGRS Research Map | TGRS