MIXVPR++: Enhanced Visual Place Recognition With Hierarchical-Region Feature-Mixer and Adaptive Gabor Texture Fuser
Visual Place Recognition (VPR) is crucial for various computer vision and robotics applications. Traditional VPR techniques relying on handcrafted features, have been enhanced by using Convolutional Neural Networks (CNNs). Recently, MixVPR has set new benchmarks in VPR by using advanced feature aggregation techniques. However, MixVPR's full-image feature mixing approach can lead to the ignoring of critical local detail information and regional saliency information in large-scale images. To overcome this, we propose MIXVPR++, which integrates an Adaptive Gabor Texture Fuser with a Learnable Gabor Filter for enriching semantic context with texture details information and a Hierarchical-Region Feature-Mixer for better spatial hierarchy capture regional saliency information, thereby enhancing robustness and accuracy. Extensive experiments demonstrate that MIXVPR++ outperforms state-of-the-art methods across most challenging benchmarks. Despite its impressive performance, MIXVPR++ shows limitations in handling severe viewpoint changes, indicating an area for future improvement.
Authors
- Wei Liu (ORCID: https://orcid.org/0000-0002-0623-7178)
- Jun Hu (ORCID: https://orcid.org/0000-0002-7094-1901)
- Zuotao Ning (ORCID: https://orcid.org/0000-0003-3114-2784)
- Jiwei Nie (ORCID: https://orcid.org/0000-0003-3639-4729)
- Dingyü Xue (ORCID: https://orcid.org/0000-0002-9310-679X)
- Feng Pan (ORCID: https://orcid.org/0009-0000-5517-5834)
- Shuai Cheng (ORCID: https://orcid.org/0009-0006-5871-6572)
Institutions
- Neusoft (China) (CN)
- Northeastern University (CN)
Publication Details
- Journal
- IEEE Robotics and Automation Letters
- Published
- 2024-12-04
- DOI
- https://doi.org/10.1109/lra.2024.3511416
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00