MFRGN: Multi-scale Feature Representation Generalization Network for Ground-to-Aerial Geo-localization
Cross-area evaluation poses a significant challenge for ground-to-aerial geo-localization, in which the training and testing data are captured from entirely distinct areas. However, current methods struggle in cross-area evaluation due to their emphasis solely on learning global information from single-scale features. Some efforts alleviate this problem but rely on complex and specific technologies like pre-processing and hard sample mining. To this end, we propose a pure end-to-end solution, free from task-specific techniques, termed the Multi-scale Feature Representation Generalization Network (MFRGN) to improve generalization. Specifically, we introduce multi-scale features and explicitly utilize them by an novel global-local information representation structure with two flows, to bolster feature representations. In the global flow, we present a lightweight Self and Cross Attention Module (SCAM) to efficiently learn global embeddings. In the local flow, we develop a Global-Prompt Attention Block (GPAB) to capture discriminative features under the global embeddings as prompts. As a result, our approach generates robust descriptors representing multi-scale global and local information, thereby enhancing the model's invariance to scene variations. Extensive experiments on benchmarks show our MFRGN achieves competitive performance in same-area evaluation and improves cross-area generalization by a significant margin compared to SOTA methods. Our code is available at https://github.com/ytao-wang/MFRGN.
Authors
- Yuntao Wang (ORCID: https://orcid.org/0000-0001-5232-008X)
- Yuehuan Wang (ORCID: https://orcid.org/0000-0001-7046-7587)
- Ruonan Wei (ORCID: https://orcid.org/0000-0002-2562-6021)
- Wenbo Gao (ORCID: https://orcid.org/0009-0009-5428-6407)
- Jinpu Zhang (ORCID: https://orcid.org/0000-0002-0617-0452)
Institutions
- National University of Defense Technology (CN)
- Huazhong University of Science and Technology (CN)
Publication Details
- Published
- 2024-10-26
- DOI
- https://doi.org/10.1145/3664647.3681431
- Citations
- 1
- Primary Topic
- Robotics and Sensor-Based Localization
- Type
- article
- Field-Weighted Citation Impact
- 1.30