Temporal Attention for Cross-View Sequential Image Localization
This paper introduces a novel approach to enhancing cross-view localization, focusing on the fine-grained, sequential localization of street-view images within a single known satellite image patch, a significant departure from traditional one-to-one image retrieval methods. By expanding to sequential image fine-grained localization, our model, equipped with a novel Temporal Attention Module (TAM), leverages contextual information to significantly improve sequential image localization accuracy. Our method shows substantial reductions in both mean and median localization errors on the Cross-View Image Sequence (CVIS) dataset, outperforming current state-of-the-art single-image localization techniques. Additionally, by adapting the KITTI-CVL dataset into sequential image sets, we not only offer a more realistic dataset for future research but also demonstrate our model’s robust generalization capabilities across varying times and areas, evidenced by a 75.3% reduction in mean distance error in cross-view sequential image localization.
Authors
- Frédéric Maire (ORCID: https://orcid.org/0000-0002-6212-7651)
- Feras Dayoub (ORCID: https://orcid.org/0000-0002-4234-7374)
- Dong Yuan
Institutions
- Queensland University of Technology (AU)
- Australian Centre for Robotic Vision (AU)
- The University of Adelaide (AU)
Publication Details
- Published
- 2024-10-14
- DOI
- https://doi.org/10.1109/iros58592.2024.10802621
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00