Overview of Deep Learning-based Visual Localization Methods
Visual localization seeks to estimate the six degrees of freedom (6-DoF) camera pose from a single input image, and has found extensive applications in augmented reality, mobile robotics, and autonomous driving. This paper provides an overview of the current landscape of visual localization. We present a comprehensive review of mainstream deep learning-based visual localization approaches. Organized around the central theme of data association, this review systematically examines three primary technical paradigms: (1) Absolute Pose Regression (APR), which employs a CNN to directly regress the camera pose from an image; (2) Scene Coordinate Regression (SCR), which predicts per-pixel 3D scene coordinates and subsequently estimates the pose using geometric solvers; and (3) Neural Rendering-based Localization, which refines poses through differentiable rendering and optimization, leveraging implicit neural representations or explicit geometric primitives. The review provides a thorough analysis of representative methods within each category. Finally, we discuss current challenges, including the limited geometric reasoning capability of APR, the scalability issues of SCR in large-scale environments, and the computational bottlenecks associated with neural rendering. This review aims to guide the advancement of robust, efficient, and scalable visual localization systems.
Authors
- Dewen Hu (ORCID: https://orcid.org/0000-0001-7357-0053)
- Ming Li (ORCID: https://orcid.org/0000-0002-9471-9897)
- Zhen Tan (ORCID: https://orcid.org/0009-0007-1582-9216)
- Jinpu Zhang (ORCID: https://orcid.org/0000-0002-0617-0452)
- Jintao Zheng (ORCID: https://orcid.org/0009-0001-7979-9200)
- Zhongyan Niu (ORCID: https://orcid.org/0009-0007-9211-0790)
Institutions
- National University of Defense Technology (CN)
Publication Details
- Journal
- ACM Transactions on Multimedia Computing Communications and Applications
- Published
- 2026-11-16
- DOI
- https://doi.org/10.1145/3857800
- Primary Topic
- Robotics and Sensor-Based Localization
- Type
- article
- Field-Weighted Citation Impact
- 0.00