Overview of Deep Learning-based Visual Localization Methods

Visual localization seeks to estimate the six degrees of freedom (6-DoF) camera pose from a single input image, and has found extensive applications in augmented reality, mobile robotics, and autonomous driving. This paper provides an overview of the current landscape of visual localization. We present a comprehensive review of mainstream deep learning-based visual localization approaches. Organized around the central theme of data association, this review systematically examines three primary technical paradigms: (1) Absolute Pose Regression (APR), which employs a CNN to directly regress the camera pose from an image; (2) Scene Coordinate Regression (SCR), which predicts per-pixel 3D scene coordinates and subsequently estimates the pose using geometric solvers; and (3) Neural Rendering-based Localization, which refines poses through differentiable rendering and optimization, leveraging implicit neural representations or explicit geometric primitives. The review provides a thorough analysis of representative methods within each category. Finally, we discuss current challenges, including the limited geometric reasoning capability of APR, the scalability issues of SCR in large-scale environments, and the computational bottlenecks associated with neural rendering. This review aims to guide the advancement of robust, efficient, and scalable visual localization systems.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Multimedia Computing Communications and Applications
Published
2026-11-16
DOI
https://doi.org/10.1145/3857800
Primary Topic
Robotics and Sensor-Based Localization
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Overview of Deep Learning-based Visual Localization Methods

Dewen Hu, Ming Li, Zhen Tan, Jinpu Zhang et al.
ACM Transactions on Multimedia Computing Communications and Applications
Robotics and Sensor-Based Localization
article

Overview of Deep Learning-based Visual Localization Methods

Dewen Hu, Ming Li, Zhen Tan, Jinpu Zhang, Jintao Zheng, Zhongyan Niu
article en

Abstract

Visual localization seeks to estimate the six degrees of freedom (6-DoF) camera pose from a single input image, and has found extensive applications in augmented reality, mobile robotics, and autonomous driving. This paper provides an overview of the current landscape of visual localization. We present a comprehensive review of mainstream deep learning-based visual localization approaches. Organized around the central theme of data association, this review systematically examines three primary technical paradigms: (1) Absolute Pose Regression (APR), which employs a CNN to directly regress the camera pose from an image; (2) Scene Coordinate Regression (SCR), which predicts per-pixel 3D scene coordinates and subsequently estimates the pose using geometric solvers; and (3) Neural Rendering-based Localization, which refines poses through differentiable rendering and optimization, leveraging implicit neural representations or explicit geometric primitives. The review provides a thorough analysis of representative methods within each category. Finally, we discuss current challenges, including the limited geometric reasoning capability of APR, the scalability issues of SCR in large-scale environments, and the computational bottlenecks associated with neural rendering. This review aims to guide the advancement of robust, efficient, and scalable visual localization systems.

ACM Transactions on Multimedia Computing Communications and Applications
National University of Defense Technology (CN)
Robotics and Sensor-Based Localization
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon