SPIdepth: A Novel Approach to Enhancing Monocular Depth Estimation with Strengthened Pose Networks

Self-supervised monocular depth estimation is a rapidly advancing field with significant implications for autonomous driving and robotics. However, many existing approaches fail to fully leverage the potential of enhancing pose information, which is crucial for accurate depth estimation. In this paper, we introduce SPIdepth, a novel method that enhances the pose network to improve depth estimation performance. By building on the Self Query Layer (SQL) framework, SPIdepth places a strong emphasis on capturing fine-grained scene structures through more effective use of pose information, resulting in notable improvements in scene understanding. Our experimental evaluation on the KITTI benchmark dataset demonstrates that SPIdepth achieves state-of-the-art performance, outperforming previous methods by substantial margins. Specifically, SPIdepth sets new records on the self-supervised KITTI benchmark, as well as sets new state-of-the-art on KITTI with achieving the lowest AbsRel (0.029), SqRel (0.069), and RMSE (1.394) metrics. Notably, SPIdepth achieves these results using only a single image for inference, outperforming even those methods that rely on video sequences, showcasing its efficiency and effectiveness in practical applications. Although primarily designed for autonomous driving, SPIdepth’s robust depth estimation and scene understanding capabilities also have significant potential for Earth observation (EO) applications. This makes it particularly valuable for geospatial analysis, disaster management, and recovery efforts, such as those required for Ukraine's post-conflict reconstruction, where precise environmental monitoring and informed decision-making are critical. The code and pre-trained models are publicly available at https://github.com/Lavreniuk/SPIdepth.

Authors

Institutions

Publication Details

Published
2024-10-11
DOI
https://doi.org/10.1109/dessert65323.2024.11122216
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SPIdepth: A Novel Approach to Enhancing Monocular Depth Estimation with Strengthened Pose Networks

Mykola Lavreniuk, Alla Lavreniuk
Advanced Vision and Imaging
article

SPIdepth: A Novel Approach to Enhancing Monocular Depth Estimation with Strengthened Pose Networks

Mykola Lavreniuk, Alla Lavreniuk
article en

Abstract

Self-supervised monocular depth estimation is a rapidly advancing field with significant implications for autonomous driving and robotics. However, many existing approaches fail to fully leverage the potential of enhancing pose information, which is crucial for accurate depth estimation. In this paper, we introduce SPIdepth, a novel method that enhances the pose network to improve depth estimation performance. By building on the Self Query Layer (SQL) framework, SPIdepth places a strong emphasis on capturing fine-grained scene structures through more effective use of pose information, resulting in notable improvements in scene understanding. Our experimental evaluation on the KITTI benchmark dataset demonstrates that SPIdepth achieves state-of-the-art performance, outperforming previous methods by substantial margins. Specifically, SPIdepth sets new records on the self-supervised KITTI benchmark, as well as sets new state-of-the-art on KITTI with achieving the lowest AbsRel (0.029), SqRel (0.069), and RMSE (1.394) metrics. Notably, SPIdepth achieves these results using only a single image for inference, outperforming even those methods that rely on video sequences, showcasing its efficiency and effectiveness in practical applications. Although primarily designed for autonomous driving, SPIdepth’s robust depth estimation and scene understanding capabilities also have significant potential for Earth observation (EO) applications. This makes it particularly valuable for geospatial analysis, disaster management, and recovery efforts, such as those required for Ukraine's post-conflict reconstruction, where precise environmental monitoring and informed decision-making are critical. The code and pre-trained models are publicly available at https://github.com/Lavreniuk/SPIdepth.

National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute” (UA), Space Research Institute (UA)
Climate action
Openalex Percentile: Top 69%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.