Self-supervised monocular depth estimation based on cross-attention mechanism

Depth information can help robots sense their surroundings. However, it is expensive to acquire depth information through hardware devices such as LiDAR. With the development of technology, self-supervised monocular depth estimation methods have emerged, but there is a lack of estimation of detail information. To improve the prediction of depth, we propose a cross-attention at skip connections of the neural network to reduce the semantic gap of the encoder and decoder. In addition, a convolution-attention hybrid module is used at the decoder minimum scale to enhance the global semantic features. Experimental results on the KITTI dataset show that the proposed method effectively enhances the performance of the depth decoder, giving the network a more detailed depth estimation of the image.

Authors

Institutions

Publication Details

Published
2024-10-25
DOI
https://doi.org/10.1109/icemce64157.2024.10861911
Primary Topic
Image Processing Techniques and Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Self-supervised monocular depth estimation based on cross-attention mechanism

Hancheng Yu, Ming Zhou, Yupu Zhang, Zhongchen Li
Image Processing Techniques and Applications
article

Self-supervised monocular depth estimation based on cross-attention mechanism

Hancheng Yu, Ming Zhou, Yupu Zhang, Zhongchen Li
article en

Abstract

Depth information can help robots sense their surroundings. However, it is expensive to acquire depth information through hardware devices such as LiDAR. With the development of technology, self-supervised monocular depth estimation methods have emerged, but there is a lack of estimation of detail information. To improve the prediction of depth, we propose a cross-attention at skip connections of the neural network to reduce the semantic gap of the encoder and decoder. In addition, a convolution-attention hybrid module is used at the decoder minimum scale to enhance the global semantic features. Experimental results on the KITTI dataset show that the proposed method effectively enhances the performance of the depth decoder, giving the network a more detailed depth estimation of the image.

Nanjing University of Aeronautics and Astronautics (CN)
Climate action
Openalex Percentile: Top 60%
Image Processing Techniques and Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.