Monocular Depth Estimation Algorithm Guided by Global Structure and Local Details
In the current encoder-decoder architecture for monocular depth estimation, there are issues with unclear structural details of depth scene objects during the decoder's upsampling process, as well as insufficient capability to extract contextual information from the scene. To address these problems, this paper proposes a monocular depth estimation algorithm guided by global structure and local details. The algorithm utilizes a pre-trained Swin-Transformer as the encoder to downsample the monocular image and extract multi-scale features from different levels of encoder representations. During the decoder phase, high-level features are fused with low-level features to create feature guidance maps enriched with structural semantic and positional information. These maps are then refined layer by layer with local detail feature maps output from a context aggregation module. This process ensures the model retains more global and local information during the multi-scale feature fusion. Finally, global structure guidance maps and local detail guidance maps from all layers are combined to predict the final depth map. Extensive experimental results on both indoor and outdoor datasets demonstrate the superiority of the proposed model. Compared to the AdaBins algorithm, our approach reduces RMSE by 10.46% and 7.41% on the KITTI and NYU Depth v2 datasets, respectively.
Authors
- C Ma (ORCID: https://orcid.org/0000-0001-5236-8374)
- Wenhao Wang (ORCID: https://orcid.org/0000-0002-9216-5325)
Institutions
- Jiangxi University of Science and Technology (CN)
Publication Details
- Published
- 2024-12-27
- DOI
- https://doi.org/10.1145/3718491.3718644
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.00