Thermal Depth Estimation Using Unified Multi-Scale Features and Propagation-Based Refinement

Thermal monocular depth estimation can provide more robust depth predictions than RGB-based methods under nighttime and adverse weather conditions. However, when trained with projected LiDAR supervision, depth models often retain structural errors in sky regions, long-range areas, and object boundaries because LiDAR measurements are sparse or missing in such regions. To address this limitation, we propose a thermal monocular depth estimation framework that incorporates propagation-based refinement. To make this refinement applicable across different base models, we further design a multi-scale feature adapter that converts heterogeneous multi-scale features with different spatial resolutions and channel dimensions into a unified representation. As a result, the same refinement architecture can be used across different base models without model-specific refiner redesign. On the multispectral stereo (MS2) dataset, the proposed method improves both BTS (big-to-small) and NeWCRFs (neural window fully connected CRFs), reducing the meter-based error metrics SqRel from 0.380 to 0.369 and RMSE from 3.163 to 3.126 for BTS, and reducing SqRel from 0.331 to 0.328 and RMSE from 2.937 to 2.924 for NeWCRFs. Qualitative results further show that the proposed method alleviates mixed-depth artifacts and abnormal depth patterns in regions lacking reliable depth supervision.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-04-22
DOI
https://doi.org/10.3390/app16094107
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Thermal Depth Estimation Using Unified Multi-Scale Features and Propagation-Based Refinement

Hoon Yoo, HeeJeong Yoo
Applied Sciences
Advanced Vision and Imaging
article

Thermal Depth Estimation Using Unified Multi-Scale Features and Propagation-Based Refinement

Hoon Yoo, HeeJeong Yoo
article en

Abstract

Thermal monocular depth estimation can provide more robust depth predictions than RGB-based methods under nighttime and adverse weather conditions. However, when trained with projected LiDAR supervision, depth models often retain structural errors in sky regions, long-range areas, and object boundaries because LiDAR measurements are sparse or missing in such regions. To address this limitation, we propose a thermal monocular depth estimation framework that incorporates propagation-based refinement. To make this refinement applicable across different base models, we further design a multi-scale feature adapter that converts heterogeneous multi-scale features with different spatial resolutions and channel dimensions into a unified representation. As a result, the same refinement architecture can be used across different base models without model-specific refiner redesign. On the multispectral stereo (MS2) dataset, the proposed method improves both BTS (big-to-small) and NeWCRFs (neural window fully connected CRFs), reducing the meter-based error metrics SqRel from 0.380 to 0.369 and RMSE from 3.163 to 3.126 for BTS, and reducing SqRel from 0.331 to 0.328 and RMSE from 2.937 to 2.924 for NeWCRFs. Qualitative results further show that the proposed method alleviates mixed-depth artifacts and abnormal depth patterns in regions lacking reliable depth supervision.

Applied SciencesVol. 16(9)
Sangmyung University (KR)
Climate action
Openalex Percentile: Top 18%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.