Thermal Non-Line-of-Sight Imaging through Rough Surfaces

Thermal non-line-of-sight (NLOS) imaging utilizes the thermal radiation emitted by hidden objects to ”see around corners”, offering promising applications in security and search-and-rescue missions. However, reconstructing hidden scenes through rough relay walls remains highly challenging due to severe spatial mixing caused by complex reflection and scattering. While existing model-based and learning-based approaches yield high-quality results under reflective surfaces, they struggle to deliver satisfactory performance under rough surfaces. Here we introduce NLOSFormer, a physics-embedded neural network to address this challenge. By formulating light transport as a convolution process, NLOSFormer estimates the convolution kernel from measurements to guide reconstruction within an end-to-end network. This explicitly estimated kernel effectively narrows the solution space, significantly improving generalization and enabling relative depth estimation. To support training and evaluation, we further present a publicly available dataset named ThermalNLOS, together with a novel data augmentation strategy to alleviate overfitting. Extensive experiments demonstrate that NLOSFormer significantly outperforms existing approaches across a wide range of relay walls. Notably, it achieves real-time imaging of dynamic targets under rough surfaces, representing a substantial advance toward robust and practical deployment.

Institutions

Publication Details

Journal
ACM Transactions on Graphics
Published
2026-05-19
DOI
https://doi.org/10.1145/3811030
Primary Topic
Advanced Optical Sensing Technologies
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Thermal Non-Line-of-Sight Imaging through Rough Surfaces

ACM Transactions on Graphics
Advanced Optical Sensing Technologies
article

Thermal Non-Line-of-Sight Imaging through Rough Surfaces

article en

Abstract

Thermal non-line-of-sight (NLOS) imaging utilizes the thermal radiation emitted by hidden objects to ”see around corners”, offering promising applications in security and search-and-rescue missions. However, reconstructing hidden scenes through rough relay walls remains highly challenging due to severe spatial mixing caused by complex reflection and scattering. While existing model-based and learning-based approaches yield high-quality results under reflective surfaces, they struggle to deliver satisfactory performance under rough surfaces. Here we introduce NLOSFormer, a physics-embedded neural network to address this challenge. By formulating light transport as a convolution process, NLOSFormer estimates the convolution kernel from measurements to guide reconstruction within an end-to-end network. This explicitly estimated kernel effectively narrows the solution space, significantly improving generalization and enabling relative depth estimation. To support training and evaluation, we further present a publicly available dataset named ThermalNLOS, together with a novel data augmentation strategy to alleviate overfitting. Extensive experiments demonstrate that NLOSFormer significantly outperforms existing approaches across a wide range of relay walls. Notably, it achieves real-time imaging of dynamic targets under rough surfaces, representing a substantial advance toward robust and practical deployment.

ACM Transactions on Graphics
University of Science and Technology of China (CN), FZU ‒ Institute of Physics of the Academy of Sciences of the Czech Republic (CZ)
Openalex Percentile: Top 5%
Advanced Optical Sensing Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.