Multimodal Diffusion-Based Depth Estimation Framework with Wi-Fi and Vision

Depth estimation is essential for applications such as autonomous driving, robotic navigation, and augmented reality. While LiDAR-based and mmWave-based approaches offer high accuracy, they come with substantial deployment costs, whereas monocular vision methods often struggle with precision. To overcome these challenges, we propose WiViD, a novel diffusion-based depth estimation framework that integrates commercial Wi-Fi and visual data. By leveraging the iterative refinement capabilities of diffusion models, WiViD achieves high-precision depth predictions. WiViD features two key encoding modules: the Complex-Valued CSI Encoder (CCE), which extracts rich spatio-temporal features from Wi-Fi signals, and the Residual Image Encoder (RIE), which processes visual data. Additionally, we introduce the Multi-Modal Alignment Bidirectional Cross-Attention (MABA) mechanism to enhance cross-modal feature integration. Real-world experiments demonstrate that WiViD significantly outperforms state-of-the-art monocular depth estimation methods, reducing Absolute Relative Error (ARE) and Square Relative Error (SRE) by 33.3% and 9.5%, respectively, highlighting its superior accuracy and robustness.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Sensor Networks
Published
2026-06-17
DOI
https://doi.org/10.1145/3821417
Primary Topic
Advanced Vision and Imaging
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal Diffusion-Based Depth Estimation Framework with Wi-Fi and Vision

Yuchong Gao, Shijie Cheng, Guoxuan Chi, Zheng Yang et al.
ACM Transactions on Sensor Networks
Advanced Vision and Imaging
article

Multimodal Diffusion-Based Depth Estimation Framework with Wi-Fi and Vision

Yuchong Gao, Shijie Cheng, Guoxuan Chi, Zheng Yang, Tony Xiao Han, Hanyu Liu
article en

Abstract

Depth estimation is essential for applications such as autonomous driving, robotic navigation, and augmented reality. While LiDAR-based and mmWave-based approaches offer high accuracy, they come with substantial deployment costs, whereas monocular vision methods often struggle with precision. To overcome these challenges, we propose WiViD, a novel diffusion-based depth estimation framework that integrates commercial Wi-Fi and visual data. By leveraging the iterative refinement capabilities of diffusion models, WiViD achieves high-precision depth predictions. WiViD features two key encoding modules: the Complex-Valued CSI Encoder (CCE), which extracts rich spatio-temporal features from Wi-Fi signals, and the Residual Image Encoder (RIE), which processes visual data. Additionally, we introduce the Multi-Modal Alignment Bidirectional Cross-Attention (MABA) mechanism to enhance cross-modal feature integration. Real-world experiments demonstrate that WiViD significantly outperforms state-of-the-art monocular depth estimation methods, reducing Absolute Relative Error (ARE) and Square Relative Error (SRE) by 33.3% and 9.5%, respectively, highlighting its superior accuracy and robustness.

ACM Transactions on Sensor Networks
Huawei Technologies (United Kingdom) (GB), Tsinghua University (CN)
Openalex Percentile: Top 6%
Advanced Vision and Imaging
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.