Multimodal Diffusion-Based Depth Estimation Framework with Wi-Fi and Vision
Depth estimation is essential for applications such as autonomous driving, robotic navigation, and augmented reality. While LiDAR-based and mmWave-based approaches offer high accuracy, they come with substantial deployment costs, whereas monocular vision methods often struggle with precision. To overcome these challenges, we propose WiViD, a novel diffusion-based depth estimation framework that integrates commercial Wi-Fi and visual data. By leveraging the iterative refinement capabilities of diffusion models, WiViD achieves high-precision depth predictions. WiViD features two key encoding modules: the Complex-Valued CSI Encoder (CCE), which extracts rich spatio-temporal features from Wi-Fi signals, and the Residual Image Encoder (RIE), which processes visual data. Additionally, we introduce the Multi-Modal Alignment Bidirectional Cross-Attention (MABA) mechanism to enhance cross-modal feature integration. Real-world experiments demonstrate that WiViD significantly outperforms state-of-the-art monocular depth estimation methods, reducing Absolute Relative Error (ARE) and Square Relative Error (SRE) by 33.3% and 9.5%, respectively, highlighting its superior accuracy and robustness.
Authors
- Yuchong Gao (ORCID: https://orcid.org/0000-0002-4457-4722)
- Shijie Cheng (ORCID: https://orcid.org/0000-0002-8752-4311)
- Guoxuan Chi (ORCID: https://orcid.org/0000-0002-6941-1612)
- Zheng Yang (ORCID: https://orcid.org/0000-0003-4048-2684)
- Tony Xiao Han (ORCID: https://orcid.org/0009-0007-8423-7345)
- Hanyu Liu (ORCID: https://orcid.org/0000-0003-2394-5421)
Institutions
- Huawei Technologies (United Kingdom) (GB)
- Tsinghua University (CN)
Publication Details
- Journal
- ACM Transactions on Sensor Networks
- Published
- 2026-06-17
- DOI
- https://doi.org/10.1145/3821417
- Primary Topic
- Advanced Vision and Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.00