Fast 3D Layout Estimation through Instance-Level Parameter Learning in Lightweight Network

Indoor layout estimation serves as a fundamental task in the realm of scene understanding, aiming to infer the overall spatial structure of the indoor scene from an input image. Many recent studies focus on learning high-resolution maps representing pixel-level planar depth parameters for layout estimation. However, the high model complexity and the error-prone parameter aggregation process make these methods challenging to deploy on mobile devices. In this study, we propose a novel framework that directly learns low-resolution instance-level planar depth parameters with a lightweight model, aiming to reduce computational costs and accelerate layout estimation. We further employ knowledge distillation of spatial attention to enhance the accuracy of layout estimation. We train a more complex teacher network, and impart the spatial attention learned by the teacher network to the lightweight student network, thereby improving its performance. Experiments demonstrate that the proposed framework achieves fast computational speed while maintaining a high level of accuracy, indicating its superiority in addressing both speed and accuracy challenges.

Authors

Institutions

Publication Details

Published
2024-09-20
DOI
https://doi.org/10.1145/3703935.3704049
Primary Topic
Digital Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Fast 3D Layout Estimation through Instance-Level Parameter Learning in Lightweight Network

Weidong Zhang, Ying Liu, Qiong Wang
Digital Image Processing Techniques
article

Fast 3D Layout Estimation through Instance-Level Parameter Learning in Lightweight Network

Weidong Zhang, Ying Liu, Qiong Wang
article en

Abstract

Indoor layout estimation serves as a fundamental task in the realm of scene understanding, aiming to infer the overall spatial structure of the indoor scene from an input image. Many recent studies focus on learning high-resolution maps representing pixel-level planar depth parameters for layout estimation. However, the high model complexity and the error-prone parameter aggregation process make these methods challenging to deploy on mobile devices. In this study, we propose a novel framework that directly learns low-resolution instance-level planar depth parameters with a lightweight model, aiming to reduce computational costs and accelerate layout estimation. We further employ knowledge distillation of spatial attention to enhance the accuracy of layout estimation. We train a more complex teacher network, and impart the spatial attention learned by the teacher network to the lightweight student network, thereby improving its performance. Experiments demonstrate that the proposed framework achieves fast computational speed while maintaining a high level of accuracy, indicating its superiority in addressing both speed and accuracy challenges.

Xi’an University of Posts and Telecommunications (CN)
Openalex Percentile: Top 70%
Digital Image Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Fast 3D Layout Estimation through Instance-Level Parameter Learning in Lightweight Network — Weidong Zhang, Ying Liu, et al. · (2024) | TGRS Research Map | TGRS