Drag2Build++: A drag-based 3D architectural mesh editing workflow based on differentiable surface modeling

In modern architectural design, as complexity increases and diverse demands emerge, reconstructing 3D spaces has become a crucial method. However, existing methods remain limited to small-scale scenarios and exhibit poor reconstruction accuracy when applied to building-scale environments, resulting in unstable mesh quality and reduced design productivity. Furthermore, the lack of real-time, interactive editing tools prolongs design iteration cycles and impedes workflow efficiency. To address this issue, we propose the following contributions: (1) We construct ArchiNet++ , an architectural dataset that includes 710,180 multi-view images, 5200 SketchUp models, and corresponding camera parameters from the conceptual design phase of architectural projects. (2) We introduce Drag2Build++ , an interactive 3D mesh reconstruction framework featuring drag-based editing and three core innovations: a differentiable geometry module for fine-grained deformation, a 2D-3D rendering bridge for supervision, and a GAN-based refinement module for photorealistic texture synthesis. (3) Comprehensive experiments demonstrate that our model excels in generating high-quality 3D meshes and enables rapid mesh editing via drag-based interactions. Furthermore, by incorporating textured mesh generation into this interactive workflow, it improves both efficiency and modeling flexibility. We hope this combination can contribute to a more intuitive modeling process and offer a practical tool set that supports the digital transformation efforts within architectural design.

Authors

Institutions

Publication Details

Journal
Frontiers of Architectural Research
Published
2025-09-05
DOI
https://doi.org/10.1016/j.foar.2025.07.005
Citations
2
Primary Topic
3D Surveying and Cultural Heritage
Type
article
Field-Weighted Citation Impact
4.69

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Drag2Build++: A drag-based 3D architectural mesh editing workflow based on differentiable surface modeling

Jun Yin, Tianze Hao, Han Zheng, Shuai Lu et al.
2 citations
Frontiers of Architectural Research
3D Surveying and Cultural Heritage
4.69
article

Drag2Build++: A drag-based 3D architectural mesh editing workflow based on differentiable surface modeling

Jun Yin, Tianze Hao, Han Zheng, Shuai Lu, Pengyu Zeng, Zhong Jing, Peilin Li
article en
2 citations

Abstract

In modern architectural design, as complexity increases and diverse demands emerge, reconstructing 3D spaces has become a crucial method. However, existing methods remain limited to small-scale scenarios and exhibit poor reconstruction accuracy when applied to building-scale environments, resulting in unstable mesh quality and reduced design productivity. Furthermore, the lack of real-time, interactive editing tools prolongs design iteration cycles and impedes workflow efficiency. To address this issue, we propose the following contributions: (1) We construct ArchiNet++ , an architectural dataset that includes 710,180 multi-view images, 5200 SketchUp models, and corresponding camera parameters from the conceptual design phase of architectural projects. (2) We introduce Drag2Build++ , an interactive 3D mesh reconstruction framework featuring drag-based editing and three core innovations: a differentiable geometry module for fine-grained deformation, a 2D-3D rendering bridge for supervision, and a GAN-based refinement module for photorealistic texture synthesis. (3) Comprehensive experiments demonstrate that our model excels in generating high-quality 3D meshes and enables rapid mesh editing via drag-based interactions. Furthermore, by incorporating textured mesh generation into this interactive workflow, it improves both efficiency and modeling flexibility. We hope this combination can contribute to a more intuitive modeling process and offer a practical tool set that supports the digital transformation efforts within architectural design.

Frontiers of Architectural ResearchVol. 14(6)
National University of Singapore (SG), University Town of Shenzhen (CN), Guangzhou University (CN), Tsinghua University (CN)
Department of Education of Guangdong Province, Science, Technology and Innovation Commission of Shenzhen Municipality, Basic and Applied Basic Research Foundation of Guangdong Province
Openalex Percentile: Top 5%
3D Surveying and Cultural Heritage
4.69
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.