Drag2Build++: A drag-based 3D architectural mesh editing workflow based on differentiable surface modeling
In modern architectural design, as complexity increases and diverse demands emerge, reconstructing 3D spaces has become a crucial method. However, existing methods remain limited to small-scale scenarios and exhibit poor reconstruction accuracy when applied to building-scale environments, resulting in unstable mesh quality and reduced design productivity. Furthermore, the lack of real-time, interactive editing tools prolongs design iteration cycles and impedes workflow efficiency. To address this issue, we propose the following contributions: (1) We construct ArchiNet++ , an architectural dataset that includes 710,180 multi-view images, 5200 SketchUp models, and corresponding camera parameters from the conceptual design phase of architectural projects. (2) We introduce Drag2Build++ , an interactive 3D mesh reconstruction framework featuring drag-based editing and three core innovations: a differentiable geometry module for fine-grained deformation, a 2D-3D rendering bridge for supervision, and a GAN-based refinement module for photorealistic texture synthesis. (3) Comprehensive experiments demonstrate that our model excels in generating high-quality 3D meshes and enables rapid mesh editing via drag-based interactions. Furthermore, by incorporating textured mesh generation into this interactive workflow, it improves both efficiency and modeling flexibility. We hope this combination can contribute to a more intuitive modeling process and offer a practical tool set that supports the digital transformation efforts within architectural design.
Authors
- Jun Yin (ORCID: https://orcid.org/0000-0003-4732-6123)
- Tianze Hao (ORCID: https://orcid.org/0000-0002-8488-9673)
- Han Zheng (ORCID: https://orcid.org/0000-0002-8179-7263)
- Shuai Lu (ORCID: https://orcid.org/0000-0003-3772-1613)
- Pengyu Zeng (ORCID: https://orcid.org/0000-0001-9018-5608)
- Zhong Jing
- Peilin Li (ORCID: https://orcid.org/0009-0000-2614-9178)
Institutions
- National University of Singapore (SG)
- University Town of Shenzhen (CN)
- Guangzhou University (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- Frontiers of Architectural Research
- Published
- 2025-09-05
- DOI
- https://doi.org/10.1016/j.foar.2025.07.005
- Citations
- 2
- Primary Topic
- 3D Surveying and Cultural Heritage
- Type
- article
- Field-Weighted Citation Impact
- 4.69
Funders
- Department of Education of Guangdong Province
- Science, Technology and Innovation Commission of Shenzhen Municipality
- Basic and Applied Basic Research Foundation of Guangdong Province