iShapEditing: Intelligent Shape Editing with Diffusion Models

Abstract Recent advancements in generative models have enabled image editing very effective with impressive results. By extending this progress to 3D geometry models, we introduce iShapEditing, a novel framework for 3D shape editing which is applicable to both generated and real shapes. Users manipulate shapes by dragging handle points to corresponding targets, offering an intuitive and intelligent editing interface. Leveraging the Triplane Diffusion model and robust intermediate feature correspondence, our framework utilizes classifier guidance to adjust noise representations during sampling process, ensuring alignment with user expectations while preserving plausibility. For real shapes, we employ shape predictions at each time step alongside a DDPM‐based inversion algorithm to derive their latent codes, facilitating seamless editing. iShapEditing provides effective and intelligent control over shapes without the need for additional model training or fine‐tuning. Experimental examples demonstrate the effectiveness and superiority of our method in terms of editing accuracy and plausibility.

Authors

Institutions

Publication Details

Journal
Computer Graphics Forum
Published
2024-10-01
DOI
https://doi.org/10.1111/cgf.15253
Citations
1
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.37
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

iShapEditing: Intelligent Shape Editing with Diffusion Models

Falai Chen, Juyong Zhang, Jing Li
1 citations
Computer Graphics Forum
3D Shape Modeling and Analysis
0.37
article

iShapEditing: Intelligent Shape Editing with Diffusion Models

Falai Chen, Juyong Zhang, Jing Li
article en
1 citations

Abstract

Abstract Recent advancements in generative models have enabled image editing very effective with impressive results. By extending this progress to 3D geometry models, we introduce iShapEditing, a novel framework for 3D shape editing which is applicable to both generated and real shapes. Users manipulate shapes by dragging handle points to corresponding targets, offering an intuitive and intelligent editing interface. Leveraging the Triplane Diffusion model and robust intermediate feature correspondence, our framework utilizes classifier guidance to adjust noise representations during sampling process, ensuring alignment with user expectations while preserving plausibility. For real shapes, we employ shape predictions at each time step alongside a DDPM‐based inversion algorithm to derive their latent codes, facilitating seamless editing. iShapEditing provides effective and intelligent control over shapes without the need for additional model training or fine‐tuning. Experimental examples demonstrate the effectiveness and superiority of our method in terms of editing accuracy and plausibility.

Computer Graphics ForumVol. 43(7)
University of Science and Technology of China (CN), University of Electronic Science and Technology of China (CN)
Openalex Percentile: Top 41%
3D Shape Modeling and Analysis
0.37
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

iShapEditing: Intelligent Shape Editing with Diffusion Models — Falai Chen, Juyong Zhang, et al. · Computer Graphics Forum (2024) | TGRS Research Map | TGRS