Unpaired 3D Point Cloud Shape Translation through Structure-aware Token Space and Gated Fusion Translator
This paper addresses the problem of unpaired shape translation on 3D point clouds. While prior methods typically rely on global latent vectors or spatially structured grids, such representations often lack the flexibility to capture both semantic structures and fine-grained geometric details. To address this, we propose operating directly in a structured token space, where tokens are pretrained through masked autoencoding. Unlike rigid spatial grids that impose fixed layouts, our tokens naturally adapt to geometric variations while maintaining semantic coherence. This structured yet flexible latent space enables semantically meaningful and geometrically precise transformations. A transformer-based translator is proposed to manipulate these tokens. This gated dual-branch translator enables detail-preserving and topology-aware shape translation across categories. Experiments on challenging tasks, such as chair-to-table transformations, demonstrate that our approach outperforms existing methods in preserving both global structure and part-level details.
Authors
- Po-Jui Lin
- Tzu-Miao Yao (ORCID: https://orcid.org/0009-0006-3222-0157)
- Yu-Chiao Wu (ORCID: https://orcid.org/0009-0000-1748-8266)
- I-Chen Lin (ORCID: https://orcid.org/0000-0001-9924-4723)
Institutions
- National Yang Ming Chiao Tung University (TW)
Publication Details
- Journal
- Proceedings of the ACM on Computer Graphics and Interactive Techniques
- Published
- 2026-05-01
- DOI
- https://doi.org/10.1145/3804503
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Science and Technology Council