PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation
Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies, but existing approaches typically only address a specific setting, such as text-guided part segmentation or point-based interaction. In this work, we argue that these settings can be unified as an intent-conditioned generative problem, where different prompts specify the desired part decomposition. To this end, we introduce PartLLM, a unified multimodal model that formulates 3D part segmentation as autoregressive semantic decomposition. Conditioned on an input shape and a user prompt, PartLLM autoregressively generates semantic part hypotheses as queries for mask prediction and feeds them to a decomposition-aware decoder that jointly predicts coherent part masks. This unified design supports text-guided part segmentation, interactive segmentation, and full-shape semantic decomposition with controllable granularity within a single model. Extensive experiments across these task settings show that PartLLM consistently outperforms task-specific baselines, demonstrating the effectiveness of unifying 3D part segmentation under an intent-conditioned generative formulation. Code and data for this paper are available at https://github.com/czvvd/PartLLM.
Authors
- Yaqing Zhang (ORCID: https://orcid.org/0000-0001-8546-5795)
- Zixing Zhao
- Honghua Chen
- Yiheng Zhang
- Wenping Wang
- Le Wan
- Peng Li
- Cheng Lin
- Yuan Liu
- Zhiyang Dou
- Zhe Zhu
- Mingqiang Wei
Institutions
- Macau University of Science and Technology (MO)
- Lingnan University (HK)
- Hong Kong University of Science and Technology (HK)
- Tencent (China) (CN)
- Massachusetts Institute of Technology (US)
- Taiyuan University of Technology (CN)
- Texas A&M University (US)
Publication Details
- Journal
- ACM Transactions on Graphics
- Published
- 2026-11-09
- DOI
- https://doi.org/10.1145/3842577
- Citations
- 2
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 4.02
Funders
- National Natural Science Foundation of China
- Fundo para o Desenvolvimento das Ciências e da Tecnologia