PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation

Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies, but existing approaches typically only address a specific setting, such as text-guided part segmentation or point-based interaction. In this work, we argue that these settings can be unified as an intent-conditioned generative problem, where different prompts specify the desired part decomposition. To this end, we introduce PartLLM, a unified multimodal model that formulates 3D part segmentation as autoregressive semantic decomposition. Conditioned on an input shape and a user prompt, PartLLM autoregressively generates semantic part hypotheses as queries for mask prediction and feeds them to a decomposition-aware decoder that jointly predicts coherent part masks. This unified design supports text-guided part segmentation, interactive segmentation, and full-shape semantic decomposition with controllable granularity within a single model. Extensive experiments across these task settings show that PartLLM consistently outperforms task-specific baselines, demonstrating the effectiveness of unifying 3D part segmentation under an intent-conditioned generative formulation. Code and data for this paper are available at https://github.com/czvvd/PartLLM.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Graphics
Published
2026-11-09
DOI
https://doi.org/10.1145/3842577
Citations
2
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
4.02

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation

Yaqing Zhang, Zixing Zhao, Honghua Chen, Yiheng Zhang et al.
2 citations
ACM Transactions on Graphics
3D Shape Modeling and Analysis
4.02
article

PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation

Yaqing Zhang, Zixing Zhao, Honghua Chen, Yiheng Zhang, Wenping Wang, Le Wan, Peng Li, Cheng Lin, Yuan Liu, Zhiyang Dou, Zhe Zhu, Mingqiang Wei
article en
2 citations

Abstract

Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies, but existing approaches typically only address a specific setting, such as text-guided part segmentation or point-based interaction. In this work, we argue that these settings can be unified as an intent-conditioned generative problem, where different prompts specify the desired part decomposition. To this end, we introduce PartLLM, a unified multimodal model that formulates 3D part segmentation as autoregressive semantic decomposition. Conditioned on an input shape and a user prompt, PartLLM autoregressively generates semantic part hypotheses as queries for mask prediction and feeds them to a decomposition-aware decoder that jointly predicts coherent part masks. This unified design supports text-guided part segmentation, interactive segmentation, and full-shape semantic decomposition with controllable granularity within a single model. Extensive experiments across these task settings show that PartLLM consistently outperforms task-specific baselines, demonstrating the effectiveness of unifying 3D part segmentation under an intent-conditioned generative formulation. Code and data for this paper are available at https://github.com/czvvd/PartLLM.

ACM Transactions on GraphicsVol. 45(6)
Macau University of Science and Technology (MO), Lingnan University (HK), Hong Kong University of Science and Technology (HK), Tencent (China) (CN), Massachusetts Institute of Technology (US), Taiyuan University of Technology (CN), Texas A&M University (US)
National Natural Science Foundation of China, Fundo para o Desenvolvimento das Ciências e da Tecnologia
Openalex Percentile: Top 7%
3D Shape Modeling and Analysis
4.02
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon