MIKU: Material Invariance and Knowledge Unification for PBR Generation

In physically based rendering (PBR) content creation, high-quality material generation remains a fundamental challenge, primarily hindered by the absence of standardized representations across existing datasets and synthesis pipelines. The heterogeneity in material definitions, rendering conventions, and parameterization schemes introduces significant inconsistencies, ultimately leading to unstable and physically implausible PBR synthesis results. To systematically address these limitations, we propose MIKU, a unified framework that establishes standardized PBR asset representation and enables physically consistent material generation across diverse 3D content domains. Our core contribution is a comprehensive unified PBR material processing pipeline that standardizes the entire workflow from data preprocessing to final texture synthesis. This pipeline enforces consistent representation across geometry and texture domains throughout material generation. Critically, it addresses the long-standing challenge of inconsistent material parameterizations by introducing a normalization scheme that harmonizes diverse input sources into a common representation space, enabling robust cross-dataset training and inference. Building upon this principled formulation, we train a novel physically aware diffusion model specifically designed for PBR texture generation. Our model operates within a two-stage multi-view synthesis framework. The first stage focuses on geometry-aware albedo generation, where multi-view albedo maps are synthesized under explicit geometric guidance to ensure cross-view appearance consistency. The second stage performs metallic-roughness (MR) generation using our trained diffusion model, which predicts physically plausible roughness and metallic maps conditioned on the generated albedo and the unified representation. The model is trained end-to-end on standardized data, learning to generate materials that respect category-level material priors and semantic part boundaries. By explicitly decoupling representation standardization from appearance synthesis, MIKU substantially improves both the stability and physical consistency of generated materials. Extensive experiments demonstrate that our approach achieves state-of-the-art performance in both texture quality and semantic consistency across different object parts, significantly advancing automated material generation for 3D content creation workflows.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Graphics
Published
2026-11-09
DOI
https://doi.org/10.1145/3842521
Primary Topic
Computer Graphics and Visualization Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

MIKU: Material Invariance and Knowledge Unification for PBR Generation

Yajie Bao, Jiachen Qian, Xun Cao, Youtian Lin et al.
1 links
ACM Transactions on Graphics
Computer Graphics and Visualization Techniques
article

MIKU: Material Invariance and Knowledge Unification for PBR Generation

Yajie Bao, Jiachen Qian, Xun Cao, Youtian Lin, Shuang Wu, Yao Yao, Feihu Zhang, Jiaye Fu
article en

Abstract

In physically based rendering (PBR) content creation, high-quality material generation remains a fundamental challenge, primarily hindered by the absence of standardized representations across existing datasets and synthesis pipelines. The heterogeneity in material definitions, rendering conventions, and parameterization schemes introduces significant inconsistencies, ultimately leading to unstable and physically implausible PBR synthesis results. To systematically address these limitations, we propose MIKU, a unified framework that establishes standardized PBR asset representation and enables physically consistent material generation across diverse 3D content domains. Our core contribution is a comprehensive unified PBR material processing pipeline that standardizes the entire workflow from data preprocessing to final texture synthesis. This pipeline enforces consistent representation across geometry and texture domains throughout material generation. Critically, it addresses the long-standing challenge of inconsistent material parameterizations by introducing a normalization scheme that harmonizes diverse input sources into a common representation space, enabling robust cross-dataset training and inference. Building upon this principled formulation, we train a novel physically aware diffusion model specifically designed for PBR texture generation. Our model operates within a two-stage multi-view synthesis framework. The first stage focuses on geometry-aware albedo generation, where multi-view albedo maps are synthesized under explicit geometric guidance to ensure cross-view appearance consistency. The second stage performs metallic-roughness (MR) generation using our trained diffusion model, which predicts physically plausible roughness and metallic maps conditioned on the generated albedo and the unified representation. The model is trained end-to-end on standardized data, learning to generate materials that respect category-level material priors and semantic part boundaries. By explicitly decoupling representation standardization from appearance synthesis, MIKU substantially improves both the stability and physical consistency of generated materials. Extensive experiments demonstrate that our approach achieves state-of-the-art performance in both texture quality and semantic consistency across different object parts, significantly advancing automated material generation for 3D content creation workflows.

ACM Transactions on GraphicsVol. 45(6)
Peking University (CN), Nanjing University (CN), University of Hong Kong (HK)
National Natural Science Foundation of China
Computer Graphics and Visualization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon