TailorCode: 3D Clothed Human Generation from Images with Text-Instructed Editable Clothing Dimensions

3D virtual garment can be widely applicable in fields like digital human applications, fashion design, gaming industry, etc., where these models are typically built by highly experienced fashion modelers with extensive labor over a long period. Image-based and text-guided 3D model generation using deep learning networks achieves impressive results of cutting down on manpower and time. This paper presents an innovative approach for generating editable 3D clothed human models from a single image. Our method enhances existing garment reconstruction techniques and introduces a specialized measurement-editable module thereby establishing a direct connection between clothed human images and corresponding 3D garment models, enabling precise adjustments of clothing attributes such as length and style. Also, fine details like wrinkles are maintained through a finetuning structure. Our proposed solution demonstrates superior semantic guidance and detail restoration, effectively reconstructing both fitted and loose garments and editing 3D garment from monocular image, and also paves the way for downstream applications in animation, texturing, and simulation of clothed digital humans.

Authors

Institutions

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.1145/3708657.3708728
Primary Topic
3D Shape Modeling and Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

TailorCode: 3D Clothed Human Generation from Images with Text-Instructed Editable Clothing Dimensions

Mingtong Zhang, Jiaxin Tong, Qiuzi Huang, Yang Liu
3D Shape Modeling and Analysis
article

TailorCode: 3D Clothed Human Generation from Images with Text-Instructed Editable Clothing Dimensions

Mingtong Zhang, Jiaxin Tong, Qiuzi Huang, Yang Liu
article en

Abstract

3D virtual garment can be widely applicable in fields like digital human applications, fashion design, gaming industry, etc., where these models are typically built by highly experienced fashion modelers with extensive labor over a long period. Image-based and text-guided 3D model generation using deep learning networks achieves impressive results of cutting down on manpower and time. This paper presents an innovative approach for generating editable 3D clothed human models from a single image. Our method enhances existing garment reconstruction techniques and introduces a specialized measurement-editable module thereby establishing a direct connection between clothed human images and corresponding 3D garment models, enabling precise adjustments of clothing attributes such as length and style. Also, fine details like wrinkles are maintained through a finetuning structure. Our proposed solution demonstrates superior semantic guidance and detail restoration, effectively reconstructing both fitted and loose garments and editing 3D garment from monocular image, and also paves the way for downstream applications in animation, texturing, and simulation of clothed digital humans.

Beijing University of Posts and Telecommunications (CN)
Gender equality
Openalex Percentile: Top 70%
3D Shape Modeling and Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

TailorCode: 3D Clothed Human Generation from Images with Text-Instructed Editable Clothing Dimensions — Mingtong Zhang, Jiaxin Tong, et al. · (2024) | TGRS Research Map | TGRS