A Study on Controlling Character Deformation through AI Image Generation Model Training and Prompt Engineering

This study investigates the control of character deformation in comics and animation using image generation AI. While deformation is a complex concept shaped by culture, authorship, and style, its foundation lies in the distortion of human proportions. To establish an objective baseline, this research focuses on facial ratios and defines five deformation points from simplified to realistic. Representative images were collected from distinctive genres—wuxia, graphic novel, live action, shojo, and super-deformed—and used to construct standard reference images through prompt-based generation and quantitative validation. A LoRA model, named D-LoRA, was trained with proportion-based prompts to reproduce these deformation points. To evaluate its effectiveness, three datasets were compared: D-LoRA, prompt-only, and alternative style LoRA. Quantitative evaluation employed FaceMesh similarity, FID, KID, and CLIPScore. Results demonstrate that D-LoRA consistently outperformed other conditions, achieving higher facial ratio similarity, lower distribution divergence, and stronger text-image alignment. This study contributes by systematizing deformation analysis, establishing validated standard images, and integrating multiple quantitative metrics for objective evaluation. Limitations include the focus on facial ratios while excluding stylistic features such as hair or accessories. Future work will extend to diverse genres, ablation tests, full-body proportions, and emotional expression control.

Authors

Publication Details

Journal
Journal of Korea Multimedia Society
Published
2025-10-31
DOI
https://doi.org/10.9717/kmms.2025.28.10.1599
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Study on Controlling Character Deformation through AI Image Generation Model Training and Prompt Engineering

Jieun Kim, Jongho Park
Journal of Korea Multimedia Society
Face recognition and analysis
article

A Study on Controlling Character Deformation through AI Image Generation Model Training and Prompt Engineering

Jieun Kim, Jongho Park
article en

Abstract

This study investigates the control of character deformation in comics and animation using image generation AI. While deformation is a complex concept shaped by culture, authorship, and style, its foundation lies in the distortion of human proportions. To establish an objective baseline, this research focuses on facial ratios and defines five deformation points from simplified to realistic. Representative images were collected from distinctive genres—wuxia, graphic novel, live action, shojo, and super-deformed—and used to construct standard reference images through prompt-based generation and quantitative validation. A LoRA model, named D-LoRA, was trained with proportion-based prompts to reproduce these deformation points. To evaluate its effectiveness, three datasets were compared: D-LoRA, prompt-only, and alternative style LoRA. Quantitative evaluation employed FaceMesh similarity, FID, KID, and CLIPScore. Results demonstrate that D-LoRA consistently outperformed other conditions, achieving higher facial ratio similarity, lower distribution divergence, and stronger text-image alignment. This study contributes by systematizing deformation analysis, establishing validated standard images, and integrating multiple quantitative metrics for objective evaluation. Limitations include the focus on facial ratios while excluding stylistic features such as hair or accessories. Future work will extend to diverse genres, ablation tests, full-body proportions, and emotional expression control.

Journal of Korea Multimedia SocietyVol. 28(10)
Openalex Percentile: Top 67%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Study on Controlling Character Deformation through AI Image Generation Model Training and Prompt Engineering — Jieun Kim, Jongho Park · Journal of Korea Multimedia Society (2025) | TGRS Research Map | TGRS