A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth

This study mainly introduces a method combining the Stable Diffusion Model (SDM) and Parameter-Efficient Fine-Tuning method for generating Chinese Landscape Paintings. This training process is accelerated by combining LoRA with pre-trained SDM and DreamBooth with pre-trained SDM, respectively. On the Chinese Landscape Paintings Internet dataset used in this paper, this study finds that SDM combined with DreamBooth exhibits superior performance, outperforming other models, including the generic pre-trained SDM and LoRA-based fine-tuning SDM. The SDM combined with DreamBooth achieves a FID of 12.75 on the dataset and outperforms all other models in terms of expert evaluation, highlighting the model's versatility in the field of Chinese Landscape Paintings given the unique identifier, high fidelity and high quality. This study illustrates the potential of specialised fine-tuning method to improve the performance of SDM on domain-specific tasks, particularly in the domain of Landscape Paintings.

Authors

Institutions

Publication Details

Published
2024-10-18
DOI
https://doi.org/10.1145/3708036.3708080
Citations
1
Primary Topic
Digital Media and Visual Art
Type
article
Field-Weighted Citation Impact
0.63
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth

Zihan Peng, Yinan Peng, Xinyu Fang, Xiangwei Deng et al.
1 citations
Digital Media and Visual Art
0.63
article

A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth

Zihan Peng, Yinan Peng, Xinyu Fang, Xiangwei Deng, Y. T. Gu
article en
1 citations

Abstract

This study mainly introduces a method combining the Stable Diffusion Model (SDM) and Parameter-Efficient Fine-Tuning method for generating Chinese Landscape Paintings. This training process is accelerated by combining LoRA with pre-trained SDM and DreamBooth with pre-trained SDM, respectively. On the Chinese Landscape Paintings Internet dataset used in this paper, this study finds that SDM combined with DreamBooth exhibits superior performance, outperforming other models, including the generic pre-trained SDM and LoRA-based fine-tuning SDM. The SDM combined with DreamBooth achieves a FID of 12.75 on the dataset and outperforms all other models in terms of expert evaluation, highlighting the model's versatility in the field of Chinese Landscape Paintings given the unique identifier, high fidelity and high quality. This study illustrates the potential of specialised fine-tuning method to improve the performance of SDM on domain-specific tasks, particularly in the domain of Landscape Paintings.

Northeastern University (US), Shanghai Huangpu District Central Hospital (CN), Seattle University (US), California State University, Long Beach (US), Columbia University (US)
Sustainable cities and communities
Openalex Percentile: Top 17%
Digital Media and Visual Art
0.63
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A New Chinese Landscape Paintings Generation Model based on Stable Diffusion using DreamBooth — Zihan Peng, Yinan Peng, et al. · (2024) | TGRS Research Map | TGRS