Improving Performance of Face Generation for Specific Individuals Based on LoRA

With the development of Artificial Intelligence (AI) technology, an increasing number of technologies have been applied to the AI field, and the technology of AI to generate pictures has also been greatly developed. At the same time, many new problems have arisen. AI-generated pictures can accurately generate graphics for general people, but for some special historical celebrities, due to the lack of stable diffusion training set, it is always impossible to generate clear faces. This article will use the LoRA model to solve the problem of inaccurate face blur generation. By using a special dataset for LoRA model training, the LoRA model can change the content of the generated images by freezing some permissions of the stable Diffusion base model. The resulting image will be evaluated for similarity to the original image. The results demonstrated that the overall similarity of the image faces after using LoRA increased by about 25%. The degree of missing in the training process of LoRA model is gradually decreasing, and the accuracy is gradually increasing. These show that LoRA model training can improve the accuracy of AI image generation and improve the similarity with the human face. This means that due to the high efficiency of LoRA training, the use of LoRA in the future can no longer be just for the change of painting style, but can be applied to a series of more subdivided fields such as face generation, landscape depiction, background replacement, etc.

Authors

Institutions

Publication Details

Published
2024-09-23
DOI
https://doi.org/10.1109/icedcs64328.2024.00018
Primary Topic
Face recognition and analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Performance of Face Generation for Specific Individuals Based on LoRA

Hailong Yao
Face recognition and analysis
article

Improving Performance of Face Generation for Specific Individuals Based on LoRA

Hailong Yao
article en

Abstract

With the development of Artificial Intelligence (AI) technology, an increasing number of technologies have been applied to the AI field, and the technology of AI to generate pictures has also been greatly developed. At the same time, many new problems have arisen. AI-generated pictures can accurately generate graphics for general people, but for some special historical celebrities, due to the lack of stable diffusion training set, it is always impossible to generate clear faces. This article will use the LoRA model to solve the problem of inaccurate face blur generation. By using a special dataset for LoRA model training, the LoRA model can change the content of the generated images by freezing some permissions of the stable Diffusion base model. The resulting image will be evaluated for similarity to the original image. The results demonstrated that the overall similarity of the image faces after using LoRA increased by about 25%. The degree of missing in the training process of LoRA model is gradually decreasing, and the accuracy is gradually increasing. These show that LoRA model training can improve the accuracy of AI image generation and improve the similarity with the human face. This means that due to the high efficiency of LoRA training, the use of LoRA in the future can no longer be just for the change of painting style, but can be applied to a series of more subdivided fields such as face generation, landscape depiction, background replacement, etc.

University of the Pacific (US)
Affordable and clean energy
Openalex Percentile: Top 74%
Face recognition and analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Improving Performance of Face Generation for Specific Individuals Based on LoRA — Hailong Yao · (2024) | TGRS Research Map | TGRS