Few-Shot Image Generation via Style Adaptation and Content Preservation

Training a generative model with limited data (e.g., 10) is a very challenging task. Many works propose to fine-tune a pretrained GAN model. However, this can easily result in overfitting. In other words, they manage to adapt the style but fail to preserve the content, where style denotes the specific properties that define a domain while content denotes the domain-irrelevant information that represents diversity. Recent works try to maintain a predefined correspondence to preserve the content, however, the diversity is still not enough and it may affect style adaptation. In this work, we propose a paired image reconstruction approach for content preservation. We propose to introduce an image translation module to GAN transferring, where the module teaches the generator to separate style and content, and the generator provides training data to the translation module in return. Qualitative and quantitative experiments show that our method consistently surpasses the state-of-the-art methods in a few-shot setting.

Authors

Institutions

Publication Details

Journal
IEEE Transactions on Neural Networks and Learning Systems
Published
2024-11-06
DOI
https://doi.org/10.1109/tnnls.2024.3477467
Citations
3
Primary Topic
Video Analysis and Summarization
Type
article
Field-Weighted Citation Impact
0.75
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Few-Shot Image Generation via Style Adaptation and Content Preservation

Guosheng Lin, Fayao Liu, Fan Yang, Xiaosheng He
3 citations
IEEE Transactions on Neural Networks and Learning Systems
Video Analysis and Summarization
0.75
article

Few-Shot Image Generation via Style Adaptation and Content Preservation

Guosheng Lin, Fayao Liu, Fan Yang, Xiaosheng He
article en
3 citations

Abstract

Training a generative model with limited data (e.g., 10) is a very challenging task. Many works propose to fine-tune a pretrained GAN model. However, this can easily result in overfitting. In other words, they manage to adapt the style but fail to preserve the content, where style denotes the specific properties that define a domain while content denotes the domain-irrelevant information that represents diversity. Recent works try to maintain a predefined correspondence to preserve the content, however, the diversity is still not enough and it may affect style adaptation. In this work, we propose a paired image reconstruction approach for content preservation. We propose to introduce an image translation module to GAN transferring, where the module teaches the generator to separate style and content, and the generator provides training data to the translation module in return. Qualitative and quantitative experiments show that our method consistently surpasses the state-of-the-art methods in a few-shot setting.

IEEE Transactions on Neural Networks and Learning SystemsVol. 36(7)
Agency for Science, Technology and Research (SG), Nanyang Technological University (SG)
Climate action
Openalex Percentile: Top 27%
Video Analysis and Summarization
0.75
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Few-Shot Image Generation via Style Adaptation and Content Preservation — Guosheng Lin, Fayao Liu, et al. · IEEE Transactions on Neural Networks and Learning Systems (2024) | TGRS Research Map | TGRS