Synthesizing SAR Images with Generative AI: Expanding to Large-Scale Imagery
This paper investigates the application of generative models in simulating radar images, highlighting their capacity in generating realistic images from text description. To overcome the usual limitation of image size constraint, we propose a model operating through a series of blocks to progressively enhance the image’s resolution and details by leveraging a pre-trained latent diffusion model. This cascading architecture, structured into three levels, is augmented by integrating a latent scaling technique, enabling a gradual improvement in the scale of the image, thus allowing the generation of larger images. Our method also stands out for incorporating the ControlNet model, maintaining content consistency during the multi-resolution process. After training on aerial SAR images from the ONERA SETHI sensor, we compare our architecture with alternative methods for large-scale image generation using larger pre-trained models and outpainting methods. The results demonstrate a clear enhancement in the scale of simulated radar images while maintaining alignment with the contexts described by the text descriptions.
Authors
- Olivier Lévêque (ORCID: https://orcid.org/0000-0002-3533-9958)
- Nicolas Trouvé
- Nathan Letheule
- Elise Colin‐Koeniguer (ORCID: https://orcid.org/0000-0002-7401-8073)
- Solène Debuysère
Institutions
- Université Paris-Saclay (FR)
Publication Details
- Published
- 2024-10-21
- DOI
- https://doi.org/10.1109/radar58436.2024.10993695
- Citations
- 1
- Primary Topic
- Computational Physics and Python Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.35