Optical-to-SAR image translation based on diffusion Schrödinger bridge

In the field of synthetic aperture radar (SAR) target recognition, the recognition of aircraft targets has consistently presented a significant challenge. This is primarily due to the difficulty in obtaining SAR data of aircraft. In contrast, optical images of the target are easy to obtain. Consequently, the prevailing approach has been to translate target optical images into SAR images for target recognition. With the advancement of diffusion models, the quality and diversity of generated samples have continued to improve, rendering it possible to employ diffusion models for the translation of optical images to SAR. Additionally, the Schrödinger bridge constructs a transition between two arbitrary distributions, which can be utilized in the diffusion model to achieve optimal transport with two distributions. This paper proposes an innovative solution to achieve the translation from optical to SAR images by diffusion model based on the Schrödinger bridge. Concurrently, there is an unavoidable domain shift between the generated image and the measured SAR image. In order to narrow this domain shift, a domain adaptation method is employed. The experimental results demonstrate that the data generated by diffusion can effectively assist in the recognition of three types of aircraft targets, with an accuracy rate of 71.11%.

Authors

Institutions

Publication Details

Published
2024-12-04
DOI
https://doi.org/10.1117/12.3037223
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Optical-to-SAR image translation based on diffusion Schrödinger bridge

Junyu Wang, Hao Sun, Tao Tang, Lingjun Zhao et al.
Model Reduction and Neural Networks
article

Optical-to-SAR image translation based on diffusion Schrödinger bridge

Junyu Wang, Hao Sun, Tao Tang, Lingjun Zhao, Lin Lei, Kefeng Ji
article en

Abstract

In the field of synthetic aperture radar (SAR) target recognition, the recognition of aircraft targets has consistently presented a significant challenge. This is primarily due to the difficulty in obtaining SAR data of aircraft. In contrast, optical images of the target are easy to obtain. Consequently, the prevailing approach has been to translate target optical images into SAR images for target recognition. With the advancement of diffusion models, the quality and diversity of generated samples have continued to improve, rendering it possible to employ diffusion models for the translation of optical images to SAR. Additionally, the Schrödinger bridge constructs a transition between two arbitrary distributions, which can be utilized in the diffusion model to achieve optimal transport with two distributions. This paper proposes an innovative solution to achieve the translation from optical to SAR images by diffusion model based on the Schrödinger bridge. Concurrently, there is an unavoidable domain shift between the generated image and the measured SAR image. In order to narrow this domain shift, a domain adaptation method is employed. The experimental results demonstrate that the data generated by diffusion can effectively assist in the recognition of three types of aircraft targets, with an accuracy rate of 71.11%.

National University of Defense Technology (CN)
Openalex Percentile: Top 79%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.