Hyperspectral Image Synthesis Through Blind Unmixing Dictionary and Deep Diffusion Models

The capability to generate realistic hyperspectral imagery plays a prominent role in applications to sensor and mission development as well as in the training of machine learning models. Yet, it is a challenging task due to the high dimensionality and complex spectral–spatial structure of the data. This paper proposes a novel unsupervised deep-learning framework for generating realistic hyperspectral imagery based on blind hyperspectral unmixing and denoising diffusion probabilistic models. First, the approach extracts both endmembers and abundance maps from hyperspectral data through a dictionary of hyperspectral unmixing algorithms. The extracted abundances are then used as inputs for a guided diffusion model, which serves as the generative framework with the goal of producing realistic synthetic abundance maps. Finally, the generation of synthetic hyperspectral images is accomplished by integrating the generated abundance maps with the extracted endmember set and by suitably conditioning the probabilistic formulation of the guided diffusion model as a function of the unmixing algorithms in the aforementioned dictionary. By combining a collection of blind linear unmixing techniques with the generative capabilities of diffusion models, the proposed methodology aims to address key challenges in simulating hyperspectral sensor outputs. The methodology was validated experimentally using real satellite hyperspectral imagery from the PRISMA mission of the Italian Space Agency. The results confirm the effectiveness of the approach in generating realistic synthetic hyperspectral images associated with various land-covers. The code is available at: https://github.com/martinapastorino/HSI_DDPM.