Generative adversarial mural inpainting algorithm based on structural and texture hybrid enhancement

For the existing deep learning image restoration methods, the joint guidance of structure and texture information is not considered, which leads to structural disorder and texture blur in the restoration results. A generative adversarial mural inpainting algorithm based on structural and texture hybrid enhancement was proposed. Firstly, the structure guidance branch composed of dynamic convolution cascade was constructed to improve the expression ability of structure features, and the structure information was used to guide the encoder coding to enhance the edge contour information of the coding feature map. Then, the multi-granularity feature extraction module was designed to obtain the texture features of texture guided branches, and the multi-scale texture information was used to guide the decoder to reconstruct and repair, so as to improve the texture consistency of murals. Finally, skip connection was used to promote the feature sharing of structure and texture features, and the spectral-normalized PatchGAN discriminator was used to complete the mural restoration. The digital restoration experiment results of real Dunhuang murals showed that the proposed method was better than the comparison algorithms in both subjective and objective evaluation, and the restoration results were clearer and more natural.