Image compressed sensing reconstruction network based on self-attention mechanism

For image compression sensing reconstruction, most algorithms use the method of reconstructing image blocks one by one and stacking many convolutional layers, which usually have defects of obvious block effects, high computational complexity, and long reconstruction time. An image compressed sensing reconstruction network based on self-attention mechanism (SAMNet) was proposed. For the compressed sampling, self-attention convolution was designed, which was conducive to capturing richer features, so that the compressed sensing measurement value retained more image structure information. For the reconstruction, a self-attention mechanism was introduced in the convolutional neural network. A reconstruction network including residual blocks, bottleneck transformer (BoTNet), and dense blocks was proposed, which strengthened the transfer of image features and reduced the amount of parameters dramatically. Under the Set5 dataset, when the measurement rates are 0.01, 0.04, 0.10, and 0.25, the average peak signal-to-noise ratio (PSNR) of SAMNet is improved by 1.27, 1.23, 0.50, and 0.15 dB, respectively, compared to the CSNet+. The running time of reconstructing a <inline-formula><alternatives><math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M1"><mn mathvariant="normal">256</mn><mo>×</mo><mn mathvariant="normal">256</mn></math><graphic specific-use="big" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="alternativeImage/1DF2CD7E-3346-4a7a-A8B8-BCBEC990C522-M001.jpg"><?fx-imagestate width="13.71599960" height="2.37066650"?></graphic><graphic specific-use="small" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="alternativeImage/1DF2CD7E-3346-4a7a-A8B8-BCBEC990C522-M001c.jpg"><?fx-imagestate width="13.71599960" height="2.37066650"?></graphic></alternatives></inline-formula> image is reduced by 0.147 3, 0.178 9, 0.231 0, and 0.252 4 s compared to ReconNet. Experimental results showed that SAMNet improved the quality of reconstructed images and reduced the reconstruction time.