Image super-resolution reconstruction based on improved Dirac residual network

• Published in: Multidimensional systems and signal processing Vol. 32; no. 4; pp. 1065 - 1082
• Main Authors: Yang, Xin, Xie, Tangxin, Liu, Li, Zhou, Dake
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.10.2021; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Artificial neural networks; Circuits and Systems; Electrical Engineering; Engineering; Image reconstruction; Image resolution; Mapping; Signal,Image and Speech Processing; Training; Visual effects; Deep learning; Super-resolution; Dirac residual network; Convolutional neural network
• ISSN: 0923-6082; 1573-0824
• DOI: 10.1007/s11045-021-00773-0

In recent years, to improve the nonlinear feature mapping ability of the image super-resolution network, the depth of the convolutional neural network is getting deeper and deeper. In the existing residual network, the the residual block’s output and input are added directly through the skip connection to deepen the nonlinear mapping layer. However, it can not be proved that every addition is useful to improve the network’s performance. In this paper, based on Dirac convolution, an improved Dirac residual block is proposed, which uses the trainable parameters to adaptively control the balance of the convolution and the skip connection to increase the nonlinear mapping ability of the model. The main body network uses multiple Dirac residual blocks to learn the nonlinear mapping of high-frequency information between LR and HR images. In addition, the global skip connection is realized by sub-pixel convolution, which can learn to use linear mapping of low-frequency features of input LR image. In the training stage, the model uses Adam optimizer for network training and L1 as the loss function. The experiments compare our algorithm with some other state-of-the-art models in PSNR, SSIM, IFC, and visual effect on five different benchmark datasets. The results show that the proposed model has excellent performance both in subjective and objective evaluation.