The improved image inpainting algorithm via encoder and similarity constraint

• Published in: The Visual computer Vol. 37; no. 7; pp. 1691 - 1705
• Main Authors: Chen, Yuantao, Liu, Linwu, Tao, Jiajun, Xia, Runlong, Zhang, Qian, Yang, Kai, Xiong, Jie, Chen, Xi
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.07.2021; Springer Nature B.V
• Subjects: Adaptive algorithms; Algorithms; Artificial Intelligence; Coders; Computer Graphics; Computer Science; Context; Deep learning; Dictionaries; Excitation; Image Processing and Computer Vision; Image restoration; Neural networks; Original Article; Partial differential equations; Semantics; Similarity; Teaching methods; Contextual loss function; Image inpainting; Residual network; Generative adversarial network
• ISSN: 0178-2789; 1432-2315
• DOI: 10.1007/s00371-020-01932-3

Existing image inpainting algorithms based on neural network models are affected by structural distortions and blurred textures on visible connectivity. As a result, overfitting and overlearning phenomena can easily emerge during the image inpainting procedure. Image inpainting refers to the repairing of missing parts of an image, given an image that is broken or incomplete. After the repairing operation is complete, there are obvious signs of repair in damaged areas, semantic discontinuities, and unclearness. This paper proposes an improved image inpainting method based on a new encoder combined with a context loss function. In order to obtain clear repaired images and ensure that the semantic features of images are fully learned, a generative network based on the fusion model of squeeze-and-excitation networks deep residual learning has been proposed to improve the application of network features in order to obtain clear images and reduce network parameters. At the same time, a discriminative network based on the squeeze-and-excitation residual Network has been proposed to strengthen the capability of the discriminative network. In order to make the generated image more realistic, so that the restored image will be more similar to the original image, a joint context-awareness loss training method (contextual perception loss network) has also been proposed to generate the similarity of the local features of the network constraint, with the result that the repaired image is closer to the original picture and more realistic. The experimental results can demonstrate that the proposed algorithm demonstrates better adaptive capability than the comparison algorithms on a number of image categories. In addition, the processing results of the image inpainting procedure were also superior to those of five state-of-the-art algorithms.