Context-Adaptive Neural Network-Based Prediction for Image Compression

• Published in: IEEE transactions on image processing Vol. 29; pp. 679 - 693
• Main Authors: Dumas, Thierry, Roumy, Aline, Guillemot, Christine
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE); Institute of Electrical and Electronics Engineers
• Subjects: Artificial neural networks; Biological neural networks; Codec; Computer Science; Convolutional neural networks; Decoding; Image coding; Image compression; Image Processing; intra prediction; Masks; Neural and Evolutionary Computing; Neural networks; Predictions; Predictive models; Training; Intra prediction; Neural Network; Image compression
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2019.2934565

This paper describes a set of neural network architectures, called Prediction Neural Networks Set (PNNS), based on both fully-connected and convolutional neural networks, for intra image prediction. The choice of neural network for predicting a given image block depends on the block size, hence does not need to be signalled to the decoder. It is shown that, while fully-connected neural networks give good performance for small block sizes, convolutional neural networks provide better predictions in large blocks with complex textures. Thanks to the use of masks of random sizes during training, the neural networks of PNNS well adapt to the available context that may vary, depending on the position of the image block to be predicted. When integrating PNNS into a H.265 codec, PSNR-rate performance gains going from 1.46% to 5.20% are obtained. These gains are on average 0.99% larger than those of prior neural network based methods. Unlike the H.265 intra prediction modes, which are each specialized in predicting a specific texture, the proposed PNNS can model a large set of complex textures.