Joint Graph Attention and Asymmetric Convolutional Neural Network for Deep Image Compression

• Published in: IEEE transactions on circuits and systems for video technology Vol. 33; no. 1; pp. 421 - 433
• Main Authors: Tang, Zhisen, Wang, Hanli, Yi, Xiaokai, Zhang, Yun, Kwong, Sam, Kuo, C.-C. Jay
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.01.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial neural networks; asymmetric convolutional neural network; Asymmetry; Convolution; Convolutional neural networks; graph attention network; Image coding; Image compression; Information flow; Kernel; Modelling; Neural networks; Rate-distortion; Representations; self-attention; Source code; Training; variational autoencoder; Visualization
• DOI: 10.1109/TCSVT.2022.3199472
• ISSN: 1051-8215

Recent deep image compression methods have achieved prominent progress by using nonlinear modeling and powerful representation capabilities of neural networks. However, most existing learning-based image compression approaches employ customized convolutional neural network (CNN) to utilize visual features by treating all pixels equally, neglecting the effect of local key features. Meanwhile, the convolutional filters in CNN usually express the local spatial relationship within the receptive field and seldom consider the long-range dependencies from distant locations. This results in the long-range dependencies of latent representations not being fully compressed. To address these issues, an end-to-end image compression method is proposed by integrating graph attention and asymmetric convolutional neural network (ACNN). Specifically, ACNN is used to strengthen the effect of local key features and reduce the cost of model training. Graph attention is introduced into image compression to address the bottleneck problem of CNN in modeling long-range dependencies. Meanwhile, regarding the limitation that existing attention mechanisms for image compression hardly share information, we propose a self-attention approach which allows information flow to achieve reasonable bit allocation. The proposed self-attention approach is in compliance with the perceptual characteristics of human visual system, as information can interact with each other via attention modules. Moreover, the proposed self-attention approach takes into account channel-level relationship and positional information to promote the compression effect of rich-texture regions. Experimental results demonstrate that the proposed method achieves state-of-the-art rate-distortion performances after being optimized by MS-SSIM compared to recent deep compression models on the benchmark datasets of Kodak and Tecnick. The project page with the source code can be found in https://mic.tongji.edu.cn .