Efficient Hard-Decision Quantization Using an Adaptive Deadzone Offset Model for Video Coding

• Published in: IEEE access Vol. 7; pp. 151215 - 151229
• Main Authors: Yin, Haibing, Wang, Hongkui, Huang, Xiaofeng, Yin, Huabing
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Adaptive algorithms; Classification; Coding; Coefficients; Discrete cosine transforms; Distortion; Encoding; hard decision quantization; Hardware; Mathematical models; Measurement; Offsets; Optimization; Parameters; Performance degradation; Position measurement; Quantization (signal); rate distortion optimization (RDO); Rate-distortion; Rounding; soft decision quantization; Video coding
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2019.2947260

In video coding, rate distortion optimized quantization (RDOQ), a popular version of soft-decision quantization (SDQ), achieves superior coding performance, however is ill-suited for hardware implementation due to its inherent sequential processing. On the other hand, deadzone hard-decision quantization (HDQ) is friendly to hardware implementation, however suffers from non-negligible coding performance degradation. This paper proposes a content-adaptive deadzone offset model to improve the coefficient-wise deadzone HDQ by imitating the behavior patterns of RDOQ. The contributions of this paper are characterized by twofold. On one hand, this work formulates seeking optimal deadzone offset model as a problem of binary classification, and analyzes the distribution characteristics of the optimal deadzone offsets obtained from samples by fully imitating RDOQ, and then derives adaptive deadzone offset model by maximizing the right classification probability of offset-induced rounding in HDQ. On the other hand, the distribution parameters of DCT coefficients are measured in a position-wise way, and the adaptive deadzone model is built by applying Maximum a posterior estimation method according to three characteristic parameters, i.e. quantization step size, parameter of DCT coefficients, and quantization remainder, in the sense of rate distortion optimization. Simulation results verify that the proposed adaptive HDQ algorithm, in comparison with fixed-offset HDQ, achieves 0.54% and 0.52% bit rate saving on average with almost negligible complexity increment. Simultaneously, the proposed algorithm only sacrifices smaller than 0.55% and 0.54% increment in terms of BD-BR in comparison with RDOQ. The proposed HDQ is well-suited for hardwired video coding implementation.