Reducing 3D video coding complexity through more efficient disparity estimation

• Published in: IEEE transactions on consumer electronics Vol. 60; no. 1; pp. 74 - 82
• Main Authors: Micallef, Brian W., Debono, Carl J., Farrugia, Reuben A.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.02.2014; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: 3D video coding; Coding; Computation; Computational efficiency; disparity estimation; Encoding; Estimation; fast disparity estimation; fast mode selection; Mathematical analysis; multi-view video coding; Searching; Surface layer; Texture; Three dimensional; Three-dimensional displays; Vectors; Vectors (mathematics); Video coding; Voltage control
• ISSN: 0098-3063; 1558-4127
• DOI: 10.1109/TCE.2014.6780928

3D video coding for transmission exploits the Disparity Estimation (DE) to remove the inter-view redundancies present within both the texture and the depth map multi-view videos. Good estimation accuracy can be achieved by partitioning the macro-block into smaller subblocks partitions. However, the DE process must be performed on each individual sub-block to determine the optimal mode and their disparity vectors, in terms of rate-distortion efficiency. This vector estimation process is heavy on computational resources, thus, the coding computational cost becomes proportional to the number of search points and the inter-view modes tested during the rate-distortion optimization. In this paper, a solution that exploits the available depth map data, together with the multi-view geometry, is proposed to identify a better DE search area; such that it allows a reduction in its search points. It also exploits the number of different depth levels present within the current macro-block to determine which modes can be used for DE to further reduce its computations. Simulation results demonstrate that this can save up to 95% of the encoding time, with little influence on the coding efficiency of the texture and the depth map multi-view video coding. This makes 3D video coding more practical for any consumer devices, which tend to have limited computational power.