Motion Compensated Three-Dimensional Frequency Selective Extrapolation for improved error concealment in video communication

• Published in: Journal of visual communication and image representation Vol. 22; no. 3; pp. 213 - 225
• Main Authors: Seiler, Jürgen, Kaup, André
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.04.2011
• Subjects: Algorithms; Channels; Distortion; Error concealment; Errors; Extrapolation; Frequency selective extrapolation; Gain; Hybrid video coding; Image restoration; Motion compensation; Noise levels; Signal extrapolation; Sparse modeling; Video communication; Frequency selective extrapolation; Video communication; Hybrid video coding; Signal extrapolation; Sparse modeling; Error concealment; Motion compensation; Image restoration
• ISSN: 1047-3203; 1095-9076
• DOI: 10.1016/j.jvcir.2010.11.006

RHtriangle Motion estimation and compensation enhance 3D Frequency Selective Extrapolation. RHtriangle Error concealment quality increases with motion estimation accuracy. RHtriangle Many error concealment algorithms can be improved by fractional-pel motion compensation. RHtriangle Orthogonality deficiency compensation can be successfully extended to higher dimensions. During transmission of video data over error-prone channels the risk of getting severe image distortions due to transmission errors is ubiquitous. To deal with image distortions at decoder side, error concealment is applied. This article presents Motion Compensated Three-Dimensional Frequency Selective Extrapolation, a novel spatio-temporal error concealment algorithm. The algorithm uses fractional-pel motion estimation and compensation as initial step, being followed by the generation of a model of the distorted signal. The model generation is conducted by an enhanced version of Three-Dimensional Frequency Selective Extrapolation, an existing error concealment algorithm. Compared to this existent algorithm, the proposed one yields an improvement in concealment quality of up to 1.64 dB PSNR. Altogether, the incorporation of motion compensation and the improved model generation extends the already high extrapolation quality of the underlying Frequency Selective Extrapolation, resulting in a gain of more than 3 dB compared to other well-known error concealment algorithms.