A novel spatial and temporal correlation integrated based motion-compensated interpolation for frame rate up-conversion

• Published in: IEEE transactions on consumer electronics Vol. 54; no. 2; pp. 863 - 869
• Main Authors: Ling, Yang, Wang, Jin, Liu, Yunqiang, Zhang, Wenjun
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.05.2008; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Asia; Bidirectional control; Correlation; Decoding; Frames; HDTV; Interpolation; Mathematical models; Motion estimation; Multimedia systems; Performance gain; Pixels; PSNR; Studies; Temporal logic; Upconversion; Videoconference
• ISSN: 0098-3063; 1558-4127
• DOI: 10.1109/TCE.2008.4560172

In this paper, a novel motion-compensated interpolation (MCI) method for frame rate up-conversion based on spatial and temporal correlation integrated is presented. Comparing to conventional MCI method, there are four main advantages of the proposed algorithm. First, the motion vectors (MVs) embedded in the bit-stream are examined and corrected by the coding-type information, the spatial correlation in the MV field and the temporal correlation in the pixel field together. Second, constant motion velocity model based MV estimation for the blocks in the interpolated frame is used to gain the initial value with consideration of the correlation of the related MV. Third, further refinement on the estimated MVs is performed based on the spatial correlation in the interpolated frame and temporal correlation in the before and after frames together. Fourth, adaptive weighted bi-directional interpolation is applied to obtain final recovered pixels using the refined MVs. Experimental results show that the proposed algorithm achieves a significant increase on PSNR and also a great improvement of visual performance over the conventional method.