Frame rate up-conversion with true motion estimation and adaptive motion vector refinement

• Published in: 2011 4th International Congress on Image and Signal Processing Vol. 1; pp. 353 - 356
• Main Authors: Chong Xu, Yingqi Chen, Zhiyong Gao, Yizhou Ye, Tuo Shan
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2011
• Subjects: block-matching algorithm; Frame rate up-conversion; Motion compensation; Motion estimation; motion vector field; PSNR; smooth resampling; Support vector machine classification; Tracking; true motion estimation; Vectors; Visualization
• ISBN: 1424493048; 9781424493043
• DOI: 10.1109/CISP.2011.6100010

Frame rate up-conversion is a useful post processing technique to enhance the visual quality of low frame rate video materials. In this paper, we propose a novel frame rate up-conversion algorithm utilizing true motion estimation and adaptive motion vector refinement. First, block-matching algorithm (BMA) based on an efficient motion similarity constrained criterion is employed to track the true motion between adjacent frames and produce a preliminary intermediate motion vector field (MVF).We then classify the intermediate motion vectors into two categories, isolated group and connected group adaptively by motion clustering. A smooth resampling method is later applied to connected group to obtain consistent motion, while isolated motion vectors are re-estimated with bilateral edge-weighted block decomposition (BEWBD). Finally, overlapped block motion compensation (OBMC) is adopted to interpolate the intermediate frame. Extensive experimental results show that the proposed algorithm outperforms conventional methods both subjectively and objectively.