Real-time video stabilization for fast-moving vehicle cameras

• Published in: Multimedia tools and applications Vol. 77; no. 1; pp. 1237 - 1260
• Main Authors: Hu, Wu-Chih, Chen, Chao-Ho, Chen, Tsong-Yi, Peng, Min-Yang, Su, Yi-Jen
• Format: Journal Article
• Language: English
• Published: New York Springer US 2018; Springer Nature B.V
• Subjects: Automotive parts; Cameras; Clusters; Compensation; Computer Communication Networks; Computer Science; Data Structures and Information Theory; Filtration; Frames; In car entertainment; Kalman filters; Multimedia Information Systems; Polar coordinates; Real time; Sequences; Shaking; Special Purpose and Application-Based Systems; Stabilization; Traffic video; Fast-moving camera; Video stabilization
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-016-4291-4

Most previous methods of real-time video stabilization are only effective for low-vibrating frames which are usually captured by in-vehicle camera at the low-speed moving. To overcome their ineffectiveness on high-vibrating frames, this paper presents a real-time video stabilization system for the video sequences captured by a fast-moving in-vehicle camera without additional sensors. The proposed method is composed of four parts: frame-shaking judgment, feature classification, evaluating global motion and rotation angle, and frame compensation. Feature points and their motion vectors are employed for judging whether the current frame is shaking or not, and then a conversion matrix is deduced through the perspective projection for classifying such feature points into background or foreground type. Next, the optical flows of background’s feature points are mapped to polar coordinates for obtaining the representative optical-flow cluster of the background. Finally, such a cluster is utilized to calculate the global motion and rotation angle for compensation followed by the Kalman filtering in order to provide the better video stabilization. Experimental results show that the proposed method has good real-time video stabilization for a vehicle camera moving at various speeds and better stabilization performance than other methods for high-vibrating frames when both real-time processing and acceptable stabilization result are considered.