Advanced digital image stabilization using similarity-constrained optimization

• Published in: Multimedia tools and applications Vol. 78; no. 12; pp. 16489 - 16506
• Main Authors: Pae, Dong Sung, An, Chi Gun, Kang, Tae Koo, Lim, Myo Taeg
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.06.2019; Springer Nature B.V
• Subjects: Advantages; Algorithms; Camcorders; Cluster analysis; Clustering; Computer Communication Networks; Computer Science; Computer vision; Data analysis; Data Structures and Information Theory; Digital cameras; Digital imaging; Image stabilizers; Multimedia Information Systems; Optimization; Photojournalism; Portable equipment; Similarity; Special Purpose and Application-Based Systems; Stabilization; Transformations; Vector quantization; K-means; MSURF; Image stabilization
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-018-6932-2

As many people have portable video devices such as cameras on cell phones and camcorders, image stabilization technique is a crucial and challenging task in computer vision applications, and many image stabilization techniques have been researched over many years. We propose a digital image stabilization method that only uses a software algorithm without additional hardware devices. Furthermore, a novel digital image stabilization method composed of three steps that use similarity-constrained nonlinear optimizer is introduced and applied to many unstabilized videos. First, a feature detection technique called moment-based speeded-up robust features (MSURF) is utilized to obtain the transformation matrix. Second, the k-means clustering algorithm is used to detect and remove some of the outliers that cause residual errors during feature matching. Third, the transformation matrix is optimized using nonlinear optimization algorithms to maintain the similarity of the transformation matrix. The experimental results prove that the proposed algorithm provides accurate image stabilization performance.