Real‐Time Video Deblurring via Lightweight Motion Compensation

• Published in: Computer graphics forum Vol. 41; no. 7; pp. 177 - 188
• Main Authors: Son†, Hyeongseok, Lee†, Junyong, Cho, Sunghyun, Lee, Seungyong
• Format: Journal Article
• Language: English
• Published: Oxford Blackwell Publishing Ltd 01.10.2022
• Subjects: CCS Concepts; Computing methodologies → Computational photography; Lightweight; Motion compensation; Optical disks
• ISSN: 0167-7055; 1467-8659
• DOI: 10.1111/cgf.14667

While motion compensation greatly improves video deblurring quality, separately performing motion compensation and video deblurring demands huge computational overhead. This paper proposes a real‐time video deblurring framework consisting of a lightweight multi‐task unit that supports both video deblurring and motion compensation in an efficient way. The multi‐task unit is specifically designed to handle large portions of the two tasks using a single shared network and consists of a multi‐task detail network and simple networks for deblurring and motion compensation. The multi‐task unit minimizes the cost of incorporating motion compensation into video deblurring and enables real‐time deblurring. Moreover, by stacking multiple multi‐task units, our framework provides flexible control between the cost and deblurring quality. We experimentally validate the state‐of‐the‐art deblurring quality of our approach, which runs at a much faster speed compared to previous methods and show practical real‐time performance (30.99dB@30fps measured on the DVD dataset).