Online Video Deblurring via Dynamic Temporal Blending Network

• Published in: Proceedings / IEEE International Conference on Computer Vision pp. 4058 - 4067
• Main Authors: Tae Hyun Kim, Kyoung Mu Lee, Scholkopf, Bernhard, Hirsch, Michael
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2017
• Subjects: Cameras; Decoding; Dynamics; Estimation; Kernel; Network architecture; Streaming media
• ISSN: 2380-7504
• DOI: 10.1109/ICCV.2017.435

State-of-the-art video deblurring methods are capable of removing non-uniform blur caused by unwanted camera shake and/or object motion in dynamic scenes. However, most existing methods are based on batch processing and thus need access to all recorded frames, rendering them computationally demanding and time-consuming and thus limiting their practical use. In contrast, we propose an online (sequential) video deblurring method based on a spatio-temporal recurrent network that allows for realtime performance. In particular, we introduce a novel architecture which extends the receptive field while keeping the overall size of the network small to enable fast execution. In doing so, our network is able to remove even large blur caused by strong camera shake and/or fast moving objects. Furthermore, we propose a novel network layer that enforces temporal consistency between consecutive frames by dynamic temporal blending which compares and adaptively (at test time) shares features obtained at different time steps. We show the superiority of the proposed method in an extensive experimental evaluation.