FDDCC-VSR: a lightweight video super-resolution network based on deformable 3D convolution and cheap convolution

• Published in: The Visual computer Vol. 41; no. 5; pp. 3581 - 3593
• Main Authors: Wang, Xiaohu, Yang, Xin, Li, Hengrui, Li, Tao
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.03.2025; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Computer Graphics; Computer Science; Convolution; Deep learning; Deformation; Feature extraction; Formability; Image Processing and Computer Vision; Machine learning; Neural networks; Signal to noise ratio; Visual effects; Bicubic interpolation; Video super-resolution reconstruction; Cheap convolution; Spatial attention; Deformable 3D convolution
• ISSN: 0178-2789; 1432-2315
• DOI: 10.1007/s00371-024-03621-x

Currently, the mainstream deep video super-resolution (VSR) models typically employ deeper neural network layers or larger receptive fields. This approach increases computational requirements, making network training difficult and inefficient. Therefore, this paper proposes a VSR model called fusion of deformable 3D convolution and cheap convolution (FDDCC-VSR).In FDDCC-VSR, we first divide the detailed features of each frame in VSR into dynamic features of visual moving objects and details of static backgrounds. This division allows for the use of fewer specialized convolutions in feature extraction, resulting in a lightweight network that is easier to train. Furthermore, FDDCC-VSR incorporates multiple D-C CRBs (Convolutional Residual Blocks), which establish a lightweight spatial attention mechanism to aid deformable 3D convolution. This enables the model to focus on learning the corresponding feature details. Finally, we employ an improved bicubic interpolation combined with subpixel techniques to enhance the PSNR (Peak Signal-to-Noise Ratio) value of the original image. Detailed experiments demonstrate that FDDCC-VSR outperforms the most advanced algorithms in terms of both subjective visual effects and objective evaluation criteria. Additionally, our model exhibits a small parameter and calculation overhead.