Self-Supervised multi-image Super-Resolution Network for Space Image Restoration

• Published in: Journal of physics. Conference series Vol. 2347; no. 1; pp. 12021 - 12026
• Main Authors: Zhou, Junyi, Wang, Canyu, Ren, Xiaoyuan, Cao, Shenyi, Wang, Zhuang
• Format: Journal Article
• Language: English
• Published: Bristol IOP Publishing 01.09.2022
• Subjects: deep learning; deformable convolutional; Image acquisition; Image resolution; Image restoration; multi-image super-resolution; Physics; Self-supervised learning; Space applications; space object; Space surveillance
• ISSN: 1742-6588; 1742-6596
• DOI: 10.1088/1742-6596/2347/1/012021

Abstract Space-based space surveillance (SBSS) has the advantage of being flexible and highly interpretable, allowing it to play a strategic role in monitoring space targets. During actual missions, however, bursts of push-frame imaging methods, dynamic noise during observation, large motions and other factors can result in visible degradation, and it isn’t easy to have the corresponding high-resolution (HR) images for the low-resolution (LR) images acquired at the high-speed intersection, which seriously limits the existing multi-image super-resolution (MISR) methods for space-based applications. To overcome these problems, this paper proposes a self-supervised video super-resolution deep learning method that can be trained end-to-end in space-based observations without LR/HR image pairs. We generate extra training pairs using different sizes of sampling factors for LR videos and train the video hyper-resolution network from coarse to fine using a pyramid format. Extensive experiments on the public satellite dataset BUAA-SID-share1.0 show that our approach outperforms traditional video hyper-resolution methods.