Local-Global Feature Aggregation for Light Field Image Super-Resolution

Deep convolutional neural networks (CNNs) have been widely explored in light field (LF) image super-resolution (SR) to achieve remarkable progress. However, most of the existing CNNs-based methods ignore the similarity of local neighbor views in the 4D LF data. Besides, due to the limitations of CNN...

Full description

Saved in:
Bibliographic Details
Published inICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) pp. 2160 - 2164
Main Authors Wang, Yan, Lu, Yao, Wang, Shunzhou, Zhang, Wenyao, Wang, Zijian
Format Conference Proceeding
LanguageEnglish
Published IEEE 23.05.2022
Subjects
Acoustics
Conferences
Convolutional neural networks
feature aggregation
image super-resolution
Light field
Light fields
self-attention
Spatial resolution
Speech processing
Superresolution
Online AccessGet full text

Cover

More Information
Summary:Deep convolutional neural networks (CNNs) have been widely explored in light field (LF) image super-resolution (SR) to achieve remarkable progress. However, most of the existing CNNs-based methods ignore the similarity of local neighbor views in the 4D LF data. Besides, due to the limitations of CNNs, these methods can't fully model the global spatial properties of the whole LF images. In this paper, we propose a network with Local-Global Feature Aggregation (LF-LGFA) to handle these problems for LF image SR. Specifically, the Local Aggregation Module is designed to incorporate the local angular information by utilizing the similarity of the local neighbor views' features in LF images. Moreover, the Global Aggregation Module is designed to capture long-range spatial information via row-wise and column-wise self-attention. Extensive experimental results on five public LF datasets demonstrate that our method achieves comparable results against state-of-the-art techniques.
ISSN:2379-190X
DOI:10.1109/ICASSP43922.2022.9746199