Revolution: A Spatial-specific Convolution for Image Super-Resolution

Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation ability. However, most existing SR methods mainly use standard convolution in each layer, neglecting to explore the various feature of spatial dom...

Full description

Saved in:
Bibliographic Details
Published in2021 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) pp. 290 - 293
Main Authors Zhang, Qi, Sun, Jifeng, Li, Yinggang, Hu, Junwei, Zhao, Shuai, Lin, Yibin
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2021
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation ability. However, most existing SR methods mainly use standard convolution in each layer, neglecting to explore the various feature of spatial domain. Standard convolution focuses on spatial invariance by using the same convolution kernel in space. It deprives kernels of the ability to adapt the different spatial positions, hence hindering the diverse of feature. Later, a new convolution operator, Involution, was proposed to implement spatial-specific convolution. But it calculated the convolution kernel parameters of surrounding pixels only by utilizing the characteristics of the central pixel, which was unreasonable and limited its performance. To address these issues, in this paper, we propose a novel convolution named Revolution, which not only incorporates spatial-specific to capture different spatial information, but also considers the relevance of the pixels to determine convolution kernel parameters to further learn more realistic feature representations. On the other hand, the Revolution we proposed makes the number of parameters smaller. Experiments demonstrate that our method obtains obvious improvement in terms of indicators and visual effects.
AbstractList Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation ability. However, most existing SR methods mainly use standard convolution in each layer, neglecting to explore the various feature of spatial domain. Standard convolution focuses on spatial invariance by using the same convolution kernel in space. It deprives kernels of the ability to adapt the different spatial positions, hence hindering the diverse of feature. Later, a new convolution operator, Involution, was proposed to implement spatial-specific convolution. But it calculated the convolution kernel parameters of surrounding pixels only by utilizing the characteristics of the central pixel, which was unreasonable and limited its performance. To address these issues, in this paper, we propose a novel convolution named Revolution, which not only incorporates spatial-specific to capture different spatial information, but also considers the relevance of the pixels to determine convolution kernel parameters to further learn more realistic feature representations. On the other hand, the Revolution we proposed makes the number of parameters smaller. Experiments demonstrate that our method obtains obvious improvement in terms of indicators and visual effects.
Author Sun, Jifeng
Zhang, Qi
Li, Yinggang
Zhao, Shuai
Hu, Junwei
Lin, Yibin
Author_xml – sequence: 1
  givenname: Qi
  surname: Zhang
  fullname: Zhang, Qi
  email: zhangq623@foxmail.com
  organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China
– sequence: 2
  givenname: Jifeng
  surname: Sun
  fullname: Sun, Jifeng
  email: ecjfsun@scut.edu.cn
  organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China
– sequence: 3
  givenname: Yinggang
  surname: Li
  fullname: Li, Yinggang
  email: 201920111231@mail.scut.edu.cn
  organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China
– sequence: 4
  givenname: Junwei
  surname: Hu
  fullname: Hu, Junwei
  email: junwei_hu@foxmail.com
  organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China
– sequence: 5
  givenname: Shuai
  surname: Zhao
  fullname: Zhao, Shuai
  email: alec_97@163.com
  organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China
– sequence: 6
  givenname: Yibin
  surname: Lin
  fullname: Lin, Yibin
  email: linyibinl997@126.com
  organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China
BookMark eNo1zM1Kw0AUQOER7EJrn0AX8wKJ83dvZtyFEDVQEFq7LtPxjgykSUhSwbe3YLs6iw_OPbvt-o4Ye5Iil1K457KpS9AKRa6EkrkQAu0NW7nCSkQwZwF7x-oN_fTtaU5998JLvh38nHybTQOFFFPgVd9dncd-5M3RfxPfngYasw1NF3pgi-jbiVaXLtnutf6s3rP1x1tTlessSWnnzAp1kFZR1F_OGO8IVNDBIx7QAbooNYbCWAtYQOE9kMJAJmoPMZwd9JI9_n8TEe2HMR39-Lt3oACs1X_7Skid
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/AIEA53260.2021.00068
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL) - NZ
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781665432658
1665432659
EndPage 293
ExternalDocumentID 9525588
Genre orig-research
GrantInformation_xml – fundername: National Natural Science Foundation of China
  funderid: 10.13039/501100001809
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-LOGICAL-i118t-802b182ef3d944a9e52c3ca66b69569f136c748856757aa5e26ce4f3a5fc56953
IEDL.DBID RIE
IngestDate Thu Jun 29 18:37:49 EDT 2023
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i118t-802b182ef3d944a9e52c3ca66b69569f136c748856757aa5e26ce4f3a5fc56953
PageCount 4
ParticipantIDs ieee_primary_9525588
PublicationCentury 2000
PublicationDate 2021-May
PublicationDateYYYYMMDD 2021-05-01
PublicationDate_xml – month: 05
  year: 2021
  text: 2021-May
PublicationDecade 2020
PublicationTitle 2021 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA)
PublicationTitleAbbrev AIEA
PublicationYear 2021
Publisher IEEE
Publisher_xml – name: IEEE
Score 1.7734374
Snippet Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation...
SourceID ieee
SourceType Publisher
StartPage 290
SubjectTerms Automation
Convolution
Deep Convolution Neural Networks
Kernel
Neural networks
Spatial resolution
Spatial-specific
Super-resolution
Superresolution
Visual effects
Title Revolution: A Spatial-specific Convolution for Image Super-Resolution
URI https://ieeexplore.ieee.org/document/9525588
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LSwMxEA5tT55UWvFNDh5Nu7t5bOOtSEsrVEQt9FaS7AREbEvZ7cFf72R3W0U8eAsZQjY7yc582flmCLnRkntlvWRSxJqJTKfMSLCBwAwm6lvtdeA7Tx_VeCYe5nLeILd7LgwAlMFn0A3N8l9-tnJFuCrraYkOcL_fJE0EbhVXq2bDxZHuDSbDgURvJELUl8QhMWHIn_qjZkppMkaHZLqbrIoUee8Wue26z195GP_7NEek803Oo097s3NMGrBsk-EzbOtNdEcHNBQaxo3FAo8yxAJRHLuTU3RT6eQDvyP0pVjDhoUb_ErUIbPR8PV-zOoKCewNgUGO5iWxCBDA80wLYTTIxHFnlLIKcY_2MVcuxSMqERakBpWQKAfCcyO9Q7nkJ6S1XC3hlFBjOc8sREZbREjamhSMgNgkwQW0Mjkj7fAKFusqCcaiXv35390X5CAooYoMvCStfFPAFVrv3F6XavsCKR6cAg
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1NT8JAEJ0gHvSkBozf7sGjhbbbbbveiIGAAjEKCTeyu50mxgiEtB789c62BY3x4K3pZNOP2e2bt503A3AjBU9DnQpHBJ50gkRGjhKorYAZlRtrmUqrdx6Nw_40eJiJWQ1ut1oYRCySz7BlD4t_-cnS5HarrC0FBcBxvAO7hPvCL9ValR7Oc2W7M-h2BMUjLvE-37OlCW0F1R9dUwrQ6B3AaHO5MlfkrZVnumU-f1Vi_O_9HELzW57HnrbAcwQ1XDSg-4wf1TS6Yx1mWw3T1HKsktJmAzEau7EzClTZ4J2-JOwlX-HasXv4pakJ0153ct93qh4JzitRg4wAxtdEETDliQwCJVH4hhsVhjok5iNTj4cmokUqiBhEitzghwaDlCuRGrILfgz1xXKBJ8CU5jzR6CqpiSNJrSJUAXrKt0GgFv4pNOwrmK_KMhjz6unP_j59DXv9yWg4Hw7Gj-ewbx1S5gleQD1b53hJWJ7pq8KFX4ANn0w
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2021+International+Conference+on+Artificial+Intelligence+and+Electromechanical+Automation+%28AIEA%29&rft.atitle=Revolution%3A+A+Spatial-specific+Convolution+for+Image+Super-Resolution&rft.au=Zhang%2C+Qi&rft.au=Sun%2C+Jifeng&rft.au=Li%2C+Yinggang&rft.au=Hu%2C+Junwei&rft.date=2021-05-01&rft.pub=IEEE&rft.spage=290&rft.epage=293&rft_id=info:doi/10.1109%2FAIEA53260.2021.00068&rft.externalDocID=9525588