Revolution: A Spatial-specific Convolution for Image Super-Resolution
Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation ability. However, most existing SR methods mainly use standard convolution in each layer, neglecting to explore the various feature of spatial dom...
Saved in:
Published in | 2021 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) pp. 290 - 293 |
---|---|
Main Authors | , , , , , |
Format | Conference Proceeding |
Language | English |
Published |
IEEE
01.05.2021
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation ability. However, most existing SR methods mainly use standard convolution in each layer, neglecting to explore the various feature of spatial domain. Standard convolution focuses on spatial invariance by using the same convolution kernel in space. It deprives kernels of the ability to adapt the different spatial positions, hence hindering the diverse of feature. Later, a new convolution operator, Involution, was proposed to implement spatial-specific convolution. But it calculated the convolution kernel parameters of surrounding pixels only by utilizing the characteristics of the central pixel, which was unreasonable and limited its performance. To address these issues, in this paper, we propose a novel convolution named Revolution, which not only incorporates spatial-specific to capture different spatial information, but also considers the relevance of the pixels to determine convolution kernel parameters to further learn more realistic feature representations. On the other hand, the Revolution we proposed makes the number of parameters smaller. Experiments demonstrate that our method obtains obvious improvement in terms of indicators and visual effects. |
---|---|
AbstractList | Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation ability. However, most existing SR methods mainly use standard convolution in each layer, neglecting to explore the various feature of spatial domain. Standard convolution focuses on spatial invariance by using the same convolution kernel in space. It deprives kernels of the ability to adapt the different spatial positions, hence hindering the diverse of feature. Later, a new convolution operator, Involution, was proposed to implement spatial-specific convolution. But it calculated the convolution kernel parameters of surrounding pixels only by utilizing the characteristics of the central pixel, which was unreasonable and limited its performance. To address these issues, in this paper, we propose a novel convolution named Revolution, which not only incorporates spatial-specific to capture different spatial information, but also considers the relevance of the pixels to determine convolution kernel parameters to further learn more realistic feature representations. On the other hand, the Revolution we proposed makes the number of parameters smaller. Experiments demonstrate that our method obtains obvious improvement in terms of indicators and visual effects. |
Author | Sun, Jifeng Zhang, Qi Li, Yinggang Zhao, Shuai Hu, Junwei Lin, Yibin |
Author_xml | – sequence: 1 givenname: Qi surname: Zhang fullname: Zhang, Qi email: zhangq623@foxmail.com organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China – sequence: 2 givenname: Jifeng surname: Sun fullname: Sun, Jifeng email: ecjfsun@scut.edu.cn organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China – sequence: 3 givenname: Yinggang surname: Li fullname: Li, Yinggang email: 201920111231@mail.scut.edu.cn organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China – sequence: 4 givenname: Junwei surname: Hu fullname: Hu, Junwei email: junwei_hu@foxmail.com organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China – sequence: 5 givenname: Shuai surname: Zhao fullname: Zhao, Shuai email: alec_97@163.com organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China – sequence: 6 givenname: Yibin surname: Lin fullname: Lin, Yibin email: linyibinl997@126.com organization: School of Electronic and Information Engineering South China University of Technology,Guangzhou,China |
BookMark | eNo1zM1Kw0AUQOER7EJrn0AX8wKJ83dvZtyFEDVQEFq7LtPxjgykSUhSwbe3YLs6iw_OPbvt-o4Ye5Iil1K457KpS9AKRa6EkrkQAu0NW7nCSkQwZwF7x-oN_fTtaU5998JLvh38nHybTQOFFFPgVd9dncd-5M3RfxPfngYasw1NF3pgi-jbiVaXLtnutf6s3rP1x1tTlessSWnnzAp1kFZR1F_OGO8IVNDBIx7QAbooNYbCWAtYQOE9kMJAJmoPMZwd9JI9_n8TEe2HMR39-Lt3oACs1X_7Skid |
CODEN | IEEPAD |
ContentType | Conference Proceeding |
DBID | 6IE 6IL CBEJK RIE RIL |
DOI | 10.1109/AIEA53260.2021.00068 |
DatabaseName | IEEE Electronic Library (IEL) Conference Proceedings IEEE Xplore POP ALL IEEE Xplore All Conference Proceedings IEEE Electronic Library (IEL) - NZ IEEE Proceedings Order Plans (POP All) 1998-Present |
DatabaseTitleList | |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
EISBN | 9781665432658 1665432659 |
EndPage | 293 |
ExternalDocumentID | 9525588 |
Genre | orig-research |
GrantInformation_xml | – fundername: National Natural Science Foundation of China funderid: 10.13039/501100001809 |
GroupedDBID | 6IE 6IL CBEJK RIE RIL |
ID | FETCH-LOGICAL-i118t-802b182ef3d944a9e52c3ca66b69569f136c748856757aa5e26ce4f3a5fc56953 |
IEDL.DBID | RIE |
IngestDate | Thu Jun 29 18:37:49 EDT 2023 |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-i118t-802b182ef3d944a9e52c3ca66b69569f136c748856757aa5e26ce4f3a5fc56953 |
PageCount | 4 |
ParticipantIDs | ieee_primary_9525588 |
PublicationCentury | 2000 |
PublicationDate | 2021-May |
PublicationDateYYYYMMDD | 2021-05-01 |
PublicationDate_xml | – month: 05 year: 2021 text: 2021-May |
PublicationDecade | 2020 |
PublicationTitle | 2021 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA) |
PublicationTitleAbbrev | AIEA |
PublicationYear | 2021 |
Publisher | IEEE |
Publisher_xml | – name: IEEE |
Score | 1.7734374 |
Snippet | Recently, deep convolution neural networks achieve remarked performance in single image super-resolution(SISR) due to their strong feature representation... |
SourceID | ieee |
SourceType | Publisher |
StartPage | 290 |
SubjectTerms | Automation Convolution Deep Convolution Neural Networks Kernel Neural networks Spatial resolution Spatial-specific Super-resolution Superresolution Visual effects |
Title | Revolution: A Spatial-specific Convolution for Image Super-Resolution |
URI | https://ieeexplore.ieee.org/document/9525588 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LSwMxEA5tT55UWvFNDh5Nu7t5bOOtSEsrVEQt9FaS7AREbEvZ7cFf72R3W0U8eAsZQjY7yc582flmCLnRkntlvWRSxJqJTKfMSLCBwAwm6lvtdeA7Tx_VeCYe5nLeILd7LgwAlMFn0A3N8l9-tnJFuCrraYkOcL_fJE0EbhVXq2bDxZHuDSbDgURvJELUl8QhMWHIn_qjZkppMkaHZLqbrIoUee8Wue26z195GP_7NEek803Oo097s3NMGrBsk-EzbOtNdEcHNBQaxo3FAo8yxAJRHLuTU3RT6eQDvyP0pVjDhoUb_ErUIbPR8PV-zOoKCewNgUGO5iWxCBDA80wLYTTIxHFnlLIKcY_2MVcuxSMqERakBpWQKAfCcyO9Q7nkJ6S1XC3hlFBjOc8sREZbREjamhSMgNgkwQW0Mjkj7fAKFusqCcaiXv35390X5CAooYoMvCStfFPAFVrv3F6XavsCKR6cAg |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1NT8JAEJ0gHvSkBozf7sGjhbbbbbveiIGAAjEKCTeyu50mxgiEtB789c62BY3x4K3pZNOP2e2bt503A3AjBU9DnQpHBJ50gkRGjhKorYAZlRtrmUqrdx6Nw_40eJiJWQ1ut1oYRCySz7BlD4t_-cnS5HarrC0FBcBxvAO7hPvCL9ValR7Oc2W7M-h2BMUjLvE-37OlCW0F1R9dUwrQ6B3AaHO5MlfkrZVnumU-f1Vi_O_9HELzW57HnrbAcwQ1XDSg-4wf1TS6Yx1mWw3T1HKsktJmAzEau7EzClTZ4J2-JOwlX-HasXv4pakJ0153ct93qh4JzitRg4wAxtdEETDliQwCJVH4hhsVhjok5iNTj4cmokUqiBhEitzghwaDlCuRGrILfgz1xXKBJ8CU5jzR6CqpiSNJrSJUAXrKt0GgFv4pNOwrmK_KMhjz6unP_j59DXv9yWg4Hw7Gj-ewbx1S5gleQD1b53hJWJ7pq8KFX4ANn0w |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2021+International+Conference+on+Artificial+Intelligence+and+Electromechanical+Automation+%28AIEA%29&rft.atitle=Revolution%3A+A+Spatial-specific+Convolution+for+Image+Super-Resolution&rft.au=Zhang%2C+Qi&rft.au=Sun%2C+Jifeng&rft.au=Li%2C+Yinggang&rft.au=Hu%2C+Junwei&rft.date=2021-05-01&rft.pub=IEEE&rft.spage=290&rft.epage=293&rft_id=info:doi/10.1109%2FAIEA53260.2021.00068&rft.externalDocID=9525588 |