Underwater Image High Definition Display Using the Multilayer Perceptron and Color Feature-Based SRCNN

High-definition display technology for underwater images is of great significance for many applications, such as marine animal observation, seabed mining, and marine fishery production. The traditional underwater visual display systems have problems, such as low visibility, poor real-time performanc...

Full description

Saved in:
Bibliographic Details
Published inIEEE access Vol. 7; pp. 83721 - 83728
Main Authors Li, Yujie, Ma, Chunyan, Zhang, Tingting, Li, Jianru, Ge, Zongyuan, Li, Yun, Serikawa, Seiichi
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 2019
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text

Cover

Loading…
Abstract High-definition display technology for underwater images is of great significance for many applications, such as marine animal observation, seabed mining, and marine fishery production. The traditional underwater visual display systems have problems, such as low visibility, poor real-time performance, and low resolution, and cannot meet the needs of real-time high-definition displays in extreme environments. To solve these issues, we propose an underwater image enhancement method and a corresponding image super-resolution algorithm. To improve the quality of underwater images, we modify the Retinex algorithm and combine it with a neural network. The Retinex algorithm is used to defog the underwater image, and then, the image brightness is improved by applying gamma correction. Then, by combining with the dark channel prior and multilayer perceptron, the transmission map is further refined to improve the dynamic range of the image. In the super-resolution process, the current convolutional neural network reconstruction algorithm is only trained on the Y channel, which will lead to problems due to the insufficient acquisition of the color feature. Therefore, an image super-resolution reconstruction algorithm that is based on color features is proposed. The experimental results show that the proposed method improves the reconstruction effect of the image edges and texture details, increases the image clarity, and enhances the image color recovery.
AbstractList High-definition display technology for underwater images is of great significance for many applications, such as marine animal observation, seabed mining, and marine fishery production. The traditional underwater visual display systems have problems, such as low visibility, poor real-time performance, and low resolution, and cannot meet the needs of real-time high-definition displays in extreme environments. To solve these issues, we propose an underwater image enhancement method and a corresponding image super-resolution algorithm. To improve the quality of underwater images, we modify the Retinex algorithm and combine it with a neural network. The Retinex algorithm is used to defog the underwater image, and then, the image brightness is improved by applying gamma correction. Then, by combining with the dark channel prior and multilayer perceptron, the transmission map is further refined to improve the dynamic range of the image. In the super-resolution process, the current convolutional neural network reconstruction algorithm is only trained on the Y channel, which will lead to problems due to the insufficient acquisition of the color feature. Therefore, an image super-resolution reconstruction algorithm that is based on color features is proposed. The experimental results show that the proposed method improves the reconstruction effect of the image edges and texture details, increases the image clarity, and enhances the image color recovery.
Author Li, Yun
Ma, Chunyan
Li, Jianru
Serikawa, Seiichi
Ge, Zongyuan
Zhang, Tingting
Li, Yujie
Author_xml – sequence: 1
  givenname: Yujie
  orcidid: 0000-0002-0275-2797
  surname: Li
  fullname: Li, Yujie
  email: yzyjli@gmail.com
  organization: School of Information Engineering, Yangzhou University, Yangzhou, China
– sequence: 2
  givenname: Chunyan
  surname: Ma
  fullname: Ma, Chunyan
  organization: School of Information Engineering, Yangzhou University, Yangzhou, China
– sequence: 3
  givenname: Tingting
  surname: Zhang
  fullname: Zhang, Tingting
  organization: School of Information Engineering, Yangzhou University, Yangzhou, China
– sequence: 4
  givenname: Jianru
  surname: Li
  fullname: Li, Jianru
  email: lijianru@tongji.edu.cn
  organization: State Key Laboratory on Marine Geology, Tongji University, Shanghai, China
– sequence: 5
  givenname: Zongyuan
  surname: Ge
  fullname: Ge, Zongyuan
  organization: NVIDIA AI Technology Centre, Monash University, Melbourne, VIC, Australia
– sequence: 6
  givenname: Yun
  surname: Li
  fullname: Li, Yun
  organization: School of Information Engineering, Yangzhou University, Yangzhou, China
– sequence: 7
  givenname: Seiichi
  surname: Serikawa
  fullname: Serikawa, Seiichi
  organization: School of Engineering, Kyushu Institute of Technology, Kitakyushu, Japan
BookMark eNpNkUtP3DAUha2KSqXAL2BjqetM_Ygde0kDlJF4VAyztm6Sm8GjEE_tjBD_vp4GIbywreNzzrX0fSdHYxiRkHPOFpwz-_Oirq9Wq4Vg3C6EFUow-4UcC65tIZXUR5_u38hZSluWl8mSqo5Jvx47jK8wYaTLF9ggvfGbZ3qJvR_95MNIL33aDfBG18mPGzo9I73bD5PPUo78wdjiborZB2NH6zCESK8Rpn3E4hck7Ojqsb6_PyVfexgSnr2fJ2R9ffVU3xS3D7-X9cVt0ZbMTAVvhRBGWOxASVY2CroWhO2Y5lUlQenDO9heSiMZNH2jWcdl1ffGQCNKJk_Icu7tAmzdLvoXiG8ugHf_hRA3DuLk2wEdl8oAa1rQ3OThaLU2JQjWGxR5l7nrx9y1i-HvHtPktmEfx_x9J0qltKiY0tklZ1cbQ0oR-4-pnLkDHzfzcQc-7p1PTp3PKY-IHwlTlVpkTv8AnQ2L9w
CODEN IAECCG
CitedBy_id crossref_primary_10_1007_s11042_021_10740_3
crossref_primary_10_1109_ACCESS_2024_3351730
crossref_primary_10_1038_s41377_022_00714_x
crossref_primary_10_1145_3511021
crossref_primary_10_1109_TED_2022_3166745
crossref_primary_10_1016_j_image_2020_116088
crossref_primary_10_1364_OE_488781
crossref_primary_10_1007_s00138_021_01230_5
crossref_primary_10_1364_OE_413164
crossref_primary_10_1364_OE_482489
Cites_doi 10.1109/CISP.2010.5647190
10.1109/TIP.2005.851684
10.1007/s11045-007-0023-2
10.1364/JOSAA.9.001914
10.1109/ICCV.2009.5459271
10.1109/TIP.2010.2050625
10.1016/j.compeleceng.2013.10.016
10.1109/MWC.2019.1800325
10.1109/83.557356
10.1007/978-3-319-27671-7_34
10.1364/JOSAA.6.001715
10.1109/ICoSP.2012.6491708
10.1109/TIP.2002.806234
10.1109/TIP.2012.2190080
10.1109/ICIP.2003.1247332
10.1109/TIP.2012.2226047
10.1016/j.future.2018.01.001
10.1109/SIU.2014.6830288
10.1109/IVMSPW.2016.7528224
10.1109/JOE.2015.2469915
10.1109/ICPR.1990.119340
10.1117/1.JEI.27.4.043022
10.1007/978-3-319-10593-2_13
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019
DBID 97E
ESBDL
RIA
RIE
AAYXX
CITATION
7SC
7SP
7SR
8BQ
8FD
JG9
JQ2
L7M
L~C
L~D
DOA
DOI 10.1109/ACCESS.2019.2925209
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005-present
IEEE Open Access Journals
IEEE All-Society Periodicals Package (ASPP) 1998-Present
IEEE/IET Electronic Library
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Engineered Materials Abstracts
METADEX
Technology Research Database
Materials Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
Materials Research Database
Engineered Materials Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
METADEX
Computer and Information Systems Abstracts Professional
DatabaseTitleList Materials Research Database


Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: RIE
  name: IEEE/IET Electronic Library
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 2169-3536
EndPage 83728
ExternalDocumentID oai_doaj_org_article_1358a0bca618408e96684a20f8e220f3
10_1109_ACCESS_2019_2925209
8746235
Genre orig-research
GrantInformation_xml – fundername: State Key Laboratory of Marine Geology
  grantid: MGK1803
  funderid: 10.13039/501100011427
GroupedDBID 0R~
4.4
5VS
6IK
97E
AAJGR
ABVLG
ACGFS
ADBBV
ALMA_UNASSIGNED_HOLDINGS
BCNDV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
ESBDL
GROUPED_DOAJ
IFIPE
IPLJI
JAVBF
KQ8
M43
M~E
O9-
OCL
OK1
RIA
RIE
RIG
RNS
AAYXX
CITATION
7SC
7SP
7SR
8BQ
8FD
JG9
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c408t-1c222829eda5304b5adca29d061773a56c222a9f33830abfb60d137ff88ab2403
IEDL.DBID RIE
ISSN 2169-3536
IngestDate Fri Oct 04 13:06:33 EDT 2024
Fri Sep 13 01:09:06 EDT 2024
Fri Aug 23 00:50:59 EDT 2024
Wed Jun 26 19:27:59 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c408t-1c222829eda5304b5adca29d061773a56c222a9f33830abfb60d137ff88ab2403
ORCID 0000-0002-0275-2797
OpenAccessLink https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/document/8746235
PQID 2455627056
PQPubID 4845423
PageCount 8
ParticipantIDs proquest_journals_2455627056
ieee_primary_8746235
crossref_primary_10_1109_ACCESS_2019_2925209
doaj_primary_oai_doaj_org_article_1358a0bca618408e96684a20f8e220f3
PublicationCentury 2000
PublicationDate 20190000
2019-00-00
20190101
2019-01-01
PublicationDateYYYYMMDD 2019-01-01
PublicationDate_xml – year: 2019
  text: 20190000
PublicationDecade 2010
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE access
PublicationTitleAbbrev Access
PublicationYear 2019
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref14
ref11
ref10
ref2
ref1
ref17
ref16
ref19
he (ref8) 2015
ref24
ref23
ref26
kai (ref18) 2017; 53
ref22
tong (ref4) 2006
ref28
gao (ref20) 2012; 21
ref27
ref29
ref7
fan (ref21) 2017
ref9
ref3
zhang (ref25) 2018; 810
ref6
wernick (ref15) 1994
ref5
References_xml – ident: ref5
  doi: 10.1109/CISP.2010.5647190
– start-page: 770
  year: 2015
  ident: ref8
  article-title: Deep residual learning for image recognition
  publication-title: Proc Conf Comput Vis Pattern Recognit
  contributor:
    fullname: he
– ident: ref7
  doi: 10.1109/TIP.2005.851684
– ident: ref3
  doi: 10.1007/s11045-007-0023-2
– volume: 53
  start-page: 29
  year: 2017
  ident: ref18
  article-title: Advances in image super-resolution reconstruction
  publication-title: Comput Eng Appl
  contributor:
    fullname: kai
– ident: ref16
  doi: 10.1364/JOSAA.9.001914
– ident: ref13
  doi: 10.1109/ICCV.2009.5459271
– ident: ref12
  doi: 10.1109/TIP.2010.2050625
– ident: ref26
  doi: 10.1016/j.compeleceng.2013.10.016
– start-page: 410
  year: 2017
  ident: ref21
  article-title: An improved single image defogging method based on Retinex
  publication-title: Proc 2nd Int Conf Image Vis Comput (ICIVC)
  contributor:
    fullname: fan
– ident: ref27
  doi: 10.1109/MWC.2019.1800325
– ident: ref22
  doi: 10.1109/83.557356
– ident: ref10
  doi: 10.1007/978-3-319-27671-7_34
– ident: ref14
  doi: 10.1364/JOSAA.6.001715
– ident: ref9
  doi: 10.1109/ICoSP.2012.6491708
– ident: ref2
  doi: 10.1109/TIP.2002.806234
– volume: 21
  start-page: 3194
  year: 2012
  ident: ref20
  article-title: Image super-resolution with sparse neighbor embedding
  publication-title: IEEE Trans Image Process
  doi: 10.1109/TIP.2012.2190080
  contributor:
    fullname: gao
– year: 1994
  ident: ref15
  article-title: Method of recovering tomographic signal elements in a projection profile or image by solving linear equations
  contributor:
    fullname: wernick
– ident: ref6
  doi: 10.1109/ICIP.2003.1247332
– ident: ref23
  doi: 10.1109/TIP.2012.2226047
– ident: ref28
  doi: 10.1016/j.future.2018.01.001
– start-page: 419
  year: 2006
  ident: ref4
  article-title: Super-resolution reconstruction using Haar wavelet estimation
  publication-title: Wavelet Analysis and Application
  contributor:
    fullname: tong
– ident: ref17
  doi: 10.1109/SIU.2014.6830288
– volume: 810
  year: 2018
  ident: ref25
  article-title: Improved image enhancement method based on retinex algorithm
  publication-title: Cognitive Internet Things Frameworks Tools and Applications
  contributor:
    fullname: zhang
– ident: ref11
  doi: 10.1109/IVMSPW.2016.7528224
– ident: ref29
  doi: 10.1109/JOE.2015.2469915
– ident: ref19
  doi: 10.1109/ICPR.1990.119340
– ident: ref24
  doi: 10.1117/1.JEI.27.4.043022
– ident: ref1
  doi: 10.1007/978-3-319-10593-2_13
SSID ssj0000816957
Score 2.3318458
Snippet High-definition display technology for underwater images is of great significance for many applications, such as marine animal observation, seabed mining, and...
SourceID doaj
proquest
crossref
ieee
SourceType Open Website
Aggregation Database
Publisher
StartPage 83721
SubjectTerms Algorithms
Artificial neural networks
Color
Convolution
Convolutional neural networks
Display devices
Extreme environments
Feature extraction
Fisheries
High definition
Image acquisition
Image color analysis
Image enhancement
Image quality
Image reconstruction
Image resolution
Low visibility
Marine animals
Multilayer perceptrons
Neural networks
Ocean floor
Real time
Retinex (algorithm)
superresolution
Training
Underwater
underwater imaging
Visual observation
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV3NT-UgECfGkx6Mn_H5FQ573Cq0UOCoVeNusi_Gj8QbgQKJiVZTnzH-987Qap7Zw172woHSFmba4Tdk5jeE_DCBM6OZK0TCxom6wPzJohVVm1LNueeYjfxnWl_cit938m6u1BfGhA30wIPgjngltWO-dViZhOkI8FwLV7KkYwntwPPJ5ZwzlW2w5rWRaqQZgukcHTcNrAhjucxhaUqM_vi2FWXG_rHEyl92OW8256tkZUSJ9HiY3RpZiN06WZ7jDtwgKVcsegOo2NNfj2AVKIZs0NOY7rschkVP71-eH9w7zVEBFIAezdm20AW3XA4BLT2Mc12gDdjAniIefO1jcQJbW6DXV810ukluz89umotiLJoA4mV6VvAWz3RKE4OTFRNeutC60gSEKqpyssbrziR0TZnzydcs8EqlpLXzSM63RRa7py5uE6qCCtwlDz6NEqZFsrsQtcfiHMob2U7Iz0_52eeBG8Nmn4IZO4jborjtKO4JOUEZfw1FYuvcAeq2o7rtv9Q9IRuooa-HaCUAwMkJ2fvUmB1_whdbCgnoTgHE2_kfr94lS7ic4fxljyzO-te4D4hk5g_yx_cBK9nYtA
  priority: 102
  providerName: Directory of Open Access Journals
Title Underwater Image High Definition Display Using the Multilayer Perceptron and Color Feature-Based SRCNN
URI https://ieeexplore.ieee.org/document/8746235
https://www.proquest.com/docview/2455627056/abstract/
https://doaj.org/article/1358a0bca618408e96684a20f8e220f3
Volume 7
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwEB61PcGBV0EslMoHjs3WSezYPrYpVUHqCgGVerPs2JYqIK3SXVXl1zPjZFe8DlysyLGjScb2fDOZB8BbE0puNHeFSNQ40RQUP1l0ou5SasrSlxSNfL5ozi7Eh0t5uQUHm1iYGGN2Potzusz_8sN1tyJT2aFWAqW13IZtzasxVmtjT6ECEkaqKbEQEnB41Lb4DuS9ZeaVqcjf4zfhk3P0T0VV_jqJs3g5fQzna8JGr5Kv89XSz7sff-Rs_F_Kn8CjCWeyo3FhPIWt2D-Dh79kH9yFlGse3SHYHNj773iuMHL6YCcxXfXZkYudXN3efHP3LPsVMISKLMfrYhdO-Ti6xAw4zvWBtXiKDowQ5WqIxTEKx8A-f2oXi-dwcfruS3tWTGUXkEFcL4uyI6tQZWJwsubCSxc6V5lAYEfVTjZ035lEyi13PvmGh7JWKWntPKX3ewE7_XUfXwJTQYXSJY9akRKmo3R5IWpP5T2UN7KbwcGaH_ZmzK5hs1bCjR3ZZ4l9dmLfDI6JZ5uhlBo7d-C3ttNOs2UtteO-c1TKhuuI-pwWruJJxwrbega7xJ_NQybWzGBvvQLstI1vbSUk4kOFIPHVv2e9hgdE4GiT2YOd5bCKbxClLP1-1u738yL9CfjG5Ds
link.rule.ids 315,786,790,802,870,2115,4043,27956,27957,27958,55109
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1Lb9QwEB6VcgAOvApioYAPHJutkziJfWxTqi10VwhaqTfLT6kC0irdFYJfz4yTXfE6cIkiPyInY3u-cWa-AXijfM6V5CYTkS5G1BnFT2ZOlC7GOs9tTtHI80U9OxfvLqqLLdjbxMKEEJLzWZjSbfqX76_cio7K9mUjUFtXt-A26nmuhmitzYkKpZBQVTNSC2H9_kHb4luQ_5aaFqogj4_f1E9i6R_Tqvy1FycFc_wA5uuhDX4ln6erpZ26H3-wNv7v2B_C_RFpsoNhajyCrdA9hnu_8A_uQExZj74h3OzZyVfcWRi5fbCjEC-75MrFji5vrr-Y7yx5FjAEiyxF7GIRdvkwOMX02M50nrW4j_aMMOWqD9khqkfPPn1sF4sncH789qydZWPiBRQRl8ssd3QuVKjgTVVyYSvjnSmUJ7jTlKaqqd6oSOYtNzbamvu8bGKU0lgi-HsK291VF54Ba3zjcxMt2kWNUI4I83yQlhJ8NFZVbgJ7a3no64FfQye7hCs9iE-T-PQovgkcksw2TYkcOxXgt9bjWtN5WUnDrTOUzIbLgBadFKbgUYYCr-UEdkg-m4eMopnA7noG6HEh3-hCVIgQG4SJz__d6zXcmZ3NT_XpyeL9C7hLgx1OaHZhe9mvwkvELEv7Kk3Vn8ev5pw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Underwater+Image+High+Definition+Display+Using+the+Multilayer+Perceptron+and+Color+Feature-Based+SRCNN&rft.jtitle=IEEE+access&rft.au=Li%2C+Yujie&rft.au=Ma%2C+Chunyan&rft.au=Zhang%2C+Tingting&rft.au=Li%2C+Jianru&rft.date=2019&rft.pub=IEEE&rft.eissn=2169-3536&rft.volume=7&rft.spage=83721&rft.epage=83728&rft_id=info:doi/10.1109%2FACCESS.2019.2925209&rft.externalDocID=8746235
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2169-3536&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2169-3536&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2169-3536&client=summon