이어도 해양과학기지 수온 시계열 자료의 이상값 검출을 위한 국제 품질검사의 성능 평가
Quality control (QC) to process observed time series has become more critical as the types and amount of observed data have increased along with the development of ocean observing sensors and communication technology. International ocean observing institutions have developed and operated automatic Q...
Saved in:
Published in | Ocean and polar research Vol. 43; no. 4; pp. 229 - 243 |
---|---|
Main Authors | , , , , , , , , , , , , , , , |
Format | Journal Article |
Language | Korean |
Published |
한국해양과학기술원
01.12.2021
|
Subjects | |
Online Access | Get full text |
ISSN | 1598-141X 2234-7313 |
DOI | 10.4217/OPR.2021.43.4.229 |
Cover
Abstract | Quality control (QC) to process observed time series has become more critical as the types and amount of observed data have increased along with the development of ocean observing sensors and communication technology. International ocean observing institutions have developed and operated automatic QC procedures for these observed time series. In this study, the performance of automated QC procedures proposed by U.S. IOOS (Integrated Ocean Observing System), NDBC (National Data Buy Center), and OOI (Ocean Observatory Initiative) were evaluated for observed time-series particularly from the Yellow and East China Seas by taking advantage of a confusion matrix. We focused on detecting additive outliers (AO) and temporary change outliers (TCO) based on ocean temperature observation from the Ieodo Ocean Research Station (I-ORS) in 2013. Our results present that the IOOS variability check procedure tends to classify normal data as AO or TCO. The NDBC variability check tracks outliers well but also tends to classify a lot of normal data as abnormal, particularly in the case of rapidly fluctuating time-series. The OOI procedure seems to detect the AO and TCO most effectively and the rate of classifying normal data as abnormal is also the lowest among the international checks. However, all three checks need additional scrutiny because they often fail to classify outliers when intermittent observations are performed or as a result of systematic errors, as well as tending to classify normal data as outliers in the case where there is abrupt change in the observed data due to a sensor being located within a sharp boundary between two water masses, which is a common feature in shallow water observations. Therefore, this study underlines the necessity of developing a new QC algorithm for time-series occurring in a shallow sea. |
---|---|
AbstractList | Quality control (QC) to process observed time series has become more critical as the types and amount of observed data have increased along with the development of ocean observing sensors and communication technology. International ocean observing institutions have developed and operated automatic QC procedures for these observed time series. In this study, the performance of automated QC procedures proposed by U.S. IOOS (Integrated Ocean Observing System), NDBC (National Data Buy Center), and OOI (Ocean Observatory Initiative) were evaluated for observed time-series particularly from the Yellow and East China Seas by taking advantage of a confusion matrix. We focused on detecting additive outliers (AO) and temporary change outliers (TCO) based on ocean temperature observation from the Ieodo Ocean Research Station (I-ORS) in 2013. Our results present that the IOOS variability check procedure tends to classify normal data as AO or TCO. The NDBC variability check tracks outliers well but also tends to classify a lot of normal data as abnormal, particularly in the case of rapidly fluctuating time-series. The OOI procedure seems to detect the AO and TCO most effectively and the rate of classifying normal data as abnormal is also the lowest among the international checks. However, all three checks need additional scrutiny because they often fail to classify outliers when intermittent observations are performed or as a result of systematic errors, as well as tending to classify normal data as outliers in the case where there is abrupt change in the observed data due to a sensor being located within a sharp boundary between two water masses, which is a common feature in shallow water observations. Therefore, this study underlines the necessity of developing a new QC algorithm for time-series occurring in a shallow sea. KCI Citation Count: 0 Quality control (QC) to process observed time series has become more critical as the types and amount of observed data have increased along with the development of ocean observing sensors and communication technology. International ocean observing institutions have developed and operated automatic QC procedures for these observed time series. In this study, the performance of automated QC procedures proposed by U.S. IOOS (Integrated Ocean Observing System), NDBC (National Data Buy Center), and OOI (Ocean Observatory Initiative) were evaluated for observed time-series particularly from the Yellow and East China Seas by taking advantage of a confusion matrix. We focused on detecting additive outliers (AO) and temporary change outliers (TCO) based on ocean temperature observation from the Ieodo Ocean Research Station (I-ORS) in 2013. Our results present that the IOOS variability check procedure tends to classify normal data as AO or TCO. The NDBC variability check tracks outliers well but also tends to classify a lot of normal data as abnormal, particularly in the case of rapidly fluctuating time-series. The OOI procedure seems to detect the AO and TCO most effectively and the rate of classifying normal data as abnormal is also the lowest among the international checks. However, all three checks need additional scrutiny because they often fail to classify outliers when intermittent observations are performed or as a result of systematic errors, as well as tending to classify normal data as outliers in the case where there is abrupt change in the observed data due to a sensor being located within a sharp boundary between two water masses, which is a common feature in shallow water observations. Therefore, this study underlines the necessity of developing a new QC algorithm for time-series occurring in a shallow sea. |
Author | 민용침 Lee, Jaeik 정종민 Park, Sung-Hwan Kim, Yong Sun 민인기 Jeong, Jin-Yong Min, Inki 김용선 정진용 Jun, Hyunjung 이재익 박숭환 전현정 Min, Yongchim Jeong, Jeongmin |
Author_xml | – sequence: 1 fullname: 민용침 – sequence: 2 fullname: 전현정 – sequence: 3 fullname: 정진용 – sequence: 4 fullname: 박숭환 – sequence: 5 fullname: 이재익 – sequence: 6 fullname: 정종민 – sequence: 7 fullname: 민인기 – sequence: 8 fullname: 김용선 – sequence: 9 fullname: Min, Yongchim – sequence: 10 fullname: Jun, Hyunjung – sequence: 11 fullname: Jeong, Jin-Yong – sequence: 12 fullname: Park, Sung-Hwan – sequence: 13 fullname: Lee, Jaeik – sequence: 14 fullname: Jeong, Jeongmin – sequence: 15 fullname: Min, Inki – sequence: 16 fullname: Kim, Yong Sun |
BackLink | https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002787783$$DAccess content in National Research Foundation of Korea (NRF) |
BookMark | eNotkEtLAlEAhS9hkFY_oN3dtGgx033PnaVIb8EQF-2GGXViUhScoK3VLOwBPcAyGCOIsEWBpUWLftF45z-U1uocON85i5MCiVq9VgZgASOdEWws57bzOkEE64zqTCfEnAJJQijTDIppAiQxN6WGGd6ZASnf30NIGFSwJDhQ3aG6GY4uAhi3f91VNPiO23fRV1_1mlC1OqrzDNVZGA0CdTuE6v5y9Hiuuh047h0fRv1rGL031WeougFUYRC3Qxh9vKqHEMbXLdVrjdOjl0kjeBudPsH44iTqN-fAtGtX_fL8v86CwupKIbOuZXNrG5l0VqsIJjXXNF1mU2pTLqSQJVG2HZcIgiSjJseSmpQQXnRwUTLhGBwhSiXjJSJcxkXRobNg6W-21nCtStGz6rY30d26VWlY6XxhwzKlaUgpf9nFP7bi-fueVSv5VWszvZUb34oE5ZwxLg1EfwDMao7w |
ContentType | Journal Article |
DBID | JDI ACYCR |
DEWEY | 551.46 |
DOI | 10.4217/OPR.2021.43.4.229 |
DatabaseName | KoreaScience Korean Citation Index |
DatabaseTitleList | |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Geology Oceanography |
DocumentTitleAlternate | Evaluation of International Quality Control Procedures for Detecting Outliers in Water Temperature Time-series at Ieodo Ocean Research Station |
EISSN | 2234-7313 |
EndPage | 243 |
ExternalDocumentID | oai_kci_go_kr_ARTI_9897888 JAKO202106355445870 |
GroupedDBID | .UV 123 2WC 9ZL ABTAH ACYCR ALMA_UNASSIGNED_HOLDINGS EBD EDH GROUPED_DOAJ IPNFZ JDI KQ8 KVFHK OK1 RIG RNS TDB ZBA ZY4 ~02 |
ID | FETCH-LOGICAL-k648-f99f4a33a356868d6eabf26208439518393225cb1c846b750033845d26f456cb3 |
ISSN | 1598-141X |
IngestDate | Tue Nov 21 21:27:45 EST 2023 Fri Dec 22 12:03:37 EST 2023 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | true |
Issue | 4 |
Keywords | S NDBC U IOOS OOI outliers Korea Ocean Research Stations (KORS) |
Language | Korean |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-k648-f99f4a33a356868d6eabf26208439518393225cb1c846b750033845d26f456cb3 |
Notes | KISTI1.1003/JNL.JAKO202106355445870 https://e-opr.org/articles/xml/zqB1/ |
OpenAccessLink | http://click.ndsl.kr/servlet/LinkingDetailView?cn=JAKO202106355445870&dbt=JAKO&org_code=O481&site_code=SS1481&service_code=01 |
PageCount | 15 |
ParticipantIDs | nrf_kci_oai_kci_go_kr_ARTI_9897888 kisti_ndsl_JAKO202106355445870 |
PublicationCentury | 2000 |
PublicationDate | 2021-12 |
PublicationDateYYYYMMDD | 2021-12-01 |
PublicationDate_xml | – month: 12 year: 2021 text: 2021-12 |
PublicationDecade | 2020 |
PublicationTitle | Ocean and polar research |
PublicationTitleAlternate | Ocean and polar research |
PublicationYear | 2021 |
Publisher | 한국해양과학기술원 |
Publisher_xml | – name: 한국해양과학기술원 |
SSID | ssj0067364 ssib053377561 ssib026971478 |
Score | 2.1885717 |
Snippet | Quality control (QC) to process observed time series has become more critical as the types and amount of observed data have increased along with the... |
SourceID | nrf kisti |
SourceType | Open Website Open Access Repository |
StartPage | 229 |
SubjectTerms | 해양학 |
Title | 이어도 해양과학기지 수온 시계열 자료의 이상값 검출을 위한 국제 품질검사의 성능 평가 |
URI | http://click.ndsl.kr/servlet/LinkingDetailView?cn=JAKO202106355445870&dbt=JAKO&org_code=O481&site_code=SS1481&service_code=01 https://www.kci.go.kr/kciportal/ci/sereArticleSearch/ciSereArtiView.kci?sereArticleSearchBean.artiId=ART002787783 |
Volume | 43 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
ispartofPNX | Ocean and Polar Research, 2021, 43(4), , pp.229-243 |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnR1daxQxMNSKIIJoVawfZRHzdOy5t5vdTR53767WFq1Khb4dt7t3UipXqC2iT1XvoX5AtVCtcBVBpH1QqLaKD_6i695_cDLJfXgW_HjZC5lkMplJMjO5ZELIxTi2KzAsEtMDfWQyz7PMiImy6cdl38-xquPhDbmr17yxW2x82p0eOLDVc2ppcSHKxg_2vVfyP1KFPJCrvCX7D5LtIIUMSIN84QsShu9fyZgW81QUaMgw4WEipHyUcpahxQIVbhcmcrQY0NChYV6DhMAcTkNLlgl8yq2MTHFOBcdqnAZcZYVU5DUCrlD6gBthokiFJRsOAJbXNAlVr0MdB5iiwKLCzmAKj1kALPQQOZbmGmcem1F05lVxlwYFJNRSWQC0Ja2adv4LTm7ToI8WQBjmkEEBDVxEIFklNFXqqae2oT4Zy78oMIqCdP4zOihSZ_Mc-zuKzIQ2AKHAnghgWLcI0qr7wTXfJPVuXxHopO4E66DrbShsF4FOSh4UpOzUs9rtHRs713P6RSsZAZ47w6eCQAdjHlhpzPQddS-3rZlUACs9A1mvmtG7RMpisVW5fmXIbIygNXn9ZlZSkWVOlmU7NXsDj_cZBJ1jmuPBxKSsaqFVylxY2w-QgzZMYqlLJm50Vm7bEzCxu4HhwIfwfbwxrWwieXgQz3e0e67OF0gKL_1GH7iJ0neaAWuvNl_tsfamjpGj2k0zAjXnjpOB2bkhcugyPoN9f4gcweGho72fIPfSjd301e7eSt1orUHqZXPnR2vtTfP7drq5ZKTL6-n6lpE-azR36unrXSN9-2Lv_fN0Y92Q9R4_bG6vGs0vS-m3RrpRN9JGvbXWMJpfP6XvGkZrdTndXJbQRx-xRv3z3tMPRmvlSXN76SSZGi1O5cdM_aKJOesxblaFqLKy45Qd1-MeT7xKOarKFyE4uAWu9FWkeo2jXAxeQQS2vOU4nLmJ7VXBz4kj5xQZrM3VKqeJweXDECLxk7gMa6uViJi5TACGuBrZlSgZJiPIxFItuXuntI8gh8kF4G5pNp4pyQjz8vf2XGl2vgR-9JWS4ELujZ35E5az5HB3hJ8jgwvzi5XzYKUvRCM4QH4CC6rEzQ |
linkProvider | Colorado Alliance of Research Libraries |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=%EC%9D%B4%EC%96%B4%EB%8F%84+%ED%95%B4%EC%96%91%EA%B3%BC%ED%95%99%EA%B8%B0%EC%A7%80+%EC%88%98%EC%98%A8+%EC%8B%9C%EA%B3%84%EC%97%B4+%EC%9E%90%EB%A3%8C%EC%9D%98+%EC%9D%B4%EC%83%81%EA%B0%92+%EA%B2%80%EC%B6%9C%EC%9D%84+%EC%9C%84%ED%95%9C+%EA%B5%AD%EC%A0%9C+%ED%92%88%EC%A7%88%EA%B2%80%EC%82%AC%EC%9D%98+%EC%84%B1%EB%8A%A5+%ED%8F%89%EA%B0%80&rft.jtitle=Ocean+and+polar+research&rft.au=%EB%AF%BC%EC%9A%A9%EC%B9%A8&rft.au=%EC%A0%84%ED%98%84%EC%A0%95&rft.au=%EC%A0%95%EC%A7%84%EC%9A%A9&rft.au=%EB%B0%95%EC%88%AD%ED%99%98&rft.date=2021-12-01&rft.issn=1598-141X&rft.eissn=2234-7313&rft.volume=43&rft.issue=4&rft.spage=229&rft.epage=243&rft_id=info:doi/10.4217%2FOPR.2021.43.4.229&rft.externalDBID=n%2Fa&rft.externalDocID=JAKO202106355445870 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1598-141X&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1598-141X&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1598-141X&client=summon |