条件付確率場を用いた海洋観測データの品質管理

• Published in: Transactions of the Japanese Society for Artificial Intelligence Vol. 33; no. 3; pp. G-SGAI05_1 - 11
• Main Authors: 上川路, 洋介, 松山, 開, 福井, 健一, 細田, 滋毅, 小野, 智司
• Format: Journal Article
• Language: Japanese
• Published: Tokyo 一般社団法人 人工知能学会 01.05.2018; Japan Science and Technology Agency
• Subjects: conditional random field; Conditional random fields; decision tree; Design; Error detection; feature function design; Flags; Human performance; Machine learning; ocean observation; Quality control; sequential labeling
• ISSN: 1346-0714; 1346-8030
• DOI: 10.1527/tjsai.G-SGAI05

Globally-covered ocean monitoring system Argo with more than 3,700 autonomous floats has been working, and its accumulated big ocean observation data helps many studies such as investigation into climate change mechanism. Since the observed data sometimes involves errors, human experts must visually confirm and revise quality control (QC) flags. However, such manual QC by human experts cannot be performed in some countries. In addition, it is difficult to regularize the quality of the ocean observation data of all over the world because the manual QC depends on human experts’ heuristics. Therefore, this paper proposes a method for error detection in Argo observation data using Conditional Random Field (CRF) because the problem requires consideration of sequence of both features and quality flags for accurate labeling in each depth. This paper also proposes a feature function design method using decision tree learning, allowing coping with various types of observation errors without manual work, whereas previous work had to focus on certain error types due to manual labor for feature function design. Furthermore, the proposed method divides the two CRF-based sequential classifiers that use manually- or automatically-designed feature functions respectively rather than combining the both feature functions into a single set. Experimental results have shown that the proposed method could detect all types of salinity errors with higher accuracy of QC flags assignments than the actually operated system in Argo project. In particular, the recall rate of the proposed method was better than that of CRF using the manually designed feature functions even for the specific error types for which they were designed.