A 1D Convolutional Neural Network (1D-CNN) Temporal Filter for Atmospheric Variability: Reducing the Sensitivity of Filtering Accuracy to Missing Data Points

• Published in: Applied sciences Vol. 14; no. 14; p. 6289
• Main Authors: Yu, Dan, Kong, Hoiio, Leung, Jeremy Cheuk-Hin, Chan, Pak Wai, Fong, Clarence, Wang, Yuchen, Zhang, Banglin
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.07.2024
• Subjects: 1D convolution neural network; climate variability; Fourier transforms; Hong Kong; machine learning; Mean square errors; Missing data; Neural networks; Observatories; quasi-biweekly-to-intraseasonal oscillation; Temperature; temporal filter; Time series; Hong Kong China; China
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app14146289

The atmosphere exhibits variability across different time scales. Currently, in the field of atmospheric science, statistical filtering is one of the most widely used methods for extracting signals on certain time scales. However, signal extraction based on traditional statistical filters may be sensitive to missing data points, which are particularly common in meteorological data. To address this issue, this study applies a new type of temporal filters based on a one-dimensional convolution neural network (1D-CNN) and examines its performance on reducing such uncertainties. As an example, we investigate the advantages of a 1D-CNN bandpass filter in extracting quasi-biweekly-to-intraseasonal signals (10–60 days) from temperature data provided by the Hong Kong Observatory. The results show that the 1D-CNN achieves accuracies similar to a 121-point Lanczos filter. In addition, the 1D-CNN filter allows a maximum of 10 missing data points within the 60-point window length, while keeping its accuracy higher than 80% (R2 > 0.8). This indicates that the 1D-CNN model works well even when missing data points exist in the time series. This study highlights another potential for applying machine learning algorithms in atmospheric and climate research, which will be useful for future research involving incomplete time series and real-time filtering.