Attention-based recurrent neural networks for accurate short-term and long-term dissolved oxygen prediction

• Published in: Computers and electronics in agriculture Vol. 165; p. 104964
• Main Authors: Liu, Yeqi, Zhang, Qian, Song, Lihua, Chen, Yingyi
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01.10.2019; Elsevier BV
• Subjects: Aquaculture; Attention mechanism; Attention-based recurrent neural network; Dissolved oxygen prediction; Long-term prediction; Neural networks; Oxygen; Recurrent neural networks; Short term; Spatio-temporal relationship; Water quality; Attention mechanism; Spatio-temporal relationship; Dissolved oxygen prediction; Attention-based recurrent neural network; Long-term prediction
• ISSN: 0168-1699; 1872-7107
• DOI: 10.1016/j.compag.2019.104964

•State-of-the-art attention-based RNN is developed for dissolved oxygen prediction.•Two attention-based RNN models are proposed to learn spatio-temporal relationships.•We provide model interpretation and parameter analysis for attention-based RNN.•Our methods can achieve the best performance, especially in long-term prediction. Accurate prediction of dissolved oxygen is important for the intelligent management and control in aquaculture. However, due to the interference of external factors and the irregularity of its own changes, it is still a difficult problem, especially in long-term prediction. Also, most of the current researches only report good results in short-term prediction of dissolved oxygen. In this paper, we study the effectiveness of attention-based recurrent neural networks (RNN) on short-term prediction (including about 1 h, 2 h) and long-term prediction (including about 8 h, 24 h and 48 h) of dissolved oxygen. We systematically discuss and compare the application of the attention-based RNN method in dissolved oxygen prediction, including spatial attention (Input-Attn), temporal attention (Temporal-Attn), spatio-temporal independent attention (DARNN and GeoMAN), and spatio-temporal joint attention (Spatio-temporal-Attn). Specifically, we first analyze the popular methods for water quality prediction and attention-based RNN methods for time series prediction. Then, we develop the latest attention-based RNN into a multi-step prediction for long-term dissolved oxygen prediction. Next, we propose two attention-based RNN structures to capture temporal relationships separately and learn spatio-temporal relationships simultaneously, which have achieved comparable performance with the state-of-the-art methods. Finally, we compare five attention-based RNN methods and five baseline methods in a real-world dataset. Experimental results show that attention-based RNN can achieve more accurate dissolved oxygen prediction in both short-term and long-term prediction.