Deep Adaptive Input Normalization for Time Series Forecasting

• Published in: IEEE transaction on neural networks and learning systems Vol. 31; no. 9; pp. 3760 - 3765
• Main Authors: Passalis, Nikolaos, Tefas, Anastasios, Kanniainen, Juho, Gabbouj, Moncef, Iosifidis, Alexandros
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Back propagation; Data models; Data normalization; Datasets; deep learning (DL); Forecasting; limit order book data; Machine learning; Mathematical models; Normalizing; Predictive models; Retraining; Task analysis; Time series; Time series analysis; time series forecasting; Training
• ISSN: 2162-237X; 2162-2388; 2162-2388
• DOI: 10.1109/TNNLS.2019.2944933

Deep learning (DL) models can be used to tackle time series analysis tasks with great success. However, the performance of DL models can degenerate rapidly if the data are not appropriately normalized. This issue is even more apparent when DL is used for financial time series forecasting tasks, where the nonstationary and multimodal nature of the data pose significant challenges and severely affect the performance of DL models. In this brief, a simple, yet effective, neural layer that is capable of adaptively normalizing the input time series, while taking into account the distribution of the data, is proposed. The proposed layer is trained in an end-to-end fashion using backpropagation and leads to significant performance improvements compared to other evaluated normalization schemes. The proposed method differs from traditional normalization methods since it learns how to perform normalization for a given task instead of using a fixed normalization scheme. At the same time, it can be directly applied to any new time series without requiring retraining. The effectiveness of the proposed method is demonstrated using a large-scale limit order book data set, as well as a load forecasting data set.