The Design and Implementation of a Deep Reinforcement Learning and Quantum Finance Theory-inspired Portfolio Investment Management System

• Published in: Expert systems with applications Vol. 238; p. 122243
• Main Authors: Qiu, Yitao, Liu, RongKai, Lee, Raymond S.T.
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 15.03.2024
• Subjects: Deep Deterministic Policy Gradient; Deep Learning; Deep Reinforcement Learning; Machine Learning; Portfolio Management; Quantum Finance; Deep Deterministic Policy Gradient; Deep Reinforcement Learning; Portfolio Management; Machine Learning; Deep Learning; Quantum Finance
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2023.122243

Deep Learning (DL) and Reinforcement Learning (RL) are common machine learning techniques used in automatic trading, notwithstanding, RL is deficient in portfolio investment in terms of funds distribution, potential loss control, profit maximization, and examine undetected environment. This paper proposed an intelligent Quantum Finance-based portfolio investment system (QFPIS), which is a combination of Deep Reinforcement Learning (DRL) with Quantum Finance Theory (QFT) to improve these conditions. There are two major agents embodied in the system: 1) a trading agent based on Deep Deterministic Policy Gradient algorithm to determine investment weighting for different financial products by generating continuous actions; 2) an intelligent agent based on Policy Gradient (PG) algorithm to enact risk control and determine whether to hold current orders by producing discrete actions depend on daily Quantum Price Levels (QPLs). The advantages of incorporating a two-agents system design are to devise stable and realistic fund allocation for different products in portfolio. Experiment results had shown robustness, flexibility, and profitability on a series of forex products and the U.S. stocks in the back-testing phase as compared to other RL trading systems.