Control the population of free viruses in nonlinear uncertain HIV system using Q-learning

• Published in: International journal of machine learning and cybernetics Vol. 9; no. 7; pp. 1169 - 1179
• Main Authors: Gholizade-Narm, Hossein, Noori, Amin
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.07.2018; Springer Nature B.V
• Subjects: Acquired immune deficiency syndrome; AIDS; Algorithms; Artificial Intelligence; Chemotherapy; Complex Systems; Computational Intelligence; Control; Control methods; Deoxyribonucleic acid; Disease; DNA; Drug dosages; Drug resistance; Drug therapy; Dynamic programming; Engineering; HIV; Human immunodeficiency virus; Immune system; Infections; Initial conditions; Lymphocytes; Machine learning; Mathematical models; Mechatronics; Mutation; Optimal control; Original Article; Patients; Pattern Recognition; Performance evaluation; Population control; Proteins; Ribonucleic acid; RNA; Robotics; Systems Biology; Uncertainty; Viral infections; Viruses; Human immunodeficiency virus; Uncertain system dynamics; Drug therapy; Q-learning algorithm; Reinforcement learning
• ISSN: 1868-8071; 1868-808X
• DOI: 10.1007/s13042-017-0639-y

This paper surveys a new method to reduce the infected cells and free virus particles (virions) via a nonlinear HIV model. Three scenarios are considered for control performance evaluation. At first, the system and initial conditions are considered known completely. In the second case, the initial conditions are taken randomly. In the third scenario, in addition to uncertainty in initial condition, an additive noise is taken into account. The optimal control method is used to design an effective drug-schedule to reduce the number of infected cells and free virions with and without uncertainty. By using the Q-learning algorithm, which is the most applicable algorithm in reinforcement learning, the drug delivery rate is obtained off-line. Since Q-learning is a model-free algorithm, it is expected that the performance of the control in the presence of uncertainty does not change significantly. Simulation results confirm that the proposed control method has a good performance and high functionality in controlling the free virions for both certain and uncertain HIV models.