Deep Reinforcement Learning for Large-Scale Epidemic Control

• Published in: Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track Vol. 12461; pp. 155 - 170
• Main Authors: Libin, Pieter J. K., Moonens, Arno, Verstraeten, Timothy, Perez-Sanjines, Fabian, Hens, Niel, Lemey, Philippe, Nowé, Ann
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2021; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Deep reinforcement learning; Epidemic control; Multi-agent systems; Pandemic influenza
• ISBN: 9783030676698; 3030676692
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-67670-4_10

Epidemics of infectious diseases are an important threat to public health and global economies. Yet, the development of prevention strategies remains a challenging process, as epidemics are non-linear and complex processes. For this reason, we investigate a deep reinforcement learning approach to automatically learn prevention strategies in the context of pandemic influenza. Firstly, we construct a new epidemiological meta-population model, with 379 $$379$$ patches (one for each administrative district in Great Britain), that adequately captures the infection process of pandemic influenza. Our model balances complexity and computational efficiency such that the use of reinforcement learning techniques becomes attainable. Secondly, we set up a ground truth such that we can evaluate the performance of the “Proximal Policy Optimization” algorithm to learn in a single district of this epidemiological model. Finally, we consider a large-scale problem, by conducting an experiment where we aim to learn a joint policy to control the districts in a community of 11 tightly coupled districts, for which no ground truth can be established. This experiment shows that deep reinforcement learning can be used to learn mitigation policies in complex epidemiological models with a large state and action space.