Scalable Epidemiological Workflows to Support COVID-19 Planning and Response

• Published in: 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS) pp. 639 - 650
• Main Authors: Machi, Dustin, Bhattacharya, Parantapa, Hoops, Stefan, Chen, Jiangzhuo, Mortveit, Henning, Venkatramanan, Srinivasan, Lewis, Bryan, Wilson, Mandy, Fadikar, Arindam, Maiden, Tom, Barrett, Christopher L., Marathe, Madhav V.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2021
• Subjects: Analytical models; Computational modeling; COVID-19; Epidemic Modeling; HPC Workflow Development; Pandemics; Scalability; Surveillance
• ISSN: 1530-2075
• DOI: 10.1109/IPDPS49936.2021.00072

The COVID-19 global outbreak represents the most significant epidemic event since the 1918 influenza pandemic. Simulations have played a crucial role in supporting COVID-19 planning and response efforts. Developing scalable workflows to provide policymakers quick responses to important questions pertaining to logistics, resource allocation, epidemic forecasts and intervention analysis remains a challenging computational problem. In this work, we present scalable high performance computing-enabled workflows for COVID-19 pandemic planning and response. The scalability of our methodology allows us to run fine-grained simulations daily, and to generate county-level forecasts and other counterfactual analysis for each of the 50 states (and DC), 3140 counties across the USA. Our workflows use a hybrid cloud/cluster system utilizing a combination of local and remote cluster computing facilities, and using over 20,000 CPU cores running for 6-9 hours every day to meet this objective. Our state (Virginia), state hospital network, our university, the DOD and the CDC use our models to guide their COVID-19 planning and response efforts. We began executing these pipelines March 25, 2020, and have delivered and briefed weekly updates to these stakeholders for over 30 weeks without interruption.