npj Digital Medicine (Oct 2021)

A prospective evaluation of AI-augmented epidemiology to forecast COVID-19 in the USA and Japan

  • Sercan Ö. Arık,
  • Joel Shor,
  • Rajarishi Sinha,
  • Jinsung Yoon,
  • Joseph R. Ledsam,
  • Long T. Le,
  • Michael W. Dusenberry,
  • Nathanael C. Yoder,
  • Kris Popendorf,
  • Arkady Epshteyn,
  • Johan Euphrosine,
  • Elli Kanal,
  • Isaac Jones,
  • Chun-Liang Li,
  • Beth Luan,
  • Joe Mckenna,
  • Vikas Menon,
  • Shashank Singh,
  • Mimi Sun,
  • Ashwin Sura Ravi,
  • Leyou Zhang,
  • Dario Sava,
  • Kane Cunningham,
  • Hiroki Kayama,
  • Thomas Tsai,
  • Daisuke Yoneoka,
  • Shuhei Nomura,
  • Hiroaki Miyata,
  • Tomas Pfister

DOI
https://doi.org/10.1038/s41746-021-00511-7
Journal volume & issue
Vol. 4, no. 1
pp. 1 – 18

Abstract

Read online

Abstract The COVID-19 pandemic has highlighted the global need for reliable models of disease spread. We propose an AI-augmented forecast modeling framework that provides daily predictions of the expected number of confirmed COVID-19 deaths, cases, and hospitalizations during the following 4 weeks. We present an international, prospective evaluation of our models’ performance across all states and counties in the USA and prefectures in Japan. Nationally, incident mean absolute percentage error (MAPE) for predicting COVID-19 associated deaths during prospective deployment remained consistently <8% (US) and <29% (Japan), while cumulative MAPE remained <2% (US) and <10% (Japan). We show that our models perform well even during periods of considerable change in population behavior, and are robust to demographic differences across different geographic locations. We further demonstrate that our framework provides meaningful explanatory insights with the models accurately adapting to local and national policy interventions. Our framework enables counterfactual simulations, which indicate continuing Non-Pharmaceutical Interventions alongside vaccinations is essential for faster recovery from the pandemic, delaying the application of interventions has a detrimental effect, and allow exploration of the consequences of different vaccination strategies. The COVID-19 pandemic remains a global emergency. In the face of substantial challenges ahead, the approach presented here has the potential to inform critical decisions.