npj Digital Medicine (Jun 2022)
International comparisons of laboratory values from the 4CE collaborative to predict COVID-19 mortality
- Griffin M. Weber,
- Chuan Hong,
- Zongqi Xia,
- Nathan P. Palmer,
- Paul Avillach,
- Sehi L’Yi,
- Mark S. Keller,
- Shawn N. Murphy,
- Alba Gutiérrez-Sacristán,
- Clara-Lea Bonzel,
- Arnaud Serret-Larmande,
- Antoine Neuraz,
- Gilbert S. Omenn,
- Shyam Visweswaran,
- Jeffrey G. Klann,
- Andrew M. South,
- Ne Hooi Will Loh,
- Mario Cannataro,
- Brett K. Beaulieu-Jones,
- Riccardo Bellazzi,
- Giuseppe Agapito,
- Mario Alessiani,
- Bruce J. Aronow,
- Douglas S. Bell,
- Vincent Benoit,
- Florence T. Bourgeois,
- Luca Chiovato,
- Kelly Cho,
- Arianna Dagliati,
- Scott L. DuVall,
- Noelia García Barrio,
- David A. Hanauer,
- Yuk-Lam Ho,
- John H. Holmes,
- Richard W. Issitt,
- Molei Liu,
- Yuan Luo,
- Kristine E. Lynch,
- Sarah E. Maidlow,
- Alberto Malovini,
- Kenneth D. Mandl,
- Chengsheng Mao,
- Michael E. Matheny,
- Jason H. Moore,
- Jeffrey S. Morris,
- Michele Morris,
- Danielle L. Mowery,
- Kee Yuan Ngiam,
- Lav P. Patel,
- Miguel Pedrera-Jimenez,
- Rachel B. Ramoni,
- Emily R. Schriver,
- Petra Schubert,
- Pablo Serrano Balazote,
- Anastasia Spiridou,
- Amelia L. M. Tan,
- Byorn W. L. Tan,
- Valentina Tibollo,
- Carlo Torti,
- Enrico M. Trecarichi,
- Xuan Wang,
- The Consortium for Clinical Characterization of COVID-19 by EHR (4CE),
- Isaac S. Kohane,
- Tianxi Cai,
- Gabriel A. Brat
Affiliations
- Griffin M. Weber
- Department of Biomedical Informatics, Harvard Medical School
- Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School
- Zongqi Xia
- Department of Neurology, University of Pittsburgh
- Nathan P. Palmer
- Department of Biomedical Informatics, Harvard Medical School
- Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School
- Sehi L’Yi
- Department of Biomedical Informatics, Harvard Medical School
- Mark S. Keller
- Department of Biomedical Informatics, Harvard Medical School
- Shawn N. Murphy
- Department of Neurology, Massachusetts General Hospital
- Alba Gutiérrez-Sacristán
- Department of Biomedical Informatics, Harvard Medical School
- Clara-Lea Bonzel
- Department of Biomedical Informatics, Harvard Medical School
- Arnaud Serret-Larmande
- Department of biomedical informatics, Hôpital Européen Georges Pompidou, Assistance Publique - Hôpitaux de Paris
- Antoine Neuraz
- Department of biomedical informatics, Hôpital Necker-Enfants Malade, Assistance Publique Hôpitaux de Paris (APHP), University of Paris
- Gilbert S. Omenn
- Department of Computational Medicine & Bioinformatics, Internal Medicine, Human Genetics, and School of Public Health, University of Michigan
- Shyam Visweswaran
- Department of Biomedical Informatics, University of Pittsburgh
- Jeffrey G. Klann
- Department of Medicine, Massachusetts General Hospital
- Andrew M. South
- Department of Pediatrics-Section of Nephrology, Brenner Children’s Hospital, Wake Forest School of Medicine
- Ne Hooi Will Loh
- Department of Anaesthesia, National University Health System, Singapore
- Mario Cannataro
- Department of Medical and Surgical Sciences, Data Analytics Research Center, University Magna Graecia of Catanzaro, Italy
- Brett K. Beaulieu-Jones
- Department of Biomedical Informatics, Harvard Medical School
- Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Italy
- Giuseppe Agapito
- Department of Legal, Economic and Social Sciences, University Magna Graecia of Catanzaro, Italy
- Mario Alessiani
- Department of Surgery, ASST Pavia, Lombardia Region Health System
- Bruce J. Aronow
- Departments of Biomedical Informatics, Pediatrics, Cincinnati Children’s Hospital Medical Center, University of Cincinnati
- Douglas S. Bell
- Department of Medicine, David Geffen School of Medicine at UCLA
- Vincent Benoit
- IT department, Innovation & Data, APHP Greater Paris University Hospital
- Florence T. Bourgeois
- Department of Pediatrics, Harvard Medical School
- Luca Chiovato
- Unit of Internal Medicine and Endocrinology, Istituti Clinici Scientifici Maugeri SpA SB IRCCS
- Kelly Cho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System
- Arianna Dagliati
- Department of Electrical Computer and Biomedical Engineering, University of Pavia, Italy
- Scott L. DuVall
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System
- Noelia García Barrio
- Health Informatics, Hospital Universitario 12 de Octubre
- David A. Hanauer
- Department of Learning Health Sciences, University of Michigan
- Yuk-Lam Ho
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System
- John H. Holmes
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine
- Richard W. Issitt
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, UK
- Molei Liu
- Department of Biostatistics, Harvard School of Public Health
- Yuan Luo
- Department of Preventive Medicine, Northwestern University
- Kristine E. Lynch
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System
- Sarah E. Maidlow
- Michigan Institute for Clinical and Health Research, University of Michigan
- Alberto Malovini
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS
- Kenneth D. Mandl
- Computational Health Informatics Program, Boston Children’s Hospital
- Chengsheng Mao
- Department of Preventive Medicine, Northwestern University
- Michael E. Matheny
- VA Informatics and Computing Infrastructure, Tennessee Valley Healthcare System Veterans Affairs Medical Center
- Jason H. Moore
- Institute for Biomedical Informatics, University of Pennsylvania Perelman School of Medicine
- Jeffrey S. Morris
- Department of Biostatistics, Epidemiology, and Biostatistics, University of Pennysylvania Perelman School of Medicine
- Michele Morris
- Department of Biomedical Informatics, University of Pittsburgh
- Danielle L. Mowery
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine
- Kee Yuan Ngiam
- Department of Biomedical informatics, WiSDM, National University Health Systems Singapore
- Lav P. Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center
- Miguel Pedrera-Jimenez
- Health Informatics, Hospital Universitario 12 de Octubre
- Rachel B. Ramoni
- Office of Research and Development, Department of Veterans Affairs
- Emily R. Schriver
- Data Analytics Center, University of Pennsylvania Health System
- Petra Schubert
- Massachusetts Veterans Epidemiology Research and Information Center (MAVERIC), VA Boston Healthcare System
- Pablo Serrano Balazote
- Health Informatics, Hospital Universitario 12 de Octubre
- Anastasia Spiridou
- Digital Research, Informatics and Virtual Environments (DRIVE), Great Ormond Street Hospital for Children, UK
- Amelia L. M. Tan
- Department of Biomedical Informatics, Harvard Medical School
- Byorn W. L. Tan
- Department of Medicine, National University Hospital, Singapore
- Valentina Tibollo
- Laboratory of Informatics and Systems Engineering for Clinical Research, Istituti Clinici Scientifici Maugeri SpA SB IRCCS
- Carlo Torti
- Department of Medical and Surgical Sciences, Infectious and Tropical Disease Unit, University Magna Graecia of Catanzaro, Italy
- Enrico M. Trecarichi
- Department of Medical and Surgical Sciences, Infectious and Tropical Disease Unit, University Magna Graecia of Catanzaro, Italy
- Xuan Wang
- Department of Biomedical Informatics, Harvard Medical School
- The Consortium for Clinical Characterization of COVID-19 by EHR (4CE)
- Isaac S. Kohane
- Department of Biomedical Informatics, Harvard Medical School
- Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School
- Gabriel A. Brat
- Department of Biomedical Informatics, Harvard Medical School
- DOI
- https://doi.org/10.1038/s41746-022-00601-0
- Journal volume & issue
-
Vol. 5,
no. 1
pp. 1 – 8
Abstract
Abstract Given the growing number of prediction algorithms developed to predict COVID-19 mortality, we evaluated the transportability of a mortality prediction algorithm using a multi-national network of healthcare systems. We predicted COVID-19 mortality using baseline commonly measured laboratory values and standard demographic and clinical covariates across healthcare systems, countries, and continents. Specifically, we trained a Cox regression model with nine measured laboratory test values, standard demographics at admission, and comorbidity burden pre-admission. These models were compared at site, country, and continent level. Of the 39,969 hospitalized patients with COVID-19 (68.6% male), 5717 (14.3%) died. In the Cox model, age, albumin, AST, creatine, CRP, and white blood cell count are most predictive of mortality. The baseline covariates are more predictive of mortality during the early days of COVID-19 hospitalization. Models trained at healthcare systems with larger cohort size largely retain good transportability performance when porting to different sites. The combination of routine laboratory test values at admission along with basic demographic features can predict mortality in patients hospitalized with COVID-19. Importantly, this potentially deployable model differs from prior work by demonstrating not only consistent performance but also reliable transportability across healthcare systems in the US and Europe, highlighting the generalizability of this model and the overall approach.