Machine learning algorithm for predicting 30-day mortality in patients receiving rapid response system activation: A retrospective nationwide cohort study

Abstract

This study investigated the accuracy of a machine learning algorithm for predicting mortality in patients receiving rapid response system (RRS) activation. This retrospective cohort study used data from the In-Hospital Emergency Registry in Japan, which collects nationwide data on patients receiving RRS activation. The missing values in the dataset were replaced using multiple imputations (mode imputation, BayseRidge sklearn. linear model, and K-nearest neighbor model), and the enrolled patients were randomly assigned to the training and test cohorts. We established prediction models for 30-day mortality using the following four types of machine learning classifiers: Light Gradient Boosting Machine (LightGBM), eXtreme Gradient Boosting, random forest, and neural network. Fifty-two variables (patient characteristics, details of RRS activation, reasons for RRS initiation, and hospital capacity) were used to construct the prediction algorithm. The primary outcome was the accuracy of the prediction model for 30-day mortality. Overall, the data from 4,997 patients across 34 hospitals were analyzed. The machine learning algorithms using LightGBM demonstrated the highest predictive value for 30-day mortality (area under the receiver operating characteristic curve, 0.860 [95 % confidence interval, 0.825–0.895]). The SHapley Additive exPlanations summary plot indicated that hospital capacity, site of incidence, code status, and abnormal vital signs within 24 h were important variables in the prediction model for 30-day mortality.

Keywords

• Rapid response system
• Machine learning
• Artificial intelligence
• Prognosis prediction
• Deteriorated patient
• Adverse event