A Prediction Model to Identify Clinically Relevant Medication Discrepancies at the Emergency Department (MED-REC Predictor): Development and Validation Study

Abstract

BackgroundMany patients do not receive a comprehensive medication reconciliation, mostly owing to limited resources. We hence need an approach to identify those patients at the emergency department (ED) who are at increased risk for clinically relevant discrepancies. ObjectiveThe aim of our study was to develop and externally validate a prediction model to identify patients at risk for at least 1 clinically relevant medication discrepancy upon ED presentation. MethodsA prospective, multicenter, observational study was conducted at the University Hospitals Leuven and General Hospital Sint-Jan Brugge-Oostende AV, Belgium. Medication histories were obtained from patients admitted to the ED between November 2017 and May 2022, and clinically relevant medication discrepancies were identified. Three distinct datasets were created for model development, temporal external validation, and geographic external validation. Multivariable logistic regression with backward stepwise selection was used to select the final model. The presence of at least 1 clinically relevant discrepancy was the dependent variable. The model was evaluated by measuring calibration, discrimination, classification, and net benefit. ResultsWe included 824, 350, and 119 patients in the development, temporal validation, and geographic validation dataset, respectively. The final model contained 8 predictors, for example, age, residence before admission, number of drugs, and number of drugs of certain drug classes based on Anatomical Therapeutic Chemical coding. Temporal validation showed excellent calibration with a slope of 1.09 and an intercept of 0.18. Discrimination was moderate with a c-index (concordance index) of 0.67 (95% CI 0.61-0.73). In the geographic validation dataset, the calibration slope and intercept were 1.35 and 0.83, respectively, and the c-index was 0.68 (95% CI 0.58-0.78). The model showed net benefit over a range of clinically reasonable threshold probabilities and outperformed other selection criteria. ConclusionsOur software-implemented prediction model shows moderate performance, outperforming random or typical selection criteria for medication reconciliation. Depending on available resources, the probability threshold can be customized to increase either the specificity or the sensitivity of the model.