Pragmatic and Observational Research (Oct 2023)
Development of an Asthma Exacerbation Risk Prediction Model for Conversational Use by Adults in England
Abstract
Constantinos Kallis,1 Rafael A Calvo,2 Bjorn Schuller,3 Jennifer K Quint1 1National Heart and Lung Institute, and School of Public Health, Imperial College London, London, UK; 2Dyson School of Engineering, Faculty of Engineering, Imperial College London, London, UK; 3Department of Computing, Faculty of Engineering, Imperial College London, London, UKCorrespondence: Jennifer K Quint, National Heart and Lung Institute and School of Public Health, Floor 9, Sir Michael Uren Building, 86 Wood Ln, London, W12 0BZ, United Kingdom, Email [email protected]: Improving accurate risk assessment of asthma exacerbations, and reduction via relevant behaviour change among people with asthma could save lives and reduce health care costs. We developed a simple personalised risk prediction model for asthma exacerbations using factors collected in routine healthcare data for use in a risk modelling feature for automated conversational systems.Methods: We used pseudonymised primary care electronic healthcare records from the Clinical Practice Research Datalink (CPRD) Aurum database in England. We combined variables for prediction of asthma exacerbations using logistic regression including age, gender, ethnicity, Index of Multiple Deprivation, geographical region and clinical variables related to asthma events.Results: We included 1,203,741 patients divided into three cohorts to implement temporal validation: 898,763 (74.7%) in the training sample, 226,754 (18.8%) in the testing sample and 78,224 (6.5%) in the validation sample. The Area under the ROC curve (AUC) for the full model was 0.72 and for the restricted model was 0.71. Using a cut-off point of 0.1, approximately 27 asthma reviews by clinicians per 100 patients would be prevented compared with a strategy that all patients are regarded as high risk. Compared with patients without an exacerbation, patients who exacerbated were older, more likely to be female, prescribed more SABA and ICS in the preceding 12 months, have history of GORD, COPD, anxiety, depression, live in very deprived areas and have more severe disease.Conclusion: Using information available from routinely collected electronic healthcare record data, we developed a model that has moderate ability to separate patients who had an asthma exacerbation within 3 months from their index date from patients who did not. When comparing this model with a simplified model with variables that can easily be self-reported through a WhatsApp chatbot, we have shown that the predictive performance of the model is not substantially different.Keywords: asthma, exacerbation, risk prediction, electronic healthcare records