Medicina (Apr 2022)
External Validation of a Convolutional Neural Network for IDH Mutation Prediction
Abstract
Background and Objectives: The IDH (isocitrate dehydrogenase) status represents one of the main prognosis factors for gliomas. However, determining it requires invasive procedures and specialized surgical skills. Medical imaging such as MRI is essential in glioma diagnosis and management. Lately, fields such as Radiomics and Radiogenomics emerged as pertinent prediction tools for extracting molecular information out of medical images. These fields are based on Artificial Intelligence algorithms that require external validation in order to evaluate their general performance. The aim of this study was to provide an external validation for the algorithm formulated by Yoon Choi et al. of IDH status prediction using preoperative common MRI sequences and patient age. Material and Methods: We applied Choi’s IDH status prediction algorithm on T1c, T2 and FLAIR preoperative MRI images of gliomas (grades WHO II-IV) of 21 operated adult patients from the Neurosurgery clinic of the Cluj County Emergency Clinical Hospital (CCECH), Cluj-Napoca Romania. We created a script to automate the testing process with DICOM format MRI sequences as input and IDH predicted status as output. Results: In terms of patient characteristics, the mean age was 48.6 ± 15.6; 57% were female and 43% male; 43% were IDH positive and 57% IDH negative. The proportions of WHO grades were 24%, 14% and 62% for II, III and IV, respectively. The validation test achieved a relative accuracy of 76% with 95% CI of (53%, 92%) and an Area Under the Curve (AUC) through DeLong et al. method of 0.74 with 95% CI of (0.53, 0.91) and a p of 0.021. Sensitivity and Specificity were 0.78 with 95% CI of (0.45, 0.96) and 0.75 with 95% CI of (0.47, 0.91), respectively. Conclusions: Although our results match the external test the author made on The Cancer Imaging Archive (TCIA) online dataset, performance of the algorithm on external data is still not high enough for clinical application. Radiogenomic approaches remain a high interest research field that may provide a rapid and accurate diagnosis and prognosis of patients with intracranial glioma.
Keywords
