Brain extraction on MRI scans in presence of diffuse glioma: Multi-institutional performance evaluation of deep learning methods and robust modality-agnostic training
Siddhesh Thakur,
Jimit Doshi,
Sarthak Pati,
Saima Rathore,
Chiharu Sako,
Michel Bilello,
Sung Min Ha,
Gaurav Shukla,
Adam Flanders,
Aikaterini Kotrotsou,
Mikhail Milchenko,
Spencer Liem,
Gregory S. Alexander,
Joseph Lombardo,
Joshua D. Palmer,
Pamela LaMontagne,
Arash Nazeri,
Sanjay Talbar,
Uday Kulkarni,
Daniel Marcus,
Rivka Colen,
Christos Davatzikos,
Guray Erus,
Spyridon Bakas
Affiliations
Siddhesh Thakur
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Shri Guru Gobind Singhji Institute of Engineering and Technology, Nanded, Maharashtra, India
Jimit Doshi
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Sarthak Pati
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Saima Rathore
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Chiharu Sako
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Michel Bilello
Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Sung Min Ha
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Gaurav Shukla
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiation Oncology, Christiana Care Health System, Philadelphia, PA, USA; Department of Radiation Oncology, Sidney Kimmel Cancer Center, Thomas Jefferson University, Philadelphia, PA, USA
Adam Flanders
Department of Radiology, Thomas Jefferson University, Philadelphia, PA, USA
Aikaterini Kotrotsou
Department of Diagnostic Radiology, University of Texas MD Anderson Cancer Center, TX, USA
Mikhail Milchenko
Department of Radiology, Washington University, School of Medicine, St. Louis, MO, USA
Spencer Liem
Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, PA, USA
Gregory S. Alexander
Department of Radiation Oncology, University of Maryland, Baltimore, MD, USA
Joseph Lombardo
Department of Radiation Oncology, Sidney Kimmel Cancer Center, Thomas Jefferson University, Philadelphia, PA, USA; Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, PA, USA
Joshua D. Palmer
Department of Radiation Oncology, Sidney Kimmel Cancer Center, Thomas Jefferson University, Philadelphia, PA, USA; Department of Radiation Oncology, James Cancer Center, The Ohio State University, Columbus, OH, USA
Pamela LaMontagne
Department of Radiology, Washington University, School of Medicine, St. Louis, MO, USA
Arash Nazeri
Department of Radiology, Washington University, School of Medicine, St. Louis, MO, USA
Sanjay Talbar
Shri Guru Gobind Singhji Institute of Engineering and Technology, Nanded, Maharashtra, India
Uday Kulkarni
Shri Guru Gobind Singhji Institute of Engineering and Technology, Nanded, Maharashtra, India
Daniel Marcus
Department of Radiology, Washington University, School of Medicine, St. Louis, MO, USA
Rivka Colen
Department of Diagnostic Radiology, University of Texas MD Anderson Cancer Center, TX, USA
Christos Davatzikos
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Guray Erus
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
Spyridon Bakas
Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA; Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; Department of Pathology and Laboratory Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; Corresponding author. Center for Biomedical Image Computing and Analytics (CBICA), University of Pennsylvania, Philadelphia, PA, USA.
Brain extraction, or skull-stripping, is an essential pre-processing step in neuro-imaging that has a direct impact on the quality of all subsequent processing and analyses steps. It is also a key requirement in multi-institutional collaborations to comply with privacy-preserving regulations. Existing automated methods, including Deep Learning (DL) based methods that have obtained state-of-the-art results in recent years, have primarily targeted brain extraction without considering pathologically-affected brains. Accordingly, they perform sub-optimally when applied on magnetic resonance imaging (MRI) brain scans with apparent pathologies such as brain tumors. Furthermore, existing methods focus on using only T1-weighted MRI scans, even though multi-parametric MRI (mpMRI) scans are routinely acquired for patients with suspected brain tumors. In this study, we present a comprehensive performance evaluation of recent deep learning architectures for brain extraction, training models on mpMRI scans of pathologically-affected brains, with a particular focus on seeking a practically-applicable, low computational footprint approach, generalizable across multiple institutions, further facilitating collaborations. We identified a large retrospective multi-institutional dataset of n=3340 mpMRI brain tumor scans, with manually-inspected and approved gold-standard segmentations, acquired during standard clinical practice under varying acquisition protocols, both from private institutional data and public (TCIA) collections. To facilitate optimal utilization of rich mpMRI data, we further introduce and evaluate a novel ‘‘modality-agnostic training’’ technique that can be applied using any available modality, without need for model retraining. Our results indicate that the modality-agnostic approach11 Publicly available source code: https://github.com/CBICA/BrainMaGe obtains accurate results, providing a generic and practical tool for brain extraction on scans with brain tumors.