Subcortical segmentation of the fetal brain in 3D ultrasound using deep learning
Linde S. Hesse,
Moska Aliasi,
Felipe Moser,
Monique C. Haak,
Weidi Xie,
Mark Jenkinson,
Ana I.L. Namburete
Affiliations
Linde S. Hesse
Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, United Kingdom; Corresponding author
Moska Aliasi
Department of Obstetrics and Fetal Medicine, Leiden University Medical Center, The Netherlands
Felipe Moser
Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, United Kingdom; Department of Obstetrics and Fetal Medicine, Leiden University Medical Center, The Netherlands; Visual Geometry Group, Department of Engineering Science, University of Oxford, United Kingdom; Wellcome center for Integrative NeuroImaging, FMRIB, University of Oxford, United Kingdom; Australian Institute for Machine Learning (AIML), Australia; South Australian Health and Medical Research Institute (SAHMRI), Australia; Department of Computer Science, University of Oxford, United Kingdom
Monique C. Haak
Department of Obstetrics and Fetal Medicine, Leiden University Medical Center, The Netherlands
Weidi Xie
Visual Geometry Group, Department of Engineering Science, University of Oxford, United Kingdom
Mark Jenkinson
Wellcome center for Integrative NeuroImaging, FMRIB, University of Oxford, United Kingdom; Australian Institute for Machine Learning (AIML), Australia; South Australian Health and Medical Research Institute (SAHMRI), Australia
Ana I.L. Namburete
Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, United Kingdom; Department of Obstetrics and Fetal Medicine, Leiden University Medical Center, The Netherlands; Visual Geometry Group, Department of Engineering Science, University of Oxford, United Kingdom; Wellcome center for Integrative NeuroImaging, FMRIB, University of Oxford, United Kingdom; Australian Institute for Machine Learning (AIML), Australia; South Australian Health and Medical Research Institute (SAHMRI), Australia; Department of Computer Science, University of Oxford, United Kingdom
The quantification of subcortical volume development from 3D fetal ultrasound can provide important diagnostic information during pregnancy monitoring. However, manual segmentation of subcortical structures in ultrasound volumes is time-consuming and challenging due to low soft tissue contrast, speckle and shadowing artifacts. For this reason, we developed a convolutional neural network (CNN) for the automated segmentation of the choroid plexus (CP), lateral posterior ventricle horns (LPVH), cavum septum pellucidum et vergae (CSPV), and cerebellum (CB) from 3D ultrasound. As ground-truth labels are scarce and expensive to obtain, we applied few-shot learning, in which only a small number of manual annotations (n = 9) are used to train a CNN. We compared training a CNN with only a few individually annotated volumes versus many weakly labelled volumes obtained from atlas-based segmentations. This showed that segmentation performance close to intra-observer variability can be obtained with only a handful of manual annotations. Finally, the trained models were applied to a large number (n = 278) of ultrasound image volumes of a diverse, healthy population, obtaining novel US-specific growth curves of the respective structures during the second trimester of gestation.