FIESTA: Autoencoders for accurate fiber segmentation in tractography
Félix Dumais,
Jon Haitz Legarreta,
Carl Lemaire,
Philippe Poulin,
François Rheault,
Laurent Petit,
Muhamed Barakovic,
Stefano Magon,
Maxime Descoteaux,
Pierre-Marc Jodoin
Affiliations
Félix Dumais
Sherbrooke Connectivity Imaging Lab (SCIL), Department of Computer Science, Université de Sherbrooke, Canada; Videos & Images Theory and Analytics Lab (VITAL), Department of Computer Science, Université de Sherbrooke, Canada; Correspondence to: Faculty of Sciences, Université de Sherbrooke, 2500, boulevard de l’Université, Sherbrooke, Québec, Canada, J1K 2R1.
Jon Haitz Legarreta
Department of Radiology, Brigham and Women’s Hospital, Mass General Brigham/Harvard Medical School, USA
Carl Lemaire
Centre de Calcul Scientifique, Université de Sherbrooke, Canada
Philippe Poulin
Sherbrooke Connectivity Imaging Lab (SCIL), Department of Computer Science, Université de Sherbrooke, Canada; Videos & Images Theory and Analytics Lab (VITAL), Department of Computer Science, Université de Sherbrooke, Canada
François Rheault
Medical Imaging and Neuroinformatic (MINi) Lab, Department of Computer Science, Université de Sherbrooke, Canada
Laurent Petit
Groupe d’Imagerie Neurofonctionnelle (GIN), CNRS, CEA, IMN, GIN, UMR 5293, F-33000 Bordeaux, Université de Bordeaux, France
Muhamed Barakovic
Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd., Basel, Switzerland
Stefano Magon
Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd., Basel, Switzerland
Maxime Descoteaux
Sherbrooke Connectivity Imaging Lab (SCIL), Department of Computer Science, Université de Sherbrooke, Canada; Imeka Solutions inc, Sherbrooke, Canada
Pierre-Marc Jodoin
Videos & Images Theory and Analytics Lab (VITAL), Department of Computer Science, Université de Sherbrooke, Canada; Imeka Solutions inc, Sherbrooke, Canada
White matter bundle segmentation is a cornerstone of modern tractography to study the brain’s structural connectivity in domains such as neurological disorders, neurosurgery, and aging. In this study, we present FIESTA (FIbEr Segmentation in Tractography using Autoencoders), a reliable and robust, fully automated, and easily semi-automatically calibrated pipeline based on deep autoencoders that can dissect and fully populate white matter bundles. This pipeline is built upon previous works that demonstrated how autoencoders can be used successfully for streamline filtering, bundle segmentation, and streamline generation in tractography. Our proposed method improves bundle segmentation coverage by recovering hard-to-track bundles with generative sampling through the latent space seeding of the subject bundle and the atlas bundle. A latent space of streamlines is learned using autoencoder-based modeling combined with contrastive learning. Using an atlas of bundles in standard space (MNI), our proposed method segments new tractograms using the autoencoder latent distance between each tractogram streamline and its closest neighbor bundle in the atlas of bundles. Intra-subject bundle reliability is improved by recovering hard-to-track streamlines, using the autoencoder to generate new streamlines that increase the spatial coverage of each bundle while remaining anatomically correct. Results show that our method is more reliable than state-of-the-art automated virtual dissection methods such as RecoBundles, RecoBundlesX, TractSeg, White Matter Analysis and XTRACT. Our framework allows for the transition from one anatomical bundle definition to another with marginal calibration efforts. Overall, these results show that our framework improves the practicality and usability of current state-of-the-art bundle segmentation framework