NeuroImage (Dec 2023)
Neuroimaging-based classification of PTSD using data-driven computational approaches: A multisite big data study from the ENIGMA-PGC PTSD consortium
- Xi Zhu,
- Yoojean Kim,
- Orren Ravid,
- Xiaofu He,
- Benjamin Suarez-Jimenez,
- Sigal Zilcha-Mano,
- Amit Lazarov,
- Seonjoo Lee,
- Chadi G. Abdallah,
- Michael Angstadt,
- Christopher L. Averill,
- C. Lexi Baird,
- Lee A. Baugh,
- Jennifer U. Blackford,
- Jessica Bomyea,
- Steven E. Bruce,
- Richard A. Bryant,
- Zhihong Cao,
- Kyle Choi,
- Josh Cisler,
- Andrew S. Cotton,
- Judith K. Daniels,
- Nicholas D. Davenport,
- Richard J. Davidson,
- Michael D. DeBellis,
- Emily L. Dennis,
- Maria Densmore,
- Terri deRoon-Cassini,
- Seth G. Disner,
- Wissam El Hage,
- Amit Etkin,
- Negar Fani,
- Kelene A. Fercho,
- Jacklynn Fitzgerald,
- Gina L. Forster,
- Jessie L. Frijling,
- Elbert Geuze,
- Atilla Gonenc,
- Evan M. Gordon,
- Staci Gruber,
- Daniel W Grupe,
- Jeffrey P. Guenette,
- Courtney C. Haswell,
- Ryan J. Herringa,
- Julia Herzog,
- David Bernd Hofmann,
- Bobak Hosseini,
- Anna R. Hudson,
- Ashley A. Huggins,
- Jonathan C. Ipser,
- Neda Jahanshad,
- Meilin Jia-Richards,
- Tanja Jovanovic,
- Milissa L. Kaufman,
- Mitzy Kennis,
- Anthony King,
- Philipp Kinzel,
- Saskia B.J. Koch,
- Inga K. Koerte,
- Sheri M. Koopowitz,
- Mayuresh S. Korgaonkar,
- John H. Krystal,
- Ruth Lanius,
- Christine L. Larson,
- Lauren A.M. Lebois,
- Gen Li,
- Israel Liberzon,
- Guang Ming Lu,
- Yifeng Luo,
- Vincent A. Magnotta,
- Antje Manthey,
- Adi Maron-Katz,
- Geoffery May,
- Katie McLaughlin,
- Sven C. Mueller,
- Laura Nawijn,
- Steven M. Nelson,
- Richard W.J. Neufeld,
- Jack B Nitschke,
- Erin M. O'Leary,
- Bunmi O. Olatunji,
- Miranda Olff,
- Matthew Peverill,
- K. Luan Phan,
- Rongfeng Qi,
- Yann Quidé,
- Ivan Rektor,
- Kerry Ressler,
- Pavel Riha,
- Marisa Ross,
- Isabelle M. Rosso,
- Lauren E. Salminen,
- Kelly Sambrook,
- Christian Schmahl,
- Martha E. Shenton,
- Margaret Sheridan,
- Chiahao Shih,
- Maurizio Sicorello,
- Anika Sierk,
- Alan N. Simmons,
- Raluca M. Simons,
- Jeffrey S. Simons,
- Scott R. Sponheim,
- Murray B. Stein,
- Dan J. Stein,
- Jennifer S. Stevens,
- Thomas Straube,
- Delin Sun,
- Jean Théberge,
- Paul M. Thompson,
- Sophia I. Thomopoulos,
- Nic J.A. van der Wee,
- Steven J.A. van der Werff,
- Theo G.M. van Erp,
- Sanne J.H. van Rooij,
- Mirjam van Zuiden,
- Tim Varkevisser,
- Dick J. Veltman,
- Robert R.J.M. Vermeiren,
- Henrik Walter,
- Li Wang,
- Xin Wang,
- Carissa Weis,
- Sherry Winternitz,
- Hong Xie,
- Ye Zhu,
- Melanie Wall,
- Yuval Neria,
- Rajendra A. Morey
Affiliations
- Xi Zhu
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA
- Yoojean Kim
- New York State Psychiatric Institute, New York, NY, USA
- Orren Ravid
- New York State Psychiatric Institute, New York, NY, USA
- Xiaofu He
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA
- Benjamin Suarez-Jimenez
- University of Rochester, Rochester, NY, USA
- Sigal Zilcha-Mano
- University of Haifa, Haifa, Israel
- Amit Lazarov
- Tel-Aviv University, Tel Aviv, Israel
- Seonjoo Lee
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA
- Chadi G. Abdallah
- Baylor College of Medicine, Houston, TX, USA; Yale University School of Medicine, New Haven, CT, USA
- Michael Angstadt
- University of Michigan, Ann Arbor, MI, USA
- Christopher L. Averill
- Baylor College of Medicine, Houston, TX, USA; Yale University School of Medicine, New Haven, CT, USA
- C. Lexi Baird
- Duke University, Durham, NC, USA
- Lee A. Baugh
- Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA
- Jennifer U. Blackford
- Munroe-Meyer Institute, University of Nebraska Medical Center, Omaha, NE, USA
- Jessica Bomyea
- University of California San Diego, La Jolla, CA, USA
- Steven E. Bruce
- Center for Trauma Recovery, Department of Psychological Sciences, University of Missouri-St. Louis, St. Louis, MO, USA
- Richard A. Bryant
- School of Psychology, University of New South Wales, Sydney, NSW, Australia
- Zhihong Cao
- Department of Radiology, The Affiliated Yixing Hospital of Jiangsu University, Yixing, Jiangsu, China
- Kyle Choi
- University of California San Diego, La Jolla, CA, USA
- Josh Cisler
- Department of Psychiatry, University of Texas at Austin, Austin, TX, USA
- Andrew S. Cotton
- University of Toledo, Toledo, OH, USA
- Judith K. Daniels
- University of Groningen, Groningen, The Netherlands
- Nicholas D. Davenport
- Minneapolis VA Health Care System, Minneapolis, MN, USA
- Richard J. Davidson
- University of Wisconsin-Madison, Madison, WI, USA
- Michael D. DeBellis
- Duke University, Durham, NC, USA
- Emily L. Dennis
- University of Utah School of Medicine, Salt Lake City, UT, USA
- Maria Densmore
- Departments of Psychology and Psychiatry, Neuroscience Program, Western University, London, ON, Canada; Department of Psychology, University of British Columbia, Okanagan, Kelowna, British Columbia, Canada
- Terri deRoon-Cassini
- Medical College of Wisconsin, Milwaukee, WI, USA
- Seth G. Disner
- Minneapolis VA Health Care System, Minneapolis, MN, USA
- Wissam El Hage
- UMR 1253, CIC 1415, University of Tours, CHRU de Tours, INSERM, France
- Amit Etkin
- Stanford University, Stanford, CA, USA
- Negar Fani
- Emory University Department of Psychiatry and Behavioral Sciences, Atlanta, GA, USA
- Kelene A. Fercho
- Civil Aerospace Medical Institute, US Federal Aviation Administration, Oklahoma City, OK, USA
- Jacklynn Fitzgerald
- Marquette University, Milwaukee, WI, USA
- Gina L. Forster
- Brain Health Research Centre, Department of Anatomy, University of Otago, Dunedin, New Zealand
- Jessie L. Frijling
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- Elbert Geuze
- Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands
- Atilla Gonenc
- Cognitive and Clinical Neuroimaging Core, McLean Hospital, Belmont, MA, USA
- Evan M. Gordon
- Department of Radiology, Washington University School of Medicine, St. Louis, MO, USA
- Staci Gruber
- Cognitive and Clinical Neuroimaging Core, McLean Hospital, Belmont, MA, USA
- Daniel W Grupe
- University of Wisconsin-Madison, Madison, WI, USA
- Jeffrey P. Guenette
- Division of Neuroradiology, Brigham and Women's Hospital, Boston, MA, USA
- Courtney C. Haswell
- Duke University, Durham, NC, USA
- Ryan J. Herringa
- School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, USA
- Julia Herzog
- Heidelberg University, Heidelberg, Germany
- David Bernd Hofmann
- University of Münster, Münster, Germany
- Bobak Hosseini
- University of Illinois at Chicago, Chicago, IL, USA
- Anna R. Hudson
- Ghent University, Ghent, Belgium
- Ashley A. Huggins
- Duke University, Durham, NC, USA
- Jonathan C. Ipser
- University of Cape Town, Cape Town, South Africa
- Neda Jahanshad
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
- Meilin Jia-Richards
- Department of Psychology and Neuroscience, Baylor University, Waco, TX, USA
- Tanja Jovanovic
- Wayne State University School of Medicine, Detroit, MI, USA
- Milissa L. Kaufman
- Division of Women's Mental Health, McLean Hospital, Belmont, MA, USA
- Mitzy Kennis
- Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands
- Anthony King
- University of Michigan, Ann Arbor, MI, USA
- Philipp Kinzel
- Department of Child and Adolescent Psychiatry, Psychosomatic and Psychotherapy, Ludwig Maximilian University of Munich, Munich, Germany; Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA
- Saskia B.J. Koch
- Donders Institute for Brain, Cognition and Behavior, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, The Netherlands
- Inga K. Koerte
- Department of Child and Adolescent Psychiatry, Psychosomatic and Psychotherapy, Ludwig Maximilian University of Munich, Munich, Germany; Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA
- Sheri M. Koopowitz
- University of Cape Town, Cape Town, South Africa
- Mayuresh S. Korgaonkar
- Westmead Institute for Medical Research, Westmead, NSW, Australia
- John H. Krystal
- Yale University School of Medicine, New Haven, CT, USA
- Ruth Lanius
- Department of Neuroscience, Western University, London, ON, Canada
- Christine L. Larson
- University of Wisconsin-Milwaukee, Milwaukee, WI, USA
- Lauren A.M. Lebois
- McLean Hospital, Belmont, MA, USA; Harvard Medical School, Boston, MA, USA
- Gen Li
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Israel Liberzon
- Psychiatry and Behavioral Science, Texas A&M University Health Science Center, College Station, TX, USA
- Guang Ming Lu
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, China
- Yifeng Luo
- Department of Radiology, The Affiliated Yixing Hospital of Jiangsu University, Yixing, Jiangsu, China
- Vincent A. Magnotta
- University of Iowa, Iowa City, IA, USA
- Antje Manthey
- Charité Universitätsmedizin Berlin Campus Charite Mitte: Charite Universitatsmedizin Berlin, Berlin, Germany
- Adi Maron-Katz
- Stanford University, Stanford, CA, USA
- Geoffery May
- VISN 17 Center of Excellence for Research on Returning War Veterans, Waco, TX, USA
- Katie McLaughlin
- Harvard University, Boston, MA, USA
- Sven C. Mueller
- Ghent University, Ghent, Belgium
- Laura Nawijn
- Department of Psychiatry, Amsterdam University Medical Centers, VU University Medical Center, VU University, Amsterdam, The Netherlands
- Steven M. Nelson
- Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
- Richard W.J. Neufeld
- Departments of Psychology and Psychiatry, Neuroscience Program, Western University, London, ON, Canada; Department of Psychology, University of British Columbia, Okanagan, Kelowna, British Columbia, Canada
- Jack B Nitschke
- University of Wisconsin-Madison, Madison, WI, USA
- Erin M. O'Leary
- University of Toledo, Toledo, OH, USA
- Bunmi O. Olatunji
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
- Miranda Olff
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- Matthew Peverill
- University of Washington, Seattle, WA, USA
- K. Luan Phan
- Department of Psychiatry and Behavioral Health, Ohio State University, Columbus, OH, USA
- Rongfeng Qi
- Department of Medical Imaging, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu, China
- Yann Quidé
- School of Psychology, University of New South Wales, Sydney, NSW, Australia; Neuroscience Research Australia, Randwick, NSW, Australia
- Ivan Rektor
- Masaryk University, Brno, Czechia
- Kerry Ressler
- McLean Hospital, Belmont, MA, USA; Harvard Medical School, Boston, MA, USA
- Pavel Riha
- Masaryk University, Brno, Czechia
- Marisa Ross
- Northwestern Neighborhood and Networks Initiative, Northwestern University Institute for Policy Research, Evanston, IL, USA
- Isabelle M. Rosso
- McLean Hospital, Belmont, MA, USA; Harvard Medical School, Boston, MA, USA
- Lauren E. Salminen
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
- Kelly Sambrook
- University of Washington, Seattle, WA, USA
- Christian Schmahl
- Heidelberg University, Heidelberg, Germany
- Martha E. Shenton
- Psychiatry Neuroimaging Laboratory, Brigham and Women's Hospital, Boston, MA, USA
- Margaret Sheridan
- University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
- Chiahao Shih
- University of Toledo, Toledo, OH, USA
- Maurizio Sicorello
- Heidelberg University, Heidelberg, Germany
- Anika Sierk
- Charité Universitätsmedizin Berlin Campus Charite Mitte: Charite Universitatsmedizin Berlin, Berlin, Germany
- Alan N. Simmons
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, CA, USA
- Raluca M. Simons
- University of South Dakota, Vermillion, SD, USA
- Jeffrey S. Simons
- University of South Dakota, Vermillion, SD, USA
- Scott R. Sponheim
- Minneapolis VA Health Care System, Minneapolis, MN, USA; University of Minnesota, Minneapolis, MN, USA
- Murray B. Stein
- University of California San Diego, La Jolla, CA, USA
- Dan J. Stein
- University of Cape Town, Cape Town, South Africa
- Jennifer S. Stevens
- Emory University Department of Psychiatry and Behavioral Sciences, Atlanta, GA, USA
- Thomas Straube
- University of Münster, Münster, Germany
- Delin Sun
- Duke University, Durham, NC, USA
- Jean Théberge
- Departments of Psychology and Psychiatry, Neuroscience Program, Western University, London, ON, Canada; Department of Psychology, University of British Columbia, Okanagan, Kelowna, British Columbia, Canada
- Paul M. Thompson
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
- Sophia I. Thomopoulos
- Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of the University of Southern California, Marina del Rey, CA, USA
- Nic J.A. van der Wee
- Leiden University Medical Center, Leiden, The Netherlands
- Steven J.A. van der Werff
- Leiden University Medical Center, Leiden, The Netherlands
- Theo G.M. van Erp
- University of California, Irvine, Irvine, CA, USA
- Sanne J.H. van Rooij
- Emory University Department of Psychiatry and Behavioral Sciences, Atlanta, GA, USA
- Mirjam van Zuiden
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands
- Tim Varkevisser
- Brain Research and Innovation Centre, Ministry of Defence, Utrecht, The Netherlands
- Dick J. Veltman
- Department of Psychiatry, Amsterdam University Medical Centers, VU University Medical Center, VU University, Amsterdam, The Netherlands
- Robert R.J.M. Vermeiren
- Leiden University Medical Center, Leiden, The Netherlands
- Henrik Walter
- Charité Universitätsmedizin Berlin Campus Charite Mitte: Charite Universitatsmedizin Berlin, Berlin, Germany
- Li Wang
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Xin Wang
- University of Toledo, Toledo, OH, USA
- Carissa Weis
- Medical College of Wisconsin, Milwaukee, WI, USA
- Sherry Winternitz
- Division of Women's Mental Health, McLean Hospital, Belmont, MA, USA
- Hong Xie
- University of Toledo, Toledo, OH, USA
- Ye Zhu
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Melanie Wall
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; New York State Psychiatric Institute, New York, NY, USA
- Yuval Neria
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA; Corresponding author at: New York State Psychiatric Institute, Unit 69, 1051 Riverside Drive, New York, NY 10032, USA.
- Rajendra A. Morey
- Duke University, Durham, NC, USA; Corresponding author at: New York State Psychiatric Institute, Unit 69, 1051 Riverside Drive, New York, NY 10032, USA.
- Journal volume & issue
-
Vol. 283
p. 120412
Abstract
Background: Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group. Methods: We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality. Results: We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for d-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance. Conclusion: These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.
