NeuroImage (Nov 2022)
A comparison of methods to harmonize cortical thickness measurements across scanners and sites
- Delin Sun,
- Gopalkumar Rakesh,
- Courtney C. Haswell,
- Mark Logue,
- C. Lexi Baird,
- Erin N. O'Leary,
- Andrew S. Cotton,
- Hong Xie,
- Marijo Tamburrino,
- Tian Chen,
- Emily L. Dennis,
- Neda Jahanshad,
- Lauren E. Salminen,
- Sophia I. Thomopoulos,
- Faisal Rashid,
- Christopher R.K. Ching,
- Saskia B.J. Koch,
- Jessie L. Frijling,
- Laura Nawijn,
- Mirjam van Zuiden,
- Xi Zhu,
- Benjamin Suarez-Jimenez,
- Anika Sierk,
- Henrik Walter,
- Antje Manthey,
- Jennifer S. Stevens,
- Negar Fani,
- Sanne J.H. van Rooij,
- Murray Stein,
- Jessica Bomyea,
- Inga K. Koerte,
- Kyle Choi,
- Steven J.A. van der Werff,
- Robert R.J.M. Vermeiren,
- Julia Herzog,
- Lauren A.M. Lebois,
- Justin T. Baker,
- Elizabeth A. Olson,
- Thomas Straube,
- Mayuresh S. Korgaonkar,
- Elpiniki Andrew,
- Ye Zhu,
- Gen Li,
- Jonathan Ipser,
- Anna R. Hudson,
- Matthew Peverill,
- Kelly Sambrook,
- Evan Gordon,
- Lee Baugh,
- Gina Forster,
- Raluca M. Simons,
- Jeffrey S. Simons,
- Vincent Magnotta,
- Adi Maron-Katz,
- Stefan du Plessis,
- Seth G. Disner,
- Nicholas Davenport,
- Daniel W. Grupe,
- Jack B. Nitschke,
- Terri A. deRoon-Cassini,
- Jacklynn M. Fitzgerald,
- John H. Krystal,
- Ifat Levy,
- Miranda Olff,
- Dick J. Veltman,
- Li Wang,
- Yuval Neria,
- Michael D. De Bellis,
- Tanja Jovanovic,
- Judith K. Daniels,
- Martha Shenton,
- Nic J.A. van de Wee,
- Christian Schmahl,
- Milissa L. Kaufman,
- Isabelle M. Rosso,
- Scott R. Sponheim,
- David Bernd Hofmann,
- Richard A. Bryant,
- Kelene A. Fercho,
- Dan J. Stein,
- Sven C. Mueller,
- Bobak Hosseini,
- K. Luan Phan,
- Katie A. McLaughlin,
- Richard J. Davidson,
- Christine L. Larson,
- Geoffrey May,
- Steven M. Nelson,
- Chadi G. Abdallah,
- Hassaan Gomaa,
- Amit Etkin,
- Soraya Seedat,
- Ilan Harpaz-Rotem,
- Israel Liberzon,
- Theo G.M. van Erp,
- Yann Quidé,
- Xin Wang,
- Paul M. Thompson,
- Rajendra A. Morey
Affiliations
- Delin Sun
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA.; Department of Veteran Affairs (VA) Mid-Atlantic Mental Illness Research, Education and Clinical Center, Durham, NC, USA.; Department of Psychology, The Education University of Hong Kong, Hong Kong, China
- Gopalkumar Rakesh
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA.; Department of Veteran Affairs (VA) Mid-Atlantic Mental Illness Research, Education and Clinical Center, Durham, NC, USA.
- Courtney C. Haswell
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA.; Department of Veteran Affairs (VA) Mid-Atlantic Mental Illness Research, Education and Clinical Center, Durham, NC, USA.
- Mark Logue
- National Center for PTSD, VA Boston Healthcare System, Boston, MA, USA.; Department of Psychiatry, Boston University School of Medicine, Boston, MA, USA.; Biomedical Genetics, Boston University School of Medicine, Boston, MA, USA.; Department of Biostatistics, Boston University School of Public Health, Boston, MA, USA.
- C. Lexi Baird
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA.; Department of Veteran Affairs (VA) Mid-Atlantic Mental Illness Research, Education and Clinical Center, Durham, NC, USA.
- Erin N. O'Leary
- Department of Psychiatry, University of Toledo, Toledo, OH, USA.
- Andrew S. Cotton
- Department of Psychiatry, University of Toledo, Toledo, OH, USA.
- Hong Xie
- Department of Psychiatry, University of Toledo, Toledo, OH, USA.
- Marijo Tamburrino
- Department of Psychiatry, University of Toledo, Toledo, OH, USA.
- Tian Chen
- Department of Psychiatry, University of Toledo, Toledo, OH, USA.; Psychiatry Neuroimaging Laboratory, Brigham & Women's Hospital, Boston, MA, USA.
- Emily L. Dennis
- Psychiatry Neuroimaging Laboratory, Brigham & Women's Hospital, Boston, MA, USA.; Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.; Department of Neurology, University of Utah, Salt Lake City, UT, USA.; Stanford Neurodevelopment, Affect, and Psychopathology Laboratory, Stanford, CA, USA.
- Neda Jahanshad
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.
- Lauren E. Salminen
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.
- Sophia I. Thomopoulos
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.
- Faisal Rashid
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.
- Christopher R.K. Ching
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.
- Saskia B.J. Koch
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.; Donders Institute for Brain, Cognition and Behavior, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, The Netherlands.
- Jessie L. Frijling
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
- Laura Nawijn
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.; Department of Psychiatry, Amsterdam University Medical Centers, VU University Medical Center, VU University, Amsterdam, The Netherlands.
- Mirjam van Zuiden
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
- Xi Zhu
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA.; New York State Psychiatric Institute, New York, NY, USA.
- Benjamin Suarez-Jimenez
- Del Monte Institute for Neuroscience, University of Rochester Medical Center, Rochester, NY, USA.; Department of Psychiatry, Columbia University Medical Center, New York, NY, USA.; New York State Psychiatric Institute, New York, NY, USA.
- Anika Sierk
- University Medical Centre Charité, Berlin, Germany.
- Henrik Walter
- University Medical Centre Charité, Berlin, Germany.
- Antje Manthey
- University Medical Centre Charité, Berlin, Germany.
- Jennifer S. Stevens
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA.
- Negar Fani
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA.
- Sanne J.H. van Rooij
- Department of Psychiatry and Behavioral Sciences, Emory University School of Medicine, Atlanta, GA, USA.
- Murray Stein
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA.
- Jessica Bomyea
- Department of Psychiatry, University of California San Diego, La Jolla, CA, USA.
- Inga K. Koerte
- Psychiatry Neuroimaging Laboratory, Brigham & Women's Hospital, Boston, MA, USA.; Department of Child and Adolescent Psychiatry, Psychosomatics, and Psychotherapy, Ludwig-Maximilians-Universität, Munich, Germany.
- Kyle Choi
- Health Services Research Center, University of California, San Diego, La Jolla, CA, USA.
- Steven J.A. van der Werff
- Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands.; Leiden Institute for Brain and Cognition, Leiden, The Netherlands.
- Robert R.J.M. Vermeiren
- Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands.
- Julia Herzog
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany.
- Lauren A.M. Lebois
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA.; Division of Depression and Anxiety Disorders, McLean Hospital, Belmont, MA, USA.
- Justin T. Baker
- Institute for Technology in Psychiatry, McLean Hospital, Harvard University, Belmont, MA, USA.
- Elizabeth A. Olson
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA.; Center for Depression, Anxiety, and Stress Research, McLean Hospital, Belmont, MA, USA.
- Thomas Straube
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Münster, Germany.
- Mayuresh S. Korgaonkar
- Brain Dynamics Centre, Westmead Institute of Medical Research, University of Sydney, Westmead, NSW, Australia.
- Elpiniki Andrew
- Department of Psychology, University of Sydney, Westmead, NSW, Australia.
- Ye Zhu
- Laboratory for Traumatic Stress Studies, Chinese Academy of Sciences Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
- Gen Li
- Laboratory for Traumatic Stress Studies, Chinese Academy of Sciences Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
- Jonathan Ipser
- SA MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry and Neuroscience Institute, University of Cape Town, Cape Town, South Africa.
- Anna R. Hudson
- Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium.
- Matthew Peverill
- Department of Psychology, University of Washington, Seattle, WA, USA.
- Kelly Sambrook
- Department of Radiology, University of Washington, Seattle, WA, USA.
- Evan Gordon
- Department of Radiology, Washington University, St. Louis, MO, USA.
- Lee Baugh
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA.; Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA.; Sioux Falls VA Health Care System, Sioux Falls, SD, USA.
- Gina Forster
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA.; Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA.; Brain Health Research Centre, Department of Anatomy, University of Otago, Dunedin, New Zealand.
- Raluca M. Simons
- Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA.; Department of Psychology, University of South Dakota, Vermillion, SD, USA.
- Jeffrey S. Simons
- Sioux Falls VA Health Care System, Sioux Falls, SD, USA.; Department of Psychology, University of South Dakota, Vermillion, SD, USA.
- Vincent Magnotta
- Department of Radiology, Psychiatry, and Biomedical Engineering, University of Iowa, Iowa City, IA, USA.
- Adi Maron-Katz
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA.
- Stefan du Plessis
- Department of Psychiatry, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa.
- Seth G. Disner
- Minneapolis VA Health Care System, Minneapolis, MN, USA.; Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA.
- Nicholas Davenport
- Minneapolis VA Health Care System, Minneapolis, MN, USA.; Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA.
- Daniel W. Grupe
- Center for Healthy Minds, University of Wisconsin-Madison, Madison, WI, USA.
- Jack B. Nitschke
- Department of Psychiatry, University of Wisconsin-Madison, Madison, WI, USA.
- Terri A. deRoon-Cassini
- Department of Surgery, Division of Trauma and Acute Care Surgery, Medical College of Wisconsin, Milwaukee, WI, USA.
- Jacklynn M. Fitzgerald
- Department of Psychology, Marquette University, Milwaukee, WI, USA.
- John H. Krystal
- Division of Clinical Neuroscience, National Center for PTSD, West Haven, CT, USA.; Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA.
- Ifat Levy
- Division of Clinical Neuroscience, National Center for PTSD, West Haven, CT, USA.; Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA.
- Miranda Olff
- Department of Psychiatry, Amsterdam University Medical Centers, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.; ARQ National Psychotrauma Centre, Diemen, The Netherlands.
- Dick J. Veltman
- Department of Psychiatry, Amsterdam University Medical Center, location VUMC, Amsterdam, The Netherlands.
- Li Wang
- Laboratory for Traumatic Stress Studies, Chinese Academy of Sciences Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
- Yuval Neria
- Department of Psychiatry, Columbia University Medical Center, New York, NY, USA.; New York State Psychiatric Institute, New York, NY, USA.
- Michael D. De Bellis
- Healthy Childhood Brain Development Developmental Traumatology Research Program, Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA.
- Tanja Jovanovic
- Department of Psychiatry and Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, USA.
- Judith K. Daniels
- Department of Clinical Psychology, University of Groningen, Groningen, The Netherlands.
- Martha Shenton
- Psychiatry Neuroimaging Laboratory, Brigham & Women's Hospital, Boston, MA, USA.; VA Boston Healthcare System, Brockton Division, Brockton, MA, USA.
- Nic J.A. van de Wee
- Department of Psychiatry, Leiden University Medical Center, Leiden, The Netherlands.; Leiden Institute for Brain and Cognition, Leiden, The Netherlands.
- Christian Schmahl
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany.
- Milissa L. Kaufman
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA.; Division of Women's Mental Health, McLean Hospital, Belmont, MA, USA.
- Isabelle M. Rosso
- Department of Psychiatry, Harvard Medical School, Boston, MA, USA.; Center for Depression, Anxiety, and Stress Research, McLean Hospital, Belmont, MA, USA.
- Scott R. Sponheim
- Minneapolis VA Health Care System, Minneapolis, MN, USA.; Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA.
- David Bernd Hofmann
- Institute of Medical Psychology and Systems Neuroscience, University of Münster, Münster, Germany.
- Richard A. Bryant
- School of Psychology, University of New South Wales, Sydney, NSW, Australia.
- Kelene A. Fercho
- Division of Basic Biomedical Sciences, Sanford School of Medicine, University of South Dakota, Vermillion, SD, USA.; Center for Brain and Behavior Research, University of South Dakota, Vermillion, SD, USA.; Sioux Falls VA Health Care System, Sioux Falls, SD, USA.; Civil Aerospace Medical Institute, US Federal Aviation Administration, Oklahoma City, OK, USA.
- Dan J. Stein
- SA MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry and Neuroscience Institute, University of Cape Town, Cape Town, South Africa.
- Sven C. Mueller
- Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium.
- Bobak Hosseini
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA.
- K. Luan Phan
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, USA.; Mental Health Service Line, Jesse Brown VA Chicago Health Care System, Chicago, IL, USA.
- Katie A. McLaughlin
- Department of Psychology, Harvard University, Cambridge, MA, USA.
- Richard J. Davidson
- Center for Healthy Minds, University of Wisconsin-Madison, Madison, WI, USA.; Department of Psychiatry, University of Wisconsin-Madison, Madison, WI, USA.; Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA.
- Christine L. Larson
- Department of Psychology, University of Wisconsin-Milwaukee, Milwaukee, WI, USA.
- Geoffrey May
- Veterans Integrated Service Network-17 Center of Excellence for Research on Returning War Veterans, Waco, TX, USA.; Department of Psychology and Neuroscience, Baylor University, Waco, TX, USA.; Center for Vital Longevity, School of Behavioral and Brain Sciences, University of Texas at Dallas, Dallas, TX, USA.; Department of Psychiatry and Behavioral Science, Texas A&M University Health Science Center, Bryan, TX, USA.
- Steven M. Nelson
- Veterans Integrated Service Network-17 Center of Excellence for Research on Returning War Veterans, Waco, TX, USA.; Department of Psychology and Neuroscience, Baylor University, Waco, TX, USA.; Center for Vital Longevity, School of Behavioral and Brain Sciences, University of Texas at Dallas, Dallas, TX, USA.; Department of Psychiatry and Behavioral Science, Texas A&M University Health Science Center, Bryan, TX, USA.
- Chadi G. Abdallah
- Division of Clinical Neuroscience, National Center for PTSD, West Haven, CT, USA.; Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA.
- Hassaan Gomaa
- Department of Psychiatry and Behavioral Health, Pennsylvania State University, Hershey, PA, USA.
- Amit Etkin
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA.; VA Palo Alto Health Care System, Palo Alto, CA, USA.
- Soraya Seedat
- Department of Psychiatry, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa.
- Ilan Harpaz-Rotem
- Division of Clinical Neuroscience, National Center for PTSD, West Haven, CT, USA.; Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA.
- Israel Liberzon
- Department of Psychiatry and Behavioral Science, Texas A&M University, College Station, TX, USA
- Theo G.M. van Erp
- Clinical Translational Neuroscience Laboratory, Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA.; Center for the Neurobiology of Learning and Memory, University of California, Irvine, Irvine, CA, USA.
- Yann Quidé
- School of Psychology, The University of New South Wales, Sydney, NSW, Australia.; Neuroscience Research Australia, Randwick, NSW, Australia.
- Xin Wang
- Department of Mathematics and Statistics, University of Toledo, Toledo, OH, USA.
- Paul M. Thompson
- Imaging Genetics Center, Mark & Mary Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, USA.
- Rajendra A. Morey
- Brain Imaging and Analysis Center, Duke University, Durham, NC, USA.; Department of Veteran Affairs (VA) Mid-Atlantic Mental Illness Research, Education and Clinical Center, Durham, NC, USA.; Corresponding Author, Rajendra A. Morey, M.D. 40 Duke Medicine Circle, Room 414, Durham, NC 27710 USA, Phone: 919-286-0411 ext. 6425, Facsimile: 919-416-5912,
- Journal volume & issue
-
Vol. 261
p. 119509
Abstract
Results of neuroimaging datasets aggregated from multiple sites may be biased by site-specific profiles in participants’ demographic and clinical characteristics, as well as MRI acquisition protocols and scanning platforms. We compared the impact of four different harmonization methods on results obtained from analyses of cortical thickness data: (1) linear mixed-effects model (LME) that models site-specific random intercepts (LMEINT), (2) LME that models both site-specific random intercepts and age-related random slopes (LMEINT+SLP), (3) ComBat, and (4) ComBat with a generalized additive model (ComBat-GAM). Our test case for comparing harmonization methods was cortical thickness data aggregated from 29 sites, which included 1,340 cases with posttraumatic stress disorder (PTSD) (6.2–81.8 years old) and 2,057 trauma-exposed controls without PTSD (6.3–85.2 years old). We found that, compared to the other data harmonization methods, data processed with ComBat-GAM was more sensitive to the detection of significant case-control differences (Χ2(3) = 63.704, p < 0.001) as well as case-control differences in age-related cortical thinning (Χ2(3) = 12.082, p = 0.007). Both ComBat and ComBat-GAM outperformed LME methods in detecting sex differences (Χ2(3) = 9.114, p = 0.028) in regional cortical thickness. ComBat-GAM also led to stronger estimates of age-related declines in cortical thickness (corrected p-values < 0.001), stronger estimates of case-related cortical thickness reduction (corrected p-values < 0.001), weaker estimates of age-related declines in cortical thickness in cases than controls (corrected p-values < 0.001), stronger estimates of cortical thickness reduction in females than males (corrected p-values < 0.001), and stronger estimates of cortical thickness reduction in females relative to males in cases than controls (corrected p-values < 0.001). Our results support the use of ComBat-GAM to minimize confounds and increase statistical power when harmonizing data with non-linear effects, and the use of either ComBat or ComBat-GAM for harmonizing data with linear effects.
