Frontiers in Neuroinformatics (Jan 2019)
An Empirical Comparison of Meta- and Mega-Analysis With Data From the ENIGMA Obsessive-Compulsive Disorder Working Group
- Premika S. W. Boedhoe,
- Premika S. W. Boedhoe,
- Martijn W. Heymans,
- Lianne Schmaal,
- Lianne Schmaal,
- Yoshinari Abe,
- Pino Alonso,
- Pino Alonso,
- Pino Alonso,
- Stephanie H. Ameis,
- Stephanie H. Ameis,
- Alan Anticevic,
- Paul D. Arnold,
- Paul D. Arnold,
- Marcelo C. Batistuzzo,
- Francesco Benedetti,
- Jan C. Beucke,
- Irene Bollettini,
- Anushree Bose,
- Silvia Brem,
- Anna Calvo,
- Rosa Calvo,
- Rosa Calvo,
- Yuqi Cheng,
- Kang Ik K. Cho,
- Valentina Ciullo,
- Valentina Ciullo,
- Sara Dallaspezia,
- Damiaan Denys,
- Damiaan Denys,
- Jamie D. Feusner,
- Kate D. Fitzgerald,
- Jean-Paul Fouche,
- Egill A. Fridgeirsson,
- Patricia Gruner,
- Gregory L. Hanna,
- Derrek P. Hibar,
- Marcelo Q. Hoexter,
- Hao Hu,
- Chaim Huyser,
- Chaim Huyser,
- Neda Jahanshad,
- Anthony James,
- Norbert Kathmann,
- Christian Kaufmann,
- Kathrin Koch,
- Kathrin Koch,
- Jun Soo Kwon,
- Jun Soo Kwon,
- Luisa Lazaro,
- Luisa Lazaro,
- Luisa Lazaro,
- Luisa Lazaro,
- Christine Lochner,
- Rachel Marsh,
- Rachel Marsh,
- Ignacio Martínez-Zalacaín,
- David Mataix-Cols,
- José M. Menchón,
- José M. Menchón,
- José M. Menchón,
- Luciano Minuzzi,
- Astrid Morer,
- Astrid Morer,
- Astrid Morer,
- Takashi Nakamae,
- Tomohiro Nakao,
- Janardhanan C. Narayanaswamy,
- Seiji Nishida,
- Erika L. Nurmi,
- Joseph O'Neill,
- John Piacentini,
- Fabrizio Piras,
- Federica Piras,
- Y. C. Janardhan Reddy,
- Tim J. Reess,
- Tim J. Reess,
- Yuki Sakai,
- Yuki Sakai,
- Joao R. Sato,
- H. Blair Simpson,
- H. Blair Simpson,
- Noam Soreni,
- Carles Soriano-Mas,
- Carles Soriano-Mas,
- Carles Soriano-Mas,
- Gianfranco Spalletta,
- Gianfranco Spalletta,
- Michael C. Stevens,
- Michael C. Stevens,
- Philip R. Szeszko,
- Philip R. Szeszko,
- David F. Tolin,
- David F. Tolin,
- Guido A. van Wingen,
- Ganesan Venkatasubramanian,
- Susanne Walitza,
- Zhen Wang,
- Zhen Wang,
- Je-Yeon Yun,
- Je-Yeon Yun,
- ENIGMA-OCD Working-Group,
- Paul M. Thompson,
- Dan J. Stein,
- Odile A. van den Heuvel,
- Odile A. van den Heuvel,
- Jos W. R. Twisk
Affiliations
- Premika S. W. Boedhoe
- Department of Psychiatry, Amsterdam University Medical Centers (UMC), Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands
- Premika S. W. Boedhoe
- Department of Anatomy and Neurosciences, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands
- Martijn W. Heymans
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- Lianne Schmaal
- Orygen, The National Centre of Excellence in Youth Mental Health, Melbourne, VIC, Australia
- Lianne Schmaal
- Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
- Yoshinari Abe
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
- Pino Alonso
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain
- Pino Alonso
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain
- Pino Alonso
- Department of Clinical Sciences, University of Barcelona, Barcelona, Spain
- Stephanie H. Ameis
- 0Department of Psychiatry, Faculty of Medicine, The Centre for Addiction and Mental Health, The Margaret and Wallace McCain Centre for Child, Youth and Family Mental Health, Campbell Family Mental Health Research Institute, University of Toronto, Toronto, ON, Canada
- Stephanie H. Ameis
- 1The Hospital for Sick Children, Centre for Brain and Mental Health, Toronto, ON, Canada
- Alan Anticevic
- 2Department of Psychiatry, Yale University School of Medicine, New Haven, CT, United States
- Paul D. Arnold
- 3Mathison Centre for Mental Health Research and Education, Cumming School of Medicine, Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
- Paul D. Arnold
- 4Department of Psychiatry, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Marcelo C. Batistuzzo
- 5Departamento de Psiquiatria, Faculdade de Medicina, Instituto de Psiquiatria, Universidade de São Paulo, São Paulo, Brazil
- Francesco Benedetti
- 6Division of Neuroscience, Psychiatry and Clinical Psychobiology, Scientific Institute Ospedale San Raffaele, Milan, Italy
- Jan C. Beucke
- 7Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- Irene Bollettini
- 6Division of Neuroscience, Psychiatry and Clinical Psychobiology, Scientific Institute Ospedale San Raffaele, Milan, Italy
- Anushree Bose
- 8Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
- Silvia Brem
- 9Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric Hospital, University of Zurich, Zurich, Switzerland
- Anna Calvo
- 0Magnetic Resonance Image Core Facility, IDIBAPS (Institut d'Investigacions Biomèdiques August Pi i Sunyer), Barcelona, Spain
- Rosa Calvo
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain
- Rosa Calvo
- 1Department of Child and Adolescent Psychiatry and Psychology, Hospital Clínic Universitari, Institute of Neurosciences, Barcelona, Spain
- Yuqi Cheng
- 2Department of Psychiatry, First Affiliated Hospital of Kunming Medical University, Kunming, China
- Kang Ik K. Cho
- 3Institute of Human Behavioral Medicine, SNU-MRC, Seoul, South Korea
- Valentina Ciullo
- 4Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy
- Valentina Ciullo
- 5Neurosciences, Psychology, Drug Research and Child Health (NEUROFARBA), University of Florence, Florence, Italy
- Sara Dallaspezia
- 6Division of Neuroscience, Psychiatry and Clinical Psychobiology, Scientific Institute Ospedale San Raffaele, Milan, Italy
- Damiaan Denys
- 6Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
- Damiaan Denys
- 7Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts and Sciences, Amsterdam, Netherlands
- Jamie D. Feusner
- 8Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
- Kate D. Fitzgerald
- 9Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States
- Jean-Paul Fouche
- 0MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry, University of Cape Town, Cape Town, South Africa
- Egill A. Fridgeirsson
- 6Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
- Patricia Gruner
- 2Department of Psychiatry, Yale University School of Medicine, New Haven, CT, United States
- Gregory L. Hanna
- 9Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States
- Derrek P. Hibar
- 1Imaging Genetics Center, Keck School of Medicine of the University of Southern California, Mark and Mary Stevens Neuroimaging and Informatics Institute, Marina del Rey, CA, United States
- Marcelo Q. Hoexter
- 5Departamento de Psiquiatria, Faculdade de Medicina, Instituto de Psiquiatria, Universidade de São Paulo, São Paulo, Brazil
- Hao Hu
- 2Shanghai Mental Health Center Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Chaim Huyser
- 3De Bascule, Academic Center for Child and Adolescent Psychiatry, Amsterdam, Netherlands
- Chaim Huyser
- 4Department of Child and Adolescent Psychiatry, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
- Neda Jahanshad
- 5Yeongeon Student Support Center, Seoul National University College of Medicine, Seoul, South Korea
- Anthony James
- 6Department of Psychiatry, Oxford University, Oxford, United Kingdom
- Norbert Kathmann
- 7Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- Christian Kaufmann
- 7Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- Kathrin Koch
- 7Department of Neuroradiology, Klinikum rechts der Isar, Technische Universität München, Munich, Germany
- Kathrin Koch
- 8TUM-Neuroimaging Center (TUM-NIC) of Klinikum rechts der Isar, Technische Universität München, Munich, Germany
- Jun Soo Kwon
- 9Department of Psychiatry, Seoul National University College of Medicine, Seoul, South Korea
- Jun Soo Kwon
- 0Department of Brain and Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, South Korea
- Luisa Lazaro
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain
- Luisa Lazaro
- 1Department of Child and Adolescent Psychiatry and Psychology, Hospital Clínic Universitari, Institute of Neurosciences, Barcelona, Spain
- Luisa Lazaro
- 1Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Luisa Lazaro
- 2Department of Medicine, University of Barcelona, Barcelona, Spain
- Christine Lochner
- 3SU/UCT MRC Unit on Anxiety and Stress Disorders, Department of Psychiatry, University of Stellenbosch, Stellenbosch, South Africa
- Rachel Marsh
- 4Columbia University Medical College, Columbia University, New York, NY, United States
- Rachel Marsh
- 5The New York State Psychiatric Institute, New York, NY, United States
- Ignacio Martínez-Zalacaín
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain
- David Mataix-Cols
- 6Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet, Stockholm, Sweden
- José M. Menchón
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain
- José M. Menchón
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain
- José M. Menchón
- Department of Clinical Sciences, University of Barcelona, Barcelona, Spain
- Luciano Minuzzi
- 7Mood Disorders Clinic, St. Joseph's HealthCare, Hamilton, ON, Canada
- Astrid Morer
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain
- Astrid Morer
- 1Department of Child and Adolescent Psychiatry and Psychology, Hospital Clínic Universitari, Institute of Neurosciences, Barcelona, Spain
- Astrid Morer
- 1Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Takashi Nakamae
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
- Tomohiro Nakao
- 8Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
- Janardhanan C. Narayanaswamy
- 8Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
- Seiji Nishida
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
- Erika L. Nurmi
- 8Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
- Joseph O'Neill
- 8Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
- John Piacentini
- 8Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
- Fabrizio Piras
- 4Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy
- Federica Piras
- 4Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy
- Y. C. Janardhan Reddy
- 8Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
- Tim J. Reess
- 7Department of Neuroradiology, Klinikum rechts der Isar, Technische Universität München, Munich, Germany
- Tim J. Reess
- 8TUM-Neuroimaging Center (TUM-NIC) of Klinikum rechts der Isar, Technische Universität München, Munich, Germany
- Yuki Sakai
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
- Yuki Sakai
- 9ATR Brain Information Communication Research Laboratory Group, Kyoto, Japan
- Joao R. Sato
- 0Center for Mathematics, Computing and Cognition, Universidade Federal do ABC, Santo Andre, Brazil
- H. Blair Simpson
- 4Columbia University Medical College, Columbia University, New York, NY, United States
- H. Blair Simpson
- 1Center for OCD and Related Disorders, New York State Psychiatric Institute, New York, NY, United States
- Noam Soreni
- 2Anxiety Treatment and Research Center, St. Joseph's HealthCare, Hamilton, ON, Canada
- Carles Soriano-Mas
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain
- Carles Soriano-Mas
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain
- Carles Soriano-Mas
- 3Department of Psychobiology and Methodology of Health Sciences, Universitat Autònoma de Barcelona, Barcelona, Spain
- Gianfranco Spalletta
- 4Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy
- Gianfranco Spalletta
- 4Beth K. and Stuart C. Yudofsky Division of Neuropsychiatry, Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, United States
- Michael C. Stevens
- 5Yale University School of Medicine, New Haven, CT, United States
- Michael C. Stevens
- 6Clinical Neuroscience and Development Laboratory, Olin Neuropsychiatry Research Center, Hartford, CT, United States
- Philip R. Szeszko
- 7Icahn School of Medicine at Mount Sinai, New York, NY, United States
- Philip R. Szeszko
- 8James J. Peters VA Medical Center, Bronx, NY, United States
- David F. Tolin
- 5Yale University School of Medicine, New Haven, CT, United States
- David F. Tolin
- 9Institute of Living/Hartford Hospital, Hartford, CT, United States
- Guido A. van Wingen
- 6Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
- Ganesan Venkatasubramanian
- 8Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
- Susanne Walitza
- 9Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric Hospital, University of Zurich, Zurich, Switzerland
- Zhen Wang
- 2Shanghai Mental Health Center Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Zhen Wang
- 0Shanghai Key Laboratory of Psychotic Disorders, Shanghai, China
- Je-Yeon Yun
- 5Yeongeon Student Support Center, Seoul National University College of Medicine, Seoul, South Korea
- Je-Yeon Yun
- 9Department of Psychiatry, Seoul National University College of Medicine, Seoul, South Korea
- ENIGMA-OCD Working-Group
- Paul M. Thompson
- 1Imaging Genetics Center, Keck School of Medicine of the University of Southern California, Mark and Mary Stevens Neuroimaging and Informatics Institute, Marina del Rey, CA, United States
- Dan J. Stein
- 0MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry, University of Cape Town, Cape Town, South Africa
- Odile A. van den Heuvel
- Department of Psychiatry, Amsterdam University Medical Centers (UMC), Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands
- Odile A. van den Heuvel
- Department of Anatomy and Neurosciences, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands
- Jos W. R. Twisk
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- DOI
- https://doi.org/10.3389/fninf.2018.00102
- Journal volume & issue
-
Vol. 12
Abstract
Objective: Brain imaging communities focusing on different diseases have increasingly started to collaborate and to pool data to perform well-powered meta- and mega-analyses. Some methodologists claim that a one-stage individual-participant data (IPD) mega-analysis can be superior to a two-stage aggregated data meta-analysis, since more detailed computations can be performed in a mega-analysis. Before definitive conclusions regarding the performance of either method can be drawn, it is necessary to critically evaluate the methodology of, and results obtained by, meta- and mega-analyses.Methods: Here, we compare the inverse variance weighted random-effect meta-analysis model with a multiple linear regression mega-analysis model, as well as with a linear mixed-effects random-intercept mega-analysis model, using data from 38 cohorts including 3,665 participants of the ENIGMA-OCD consortium. We assessed the effect sizes and standard errors, and the fit of the models, to evaluate the performance of the different methods.Results: The mega-analytical models showed lower standard errors and narrower confidence intervals than the meta-analysis. Similar standard errors and confidence intervals were found for the linear regression and linear mixed-effects random-intercept models. Moreover, the linear mixed-effects random-intercept models showed better fit indices compared to linear regression mega-analytical models.Conclusions: Our findings indicate that results obtained by meta- and mega-analysis differ, in favor of the latter. In multi-center studies with a moderate amount of variation between cohorts, a linear mixed-effects random-intercept mega-analytical framework appears to be the better approach to investigate structural neuroimaging data.
Keywords
