1
|
Boedhoe PSW, Heymans MW, Schmaal L, Abe Y, Alonso P, Ameis SH, Anticevic A, Arnold PD, Batistuzzo MC, Benedetti F, Beucke JC, Bollettini I, Bose A, Brem S, Calvo A, Calvo R, Cheng Y, Cho KIK, Ciullo V, Dallaspezia S, Denys D, Feusner JD, Fitzgerald KD, Fouche JP, Fridgeirsson EA, Gruner P, Hanna GL, Hibar DP, Hoexter MQ, Hu H, Huyser C, Jahanshad N, James A, Kathmann N, Kaufmann C, Koch K, Kwon JS, Lazaro L, Lochner C, Marsh R, Martínez-Zalacaín I, Mataix-Cols D, Menchón JM, Minuzzi L, Morer A, Nakamae T, Nakao T, Narayanaswamy JC, Nishida S, Nurmi EL, O'Neill J, Piacentini J, Piras F, Piras F, Reddy YCJ, Reess TJ, Sakai Y, Sato JR, Simpson HB, Soreni N, Soriano-Mas C, Spalletta G, Stevens MC, Szeszko PR, Tolin DF, van Wingen GA, Venkatasubramanian G, Walitza S, Wang Z, Yun JY, Thompson PM, Stein DJ, van den Heuvel OA, Twisk JWR. An Empirical Comparison of Meta- and Mega-Analysis With Data From the ENIGMA Obsessive-Compulsive Disorder Working Group. Front Neuroinform 2019; 12:102. [PMID: 30670959 PMCID: PMC6331928 DOI: 10.3389/fninf.2018.00102] [Citation(s) in RCA: 47] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Accepted: 12/13/2018] [Indexed: 01/08/2023] Open
Abstract
Objective: Brain imaging communities focusing on different diseases have increasingly started to collaborate and to pool data to perform well-powered meta- and mega-analyses. Some methodologists claim that a one-stage individual-participant data (IPD) mega-analysis can be superior to a two-stage aggregated data meta-analysis, since more detailed computations can be performed in a mega-analysis. Before definitive conclusions regarding the performance of either method can be drawn, it is necessary to critically evaluate the methodology of, and results obtained by, meta- and mega-analyses. Methods: Here, we compare the inverse variance weighted random-effect meta-analysis model with a multiple linear regression mega-analysis model, as well as with a linear mixed-effects random-intercept mega-analysis model, using data from 38 cohorts including 3,665 participants of the ENIGMA-OCD consortium. We assessed the effect sizes and standard errors, and the fit of the models, to evaluate the performance of the different methods. Results: The mega-analytical models showed lower standard errors and narrower confidence intervals than the meta-analysis. Similar standard errors and confidence intervals were found for the linear regression and linear mixed-effects random-intercept models. Moreover, the linear mixed-effects random-intercept models showed better fit indices compared to linear regression mega-analytical models. Conclusions: Our findings indicate that results obtained by meta- and mega-analysis differ, in favor of the latter. In multi-center studies with a moderate amount of variation between cohorts, a linear mixed-effects random-intercept mega-analytical framework appears to be the better approach to investigate structural neuroimaging data.
Collapse
Affiliation(s)
- Premika S W Boedhoe
- Department of Psychiatry, Amsterdam University Medical Centers (UMC), Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands.,Department of Anatomy and Neurosciences, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands
| | - Martijn W Heymans
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Lianne Schmaal
- Orygen, The National Centre of Excellence in Youth Mental Health, Melbourne, VIC, Australia.,Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
| | - Yoshinari Abe
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Pino Alonso
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain.,Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.,Department of Clinical Sciences, University of Barcelona, Barcelona, Spain
| | - Stephanie H Ameis
- Department of Psychiatry, Faculty of Medicine, The Centre for Addiction and Mental Health, The Margaret and Wallace McCain Centre for Child, Youth and Family Mental Health, Campbell Family Mental Health Research Institute, University of Toronto, Toronto, ON, Canada.,The Hospital for Sick Children, Centre for Brain and Mental Health, Toronto, ON, Canada
| | - Alan Anticevic
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, United States
| | - Paul D Arnold
- Mathison Centre for Mental Health Research and Education, Cumming School of Medicine, Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Department of Psychiatry, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Marcelo C Batistuzzo
- Departamento de Psiquiatria, Faculdade de Medicina, Instituto de Psiquiatria, Universidade de São Paulo, São Paulo, Brazil
| | - Francesco Benedetti
- Division of Neuroscience, Psychiatry and Clinical Psychobiology, Scientific Institute Ospedale San Raffaele, Milan, Italy
| | - Jan C Beucke
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Irene Bollettini
- Division of Neuroscience, Psychiatry and Clinical Psychobiology, Scientific Institute Ospedale San Raffaele, Milan, Italy
| | - Anushree Bose
- Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
| | - Silvia Brem
- Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric Hospital, University of Zurich, Zurich, Switzerland
| | - Anna Calvo
- Magnetic Resonance Image Core Facility, IDIBAPS (Institut d'Investigacions Biomèdiques August Pi i Sunyer), Barcelona, Spain
| | - Rosa Calvo
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.,Department of Child and Adolescent Psychiatry and Psychology, Hospital Clínic Universitari, Institute of Neurosciences, Barcelona, Spain
| | - Yuqi Cheng
- Department of Psychiatry, First Affiliated Hospital of Kunming Medical University, Kunming, China
| | - Kang Ik K Cho
- Institute of Human Behavioral Medicine, SNU-MRC, Seoul, South Korea
| | - Valentina Ciullo
- Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy.,Neurosciences, Psychology, Drug Research and Child Health (NEUROFARBA), University of Florence, Florence, Italy
| | - Sara Dallaspezia
- Division of Neuroscience, Psychiatry and Clinical Psychobiology, Scientific Institute Ospedale San Raffaele, Milan, Italy
| | - Damiaan Denys
- Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands.,Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts and Sciences, Amsterdam, Netherlands
| | - Jamie D Feusner
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
| | - Kate D Fitzgerald
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States
| | - Jean-Paul Fouche
- MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry, University of Cape Town, Cape Town, South Africa
| | - Egill A Fridgeirsson
- Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
| | - Patricia Gruner
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, United States
| | - Gregory L Hanna
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States
| | - Derrek P Hibar
- Imaging Genetics Center, Keck School of Medicine of the University of Southern California, Mark and Mary Stevens Neuroimaging and Informatics Institute, Marina del Rey, CA, United States
| | - Marcelo Q Hoexter
- Departamento de Psiquiatria, Faculdade de Medicina, Instituto de Psiquiatria, Universidade de São Paulo, São Paulo, Brazil
| | - Hao Hu
- Shanghai Mental Health Center Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Chaim Huyser
- De Bascule, Academic Center for Child and Adolescent Psychiatry, Amsterdam, Netherlands.,Department of Child and Adolescent Psychiatry, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
| | - Neda Jahanshad
- Yeongeon Student Support Center, Seoul National University College of Medicine, Seoul, South Korea
| | - Anthony James
- Department of Psychiatry, Oxford University, Oxford, United Kingdom
| | - Norbert Kathmann
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Christian Kaufmann
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Kathrin Koch
- Department of Neuroradiology, Klinikum rechts der Isar, Technische Universität München, Munich, Germany.,TUM-Neuroimaging Center (TUM-NIC) of Klinikum rechts der Isar, Technische Universität München, Munich, Germany
| | - Jun Soo Kwon
- Department of Psychiatry, Seoul National University College of Medicine, Seoul, South Korea.,Department of Brain and Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, South Korea
| | - Luisa Lazaro
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.,Department of Child and Adolescent Psychiatry and Psychology, Hospital Clínic Universitari, Institute of Neurosciences, Barcelona, Spain.,Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain.,Department of Medicine, University of Barcelona, Barcelona, Spain
| | - Christine Lochner
- SU/UCT MRC Unit on Anxiety and Stress Disorders, Department of Psychiatry, University of Stellenbosch, Stellenbosch, South Africa
| | - Rachel Marsh
- Columbia University Medical College, Columbia University, New York, NY, United States.,The New York State Psychiatric Institute, New York, NY, United States
| | - Ignacio Martínez-Zalacaín
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain
| | - David Mataix-Cols
- Department of Clinical Neuroscience, Centre for Psychiatry Research, Karolinska Institutet, Stockholm, Sweden
| | - José M Menchón
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain.,Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.,Department of Clinical Sciences, University of Barcelona, Barcelona, Spain
| | - Luciano Minuzzi
- Mood Disorders Clinic, St. Joseph's HealthCare, Hamilton, ON, Canada
| | - Astrid Morer
- Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.,Department of Child and Adolescent Psychiatry and Psychology, Hospital Clínic Universitari, Institute of Neurosciences, Barcelona, Spain.,Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Takashi Nakamae
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Tomohiro Nakao
- Department of Neuropsychiatry, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
| | - Janardhanan C Narayanaswamy
- Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
| | - Seiji Nishida
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Erika L Nurmi
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
| | - Joseph O'Neill
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
| | - John Piacentini
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, United States
| | - Fabrizio Piras
- Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Federica Piras
- Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Y C Janardhan Reddy
- Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
| | - Tim J Reess
- Department of Neuroradiology, Klinikum rechts der Isar, Technische Universität München, Munich, Germany.,TUM-Neuroimaging Center (TUM-NIC) of Klinikum rechts der Isar, Technische Universität München, Munich, Germany
| | - Yuki Sakai
- Department of Psychiatry, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan.,ATR Brain Information Communication Research Laboratory Group, Kyoto, Japan
| | - Joao R Sato
- Center for Mathematics, Computing and Cognition, Universidade Federal do ABC, Santo Andre, Brazil
| | - H Blair Simpson
- Columbia University Medical College, Columbia University, New York, NY, United States.,Center for OCD and Related Disorders, New York State Psychiatric Institute, New York, NY, United States
| | - Noam Soreni
- Anxiety Treatment and Research Center, St. Joseph's HealthCare, Hamilton, ON, Canada
| | - Carles Soriano-Mas
- Department of Psychiatry, Bellvitge University Hospital, Bellvitge Biomedical Research Institute-IDIBELL, L'Hospitalet de Llobregat, Barcelona, Spain.,Centro de Investigación Biomèdica en Red de Salud Mental (CIBERSAM), Barcelona, Spain.,Department of Psychobiology and Methodology of Health Sciences, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Gianfranco Spalletta
- Laboratory of Neuropsychiatry, Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, Rome, Italy.,Beth K. and Stuart C. Yudofsky Division of Neuropsychiatry, Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, United States
| | - Michael C Stevens
- Yale University School of Medicine, New Haven, CT, United States.,Clinical Neuroscience and Development Laboratory, Olin Neuropsychiatry Research Center, Hartford, CT, United States
| | - Philip R Szeszko
- Icahn School of Medicine at Mount Sinai, New York, NY, United States.,James J. Peters VA Medical Center, Bronx, NY, United States
| | - David F Tolin
- Yale University School of Medicine, New Haven, CT, United States.,Institute of Living/Hartford Hospital, Hartford, CT, United States
| | - Guido A van Wingen
- Department of Psychiatry, Amsterdam Neuroscience, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, Netherlands
| | - Ganesan Venkatasubramanian
- Obsessive-Compulsive Disorder (OCD) Clinic Department of Psychiatry National Institute of Mental Health and Neurosciences, Bangalore, India
| | - Susanne Walitza
- Department of Child and Adolescent Psychiatry and Psychotherapy, Psychiatric Hospital, University of Zurich, Zurich, Switzerland
| | - Zhen Wang
- Shanghai Mental Health Center Shanghai Jiao Tong University School of Medicine, Shanghai, China.,Shanghai Key Laboratory of Psychotic Disorders, Shanghai, China
| | - Je-Yeon Yun
- Yeongeon Student Support Center, Seoul National University College of Medicine, Seoul, South Korea.,Department of Psychiatry, Seoul National University College of Medicine, Seoul, South Korea
| | | | - Paul M Thompson
- Imaging Genetics Center, Keck School of Medicine of the University of Southern California, Mark and Mary Stevens Neuroimaging and Informatics Institute, Marina del Rey, CA, United States
| | - Dan J Stein
- MRC Unit on Risk & Resilience in Mental Disorders, Department of Psychiatry, University of Cape Town, Cape Town, South Africa
| | - Odile A van den Heuvel
- Department of Psychiatry, Amsterdam University Medical Centers (UMC), Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands.,Department of Anatomy and Neurosciences, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, Amsterdam, Netherlands
| | - Jos W R Twisk
- Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| |
Collapse
|