1
|
Kang K, Seidlitz J, Bethlehem RA, Xiong J, Jones MT, Mehta K, Keller AS, Tao R, Randolph A, Larsen B, Tervo-Clemmens B, Feczko E, Dominguez OM, Nelson S, Schildcrout J, Fair D, Satterthwaite TD, Alexander-Bloch A, Vandekar S. Study design features that improve effect sizes in cross-sectional and longitudinal brain-wide association studies. bioRxiv 2024:2023.05.29.542742. [PMID: 37398345 PMCID: PMC10312450 DOI: 10.1101/2023.05.29.542742] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Abstract
Brain-wide association studies (BWAS) are a fundamental tool in discovering brain-behavior associations. Several recent studies showed that thousands of study participants are required to improve the replicability of BWAS because actual effect sizes are much smaller than those reported in smaller studies. Here, we perform analyses and meta-analyses of a robust effect size index (RESI) using 63 longitudinal and cross-sectional magnetic resonance imaging studies from the Lifespan Brain Chart Consortium (77,695 total scans) to demonstrate that optimizing study design is critical for improving standardized effect sizes and replicability in BWAS. A meta-analysis of brain volume associations with age indicates that BWAS with larger covariate variance have larger effect size estimates and that the longitudinal studies we examined have systematically larger standardized effect sizes than cross-sectional studies. We propose a cross-sectional RESI to adjust for the systematic difference in effect sizes between cross-sectional and longitudinal studies that allows investigators to quantify the benefit of conducting their study longitudinally. Analyzing age effects on global and regional brain measures from the United Kingdom Biobank and the Alzheimer's Disease Neuroimaging Initiative, we show that modifying longitudinal study design through sampling schemes to increase between-subject variability and adding a single additional longitudinal measurement per subject can improve effect sizes. However, evaluating these longitudinal sampling schemes on cognitive, psychopathology, and demographic associations with structural and functional brain outcome measures in the Adolescent Brain and Cognitive Development dataset shows that commonly used longitudinal models can, counterintuitively, reduce effect sizes. We demonstrate that the benefit of conducting longitudinal studies depends on the strengths of the between- and within-subject associations of the brain and non-brain measures. Explicitly modeling between- and within-subject effects avoids conflating the effects and allows optimizing effect sizes for them separately. These findings underscore the importance of considering study design features to improve the replicability of BWAS.
Collapse
Affiliation(s)
- Kaidi Kang
- Department of Biostatistics, Vanderbilt University Medical Center
| | - Jakob Seidlitz
- Department of Child and Adolescent Psychiatry and Behavioral Sciences, The Children’s Hospital of Philadelphia
- Department of Psychiatry, University of Pennsylvania
- Lifespan Brain Institute of The Children’s Hospital of Philadelphia and Penn Medicine
| | | | - Jiangmei Xiong
- Department of Biostatistics, Vanderbilt University Medical Center
| | - Megan T. Jones
- Department of Biostatistics, Vanderbilt University Medical Center
| | - Kahini Mehta
- Department of Psychiatry, University of Pennsylvania
- Lifespan Brain Institute of The Children’s Hospital of Philadelphia and Penn Medicine
- Penn Lifespan Informatics and Neuroimaging Center (PennLINC), Perelman School of Medicine, University of Pennsylvania
| | - Arielle S. Keller
- Department of Psychiatry, University of Pennsylvania
- Lifespan Brain Institute of The Children’s Hospital of Philadelphia and Penn Medicine
- Penn Lifespan Informatics and Neuroimaging Center (PennLINC), Perelman School of Medicine, University of Pennsylvania
| | - Ran Tao
- Department of Biostatistics, Vanderbilt University Medical Center
| | - Anita Randolph
- Department of Pediatrics, University of Minnesota Medical School
| | - Bart Larsen
- Department of Pediatrics, University of Minnesota Medical School
| | - Brenden Tervo-Clemmens
- Department of Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School
| | - Eric Feczko
- Department of Pediatrics, University of Minnesota Medical School
| | | | - Steve Nelson
- Department of Pediatrics, University of Minnesota Medical School
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Damien Fair
- Department of Pediatrics, University of Minnesota Medical School
| | - Theodore D. Satterthwaite
- Department of Psychiatry, University of Pennsylvania
- Lifespan Brain Institute of The Children’s Hospital of Philadelphia and Penn Medicine
- Penn Lifespan Informatics and Neuroimaging Center (PennLINC), Perelman School of Medicine, University of Pennsylvania
| | - Aaron Alexander-Bloch
- Department of Child and Adolescent Psychiatry and Behavioral Sciences, The Children’s Hospital of Philadelphia
- Department of Psychiatry, University of Pennsylvania
- Lifespan Brain Institute of The Children’s Hospital of Philadelphia and Penn Medicine
| | - Simon Vandekar
- Department of Biostatistics, Vanderbilt University Medical Center
| |
Collapse
|
2
|
Ko H, Kim T, Ihm JJ, Kim HG. IC-P-120: CORTICAL THICKNESS PROFILING RELATED TO CEREBRAL BETA-AMYLOID BURDEN USING MACHINE LEARNING APPROACH. Alzheimers Dement 2019. [DOI: 10.1016/j.jalz.2019.06.4234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Affiliation(s)
- Hyunwoong Ko
- Seoul National University; Seoul Republic of South Korea
- Biomedical Knowledge Engineering Laboratory; Seoul National University; Seoul Republic of South Korea
| | - Taehyeong Kim
- Seoul National University; Seoul Republic of South Korea
| | - Jung-Joon Ihm
- Seoul National University; Seoul Republic of South Korea
| | - Hong-Gee Kim
- Seoul National University; Seoul Republic of South Korea
- Biomedical Knowledge Engineering Laboratory; Seoul National University; Seoul Republic of South Korea
| | | |
Collapse
|
3
|
Abstract
Truncated survival data arise when the event time is observed only if it falls within a subject-specific region, known as the truncation set. Left-truncated data arise when there is delayed entry into a study, such that subjects are included only if their event time exceeds some other time. Quasi-independence of truncation and failure refers to factorization of their joint density in the observable region. Under quasi-independence, standard methods for survival data such as the Kaplan-Meier estimator and Cox regression can be applied after simple adjustments to the risk sets. Unlike the requisite assumption of independent censoring, quasi-independence can be tested, e.g., using a conditional Kendall's tau test. Current methods for testing for quasi-independence are powerful for monotone alternatives. Nonetheless, it is essential to detect any kind of deviation from quasi-independence so as not to report a biased Kaplan-Meier estimator or regression effect, which would arise from applying the simple risk set adjustment when dependence holds. Nonparametric, minimum p-value tests that are powerful against non-monotone alternatives are developed to offer protection against erroneous assumptions of quasi-independence. The use of conditional and unconditional methods of permutation for evaluation of the proposed tests are investigated in simulation studies. The proposed tests are applied to a study on the cognitive and functional decline in aging.
Collapse
Affiliation(s)
- Sy Han Chiou
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA 02115, U.S.A
| | - Jing Qian
- Department of Biostatistics and Epidemiology, University of Massachusetts Amherst, Amherst, MA 01003, U.S.A
| | - Elizabeth Mormino
- Department of Neurology, School of Medicine, Stanford University, Stanford, CA 94305, U.S.A
| | - Rebecca A. Betensky
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA 02115, U.S.A
| | | | | | | |
Collapse
|
4
|
Johnson K. [S2–01–01]: IMAGING AMYLOID AND TAU PATHOLOGY: LESSONS LEARNED. Alzheimers Dement 2017. [DOI: 10.1016/j.jalz.2017.07.121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|