Replicability in Brain Imaging

Lifetime depression and mania/hypomania risk predicted by neural markers in three independent young adult samples during working memory and emotional regulation

Objective markers of pathophysiological processes underlying lifetime depression and mania/hypomania risk can provide biologically informed targets for novel interventions to help prevent the onset of affective disorders in individuals with subsyndromal symptoms. Greater activity within and functional connectivity (FC) between the central executive network (CEN), supporting emotional regulation (ER) subcomponent processes such as working memory (WM), the default mode network (DMN), supporting self-related information processing, and the salience network (SN), is thought to interfere with cognitive functioning and predispose to depressive disorders. Using an emotional n-back paradigm designed to examine WM and ER capacity, we examined in young adults: (1) relationships among activity and FC in these networks and lifetime depression and mania/hypomania risk; (2) the extent to which these relationships were specific to lifetime depression risk versus lifetime mania/hypomania risk; (3) whether findings in a first, Discovery sample n = 101, 63 female, age = 23.85 (2.9) could be replicated in a two independent Test samples of young adults: Test sample 1: n = 90, 60 female, age = 21.7 (2.0); Test sample 2: n = 96, 65 female, age = 21.6 (2.1). The Mood Spectrum Self-Report (MOODS-SR-L) assessed lifetime mania/hypomania risk and depression risk. We showed significant clusters of activity to each contrast in similar locations in the anatomic mask in each Test sample as in the Discovery sample, and, using extracted mean BOLD signal from these clusters as IVs, we showed similar patterns of IV-DV relationships in each Test sample as in the Discovery sample. Specifically, in the Discovery sample, greater DMN activity during WM was associated with greater lifetime depression risk. This finding was specific to depression and replicated in both independent samples (all ps<0.05 qFDR). Greater CEN activity during ER was associated with increased lifetime depression risk and lifetime mania/hypomania risk in all three samples (all ps< 0.05 qFDR). These replicated findings provide promising objective, neural markers to better identify, and guide and monitor early interventions for, depression and mania/hypomania risk in young adults.

Leveraging the adolescent brain cognitive development study to improve behavioral prediction from neuroimaging in smaller replication samples

Neuroimaging is a popular method to map brain structural and functional patterns to complex human traits. Recently published observations cast doubt upon these prospects, particularly for prediction of cognitive traits from structural and resting state functional magnetic resonance imaging (MRI). We leverage baseline data from thousands of children in the Adolescent Brain Cognitive DevelopmentSM Study to inform the replication sample size required with univariate and multivariate methods across different imaging modalities to detect reproducible brain-behavior associations. We demonstrate that by applying multivariate methods to high-dimensional brain imaging data, we can capture lower dimensional patterns of structural and functional brain architecture that correlate robustly with cognitive phenotypes and are reproducible with only 41 individuals in the replication sample for working memory-related functional MRI, and ~ 100 subjects for structural and resting state MRI. Even with 100 random re-samplings of 100 subjects in discovery, prediction can be adequately powered with 66 subjects in replication for multivariate prediction of cognition with working memory task functional MRI. These results point to an important role for neuroimaging in translational neurodevelopmental research and showcase how findings in large samples can inform reproducible brain-behavior associations in small sample sizes that are at the heart of many research programs and grants.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

Leveraging the Adolescent Brain Cognitive Development Study to improve behavioral prediction from neuroimaging in smaller replication samples

Magnetic resonance imaging (MRI) is a popular and useful non-invasive method to map patterns of brain structure and function to complex human traits. Recently published observations in multiple large scale studies cast doubt upon these prospects, particularly for prediction of cognitive traits from structural and resting state functional MRI, which seems to account for little behavioral variability. We leverage baseline data from thousands of children in the Adolescent Brain Cognitive DevelopmentSM (ABCD®) Study to inform the replication sample size required with both univariate and multivariate methods across different imaging modalities to detect reproducible brain-behavior associations. We demonstrate that by applying multivariate methods to high-dimensional brain imaging data, we can capture lower dimensional patterns of structural and functional brain architecture that correlate robustly with cognitive phenotypes and are reproducible with only 41 individuals in the replication sample for working memory-related functional MRI, and ~100 subjects for structural MRI. Even with 100 random re-samplings of 50 subjects in the discovery sample, prediction can be adequately powered with 98 subjects in the replication sample for multivariate prediction of cognition with working memory task functional MRI. These results point to an important role for neuroimaging in translational neurodevelopmental research and showcase how findings in large samples can inform reproducible brain-behavior associations in small sample sizes that are at the heart of many investigators' research programs and grants.

Adaptive Design Optimization as a Promising Tool for Reliable and Efficient Computational Fingerprinting

A key challenge in understanding mental (dys)functions is their etiological and functional heterogeneity, and several multidimensional assessments have been proposed for their comprehensive characterization. However, such assessments require lengthy testing, which may hinder reliable and efficient characterization of individual differences due to increased fatigue and distraction, especially in clinical populations. Computational modeling may address this challenge as it often provides more reliable measures of latent neurocognitive processes underlying observed behaviors and captures individual differences better than traditional assessments. However, even with a state-of-the-art hierarchical modeling approach, reliable estimation of model parameters still requires a large number of trials. Recent work suggests that Bayesian adaptive design optimization (ADO) is a promising way to address these challenges. With ADO, experimental design is optimized adaptively from trial to trial to extract the maximum amount of information about an individual's characteristics. In this review, we first describe the ADO methodology and then summarize recent work demonstrating that ADO increases the reliability and efficiency of latent neurocognitive measures. We conclude by discussing the challenges and future directions of ADO and proposing development of ADO-based computational fingerprints to reliably and efficiently characterize the heterogeneous profiles of psychiatric disorders.