What Has Replication Ever Done for Us? Insights from Neuroimaging of Speech Perception

Behaviour-correlated profiles of cerebellar-cerebral functional connectivity observed in independent neurodevelopmental disorder cohorts

The cerebellum, through its connectivity with the cerebral cortex, plays an integral role in regulating cognitive and affective processes, and its dysregulation can result in neurodevelopmental disorder (NDD)-related behavioural deficits. Identifying cerebellar-cerebral functional connectivity (FC) profiles in children with NDDs can provide insight into common connectivity profiles and their correlation to NDD-related behaviours. 479 participants from the Province of Ontario Neurodevelopmental Disorders (POND) network (typically developing = 93, Autism Spectrum Disorder = 172, Attention Deficit/Hyperactivity Disorder = 161, Obsessive-Compulsive Disorder = 53, mean age = 12.2) underwent resting-state functional magnetic resonance imaging and behaviour testing (Social Communication Questionnaire, Toronto Obsessive-Compulsive Scale, and Child Behaviour Checklist - Attentional Problems Subscale). FC components maximally correlated to behaviour were identified using canonical correlation analysis. Results were then validated by repeating the investigation in 556 participants from an independent NDD cohort provided from a separate consortium (Healthy Brain Network (HBN)). Replication of canonical components was quantified by correlating the feature vectors between the two cohorts. The two cerebellar-cerebral FC components that replicated to the greatest extent were correlated to, respectively, obsessive-compulsive behaviour (behaviour feature vectors, rPOND-HBN = -0.97; FC feature vectors, rPOND-HBN = -0.68) and social communication deficit contrasted against attention deficit behaviour (behaviour feature vectors, rPOND-HBN = -0.99; FC feature vectors, rPOND-HBN = -0.78). The statistically stable (|z| > 1.96) features of the FC feature vectors, measured via bootstrap re-sampling, predominantly comprised of correlations between cerebellar attentional and control network regions and cerebral attentional, default mode, and control network regions. In both cohorts, spectral clustering on FC loading values resulted in subject clusters mixed across diagnostic categories, but no cluster was significantly enriched for any given diagnosis as measured via chi-squared test (p > 0.05). Overall, two behaviour-correlated components of cerebellar-cerebral functional connectivity were observed in two independent cohorts. This suggests the existence of generalizable cerebellar network differences that span across NDD diagnostic boundaries.

Computational Language Modeling and the Promise of In Silico Experimentation

Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.

Large, open datasets for human connectomics research: Considerations for reproducible and responsible data use

Large, open datasets have emerged as important resources in the field of human connectomics. In this review, the evolution of data sharing involving magnetic resonance imaging is described. A summary of the challenges and progress in conducting reproducible data analyses is provided, including description of recent progress made in the development of community guidelines and recommendations, software and data management tools, and initiatives to enhance training and education. Finally, this review concludes with a discussion of ethical conduct relevant to analyses of large, open datasets and a researcher's responsibility to prevent further stigmatization of historically marginalized racial and ethnic groups. Moving forward, future work should include an enhanced emphasis on the social determinants of health, which may further contextualize findings among diverse population-based samples. Leveraging the progress to date and guided by interdisciplinary collaborations, the future of connectomics promises to be an impressive era of innovative research, yielding a more inclusive understanding of brain structure and function.

A Willingness-to-Pay Associated Right Prefrontal Activation During a Single, Real Use of Lipsticks as Assessed Using Functional Near-Infrared Spectroscopy

Understanding consumer preferences and behavior is a major goal of consumer-oriented companies. The application of neuroscience to this goal is a promising avenue for companies. Previously, we observed a positive correlation during actual cosmetic use between the right dorsolateral prefrontal cortex (dlPFC) activity, measured by functional near-infrared spectroscopy (fNIRS), and the associated willingness-to-pay (WTP) values. However, we were unable to find any consistent group differences in the right dlPFC between different powdery foundations. Thus, the main objective of this study was to replicate the previous study and in addition, we aimed to refine the method of the previous study to increase the chance that a difference in valuation between different products can be detected. Twenty-five frequent lipstick using females were asked to apply six different lipsticks to their lips and to record how much they were willing to pay. To maximize the variation of the subjective experience of the products and the associated brain activity, the most preferred color lipstick and a less preferred color lipstick were chosen for each participant, and each color of lipstick had three different textures (Lo, Mid, and Hi). The time series was analyzed with the general linear model (GLM) and the correlation between the right dlPFC beta scores for the lipsticks and their respective WTP values conducted for each participant. This revealed a significant positive correlation and replicated our previous study. Surprisingly, the lipstick color and the texture manipulations did not result in any consistent differences in WTP and similarly no consistent group differences in brain activations. This study replicates our previous study extending it to a different type of cosmetic. The right dlPFC activity during the use of cosmetics may be a potential brain-based personalization or product selection process biomarker.

Patterns of Infant Amygdala Connectivity Mediate the Impact of High Caregiver Affect on Reducing Infant Smiling: Discovery and Replication

BACKGROUND

Behavioral research indicates that caregiver mood disorders and emotional instability in the early months following childbirth are associated with lower positive emotionality and higher negative emotionality in infants, but the neural mechanisms remain understudied.

METHODS

Using resting-state functional connectivity as a measure of the functional architecture of the early infant brain, we aimed to determine the extent to which connectivity between the amygdala, a key region supporting emotional learning and perception, and large-scale neural networks mediated the association between caregiver affect and anxiety and early infant negative emotionality and positive emotionality. Two samples of infants (first sample: n = 58; second sample: n = 31) 3 months of age underwent magnetic resonance imaging during natural sleep.

RESULTS

During infancy, greater resting-state functional connectivity between the amygdala and the salience network and, to a lesser extent, lower amygdala and executive control network resting-state functional connectivity mediated the effect of greater caregiver postpartum depression and trait anxiety on reducing infant smiling (familywise error-corrected p < .05). Furthermore, results from the first sample were replicated in the second, independent sample, to a greater extent for caregiver depression than for caregiver anxiety.

CONCLUSIONS

We provide evidence of early objective neural markers that can help identify infants who are more likely to be at risk from, versus those who might be protected against, the deleterious effects of caregiver depression and anxiety and reduced positive emotionality.

Replicable brain signatures of emotional bias and memory based on diffusion kurtosis imaging of white matter tracts

Diffusion MRI (dMRI) is sensitive to anisotropic diffusion within bundles of nerve axons and can be used to make objective measurements of brain networks. Many brain disorders are now recognised as being caused by network dysfunction or are secondarily associated with changes in networks. There is therefore great potential in using dMRI measures that reflect network integrity as a future clinical tool to help manage these conditions. Here, we used dMRI to identify replicable, robust and objective markers that meaningfully reflect cognitive and emotional performance. Using diffusion kurtosis analysis and a battery of cognitive and emotional tests, we demonstrated strong relationships between white matter structure across networks of anatomically and functionally specific brain regions with both emotional bias and emotional memory performance in a large healthy cohort. When the connectivity of these regions was examined using diffusion tractography, the terminations of the identified tracts overlapped precisely with cortical loci relating to these domains, drawn from an independent spatial meta‐analysis of available functional neuroimaging literature. The association with emotional bias was then replicated using an independently acquired healthy cohort drawn from the Human Connectome Project. These results demonstrate that, even in healthy individuals, white matter dMRI structural features underpin important cognitive and emotional functions. Our robust cross‐correlation and replication supports the potential of structural brain biomarkers from diffusion kurtosis MRI to characterise early neurological changes and risk in individuals with a reduced threshold for cognitive dysfunction, with further testing required to demonstrate clinical utility.

The superior longitudinal fasciculus and its functional triple-network mechanisms in brooding

Brooding, which refers to a repetitive focus on one's distress, is associated with functional connectivity within Default-Mode, Salience, and Executive-Control networks (DMN; SN; ECN), comprising the so-called "triple-network" of attention. Individual differences in brain structure that might perseverate dysfunctional connectivity of brain networks associated with brooding are less clear, however. Using diffusion and functional Magnetic Resonance Imaging, we explored multimodal relationships between brooding severity, white-matter microstructure, and resting-state functional connectivity in depressed adults (N = 32-44), and then examined whether findings directly replicated in a demographically-similar, independent sample (N = 36-45). Among the fully-replicated results, three core findings emerged. First, brooding severity is associated with functional integration and segregation of the triple-network, particularly with a Precuneal subnetwork of the DMN. Second, microstructural asymmetry of the Superior Longitudinal Fasciculus (SLF) provides a robust structural connectivity basis for brooding and may account for over 20% of its severity (Discovery: adj. R² = 0.18; Replication: adj. R² = 0.22; MSE = 0.06, Predictive R² = 0.22). Finally, microstructure of the right SLF and auxiliary white-matter is associated with the functional connectivity correlates of brooding, both within and between components of the triple-network (Discovery: adj. R² = 0.21; Replication: adj. R² = 0.18; MSE = 0.03, Predictive R² = 0.21-0.22). By cross-validating multimodal discovery with replication, the present findings help to reproducibly unify disparate perspectives of brooding etiology. Based on that synthesis, our study reformulates brooding as a microstructural-functional connectivity neurophenotype.

Structural Asymmetry in the Frontal and Temporal Lobes Is Associated with PCSK6 VNTR Polymorphism

The nodal cascade influences the development of bodily asymmetries in humans and other vertebrates. The gene PCSK6 has shown a regulatory function during left-right axis formation and is therefore thought to influence bodily left-right asymmetries. However, it is not clear if variation in this gene is also associated with structural asymmetries in the brain. We genotyped an intronic 33bp PCSK6 variable number tandem repeat (VNTR) polymorphism that has been associated with handedness in a cohort of healthy adults. We acquired T1-weighted structural MRI images of 320 participants and defined cortical surface and thickness for each HCP region. The results demonstrate a significant association between PCSK6 VNTR genotypes and gray matter asymmetry in the superior temporal sulcus, which is involved in voice perception. Heterozygous individuals who carry a short (≤ 6 repeats) and a long (≥ 9 repeats) PCSK6 VNTR allele show stronger rightward asymmetry. Further associations were evident in the dorsolateral prefrontal cortex. Here, individuals homozygous for short alleles show a more pronounced asymmetry. This shows that PCSK6, a gene that has been implicated in the ontogenesis of bodily asymmetries by regulating the nodal cascade, is also relevant for structural asymmetries in the human brain.

Hierarchy of speech-driven spectrotemporal receptive fields in human auditory cortex

Existing data indicate that cortical speech processing is hierarchically organized. Numerous studies have shown that early auditory areas encode fine acoustic details while later areas encode abstracted speech patterns. However, it remains unclear precisely what speech information is encoded across these hierarchical levels. Estimation of speech-driven spectrotemporal receptive fields (STRFs) provides a means to explore cortical speech processing in terms of acoustic or linguistic information associated with characteristic spectrotemporal patterns. Here, we estimate STRFs from cortical responses to continuous speech in fMRI. Using a novel approach based on filtering randomly-selected spectrotemporal modulations (STMs) from aurally-presented sentences, STRFs were estimated for a group of listeners and categorized using a data-driven clustering algorithm. 'Behavioral STRFs' highlighting STMs crucial for speech recognition were derived from intelligibility judgments. Clustering revealed that STRFs in the supratemporal plane represented a broad range of STMs, while STRFs in the lateral temporal lobe represented circumscribed STM patterns important to intelligibility. Detailed analysis recovered a bilateral organization with posterior-lateral regions preferentially processing STMs associated with phonological information and anterior-lateral regions preferentially processing STMs associated with word- and phrase-level information. Regions in lateral Heschl's gyrus preferentially processed STMs associated with vocalic information (pitch).

Small sample sizes reduce the replicability of task-based fMRI studies

Despite a growing body of research suggesting that task-based functional magnetic resonance imaging (fMRI) studies often suffer from a lack of statistical power due to too-small samples, the proliferation of such underpowered studies continues unabated. Using large independent samples across eleven tasks, we demonstrate the impact of sample size on replicability, assessed at different levels of analysis relevant to fMRI researchers. We find that the degree of replicability for typical sample sizes is modest and that sample sizes much larger than typical (e.g., N = 100) produce results that fall well short of perfectly replicable. Thus, our results join the existing line of work advocating for larger sample sizes. Moreover, because we test sample sizes over a fairly large range and use intuitive metrics of replicability, our hope is that our results are more understandable and convincing to researchers who may have found previous results advocating for larger samples inaccessible.

Do Neuroscience Journals Accept Replications? A Survey of Literature

Background: Recent reports in neuroscience, especially those concerning brain-injury and neuroimaging, have revealed low reproducibility of results within the field and urged for more replication studies. However, it is unclear if the neuroscience journals welcome or discourage the submission of reports on replication studies. Therefore, the current study assessed the explicit position of neuroscience journals on replications.

Methods: A list of active neuroscience journals publishing in English was compiled from Scopus database. These journal websites were accessed to read their aims and scope and instructions to authors, and to assess if they: (1) explicitly stated that they accept replications; (2) did not state their position on replications; (3) implicitly discouraged replications by emphasizing on the novelty of the manuscripts; or (4) explicitly stated that they reject replications. For journals that explicitly stated they accept or reject replications, their subcategory within neuroscience and their 5-year impact factor were recorded. The distribution of neuroscience replication studies published was also recorded by searching and extracting data from Scopus.

Results: Of the 465 journals reviewed, 28 (6.0%) explicitly stated that they accept replications, 394 (84.7%) did not state their position on replications, 40 (8.6%) implicitly discouraged replications by emphasizing on the novelty of the manuscripts, and 3 (0.6%) explicitly stated that they reject replications. For the 28 journals that explicitly welcomed replications, three (10.7%) stated their position in the aims and scope, whereas 25 (89.3%) stated in within the detailed instructions to authors. The five-year impact factor (2015) of these journals ranged from 1.655 to 10.799, and nine of them (32.1%) did not receive a 5-year or annual impact factor in 2015. There was no significant difference in the proportions of journals explicitly welcomed replications (journals with vs. without impact factors, or high vs. low impact factors). All sub-categories of neuroscience had at least a journal that welcomed replications.

Discussion: The neuroscience journals that welcomed replications and published replications were reported. These pieces of information may provide descriptive information on the current journal practices regarding replication so the evidence-based recommendations to journal publishers can be made.