Inter-subject Functional Correlation Reveal a Hierarchical Organization of Extrinsic and Intrinsic Systems in the Brain

Mapping brain function in adults and young children during naturalistic viewing with high-density diffuse optical tomography

Human studies of early brain development have been limited by extant neuroimaging methods. MRI scanners present logistical challenges for imaging young children, while alternative modalities like functional near-infrared spectroscopy have traditionally been limited by image quality due to sparse sampling. In addition, conventional tasks for brain mapping elicit low task engagement, high head motion, and considerable participant attrition in pediatric populations. As a result, typical and atypical developmental trajectories of processes such as language acquisition remain understudied during sensitive periods over the first years of life. We evaluate high-density diffuse optical tomography (HD-DOT) imaging combined with movie stimuli for high resolution optical neuroimaging in awake children ranging from 1 to 7 years of age. We built an HD-DOT system with design features geared towards enhancing both image quality and child comfort. Furthermore, we characterized a library of animated movie clips as a stimulus set for brain mapping and we optimized associated data analysis pipelines. Together, these tools could map cortical responses to movies and contained features such as speech in both adults and awake young children. This study lays the groundwork for future research to investigate response variability in larger pediatric samples and atypical trajectories of early brain development in clinical populations.

Characterizing the spatiotemporal features of functional connectivity across the white matter and gray matter during the naturalistic condition

Introduction

The naturalistic stimuli due to its ease of operability has attracted many researchers in recent years. However, the influence of the naturalistic stimuli for whole-brain functions compared with the resting state is still unclear.

Methods

In this study, we clustered gray matter (GM) and white matter (WM) masks both at the ROI- and network-levels. Functional connectivity (FC) and inter-subject functional connectivity (ISFC) were calculated in GM, WM, and between GM and WM under the movie-watching and the resting-state conditions. Furthermore, intra-class correlation coefficients (ICC) of FC and ISFC were estimated on different runs of fMRI data to denote the reliability of them during the two conditions. In addition, static and dynamic connectivity indices were calculated with Pearson correlation coefficient to demonstrate the associations between the movie-watching and the resting-state.

Results

As the results, we found that the movie-watching significantly affected FC in whole-brain compared with the resting-state, but ISFC did not show significant connectivity induced by the naturalistic condition. ICC of FC and ISFC was generally higher during movie-watching compared with the resting-state, demonstrating that naturalistic stimuli could promote the reliability of connectivity. The associations between static and dynamic ISFC were weakly negative correlations in the naturalistic stimuli while there is no correlation between them under resting-state condition.

Discussion

Our findings confirmed that compared to resting-state condition, the connectivity indices under the naturalistic stimuli were more reliable and stable to investigate the normal functional activities of the human brain, and might promote the applications of FC in the cerebral dysfunction in various mental disorders.

Mapping the time-varying functional brain networks in response to naturalistic movie stimuli

One of human brain's remarkable traits lies in its capacity to dynamically coordinate the activities of multiple brain regions or networks, adapting to an externally changing environment. Studying the dynamic functional brain networks (DFNs) and their role in perception, assessment, and action can significantly advance our comprehension of how the brain responds to patterns of sensory input. Movies provide a valuable tool for studying DFNs, as they offer a naturalistic paradigm that can evoke complex cognitive and emotional experiences through rich multimodal and dynamic stimuli. However, most previous research on DFNs have predominantly concentrated on the resting-state paradigm, investigating the topological structure of temporal dynamic brain networks generated via chosen templates. The dynamic spatial configurations of the functional networks elicited by naturalistic stimuli demand further exploration. In this study, we employed an unsupervised dictionary learning and sparse coding method combing with a sliding window strategy to map and quantify the dynamic spatial patterns of functional brain networks (FBNs) present in naturalistic functional magnetic resonance imaging (NfMRI) data, and further evaluated whether the temporal dynamics of distinct FBNs are aligned to the sensory, cognitive, and affective processes involved in the subjective perception of the movie. The results revealed that movie viewing can evoke complex FBNs, and these FBNs were time-varying with the movie storylines and were correlated with the movie annotations and the subjective ratings of viewing experience. The reliability of DFNs was also validated by assessing the Intra-class coefficient (ICC) among two scanning sessions under the same naturalistic paradigm with a three-month interval. Our findings offer novel insight into comprehending the dynamic properties of FBNs in response to naturalistic stimuli, which could potentially deepen our understanding of the neural mechanisms underlying the brain's dynamic changes during the processing of visual and auditory stimuli.

Direct machine learning reconstruction of respiratory variation waveforms from resting state fMRI data in a pediatric population

In many functional magnetic resonance imaging (fMRI) studies, respiratory signals are unavailable or do not have acceptable quality due to issues with subject compliance, equipment failure or signal error. In large databases, such as the Human Connectome Projects, over half of the respiratory recordings may be unusable. As a result, the direct removal of low frequency respiratory variations from the blood oxygen level-dependent (BOLD) signal time series is not possible. This study proposes a deep learning-based method for reconstruction of respiratory variation (RV) waveforms directly from BOLD fMRI data in pediatric participants (aged 5 to 21 years old), and does not require any respiratory measurement device. To do this, the Lifespan Human Connectome Project in Development (HCP-D) dataset, which includes respiratory measurements, was used to both train a convolutional neural network (CNN) and evaluate its performance. Results show that a CNN can capture informative features from the BOLD signal time course and reconstruct accurate RV timeseries, especially when the subject has a prominent respiratory event. This work advances the use of direct estimation of physiological parameters from fMRI, which will eventually lead to reduced complexity and decrease the burden on participants because they may not be required to wear a respiratory bellows.

Ongoing first-hand pain facilitates somatosensory resonance but inhibits affective sharing in empathy for pain

Alterations of empathy for others' pain among patients with chronic pain remained inconsistent. Here, applying a capsaicin-based ongoing pain model on healthy participants, this study investigated how ongoing first-hand pain influences empathic reactions to vicarious pain stimuli. Healthy participants were randomly treated with topical capsaicin cream (capsaicin group) or hand cream (control group) on the left forearm. Video clips showing limbs in painful and non-painful situations were used to induce empathic responses. The capsaicin group showed greater empathic neural responses in the right primary somatosensory cortex (S1) than the control group but smaller responses in the left anterior insula (AI) accompanied with smaller empathic pain-intensity ratings. Notably, the intensity of ongoing pain negatively correlated with empathy-related neural responses in the left AI. Inter-subject phase synchronization analysis was used to assess stimulus-dependent dynamic functional connectivity within or between brain regions engaged in pain empathy. The capsaicin group showed greater empathy-related neural synchronization within S1 and between S1 and AI, but less synchronization within AI and between AI and MCC. Behaviorally, the differential inter-subject pain-intensity rating alignment between painful and non-painful videos was more positive for the capsaicin group than for the control group, and this effect was partially mediated by the inter-subject neural synchronization between S1 and AI. These results suggest that ongoing first-hand pain facilitates neural activation and synchronization within brain regions associated with empathy-related somatosensory resonance at the cost of inhibiting activation and synchronization within brain regions engaged in empathy-related affective sharing.

Hierarchical Individual Naturalistic Functional Brain Networks with Group Consistency uncovered by a Two-Stage NAS-Volumetric Sparse DBN Framework

The functional magnetic resonance imaging under naturalistic paradigm (NfMRI) showed great advantages in identifying complex and interactive functional brain networks due to its dynamics and multimodal information. In recent years, various deep learning models, such as deep convolutional autoencoder (DCAE), deep belief network (DBN) and volumetric sparse deep belief network (vsDBN), can obtain hierarchical functional brain networks (FBN) and temporal features from fMRI data. Among them, the vsDBN model revealed a good capability in identifying hierarchical FBNs by modelling fMRI volume images. However, due to the high dimensionality of fMRI volumes and the diverse training parameters of deep learning methods, especially the network architecture that is the most critical parameter for uncovering the hierarchical organization of human brain function, researchers still face challenges in designing an appropriate deep learning framework with automatic network architecture optimization to model volumetric NfMRI. In addition, most of the existing deep learning models ignore the group-wise consistency and inter-subject variation properties embedded in NfMRI volumes. To solve these problems, we proposed a two-stage neural architecture search and vs DBN model (two-stage NAS-vsDBN model) to identify the hierarchical human brain spatio-temporal features possessing both group-consistency and individual-uniqueness under naturalistic condition. Moreover, our model defined reliable network structure for modelling volumetric NfMRI data via NAS framework, and the group-level and individual-level FBNs and associated temporal features exhibited great consistency. In general, our method well identified the hierarchical temporal and spatial features of the brain function and revealed the crucial properties of neural processes under natural viewing condition.Significance StatementIn this paper, we proposed and applied a novel analytical strategy - a two-stage NAS-vsDBN model to identify both group-level and individual-level spatio-temporal features at multi-scales from volumetric NfMRI data. The proposed PSO-based NAS framework can find optimal neural structure for both group-wise and individual-level vs-DBN models. Furthermore, with well-established correspondence between two stages of vsDBN models, our model can effectively detect group-level FBNs that reveal the consistency in neural processes across subjects and individual-level FBNs that maintain the subject specific variability, verifying the inherent property of brain function under naturalistic condition.

Hierarchical Spatio-Temporal Modeling of Naturalistic Functional Magnetic Resonance Imaging Signals via Two-Stage Deep Belief Network With Neural Architecture Search

Naturalistic functional magnetic resonance imaging (NfMRI) has become an effective tool to study brain functional activities in real-life context, which reduces the anxiety or boredom due to difficult or repetitive tasks and avoids the problem of unreliable collection of brain activity caused by the subjects’ microsleeps during resting state. Recent studies have made efforts on characterizing the brain’s hierarchical organizations from fMRI data by various deep learning models. However, most of those models have ignored the properties of group-wise consistency and inter-subject difference in brain function under naturalistic paradigm. Another critical issue is how to determine the optimal neural architecture of deep learning models, as manual design of neural architecture is time-consuming and less reliable. To tackle these problems, we proposed a two-stage deep belief network (DBN) with neural architecture search (NAS) combined framework (two-stage NAS-DBN) to model both the group-consistent and individual-specific naturalistic functional brain networks (FBNs), which reflected the hierarchical organization of brain function and the nature of brain functional activities under naturalistic paradigm. Moreover, the test-retest reliability and spatial overlap rate of the FBNs identified by our model reveal better performance than that of widely used traditional methods. In general, our model provides a promising method for characterizing hierarchical spatiotemporal features under the natural paradigm.

Semantic verbal fluency brain network: delineating a physiological basis for the functional hubs using dual-echo ASL and graph theory approach

Objective. Semantic verbal fluency (SFV) is a cognitive process that engages and modulates specific brain areas related to language comprehension and production, decision making, response inhibition, and memory retrieval. The impairment of the brain network responsible for these functions is related to various neurological conditions, and different strategies have been proposed to assess SVF-related deficits in such diseases. In the present study, the concomitant changes of brain perfusion and functional connectivity were investigated during the resting state and SVF task performance.Approach. Arterial spin labeling (ASL), a perfusion-based magnetic resonance imaging (MRI) method, was used with a pseudocontinuous labeling approach and dual-echo readout in 28 healthy right-handed Brazilian Portuguese speakers. The acquisition was performed in a resting state condition and during the performance of a SVF task.Main results. During task performance, a significant increase in cerebral blood flow (CBF) was observed in language-related regions of the frontal lobe, including Brodmann's areas 6, 9, 45, and 47, associated with semantic processing, word retrieval, and speech motor programming. Such regions, along with the posterior cingulate, showed a crucial role in the SVF functional network, assessed by seed-to-voxel and graph analysis. Our approach successfully overcame the generalization problem regarding functional MRI (fMRI) graph analysis with cognitive, task-based paradigms. Moreover, the CBF maps enabled the functional assessment of orbital frontal and temporal regions commonly affected by magnetic susceptibility artifacts in conventional T2*-weighted fMRI approaches.Significance. Our results demonstrated the capability of ASL to evaluate perfusion alterations and functional patterns simultaneously regarding the SVF network providing a quantitative physiological basis to functional hubs in this network, which may support future clinical studies.

Brain dynamics and connectivity networks under natural auditory stimulation

The analysis of functional magnetic resonance imaging (fMRI) data is challenging when subjects are under exposure to natural sensory stimulation. In this study, a two-stage approach was developed to enable the identification of connectivity networks involved in the processing of information in the brain under natural sensory stimulation. In the first stage, the degree of concordance between the results of inter-subject and intra-subject correlation analyses is assessed statistically. The microstructurally (i.e., cytoarchitectonically) defined brain areas are designated either as concordant in which the results of both correlation analyses are in agreement, or as discordant in which one analysis method shows a higher proportion of supra-threshold voxels than does the other. In the second stage, connectivity networks are identified using the time courses of supra-threshold voxels in brain areas contingent upon the classifications derived in the first stage. In an empirical study, fMRI data were collected from 40 young adults (19 males, average age 22.76 ± 3.25), who underwent auditory stimulation involving sound clips of human voices and animal vocalizations under two operational conditions (i.e., eyes-closed and eyes-open). The operational conditions were designed to assess confounding effects due to auditory instructions or visual perception. The proposed two-stage analysis demonstrated that stress modulation (affective) and language networks in the limbic and cortical structures were respectively engaged during sound stimulation, and presented considerable variability among subjects. The network involved in regulating visuomotor control was sensitive to the eyes-open instruction, and presented only small variations among subjects. A high degree of concordance was observed between the two analyses in the primary auditory cortex which was highly sensitive to the pitch of sound clips. Our results have indicated that brain areas can be identified as concordant or discordant based on the two correlation analyses. This may further facilitate the search for connectivity networks involved in the processing of information under natural sensory stimulation.

A connectivity-based parcellation improved functional representation of the human cerebellum

The cerebellum is traditionally well known for its role in motor learning and coordination. Recently, it is recognized that the function of the cerebellum is highly diverse and extends to non-motor domains, such as working memory, emotion and language. The diversity of the cerebellum can be appreciated by examining its extensive connectivity to the cerebral regions selective for both motor and cognitive functions. Importantly, the pattern of cerebro-cerebellar connectivity is specific and distinct to different cerebellar subregions. Therefore, to understand the cerebellum and the various functions it involves, it is essential to identify and differentiate its subdivisions. However, most studies are still referring the cerebellum as one brain structure or by its gross anatomical subdivisions, which does not necessarily reflect the functional mapping of the cerebellum. We here employed a data-driven method to generate a functional connectivity-based parcellation of the cerebellum. Our results demonstrated that functional connectivity-based atlas is superior to existing atlases in regards to cluster homogeneity, accuracy of functional connectivity representation and individual identification. Furthermore, our functional atlas improves statistical results of task fMRI analyses, as compared to the standard voxel-based approach and existing atlases. Our detailed functional parcellation provides a valuable tool for elucidating the functional diversity and connectivity of the cerebellum as well as its network relationships with the whole brain.

Large-scale intrinsic connectivity is consistent across varying task demands

Measuring whole-brain functional connectivity patterns based on task-free (‘resting-state’) spontaneous fluctuations in the functional MRI (fMRI) signal is a standard approach to probing habitual brain states, independent of task-specific context. This view is supported by spatial correspondence between task- and rest-derived connectivity networks. Yet, it remains unclear whether intrinsic connectivity observed in a resting-state acquisition is persistent during task. Here, we sought to determine how changes in ongoing brain activation, elicited by task performance, impact the integrity of whole-brain functional connectivity patterns (commonly termed ‘resting state networks’). We employed a ‘steady-states’ paradigm, in which participants continuously executed a specific task (without baseline periods). Participants underwent separate task-based (visual, motor and visuomotor) or task-free (resting) steady-state scans, each performed over a 5-minute period. This unique design allowed us to apply a set of traditional resting-state analyses to various task-states. In addition, a classical fMRI block-design was employed to identify individualized brain activation patterns for each task, allowing us to characterize how differing activation patterns across the steady-states impact whole-brain intrinsic connectivity patterns. By examining correlations across segregated brain regions (nodes) and the whole brain (using independent component analysis) using standard resting-state functional connectivity (FC) analysis, we show that the whole-brain network architecture characteristic of the resting-state is comparable across different steady-task states, despite striking inter-task changes in brain activation (signal amplitude). Changes in functional connectivity were detected locally, within the active networks. But to identify these local changes, the contributions of different FC networks to the global intrinsic connectivity pattern had to be isolated. Together, we show that intrinsic connectivity underlying the canonical resting-state networks is relatively stable even when participants are engaged in different tasks and is not limited to the resting-state.

Movies in the magnet: Naturalistic paradigms in developmental functional neuroimaging

The use of movie-watching as an acquisition state for functional connectivity (FC) MRI has recently enabled multiple groups to obtain rich data sets in younger children with both substantial sample sizes and scan durations. Using naturalistic paradigms such as movies has also provided analytic flexibility for these developmental studies that extends beyond conventional resting state approaches. This review highlights the advantages and challenges of using movies for developmental neuroimaging and explores some of the methodological issues involved in designing pediatric studies with movies. Emerging themes from movie-watching studies are discussed, including an emphasis on intersubject correlations, developmental changes in network interactions under complex naturalistic conditions, and dynamic age-related changes in both sensory and higher-order network FC even in narrow age ranges. Converging evidence suggests an enhanced ability to identify brain-behavior correlations in children when using movie-watching data relative to both resting state and conventional tasks. Future directions and cautionary notes highlight the potential and the limitations of using movies to study FC in pediatric populations.

Trait paranoia shapes inter-subject synchrony in brain activity during an ambiguous social narrative

Individuals often interpret the same event in different ways. How do personality traits modulate brain activity evoked by a complex stimulus? Here we report results from a naturalistic paradigm designed to draw out both neural and behavioral variation along a specific dimension of interest, namely paranoia. Participants listen to a narrative during functional MRI describing an ambiguous social scenario, written such that some individuals would find it highly suspicious, while others less so. Using inter-subject correlation analysis, we identify several brain areas that are differentially synchronized during listening between participants with high and low trait-level paranoia, including theory-of-mind regions. Follow-up analyses indicate that these regions are more active to mentalizing events in high-paranoia individuals. Analyzing participants’ speech as they freely recall the narrative reveals semantic and syntactic features that also scale with paranoia. Results indicate that a personality trait can act as an intrinsic “prime,” yielding different neural and behavioral responses to the same stimulus across individuals.

Reactions to the same event can vary vastly based on multiple factors. Here the authors show that people with high trait-level paranoia process ambiguous information in a narrative differently and this can be attributed to greater activity in mentalizing brain regions during the moments of ambiguity.

Sparse coding reveals greater functional connectivity in female brains during naturalistic emotional experience

Functional neuroimaging is widely used to examine changes in brain function associated with age, gender or neuropsychiatric conditions. FMRI (functional magnetic resonance imaging) studies employ either laboratory-designed tasks that engage the brain with abstracted and repeated stimuli, or resting state paradigms with little behavioral constraint. Recently, novel neuroimaging paradigms using naturalistic stimuli are gaining increasing attraction, as they offer an ecologically-valid condition to approximate brain function in real life. Wider application of naturalistic paradigms in exploring individual differences in brain function, however, awaits further advances in statistical methods for modeling dynamic and complex dataset. Here, we developed a novel data-driven strategy that employs group sparse representation to assess gender differences in brain responses during naturalistic emotional experience. Comparing to independent component analysis (ICA), sparse coding algorithm considers the intrinsic sparsity of neural coding and thus could be more suitable in modeling dynamic whole-brain fMRI signals. An online dictionary learning and sparse coding algorithm was applied to the aggregated fMRI signals from both groups, which was subsequently factorized into a common time series signal dictionary matrix and the associated weight coefficient matrix. Our results demonstrate that group sparse representation can effectively identify gender differences in functional brain network during natural viewing, with improved sensitivity and reliability over ICA-based method. Group sparse representation hence offers a superior data-driven strategy for examining brain function during naturalistic conditions, with great potential for clinical application in neuropsychiatric disorders.