Reliable individual differences in fine-grained cortical functional architecture

Group-to-individual generalizability and individual-level inferences in cognitive neuroscience

Much of cognitive neuroscience research is focused on group-averages and interindividual brain-behavior associations. However, many theories core to the goal of cognitive neuroscience, such as hypothesized neural mechanisms for a behavior, are inherently based on intraindividual processes. To accommodate this mismatch between study design and theory, research frequently relies on an implicit assumption that group-level, between-person inferences extend to individual-level, within-person processes. The assumption of group-to-individual generalizability, formally referred to as ergodicity, requires that a process be both homogenous within a population and stationary within individuals over time. Our goal in this review is to assess this assumption and provide an accessible introduction to idiographic science (study of the individual) for the cognitive neuroscientist, ultimately laying a foundation for increased focus on the study of intraindividual processes. We first review the history of idiographic science in psychology to connect this longstanding literature with recent individual-level research goals in cognitive neuroscience. We then consider two requirements of group-to-individual generalizability, pattern homogeneity and stationarity, and suggest that most processes in cognitive neuroscience do not meet these assumptions. Consequently, interindividual findings are inappropriate for the intraindividual inferences that many theories are based on. To address this challenge, we suggest precision imaging as an ideal path forward for intraindividual study and present a research framework for complementary interindividual and intraindividual study.

Individual gaze shapes diverging neural representations

Complex visual stimuli evoke diverse patterns of gaze, but previous research suggests that their neural representations are shared across brains. Here, we used hyperalignment to compare visual responses between observers viewing identical stimuli. We find that individual eye movements enhance cortical visual responses but also lead to representational divergence. Pairwise differences in the spatial distribution of gaze and in semantic salience predict pairwise representational divergence in V1 and inferior temporal cortex, respectively. This suggests that individual gaze sculpts individual visual worlds.

Effects of connectivity hyperalignment (CHA) on estimated brain network properties: from coarse-scale to fine-scale

Recent gains in functional magnetic resonance imaging (fMRI) studies have been driven by increasingly sophisticated statistical and computational techniques and the ability to capture brain data at finer spatial and temporal resolution. These advances allow researchers to develop population-level models of the functional brain representations underlying behavior, performance, clinical status, and prognosis. However, even following conventional preprocessing pipelines, considerable inter-individual disparities in functional localization persist, posing a hurdle to performing compelling population-level inference. Persistent misalignment in functional topography after registration and spatial normalization will reduce power in developing predictive models and biomarkers, reduce the specificity of estimated brain responses and patterns, and provide misleading results on local neural representations and individual differences. This study aims to determine how connectivity hyperalignment (CHA)-an analytic approach for handling functional misalignment-can change estimated functional brain network topologies at various spatial scales from the coarsest set of parcels down to the vertex-level scale. The findings highlight the role of CHA in improving inter-subject similarities, while retaining individual-specific information and idiosyncrasies at finer spatial granularities. This highlights the potential for fine-grained connectivity analysis using this approach to reveal previously unexplored facets of brain structure and function.

Atypical neural encoding of faces in individuals with autism spectrum disorder

Individuals with autism spectrum disorder (ASD) experience pervasive difficulties in processing social information from faces. However, the behavioral and neural mechanisms underlying social trait judgments of faces in ASD remain largely unclear. Here, we comprehensively addressed this question by employing functional neuroimaging and parametrically generated faces that vary in facial trustworthiness and dominance. Behaviorally, participants with ASD exhibited reduced specificity but increased inter-rater variability in social trait judgments. Neurally, participants with ASD showed hypo-activation across broad face-processing areas. Multivariate analysis based on trial-by-trial face responses could discriminate participant groups in the majority of the face-processing areas. Encoding social traits in ASD engaged vastly different face-processing areas compared to controls, and encoding different social traits engaged different brain areas. Interestingly, the idiosyncratic brain areas encoding social traits in ASD were still flexible and context-dependent, similar to neurotypicals. Additionally, participants with ASD also showed an altered encoding of facial saliency features in the eyes and mouth. Together, our results provide a comprehensive understanding of the neural mechanisms underlying social trait judgments in ASD.

Dissociation of Reliability, Heritability, and Predictivity in Coarse- and Fine-Scale Functional Connectomes during Development

The functional connectome supports information transmission through the brain at various spatial scales, from exchange between broad cortical regions to finer-scale, vertex-wise connections that underlie specific information processing mechanisms. In adults, while both the coarse- and fine-scale functional connectomes predict cognition, the fine scale can predict up to twice the variance as the coarse-scale functional connectome. Yet, past brain-wide association studies, particularly using large developmental samples, focus on the coarse connectome to understand the neural underpinnings of individual differences in cognition. Using a large cohort of children (age 9-10 years; n = 1,115 individuals; both sexes; 50% female, including 170 monozygotic and 219 dizygotic twin pairs and 337 unrelated individuals), we examine the reliability, heritability, and behavioral relevance of resting-state functional connectivity computed at different spatial scales. We use connectivity hyperalignment to improve access to reliable fine-scale (vertex-wise) connectivity information and compare the fine-scale connectome with the traditional parcel-wise (coarse scale) functional connectomes. Though individual differences in the fine-scale connectome are more reliable than those in the coarse-scale, they are less heritable. Further, the alignment and scale of connectomes influence their ability to predict behavior, whereby some cognitive traits are equally well predicted by both connectome scales, but other, less heritable cognitive traits are better predicted by the fine-scale connectome. Together, our findings suggest there are dissociable individual differences in information processing represented at different scales of the functional connectome which, in turn, have distinct implications for heritability and cognition.

Reduced dimension stimulus decoding and column-based modeling reveal architectural differences of primary somatosensory finger maps between younger and older adults

The primary somatosensory cortex (SI) contains fine-grained tactile representations of the body, arranged in an orderly fashion. The use of ultra-high resolution fMRI data to detect group differences, for example between younger and older adults' SI maps, is challenging, because group alignment often does not preserve the high spatial detail of the data. Here, we use robust-shared response modeling (rSRM) that allows group analyses by mapping individual stimulus-driven responses to a lower dimensional shared feature space, to detect age-related differences in tactile representations between younger and older adults using 7T-fMRI data. Using this method, we show that finger representations are more precise in Brodmann-Area (BA) 3b and BA1 compared to BA2 and motor areas, and that this hierarchical processing is preserved across age groups. By combining rSRM with column-based decoding (C-SRM), we further show that the number of columns that optimally describes finger maps in SI is higher in younger compared to older adults in BA1, indicating a greater columnar size in older adults' SI. Taken together, we conclude that rSRM is suitable for finding fine-grained group differences in ultra-high resolution fMRI data, and we provide first evidence that the columnar architecture in SI changes with increasing age.

Cross-movie prediction of individualized functional topography

Participant-specific, functionally defined brain areas are usually mapped with functional localizers and estimated by making contrasts between responses to single categories of input. Naturalistic stimuli engage multiple brain systems in parallel, provide more ecologically plausible estimates of real-world statistics, and are friendly to special populations. The current study shows that cortical functional topographies in individual participants can be estimated with high fidelity from naturalistic stimuli. Importantly, we demonstrate that robust, individualized estimates can be obtained even when participants watched different movies, were scanned with different parameters/scanners, and were sampled from different institutes across the world. Our results create a foundation for future studies that allow researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate high-level cognitive functions across datasets from laboratories worldwide.

The individualized neural tuning model: Precise and generalizable cartography of functional architecture in individual brains

Quantifying how brain functional architecture differs from person to person is a key challenge in human neuroscience. Current individualized models of brain functional organization are based on brain regions and networks, limiting their use in studying fine-grained vertex-level differences. In this work, we present the individualized neural tuning (INT) model, a fine-grained individualized model of brain functional organization. The INT model is designed to have vertex-level granularity, to capture both representational and topographic differences, and to model stimulus-general neural tuning. Through a series of analyses, we demonstrate that (a) our INT model provides a reliable individualized measure of fine-grained brain functional organization, (b) it accurately predicts individualized brain response patterns to new stimuli, and (c) for many benchmarks, it requires only 10-20 minutes of data for good performance. The high reliability, specificity, precision, and generalizability of our INT model affords new opportunities for building brain-based biomarkers based on naturalistic neuroimaging paradigms.

Regression models for partially localized fMRI connectivity analyses

Background

Brain functional connectivity analysis of resting-state functional magnetic resonance imaging (fMRI) data is typically performed in a standardized template space assuming consistency of connections across subjects. Analysis methods can come in the form of one-edge-at-a-time analyses or dimension reduction/decomposition methods. Common to these approaches is an assumption that brain regions are functionally aligned across subjects; however, it is known that this functional alignment assumption is often violated.

Methods

In this paper, we use subject-level regression models to explain intra-subject variability in connectivity. Covariates can include factors such as geographic distance between two pairs of brain regions, whether the two regions are symmetrically opposite (homotopic), and whether the two regions are members of the same functional network. Additionally, a covariate for each brain region can be included, to account for the possibility that some regions have consistently higher or lower connectivity. This style of analysis allows us to characterize the fraction of variation explained by each type of covariate. Additionally, comparisons across subjects can then be made using the fitted connectivity regression models, offering a more parsimonious alternative to edge-at-a-time approaches.

Results

We apply our approach to Human Connectome Project data on 268 regions of interest (ROIs), grouped into eight functional networks. We find that a high proportion of variation is explained by region covariates and network membership covariates, while geographic distance and homotopy have high relative importance after adjusting for the number of predictors. We also find that the degree of data repeatability using our connectivity regression model-which uses only partial location information about pairs of ROI's-is comparably as high as the repeatability obtained using full location information.

Discussion

While our analysis uses data that have been transformed into a common template-space, we also envision the method being useful in multi-atlas registration settings, where subject data remains in its own geometry and templates are warped instead. These results suggest the tantalizing possibility that fMRI connectivity analysis can be performed in subject-space, using less aggressive registration, such as simple affine transformations, multi-atlas subject-space registration, or perhaps even no registration whatsoever.

Modeling naturalistic face processing in humans with deep convolutional neural networks

Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The ways in which the internal face representations in DCNNs relate to human cognitive representations and brain activity are not well understood. Nearly all previous studies focused on static face image processing with rapid display times and ignored the processing of naturalistic, dynamic information. To address this gap, we developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces). We used this naturalistic dataset to compare representational geometries estimated from DCNNs, behavioral responses, and brain responses. We found that DCNN representational geometries were consistent across architectures, cognitive representational geometries were consistent across raters in a behavioral arrangement task, and neural representational geometries in face areas were consistent across brains. Representational geometries in late, fully connected DCNN layers, which are optimized for individuation, were much more weakly correlated with cognitive and neural geometries than were geometries in late-intermediate layers. The late-intermediate face-DCNN layers successfully matched cognitive representational geometries, as measured with a behavioral arrangement task that primarily reflected categorical attributes, and correlated with neural representational geometries in known face-selective topographies. Our study suggests that current DCNNs successfully capture neural cognitive processes for categorical attributes of faces but less accurately capture individuation and dynamic features.

Substructure of the brain's Cingulo-Opercular network

The Cingulo-Opercular network (CON) is an executive network of the human brain that regulates actions. CON is composed of many widely distributed cortical regions that are involved in top-down control over both lower-level (i.e., motor) and higher-level (i.e., cognitive) functions, as well as in processing of painful stimuli. Given the topographical and functional heterogeneity of the CON, we investigated whether subnetworks within the CON support separable aspects of action control. Using precision functional mapping (PFM) in 15 participants with > 5 hours of resting state functional connectivity (RSFC) and task data, we identified three anatomically and functionally distinct CON subnetworks within each individual. These three distinct subnetworks were linked to Decisions, Actions, and Feedback (including pain processing), respectively, in convergence with a meta-analytic task database. These Decision, Action and Feedback subnetworks represent pathways by which the brain establishes top-down goals, transforms those goals into actions, implemented as movements, and processes critical action feedback such as pain.

Disruptions of salience network during uncertain anticipation of conflict control in anxiety

BACKGROUND

Anxiety has been characterized by disrupted processing of conflict control, while little is known about anticipatory processing of conflicts in anxiety. Anticipation is the key factor in both anxiety and cognitive control, especially under uncertain conditions. The current study therefore examined neurocomputational mechanisms of uncertain anticipation of conflict control in anxiety.

METHODS

Twenty-six participants with high-trait anxiety and twenty-nine low-trait anxiety participants completed a cue-flanker task with functional magnetic resonance imaging. The hierarchical drift diffusion model (HDDM) was used to measure the cognitive computations during the task. To identify the neurocomputational mechanism of anticipatory control in anxiety, mediation analysis and dynamic causal modelling (DCM) analysis were conducted to examine the relationship between functional connectivity of brain networks and the parameters of HDDM.

RESULTS

We found influences of regulatory signals from the dorsolateral prefrontal cortex to dorsal anterior cingulate cortex on decision threshold in low-trait anxiety (LTA), but not in high-trait anxiety (HTA), especially for the condition with uncertain cues. The results indicate deficient top-down anticipatory control of upcoming conflicts in anxious individuals. DCM and HDDM analyses revealed that lower decision threshold was associated with higher intrinsic connectivity of salience network (SN) in anxious individuals, suggesting that dysfunctional SN disrupts anticipation of conflict control under uncertainty in anxiety.

CONCLUSIONS

Our results suggest hyperfunction of the SN underlies the deficient information accumulation during uncertain anticipation of upcoming conflicts in anxiety. Our findings shed new light on the mechanisms of anticipation processing and the psychopathology of anxiety.

Regression models for partially localized fMRI connectivity analyses

Brain functional connectivity analysis of resting-state functional magnetic resonance imaging (fMRI) data is typically performed in a standardized template space assuming consistency of connections across subjects. This can come in the form of one-edge-at-a-time analyses or dimension reduction/decomposition methods. Common to these approaches is the assumption of complete localization (or spatial alignment) of brain regions across subjects. Alternative approaches completely eschew localization assumptions by treating connections as statistically exchangeable (for example, using the density of connectivity between nodes). Yet other approaches, such as hyperalignment, attempt to align subjects on function as well as structure, thereby achieving a different sort of template-based localization. In this paper, we propose the use of simple regression models to characterize connectivity. To that end, we build regression models on subject-level Fisher transformed regional connection matrices using geographic distance, homotopic distance, network labels, and region indicators as covariates to explain variation in connections. While we perform our analysis in template-space in this paper, we envision the method being useful in multi-atlas registration settings, where subject data remains in its own geometry and templates are warped instead. A byproduct of this style of analysis is the ability to characterize the fraction of variation in subject-level connections explained by each type of covariate. Using Human Connectome Project data, we found that network labels and regional characteristics contribute far more than geographic or homotopic relationships (considered non-parametrically). In addition, visual regions had the highest explanatory power (i.e., largest regression coefficients). We also considered subject repeatability and found that the degree of repeatability seen in fully localized models is largely recovered using our proposed subject-level regression models. Further, even fully exchangeable models retain a sizeable amount of repeatability information, despite discarding all localization information. These results suggest the tantalizing possibility that fMRI connectivity analysis can be performed in subject-space, using less aggressive registration, such as simple affine transformations, multi-atlas subject-space registration, or perhaps even no registration whatsoever.

Every individual makes a difference: A trinity derived from linking individual brain morphometry, connectivity and mentalising ability

Mentalising ability, indexed as the ability to understand others' beliefs, feelings, intentions, thoughts and traits, is a pivotal and fundamental component of human social cognition. However, considering the multifaceted nature of mentalising ability, little research has focused on characterising individual differences in different mentalising components. And even less research has been devoted to investigating how the variance in the structural and functional patterns of the amygdala and hippocampus, two vital subcortical regions of the "social brain", are related to inter-individual variability in mentalising ability. Here, as a first step toward filling these gaps, we exploited inter-subject representational similarity analysis (IS-RSA) to assess relationships between amygdala and hippocampal morphometry (surface-based multivariate morphometry statistics, MMS), connectivity (resting-state functional connectivity, rs-FC) and mentalising ability (interactive mentalisation questionnaire [IMQ] scores) across the participants ( N = 24 $$ N=24 $$ ). In IS-RSA, we proposed a novel pipeline, that is, computing patching and pooling operations-based surface distance (CPP-SD), to obtain a decent representation for high-dimensional MMS data. On this basis, we found significant correlations (i.e., second-order isomorphisms) between these three distinct modalities, indicating that a trinity existed in idiosyncratic patterns of brain morphometry, connectivity and mentalising ability. Notably, a region-related mentalising specificity emerged from these associations: self-self and self-other mentalisation are more related to the hippocampus, while other-self mentalisation shows a closer link with the amygdala. Furthermore, by utilising the dyadic regression analysis, we observed significant interactions such that subject pairs with similar morphometry had even greater mentalising similarity if they were also similar in rs-FC. Altogether, we demonstrated the feasibility and illustrated the promise of using IS-RSA to study individual differences, deepening our understanding of how individual brains give rise to their mentalising abilities.

A unifying model for discordant and concordant results in human neuroimaging studies of facial viewpoint selectivity

Our ability to recognize faces regardless of viewpoint is a key property of the primate visual system. Traditional theories hold that facial viewpoint is represented by view-selective mechanisms at early visual processing stages and that representations become increasingly tolerant to viewpoint changes in higher-level visual areas. Newer theories, based on single-neuron monkey electrophysiological recordings, suggest an additional intermediate processing stage invariant to mirror-symmetric face views. Consistent with traditional theories, human studies combining neuroimaging and multivariate pattern analysis (MVPA) methods have provided evidence of view-selectivity in early visual cortex. However, contradictory results have been reported in higher-level visual areas concerning the existence in humans of mirror-symmetrically tuned representations. We believe these results reflect low-level stimulus confounds and data analysis choices. To probe for low-level confounds, we analyzed images from two popular face databases. Analyses of mean image luminance and contrast revealed biases across face views described by even polynomials-i.e., mirror-symmetric. To explain major trends across human neuroimaging studies of viewpoint selectivity, we constructed a network model that incorporates three biological constraints: cortical magnification, convergent feedforward projections, and interhemispheric connections. Given the identified low-level biases, we show that a gradual increase of interhemispheric connections across network layers is sufficient to replicate findings of mirror-symmetry in high-level processing stages, as well as view-tuning in early processing stages. Data analysis decisions-pattern dissimilarity measure and data recentering-accounted for the variable observation of mirror-symmetry in late processing stages. The model provides a unifying explanation of MVPA studies of viewpoint selectivity. We also show how common analysis choices can lead to erroneous conclusions.

Real-time neurofeedback to alter interpretations of a naturalistic narrative

We explored the potential of using real-time fMRI (rt-fMRI) neurofeedback training to bias interpretations of naturalistic narrative stimuli. Participants were randomly assigned to one of two possible conditions, each corresponding to a different interpretation of an ambiguous spoken story. While participants listened to the story in the scanner, neurofeedback was used to reward neural activity corresponding to the assigned interpretation. After scanning, final interpretations were assessed. While neurofeedback did not change story interpretations on average, participants with higher levels of decoding accuracy during the neurofeedback procedure were more likely to adopt the assigned interpretation; additional control conditions are needed to establish the role of individualized feedback in driving this result. While naturalistic stimuli introduce a unique set of challenges in providing effective and individualized neurofeedback, we believe that this technique holds promise for individualized cognitive therapy.

Person-specific and precision neuroimaging: Current methods and future directions

Most neuroimaging studies of brain function analyze data in normalized space to identify regions of common activation across participants. These studies treat interindividual differences in brain organization as noise, but this approach can obscure important information about the brain's functional architecture. Recently, a number of studies have adopted a person-specific approach that aims to characterize these individual differences and explore their reliability and implications for behavior. A subset of these studies has taken a precision imaging approach that collects multiple hours of data from each participant to map brain function on a finer scale. In this review, we provide a broad overview of how person-specific and precision imaging techniques have used resting-state measures to examine individual differences in the brain's organization and their impact on behavior, followed by how task-based activity continues to add detail to these discoveries. We argue that person-specific and precision approaches demonstrate substantial promise in uncovering new details of the brain's functional organization and its relationship to behavior in many areas of cognitive neuroscience. We also discuss some current limitations in this new field and some new directions it may take.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

Individualized Functional Subnetworks Connect Human Striatum and Frontal Cortex

The striatum and cerebral cortex are interconnected via multiple recurrent loops that play a major role in many neuropsychiatric conditions. Primate corticostriatal connections can be precisely mapped using invasive tract-tracing. However, noninvasive human research has not mapped these connections with anatomical precision, limited in part by the practice of averaging neuroimaging data across individuals. Here we utilized highly sampled resting-state functional connectivity MRI for individual-specific precision functional mapping (PFM) of corticostriatal connections. We identified ten individual-specific subnetworks linking cortex-predominately frontal cortex-to striatum, most of which converged with nonhuman primate tract-tracing work. These included separable connections between nucleus accumbens core/shell and orbitofrontal/medial frontal gyrus; between anterior striatum and dorsomedial prefrontal cortex; between dorsal caudate and lateral prefrontal cortex; and between middle/posterior putamen and supplementary motor/primary motor cortex. Two subnetworks that did not converge with nonhuman primates were connected to cortical regions associated with human language function. Thus, precision subnetworks identify detailed, individual-specific, neurobiologically plausible corticostriatal connectivity that includes human-specific language networks.

The intra-session reliability of functional connectivity during naturalistic viewing conditions

Functional connectivity analysis is a common approach to the characterization of brain function. While studies of functional connectivity have predominantly focused on resting-state fMRI, naturalistic paradigms, such as movie watching, are increasingly being used. This ecologically valid, yet relatively unconstrained acquisition state has been shown to improve subject compliance and, potentially, enhance individual differences. However, unlike the reliability of resting-state functional connectivity, the reliability of functional connectivity during naturalistic viewing has not yet been fully established. The current study investigates the intra-session reliability of functional connectivity during naturalistic viewing sessions to extend its understanding. Using fMRI data of 24 subjects measured at rest as well as during six naturalistic viewing conditions, we quantified the split-half reliability of each condition, as well as cross-condition reliabilities. We find that intra-session reliability is relatively high for all conditions. While cross-condition reliabilities are higher for pairings of two naturalistic viewing conditions, split-half reliability is highest for the resting state. Potential sources of variability across the conditions, as well as the strengths and limitations of using intra-session reliability as a measure in naturalistic viewing, are discussed.

Limits of decoding mental states with fMRI

A growing number of studies claim to decode mental states using multi-voxel decoders of brain activity. It has been proposed that the fixed, fine-grained, multi-voxel patterns in these decoders are necessary for discriminating between and identifying mental states. Here, we present evidence that the efficacy of these decoders might be overstated. Across various tasks, decoder patterns were spatially imprecise, as decoder performance was unaffected by spatial smoothing; 90% redundant, as selecting a random 10% of a decoder's constituent voxels recovered full decoder performance; and performed similarly to brain activity maps used as decoders. We distinguish decoder performance in discriminating between mental states from performance in identifying a given mental state, and show that even when discrimination performance is adequate, identification can be poor. Finally, we demonstrate that simple and intuitive similarity metrics explain 91% and 62% of discrimination performance within- and across-subjects, respectively. These findings indicate that currently used across-subject decoders of mental states are superfluous and inappropriate for decision-making.

Network dynamics scale with levels of awareness

Small world topologies are thought to provide a valuable insight into human brain organisation and consciousness. However, functional magnetic resonance imaging studies in consciousness have not yielded consistent results. Given the importance of dynamics for both consciousness and cognition, here we investigate how the diversity of small world dynamics (quantified by sample entropy; dSW-E¹) scales with decreasing levels of awareness (i.e., sedation and disorders of consciousness). Paying particular attention to result reproducibility, we show that dSW-E is a consistent predictor of levels of awareness even when controlling for the underlying functional connectivity dynamics. We find that dSW-E of subcortical and cortical areas are predictive, with the former showing higher and more robust effect sizes across analyses. We find that the network dynamics of intermodular communication in the cerebellum also have unique predictive power for levels of awareness. Consequently, we propose that the dynamic reorganisation of the functional information architecture, in particular of the subcortex, is a characteristic that emerges with awareness and has explanatory power beyond that of the complexity of dynamic functional connectivity.

A connectivity-constrained computational account of topographic organization in primate high-level visual cortex

Inferotemporal (IT) cortex in humans and other primates is topographically organized, containing multiple hierarchically organized areas selective for particular domains, such as faces and scenes. This organization is commonly viewed in terms of evolved domain-specific visual mechanisms. Here, we develop an alternative, domain-general and developmental account of IT cortical organization. The account is instantiated in interactive topographic networks (ITNs), a class of computational models in which a hierarchy of model IT areas, subject to biologically plausible connectivity-based constraints, learns high-level visual representations optimized for multiple domains. We find that minimizing a wiring cost on spatially organized feedforward and lateral connections, alongside realistic constraints on the sign of neuronal connectivity within model IT, results in a hierarchical, topographic organization. This organization replicates a number of key properties of primate IT cortex, including the presence of domain-selective spatial clusters preferentially involved in the representation of faces, objects, and scenes; columnar responses across separate excitatory and inhibitory units; and generic spatial organization whereby the response correlation of pairs of units falls off with their distance. We thus argue that topographic domain selectivity is an emergent property of a visual system optimized to maximize behavioral performance under generic connectivity-based constraints.

The unreliable influence of multivariate noise normalization on the reliability of neural dissimilarity

Representational similarity analysis (RSA) is a key element in the multivariate pattern analysis toolkit. The central construct of the method is the representational dissimilarity matrix (RDM), which can be generated for datasets from different modalities (neuroimaging, behavior, and computational models) and directly correlated in order to evaluate their second-order similarity. Given the inherent noisiness of neuroimaging signals it is important to evaluate the reliability of neuroimaging RDMs in order to determine whether these comparisons are meaningful. Recently, multivariate noise normalization (NN_M) has been proposed as a widely applicable method for boosting signal estimates for RSA, regardless of choice of dissimilarity metrics, based on evidence that the analysis improves the within-subject reliability of RDMs (Guggenmos et al. 2018; Walther et al. 2016). We revisited this issue with three fMRI datasets and evaluated the impact of NN_M on within- and between-subject reliability and RSA effect sizes using multiple dissimilarity metrics. We also assessed its impact across regions of interest from the same dataset, its interaction with spatial smoothing, and compared it to GLMdenoise, which has also been proposed as a method that improves signal estimates for RSA (Charest et al. 2018). We found that across these tests the impact of NN_M was highly variable, as also seems to be the case for other analysis choices. Overall, we suggest being conservative before adding steps and complexities to the (pre)processing pipeline for RSA.

The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension

The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

Endogenous variation in ventromedial prefrontal cortex state dynamics during naturalistic viewing reflects affective experience

How we process ongoing experiences is shaped by our personal history, current needs, and future goals. Consequently, ventromedial prefrontal cortex (vmPFC) activity involved in processing these subjective appraisals appears to be highly idiosyncratic across individuals. To elucidate the role of the vmPFC in processing our ongoing experiences, we developed a computational framework and analysis pipeline to characterize the spatiotemporal dynamics of individual vmPFC responses as participants viewed a 45-minute television drama. Through a combination of functional magnetic resonance imaging, facial expression tracking, and self-reported emotional experiences across four studies, our data suggest that the vmPFC slowly transitions through a series of discretized states that broadly map onto affective experiences. Although these transitions typically occur at idiosyncratic times across people, participants exhibited a marked increase in state alignment during high affectively valenced events in the show. Our work suggests that the vmPFC ascribes affective meaning to our ongoing experiences.

Hybrid hyperalignment: A single high-dimensional model of shared information embedded in cortical patterns of response and functional connectivity

Shared information content is represented across brains in idiosyncratic functional topographies. Hyperalignment addresses these idiosyncrasies by using neural responses to project individuals’ brain data into a common model space while maintaining the geometric relationships between distinct patterns of activity or connectivity. The dimensions of this common model capture functional profiles that are shared across individuals such as cortical response profiles collected during a common time-locked stimulus presentation (e.g. movie viewing) or functional connectivity profiles. Hyperalignment can use either response-based or connectivity-based input data to derive transformations that project individuals’ neural data from anatomical space into the common model space. Previously, only response or connectivity profiles were used in the derivation of these transformations. In this study, we developed a new hyperalignment algorithm, hybrid hyperalignment, that derives transformations based on both response-based and connectivity-based information. We used three different movie-viewing fMRI datasets to test the performance of our new algorithm. Hybrid hyperalignment derives a single common model space that aligns response-based information as well as or better than response hyperalignment while simultaneously aligning connectivity-based information better than connectivity hyperalignment. These results suggest that a single common information space can encode both shared cortical response and functional connectivity profiles across individuals.

The neural basis of intelligence in fine-grained cortical topographies

Intelligent thought is the product of efficient neural information processing, which is embedded in fine-grained, topographically organized population responses and supported by fine-grained patterns of connectivity among cortical fields. Previous work on the neural basis of intelligence, however, has focused on coarse-grained features of brain anatomy and function because cortical topographies are highly idiosyncratic at a finer scale, obscuring individual differences in fine-grained connectivity patterns. We used a computational algorithm, hyperalignment, to resolve these topographic idiosyncrasies and found that predictions of general intelligence based on fine-grained (vertex-by-vertex) connectivity patterns were markedly stronger than predictions based on coarse-grained (region-by-region) patterns. Intelligence was best predicted by fine-grained connectivity in the default and frontoparietal cortical systems, both of which are associated with self-generated thought. Previous work overlooked fine-grained architecture because existing methods could not resolve idiosyncratic topographies, preventing investigation where the keys to the neural basis of intelligence are more likely to be found.

Neurophysiological Effects of Whole Coffee Cherry Extract in Older Adults with Subjective Cognitive Impairment: A Randomized, Double-Blind, Placebo-Controlled, Cross-Over Pilot Study

Bioactive plant-based compounds have shown promise as protective agents across multiple domains including improvements in neurological and psychological measures. Methodological challenges have limited our understanding of the neurophysiological changes associated with polyphenol-rich supplements such as whole coffee cherry extract (WCCE). In the current study, we (1) compared 100 mg of WCCE to a placebo using an acute, randomized, double-blind, within-subject, cross-over design, and we (2) conducted a phytochemical analysis of WCCE. The primary objective of the study was to determine the neurophysiological and behavioral changes that resulted from the acute administration of WCCE. We hypothesized that WCCE would increase brain-derived neurotrophic factor (BDNF) and glutamate levels while also increasing neurofunctional measures in cognitive brain regions. Furthermore, we expected there to be increased behavioral performance associated with WCCE, as measured by reaction time and accuracy. Participants underwent four neuroimaging scans (pre- and post-WCCE and placebo) to assess neurofunctional/metabolic outcomes using functional magnetic resonance imaging and magnetic resonance spectroscopy. The results suggest that polyphenol-rich WCCE is associated with decreased reaction time and may protect against cognitive errors on tasks of working memory and response inhibition. Behavioral findings were concomitant with neurofunctional changes in structures involved in decision-making and attention. Specifically, we found increased functional connectivity between the anterior cingulate and regions involved in sensory and decision-making networks. Additionally, we observed increased BDNF and an increased glutamate/gamma-aminobutyric acid (GABA) ratio following WCCE administration. These results suggest that WCCE is associated with acute neurophysiological changes supportive of faster reaction times and increased, sustained attention.

An fMRI dataset in response to "The Grand Budapest Hotel", a socially-rich, naturalistic movie

Naturalistic stimuli evoke strong, consistent, and information-rich patterns of brain activity, and engage large extents of the human brain. They allow researchers to compare highly similar brain responses across subjects, and to study how complex representations are encoded in brain activity. Here, we describe and share a dataset where 25 subjects watched part of the feature film "The Grand Budapest Hotel" by Wes Anderson. The movie has a large cast with many famous actors. Throughout the story, the camera shots highlight faces and expressions, which are fundamental to understand the complex narrative of the movie. This movie was chosen to sample brain activity specifically related to social interactions and face processing. This dataset provides researchers with fMRI data that can be used to explore social cognitive processes and face processing, adding to the existing neuroimaging datasets that sample brain activity with naturalistic movies.

Mapping neural activity patterns to contextualized fearful facial expressions onto callous-unemotional (CU) traits: intersubject representational similarity analysis reveals less variation among high-CU adolescents

Callous-unemotional (CU) traits are early-emerging personality features characterized by deficits in empathy, concern for others, and remorse following social transgressions. One of the interpersonal deficits most consistently associated with CU traits is impaired behavioral and neurophysiological responsiveness to fearful facial expressions. However, the facial expression paradigms traditionally employed in neuroimaging are often ambiguous with respect to the nature of threat (i.e., is the perceiver the threat, or is something else in the environment?). In the present study, 30 adolescents with varying CU traits viewed fearful facial expressions cued to three different contexts ("afraid for you," "afraid of you," "afraid for self") while undergoing functional magnetic resonance imaging (fMRI). Univariate analyses found that mean right amygdala activity during the "afraid for self" context was negatively associated with CU traits. With the goal of disentangling idiosyncratic stimulus-driven neural responses, we employed intersubject representational similarity analysis to link intersubject similarities in multivoxel neural response patterns to contextualized fearful expressions with differential intersubject models of CU traits. Among low-CU adolescents, neural response patterns while viewing fearful faces were most consistently similar early in the visual processing stream and among regions implicated in affective responding, but were more idiosyncratic as emotional face information moved up the cortical processing hierarchy. By contrast, high-CU adolescents' neural response patterns consistently aligned along the entire cortical hierarchy (but diverged among low-CU youths). Observed patterns varied across contexts, suggesting that interpretations of fearful expressions depend to an extent on neural response patterns and are further shaped by levels of CU traits.

Leveraging shared connectivity to aggregate heterogeneous datasets into a common response space

Connectivity hyperalignment can be used to estimate a single shared response space across disjoint datasets. We develop a connectivity-based shared response model that factorizes aggregated fMRI datasets into a single reduced-dimension shared connectivity space and subject-specific topographic transformations. These transformations resolve idiosyncratic functional topographies and can be used to project response time series into shared space. We evaluate this algorithm on a large collection of heterogeneous, naturalistic fMRI datasets acquired while subjects listened to spoken stories. Projecting subject data into shared space dramatically improves between-subject story time-segment classification and increases the dimensionality of shared information across subjects. This improvement generalizes to subjects and stories excluded when estimating the shared space. We demonstrate that estimating a simple semantic encoding model in shared space improves between-subject forward encoding and inverted encoding model performance. The shared space estimated across all datasets is distinct from the shared space derived from any particular constituent dataset; the algorithm leverages shared connectivity to yield a consensus shared space conjoining diverse story stimuli.

Default-mode network streams for coupling to language and control systems

The human brain is organized into large-scale networks identifiable using resting-state functional connectivity (RSFC). These functional networks correspond with broad cognitive domains; for example, the Default-mode network (DMN) is engaged during internally oriented cognition. However, functional networks may contain hierarchical substructures corresponding with more specific cognitive functions. Here, we used individual-specific precision RSFC to test whether network substructures could be identified in 10 healthy human brains. Across all subjects and networks, individualized network subdivisions were more valid-more internally homogeneous and better matching spatial patterns of task activation-than canonical networks. These measures of validity were maximized at a hierarchical scale that contained ∼83 subnetworks across the brain. At this scale, nine DMN subnetworks exhibited topographical similarity across subjects, suggesting that this approach identifies homologous neurobiological circuits across individuals. Some DMN subnetworks matched known features of brain organization corresponding with cognitive functions. Other subnetworks represented separate streams by which DMN couples with other canonical large-scale networks, including language and control networks. Together, this work provides a detailed organizational framework for studying the DMN in individual humans.

Idiosynchrony: From shared responses to individual differences during naturalistic neuroimaging

Two ongoing movements in human cognitive neuroscience have researchers shifting focus from group-level inferences to characterizing single subjects, and complementing tightly controlled tasks with rich, dynamic paradigms such as movies and stories. Yet relatively little work combines these two, perhaps because traditional analysis approaches for naturalistic imaging data are geared toward detecting shared responses rather than between-subject variability. Here, we review recent work using naturalistic stimuli to study individual differences, and advance a framework for detecting structure in idiosyncratic patterns of brain activity, or "idiosynchrony". Specifically, we outline the emerging technique of inter-subject representational similarity analysis (IS-RSA), including its theoretical motivation and an empirical demonstration of how it recovers brain-behavior relationships during movie watching using data from the Human Connectome Project. We also consider how stimulus choice may affect the individual signal and discuss areas for future research. We argue that naturalistic neuroimaging paradigms have the potential to reveal meaningful individual differences above and beyond those observed during traditional tasks or at rest.

Hyperalignment: Modeling shared information encoded in idiosyncratic cortical topographies

Information that is shared across brains is encoded in idiosyncratic fine-scale functional topographies. Hyperalignment captures shared information by projecting pattern vectors for neural responses and connectivities into a common, high-dimensional information space, rather than by aligning topographies in a canonical anatomical space. Individual transformation matrices project information from individual anatomical spaces into the common model information space, preserving the geometry of pairwise dissimilarities between pattern vectors, and model cortical topography as mixtures of overlapping, individual-specific topographic basis functions, rather than as contiguous functional areas. The fundamental property of brain function that is preserved across brains is information content, rather than the functional properties of local features that support that content. In this Perspective, we present the conceptual framework that motivates hyperalignment, its computational underpinnings for joint modeling of a common information space and idiosyncratic cortical topographies, and discuss implications for understanding the structure of cortical functional architecture.

Organization of Propagated Intrinsic Brain Activity in Individual Humans

Spontaneous infra-slow (<0.1 Hz) fluctuations in functional magnetic resonance imaging (fMRI) signals are temporally correlated within large-scale functional brain networks, motivating their use for mapping systems-level brain organization. However, recent electrophysiological and hemodynamic evidence suggest state-dependent propagation of infra-slow fluctuations, implying a functional role for ongoing infra-slow activity. Crucially, the study of infra-slow temporal lag structure has thus far been limited to large groups, as analyzing propagation delays requires extensive data averaging to overcome sampling variability. Here, we use resting-state fMRI data from 11 extensively-sampled individuals to characterize lag structure at the individual level. In addition to stable individual-specific features, we find spatiotemporal topographies in each subject similar to the group average. Notably, we find a set of early regions that are common to all individuals, are preferentially positioned proximal to multiple functional networks, and overlap with brain regions known to respond to diverse behavioral tasks-altogether consistent with a hypothesized ability to broadly influence cortical excitability. Our findings suggest that, like correlation structure, temporal lag structure is a fundamental organizational property of resting-state infra-slow activity.

Predicting individual face-selective topography using naturalistic stimuli

Subject-specific, functionally defined areas are conventionally estimated with functional localizers and a simple contrast analysis between responses to different stimulus categories. Compared with functional localizers, naturalistic stimuli provide several advantages such as stronger and widespread brain activation, greater engagement, and increased subject compliance. In this study we demonstrate that a subject's idiosyncratic functional topography can be estimated with high fidelity from that subject's fMRI data obtained while watching a naturalistic movie using hyperalignment to project other subjects' localizer data into that subject's idiosyncratic cortical anatomy. These findings lay the foundation for developing an efficient tool for mapping functional topographies for a wide range of perceptual and cognitive functions in new subjects based only on fMRI data collected while watching an engaging, naturalistic stimulus and other subjects' localizer data from a normative sample.

Measuring shared responses across subjects using intersubject correlation

Our capacity to jointly represent information about the world underpins our social experience. By leveraging one individual's brain activity to model another's, we can measure shared information across brains-even in dynamic, naturalistic scenarios where an explicit response model may be unobtainable. Introducing experimental manipulations allows us to measure, for example, shared responses between speakers and listeners or between perception and recall. In this tutorial, we develop the logic of intersubject correlation (ISC) analysis and discuss the family of neuroscientific questions that stem from this approach. We also extend this logic to spatially distributed response patterns and functional network estimation. We provide a thorough and accessible treatment of methodological considerations specific to ISC analysis and outline best practices.

Redefining the resolution of semantic knowledge in the brain: Advances made by the introduction of models of semantics in neuroimaging

The boundaries of our understanding of conceptual representation in the brain have been redrawn since the introduction of explicit models of semantics. These models are grounded in vast behavioural datasets acquired in healthy volunteers. Here, we review the most important techniques which have been applied to detect semantic information in neuroimaging data and argue why semantic models are possibly the most valuable addition to the research of semantics in recent years. Using multivariate analysis, predictions based on patient lesion data have been confirmed during semantic processing in healthy controls. Secondly, this new method has given rise to new research avenues, e.g. the detection of semantic processing outside of the temporal cortex. As a future line of work, the same research strategy could be useful to study neurological conditions such as the semantic variant of primary progressive aphasia, which is characterized by pathological semantic processing.

Movies in the magnet: Naturalistic paradigms in developmental functional neuroimaging

The use of movie-watching as an acquisition state for functional connectivity (FC) MRI has recently enabled multiple groups to obtain rich data sets in younger children with both substantial sample sizes and scan durations. Using naturalistic paradigms such as movies has also provided analytic flexibility for these developmental studies that extends beyond conventional resting state approaches. This review highlights the advantages and challenges of using movies for developmental neuroimaging and explores some of the methodological issues involved in designing pediatric studies with movies. Emerging themes from movie-watching studies are discussed, including an emphasis on intersubject correlations, developmental changes in network interactions under complex naturalistic conditions, and dynamic age-related changes in both sensory and higher-order network FC even in narrow age ranges. Converging evidence suggests an enhanced ability to identify brain-behavior correlations in children when using movie-watching data relative to both resting state and conventional tasks. Future directions and cautionary notes highlight the potential and the limitations of using movies to study FC in pediatric populations.