Computational approaches to fMRI analysis

A data integration method for new advances in development cognitive neuroscience

Combining existing datasets to investigate key questions in developmental cognitive neuroscience brings exciting opportunities and unique challenges. However, many data pooling methods require identical or harmonized methodologies that are often not feasible. We propose Integrative Data Analysis (IDA) as a promising framework to advance developmental cognitive neuroscience with secondary data analysis. IDA serves to test hypotheses by combining data of the same construct from commensurate (but not identical) measures. To overcome idiosyncrasies of neuroimaging data, IDA explicitly evaluates if measures across studies assess the same construct. Moreover, IDA allows investigators to examine meaningful individual variability by de-confounding source-specific differences. To demonstrate IDA's potential, we explain foundational concepts, outline necessary steps, and apply IDA to volumetric measures of hippocampal subfields from 443 4- to 17-year-olds across three independent studies. We identified commensurate measures of Cornu Ammonis (CA) 1, dentate gyrus (DG)/CA3, and Subiculum (Sub). Model testing supported use of IDA to create IDA factor scores. We found age-related differences in DG/CA3, not but CA1 and Sub volume in the integrated dataset. By successfully demonstrating IDA, our hope is that future innovations come from the combination of existing neuroimaging data to create representative integrated samples when testing critical developmental questions.

A double-blind trial of decoded neurofeedback intervention for specific phobias

AIM

A new closed-loop functional magnetic resonance imaging method called multivoxel neuroreinforcement has the potential to alleviate the subjective aversiveness of exposure-based interventions by directly inducing phobic representations in the brain, outside of conscious awareness. The current study seeks to test this method as an intervention for specific phobia.

METHODS

In a randomized, double-blind, controlled single-university trial, individuals diagnosed with at least two (one target, one control) animal subtype-specific phobias were randomly assigned (1:1:1) to receive one, three, or five sessions of multivoxel neuroreinforcement in which they were rewarded for implicit activation of a target animal representation. Amygdala response to phobic stimuli was assessed by study staff blind to target and control animal assignments. Pretreatment to posttreatment differences were analyzed with a two-way repeated-measures anova.

RESULTS

A total of 23 participants (69.6% female) were randomized to receive one (n = 8), three (n = 7), or five (n = 7) sessions of multivoxel neuroreinforcement. Eighteen (n = 6 each group) participants were analyzed for our primary outcome. After neuroreinforcement, we observed an interaction indicating a significant decrease in amygdala response for the target phobia but not the control phobia. No adverse events or dropouts were reported as a result of the intervention.

CONCLUSION

Results suggest that multivoxel neuroreinforcement can specifically reduce threat signatures in specific phobia. Consequently, this intervention may complement conventional psychotherapy approaches with a nondistressing experience for patients seeking treatment. This trial sets the stage for a larger randomized clinical trial to replicate these results and examine the effects on real-life exposure.

CLINICAL TRIAL REGISTRATION

The now-closed trial was prospectively registered at ClinicalTrials.gov with ID NCT03655262.

Predicting tremor improvement after MRgFUS thalamotomy in essential tremor from preoperative spontaneous brain activity: A machine learning approach

Magnetic resonance-guided focused ultrasound surgery (MRgFUS) thalamotomy is an emerging technique for medication-refractory essential tremor (ET), but with variable outcomes. This study used pattern regression analysis to identify brain signatures predictive of tremor improvements. Fifty-four ET patients (mean age = 63.06 years, standard deviation (SD) = 10.55 years, 38 males) underwent unilateral MRgFUS thalamotomy and were scanned for resting-state functional magnetic resonance imaging (rs-fMRI). Seventy-four healthy controls (mean age = 58.09 years, SD = 10.30 years, 38 males) were recruited for comparison. Tremor responses at 12 months posttreatment were evaluated by the Clinical Rating Scale for Tremor. The fractional amplitude of low-frequency fluctuations (fALFF) was calculated from rs-fMRI data. Two-sample t-test was used to generate a disease-specific mask, within which Multivariate Kernel Ridge Regression analyses were conducted. Predicted and actual clinical scores were compared using Pearson's correlation coefficient (r) and normalized mean squared error (Norm. MSE). Permutation test and leave-one-out strategy were applied for results validation. KRR identified fALFF patterns that significantly predicted the hand tremor improvement (r = 0.23, P = 0.025; Norm. MSE = 0.05, P = 0.026) and the postural tremor improvement (r = 0.28, P = 0.025; Norm. MSE = 0.06, P = 0.023), but not action tremor improvement. Lobule VI of right cerebellum (Cerebelum_6_R), right superior occipital gyrus (Occipital_Sup_R) and lobule X of vermis (Vermis_10) contributed most for hand tremor prediction (normalized weights (NW): 2.77%, 2.40%, 2.34%) while Vermis_10, left supplementary motor area (Supp_Motor_Area_L) and right hippocampus (Hippocampus_R) for postural tremor prediction (NW: 2.69%, 2.12%, 2.05%). The low contributing NW of the individual brain regions suggested that the fALFF pattern as a whole is an overall predicting feature. Preoperative fALFF pattern predicts tremor benefits induced by MRgFUS thalamotomy. ClinicalTrials.gov number: NCT04570046.

The association between social rewards and anxiety: Links from neurophysiological analysis in virtual reality and social interaction game

Individuals' affective experience can be intricate, influenced by various factors including monetary rewards and social factors during social interaction. However, within this array of factors, divergent evidence has been considered as potential contributors to social anxiety. To gain a better understanding of the specific factors associated with anxiety during social interaction, we combined a social interaction task with neurophysiological recordings obtained through an anxiety-elicitation task conducted in a Virtual Reality (VR) environment. Employing inter-subject representational similarity analysis (ISRSA), we explored the potential linkage between individuals' anxiety neural patterns and their affective experiences during social interaction. Our findings suggest that, after controlling for other factors, the influence of the partner's emotional cues on individuals' affective experiences is specifically linked to their neural pattern of anxiety. This indicates that the emergence of anxiety during social interaction may be particularly associated with the emotional cues provided by the social partner, rather than individuals' own reward or prediction errors during social interaction. These results provide further support for the cognitive theory of social anxiety and extend the application of VR in future cognitive and affective studies.

Sex differences in distributed error-related neural activation in problem-drinking young adults

BACKGROUND

Detecting and responding to errors is central to goal-directed behavior and cognitive control and is thought to be supported by a network of structures that includes the anterior cingulate cortex and anterior insula. Sex differences in the maturational timing of cognitive control systems create differential periods of vulnerability for psychiatric conditions, such as substance use disorders.

METHODS

We examined sex differences in error-related activation across an array of distributed brain regions during a Go/No-Go task in young adults with problem alcohol use (N=69; 34 females; M=19.4 years). Regions of interest previously linked to error-related activation, including anterior cingulate cortex, insula, and frontoparietal structures, were selected in a term-based meta-analysis. Individual differences in their responses to false alarm (FA) inhibitory errors relative to "go" trials (FA>GO) and correct rejections (FA>CR) were indexed using multivariate summary measures derived from principal components analysis.

RESULTS

FA>GO and FA>CR activation both revealed a first component that explained the majority of the variance across error-associated regions and displayed the strongest loadings on salience network structures. Compared to females, males exhibited significantly higher levels of the FA>GO component but not the FA>CR component.

CONCLUSIONS

Males exhibit greater salience network activation in response to inhibitory errors, which could be attributed to sex differences in error-monitoring processes or to other functions (e.g., novelty detection). The findings are relevant for the further characterization of sex differences in cognitive control and may have implications for understanding individual differences in those at risk for substance use or other cognitive control disorders.

A double-blind trial of decoded neurofeedback intervention for specific phobias

Aim

A new closed-loop fMRI method called multi-voxel neuro-reinforcement has the potential to alleviate the subjective aversiveness of exposure-based interventions by directly inducing phobic representations in the brain, outside of conscious awareness. The current study seeks to test this method as an intervention for specific phobia.

Methods

In a randomized, double-blind, controlled single-university trial, individuals diagnosed with at least two (1 target, 1 control) animal subtype specific phobias were randomly assigned (1:1:1) to receive 1, 3, or 5 sessions of multi-voxel neuro-reinforcement in which they were rewarded for implicit activation of a target animal representation. Amygdala response to phobic stimuli was assessed by study staff blind to target and control animal assignments. Pre-treatment to post-treatment differences were analyzed with a 2-way repeated-measures ANOVA.

Results

A total of 23 participants (69.6% female) were randomized to receive 1 (n=8), 3 (n=7), or 5 (n=7) sessions of multi-voxel neuro-reinforcement. Eighteen (n=6 each group) participants were analyzed for our primary outcome. After neuro-reinforcement, we observed an interaction indicating a significant decrease in amygdala response for the target phobia but not the control phobia. No adverse events or dropouts were reported as a result of the intervention.

Conclusion

Results suggest multi-voxel neuro-reinforcement can specifically reduce threat signatures in specific phobia. Consequently, this intervention may complement conventional psychotherapy approaches with a non-distressing experience for patients seeking treatment. This trial sets the stage for a larger randomized clinical trial to replicate these results and examine the effects on real-life exposure.

Clinical Trial Registration

The now-closed trial was prospectively registered at ClinicalTrials.gov with ID NCT03655262.

Infant neuroscience: how to measure brain activity in the youngest minds

The functional properties of the infant brain are poorly understood. Recent advances in cognitive neuroscience are opening new avenues for measuring brain activity in human infants. These include novel uses of existing technologies such as electroencephalography (EEG) and magnetoencephalography (MEG), the availability of newer technologies including functional near-infrared spectroscopy (fNIRS) and optically pumped magnetometry (OPM), and innovative applications of functional magnetic resonance imaging (fMRI) in awake infants during cognitive tasks. In this review article we catalog these available non-invasive methods, discuss the challenges and opportunities encountered when applying them to human infants, and highlight the potential they may ultimately hold for advancing our understanding of the youngest minds.

Task sub-type states decoding via group deep bidirectional recurrent neural network

Decoding brain states under different cognitive tasks from functional magnetic resonance imaging (fMRI) data has attracted great attention in the neuroimaging filed. However, the well-known temporal dependency in fMRI sequences has not been fully exploited in existing studies, due to the limited temporal-modeling capacity of the backbone machine learning algorithms and rigid training sample organization strategies upon which the brain decoding methods are built. To address these limitations, we propose a novel method for fine-grain brain state decoding, namely, group deep bidirectional recurrent neural network (Group-DBRNN) model. We first propose a training sample organization strategy that consists of a group-task sample generation module and a multiple-scale random fragment strategy (MRFS) module to collect training samples that contain rich task-relevant brain activity contrast (i.e., the comparison of neural activity patterns between different tasks) and maintain the temporal dependency. We then develop a novel decoding model by replacing the unidirectional RNNs that are widely used in existing brain state decoding studies with bidirectional stacked RNNs to better capture the temporal dependency, and by introducing a multi-task interaction layer (MTIL) module to effectively model the task-relevant brain activity contrast. Our experimental results on the Human Connectome Project task fMRI dataset (7 tasks consisting of 23 task sub-type states) show that the proposed model achieves an average decoding accuracy of 94.7% over the 23 fine-grain sub-type states. Meanwhile, our extensive interpretations of the intermediate features learned in the proposed model via visualizations and quantitative assessments of their discriminability and inter-subject alignment evidence that the proposed model can effectively capture the temporal dependency and task-relevant contrast.

Microglia dysfunction drives disrupted hippocampal amplitude of low frequency after acute kidney injury

AIMS

Acute kidney injury (AKI) has been associated with a variety of neurological problems, while the neurobiological mechanism remains unclear. In the present study, we utilized resting-state functional magnetic resonance imaging (rs-fMRI) to detect brain injury at an early stage and investigated the impact of microglia on the neuropathological mechanism of AKI.

METHODS

Rs-fMRI data were collected from AKI rats and the control group with a 9.4-Tesla scanner at 24, 48, and 72 h post administration of contrast medium or saline. The amplitude of low-frequency fluctuations (ALFF) was then compared across the groups at each time course. Additionally, flow cytometry and SMART-seq2 were employed to evaluate microglia. Furthermore, pathological staining and Western blot were used to analyze the samples.

RESULTS

MRI results revealed that AKI led to a decreased ALFF in the hippocampus, particularly in the 48 h and 72 h groups. Additionally, western blot suggested that AKI-induced the neuronal apoptosis at 48 h and 72 h. Flow cytometry and confocal microscopy images demonstrated that AKI activated the aggregation of microglia into neurons at 24 h, with a strong upregulation of M1 polarization at 48 h and peaking at 72 h, accompanying with the release of proinflammatory cytokines. The ALFF value was strongly correlated with the proportion of microglia (|r| > 0.80, p < 0.001).

CONCLUSIONS

Our study demonstrated that microglia aggregation and inflammatory factor upregulation are significant mechanisms of AKI-induced neuronal apoptosis. We used fMRI to detect the alterations in hippocampal function, which may provide a noninvasive method for the early detection of brain injury after AKI.

A novel technique for delineating the effect of variation in the learning rate on the neural correlates of reward prediction errors in model-based fMRI

Introduction

Computational models play an increasingly important role in describing variation in neural activation in human neuroimaging experiments, including evaluating individual differences in the context of psychiatric neuroimaging. In particular, reinforcement learning (RL) techniques have been widely adopted to examine neural responses to reward prediction errors and stimulus or action values, and how these might vary as a function of clinical status. However, there is a lack of consensus around the importance of the precision of free parameter estimation for these methods, particularly with regard to the learning rate. In the present study, I introduce a novel technique which may be used within a general linear model (GLM) to model the effect of mis-estimation of the learning rate on reward prediction error (RPE)-related neural responses.

Methods

Simulations employed a simple RL algorithm, which was used to generate hypothetical neural activations that would be expected to be observed in functional magnetic resonance imaging (fMRI) studies of RL. Similar RL models were incorporated within a GLM-based analysis method including derivatives, with individual differences in the resulting GLM-derived beta parameters being evaluated with respect to the free parameters of the RL model or being submitted to other validation analyses.

Results

Initial simulations demonstrated that the conventional approach to fitting RL models to RPE responses is more likely to reflect individual differences in a reinforcement efficacy construct (lambda) rather than learning rate (alpha). The proposed method, adding a derivative regressor to the GLM, provides a second regressor which reflects the learning rate. Validation analyses were performed including examining another comparable method which yielded highly similar results, and a demonstration of sensitivity of the method in presence of fMRI-like noise.

Conclusion

Overall, the findings underscore the importance of the lambda parameter for interpreting individual differences in RPE-coupled neural activity, and validate a novel neural metric of the modulation of such activity by individual differences in the learning rate. The method is expected to find application in understanding aberrant reinforcement learning across different psychiatric patient groups including major depression and substance use disorder.

Where in the brain do internally generated and externally presented visual information interact?

Conscious experiences normally result from the flow of external input into our sensory systems. However, we can also create conscious percepts independently of sensory stimulation. These internally generated percepts are referred to as mental images, and they have many similarities with real visual percepts. Consequently, mental imagery is often referred to as "seeing in the mind's eye". While the neural basis of imagery has been widely studied, the interaction between internal and external sources of visual information has received little interest. Here we examined this question by using fMRI to record brain activity of healthy human volunteers while they were performing visual imagery that was distracted with a concurrent presentation of a visual stimulus. Multivariate pattern analysis (MVPA) was used to identify the brain basis of this interaction. Visual imagery was reflected in several brain areas in ventral temporal, lateral occipitotemporal, and posterior frontal cortices, with a left-hemisphere dominance. The key finding was that imagery content representations in the left lateral occipitotemporal cortex were disrupted when a visual distractor was presented during imagery. Our results thus demonstrate that the representations of internal and external visual information interact in brain areas associated with the encoding of visual objects and shapes.

Multifractal long-range dependence pattern of functional magnetic resonance imaging in the human brain at rest

Long-range dependence is a prevalent phenomenon in various biological systems that characterizes the long-memory effect of temporal fluctuations. While recent research suggests that functional magnetic resonance imaging signal has fractal property, it remains unknown about the multifractal long-range dependence pattern of resting-state functional magnetic resonance imaging signals. The current study adopted the multifractal detrended fluctuation analysis on highly sampled resting-state functional magnetic resonance imaging scans to investigate long-range dependence profile associated with the whole-brain voxels as specific functional networks. Our findings revealed the long-range dependence's multifractal properties. Moreover, long-term persistent fluctuations are found for all stations with stronger persistency in whole-brain regions. Subsets with large fluctuations contribute more to the multifractal spectrum in the whole brain. Additionally, we found that the preprocessing with band-pass filtering provided significantly higher reliability for estimating long-range dependence. Our validation analysis confirmed that the optimal pipeline of long-range dependence analysis should include band-pass filtering and removal of daily temporal dependence. Furthermore, multifractal long-range dependence characteristics in healthy control and schizophrenia are different significantly. This work has provided an analytical pipeline for the multifractal long-range dependence in the resting-state functional magnetic resonance imaging signal. The findings suggest differential long-memory effects in the intrinsic functional networks, which may offer a neural marker finding for understanding brain function and pathology.

Novel machine learning approaches for improving the reproducibility and reliability of functional and effective connectivity from functional MRI

Objective.New measures of human brain connectivity are needed to address gaps in the existing measures and facilitate the study of brain function, cognitive capacity, and identify early markers of human disease. Traditional approaches to measure functional connectivity (FC) between pairs of brain regions in functional MRI, such as correlation and partial correlation, fail to capture nonlinear aspects in the regional associations. We propose a new machine learning based measure of FC (ML.FC) which efficiently captures linear and nonlinear aspects.Approach.To capture directed information flow between brain regions, effective connectivity (EC) metrics, including dynamic causal modeling and structural equation modeling have been used. However, these methods are impractical to compute across the many regions of the whole brain. Therefore, we propose two new EC measures. The first, a machine learning based measure of effective connectivity (ML.EC), measures nonlinear aspects across the entire brain. The second, Structurally Projected Granger Causality (SP.GC) adapts Granger Causal connectivity to efficiently characterize and regularize the whole brain EC connectome to respect underlying biological structural connectivity. The proposed measures are compared to traditional measures in terms ofreproducibilityand theability to predict individual traitsin order to demonstrate these measures' internal validity. We use four repeat scans of the same individuals from the Human Connectome Project and measure the ability of the measures to predict individual subject physiologic and cognitive traits.Main results.The proposed new FC measure ofML.FCattains high reproducibility (mean intra-subjectR2of 0.44), while the proposed EC measure ofSP.GCattains the highest predictive power (meanR2across prediction tasks of 0.66).Significance.The proposed methods are highly suitable for achieving high reproducibility and predictiveness and demonstrate their strong potential for future neuroimaging studies.

Progressive reduction in basal ganglia explains and predicts cerebral structural alteration in type 2 diabetes

Type 2 diabetes is consistently reported to be associated with reduced gray matter, mainly in the cortical-striatal-limbic networks. However, little is known about how the progression of diabetes affects cerebral gray matter. To investigate, we collected 543 age- and sex-matched participants of nondiabetes, prediabetes, and diabetes. Voxel-based morphometry using a linear trend model was performed to reveal brain regions associated with disease progression. The Granger causal network of structural covariance was used to assess the causal relationships of brain structural alterations according to disease progression. Multivariate pattern analysis was applied for the stage-specific predictions of hyperglycemia. We detected a linear trend of gray matter volume reduction in the basal ganglia with disease progression (P < 0.05, FWER corrected), which caused a reduction in bilateral temporal gyri, frontal pole, parahippocampus, and bilateral posterior cingulate/precuneus volumes. In addition, the gray matter pattern of the basal ganglia could predict patients with diabetes (accuracy 60.12%, p = 0.002). In conclusion, the basal ganglia is the brain area with progressive gray matter reduction as diabetes progress. The reduced volume in the basal ganglia causes widespread gray matter reductions throughout diabetes progression. These findings indicate that the basal ganglia play a key role in diabetes by affecting the cortical-striatal-limbic network.

Reduced dimension stimulus decoding and column-based modeling reveal architectural differences of primary somatosensory finger maps between younger and older adults

The primary somatosensory cortex (SI) contains fine-grained tactile representations of the body, arranged in an orderly fashion. The use of ultra-high resolution fMRI data to detect group differences, for example between younger and older adults' SI maps, is challenging, because group alignment often does not preserve the high spatial detail of the data. Here, we use robust-shared response modeling (rSRM) that allows group analyses by mapping individual stimulus-driven responses to a lower dimensional shared feature space, to detect age-related differences in tactile representations between younger and older adults using 7T-fMRI data. Using this method, we show that finger representations are more precise in Brodmann-Area (BA) 3b and BA1 compared to BA2 and motor areas, and that this hierarchical processing is preserved across age groups. By combining rSRM with column-based decoding (C-SRM), we further show that the number of columns that optimally describes finger maps in SI is higher in younger compared to older adults in BA1, indicating a greater columnar size in older adults' SI. Taken together, we conclude that rSRM is suitable for finding fine-grained group differences in ultra-high resolution fMRI data, and we provide first evidence that the columnar architecture in SI changes with increasing age.

Anatomically compliant modes of variations: New tools for brain connectivity

Anatomical complexity and data dimensionality present major issues when analysing brain connectivity data. The functional and anatomical aspects of the connections taking place in the brain are in fact equally relevant and strongly intertwined. However, due to theoretical challenges and computational issues, their relationship is often overlooked in neuroscience and clinical research. In this work, we propose to tackle this problem through Smooth Functional Principal Component Analysis, which enables to perform dimensional reduction and exploration of the variability in functional connectivity maps, complying with the formidably complicated anatomy of the grey matter volume. In particular, we analyse a population that includes controls and subjects affected by schizophrenia, starting from fMRI data acquired at rest and during a task-switching paradigm. For both sessions, we first identify the common modes of variation in the entire population. We hence explore whether the subjects' expressions along these common modes of variation differ between controls and pathological subjects. In each session, we find principal components that are significantly differently expressed in the healthy vs pathological subjects (with p-values < 0.001), highlighting clearly interpretable differences in the connectivity in the two subpopulations. For instance, the second and third principal components for the rest session capture the imbalance between the Default Mode and Executive Networks characterizing schizophrenia patients.

Compressibility Analysis of Functional Near-Infrared Spectroscopy Signals in Children With Attention-Deficit/Hyperactivity Disorder

Functional near-infrared spectroscopy (fNIRS) as an emerging optical neuroimaging technique has attracted the interest and attention of many investigators. With the growth of fNIRS data volume, effective data compression methods are urgent. Compressive sensing (CS) has been demonstrated a promising tool to deal with biomedical data. However, whether the compressibility of fNIRS data can discriminate different brain states is unclear. In this study, the fNIRS signals from fifteen attention-deficit/hyperactivity disorder (ADHD) children and fifteen typically developing (TD) children were recorded during an N-back task and a Go/NoGo task respectively. A block sparse Bayesian learning-based CS method was used to reconstruct the compressed fNIRS data. To assess the performance of the CS method, we adopted two metrics, structural similarity index (SSIM) and mean squared error (MSE), both of them effective in evaluating the compressibility of fNIRS data. Then, the two metrics were analyzed to discriminate the brain states of ADHD children and TD children during the two tasks using the multivariate pattern analysis (MVPA) method. As indicated by the results, the CS method could reconstruct the compressed fNIRS data with a high reconstruction quality at different compression ratio ([Formula: see text] and [Formula: see text]). Furthermore, the MVPA method could distinguish different brain states with high accuracy, and identify that the prefrontal cortex is a key brain region for distinguishing ADHD vs. TD or N-back vs. Go/NoGo. These findings indicated that CS is very promising for the storage and transmission of massive fNIRS data, and the compressibility of fNIRS data is a potential biomarker for the diagnosis of ADHD.

The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis

Objective

Machine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD.

Methods

English databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity.

Results

Thirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity.

Conclusion

ML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings.

Testing cognitive theories with multivariate pattern analysis of neuroimaging data

Multivariate pattern analysis (MVPA) has emerged as a powerful method for the analysis of functional magnetic resonance imaging, electroencephalography and magnetoencephalography data. The new approaches to experimental design and hypothesis testing afforded by MVPA have made it possible to address theories that describe cognition at the functional level. Here we review a selection of studies that have used MVPA to test cognitive theories from a range of domains, including perception, attention, memory, navigation, emotion, social cognition and motor control. This broad view reveals properties of MVPA that make it suitable for understanding the 'how' of human cognition, such as the ability to test predictions expressed at the item or event level. It also reveals limitations and points to future directions.

Learning of irrelevant stimulus-response associations modulates cognitive control

It has been shown that manipulating the proportion of congruent to incongruent trials in conflict tasks (e.g., Stroop, Simon, and flanker tasks) can vary the size of conflict effects, however, by two different mechanisms. One theory is the control learning account (the brain learns the probability of conflict and uses it to proactively adjust the control demand for future trials). The other is the irrelevant stimulus-response learning account (the brain learns the probability of irrelevant stimulus-response associations and uses it to prepare responses). Previous fMRI studies have detected the brain regions that contribute to the control-learning-modulated conflict effects, but it is less known what neural substrates underlie the conflict effects modulated by irrelevant S-R learning. We here investigated this question with a model-based fMRI study, in which the proportion of congruent to incongruent trials changed dynamically in the Simon task and the models learned the probability of irrelevant S-R associations quantitatively. Behavioral analyses showed that the unsigned prediction errors (PEs) of responses generated by the learning models correlated with reaction times irrespective of congruent and incongruent trials, indicating that large unsigned PEs associated with slow responses. The fMRI results showed that the regions of fronto-parietal and cingulo-opercular network involved in cognitive control were significantly modulated by the unsigned PEs, also irrespective of congruent and incongruent trials, indicating that large unsigned PEs associated with transiently increased activity in these regions. These results together suggest that learning of irrelevant S-R associations modulates reactive control, which demonstrates a new way to modulate cognitive control compared to the control learning account.

Fused Brain Functional Connectivity Network and Edge-attention Graph Convolution Network for Fibromyalgia Syndrome Diagnosis

Fibromyalgia syndrome (FMS) is a type of rheumatology that seriously affects the normal life of patients. Due to the complex clinical manifestations of FMS, it is challenging to detect FMS. Therefore, an automatic FMS diagnosis model is urgently needed to assist physicians. Brain functional connectivity networks (BFCNs) constructed by resting-state functional magnetic resonance imaging (rs-fMRI) to describe brain functions have been widely used to identify individuals with relevant diseases from normal control (NC). Therefore, we propose a novel model based on BFCN and graph convolutional network (GCN) for automatic FMS diagnosis. Firstly, a novel fused BFCN method is proposed by fusing Pearson's correlation (PC) and low-rank (LR) BFCN, which retains information and reduces data redundancy to construct BFCN. Then we combine the feature of BFCN with non-image information of subjects to obtain nodes and adjacency matrices, which builds a graph with edge attention. Finally, the graph is sent to the GCN layer for FMS diagnosis. Our model is evaluated on the in-house FMS dataset to achieve 82.48% accuracy. The experimental results show that our method outperforms the state-of-the-art competing methods.

Applying Joint Graph Embedding to Study Alzheimer's Neurodegeneration Patterns in Volumetric Data

Neurodegeneration measured through volumetry in MRI is recognized as a potential Alzheimer's Disease (AD) biomarker, but its utility is limited by lack of specificity. Quantifying spatial patterns of neurodegeneration on a whole brain scale rather than locally may help address this. In this work, we turn to network based analyses and extend a graph embedding algorithm to study morphometric connectivity from volume-change correlations measured with structural MRI on the timescale of years. We model our data with the multiple random eigengraphs framework, as well as modify and implement a multigraph embedding algorithm proposed earlier to estimate a low dimensional embedding of the networks. Our version of the algorithm guarantees meaningful finite-sample results and estimates maximum likelihood edge probabilities from population-specific network modes and subject-specific loadings. Furthermore, we propose and implement a novel statistical testing procedure to analyze group differences after accounting for confounders and locate significant structures during AD neurodegeneration. Family-wise error rate is controlled at 5% using permutation testing on the maximum statistic. We show that results from our analysis reveal networks dominated by known structures associated to AD neurodegeneration, indicating the framework has promise for studying AD. Furthermore, we find network-structure tuples that are not found with traditional methods in the field.

A topography-based predictive framework for naturalistic viewing fMRI

Functional magnetic resonance imaging (fMRI) during naturalistic viewing (NV) provides exciting opportunities for studying brain functions in more ecologically valid settings. Understanding individual differences in brain functions during NV and their behavioural relevance has recently become an important goal. However, methods specifically designed for this purpose remain limited. Here, we propose a topography-based predictive framework (TOPF) to fill this methodological gap. TOPF identifies individual-specific evoked activity topographies in a data-driven manner and examines their behavioural relevance using a machine learning-based predictive framework. We validate TOPF on both NV and task-based fMRI data from multiple conditions. Our results show that TOPF effectively and stably captures individual differences in evoked brain activity and successfully predicts phenotypes across cognition, emotion and personality on unseen subjects from their activity topographies. Moreover, TOPF compares favourably with functional connectivity-based approaches in prediction performance, with the identified predictive brain regions being neurobiologically interpretable. Crucially, we highlight the importance of examining individual evoked brain activity topographies in advancing our understanding of the brain-behaviour relationship. We believe that the TOPF approach provides a simple but powerful tool for understanding brain-behaviour relationships on an individual level with a strong potential for clinical applications.

Modeling the development of cortical responses in primate dorsal ("where") pathway to optic flow using hierarchical neural field models

Although there is a plethora of modeling literature dedicated to the object recognition processes of the ventral ("what") pathway of primate visual systems, modeling studies on the motion-sensitive regions like the Medial superior temporal area (MST) of the dorsal ("where") pathway are relatively scarce. Neurons in the MST area of the macaque monkey respond selectively to different types of optic flow sequences such as radial and rotational flows. We present three models that are designed to simulate the computation of optic flow performed by the MST neurons. Model-1 and model-2 each composed of three stages: Direction Selective Mosaic Network (DSMN), Cell Plane Network (CPNW) or the Hebbian Network (HBNW), and the Optic flow network (OF). The three stages roughly correspond to V1-MT-MST areas, respectively, in the primate motion pathway. Both these models are trained stage by stage using a biologically plausible variation of Hebbian rule. The simulation results show that, neurons in model-1 and model-2 (that are trained on translational, radial, and rotational sequences) develop responses that could account for MSTd cell properties found neurobiologically. On the other hand, model-3 consists of the Velocity Selective Mosaic Network (VSMN) followed by a convolutional neural network (CNN) which is trained on radial and rotational sequences using a supervised backpropagation algorithm. The quantitative comparison of response similarity matrices (RSMs), made out of convolution layer and last hidden layer responses, show that model-3 neuron responses are consistent with the idea of functional hierarchy in the macaque motion pathway. These results also suggest that the deep learning models could offer a computationally elegant and biologically plausible solution to simulate the development of cortical responses of the primate motion pathway.

Neurocomputational mechanisms of food and physical activity decision-making in male adolescents

We examined the neurocomputational mechanisms in which male adolescents make food and physical activity decisions and how those processes are influenced by body weight and physical activity levels. After physical activity and dietary assessments, thirty-eight males ages 14-18 completed the behavioral rating and fMRI decision tasks for food and physical activity items. The food and physical activity self-control decisions were significantly correlated with each other. In both, taste- or enjoyment-oriented processes were negatively associated with successful self-control decisions, while health-oriented processes were positively associated. The correlation between taste/enjoyment and healthy attribute ratings predicted actual laboratory food intake and physical activities (2-week activity monitoring). fMRI data showed the decision values of both food and activity are encoded in the ventromedial prefrontal cortex, suggesting both decisions share common reward value-related circuits at the time of choice. Compared to the group with overweight/obese, the group with normal weight showed stronger brain activations in the cognitive control, multisensory integration, and motor control regions during physical activity decisions. For both food and physical activity, self-controlled decisions utilize similar computational and neurobiological mechanisms, which may provide insights into how to promote healthy food and physical activity decisions.

Applying joint graph embedding to study Alzheimer's neurodegeneration patterns in volumetric data

Neurodegeneration measured through volumetry in MRI is recognized as a potential Alzheimer's Disease (AD) biomarker, but its utility is limited by lack of specificity. Quantifying spatial patterns of neurodegeneration on a whole brain scale rather than locally may help address this. In this work, we turn to network based analyses and extend a graph embedding algorithm to study morphometric connectivity from volume-change correlations measured with structural MRI on the timescale of years. We model our data with the multiple random eigengraphs framework, as well as modify and implement a multigraph embedding algorithm proposed earlier to estimate a low dimensional embedding of the networks. Our version of the algorithm guarantees meaningful finite-sample results and estimates maximum likelihood edge probabilities from population-specific network modes and subject-specific loadings. Furthermore, we propose and implement a novel statistical testing procedure to analyze group differences after accounting for confounders and locate significant structures during AD neurodegeneration. Family-wise error rate is controlled at 5% using permutation testing on the maximum statistic. We show that results from our analysis reveal networks dominated by known structures associated to AD neurodegeneration, indicating the framework has promise for studying AD. Furthermore, we find network-structure tuples that are not found with traditional methods in the field.

Interaction between Functional Connectivity and Neural Excitability in Autism: A Novel Framework for Computational Modeling and Application to Biological Data

Functional connectivity (FC) and neural excitability may interact to affect symptoms of autism spectrum disorder (ASD). We tested this hypothesis with neural network simulations, and applied it with functional magnetic resonance imaging (fMRI). A hierarchical recurrent neural network embodying predictive processing theory was subjected to a facial emotion recognition task. Neural network simulations examined the effects of FC and neural excitability on changes in neural representations by developmental learning, and eventually on ASD-like performance. Next, by mapping each neural network condition to subject subgroups on the basis of fMRI parameters, the association between ASD-like performance in the simulation and ASD diagnosis in the corresponding subject subgroup was examined. In the neural network simulation, the more homogeneous the neural excitability of the lower-level network, the more ASD-like the performance (reduced generalization and emotion recognition capability). In addition, in homogeneous networks, the higher the FC, the more ASD-like performance, while in heterogeneous networks, the higher the FC, the less ASD-like performance, demonstrating that FC and neural excitability interact. As an underlying mechanism, neural excitability determines the generalization capability of top-down prediction, and FC determines whether the model's information processing will be top-down prediction-dependent or bottom-up sensory-input dependent. In fMRI datasets, ASD was actually more prevalent in subject subgroups corresponding to the network condition showing ASD-like performance. The current study suggests an interaction between FC and neural excitability, and presents a novel framework for computational modeling and biological application of a developmental learning process underlying cognitive alterations in ASD.

Multiclass characterization of frontotemporal dementia variants via multimodal brain network computational inference

Characterizing a particular neurodegenerative condition against others possible diseases remains a challenge along clinical, biomarker, and neuroscientific levels. This is the particular case of frontotemporal dementia (FTD) variants, where their specific characterization requires high levels of expertise and multidisciplinary teams to subtly distinguish among similar physiopathological processes. Here, we used a computational approach of multimodal brain networks to address simultaneous multiclass classification of 298 subjects (one group against all others), including five FTD variants: behavioral variant FTD, corticobasal syndrome, nonfluent variant primary progressive aphasia, progressive supranuclear palsy, and semantic variant primary progressive aphasia, with healthy controls. Fourteen machine learning classifiers were trained with functional and structural connectivity metrics calculated through different methods. Due to the large number of variables, dimensionality was reduced, employing statistical comparisons and progressive elimination to assess feature stability under nested cross-validation. The machine learning performance was measured through the area under the receiver operating characteristic curves, reaching 0.81 on average, with a standard deviation of 0.09. Furthermore, the contributions of demographic and cognitive data were also assessed via multifeatured classifiers. An accurate simultaneous multiclass classification of each FTD variant against other variants and controls was obtained based on the selection of an optimum set of features. The classifiers incorporating the brain's network and cognitive assessment increased performance metrics. Multimodal classifiers evidenced specific variants' compromise, across modalities and methods through feature importance analysis. If replicated and validated, this approach may help to support clinical decision tools aimed to detect specific affectations in the context of overlapping diseases.

Revisiting Riemannian geometry-based EEG decoding through approximate joint diagonalization

Objective.The wider adoption of Riemannian geometry in electroencephalography (EEG) processing is hindered by two factors: (a) it involves the manipulation of complex mathematical formulations and, (b) it leads to computationally demanding tasks. The main scope of this work is to simplify particular notions of Riemannian geometry and provide an efficient and comprehensible scheme for neuroscientific explorations.Approach.To overcome the aforementioned shortcomings, we exploit the concept of approximate joint diagonalization in order to reconstruct the spatial covariance matrices assuming the existence of (and identifying) a common eigenspace in which the application of Riemannian geometry is significantly simplified.Main results.The employed reconstruction process abides to physiologically plausible assumptions, reduces the computational complexity in Riemannian geometry schemes and bridges the gap between rigorous mathematical procedures and computational neuroscience. Our approach is both formally established and experimentally validated by employing real and synthetic EEG data.Significance.The implications of the introduced reconstruction process are highlighted by reformulating and re-introducing two signal processing methodologies, namely the 'Symmetric Positive Definite (SPD) Matrix Quantization' and the 'Coding over SPD Atoms'. The presented approach paves the way for robust and efficient neuroscientific explorations that exploit Riemannian geometry schemes.

Computational and neural mechanisms of statistical pain learning

Pain invariably changes over time. These fluctuations contain statistical regularities which, in theory, could be learned by the brain to generate expectations and control responses. We demonstrate that humans learn to extract these regularities and explicitly predict the likelihood of forthcoming pain intensities in a manner consistent with optimal Bayesian inference with dynamic update of beliefs. Healthy participants received probabilistic, volatile sequences of low and high-intensity electrical stimuli to the hand during brain fMRI. The inferred frequency of pain correlated with activity in sensorimotor cortical regions and dorsal striatum, whereas the uncertainty of these inferences was encoded in the right superior parietal cortex. Unexpected changes in stimulus frequencies drove the update of internal models by engaging premotor, prefrontal and posterior parietal regions. This study extends our understanding of sensory processing of pain to include the generation of Bayesian internal models of the temporal statistics of pain.

Do sparse brain activity patterns underlie human cognition?

Accumulating multivariate pattern analysis (MVPA) results from fMRI studies suggest that information is represented in fingerprint patterns of activations and deactivations during perception, emotions, and cognition. We postulate that these fingerprint patterns might reflect neuronal-population level sparse code documented in two-photon calcium imaging studies in animal models, i.e., information represented in specific and reproducible ensembles of a few percent of active neurons amidst widespread inhibition in neural populations. We suggest that such representations constitute a fundamental organizational principle via interacting across multiple levels of brain hierarchy, thus giving rise to perception, emotions, and cognition.

Pattern analysis of neuroimaging data reveals novel insights on threat learning and extinction in humans

Several decades of rodent neurobiology research have identified a network of brain regions that support Pavlovian threat conditioning and extinction, focused predominately on the amygdala, hippocampus, and medial prefrontal cortex (mPFC). Surprisingly, functional magnetic resonance imaging (fMRI) studies have shown inconsistent evidence for these regions while humans undergo threat conditioning and extinction. In this review, we suggest that translational neuroimaging efforts have been hindered by reliance on traditional univariate analysis of fMRI. Whereas univariate analyses average activity across voxels in a given region, multivariate pattern analyses (MVPA) leverage the information present in spatial patterns of activity. MVPA therefore provides a more sensitive analysis tool to translate rodent neurobiology to human neuroimaging. We review human fMRI studies using MVPA that successfully bridge rodent models of amygdala, hippocampus, and mPFC function during Pavlovian learning. We also highlight clinical applications of these information-sensitive multivariate analyses. In sum, we advocate that the field should consider adopting a variety of multivariate approaches to help bridge cutting-edge research on the neuroscience of threat and anxiety.

RT-Cloud: A cloud-based software framework to simplify and standardize real-time fMRI

Real-time fMRI (RT-fMRI) neurofeedback has been shown to be effective in treating neuropsychiatric disorders and holds tremendous promise for future breakthroughs, both with regard to basic science and clinical applications. However, the prevalence of its use has been hampered by computing hardware requirements, the complexity of setting up and running an experiment, and a lack of standards that would foster collaboration. To address these issues, we have developed RT-Cloud (https://github.com/brainiak/rt-cloud), a flexible, cloud-based, open-source Python software package for the execution of RT-fMRI experiments. RT-Cloud uses standardized data formats and adaptable processing streams to support and expand open science in RT-fMRI research and applications. Cloud computing is a key enabling technology for advancing RT-fMRI because it eliminates the need for on-premise technical expertise and high-performance computing; this allows installation, configuration, and maintenance to be automated and done remotely. Furthermore, the scalability of cloud computing makes it easier to deploy computationally-demanding multivariate analyses in real time. In this paper, we describe how RT-Cloud has been integrated with open standards, including the Brain Imaging Data Structure (BIDS) standard and the OpenNeuro database, how it has been applied thus far, and our plans for further development and deployment of RT-Cloud in the coming years.

Diurnal variations of resting-state fMRI data: A graph-based analysis

Circadian rhythms (lasting approximately 24 h) control and entrain various physiological processes, ranging from neural activity and hormone secretion to sleep cycles and eating habits. Several studies have shown that time of day (TOD) is associated with human cognition and brain functions. In this study, utilizing a chronotype-based paradigm, we applied a graph theory approach on resting-state functional MRI (rs-fMRI) data to compare whole-brain functional network topology between morning and evening sessions and between morning-type (MT) and evening-type (ET) participants. Sixty-two individuals (31 MT and 31 ET) underwent two fMRI sessions, approximately 1 hour (morning) and 10 h (evening) after their wake-up time, according to their declared habitual sleep-wake pattern on a regular working day. In the global analysis, the findings revealed the effect of TOD on functional connectivity (FC) patterns, including increased small-worldness, assortativity, and synchronization across the day. However, we identified no significant differences based on chronotype categories. The study of the modular structure of the brain at mesoscale showed that functional networks tended to be more integrated with one another in the evening session than in the morning session. Local/regional changes were affected by both factors (i.e., TOD and chronotype), mostly in areas associated with somatomotor, attention, frontoparietal, and default networks. Furthermore, connectivity and hub analyses revealed that the somatomotor, ventral attention, and visual networks covered the most highly connected areas in the morning and evening sessions: the latter two were more active in the morning sessions, and the first was identified as being more active in the evening. Finally, we performed a correlation analysis to determine whether global and nodal measures were associated with subjective assessments across participants. Collectively, these findings contribute to an increased understanding of diurnal fluctuations in resting brain activity and highlight the role of TOD in future studies on brain function and the design of fMRI experiments.

Neural variability fingerprint predicts individuals' information security violation intentions

As the weakest links in information security defense are the individuals in an organizations, it is important to understand their information security behaviors. In the current study, we tested whether the neural variability pattern could predict an individual's intention to engage in information security violations. Because cognitive neuroscience methods can provide a new perspective into psychological processes without common methodological biases or social desirability, we combined an adapted version of the information security paradigm (ISP) with functional magnetic resonance imaging (fMRI) technology. While completing an adapted ISP task, participants underwent an fMRI scan. We adopted a machine learning method to build a neural variability predictive model. Consistent with previous studies, we found that people were more likely to take actions under neutral conditions than in minor violation contexts and major violation contexts. Moreover, the neural variability predictive model, including nodes within the task control, default mode, visual, salience and attention networks, can predict information security violation intentions. These results illustrate the predictive value of neural variability for information security violations and provide a new perspective for combining ISP with the fMRI technique to explore a neural predictive model of information security violation intention.

BrainIAK: The Brain Imaging Analysis Kit

Functional magnetic resonance imaging (fMRI) offers a rich source of data for studying the neural basis of cognition. Here, we describe the Brain Imaging Analysis Kit (BrainIAK), an open-source, free Python package that provides computationally optimized solutions to key problems in advanced fMRI analysis. A variety of techniques are presently included in BrainIAK: intersubject correlation (ISC) and intersubject functional connectivity (ISFC), functional alignment via the shared response model (SRM), full correlation matrix analysis (FCMA), a Bayesian version of representational similarity analysis (BRSA), event segmentation using hidden Markov models, topographic factor analysis (TFA), inverted encoding models (IEMs), an fMRI data simulator that uses noise characteristics from real data (fmrisim), and some emerging methods. These techniques have been optimized to leverage the efficiencies of high-performance compute (HPC) clusters, and the same code can be seamlessly transferred from a laptop to a cluster. For each of the aforementioned techniques, we describe the data analysis problem that the technique is meant to solve and how it solves that problem; we also include an example Jupyter notebook for each technique and an annotated bibliography of papers that have used and/or described that technique. In addition to the sections describing various analysis techniques in BrainIAK, we have included sections describing the future applications of BrainIAK to real-time fMRI, tutorials that we have developed and shared online to facilitate learning the techniques in BrainIAK, computational innovations in BrainIAK, and how to contribute to BrainIAK. We hope that this manuscript helps readers to understand how BrainIAK might be useful in their research.

Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex

Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech consisting of English sentences presented in five different formats: visual-only; auditory with and without added auditory noise; and audiovisual with and without auditory noise. Participants reported the intelligibility of each sentence with a button press and trials were sorted post-hoc into those that were more or less intelligible. Response patterns were measured in regions of the pSTG/S identified with an independent localizer. Noisy audiovisual sentences with very similar physical properties evoked very different response patterns depending on their intelligibility. When a noisy audiovisual sentence was reported as intelligible, the pattern was nearly identical to that elicited by clear audiovisual sentences. In contrast, an unintelligible noisy audiovisual sentence evoked a pattern like that of visual-only sentences. This effect was less pronounced for noisy auditory-only sentences, which evoked similar response patterns regardless of intelligibility. The successful integration of visual and auditory speech produces a characteristic neural signature in pSTG/S, highlighting the importance of this region in generating the perceptual benefit of visual speech.

Real-Time Functional MRI in the Treatment of Mental Health Disorders

Multiple mental disorders have been associated with dysregulation of precise brain processes. However, few therapeutic approaches can correct such specific patterns of brain activity. Since the late 1960s and early 1970s, many researchers have hoped that this feat could be achieved by closed-loop brain imaging approaches, such as neurofeedback, that aim to modulate brain activity directly. However, neurofeedback never gained mainstream acceptance in mental health, in part due to methodological considerations. In this review, we argue that, when contemporary methodological guidelines are followed, neurofeedback is one of the few intervention methods in psychology that can be assessed in double-blind placebo-controlled trials. Furthermore, using new advances in machine learning and statistics, it is now possible to target very precise patterns of brain activity for therapeutic purposes. We review the recent literature in functional magnetic resonance imaging neurofeedback and discuss current and future applications to mental health.

Expected final online publication date for the Annual Review of Clinical Psychology, Volume 18 is May 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Predicting speech from a cortical hierarchy of event-based time scales

How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.

Predicting speech from a cortical hierarchy of event-based time scales

How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.

Neural Representations of the Committed Romantic Partner in the Nucleus Accumbens

Having an intimate romantic relationship is an important aspect of life. Dopamine-rich reward regions, including the nucleus accumbens (NAcc), have been identified as neural correlates for both emotional bonding with the partner and interest in unfamiliar attractive nonpartners. Here, we aimed to disentangle the overlapping functions of the NAcc using multivoxel pattern analysis, which can decode the cognitive processes encoded in particular neural activity. During functional MRI scanning, 46 romantically involved men performed the social-incentive-delay task, in which a successful response resulted in the presentation of a dynamic and positive facial expression from their partner and unfamiliar women. Multivoxel pattern analysis revealed that the spatial patterns of NAcc activity could successfully discriminate between romantic partners and unfamiliar women during the period in which participants anticipated the target presentation. We speculate that neural activity patterns within the NAcc represent the relationship partner, which might be a key neural mechanism for committed romantic relationships.

Dynamic Transitions between Neural States Are Associated with Flexible Task Switching during a Memory Task

Flexible behavior requires switching between different task conditions. It is known that such task switching is associated with costs in terms of slowed RT, reduced accuracy, or both. The neural correlates of task switching have usually been studied by requiring participants to switch between distinct task conditions that recruit different brain networks. Here, we investigated the transition of neural states underlying switching between two opposite memory-related processes (i.e., memory retrieval and memory suppression) in a memory task. We investigated 26 healthy participants who performed a think/no-think task while being in the fMRI scanner. Behaviorally, we show that it was more difficult for participants to suppress unwanted memories when a no-think was preceded by a think trial instead of another no-think trial. Neurally, we demonstrate that think-no-think switches were associated with an increase in control-related and a decrease in memory-related brain activity. Neural representations of task condition, assessed by decoding accuracy, were lower immediately after task switching compared with the nonswitch transitions, suggesting a switch-induced delay in the neural transition toward the required task condition. This suggestion is corroborated by an association between condition-specific representational strength and condition-specific performance in switch trials. Taken together, we provided neural evidence from the time-resolved decoding approach to support the notion that carryover of the previous task set activation is associated with the switching cost, leading to less successful memory suppression.

Humans use forward thinking to exploit social controllability

The controllability of our social environment has a profound impact on our behavior and mental health. Nevertheless, neurocomputational mechanisms underlying social controllability remain elusive. Here, 48 participants performed a task where their current choices either did (Controllable), or did not (Uncontrollable), influence partners’ future proposals. Computational modeling revealed that people engaged a mental model of forward thinking (FT; i.e., calculating the downstream effects of current actions) to estimate social controllability in both Controllable and Uncontrollable conditions. A large-scale online replication study (n=1342) supported this finding. Using functional magnetic resonance imaging (n=48), we further demonstrated that the ventromedial prefrontal cortex (vmPFC) computed the projected total values of current actions during forward planning, supporting the neural realization of the forward-thinking model. These findings demonstrate that humans use vmPFC-dependent FT to estimate and exploit social controllability, expanding the role of this neurocomputational mechanism beyond spatial and cognitive contexts.

The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension

The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

Data-Driven Approach to the Analysis of Real-Time FMRI Neurofeedback Data: Disorder-Specific Brain Synchrony in PTSD

Brain-computer interfaces (BCIs) can be used in real-time fMRI neurofeedback (rtfMRI NF) investigations to provide feedback on brain activity to enable voluntary regulation of the blood-oxygen-level dependent (BOLD) signal from localized brain regions. However, the temporal pattern of successful self-regulation is dynamic and complex. In particular, the general linear model (GLM) assumes fixed temporal model functions and misses other dynamics. We propose a novel data-driven analyses approach for rtfMRI NF using intersubject covariance (ISC) analysis. The potential of ISC was examined in a reanalysis of data from 21 healthy individuals and nine patients with post-traumatic stress-disorder (PTSD) performing up-regulation of the anterior cingulate cortex (ACC). ISC in the PTSD group differed from healthy controls in a network including the right inferior frontal gyrus (IFG). In both cohorts, ISC decreased throughout the experiment indicating the development of individual regulation strategies. ISC analyses are a promising approach to reveal novel information on the mechanisms involved in voluntary self-regulation of brain signals and thus extend the results from GLM-based methods. ISC enables a novel set of research questions that can guide future neurofeedback and neuroimaging investigations.

Current and Future Challenges of Functional MRI and Diffusion Tractography in the Surgical Setting: From Eloquent Brain Mapping to Neural Plasticity

Decades ago, Spetzler (1986) and Sawaya (1998) provided a rough brain segmentation of the eloquent areas of the brain, aimed to help surgical decisions in cases of vascular malformations and tumors, respectively. Currently in clinical use, their criteria are in need of revision. Defining functions (eg, sensorimotor, language and visual) that should be preserved during surgery seems a straightforward task. In practice, locating the specific areas that could cause a permanent vs transient deficit is not an easy task. This is particularly true for the associative cortex and cognitive domains such as language. The old model, with Broca's and Wernicke's areas at the forefront, has been superseded by a dual-stream model of parallel language processing; named ventral and dorsal pathways. This complicated network of cortical hubs and subcortical white matter pathways needing preservation during surgery is a work in progress. Preserving not only cortical regions but most importantly preserving the connections, or white matter fiber bundles, of core regions in the brain is the new paradigm. For instance, the arcuate fascicululs and inferior fronto-occipital fasciculus are key components of the dorsal and ventral language pathways, respectively; and their damage result in permanent language deficits. Interestedly, the damage of the temporal portions of these bundles -where there is a crossroad with other multiple bundles-, appears to be more important (permanent) than the damage of the frontal portions - where plasticity and contralateral activation could help. Although intraoperative direct cortical and subcortical stimulation have contributed largely, advanced MR techniques such as functional MRI (fMRI) and diffusion tractography (DT), are at the epi-center of our current understanding. Nevertheless, these techniques posse important challenges: such as neurovascular uncoupling or venous bias on fMRI; and appropriate anatomical validation or accurate representation of crossing fibers on DT. These limitations should be well understood and taken into account in clinical practice. Unifying multidisciplinary research and clinical efforts is desirable, so these techniques could contribute more efficiently not only to locate eloquent areas but to improve outcomes and our understanding of neural plasticity. Finally, although there are constant anatomical and functional regions at the individual level, there is a known variability at the inter-individual level. This concept should strengthen the importance of a personalized approach when evaluating these regions on fMRI and DT. It should strengthen the importance of personalized treatments as well, aimed to meet tailored needs and expectations.

Evidence accumulation and associated error-related brain activity as computationally-informed prospective predictors of substance use in emerging adulthood

RATIONALE

Substance use peaks during the developmental period known as emerging adulthood (ages 18-25), but not every individual who uses substances during this period engages in frequent or problematic use. Although individual differences in neurocognition appear to predict use severity, mechanistic neurocognitive risk factors with clear links to both behavior and neural circuitry have yet to be identified. Here, we aim to do so with an approach rooted in computational psychiatry, an emerging field in which formal models are used to identify candidate biobehavioral dimensions that confer risk for psychopathology.

OBJECTIVES

We test whether lower efficiency of evidence accumulation (EEA), a computationally characterized individual difference variable that drives performance on the go/no-go and other neurocognitive tasks, is a risk factor for substance use in emerging adults.

METHODS AND RESULTS

In an fMRI substudy within a sociobehavioral longitudinal study (n = 106), we find that lower EEA and reductions in a robust neural-level correlate of EEA (error-related activations in salience network structures) measured at ages 18-21 are both prospectively related to greater substance use during ages 22-26, even after adjusting for other well-known risk factors. Results from Bayesian model comparisons corroborated inferences from conventional hypothesis testing and provided evidence that both EEA and its neuroimaging correlates contain unique predictive information about substance use involvement.

CONCLUSIONS

These findings highlight EEA as a computationally characterized neurocognitive risk factor for substance use during a critical developmental period, with clear links to both neuroimaging measures and well-established formal theories of brain function.

The elusiveness of context effects in decision making

Contextual features influence human and non-human decision making, giving rise to preference reversals. Decades of research have documented the species and situations in which these effects are observed. More recently, however, researchers have focused on boundary conditions, that is, settings in which established effects disappear or reverse. This work is scattered across academic disciplines and some results appear to contradict each other. We synthesize recent findings and resolve apparent contradictions by considering them in terms of three core categories of decision context: spatial arrangement, attribute concreteness, and deliberation time. We suggest that these categories could be understood using theories of choice representation, which specify how context shapes the information over which deliberation processes operate.

Hippocampal-Medial Prefrontal Event Segmentation and Integration Contribute to Episodic Memory Formation

How do we encode our continuous life experiences for later retrieval? Theories of event segmentation and integration suggest that the hippocampus binds separately represented events into an ordered narrative. Using a functional Magnetic Resonance Imaging (fMRI) movie watching-recall dataset, we quantified two types of neural similarities (i.e., "activation pattern" similarity and within-region voxel-based "connectivity pattern" similarity) between separate events during movie watching and related them to subsequent retrieval of events as well as retrieval of sequential order. We demonstrated that compared with forgotten events, successfully remembered events were associated with distinct "activation patterns" in the hippocampus and medial prefrontal cortex. In contrast, similar "connectivity pattern" between events were associated with memory formation and were also relevant for retaining events in the correct order. We applied the same approaches to an independent movie watching fMRI dataset as validation and highlighted again the role of hippocampal activation pattern and connectivity pattern in memory formation. We propose that distinct activation patterns represent neural segmentation of events, while similar connectivity patterns encode context information and, therefore, integrate events into a narrative. Our results provide novel evidence for the role of hippocampal-medial prefrontal event segmentation and integration in episodic memory formation of real-life experience.