SimTB, a simulation toolbox for fMRI data under a model of spatiotemporal separability

Three layered sparse dictionary learning algorithm for enhancing the subject wise segregation of brain networks

Independent component analysis (ICA) and dictionary learning (DL) are the most successful blind source separation (BSS) methods for functional magnetic resonance imaging (fMRI) data analysis. However, ICA to higher and DL to lower extent may suffer from performance degradation by the presence of anomalous observations in the recovered time courses (TCs) and high overlaps among spatial maps (SMs). This paper addressed both problems using a novel three-layered sparse DL (TLSDL) algorithm that incorporated prior information in the dictionary update process and recovered full-rank outlier-free TCs from highly corrupted measurements. The associated sequential DL model involved factorizing each subject's data into a multi-subject (MS) dictionary and MS sparse code while imposing a low-rank and a sparse matrix decomposition restriction on the dictionary matrix. It is derived by solving three layers of feature extraction and component estimation. The first and second layers captured brain regions with low and moderate spatial overlaps, respectively. The third layer that segregated regions with significant spatial overlaps solved a sequence of vector decomposition problems using the proximal alternating linearized minimization (PALM) method and solved a decomposition restriction using the alternating directions method (ALM). It learned outlier-free dynamics that integrate spatiotemporal diversities across brains and external information. It differs from existing DL methods owing to its unique optimization model, which incorporates prior knowledge, subject-wise/multi-subject representation matrices, and outlier handling. The TLSDL algorithm was compared with existing dictionary learning algorithms using experimental and synthetic fMRI datasets to verify its performance. Overall, the mean correlation value was found to be 26 % higher for the TLSDL than for the state-of-the-art subject-wise sequential DL (swsDL) technique.

SMART (Splitting-Merging Assisted Reliable) Independent Component Analysis for Extracting Accurate Brain Functional Networks

Functional networks (FNs) hold significant promise in understanding brain function. Independent component analysis (ICA) has been applied in estimating FNs from functional magnetic resonance imaging (fMRI). However, determining an optimal model order for ICA remains challenging, leading to criticism about the reliability of FN estimation. Here, we propose a SMART (splitting-merging assisted reliable) ICA method that automatically extracts reliable FNs by clustering independent components (ICs) obtained from multi-model-order ICA using a simplified graph while providing linkages among FNs deduced from different-model orders. We extend SMART ICA to multi-subject fMRI analysis, validating its effectiveness using simulated and real fMRI data. Based on simulated data, the method accurately estimates both group-common and group-unique components and demonstrates robustness to parameters. Using two age-matched cohorts of resting fMRI data comprising 1,950 healthy subjects, the resulting reliable group-level FNs are greatly similar between the two cohorts, and interestingly the subject-specific FNs show progressive changes while age increases. Furthermore, both small-scale and large-scale brain FN templates are provided as benchmarks for future studies. Taken together, SMART ICA can automatically obtain reliable FNs in analyzing multi-subject fMRI data, while also providing linkages between different FNs.

Estimation of static and dynamic functional connectivity in resting-state fMRI using zero-frequency resonator

Resting-state functional magnetic resonance imaging (rs-fMRI) is increasingly being used to infer the functional organization of the brain. Blood oxygen level-dependent (BOLD) features related to spontaneous neuronal activity, are yet to be clearly understood. Prior studies have hypothesized that rs-fMRI is spontaneous event-related and these events convey crucial information about the neuronal activity in estimating resting state functional connectivity (FC). Attempts have been made to extract these temporal events using a predetermined threshold. However, the thresholding methods in addition to being very sensitive to noise, may consider redundant events or exclude the low-valued inflection points. Here, we extract the event-related temporal onsets from the rs-fMRI time courses using a zero-frequency resonator (ZFR). The ZFR reflects the transient behavior of the BOLD events at its output. The conditional rate (CR) of the BOLD events occurring in a time course with respect to a seed time course is used to derive static FC. The temporal activity around the estimated events called high signal-to-noise ratio (SNR) segments are also obtained in the rs-fMRI time course and are then used to compute static and dynamic FCs during rest. Coactivation pattern (CAP) is the dynamic FC obtained using the high SNR segments driven by the ZFR. The static FC demonstrates that the ZFR-based CR distinguishes the coactivation and non-coactivation scores well in the distribution. CAP analysis demonstrated the stable and longer dwell time dominant resting state functional networks with high SNR segments driven by the ZFR. Static and dynamic FC analysis underpins that the ZFR-driven temporal onsets of BOLD events derive reliable and consistent FCs in the resting brain using a subset of the time points.

A spatially constrained independent component analysis jointly informed by structural and functional network connectivity

There are a growing number of neuroimaging studies motivating joint structural and functional brain connectivity. Brain connectivity of different modalities provides insight into brain functional organization by leveraging complementary information, especially for brain disorders such as schizophrenia. In this paper, we propose a multi-modal independent component analysis (ICA) model that utilizes information from both structural and functional brain connectivity guided by spatial maps to estimate intrinsic connectivity networks (ICNs). Structural connectivity is estimated through whole-brain tractography on diffusion-weighted MRI (dMRI), while functional connectivity is derived from resting-state functional MRI (rs-fMRI). The proposed structural-functional connectivity and spatially constrained ICA (sfCICA) model estimates ICNs at the subject level using a multi-objective optimization framework. We evaluated our model using synthetic and real datasets (including dMRI and rs-fMRI from 149 schizophrenia patients and 162 controls). Multi-modal ICNs revealed enhanced functional coupling between ICNs with higher structural connectivity, improved modularity, and network distinction, particularly in schizophrenia. Statistical analysis of group differences showed more significant differences in the proposed model compared to the unimodal model. In summary, the sfCICA model showed benefits from being jointly informed by structural and functional connectivity. These findings suggest advantages in simultaneously learning effectively and enhancing connectivity estimates using structural connectivity.

A predictor-informed multi-subject bayesian approach for dynamic functional connectivity

Dynamic functional connectivity investigates how the interactions among brain regions vary over the course of an fMRI experiment. Such transitions between different individual connectivity states can be modulated by changes in underlying physiological mechanisms that drive functional network dynamics, e.g., changes in attention or cognitive effort. In this paper, we develop a multi-subject Bayesian framework where the estimation of dynamic functional networks is informed by time-varying exogenous physiological covariates that are simultaneously recorded in each subject during the fMRI experiment. More specifically, we consider a dynamic Gaussian graphical model approach where a non-homogeneous hidden Markov model is employed to classify the fMRI time series into latent neurological states. We assume the state-transition probabilities to vary over time and across subjects as a function of the underlying covariates, allowing for the estimation of recurrent connectivity patterns and the sharing of networks among the subjects. We further assume sparsity in the network structures via shrinkage priors, and achieve edge selection in the estimated graph structures by introducing a multi-comparison procedure for shrinkage-based inferences with Bayesian false discovery rate control. We evaluate the performances of our method vs alternative approaches on synthetic data. We apply our modeling framework on a resting-state experiment where fMRI data have been collected concurrently with pupillometry measurements, as a proxy of cognitive processing, and assess the heterogeneity of the effects of changes in pupil dilation on the subjects' propensity to change connectivity states. The heterogeneity of state occupancy across subjects provides an understanding of the relationship between increased pupil dilation and transitions toward different cognitive states.

Hierarchical Principal Components for Data-Driven Multiresolution fMRI Analyses

Understanding the organization of neural processing is a fundamental goal of neuroscience. Recent work suggests that these systems are organized as a multiscale hierarchy, with increasingly specialized subsystems nested inside general processing systems. Current neuroimaging methods, such as independent component analysis (ICA), cannot fully capture this hierarchy since they are limited to a single spatial scale. In this manuscript, we introduce multiresolution hierarchical principal components analysis (hPCA) and compare it to ICA using simulated fMRI datasets. Furthermore, we describe a parametric statistical filtering method developed to focus analyses on biologically relevant features. Lastly, we apply hPCA to the Human Connectome Project (HCP) to demonstrate its ability to estimate a hierarchy from real fMRI data. hPCA accurately estimated spatial maps and time series from networks with diverse hierarchical structures. Simulated hierarchies varied in the degree of branching, such as two-way or three-way subdivisions, and the total number of levels, with varying equal or unequal subdivision sizes at each branch. In each case, as well as in the HCP, hPCA was able to reconstruct a known hierarchy of networks. Our results suggest that hPCA can facilitate more detailed and comprehensive analyses of the brain's network of networks and the multiscale regional specializations underlying neural processing and cognition.

Dynamic nonreversibility view of intrinsic brain organization and brain dynamic analysis of repetitive transcranial magnitude stimulation

Intrinsic neural activities are characterized as endless spontaneous fluctuation over multiple time scales. However, how the intrinsic brain organization changes over time under local perturbation remains an open question. By means of statistical physics, we proposed an approach to capture whole-brain dynamics based on estimating time-varying nonreversibility and k-means clustering of dynamic varying nonreversibility patterns. We first used synthetic fMRI to investigate the effects of window parameters on the temporal variability of varying nonreversibility. Second, using real test-retest fMRI data, we examined the reproducibility, reliability, biological, and physiological correlation of the varying nonreversibility substates. Finally, using repetitive transcranial magnetic stimulation-fMRI data, we investigated the modulation effects of repetitive transcranial magnetic stimulation on varying nonreversibility substate dynamics. The results show that: (i) as window length increased, the varying nonreversibility variance decreased, while the sliding step almost did not alter it; (ii) the global high varying nonreversibility states and low varying nonreversibility states were reproducible across multiple datasets and different window lengths; and (iii) there were increased low varying nonreversibility states and decreased high varying nonreversibility states when the left frontal lobe was stimulated, but not the occipital lobe. Taken together, these results provide a thermodynamic equilibrium perspective of intrinsic brain organization and reorganization under local perturbation.

Characterizing Spatiotemporal Population Receptive Fields in Human Visual Cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time-varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants (both females and males). We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (1) from early to later areas within a visual stream, spatial and temporal windows of pRFs progressively increase in size and show greater compressive nonlinearities, (2) later visual areas show diverging spatial and temporal windows across streams, and (3) within early visual areas (V1-V3), both spatial and temporal windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses using fMRI.

Static and dynamic fMRI-derived functional connectomes represent largely similar information

Functional connectivity (FC) of blood oxygen level-dependent (BOLD) fMRI time series can be estimated using methods that differ in sensitivity to the temporal order of time points (static vs. dynamic) and the number of regions considered in estimating a single edge (bivariate vs. multivariate). Previous research suggests that dynamic FC explains variability in FC fluctuations and behavior beyond static FC. Our aim was to systematically compare methods on both dimensions. We compared five FC methods: Pearson's/full correlation (static, bivariate), lagged correlation (dynamic, bivariate), partial correlation (static, multivariate), and multivariate AR model with and without self-connections (dynamic, multivariate). We compared these methods by (i) assessing similarities between FC matrices, (ii) by comparing node centrality measures, and (iii) by comparing the patterns of brain-behavior associations. Although FC estimates did not differ as a function of sensitivity to temporal order, we observed differences between the multivariate and bivariate FC methods. The dynamic FC estimates were highly correlated with the static FC estimates, especially when comparing group-level FC matrices. Similarly, there were high correlations between the patterns of brain-behavior associations obtained using the dynamic and static FC methods. We conclude that the dynamic FC estimates represent information largely similar to that of the static FC.

G-bic: generating synthetic benchmarks for biclustering

BACKGROUND

Biclustering is increasingly used in biomedical data analysis, recommendation tasks, and text mining domains, with hundreds of biclustering algorithms proposed. When assessing the performance of these algorithms, more than real datasets are required as they do not offer a solid ground truth. Synthetic data surpass this limitation by producing reference solutions to be compared with the found patterns. However, generating synthetic datasets is challenging since the generated data must ensure reproducibility, pattern representativity, and real data resemblance.

RESULTS

We propose G-Bic, a dataset generator conceived to produce synthetic benchmarks for the normative assessment of biclustering algorithms. Beyond expanding on aspects of pattern coherence, data quality, and positioning properties, it further handles specificities related to mixed-type datasets and time-series data.G-Bic has the flexibility to replicate real data regularities from diverse domains. We provide the default configurations to generate reproducible benchmarks to evaluate and compare diverse aspects of biclustering algorithms. Additionally, we discuss empirical strategies to simulate the properties of real data.

CONCLUSION

G-Bic is a parametrizable generator for biclustering analysis, offering a solid means to assess biclustering solutions according to internal and external metrics robustly.

Denoising brain networks using a fixed mathematical phase change in independent component analysis of magnitude-only fMRI data

Brain networks extracted by independent component analysis (ICA) from magnitude-only fMRI data are usually denoised using various amplitude-based thresholds. By contrast, spatial source phase (SSP) or the phase information of ICA brain networks extracted from complex-valued fMRI data, has provided a simple yet effective way to perform the denoising using a fixed phase change. In this work, we extend the approach to magnitude-only fMRI data to avoid testing various amplitude thresholds for denoising magnitude maps extracted by ICA, as most studies do not save the complex-valued data. The main idea is to generate a mathematical SSP map for a magnitude map using a mapping framework, and the mapping framework is built using complex-valued fMRI data with a known SSP map. Here we leverage the fact that the phase map derived from phase fMRI data has similar phase information to the SSP map. After verifying the use of the magnitude data of complex-valued fMRI, this framework is generalized to work with magnitude-only data, allowing use of our approach even without the availability of the corresponding phase fMRI datasets. We test the proposed method using both simulated and experimental fMRI data including complex-valued data from University of New Mexico and magnitude-only data from Human Connectome Project. The results provide evidence that the mathematical SSP denoising with a fixed phase change is effective for denoising spatial maps from magnitude-only fMRI data in terms of retaining more BOLD-related activity and fewer unwanted voxels, compared with amplitude-based thresholding. The proposed method provides a unified and efficient SSP approach to denoise ICA brain networks in fMRI data.

Statistical Brain Network Analysis

The recent fusion of network science and neuroscience has catalyzed a paradigm shift in how we study the brain and led to the field of brain network analysis. Brain network analyses hold great potential in helping us understand normal and abnormal brain function by providing profound clinical insight into links between system-level properties and health and behavioral outcomes. Nonetheless, methods for statistically analyzing networks at the group and individual levels have lagged behind. We have attempted to address this need by developing three complementary statistical frameworks-a mixed modeling framework, a distance regression framework, and a hidden semi-Markov modeling framework. These tools serve as synergistic fusions of statistical approaches with network science methods, providing needed analytic foundations for whole-brain network data. Here we delineate these approaches, briefly survey related tools, and discuss potential future avenues of research. We hope this review catalyzes further statistical interest and methodological development in the field.

A novel subject-wise dictionary learning approach using multi-subject fMRI spatial and temporal components

The conventional dictionary learning (DL) algorithms aim to adapt the dictionary/sparse code to individual functional magnetic resonance imaging (fMRI) data. Thus, lacking the capability to consolidate the spatiotemporal diversities offered by other subjects. Considering that subject-wise (sw) data matrix can be decomposed into the sparse linear combination of multi-subject (MS) time courses and MS spatial maps, two new algorithms, sw sequential DL (swsDL) and sw block DL (swbDL), have been proposed. They are based on the novel framework, defined by the mixing model, where base matrices prepared by operating a computationally fast sparse spatiotemporal blind source separation method over multiple subjects are employed to adapt the mixing matrices to sw training data. They solve the optimization models formulated using [Formula: see text]/[Formula: see text]-norm penalization/constraints through dictionary/sparse code pair update and alternating minimization approach. They are unique because no existing sparse DL method can incorporate MS spatiotemporal components while updating sw atoms/sparse codes, which can eventually be assembled using neuroscience knowledge to extract group-level dynamics. Various fMRI datasets are used to evaluate and compare the performance of the proposed algorithms with existing state-of-the-art algorithms. Specifically, overall, a [Formula: see text] increase in the mean correlation value and [Formula: see text] reduction in the mean computation time exhibited by swsDL and swbDL, respectively, over the adaptive consistent sequential dictionary algorithm.

Group Surrogate Data Generating Models and similarity quantification of multivariate time-series: A resting-state fMRI study

Advancements in non-invasive brain analysis through novel approaches such as big data analytics and in silico simulation are essential for explaining brain function and associated pathologies. In this study, we extend the vector auto-regressive surrogate technique from a single multivariate time-series to group data using a novel Group Surrogate Data Generating Model (GSDGM). This methodology allowed us to generate biologically plausible human brain dynamics representative of a large human resting-state (rs-fMRI) dataset obtained from the Human Connectome Project. Simultaneously, we defined a novel similarity measure, termed the Multivariate Time-series Ensemble Similarity Score (MTESS). MTESS showed high accuracy and f-measure in subject identification, and it can directly compare the similarity between two multivariate time-series. We used MTESS to analyze both human and marmoset rs-fMRI data. Our results showed similarity differences between cortical and subcortical regions. We also conducted MTESS and state transition analysis between single and group surrogate techniques, and confirmed that a group surrogate approach can generate plausible group centroid multivariate time-series. Finally, we used GSDGM and MTESS for the fingerprint analysis of human rs-fMRI data, successfully distinguishing normal and outlier sessions. These new techniques will be useful for clinical applications and in silico simulation.

Improved dynamic functional connectivity estimation with an alternating hidden Markov model

Dynamic functional connectivity (DFC) analysis has been widely applied to functional magnetic resonance imaging (fMRI) data to reveal the time-varying functional interactions between brain regions. Although the sliding window (SW) method is popular for DFC analysis, the selection of window length is hard, and the temporal resolution is limited by the window length. The hidden Markov model (HMM) without the limitation of window length has been proven to be able to estimate time-varying brain states from fMRI data. However, HMM tends to be overfitted in DFC analysis of fMRI data because of the high spatial dimension and the limited sample size of fMRI data. In this study, we proposed an alternating HMM (aHMM) method that used the functional connectivity estimation of SW to initialize the covariance matrix of HMM and adopted an alternating HMM procedure to reduce the number of parameters during each optimization. The simulated and real fMRI resting data from the Human Connectome Projects showed that aHMM produced better robustness to noise, parameter number and sample size in DFC estimation than SW and HMM. For the real fMRI resting data of cerebral small vessel disease (CSVD), results of aHMM revealed that amnesia and mild cognitive impairment (aMCI) caused the CSVD with aMCI (CSVD-aMCI) group tended to spend more time on the brain state with overall weak connections and less time on the state with overall strong connections than the CSVD-controls. Moreover, CSVD-aMCI showed significantly lower connectivity amplitude and higher connectivity fluctuation than CSVD-control. In contrast, HMM did not detect intergroup differences of the connectivity amplitude and fluctuations and SW did not detect intergroup differences of connectivity fluctuations and fraction of time. The results further indicated that aHMM outperformed HMM and SW in detecting inter-group differences of temporal properties of DFC and connectivity fluctuations.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09874-3.

A Novel Method for Multi-subject fMRI Data Analysis: Independent Component Analysis with Clustering Embedded (ICA-CE)

The analysis of multi-subject functional magnetic resonance imaging (fMRI) data and the extraction of accurate brain functional networks (FNs) are of great importance. However, traditional independent component analysis (ICA) methods perform analysis on multi-subject fMRI data under the condition of known or assumed classes of subjects, which may decrease its ability to extract accurate individual brain FNs. Although a previous method named clusterwise ICA (C-ICA) clusters subjects and obtains shared FNs in group-level for each class, its clustering performance on complex data is not ideal. To address the issues, we propose a novel method called independent component analysis with clustering embedded (ICA-CE) that can achieve both the estimation of individual FNs and the clustering of subjects in an unsupervised or semi-supervised manner. Using the simulated data with different properties, ICA-CE achieved better clustering performance than group ICA followed by K-means and C-ICA, and the mean accuracy of extracted individual FNs obtained by ICA-CE was greater than 90%. Using the task-related fMRI data from Human Connectome Project (HCP), our method also achieved higher clustering accuracy, while extracting task-related class-specific FNs. In summary, ICA-CE is effective in estimating accurate brain FNs while achieving the clustering of multiple subjects.Clinical Relevance- Our method is promising in estimating accurate brain functional networks for patients with brain disorders and outputting related class label for each subject.

Static and dynamic functional connectomes represent largely similar information

Functional connectivity (FC) of blood-oxygen-level-dependent (BOLD) fMRI time series can be estimated using methods that differ in sensitivity to the temporal order of time points (static vs. dynamic) and the number of regions considered in estimating a single edge (bivariate vs. multivariate). Previous research suggests that dynamic FC explains variability in FC fluctuations and behavior beyond static FC. Our aim was to systematically compare methods on both dimensions. We compared five FC methods: Pearson's/full correlation (static, bivariate), lagged correlation (dynamic, bivariate), partial correlation (static, multivariate) and multivariate AR model with and without self-connections (dynamic, multivariate). We compared these methods by (i) assessing similarities between FC matrices, (ii) by comparing node centrality measures, and (iii) by comparing the patterns of brain-behavior associations. Although FC estimates did not differ as a function of sensitivity to temporal order, we observed differences between the multivariate and bivariate FC methods. The dynamic FC estimates were highly correlated with the static FC estimates, especially when comparing group-level FC matrices. Similarly, there were high correlations between the patterns of brain-behavior associations obtained using the dynamic and static FC methods. We conclude that the dynamic FC estimates represent information largely similar to that of the static FC.

Characterizing spatiotemporal population receptive fields in human visual cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants. We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (i) from early to later areas within a visual stream, spatial and temporal integration windows of pRFs progressively increase in size and show greater compressive nonlinearities, (ii) later visual areas show diverging spatial and temporal integration windows across streams, and (iii) within early visual areas (V1-V3), both spatial and temporal integration windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses in the human brain using fMRI.

Processing negative emotion in two languages of bilinguals: Accommodation and assimilation of the neural pathways based on a meta-analysis

Numerous functional magnetic resonance imaging (fMRI) studies have examined the neural mechanisms of negative emotional words, but scarce evidence is available for the interactions among related brain regions from the functional brain connectivity perspective. Moreover, few studies have addressed the neural networks for negative word processing in bilinguals. To fill this gap, the current study examined the brain networks for processing negative words in the first language (L1) and the second language (L2) with Chinese-English bilinguals. To identify objective indicators associated with negative word processing, we first conducted a coordinate-based meta-analysis on contrasts between negative and neutral words (including 32 contrasts from 1589 participants) using the activation likelihood estimation method. Results showed that the left medial prefrontal cortex (mPFC), the left inferior frontal gyrus (IFG), the left posterior cingulate cortex (PCC), the left amygdala, the left inferior temporal gyrus (ITG), and the left thalamus were involved in processing negative words. Next, these six clusters were used as regions of interest in effective connectivity analyses using extended unified structural equation modeling to pinpoint the brain networks for bilingual negative word processing. Brain network results revealed two pathways for negative word processing in L1: a dorsal pathway consisting of the left IFG, the left mPFC, and the left PCC, and a ventral pathway involving the left amygdala, the left ITG, and the left thalamus. We further investigated the similarity and difference between brain networks for negative word processing in L1 and L2. The findings revealed similarities in the dorsal pathway, as well as differences primarily in the ventral pathway, indicating both neural assimilation and accommodation across processing negative emotion in two languages of bilinguals.

Reliability and clinical utility of spatially constrained estimates of intrinsic functional networks from very short fMRI scans

Resting-state functional network connectivity (rsFNC) has shown utility for identifying characteristic functional brain patterns in individuals with psychiatric and mood disorders, providing a promising avenue for biomarker development. However, several factors have precluded widespread clinical adoption of rsFNC diagnostics, namely a lack of standardized approaches for capturing comparable and reproducible imaging markers across individuals, as well as the disagreement on the amount of data required to robustly detect intrinsic connectivity networks (ICNs) and diagnostically relevant patterns of rsFNC at the individual subject level. Recently, spatially constrained independent component analysis (scICA) has been proposed as an automated method for extracting ICNs standardized to a chosen network template while still preserving individual variation. Leveraging the scICA methodology, which solves the former challenge of standardized neuroimaging markers, we investigate the latter challenge of identifying a minimally sufficient data length for clinical applications of resting-state fMRI (rsfMRI). Using a dataset containing rsfMRI scans of individuals with schizophrenia and controls (M = 310) as well as simulated rsfMRI, we evaluated the robustness of ICN and rsFNC estimates at both the subject- and group-level, as well as the performance of diagnostic classification, with respect to the length of the rsfMRI time course. We found individual estimates of ICNs and rsFNC from the full-length (5 min) reference time course were sufficiently approximated with just 3-3.5 min of data (r = 0.85, 0.88, respectively), and significant differences in group-average rsFNC could be sufficiently approximated with even less data, just 2 min (r = 0.86). These results from the shorter clinical data were largely consistent with the results from validation experiments using longer time series from both simulated (30 min) and real-world (14 min) datasets, in which estimates of subject-level FNC were reliably estimated with 3-5 min of data. Moreover, in the real-world data we found rsFNC and ICN estimates generated across the full range of data lengths (0.5-14 min) more reliably matched those generated from the first 5 min of scan time than those generated from the last 5 min, suggesting increased influence of "late scan" noise factors such as fatigue or drowsiness may limit the reliability of FNC from data collected after 10+ min of scan time, further supporting the notion of shorter scans. Lastly, a diagnostic classification model trained on just 2 min of data retained 97%-98% classification accuracy relative to that of the full-length reference model. Our results suggest that, when decomposed with scICA, rsfMRI scans of just 2-5 min show good clinical utility without significant loss of individual FNC information of longer scan lengths.

Computing personalized brain functional networks from fMRI using self-supervised deep learning

A novel self-supervised deep learning (DL) method is developed to compute personalized brain functional networks (FNs) for characterizing brain functional neuroanatomy based on functional MRI (fMRI). Specifically, a DL model of convolutional neural networks with an encoder-decoder architecture is developed to compute personalized FNs directly from fMRI data. The DL model is trained to optimize functional homogeneity of personalized FNs without utilizing any external supervision in an end-to-end fashion. We demonstrate that a DL model trained on fMRI scans from the Human Connectome Project can identify personalized FNs and generalizes well across four different datasets. We further demonstrate that the identified personalized FNs are informative for predicting individual differences in behavior, brain development, and schizophrenia status. Taken together, the self-supervised DL allows for rapid, generalizable computation of personalized FNs.

Estimation of neuronal task information in fMRI using zero frequency resonator

In functional magnetic resonance imaging (fMRI), temporal onsets of BOLD events contain crucial information on activity-inducing signals and make a significant impact in the analysis of functional connectivity (FC). In literature, the estimation of the onsets of the BOLD events from the acquired blood oxygen level-dependent (BOLD) signal using fMRI is mostly performed by choosing locations with a high value of the BOLD signal. This approach may give false onset points because it can incorporate redundant onsets which could be due to non-neuronal activity or can exclude true low-valued BOLD signals. In this study, we present a novel approach to estimating the temporal onsets of the BOLD events using a zero frequency resonator (ZFR) without necessitating information regarding the experimental paradigm (EP). The proposed approach exploits the impulse-like characteristic of activity-inducing signal to estimate the temporal onset points of BOLD events using ZFR which has been widely studied in the area of speech signal processing to estimate the glottal closure instances. The idea behind the approach is that an ideal neuronal impulse has, in principle, equal energy at all frequencies, including around the zero frequency, and will preserve the information of the temporal onsets of the BOLD events at its output. The ZFR-based approach estimates two important features, namely: 1) task-induced temporal onsets of the BOLD events in the fMRI time course and 2) high SNR (HSNR) regions around the estimated BOLD events. Both the estimated features are used to obtain the FC. Results are demonstrated using both the synthetic and experimental (event-related finger tapping and block design working memory) data. We show that a small number of plausible time points, estimated by ZFR, can convey sufficient information indicating the associated activation pattern. The method also illustrates its significance over the conventional correlation and threshold-based conditional rate analysis to estimate FC. The study demonstrates that ZFR-estimated BOLD events and HSNR regions can produce sufficient functionality of the brain in the task paradigm.

Bayesian Spatial Blind Source Separation via the Thresholded Gaussian Process

Blind source separation (BSS) aims to separate latent source signals from their mixtures. For spatially dependent signals in high dimensional and large-scale data, such as neuroimaging, most existing BSS methods do not take into account the spatial dependence and the sparsity of the latent source signals. To address these major limitations, we propose a Bayesian spatial blind source separation (BSP-BSS) approach for neuroimaging data analysis. We assume the expectation of the observed images as a linear mixture of multiple sparse and piece-wise smooth latent source signals, for which we construct a new class of Bayesian nonparametric prior models by thresholding Gaussian processes. We assign the vMF priors to mixing coefficients in the model. Under some regularity conditions, we show that the proposed method has several desirable theoretical properties including the large support for the priors, the consistency of joint posterior distribution of the latent source intensity functions and the mixing coefficients, and the selection consistency on the number of latent sources. We use extensive simulation studies and an analysis of the resting-state fMRI data in the Autism Brain Imaging Data Exchange (ABIDE) study to demonstrate that BSP-BSS outperforms the existing method for separating latent brain networks and detecting activated brain activation in the latent sources.

Learning Brain Dynamics of Evolving Manifold Functional MRI Data Using Geometric-Attention Neural Network

Functional connectivities (FC) of brain network manifest remarkable geometric patterns, which is the gateway to understanding brain dynamics. In this work, we present a novel geometric-attention neural network to characterize the time-evolving brain state change from the functional neuroimages by tracking the trajectory of functional dynamics on high-dimension Riemannian manifold of symmetric positive definite (SPD) matrices. Specifically, we put the spotlight on learning the common state-specific manifold signatures that represent the underlying cognition. In this context, the driving force of our neural network is tied up with the learning of the evolution functionals on the Riemannian manifold of SPD matrix that underlies the known evolving brain states. To do so, we train a convolution neural network (CNN) on the Riemannian manifold of SPD matrices to seek for the putative low-dimension feature representations, followed by an end-to-end recurrent neural network (RNN) to yield the time-varying mapping function of SPD matrices which fits the evolutionary trajectories of the underlying states. Furthermore, we devise a geometric attention mechanism in CNN, allowing us to discover the latent geometric patterns in SPD matrices that are associated with the underlying states. Notably, our work has the potential to understand how brain function emerges behavior by investigating the geometrical patterns from functional brain networks, which is essentially a correlation matrix of neuronal activity signals. Our proposed manifold-based neural network achieves promising results in predicting brain state changes on both simulated data and task functional neuroimaging data from Human Connectome Project, which implies great applicability in neuroscience studies.

Constrained CPD of Complex-Valued Multi-Subject fMRI Data via Alternating Rank-R and Rank-1 Least Squares

Complex-valued shift-invariant canonical polyadic decomposition (CPD) under a spatial phase sparsity constraint (pcsCPD) shows excellent separation performance when applied to band-pass filtered complex-valued multi-subject fMRI data. However, some useful information may also be eliminated when using a band-pass filter to suppress unwanted noise. As such, we propose an alternating rank- R and rank-1 least squares optimization to relax the CPD model. Based upon this optimization method, we present a novel constrained CPD algorithm with temporal shift-invariance and spatial sparsity and orthonormality constraints. More specifically, four steps are conducted until convergence for each iteration of the proposed algorithm: 1) use rank- R least-squares fit under spatial phase sparsity constraint to update shared spatial maps after phase de-ambiguity; 2) use orthonormality constraint to minimize the cross-talk between shared spatial maps; 3) update the aggregating mixing matrix using rank- R least-squares fit; 4) utilize shift-invariant rank-1 least-squares on a series of rank-1 matrices reconstructed by each column of the aggregating mixing matrix to update shared time courses, and subject-specific time delays and intensities. The experimental results of simulated and actual complex-valued fMRI data show that the proposed algorithm improves the estimates for task-related sensorimotor and auditory networks, compared to pcsCPD and tensorial spatial ICA. The proposed alternating rank- R and rank-1 least squares optimization is also flexible to improve CPD-related algorithm using alternating least squares.

Using deep clustering to improve fMRI dynamic functional connectivity analysis

Dynamic functional connectivity (dFC) analysis of resting-state fMRI data is commonly performed by calculating sliding-window correlations (SWC), followed by k-means clustering in order to assign each window to a given state. Studies using synthetic data have shown that k-means performance is highly dependent on sliding window parameters and signal-to-noise ratio. Additionally, sources of heterogeneity between subjects may affect the accuracy of group-level clustering, thus affecting measurements of dFC state temporal properties such as dwell time and fractional occupancy. This may result in spurious conclusions regarding differences between groups (e.g. when comparing a clinical population to healthy controls). Therefore, is it important to quantify the ability of k-means to estimate dFC state temporal properties when applied to cohorts of multiple subjects, and to explore ways in which clustering performance can be maximised. Here, we explore the use of dimensionality reduction methods prior to clustering in order to map high-dimensional data to a lower dimensional space, providing salient features to the subsequent clustering step. We assess the use of deep autoencoders for dimensionality reduction prior to applying k-means clustering to the encoded data. We compare this deep clustering method to dimensionality reduction using principle component analysis (PCA), uniform manifold approximation and projection (UMAP), as well as applying k-means to the original feature space using either L1 or L2 distance. We provide extensive quantitative evaluation of clustering performance using synthetic datasets, representing data from multiple heterogeneous subjects. In synthetic data we find that deep clustering gives the best performance, while other approaches are often insufficient to capture temporal properties of dFC states. We then demonstrate the application of each method to real-world data from human subjects and show that the choice of dimensionality reduction method has a significant effect on group-level measurements of state temporal properties.

Discovering hidden brain network responses to naturalistic stimuli via tensor component analysis of multi-subject fMRI data

The study of brain network interactions during naturalistic stimuli facilitates a deeper understanding of human brain function. To estimate large-scale brain networks evoked with naturalistic stimuli, a tensor component analysis (TCA) based framework was used to characterize shared spatio-temporal patterns across subjects in a purely data-driven manner. In this framework, a third-order tensor is constructed from the timeseries extracted from all brain regions from a given parcellation, for all participants, with modes of the tensor corresponding to spatial distribution, time series and participants. TCA then reveals spatially and temporally shared components, i.e., evoked networks with the naturalistic stimuli, their time courses of activity and subject loadings of each component. To enhance the reproducibility of the estimation with the adaptive TCA algorithm, a novel spectral clustering method, tensor spectral clustering, was proposed and applied to evaluate the stability of the TCA algorithm. We demonstrated the effectiveness of the proposed framework via simulations and real fMRI data collected during a motor task with a traditional fMRI study design. We also applied the proposed framework to fMRI data collected during passive movie watching to illustrate how reproducible brain networks are evoked by naturalistic movie viewing.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

Spatially Constrained ICA Enables Robust Detection of Schizophrenia from Very Short Resting-state fMRI

Resting-state functional network connectivity (rsFNC) has shown utility for identifying characteristic functional brain patterns in individuals with psychiatric and mood disorders, providing a promising avenue for biomarker development. However, several factors have precluded widespread clinical adoption of rsFNC diagnostics, namely the lack of standardized approaches for capturing comparable and reproducible imaging markers across individuals, as well as the disagreement on the amount of data required to robustly detect intrinsic connectivity networks (ICNs) and diagnostically relevant patterns of rsFNC. Here, we investigate the robustness of (1) subject-specific ICNs standardized to an a priori network template via spatially constrained ICA (scICA), and (2) rsFNC differences between schizophrenia and control groups with respect to the length of the fMRI. Our results suggest clinical rsFMRI scans, when decomposed with scICA, could potentially be shortened to just 2-4 minutes without significant loss of individual rsFNC information or classification performance of longer scan lengths. Clinical Relevance - This work shows diagnostically relevant rsFNC patterns for schizophrenia can be identified from just 2-4 minutes of rsfMRI using an scICA approach. These results can influence future work in neuroimaging biomarker development.

Biclustering fMRI time series: a comparative study

BACKGROUND

The effectiveness of biclustering, simultaneous clustering of rows and columns in a data matrix, was shown in gene expression data analysis. Several researchers recognize its potentialities in other research areas. Nevertheless, the last two decades have witnessed the development of a significant number of biclustering algorithms targeting gene expression data analysis and a lack of consistent studies exploring the capacities of biclustering outside this traditional application domain.

RESULTS

This work evaluates the potential use of biclustering in fMRI time series data, targeting the Region × Time dimensions by comparing seven state-in-the-art biclustering and three traditional clustering algorithms on artificial and real data. It further proposes a methodology for biclustering evaluation beyond gene expression data analysis. The results discuss the use of different search strategies in both artificial and real fMRI time series showed the superiority of exhaustive biclustering approaches, obtaining the most homogeneous biclusters. However, their high computational costs are a challenge, and further work is needed for the efficient use of biclustering in fMRI data analysis.

CONCLUSIONS

This work pinpoints avenues for the use of biclustering in spatio-temporal data analysis, in particular neurosciences applications. The proposed evaluation methodology showed evidence of the effectiveness of biclustering in finding local patterns in fMRI time series data. Further work is needed regarding scalability to promote the application in real scenarios.

Uncovering shape signatures of resting-state functional connectivity by geometric deep learning on Riemannian manifold

Functional neural activities manifest geometric patterns, as evidenced by the evolving network topology of functional connectivities (FC) even in the resting state. In this work, we propose a novel manifold‐based geometric neural network for functional brain networks (called “Geo‐Net4Net” for short) to learn the intrinsic low‐dimensional feature representations of resting‐state brain networks on the Riemannian manifold. This tool allows us to answer the scientific question of how the spontaneous fluctuation of FC supports behavior and cognition. We deploy a set of positive maps and rectified linear unit (ReLU) layers to uncover the intrinsic low‐dimensional feature representations of functional brain networks on the Riemannian manifold taking advantage of the symmetric positive‐definite (SPD) form of the correlation matrices. Due to the lack of well‐defined ground truth in the resting state, existing learning‐based methods are limited to unsupervised methodologies. To go beyond this boundary, we propose to self‐supervise the feature representation learning of resting‐state functional networks by leveraging the task‐based counterparts occurring before and after the underlying resting state. With this extra heuristic, our Geo‐Net4Net allows us to establish a more reasonable understanding of resting‐state FCs by capturing the geometric patterns (aka. spectral/shape signature) associated with resting states on the Riemannian manifold. We have conducted extensive experiments on both simulated data and task‐based functional resonance magnetic imaging (fMRI) data from the Human Connectome Project (HCP) database, where our Geo‐Net4Net not only achieves more accurate change detection results than other state‐of‐the‐art counterpart methods but also yields ubiquitous geometric patterns that manifest putative insights into brain function.

Three-way parallel group independent component analysis: Fusion of spatial and spatiotemporal magnetic resonance imaging data

Advances in imaging acquisition techniques allow multiple imaging modalities to be collected from the same subject. Each individual modality offers limited yet unique views of the functional, structural, or dynamic temporal features of the brain. Multimodal fusion provides effective ways to leverage these complementary perspectives from multiple modalities. However, the majority of current multimodal fusion approaches involving functional magnetic resonance imaging (fMRI) are limited to 3D feature summaries that do not incorporate its rich temporal information. Thus, we propose a novel three-way parallel group independent component analysis (pGICA) fusion method that incorporates the first-level 4D fMRI data (temporal information included) by parallelizing group ICA into parallel ICA via a unified optimization framework. A new variability matrix was defined to capture subject-wise functional variability and then link it to the mixing matrices of the other two modalities. Simulation results show that the three-way pGICA provides highly accurate cross-modality linkage estimation under both weakly and strongly correlated conditions, as well as comparable source estimation under different noise levels. Results using real brain imaging data identified one linked functional-structural-diffusion component associated to differences between schizophrenia and controls. This was replicated in an independent cohort, and the identified components were also correlated with major cognitive domains. Functional network connectivity revealed visual-subcortical and default mode-cerebellum pairs that discriminate between schizophrenia and controls. Overall, both simulation and real data results support the use of three-way pGICA to identify multimodal spatiotemporal links and to pursue the study of brain disorders under a single unifying multimodal framework.

Data and model considerations for estimating time-varying functional connectivity in fMRI

•

Time-varying FC models sometimes fail to detect temporal changes in fMRI data.

•

Between-subject and within-session FC variability affect model stasis.

•

The choice of parcellation affects model stasis in real fMRI data.

•

The number of observations and free parameters per state critically affect model stasis.

Functional connectivity (FC) in the brain has been shown to exhibit subtle but reliable modulations within a session. One way of estimating time-varying FC is by using state-based models that describe fMRI time series as temporal sequences of states, each with an associated, characteristic pattern of FC. However, the estimation of these models from data sometimes fails to capture changes in a meaningful way, such that the model estimation assigns entire sessions (or the largest part of them) to a single state, therefore failing to capture within-session state modulations effectively; we refer to this phenomenon as the model becoming static, or model stasis. Here, we aim to quantify how the nature of the data and the choice of model parameters affect the model's ability to detect temporal changes in FC using both simulated fMRI time courses and resting state fMRI data. We show that large between-subject FC differences can overwhelm subtler within-session modulations, causing the model to become static. Further, the choice of parcellation can also affect the model's ability to detect temporal changes. We finally show that the model often becomes static when the number of free parameters per state that need to be estimated is high and the number of observations available for this estimation is low in comparison. Based on these findings, we derive a set of practical recommendations for time-varying FC studies, in terms of preprocessing, parcellation and complexity of the model.

BrainIAK: The Brain Imaging Analysis Kit

Functional magnetic resonance imaging (fMRI) offers a rich source of data for studying the neural basis of cognition. Here, we describe the Brain Imaging Analysis Kit (BrainIAK), an open-source, free Python package that provides computationally optimized solutions to key problems in advanced fMRI analysis. A variety of techniques are presently included in BrainIAK: intersubject correlation (ISC) and intersubject functional connectivity (ISFC), functional alignment via the shared response model (SRM), full correlation matrix analysis (FCMA), a Bayesian version of representational similarity analysis (BRSA), event segmentation using hidden Markov models, topographic factor analysis (TFA), inverted encoding models (IEMs), an fMRI data simulator that uses noise characteristics from real data (fmrisim), and some emerging methods. These techniques have been optimized to leverage the efficiencies of high-performance compute (HPC) clusters, and the same code can be seamlessly transferred from a laptop to a cluster. For each of the aforementioned techniques, we describe the data analysis problem that the technique is meant to solve and how it solves that problem; we also include an example Jupyter notebook for each technique and an annotated bibliography of papers that have used and/or described that technique. In addition to the sections describing various analysis techniques in BrainIAK, we have included sections describing the future applications of BrainIAK to real-time fMRI, tutorials that we have developed and shared online to facilitate learning the techniques in BrainIAK, computational innovations in BrainIAK, and how to contribute to BrainIAK. We hope that this manuscript helps readers to understand how BrainIAK might be useful in their research.

Enhanced design matrix for task-related fMRI data analysis

In this paper, we introduce a novel methodology for the analysis of task-related fMRI data. In particular, we propose an alternative way for constructing the design matrix, based on the newly suggested Information-Assisted Dictionary Learning (IADL) method. This technique offers an enhanced potential, within the conventional GLM framework, (a) to efficiently cope with uncertainties in the modeling of the hemodynamic response function, (b) to accommodate unmodeled brain-induced sources, beyond the task-related ones, as well as potential interfering scanner-induced artifacts, uncorrected head-motion residuals and other unmodeled physiological signals, and (c) to integrate external knowledge regarding the natural sparsity of the brain activity that is associated with both the experimental design and brain atlases. The capabilities of the proposed methodology are evaluated via a realistic synthetic fMRI-like dataset, and demonstrated using a test case of a challenging fMRI study, which verifies that the proposed approach produces substantially more consistent results compared to the standard design matrix method. A toolbox extension for SPM is also provided, to facilitate the use and reproducibility of the proposed methodology.

Early soft and flexible fusion of electroencephalography and functional magnetic resonance imaging via double coupled matrix tensor factorization for multisubject group analysis

Data fusion refers to the joint analysis of multiple datasets that provide different (e.g., complementary) views of the same task. In general, it can extract more information than separate analyses can. Jointly analyzing electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) measurements has been proved to be highly beneficial to the study of the brain function, mainly because these neuroimaging modalities have complementary spatiotemporal resolution: EEG offers good temporal resolution while fMRI is better in its spatial resolution. The EEG–fMRI fusion methods that have been reported so far ignore the underlying multiway nature of the data in at least one of the modalities and/or rely on very strong assumptions concerning the relation of the respective datasets. For example, in multisubject analysis, it is commonly assumed that the hemodynamic response function is a priori known for all subjects and/or the coupling across corresponding modes is assumed to be exact (hard). In this article, these two limitations are overcome by adopting tensor models for both modalities and by following soft and flexible coupling approaches to implement the multimodal fusion. The obtained results are compared against those of parallel independent component analysis and hard coupling alternatives, with both synthetic and real data (epilepsy and visual oddball paradigm). Our results demonstrate the clear advantage of using soft and flexible coupled tensor decompositions in scenarios that do not conform with the hard coupling assumption.

SMART (splitting-merging assisted reliable) Independent Component Analysis for Brain Functional Networks

Independent component analysis (ICA) has been widely applied to estimate brain functional networks from functional magnetic resonance imaging (fMRI) data. ICA is a data-driven approach, however, the number of components must be prespecified. Indeed, it is difficult to estimate or determine an optimal number of components in fMRI analysis. In this paper, we propose a SMART (splitting-merging assisted reliable) ICA to overcome the problem. Our method first estimates group-level components using different settings and then yields reliable components by using a splitting and merging clustering approach. Subject-specific components are obtained using our previously proposed group information guided ICA (GIG-ICA) based on reliable group-level components to estimate individual-subject independent components. Simulations with unique components for subjects showed our method extracted components with high similarity to the ground truth spatial maps (SMs). For real fMRI data, the functional networks extracted by our method showed both similarity and specificity across subjects. To sum up, our method can effectively and accurately identify subject-specific brain functional networks without a need of parameter setting.Clinical Relevance- SMART ICA automatically extracts reliable subject-specific brain functional networks that can be used for biomarker identification.

Distributional independent component analysis for diverse neuroimaging modalities

Recent advances in neuroimaging technologies have provided opportunities to acquire brain images of different modalities for studying human brain organization from both functional and structural perspectives. Analysis of images derived from various modalities involves some common goals such as dimension reduction, denoising, and feature extraction. However, since these modalities have vastly different data characteristics, the current analysis is usually performed using distinct analytical tools that are only suitable for a specific imaging modality. In this paper, we present a Distributional Independent Component Analysis (DICA) that represents a new approach that performs decomposition on the distribution level, providing a unified framework for extracting features across imaging modalities with different scales and representations. When applying DICA to fMRI images, we successfully recover well-established brain functional networks in neuroscience literature, providing empirical validation that DICA delivers neurologically relevant findings. More importantly, we discover several structural network components when applying DICA to DTI images. Through fiber tracking, we find these DICA-derived structural components correspond to several major white fiber bundles. To the best of our knowledge, this is the first time these fiber bundles are successfully identified via blind source separation on single subject DTI images. We also evaluate the performance of DICA as compared with existing ICA methods through extensive simulation studies.

Impact of inter-individual variability on the estimation of default mode network in temporal concatenation group ICA

Temporal concatenation group ICA (TC-GICA) is a widely used data-driven method to extract common functional brain networks among individuals. TC-GICA concatenates the time series of individual fMRI data and applies dimension reduction and ICA algorithms to decompose the data into group-level components. The default mode network (DMN) estimated using TC-GICA at relatively high model orders (i.e., large numbers of components) is split into multiple components. The split DMNs are topographically different from those estimated using other methods (e.g., seed-based correlation, clustering, graph theoretical analysis, and other ICA methods like gRAICAR and IVA-GL) and are inconsistent with the existing knowledge of DMN. We hypothesize that the "DMN-splitting'' phenomenon reflects the impact of inter-individual variability in data, which is propagated into the ICA decomposition via the data-concatenation step of TC-GICA. By systematically manipulating the amount of variability involved in the temporal concatenation in both simulated and several realistic datasets, we observed that as more variability was involved, the estimated DMN became less similar to the averaged functional connectivity (FC) pattern obtained using seed-based correlation analysis. The performance of the DMN estimation in TC-GICA also exhibited remarkable dependence on the model order settings. Further analyses revealed that the "DMN-splitting" in TC-GICA could be reproduced when involving large variability in the data-concatenation and performing ICA at high model orders. These results were replicated across multiple datasets and various software implementations. When applying ICA approaches that avoid temporal concatenation, such as gRAICAR and IVA-GL, to the same datasets, the estimated group-level DMN was more consistent with the seed-based FC pattern and was more robust to various model order settings. This study calls for caution when applying TC-GICA to datasets expected to have large inter-individual variability, such as pooling different experimental groups of subjects.

Detecting Task-Dependent Functional Connectivity in Group Iterative Multiple Model Estimation with Person-Specific Hemodynamic Response Functions

Introduction: Group iterative multiple model estimation (GIMME) has proven to be a reliable data-driven method to arrive at functional connectivity maps that represent associations between brain regions across time in groups and individuals. However, to date, GIMME has not been able to model time-varying task-related effects. This article introduces HRF-GIMME, an extension of GIMME that enables the modeling of the direct and modulatory effects of a task on functional magnetic resonance imaging data collected by using event-related designs. Critically, hemodynamic response function (HRF)-GIMME incorporates person-specific modeling of the HRF to accommodate known variability in onset delay and shape. Methods: After an introduction of the technical aspects of HRF-GIMME, the performance of HRF-GIMME is evaluated via both a simulation study and application to empirical data. The simulation study assesses the sensitivity and specificity of HRF-GIMME by using data simulated from one slow and two rapid event-related designs, and HRF-GIMME is then applied to two empirical data sets from similar designs to evaluate performance in recovering known neural circuitry. Results: HRF-GIMME showed high sensitivity and specificity across all simulated conditions, and it performed well in the recovery of expected relations between convolved task vectors and brain regions in both simulated and empirical data, particularly for the slow event-related design. Conclusion: Results from simulated and empirical data indicate that HRF-GIMME is a powerful new tool for obtaining directed functional connectivity maps of intrinsic and task-related connections that is able to uncover what is common across the sample as well as crucial individual-level path connections and estimates. Impact statement Group iterative multiple model estimation (GIMME) is a reliable method for creating functional connectivity maps of the connections between brain regions across time, and it is able to detect what is common across the sample and what is shared between subsets of participants, as well as individual-level path estimates. However, historically, GIMME does not model task-related effects. The novel HRF-GIMME algorithm enables the modeling of direct and modulatory task effects through individual-level estimation of the hemodynamic response function (HRF), presenting a powerful new tool for assessing task effects on functional connectivity networks in functional magnetic resonance imaging data.

Learning dynamic graph embeddings for accurate detection of cognitive state changes in functional brain networks

Mounting evidence shows that brain functions and cognitive states are dynamically changing even in the resting state rather than remaining at a single constant state. Due to the relatively small changes in BOLD (blood-oxygen-level-dependent) signals across tasks, it is difficult to detect the change of cognitive status without requiring prior knowledge of the experimental design. To address this challenge, we present a dynamic graph learning approach to generate an ensemble of subject-specific dynamic graph embeddings, which allows us to use brain networks to disentangle cognitive events more accurately than using raw BOLD signals. The backbone of our method is essentially a representation learning process for projecting BOLD signals into a latent vertex-temporal domain with the greater biological underpinning of brain activities. Specifically, the learned representation domain is jointly formed by (1) a set of harmonic waves that govern the topology of whole-brain functional connectivities and (2) a set of Fourier bases that characterize the temporal dynamics of functional changes. In this regard our dynamic graph embeddings provide a new methodology to investigate how these self-organized functional fluctuation patterns oscillate along with the evolving cognitive status. We have evaluated our proposed method on both simulated data and working memory task-based fMRI datasets, where our dynamic graph embeddings achieve higher accuracy in detecting multiple cognitive states than other state-of-the-art methods.

SS-Detect: Development and Validation of a New Strategy for Source-Based Morphometry in Multiscanner Studies

BACKGROUND AND PURPOSE

Source-based morphometry(SBM) has been used in multicenter studies pooling magnetic resonance imaging data across different scanners to advance the reproducibility of neuroscience research. In the present study, we developed an analysis strategy for Scanner-Specific Detection (SS-Detect) of SBPs in multiscanner studies, and evaluated its performance relative to a conventional strategy.

METHODS

In the first experiment, the SimTB toolbox was used to generate simulated datasets mimicking 20 different scanners with common and scanner-specific SBPs. In the second experiment, we generated one simulated SBP from empirical gray matter volume (GMV) datasets from two different scanners. Moreover, we applied two strategies to compare SBPs between schizophrenia patients' and healthy controls' GMV from two scanners.

RESULTS

The outputs of the conventional strategy were limited to whole-sample-level results across all scanners; the outputs of SS-Detect included whole-sample-level and scanner-specific results. In the first simulation experiment, SS-Detect successfully estimated all simulated SBPs, including the common and scanner-specific SBPs, whereas the conventional strategy detected only some of the whole-sample SBPs. The second simulation experiment showed that both strategies could detect the simulated SBP. Quantitative evaluations of both experiments demonstrated greater accuracy of the SS-Detect in estimating spatial SBPs and subject-specific loading parameters. In the third experiment, SS-Detect detected more significant between-group SBPs, and these SBPs corresponded with the results from voxel-based morphometry analysis, suggesting that SS-Detect has higher sensitivity in detecting between-group differences.

CONCLUSIONS

SS-Detect outperformed the conventional strategy and can be considered advantageous when SBM is applied to a multiscanner study.

Dynamic time warping outperforms Pearson correlation in detecting atypical functional connectivity in autism spectrum disorders

Resting state fMRI (rsfMRI) is frequently used to study brain function, including in clinical populations. Similarity of blood-oxygen-level-dependent (BOLD) fluctuations during rsfMRI between brain regions is thought to reflect intrinsic functional connectivity (FC), potentially due to history of coactivation. To quantify similarity, studies have almost exclusively relied on Pearson correlation, which assumes linearity and can therefore underestimate FC if the hemodynamic response function differs regionally or there is BOLD signal lag between timeseries. Here we show in three cohorts of children, adolescents and adults, with and without autism spectrum disorders (ASDs), that measuring the similarity of BOLD signal fluctuations using non-linear dynamic time warping (DTW) is more robust to global signal regression (GSR), has higher test-retest reliability and is more sensitive to task-related changes in FC. Additionally, when comparing FC between individuals with ASDs and typical controls, more group differences are detected using DTW. DTW estimates are also more related to ASD symptom severity and executive function, while Pearson correlation estimates of FC are more strongly associated with respiration during rsfMRI. Together these findings suggest that non-linear methods such as DTW improve estimation of resting state FC, particularly when studying clinical populations whose hemodynamics or neurovascular coupling may be altered compared to typical controls.

Snowball ICA: A Model Order Free Independent Component Analysis Strategy for Functional Magnetic Resonance Imaging Data

In independent component analysis (ICA), the selection of model order (i.e., number of components to be extracted) has crucial effects on functional magnetic resonance imaging (fMRI) brain network analysis. Model order selection (MOS) algorithms have been used to determine the number of estimated components. However, simulations show that even when the model order equals the number of simulated signal sources, traditional ICA algorithms may misestimate the spatial maps of the signal sources. In principle, increasing model order will consider more potential information in the estimation, and should therefore produce more accurate results. However, this strategy may not work for fMRI because large-scale networks are widely spatially distributed and thus have increased mutual information with noise. As such, conventional ICA algorithms with high model orders may not extract these components at all. This conflict makes the selection of model order a problem. We present a new strategy for model order free ICA, called Snowball ICA, that obviates these issues. The algorithm collects all information for each network from fMRI data without the limitations of network scale. Using simulations and in vivo resting-state fMRI data, our results show that component estimation using Snowball ICA is more accurate than traditional ICA. The Snowball ICA software is available at https://github.com/GHu-DUT/Snowball-ICA.

Regularized-Ncut: Robust and homogeneous functional parcellation of neonate and adult brain networks

Brain network parcellation based on resting-state functional MRI (rs-fMRI) is affected by noise, resulting in spurious small patches and decreased functional homogeneity within each network. Obtaining robust and homogeneous parcellation of neonate brain is more difficult, because neonate rs-fMRI is associated with relatively higher level of noise and no prior knowledge from a functional neonate atlas is available as spatial constraints. To meet these challenges, we developed a novel data-driven Regularized Normalized-cut (RNcut) method. RNcut is formulated by adding two regularization terms, a smoothing term using Markov random fields and a small-patch removal term, to conventional normalized-cut (Ncut) method. The RNcut and competing methods were tested with simulated datasets with known ground truth and then applied to both adult and neonate rs-fMRI datasets. Based on the parcellated networks generated by RNcut, intra-network connectivity was quantified. The test results from simulated datasets demonstrated that the RNcut method is more robust (p < 0.01) to noise and can delineate parcellated functional networks with significantly better (p < 0.01) spatial contiguity and significantly higher (p < 0.01) functional homogeneity than competing methods. Application of RNcut to neonate and adult rs-fMRI dataset revealed distinctive functional brain organization of neonate brains from that of adult brains. Collectively, we developed a novel data-driven RNcut method by integrating conventional Ncut with two regularization terms, generating robust and homogeneous functional parcellation without imposing spatial constraints. A broad range of brain network applications and analyses, especially neonate and infant brain parcellation with noisy and large sample of datasets, can potentially benefit from this RNcut method.

aNy-way Independent Component Analysis

Multimodal data fusion is a topic of great interest. Several fusion methods have been proposed to investigate coherent patterns and corresponding linkages across modalities, such as joint independent component analysis (jICA), multiset canonical correlation analysis (mCCA), mCCA+jICA, disjoint subspace using ICA (DS-ICA) and parallel ICA. JICA exploits source independence but assumes shared loading parameters. MCCA maximizes correlation linkage across modalities directly but is limited to orthogonal features. While there is no theoretical limit to the number of modalities analyzed together by jICA, mCCA, or the two-step approach mCCA+jICA, these approaches can only extract common features and require the same number of sources/components for all modalities. On the other hand, DS-ICA and parallel ICA can identify both common and distinct features but are limited to two modalities. DS-ICA assumes shared loading parameters among common features, which works well when links are strong. Parallel ICA simultaneously maximizes correlation between modalities and independence of sources, while allowing different number of sources for each modality. However, only a very limited number of modalities and linkage pairs can be optimized. To overcome these limitations, we propose aNy-way ICA, a new model to simultaneously maximize the independence of sources and correlations across modalities. aNy-way ICA combines infomax ICA and Gaussian independent vector analysis (IVA-G) via a shared weight matrix model without orthogonality constraints. Simulation results demonstrate that aNy-way ICA not only accurately recovers sources and loadings, but also the true covariance/linkage patterns, whether different modalities have the same or different number of sources. Moreover, aNy-way ICA outperforms mCCA and mCCA+jICA in terms of source and loading recovery accuracy, especially under noisy conditions.Clinical Relevance-This establishes a model for N-way data fusion of any number of modalities and linkage pairs, allowing different number of non-orthogonal sources for different modalities.

A validation framework for neuroimaging software: The case of population receptive fields

Neuroimaging software methods are complex, making it a near certainty that some implementations will contain errors. Modern computational techniques (i.e., public code and data repositories, continuous integration, containerization) enable the reproducibility of the analyses and reduce coding errors, but they do not guarantee the scientific validity of the results. It is difficult, nay impossible, for researchers to check the accuracy of software by reading the source code; ground truth test datasets are needed. Computational reproducibility means providing software so that for the same input anyone obtains the same result, right or wrong. Computational validity means obtaining the right result for the ground-truth test data. We describe a framework for validating and sharing software implementations, and we illustrate its usage with an example application: population receptive field (pRF) methods for functional MRI data. The framework is composed of three main components implemented with containerization methods to guarantee computational reproducibility. In our example pRF application, those components are: (1) synthesis of fMRI time series from ground-truth pRF parameters, (2) implementation of four public pRF analysis tools and standardization of inputs and outputs, and (3) report creation to compare the results with the ground truth parameters. The framework was useful in identifying realistic conditions that lead to imperfect parameter recovery in all four pRF implementations, that would remain undetected using classic validation methods. We provide means to mitigate these problems in future experiments. A computational validation framework supports scientific rigor and creativity, as opposed to the oft-repeated suggestion that investigators rely upon a few agreed upon packages. We hope that the framework will be helpful to validate other critical neuroimaging algorithms, as having a validation framework helps (1) developers to build new software, (2) research scientists to verify the software's accuracy, and (3) reviewers to evaluate the methods used in publications and grants.