Extraction of Time-Varying Spatiotemporal Networks Using Parameter-Tuned Constrained IVA

Searching Reproducible Brain Features using NeuroMark: Templates for Different Age Populations and Imaging Modalities

A primary challenge to the data-driven analysis is the balance between poor generalizability of population-based research and characterizing more subject-, study- and population-specific variability. We previously introduced a fully automated spatially constrained independent component analysis (ICA) framework called NeuroMark and its functional MRI (fMRI) template. NeuroMark has been successfully applied in numerous studies, identifying brain markers reproducible across datasets and disorders. The first NeuroMark template was constructed based on young adult cohorts. We recently expanded on this initiative by creating a standardized normative multi-spatial-scale functional template using over 100,000 subjects, aiming to improve generalizability and comparability across studies involving diverse cohorts. While a unified template across the lifespan is desirable, a comprehensive investigation of the similarities and differences between components from different age populations might help systematically transform our understanding of the human brain by revealing the most well-replicated and variable network features throughout the lifespan. In this work, we introduced two significant expansions of NeuroMark templates first by generating replicable fMRI templates for infants, adolescents, and aging cohorts, and second by incorporating structural MRI (sMRI) and diffusion MRI (dMRI) modalities. Specifically, we built spatiotemporal fMRI templates based on 6,000 resting-state scans from four datasets. This is the first attempt to create robust ICA templates covering dynamic brain development across the lifespan. For the sMRI and dMRI data, we used two large publicly available datasets including more than 30,000 scans to build reliable templates. We employed a spatial similarity analysis to identify replicable templates and investigate the degree to which unique and similar patterns are reflective in different age populations. Our results suggest remarkably high similarity of the resulting adapted components, even across extreme age differences. With the new templates, the NeuroMark framework allows us to perform age-specific adaptations and to capture features adaptable to each modality, therefore facilitating biomarker identification across brain disorders. In sum, the present work demonstrates the generalizability of NeuroMark templates and suggests the potential of new templates to boost accuracy in mental health research and advance our understanding of lifespan and cross-modal alterations.

Dynamic functional network connectivity analysis in schizophrenia based on a spatiotemporal CPD framework

Objective.Dynamic functional network connectivity (dFNC), based on data-driven group independent component (IC) analysis, is an important avenue for investigating underlying patterns of certain brain diseases such as schizophrenia. Canonical polyadic decomposition (CPD) of a higher-way dynamic functional connectivity tensor, can offer an innovative spatiotemporal framework to accurately characterize potential dynamic spatial and temporal fluctuations. Since multi-subject dFNC data from sliding-window analysis are also naturally a higher-order tensor, we propose an innovative sparse and low-rank CPD (SLRCPD) for the three-way dFNC tensor to excavate significant dynamic spatiotemporal aberrant changes in schizophrenia.Approach.The proposed SLRCPD approach imposes two constraints. First, the L1regularization on spatial modules is applied to extract sparse but significant dynamic connectivity and avoid overfitting the model. Second, low-rank constraint is added on time-varying weights to enhance the temporal state clustering quality. Shared dynamic spatial modules, group-specific dynamic spatial modules and time-varying weights can be extracted by SLRCPD. The strength of connections within- and between-IC networks and connection contribution are proposed to inspect the spatial modules. K-means clustering and classification are further conducted to explore temporal group difference.Main results.82 subject resting-state functional magnetic resonance imaging (fMRI) dataset and opening Center for Biomedical Research Excellence (COBRE) schizophrenia dataset both containing schizophrenia patients (SZs) and healthy controls (HCs) were utilized in our work. Three typical dFNC patterns between different brain functional regions were obtained. Compared to the spatial modules of HCs, the aberrant connections among auditory network, somatomotor, visual, cognitive control and cerebellar networks in 82 subject dataset and COBRE dataset were detected. Four temporal states reveal significant differences between SZs and HCs for these two datasets. Additionally, the accuracy values for SZs and HCs classification based on time-varying weights are larger than 0.96.Significance.This study significantly excavates spatio-temporal patterns for schizophrenia disease.

A Scalable Approach to Independent Vector Analysis by Shared Subspace Separation for Multi-Subject fMRI Analysis

Joint blind source separation (JBSS) has wide applications in modeling latent structures across multiple related datasets. However, JBSS is computationally prohibitive with high-dimensional data, limiting the number of datasets that can be included in a tractable analysis. Furthermore, JBSS may not be effective if the data's true latent dimensionality is not adequately modeled, where severe overparameterization may lead to poor separation and time performance. In this paper, we propose a scalable JBSS method by modeling and separating the "shared" subspace from the data. The shared subspace is defined as the subset of latent sources that exists across all datasets, represented by groups of sources that collectively form a low-rank structure. Our method first provides the efficient initialization of the independent vector analysis (IVA) with a multivariate Gaussian source prior (IVA-G) specifically designed to estimate the shared sources. Estimated sources are then evaluated regarding whether they are shared, upon which further JBSS is applied separately to the shared and non-shared sources. This provides an effective means to reduce the dimensionality of the problem, improving analyses with larger numbers of datasets. We apply our method to resting-state fMRI datasets, demonstrating that our method can achieve an excellent estimation performance with significantly reduced computational costs.

Tracing Evolving Networks Using Tensor Factorizations vs. ICA-Based Approaches

Analysis of time-evolving data is crucial to understand the functioning of dynamic systems such as the brain. For instance, analysis of functional magnetic resonance imaging (fMRI) data collected during a task may reveal spatial regions of interest, and how they evolve during the task. However, capturing underlying spatial patterns as well as their change in time is challenging. The traditional approach in fMRI data analysis is to assume that underlying spatial regions of interest are static. In this article, using fractional amplitude of low-frequency fluctuations (fALFF) as an effective way to summarize the variability in fMRI data collected during a task, we arrange time-evolving fMRI data as a subjects by voxels by time windows tensor, and analyze the tensor using a tensor factorization-based approach called a PARAFAC2 model to reveal spatial dynamics. The PARAFAC2 model jointly analyzes data from multiple time windows revealing subject-mode patterns, evolving spatial regions (also referred to as networks) and temporal patterns. We compare the PARAFAC2 model with matrix factorization-based approaches relying on independent components, namely, joint independent component analysis (ICA) and independent vector analysis (IVA), commonly used in neuroimaging data analysis. We assess the performance of the methods in terms of capturing evolving networks through extensive numerical experiments demonstrating their modeling assumptions. In particular, we show that (i) PARAFAC2 provides a compact representation in all modes, i.e., subjects, time, and voxels, revealing temporal patterns as well as evolving spatial networks, (ii) joint ICA is as effective as PARAFAC2 in terms of revealing evolving networks but does not reveal temporal patterns, (iii) IVA's performance depends on sample size, data distribution and covariance structure of underlying networks. When these assumptions are satisfied, IVA is as accurate as the other methods, (iv) when subject-mode patterns differ from one time window to another, IVA is the most accurate. Furthermore, we analyze real fMRI data collected during a sensory motor task, and demonstrate that a component indicating statistically significant group difference between patients with schizophrenia and healthy controls is captured, which includes primary and secondary motor regions, cerebellum, and temporal lobe, revealing a meaningful spatial map and its temporal change.

Disjoint subspaces for common and distinct component analysis: Application to the fusion of multi-task FMRI data

BACKGROUND

Data-driven methods such as independent component analysis (ICA) makes very few assumptions on the data and the relationships of multiple datasets, and hence, are attractive for the fusion of medical imaging data. Two important extensions of ICA for multiset fusion are the joint ICA (jICA) and the multiset canonical correlation analysis and joint ICA (MCCA-jICA) techniques. Both approaches assume identical mixing matrices, emphasizing components that are common across the multiple datasets. However, in general, one would expect to have components that are both common across the datasets and distinct to each dataset.

NEW METHOD

We propose a general framework, disjoint subspace analysis using ICA (DS-ICA), which identifies and extracts not only the common but also the distinct components across multiple datasets. A key component of the method is the identification of these subspaces and their separation before subsequent analyses, which helps establish better model match and provides flexibility in algorithm and order choice.

COMPARISON

We compare DS-ICA with jICA and MCCA-jICA through both simulations and application to multiset functional magnetic resonance imaging (fMRI) task data collected from healthy controls as well as patients with schizophrenia.

RESULTS

The results show DS-ICA estimates more components discriminative between healthy controls and patients than jICA and MCCA-jICA, and with higher discriminatory power showing activation differences in meaningful regions. When applied to a classification framework, components estimated by DS-ICA results in higher classification performance for different dataset combinations than the other two methods.

CONCLUSION

These results demonstrate that DS-ICA is an effective method for fusion of multiple datasets.

Relationship between Dynamic Blood-Oxygen-Level-Dependent Activity and Functional Network Connectivity: Characterization of Schizophrenia Subgroups

Aim: In this work, we propose the novel use of adaptively constrained independent vector analysis (acIVA) to effectively capture the temporal and spatial properties of dynamic blood-oxygen-level-dependent (BOLD) activity (dBA), and we efficiently quantify the spatial property of dBA (sdBA). We also propose to incorporate dBA into the study of brain dynamics to gain insight into activity-connectivity co-evolution patterns. Introduction: Studies of the dynamics of the human brain using functional magnetic resonance imaging (fMRI) have enabled the identification of unique functional network connectivity (FNC) states and provided new insights into mental disorders. There is evidence showing that both BOLD activity, which is captured by fMRI, and FNC are related to mental and cognitive processes. However, a few studies have evaluated the inter-relationships of these two domains of function. Moreover, the identification of subgroups of schizophrenia has gained significant clinical importance due to a need to study the heterogeneity of schizophrenia. Methods: We design a simulation study to verify the effectiveness of acIVA and apply acIVA to the dynamic study of resting-state fMRI data collected from individuals with schizophrenia and healthy controls (HCs) to investigate the relationship between dBA and dynamic FNC (dFNC). Results: The simulation study demonstrates that acIVA accurately captures the spatial variability and provides an efficient quantification of sdBA. The fMRI analysis yields synchronized sdBA-temporal property of dBA (tdBA) patterns and shows that the dBA and dFNC are significantly correlated in the spatial domain. Using these dynamic features, we identify schizophrenia subgroups with significant differences in terms of their clinical symptoms. Conclusion: We find that brain function is abnormally organized in schizophrenia compared with HCs since there are less synchronized sdBA-tdBA patterns in schizophrenia and schizophrenia prefers a component that merges multiple brain regions. Identification of schizophrenia subgroups using dynamic features inspires the use of neuroimaging in studying the heterogeneity of disorders. Impact statement This work introduces the use of joint blind source separation for the study of brain dynamics to enable efficient quantification of the spatial property of dynamic blood-oxygen-level-dependent (BOLD) activity to provide insight into the relationship of dynamic BOLD activity and dynamic functional network connectivity. The identification of subgroups of schizophrenia using dynamic features allows the study of heterogeneity of schizophrenia, emphasizing the importance of functional magnetic resonance imaging analysis in the study of brain activity and functional connectivity to gain a better understanding of the human brain, especially the brain with a mental disorder.

Graph-theoretical analysis identifies transient spatial states of resting-state dynamic functional network connectivity and reveals dysconnectivity in schizophrenia

BACKGROUND

Dynamic functional network connectivity (dFNC) summarizes associations among time-varying brain networks and is widely used for studying dynamics. However, most previous studies compute dFNC using temporal variability while spatial variability started receiving increasing attention. It is hence desirable to investigate spatial variability and the interaction between temporal and spatial variability.

NEW METHOD

We propose to use an adaptive variant of constrained independent vector analysis to simultaneously capture temporal and spatial variability, and introduce a goal-driven scheme for addressing a key challenge in dFNC analysis---determining the number of transient states. We apply our methods to resting-state functional magnetic resonance imaging data of schizophrenia patients (SZs) and healthy controls (HCs).

RESULTS

The results show spatial variability provides more features discriminative between groups than temporal variability. A comprehensive study of graph-theoretical (GT) metrics determines the optimal number of spatial states and suggests centrality as a key metric. Four networks yield significantly different levels of involvement in SZs and HCs. The high involvement of a component that relates to multiple distributed brain regions highlights dysconnectivity in SZ. One frontoparietal component and one frontal component demonstrate higher involvement in HCs, suggesting a more efficient cognitive control system relative to SZs.

COMPARISON WITH EXISTING METHODS

Spatial variability is more informative than temporal variability. The proposed goal-driven scheme determines the optimal number of states in a more interpretable way by making use of discriminative features.

CONCLUSION

GT analysis is promising in dFNC analysis as it identifies distinctive transient spatial states of dFNC and reveals unique biomedical patterns in SZs.

Dynamic Modeling of Common Brain Neural Activity in Motor Imagery Tasks

Evaluation of brain dynamics elicited by motor imagery (MI) tasks can contribute to clinical and learning applications. The multi-subject analysis is to make inferences on the group/population level about the properties of MI brain activity. However, intrinsic neurophysiological variability of neural dynamics poses a challenge for devising efficient MI systems. Here, we develop a time-frequency model for estimating the spatial relevance of common neural activity across subjects employing an introduced statistical thresholding rule. In deriving multi-subject spatial maps, we present a comparative analysis of three feature extraction methods: Common Spatial Patterns, Functional Connectivity, and Event-Related De/Synchronization. In terms of interpretability, we evaluate the effectiveness in gathering MI data from collective populations by introducing two assumptions: (i) Non-linear assessment of the similarity between multi-subject data originating the subject-level dynamics; (ii) Assessment of time-varying brain network responses according to the ranking of individual accuracy performed in distinguishing distinct motor imagery tasks (left-hand vs. right-hand). The obtained validation results indicate that the estimated collective dynamics differently reflect the flow of sensorimotor cortex activation, providing new insights into the evolution of MI responses.

Multidataset Independent Subspace Analysis With Application to Multimodal Fusion

Unsupervised latent variable models-blind source separation (BSS) especially-enjoy a strong reputation for their interpretability. But they seldom combine the rich diversity of information available in multiple datasets, even though multidatasets yield insightful joint solutions otherwise unavailable in isolation. We present a direct, principled approach to multidataset combination that takes advantage of multidimensional subspace structures. In turn, we extend BSS models to capture the underlying modes of shared and unique variability across and within datasets. Our approach leverages joint information from heterogeneous datasets in a flexible and synergistic fashion. We call this method multidataset independent subspace analysis (MISA). Methodological innovations exploiting the Kotz distribution for subspace modeling, in conjunction with a novel combinatorial optimization for evasion of local minima, enable MISA to produce a robust generalization of independent component analysis (ICA), independent vector analysis (IVA), and independent subspace analysis (ISA) in a single unified model. We highlight the utility of MISA for multimodal information fusion, including sample-poor regimes ( N = 600 ) and low signal-to-noise ratio, promoting novel applications in both unimodal and multimodal brain imaging data.

Adaptive constrained independent vector analysis: An effective solution for analysis of large-scale medical imaging data

There is a growing need for flexible methods for the analysis of large-scale functional magnetic resonance imaging (fMRI) data for the estimation of global signatures that summarize the population while preserving individual-specific traits. Independent vector analysis (IVA) is a data-driven method that jointly estimates global spatio-temporal patterns from multi-subject fMRI data, and effectively preserves subject variability. However, as we show, IVA performance is negatively affected when the number of datasets and components increases especially when there is low component correlation across the datasets. We study the problem and its relationship with respect to correlation across the datasets, and propose an effective method for addressing the issue by incorporating reference information of the estimation patterns into the formulation, as a guidance in high dimensional scenarios. Constrained IVA (cIVA) provides an efficient framework for incorporating references, however its performance depends on a user-defined constraint parameter, which enforces the association between the reference signals and estimation patterns to a fixed level. We propose adaptive cIVA (acIVA) that tunes the constraint parameter to allow flexible associations between the references and estimation patterns, and enables incorporating multiple reference signals, without enforcing inaccurate conditions. Our results indicate that acIVA can reliably estimate high-dimensional multivariate sources from large-scale simulated datasets, when compared with standard IVA. It also successfully extracts meaningful functional networks from a large-scale fMRI dataset for which standard IVA did not converge. The method also efficiently captures subject-specific information, which is demonstrated through observed gender differences in spectral power, higher spectral power in males at low frequencies and in females at high frequencies, within the motor, attention, visual and default mode networks.

Identification of Subgroup Differences Using IVA: Application to fMRI Data Fusion

In application to functional magnetic resonance imaging (fMRI) data analysis, a number of data fusion algorithms have shown success in extracting interpretable brain networks that can distinguish two groups such two populations-patients with mental disorder and the healthy controls. However, there are situations where more than two groups exist such as the fusion of multi-task fMRI data. Therefore, in this work we propose the use of IVA to effectively extract information that is able to distinguish across multiple groups when applied to data fusion. The performance of IVA is investigated using a simulated fMRI-like data. The simulation results illustrate that IVA with multivariate Laplacian distribution and second-order statistics (IVA-L-SOS) yields better performance compared to joint independent component analysis and IVA with multivariate Gaussian distribution in terms of both estimation accuracy and robustness. When applied to real multi-task fMRI data, IVA-L-SOS successfully extract task-related brain networks that are able to distinguish three tasks.

Independent vector analysis for common subspace analysis: Application to multi-subject fMRI data yields meaningful subgroups of schizophrenia

The extraction of common and distinct biomedical signatures among different populations allows for a more detailed study of the group-specific as well as distinct information of different populations. A number of subspace analysis algorithms have been developed and successfully applied to data fusion, however they are limited to joint analysis of only a couple of datasets. Since subspace analysis is very promising for analysis of multi-subject medical imaging data as well, we focus on this problem and propose a new method based on independent vector analysis (IVA) for common subspace extraction (IVA-CS) for multi-subject data analysis. IVA-CS leverages the strength of IVA in identification of a complete subspace structure across multiple datasets along with an efficient solution that uses only second-order statistics. We propose a subset analysis approach within IVA-CS to mitigate issues in estimation in IVA due to high dimensionality, both in terms of components estimated and the number of datasets. We introduce a scheme to determine a desirable size for the subset that is high enough to exploit the dependence across datasets and is not affected by the high dimensionality issue. We demonstrate the success of IVA-CS in extracting complex subset structures and apply the method to analysis of functional magnetic resonance imaging data from 179 subjects and show that it successfully identifies shared and complementary brain patterns from patients with schizophrenia (SZ) and healthy controls group. Two components with linked resting-state networks are identified to be unique to the SZ group providing evidence of functional dysconnectivity. IVA-CS also identifies subgroups of SZs that show significant differences in terms of their brain networks and clinical symptoms.

Space: A Missing Piece of the Dynamic Puzzle

There has been growing interest in studying the temporal reconfiguration of brain functional connectivity to understand the role of dynamic interaction (e.g., integration and segregation) among neuronal populations in cognitive functions. However, it is crucial to differentiate between various dynamic properties because nearly all existing dynamic connectivity studies are presented as spatiotemporally dynamic, even though they fall into different categories. As a result, variation in the spatial patterns of functional structures are not well characterized. Here, we present the concepts of spatially, temporally, and spatiotemporally dynamics and use this terminology to categorize existing approaches. We review current spatially dynamic connectivity work, emphasizing that explicit incorporation of space into dynamic analyses can expand our understanding of brain function and disorder.

Spatial Dynamic Functional Connectivity Analysis Identifies Distinctive Biomarkers in Schizophrenia

Dynamic functional network connectivity (dFNC) analysis is a widely-used to study associations between dynamic functional correlations and cognitive abilities. Traditional methods analyze time-varying association of different spatial networks while assuming that the spatial network itself is stationary. However, there has been very little work focused on voxelwise spatial variability. Exploiting the variability across both the temporal and spatial domains provide a more promising direction to obtain reliable dynamic functional patterns. However, methods for extracting time-varying spatio-temporal patterns from large-scale functional magnetic resonance imaging (fMRI) data present some challenges, such as degradation in performance with respect to increase in size of the data, estimation of the number of dynamic components, and the potential sensitivity of the resulting dFNCs to selection of the networks. In this work, we implement subsequent extraction of exemplars and dynamics using a constrained independent vector analysis, a data-driven method that efficiently estimates spatial and temporal dynamics from large-scale resting-state fMRI data. We explore the benefits of analyzing spatial dFNC (sdFNC) patterns over temporal dFNC (tdFNC) patterns in the context of differentiating healthy controls and patients with schizophrenia. Our results indicate that for resting-state fMRI data, sdFNC patterns were able to better classify patients and controls, and yield more distinguishing features compared with tdFNC patterns. We also estimate structured patterns of connectivity/states using sdFNC patterns, an area that has not been studied so far, and observe that sdFNC was able to successfully capture distinct information from healthy controls and patients with schizophrenia. In addition, sdFNC patterns were also able to identify functional patterns that associate with signs of paranoia and abnormalities in the patients group. We also observe that patients with schizophrenia tend to switch to or stay in a state corresponding to a hyperconnected brain network.