1
|
Zou A, Ji J, Lei M, Liu J, Song Y. Exploring Brain Effective Connectivity Networks Through Spatiotemporal Graph Convolutional Models. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:7871-7883. [PMID: 36399590 DOI: 10.1109/tnnls.2022.3221617] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Learning brain effective connectivity networks (ECN) from functional magnetic resonance imaging (fMRI) data has gained much attention in recent years. With the successful applications of deep learning in numerous fields, several brain ECN learning methods based on deep learning have been reported in the literature. However, current methods ignore the deep temporal features of fMRI data and fail to fully employ the spatial topological relationship between brain regions. In this article, we propose a novel method for learning brain ECN based on spatiotemporal graph convolutional models (STGCM), named STGCMEC, in which we first adopt the temporal convolutional network to extract the deep temporal features of fMRI data and utilize the graph convolutional network to update the spatial features of each brain region by aggregating information from neighborhoods, which makes the features of brain regions more discriminative. Then, based on such features of brain regions, we design a joint loss function to guide STGCMEC to learn the brain ECN, which includes a task prediction loss and a graph regularization loss. The experimental results on a simulated dataset and a real Alzheimer's disease neuroimaging initiative (ADNI) dataset show that the proposed STGCMEC is able to better learn brain ECN compared with some state-of-the-art methods.
Collapse
|
2
|
Ji J, Zou A, Liu J, Yang C, Zhang X, Song Y. A Survey on Brain Effective Connectivity Network Learning. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:1879-1899. [PMID: 34469315 DOI: 10.1109/tnnls.2021.3106299] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Human brain effective connectivity characterizes the causal effects of neural activities among different brain regions. Studies of brain effective connectivity networks (ECNs) for different populations contribute significantly to the understanding of the pathological mechanism associated with neuropsychiatric diseases and facilitate finding new brain network imaging markers for the early diagnosis and evaluation for the treatment of cerebral diseases. A deeper understanding of brain ECNs also greatly promotes brain-inspired artificial intelligence (AI) research in the context of brain-like neural networks and machine learning. Thus, how to picture and grasp deeper features of brain ECNs from functional magnetic resonance imaging (fMRI) data is currently an important and active research area of the human brain connectome. In this survey, we first show some typical applications and analyze existing challenging problems in learning brain ECNs from fMRI data. Second, we give a taxonomy of ECN learning methods from the perspective of computational science and describe some representative methods in each category. Third, we summarize commonly used evaluation metrics and conduct a performance comparison of several typical algorithms both on simulated and real datasets. Finally, we present the prospects and references for researchers engaged in learning ECNs.
Collapse
|
3
|
De Castro Martins C, Chaminade T, Cavazza M. Causal Analysis of Activity in Social Brain Areas During Human-Agent Conversation. FRONTIERS IN NEUROERGONOMICS 2022; 3:843005. [PMID: 38235459 PMCID: PMC10790851 DOI: 10.3389/fnrgo.2022.843005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Accepted: 04/11/2022] [Indexed: 01/19/2024]
Abstract
This article investigates the differences in cognitive and neural mechanisms between human-human and human-virtual agent interaction using a dataset recorded in an ecologically realistic environment. We use Convergent Cross Mapping (CCM) to investigate functional connectivity between pairs of regions involved in the framework of social cognitive neuroscience, namely the fusiform gyrus, superior temporal sulcus (STS), temporoparietal junction (TPJ), and the dorsolateral prefrontal cortex (DLPFC)-taken as prefrontal asymmetry. Our approach is a compromise between investigating local activation in specific regions and investigating connectivity networks that may form part of larger networks. In addition to concording with previous studies, our results suggest that the right TPJ is one of the most reliable areas for assessing processes occurring during human-virtual agent interactions, both in a static and dynamic sense.
Collapse
Affiliation(s)
| | - Thierry Chaminade
- Institut de Neurosciences de la Timone (INT, UMR7289), Aix-Marseille University-CNRS, Marseille, France
| | | |
Collapse
|
4
|
Large-scale nonlinear Granger causality for inferring directed dependence from short multivariate time-series data. Sci Rep 2021; 11:7817. [PMID: 33837245 PMCID: PMC8035412 DOI: 10.1038/s41598-021-87316-6] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 03/23/2021] [Indexed: 11/20/2022] Open
Abstract
A key challenge to gaining insight into complex systems is inferring nonlinear causal directional relations from observational time-series data. Specifically, estimating causal relationships between interacting components in large systems with only short recordings over few temporal observations remains an important, yet unresolved problem. Here, we introduce large-scale nonlinear Granger causality (lsNGC) which facilitates conditional Granger causality between two multivariate time series conditioned on a large number of confounding time series with a small number of observations. By modeling interactions with nonlinear state-space transformations from limited observational data, lsNGC identifies casual relations with no explicit a priori assumptions on functional interdependence between component time series in a computationally efficient manner. Additionally, our method provides a mathematical formulation revealing statistical significance of inferred causal relations. We extensively study the ability of lsNGC in inferring directed relations from two-node to thirty-four node chaotic time-series systems. Our results suggest that lsNGC captures meaningful interactions from limited observational data, where it performs favorably when compared to traditionally used methods. Finally, we demonstrate the applicability of lsNGC to estimating causality in large, real-world systems by inferring directional nonlinear, causal relationships among a large number of relatively short time series acquired from functional Magnetic Resonance Imaging (fMRI) data of the human brain.
Collapse
|
5
|
Hall SA, Lalee Z, Bell RP, Towe SL, Meade CS. Synergistic effects of HIV and marijuana use on functional brain network organization. Prog Neuropsychopharmacol Biol Psychiatry 2021; 104:110040. [PMID: 32687963 PMCID: PMC7685308 DOI: 10.1016/j.pnpbp.2020.110040] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 06/23/2020] [Accepted: 07/12/2020] [Indexed: 11/25/2022]
Abstract
HIV is associated with disruptions in cognition and brain function. Marijuana use is highly prevalent in HIV but its effects on resting brain function in HIV are unknown. Brain function can be characterized by brain activity that is correlated between regions over time, called functional connectivity. Neuropsychiatric disorders are increasingly being characterized by disruptions in such connectivity. We examined the synergistic effects of HIV and marijuana use on functional whole-brain network organization during resting state. Our sample included 78 adults who differed on HIV and marijuana status (19 with co-occurring HIV and marijuana use, 20 HIV-only, 17 marijuana-only, and 22 controls). We examined differences in local and long-range brain network organization using eight graph theoretical metrics: transitivity, local efficiency, within-module degree, modularity, global efficiency, strength, betweenness, and participation coefficient. Local and long-range connectivity were similar between the co-occurring HIV and marijuana use and control groups. In contrast, the HIV-only and marijuana-only groups were both associated with disruptions in brain network organization. These results suggest that marijuana use in HIV may normalize disruptions in brain network organization observed in persons with HIV. However, future work is needed to determine whether this normalization is suggestive of a beneficial or detrimental effect of marijuana on cognitive functioning in HIV.
Collapse
Affiliation(s)
- Shana A Hall
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC 27708, USA.
| | - Zahra Lalee
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC 27708, USA
| | - Ryan P Bell
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC 27708, USA
| | - Sheri L Towe
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC 27708, USA
| | - Christina S Meade
- Duke University School of Medicine, Department of Psychiatry & Behavioral Sciences, Durham, NC 27708, USA; Brain Imaging and Analysis Center, Duke University Medical Center, Durham, NC 27708, USA
| |
Collapse
|
6
|
Linke A, Mash L, Fong C, Kinnear M, Kohli J, Wilkinson M, Tung R, Keehn RJ, Carper R, Fishman I, Müller R.A. Dynamic time warping outperforms Pearson correlation in detecting atypical functional connectivity in autism spectrum disorders. Neuroimage 2020; 223:117383. [PMID: 32949710 PMCID: PMC9851773 DOI: 10.1016/j.neuroimage.2020.117383] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2020] [Accepted: 09/12/2020] [Indexed: 01/21/2023] Open
Abstract
Resting state fMRI (rsfMRI) is frequently used to study brain function, including in clinical populations. Similarity of blood-oxygen-level-dependent (BOLD) fluctuations during rsfMRI between brain regions is thought to reflect intrinsic functional connectivity (FC), potentially due to history of coactivation. To quantify similarity, studies have almost exclusively relied on Pearson correlation, which assumes linearity and can therefore underestimate FC if the hemodynamic response function differs regionally or there is BOLD signal lag between timeseries. Here we show in three cohorts of children, adolescents and adults, with and without autism spectrum disorders (ASDs), that measuring the similarity of BOLD signal fluctuations using non-linear dynamic time warping (DTW) is more robust to global signal regression (GSR), has higher test-retest reliability and is more sensitive to task-related changes in FC. Additionally, when comparing FC between individuals with ASDs and typical controls, more group differences are detected using DTW. DTW estimates are also more related to ASD symptom severity and executive function, while Pearson correlation estimates of FC are more strongly associated with respiration during rsfMRI. Together these findings suggest that non-linear methods such as DTW improve estimation of resting state FC, particularly when studying clinical populations whose hemodynamics or neurovascular coupling may be altered compared to typical controls.
Collapse
Affiliation(s)
- A.C. Linke
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,Corresponding author. (A.C. Linke)
| | - L.E. Mash
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - C.H. Fong
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - M.K. Kinnear
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States
| | - J.S. Kohli
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - M. Wilkinson
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - R. Tung
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States
| | - R.J. Jao Keehn
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States
| | - R.A. Carper
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - I. Fishman
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - R.-.A. Müller
- Brain Development Imaging Laboratories, Department of Psychology, San Diego State University, 6363 Alvarado Ct., Suite 200, San Diego, CA 92120, United States,San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| |
Collapse
|
7
|
Mohanty R, Sethares WA, Nair VA, Prabhakaran V. Rethinking Measures of Functional Connectivity via Feature Extraction. Sci Rep 2020; 10:1298. [PMID: 31992762 PMCID: PMC6987226 DOI: 10.1038/s41598-020-57915-w] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Accepted: 01/08/2020] [Indexed: 11/17/2022] Open
Abstract
Functional magnetic resonance imaging (fMRI)-based functional connectivity (FC) commonly characterizes the functional connections in the brain. Conventional quantification of FC by Pearson's correlation captures linear, time-domain dependencies among blood-oxygen-level-dependent (BOLD) signals. We examined measures to quantify FC by investigating: (i) Is Pearson's correlation sufficient to characterize FC? (ii) Can alternative measures better quantify FC? (iii) What are the implications of using alternative FC measures? FMRI analysis in healthy adult population suggested that: (i) Pearson's correlation cannot comprehensively capture BOLD inter-dependencies. (ii) Eight alternative FC measures were similarly consistent between task and resting-state fMRI, improved age-based classification and provided better association with behavioral outcomes. (iii) Formulated hypotheses were: first, in lieu of Pearson’s correlation, an augmented, composite and multi-metric definition of FC is more appropriate; second, canonical large-scale brain networks may depend on the chosen FC measure. A thorough notion of FC promises better understanding of variations within a given population.
Collapse
Affiliation(s)
- Rosaleena Mohanty
- Department of Radiology, University of Wisconsin-Madison, Madison, WI, USA. .,Electrical Engineering, University of Wisconsin-Madison, Madison, WI, USA. .,Karolinska Institutet, Huddinge, Sweden.
| | - William A Sethares
- Electrical Engineering, University of Wisconsin-Madison, Madison, WI, USA
| | - Veena A Nair
- Department of Radiology, University of Wisconsin-Madison, Madison, WI, USA
| | - Vivek Prabhakaran
- Department of Radiology, University of Wisconsin-Madison, Madison, WI, USA.,Department of Psychiatry, University of Wisconsin-Madison, Madison, USA.,Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
8
|
Detecting cognitive impairment in HIV-infected individuals using mutual connectivity analysis of resting state functional MRI. J Neurovirol 2020; 26:188-200. [PMID: 31912459 DOI: 10.1007/s13365-019-00823-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2019] [Revised: 10/29/2019] [Accepted: 12/03/2019] [Indexed: 01/03/2023]
Abstract
It is estimated that more than 50% of the individuals affected with Human Immunodeficiency Virus (HIV) present deficits in multiple cognitive domains, collectively known as HIV-associated neurocognitive disorder (HAND). Early stages of brain injury may be clinically silent but potentially measurable via neuroimaging. A total of 40 subjects (20 HIV positive and 20 age-matched controls) volunteered for the study. All subjects underwent a standard battery of neuropsychological tests used for the clinical diagnosis of HAND. Fourteen HIV+ and five healthy subjects showed signs of neurological impairment. Connectivity was computed using mutual connectivity analysis (MCA) with generalized radial basis function neural network, a framework for quantifying non-linear connectivity as well as conventional correlation from 160 regional time-series that were extracted based on the Dosenbach (DOS) atlas. We subsequently applied graph theoretic as well as network analysis approaches for characterizing the connectivity matrices obtained and localizing between-group differences. We focused on trying to detect cognitive impairment using the subset of 29 (14 subjects with HAND and 15 cognitively normal controls) subjects. For the global analysis, significant differences (p < 0.05) were seen in the variance in degree, modularity and Smallworldness. Regional analysis revealed changes occurring mainly in portions of the lateral occipital cortex and the cingulate cortex. Furthermore, using Network Based Statistics (NBS), we uncovered an affected sub-network of 19 nodes comprising predominantly of regions of the default mode network. Similar analysis using the conventional correlation method revealed no significant results at a global scale, while regional analysis shows some differences spread across resting state networks. These results suggest that there is a subtle reorganization occurring in the topology of brain networks in HAND, which can be captured using improved connectivity analysis.
Collapse
|
9
|
Lombardi A, Guaragnella C, Amoroso N, Monaco A, Fazio L, Taurisano P, Pergola G, Blasi G, Bertolino A, Bellotti R, Tangaro S. Modelling cognitive loads in schizophrenia by means of new functional dynamic indexes. Neuroimage 2019; 195:150-164. [DOI: 10.1016/j.neuroimage.2019.03.055] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2018] [Revised: 03/20/2019] [Accepted: 03/25/2019] [Indexed: 01/21/2023] Open
|
10
|
DSouza AM, Abidin AZ, Schifitto G, Wismüller A. A multivoxel pattern analysis framework with mutual connectivity analysis investigating changes in resting state connectivity in patients with HIV associated neurocognitve disorder. Magn Reson Imaging 2019; 62:121-128. [PMID: 31189074 DOI: 10.1016/j.mri.2019.06.001] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2018] [Revised: 05/09/2019] [Accepted: 06/02/2019] [Indexed: 01/19/2023]
Abstract
Functional MRI (fMRI) quantifies brain activity non-invasively by measuring the blood oxygen level dependent (BOLD) response to neuronal activity. It was recently demonstrated, on realistic fMRI simulations, that nonlinear connectivity approaches, such as Mutual Connectivity Analysis with Local Models (MCA-LM), are better suited for extracting connectivity measures than conventional techniques of cross-correlating time-series pairs. In this work, we investigate the application of MCA-LM in extracting meaningful connectivity measures aiding in distinguishing healthy controls from individuals presenting with symptoms of HIV Associated Neurocognitive Disorder (HAND), which occurs as a result of HIV infection of the central nervous system. The pairwise connectivity measures provide a high-dimensional representation of connectivity profiles for subjects and are used as features for classification. We adopt feature selection (FS) techniques reducing the number of redundant and noisy features, while also controlling the complexity of the classifiers. We investigate three FS techniques: 1) Kendall's τ, 2) Information Gain Attribute selection 3) ReliefF and two classifiers:1) AdaBoost and 2) Random Forests. Our results demonstrate that MCA-LM consistently outperforms correlation in terms of Area under the Receiver Operating Characteristic Curve and accuracy. Improved performance with MCA-LM suggests that such a nonlinear approach is better at capturing meaningful connectivity relationships between brain regions. This demonstrates potential for developing novel neuroimaging-derived biomarkers for HAND. Furthermore, FS helps identify connections between anatomical regions that are affected by HAND. In this work, we show that the regions of the basal ganglia and frontal cortex, which are known to be affected by HAND according to current literature, are identified as most discriminative.
Collapse
Affiliation(s)
- Adora M DSouza
- Department of Electrical Engineering, University of Rochester, Rochester, NY, USA.
| | - Anas Z Abidin
- Department of Biomedical Engineering, University of Rochester, Rochester, NY, USA
| | - Giovanni Schifitto
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA; Department of Imaging Sciences, University of Rochester, NY, USA
| | - Axel Wismüller
- Department of Electrical Engineering, University of Rochester, Rochester, NY, USA; Department of Biomedical Engineering, University of Rochester, Rochester, NY, USA; Department of Imaging Sciences, University of Rochester, NY, USA; Faculty of Medicine and Institute of Clinical Radiology, Ludwig Maximilians University, Munich, Germany
| |
Collapse
|