1
|
Jung W, Jeon E, Kang E, Suk HI. EAG-RS: A Novel Explainability-Guided ROI-Selection Framework for ASD Diagnosis via Inter-Regional Relation Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1400-1411. [PMID: 38015693 DOI: 10.1109/tmi.2023.3337362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
Deep learning models based on resting-state functional magnetic resonance imaging (rs-fMRI) have been widely used to diagnose brain diseases, particularly autism spectrum disorder (ASD). Existing studies have leveraged the functional connectivity (FC) of rs-fMRI, achieving notable classification performance. However, they have significant limitations, including the lack of adequate information while using linear low-order FC as inputs to the model, not considering individual characteristics (i.e., different symptoms or varying stages of severity) among patients with ASD, and the non-explainability of the decision process. To cover these limitations, we propose a novel explainability-guided region of interest (ROI) selection (EAG-RS) framework that identifies non-linear high-order functional associations among brain regions by leveraging an explainable artificial intelligence technique and selects class-discriminative regions for brain disease identification. The proposed framework includes three steps: (i) inter-regional relation learning to estimate non-linear relations through random seed-based network masking, (ii) explainable connection-wise relevance score estimation to explore high-order relations between functional connections, and (iii) non-linear high-order FC-based diagnosis-informative ROI selection and classifier learning to identify ASD. We validated the effectiveness of our proposed method by conducting experiments using the Autism Brain Imaging Database Exchange (ABIDE) dataset, demonstrating that the proposed method outperforms other comparative methods in terms of various evaluation metrics. Furthermore, we qualitatively analyzed the selected ROIs and identified ASD subtypes linked to previous neuroscientific studies.
Collapse
|
2
|
Porter A, Fei S, Damme KSF, Nusslock R, Gratton C, Mittal VA. A meta-analysis and systematic review of single vs. multimodal neuroimaging techniques in the classification of psychosis. Mol Psychiatry 2023; 28:3278-3292. [PMID: 37563277 PMCID: PMC10618094 DOI: 10.1038/s41380-023-02195-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 07/11/2023] [Accepted: 07/17/2023] [Indexed: 08/12/2023]
Abstract
BACKGROUND Psychotic disorders are characterized by structural and functional abnormalities in brain networks. Neuroimaging techniques map and characterize such abnormalities using unique features (e.g., structural integrity, coactivation). However, it is unclear if a specific method, or a combination of modalities, is particularly effective in identifying differences in brain networks of someone with a psychotic disorder. METHODS A systematic meta-analysis evaluated machine learning classification of schizophrenia spectrum disorders in comparison to healthy control participants using various neuroimaging modalities (i.e., T1-weighted imaging (T1), diffusion tensor imaging (DTI), resting state functional connectivity (rs-FC), or some combination (multimodal)). Criteria for manuscript inclusion included whole-brain analyses and cross-validation to provide a complete picture regarding the predictive ability of large-scale brain systems in psychosis. For this meta-analysis, we searched Ovid MEDLINE, PubMed, PsychInfo, Google Scholar, and Web of Science published between inception and March 13th 2023. Prediction results were averaged for studies using the same dataset, but parallel analyses were run that included studies with pooled sample across many datasets. We assessed bias through funnel plot asymmetry. A bivariate regression model determined whether differences in imaging modality, demographics, and preprocessing methods moderated classification. Separate models were run for studies with internal prediction (via cross-validation) and external prediction. RESULTS 93 studies were identified for quantitative review (30 T1, 9 DTI, 40 rs-FC, and 14 multimodal). As a whole, all modalities reliably differentiated those with schizophrenia spectrum disorders from controls (OR = 2.64 (95%CI = 2.33 to 2.95)). However, classification was relatively similar across modalities: no differences were seen across modalities in the classification of independent internal data, and a small advantage was seen for rs-FC studies relative to T1 studies in classification in external datasets. We found large amounts of heterogeneity across results resulting in significant signs of bias in funnel plots and Egger's tests. Results remained similar, however, when studies were restricted to those with less heterogeneity, with continued small advantages for rs-FC relative to structural measures. Notably, in all cases, no significant differences were seen between multimodal and unimodal approaches, with rs-FC and unimodal studies reporting largely overlapping classification performance. Differences in demographics and analysis or denoising were not associated with changes in classification scores. CONCLUSIONS The results of this study suggest that neuroimaging approaches have promise in the classification of psychosis. Interestingly, at present most modalities perform similarly in the classification of psychosis, with slight advantages for rs-FC relative to structural modalities in some specific cases. Notably, results differed substantially across studies, with suggestions of biased effect sizes, particularly highlighting the need for more studies using external prediction and large sample sizes. Adopting more rigorous and systematized standards will add significant value toward understanding and treating this critical population.
Collapse
Affiliation(s)
- Alexis Porter
- Department of Psychology, Northwestern University, Evanston, IL, USA.
| | - Sihan Fei
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Katherine S F Damme
- Department of Psychology, Northwestern University, Evanston, IL, USA
- Institute for Innovations in Developmental Sciences, Northwestern University, Evanston and Chicago, IL, USA
| | - Robin Nusslock
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Caterina Gratton
- Department of Psychology, Florida State University, Tallahassee, FL, USA
| | - Vijay A Mittal
- Department of Psychology, Northwestern University, Evanston, IL, USA
- Institute for Innovations in Developmental Sciences, Northwestern University, Evanston and Chicago, IL, USA
- Department of Psychiatry, Northwestern University, Chicago, IL, USA
- Medical Social Sciences, Northwestern University, Chicago, IL, USA
- Institute for Policy Research, Northwestern University, Chicago, IL, USA
| |
Collapse
|
3
|
Cui H, Dai W, Zhu Y, Kan X, Gu AAC, Lukemire J, Zhan L, He L, Guo Y, Yang C. BrainGB: A Benchmark for Brain Network Analysis With Graph Neural Networks. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:493-506. [PMID: 36318557 PMCID: PMC10079627 DOI: 10.1109/tmi.2022.3218745] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Mapping the connectome of the human brain using structural or functional connectivity has become one of the most pervasive paradigms for neuroimaging analysis. Recently, Graph Neural Networks (GNNs) motivated from geometric deep learning have attracted broad interest due to their established power for modeling complex networked data. Despite their superior performance in many fields, there has not yet been a systematic study of how to design effective GNNs for brain network analysis. To bridge this gap, we present BrainGB, a benchmark for brain network analysis with GNNs. BrainGB standardizes the process by (1) summarizing brain network construction pipelines for both functional and structural neuroimaging modalities and (2) modularizing the implementation of GNN designs. We conduct extensive experiments on datasets across cohorts and modalities and recommend a set of general recipes for effective GNN designs on brain networks. To support open and reproducible research on GNN-based brain network analysis, we host the BrainGB website at https://braingb.us with models, tutorials, examples, as well as an out-of-box Python package. We hope that this work will provide useful empirical evidence and offer insights for future research in this novel and promising direction.
Collapse
|
4
|
Wang C, Zhang L, Zhang J, Qiao L, Liu M. Fusing Multiview Functional Brain Networks by Joint Embedding for Brain Disease Identification. J Pers Med 2023; 13:jpm13020251. [PMID: 36836485 PMCID: PMC9958959 DOI: 10.3390/jpm13020251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 12/27/2022] [Accepted: 01/13/2023] [Indexed: 01/31/2023] Open
Abstract
Background: Functional brain networks (FBNs) derived from resting-state functional MRI (rs-fMRI) have shown great potential in identifying brain disorders, such as autistic spectrum disorder (ASD). Therefore, many FBN estimation methods have been proposed in recent years. Most existing methods only model the functional connections between brain regions of interest (ROIs) from a single view (e.g., by estimating FBNs through a specific strategy), failing to capture the complex interactions among ROIs in the brain. Methods: To address this problem, we propose fusion of multiview FBNs through joint embedding, which can make full use of the common information of multiview FBNs estimated by different strategies. More specifically, we first stack the adjacency matrices of FBNs estimated by different methods into a tensor and use tensor factorization to learn the joint embedding (i.e., a common factor of all FBNs) for each ROI. Then, we use Pearson's correlation to calculate the connections between each embedded ROI in order to reconstruct a new FBN. Results: Experimental results obtained on the public ABIDE dataset with rs-fMRI data reveal that our method is superior to several state-of-the-art methods in automated ASD diagnosis. Moreover, by exploring FBN "features" that contributed most to ASD identification, we discovered potential biomarkers for ASD diagnosis. The proposed framework achieves an accuracy of 74.46%, which is generally better than the compared individual FBN methods. In addition, our method achieves the best performance compared to other multinetwork methods, i.e., an accuracy improvement of at least 2.72%. Conclusions: We present a multiview FBN fusion strategy through joint embedding for fMRI-based ASD identification. The proposed fusion method has an elegant theoretical explanation from the perspective of eigenvector centrality.
Collapse
Affiliation(s)
- Chengcheng Wang
- School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Limei Zhang
- School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101, China
- Correspondence: (L.Z.); (M.L.)
| | - Jinshan Zhang
- College of Mathematics and Statistics, Sichuan University of Science and Engineering, Zigong 643000, China
| | - Lishan Qiao
- School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
- Correspondence: (L.Z.); (M.L.)
| |
Collapse
|
5
|
Sadeghi D, Shoeibi A, Ghassemi N, Moridian P, Khadem A, Alizadehsani R, Teshnehlab M, Gorriz JM, Khozeimeh F, Zhang YD, Nahavandi S, Acharya UR. An overview of artificial intelligence techniques for diagnosis of Schizophrenia based on magnetic resonance imaging modalities: Methods, challenges, and future works. Comput Biol Med 2022; 146:105554. [DOI: 10.1016/j.compbiomed.2022.105554] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 04/11/2022] [Accepted: 04/11/2022] [Indexed: 12/21/2022]
|
6
|
Hybrid High-order Brain Functional Networks for Schizophrenia-Aided Diagnosis. Cognit Comput 2022. [DOI: 10.1007/s12559-022-10014-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
7
|
Cruz-Martinez C, Reyes-Garcia CA, Vanello N. A novel event-related fMRI supervoxels-based representation and its application to schizophrenia diagnosis. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 213:106509. [PMID: 34800805 DOI: 10.1016/j.cmpb.2021.106509] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 10/29/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE The schizophrenia diagnosis represents a difficult task because of the confusing descriptions of symptoms given by the patient, their similarity among several disorders, the lower familiarity with genetic predisposition, and the probably inadequate response to the treatment. Neuro-biological markers of schizophrenia, as a quantitative relationship between the psychiatrist's reports and the biology of the brain, could be used. Functional Magnetic Resonance Imaging (fMRI) obtain the subject's performance in cognitive tasks and may find significant differences between the patient's data and controls. The input data of classifiers may imply alterations in diagnosis; therefore, it is essential to ensure an adequate representation to describe the entire dataset classified. METHODS We propose a supervoxels-based representation calculated by two main steps: the short-range connectivity, supervoxels' generation using a Fuzzy Iterative Clustering algorithm, and the long-range connectivity, employing Detrended Cross-Correlation Analysis among supervoxels. The unrelated supervoxels, through a statistical test based on critical points calculated empirically, are removed. The remainder supervoxels are the input for feature selectors to extract the discriminative supervoxels. We implement support vector machine classifiers using the correlation coefficient of the significant supervoxels. The dataset of 1.5 Tesla was downloaded from the SchizConnect site, where the fMRI data, during an auditory oddball task, was acquired. We calculate the performance of the classifiers using a leave-one-out cross-validation and compute the area under the Receiver Operating Characteristic curve and a permutation test to ensure no bias in the classifiers. RESULTS According to the permutation test, with p-values less than the significance level of 0.05, the classifiers extract discriminative class structure from data where no bias is shown. Our supervoxels-based representation gets the maximum values of sensitivity, specificity, and accuracy of 92.9%, 100%, and 96.4%, respectively. The discriminative brain regions, to discern among patients and controls, are extracted; these regions also are mentioned by the related works. CONCLUSIONS The proposed representation, based on supervoxels, is a data-driven model that does not use predefined models of the signal nor pre-relocated brain regions of interest. The results are competitive against the related works, and the relevant supervoxels are related to the schizophrenia diagnosis.
Collapse
Affiliation(s)
- Claudia Cruz-Martinez
- Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), Computer Science Department, Puebla, Mexico.
| | - Carlos A Reyes-Garcia
- Instituto Nacional de Astrofísica, Óptica y Electrónica (INAOE), Computer Science Department, Puebla, Mexico.
| | - Nicola Vanello
- University of Pisa, Department of Information Engineering, Pisa, Italy.
| |
Collapse
|
8
|
Sadiq MU, Langella S, Giovanello KS, Mucha PJ, Dayan E. Accrual of functional redundancy along the lifespan and its effects on cognition. Neuroimage 2021; 229:117737. [PMID: 33486125 PMCID: PMC8022200 DOI: 10.1016/j.neuroimage.2021.117737] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 01/04/2021] [Accepted: 01/05/2021] [Indexed: 12/01/2022] Open
Abstract
Despite the necessity to understand how the brain endures the initial stages of age-associated cognitive decline, no brain mechanism has been quantitatively specified to date. The brain may withstand the effects of cognitive aging through redundancy, a design feature in engineered and biological systems, which entails the presence of substitute elements to protect it against failure. Here, we investigated the relationship between functional network redundancy and age over the human lifespan and their interaction with cognition, analyzing resting-state functional MRI images and cognitive measures from 579 subjects. Network-wide redundancy was significantly associated with age, showing a stronger link with age than other major topological measures, presenting a pattern of accumulation followed by old-age decline. Critically, redundancy significantly mediated the association between age and executive function, with lower anti-correlation between age and cognition in subjects with high redundancy. The results suggest that functional redundancy accrues throughout the lifespan, mitigating the effects of age on cognition.
Collapse
Affiliation(s)
- Muhammad Usman Sadiq
- Biomedical Research Imaging Center (BRIC), UNC-Chapel Hill, Chapel Hill, NC 27599, United States
| | - Stephanie Langella
- Department of Psychology and Neuroscience, UNC-Chapel Hill, Chapel Hill, NC 27599, United States
| | - Kelly S Giovanello
- Biomedical Research Imaging Center (BRIC), UNC-Chapel Hill, Chapel Hill, NC 27599, United States; Department of Psychology and Neuroscience, UNC-Chapel Hill, Chapel Hill, NC 27599, United States
| | - Peter J Mucha
- Department of Mathematics, UNC-Chapel Hill, Chapel Hill, NC 27599, United States; Department of Applied Physical Sciences, UNC-Chapel Hill, Chapel Hill, NC 27599, United States
| | - Eran Dayan
- Biomedical Research Imaging Center (BRIC), UNC-Chapel Hill, Chapel Hill, NC 27599, United States; Department of Radiology, UNC-Chapel Hill, Chapel Hill, NC 27599, United States.
| |
Collapse
|
9
|
Huang J, Zhou L, Wang L, Zhang D. Attention-Diffusion-Bilinear Neural Network for Brain Network Analysis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2541-2552. [PMID: 32070948 DOI: 10.1109/tmi.2020.2973650] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Brain network provides essential insights in diagnosing many brain disorders. Integrative analysis of multiple types of connectivity, e.g, functional connectivity (FC) and structural connectivity (SC), can take advantage of their complementary information and therefore may help to identify patients. However, traditional brain network methods usually focus on either FC or SC for describing node interactions and only consider the interaction between paired network nodes. To tackle this problem, in this paper, we propose an Attention-Diffusion-Bilinear Neural Network (ADB-NN) framework for brain network analysis, which is trained in an end-to-end manner. The proposed network seamlessly couples FC and SC to learn wider node interactions and generates a joint representation of FC and SC for diagnosis. Specifically, a brain network (graph) is first defined, where each node corresponding to a brain region is governed by the features of brain activities (i.e., FC) extracted from functional magnetic resonance imaging (fMRI), and the presence of edges is determined by neural fiber physical connections (i.e., SC) extracted from Diffusion Tensor Imaging (DTI). Based on this graph, we train two Attention-Diffusion-Bilinear (ADB) modules jointly. In each module, an attention model is utilized to automatically learn the strength of node interactions. This information further guides a diffusion process that generates new node representations by considering the influence from other nodes as well. After that, the second-order statistics of these node representations are extracted by bilinear pooling to form connectivity-based features for disease prediction. The two ADB modules correspond to the one-step and two-step diffusion, respectively. Experiments on a real epilepsy dataset demonstrate the effectiveness and advantages of our proposed method.
Collapse
|