1
|
Mayer J, Baum D, Ambellan F, von Tycowicz C. Shape-based disease grading via functional maps and graph convolutional networks with application to Alzheimer's disease. BMC Med Imaging 2024; 24:342. [PMID: 39696064 DOI: 10.1186/s12880-024-01513-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2024] [Accepted: 11/21/2024] [Indexed: 12/20/2024] Open
Abstract
Shape analysis provides methods for understanding anatomical structures extracted from medical images. However, the underlying notions of shape spaces that are frequently employed come with strict assumptions prohibiting the analysis of incomplete and/or topologically varying shapes. This work aims to alleviate these limitations by adapting the concept of functional maps. Further, we present a graph-based learning approach for morphometric classification of disease states that uses novel shape descriptors based on this concept. We demonstrate the performance of the derived classifier on the open-access ADNI database differentiating normal controls and subjects with Alzheimer's disease. Notably, the experiments show that our approach can improve over state-of-the-art from geometric deep learning.
Collapse
Affiliation(s)
- Julius Mayer
- Visual and Data-centric Computing, Zuse Institute Berlin, Takustraße 7, Berlin, 14195, Berlin, Germany.
| | - Daniel Baum
- Visual and Data-centric Computing, Zuse Institute Berlin, Takustraße 7, Berlin, 14195, Berlin, Germany
| | - Felix Ambellan
- Visual and Data-centric Computing, Zuse Institute Berlin, Takustraße 7, Berlin, 14195, Berlin, Germany
| | - Christoph von Tycowicz
- Visual and Data-centric Computing, Zuse Institute Berlin, Takustraße 7, Berlin, 14195, Berlin, Germany
| |
Collapse
|
2
|
Duan P, Dvornek NC, Wang J, Eilbott J, Du Y, Sukhodolsky DG, Duncan JS. SPECTRAL BRAIN GRAPH NEURAL NETWORK FOR PREDICTION OF ANXIETY IN CHILDREN WITH AUTISM SPECTRUM DISORDER. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2024; 2024:10.1109/isbi56570.2024.10635753. [PMID: 39697611 PMCID: PMC11655121 DOI: 10.1109/isbi56570.2024.10635753] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2024]
Abstract
Children with Autism Spectrum Disorder (ASD) frequently exhibit comorbid anxiety, which contributes to impairment and requires treatment. Therefore, it is critical to investigate co-occurring autism and anxiety with functional imaging tools to understand the brain mechanisms of this comorbidity. Multidimensional Anxiety Scale for Children, 2nd edition (MASC-2) score is a common tool to evaluate the daily anxiety level in autistic children. Predicting MASC-2 score with Functional Magnetic Resonance Imaging (fMRI) data will help gain more insights into the brain functional networks of children with ASD complicated by anxiety. However, most of the current graph neural network (GNN) studies using fMRI only focus on graph operations but ignore the spectral features. In this paper, we explored the feasibility of using spectral features to predict the MASC-2 total scores. We proposed SpectBGNN, a graph-based network, which uses spectral features and integrates graph spectral filtering layers to extract hidden information. We experimented with multiple spectral analysis algorithms and compared the performance of the SpectBGNN model with CPM, GAT, and BrainGNN on a dataset consisting of 26 typically developing and 70 ASD children with 5-fold cross-validation. We showed that among all spectral analysis algorithms tested, using the Fast Fourier Transform (FFT) or Welch's Power Spectrum Density (PSD) as node features performs significantly better than correlation features, and adding the graph spectral filtering layer significantly increases the network's performance.
Collapse
Affiliation(s)
- Peiyu Duan
- Department of Biomedical Engineering, Yale University, USA
| | | | - Jiyao Wang
- Department of Biomedical Engineering, Yale University, USA
| | | | - Yuexi Du
- Department of Biomedical Engineering, Yale University, USA
| | | | - James S Duncan
- Department of Biomedical Engineering, Yale University, USA
| |
Collapse
|
3
|
Han S, Sun Z, Zhao K, Duan F, Caiafa CF, Zhang Y, Solé-Casals J. Early prediction of dementia using fMRI data with a graph convolutional network approach. J Neural Eng 2024; 21:016013. [PMID: 38215493 DOI: 10.1088/1741-2552/ad1e22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 01/12/2024] [Indexed: 01/14/2024]
Abstract
Objective. Alzheimer's disease is a progressive neurodegenerative dementia that poses a significant global health threat. It is imperative and essential to detect patients in the mild cognitive impairment (MCI) stage or even earlier, enabling effective interventions to prevent further deterioration of dementia. This study focuses on the early prediction of dementia utilizing Magnetic Resonance Imaging (MRI) data, using the proposed Graph Convolutional Networks (GCNs).Approach. Specifically, we developed a functional connectivity (FC) based GCN framework for binary classifications using resting-state fMRI data. We explored different types and processing methods of FC and evaluated the performance on the OASIS-3 dataset. We developed the GCN model for two different purposes: (1) MCI diagnosis: classifying MCI from normal controls (NCs); and (2) dementia risk prediction: classifying NCs from subjects who have the potential for developing MCI but have not been clinically diagnosed as MCI.Main results. The results of the experiments revealed several important findings: First, the proposed GCN outperformed both the baseline GCN and Support Vector Machine (SVM). It achieved the best average accuracy of 80.3% (11.7% higher than the baseline GCN and 23.5% higher than SVM) and the highest accuracy of 91.2%. Secondly, the GCN framework with (absolute) individual FC performed slightly better than that with global FC generally. However, GCN using global graphs with appropriate connectivity can achieve equivalent or superior performance to individual graphs in some cases, which highlights the significance of suitable connectivity for achieving performance. Additionally, the results indicate that the self-network connectivity of specific brain network regions (such as default mode network, visual network, ventral attention network and somatomotor network) may play a more significant role in GCN classification.Significance. Overall, this study offers valuable insights into the application of GCNs in brain analysis and early diagnosis of dementia. This contributes significantly to the understanding of MCI and has substantial potential for clinical applications in early diagnosis and intervention for dementia and other neurodegenerative diseases. Our code for GCN implementation is available at:https://github.com/Shuning-Han/FC-based-GCN.
Collapse
Affiliation(s)
- Shuning Han
- Data and Signal Processing Research Group, University of Vic-Central University of Catalonia, Vic 08500, Catalonia, Spain
- Image Processing Research Group, RIKEN Center for Advanced Photonics, RIKEN, Wako-Shi, Saitama, Japan
| | - Zhe Sun
- Faculty of Health Data Science, Juntendo University, Urayasu, Chiba, Japan
| | - Kanhao Zhao
- Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, United States of America
| | - Feng Duan
- Tianjin Key Laboratory of Brain Science and Intelligent Rehabilitation, Nankai University, Tianjin, People's Republic of China
| | - Cesar F Caiafa
- Instituto Argentino de Radioastronomía-CCT La Plata, CONICET / CIC-PBA / UNLP, V. Elisa 1894, Argentina
- Tensor Learning Team, Riken AIP, Tokyo, Tokyo 103-0027, Japan
| | - Yu Zhang
- Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, United States of America
- Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, United States of America
| | - Jordi Solé-Casals
- Data and Signal Processing Research Group, University of Vic-Central University of Catalonia, Vic 08500, Catalonia, Spain
- Department of Psychiatry, University of Cambridge, Cambridge CB20SZ, United Kingdom
| |
Collapse
|
4
|
Coupeau P, Démas J, Fasquel JB, Hertz-Pannier L, Chabrier S, Dinomais M. Hand function after neonatal stroke: A graph model based on basal ganglia and thalami structure. Neuroimage Clin 2024; 41:103568. [PMID: 38277807 PMCID: PMC10832504 DOI: 10.1016/j.nicl.2024.103568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 01/18/2024] [Accepted: 01/18/2024] [Indexed: 01/28/2024]
Abstract
INTRODUCTION Neonatal arterial ischemic stroke (NAIS) is a common model to study the impact of a unilateral early brain insult on developmental brain plasticity and the appearance of long-term outcomes. Motor difficulties that may arise are typically related to poor function of the affected (contra-lesioned) hand, but surprisingly also of the ipsilesional hand. Although many longitudinal studies after NAIS have shown that predicting the occurrence of gross motor difficulties is easier, accurately predicting hand motor function (for both hands) from morphometric MRI remains complicated. The hypothesis of an association between the structural organization of the basal ganglia (BG) and thalamus with hand motor function seems intuitive given their key role in sensorimotor function. Neuroimaging studies have frequently investigated these structures to evaluate the correlation between their volumes and motor function following early brain injury. However, the results have been controversial. We hypothesize the involvement of other structural parameters. METHOD The study involves 35 children (mean age 7.3 years, SD 0.4) with middle cerebral artery NAIS who underwent a structural T1-weighted 3D MRI and clinical examination to assess manual dexterity using the Box and Blocks Test (BBT). Graphs are used to represent high-level structural information of the BG and thalami (volumes, elongations, distances) measured from the MRI. A graph neural network (GNN) is proposed to predict children's hand motor function through a graph regression. To reduce the impact of external factors on motor function (such as behavior and cognition), we calculate a BBT score ratio for each child and hand. RESULTS The results indicate a significant correlation between the score ratios predicted by our method and the actual score ratios of both hands (p < 0.05), together with a relatively high accuracy of prediction (mean L1 distance < 0.03). The structural information seems to have a different influence on each hand's motor function. The affected hand's motor function is more correlated with the volume, while the 'unaffected' hand function is more correlated with the elongation of the structures. Experiments emphasize the importance of considering the whole macrostructural organization of the basal ganglia and thalami networks, rather than the volume alone, to predict hand motor function. CONCLUSION There is a significant correlation between the structural characteristics of the basal ganglia/thalami and motor function in both hands. These results support the use of MRI macrostructural features of the basal ganglia and thalamus as an early biomarker for predicting motor function in both hands after early brain injury.
Collapse
Affiliation(s)
- Patty Coupeau
- Université d'Angers, LARIS, SFR MATHSTIC, F-49000 Angers, France.
| | - Josselin Démas
- Université d'Angers, LARIS, SFR MATHSTIC, F-49000 Angers, France; Instituts de Formation, CH Laval, France
| | | | - Lucie Hertz-Pannier
- UNIACT/Neurospin/JOLIOT/DRF/CEA-Saclay, and U1141 NeuroDiderot/Inserm, CEA, Paris University, France
| | - Stéphane Chabrier
- French Centre for Pediatric Stroke, Pediatric Physical and Rehabilitation Medicine Department, Saint-Etienne University Hospital, France
| | - Mickael Dinomais
- Université d'Angers, LARIS, SFR MATHSTIC, F-49000 Angers, France; Department of Physical and Rehabilitation Medicine, University Hospital, CHU Angers, France
| |
Collapse
|
5
|
Nerrise F, Zhao Q, Poston KL, Pohl KM, Adeli E. An Explainable Geometric-Weighted Graph Attention Network for Identifying Functional Networks Associated with Gait Impairment. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2023; 14221:723-733. [PMID: 37982132 PMCID: PMC10657737 DOI: 10.1007/978-3-031-43895-0_68] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/21/2023]
Abstract
One of the hallmark symptoms of Parkinson's Disease (PD) is the progressive loss of postural reflexes, which eventually leads to gait difficulties and balance problems. Identifying disruptions in brain function associated with gait impairment could be crucial in better understanding PD motor progression, thus advancing the development of more effective and personalized therapeutics. In this work, we present an explainable, geometric, weighted-graph attention neural network (xGW-GAT) to identify functional networks predictive of the progression of gait difficulties in individuals with PD. xGW-GAT predicts the multi-class gait impairment on the MDS-Unified PD Rating Scale (MDS-UPDRS). Our computational- and data-efficient model represents functional connectomes as symmetric positive definite (SPD) matrices on a Riemannian manifold to explicitly encode pairwise interactions of entire connectomes, based on which we learn an attention mask yielding individual- and group-level explainability. Applied to our resting-state functional MRI (rs-fMRI) dataset of individuals with PD, xGW-GAT identifies functional connectivity patterns associated with gait impairment in PD and offers interpretable explanations of functional subnetworks associated with motor impairment. Our model successfully outperforms several existing methods while simultaneously revealing clinically-relevant connectivity patterns. The source code is available at https://github.com/favour-nerrise/xGW-GAT.
Collapse
Affiliation(s)
- Favour Nerrise
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Qingyu Zhao
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Kathleen L Poston
- Department of Neurology and Neurological Sciences, Stanford University, Stanford, CA, USA
| | - Kilian M Pohl
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Ehsan Adeli
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA
| |
Collapse
|
6
|
Nerrise F, Zhao Q, Poston KL, Pohl KM, Adeli E. An Explainable Geometric-Weighted Graph Attention Network for Identifying Functional Networks Associated with Gait Impairment. ARXIV 2023:arXiv:2307.13108v1. [PMID: 37547656 PMCID: PMC10402187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
One of the hallmark symptoms of Parkinson's Disease (PD) is the progressive loss of postural reflexes, which eventually leads to gait difficulties and balance problems. Identifying disruptions in brain function associated with gait impairment could be crucial in better understanding PD motor progression, thus advancing the development of more effective and personalized therapeutics. In this work, we present an explainable, geometric, weighted-graph attention neural network (xGW-GAT) to identify functional networks predictive of the progression of gait difficulties in individuals with PD. xGW-GAT predicts the multi-class gait impairment on the MDS-Unified PD Rating Scale (MDS-UPDRS). Our computational- and data-efficient model represents functional connectomes as symmetric positive definite (SPD) matrices on a Riemannian manifold to explicitly encode pairwise interactions of entire connectomes, based on which we learn an attention mask yielding individual- and group-level explain-ability. Applied to our resting-state functional MRI (rs-fMRI) dataset of individuals with PD, xGW-GAT identifies functional connectivity patterns associated with gait impairment in PD and offers interpretable explanations of functional subnetworks associated with motor impairment. Our model successfully outperforms several existing methods while simultaneously revealing clinically-relevant connectivity patterns. The source code is available at https://github.com/favour-nerrise/xGW-GAT.
Collapse
Affiliation(s)
- Favour Nerrise
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Qingyu Zhao
- Dept. of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Kathleen L. Poston
- Dept. of Neurology & Neurological Sciences, Stanford University, Stanford, CA, USA
| | - Kilian M. Pohl
- Dept. of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA, USA
| | - Ehsan Adeli
- Dept. of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA, USA
| |
Collapse
|
7
|
Li Y, Wei Q, Adeli E, Pohl KM, Zhao Q. Joint Graph Convolution for Analyzing Brain Structural and Functional Connectome. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13431:231-240. [PMID: 36321855 PMCID: PMC9620868 DOI: 10.1007/978-3-031-16431-6_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
The white-matter (micro-)structural architecture of the brain promotes synchrony among neuronal populations, giving rise to richly patterned functional connections. A fundamental problem for systems neuroscience is determining the best way to relate structural and functional networks quantified by diffusion tensor imaging and resting-state functional MRI. As one of the state-of-the-art approaches for network analysis, graph convolutional networks (GCN) have been separately used to analyze functional and structural networks, but have not been applied to explore inter-network relationships. In this work, we propose to couple the two networks of an individual by adding inter-network edges between corresponding brain regions, so that the joint structure-function graph can be directly analyzed by a single GCN. The weights of inter-network edges are learnable, reflecting non-uniform structure-function coupling strength across the brain. We apply our Joint-GCN to predict age and sex of 662 participants from the public dataset of the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) based on their functional and micro-structural white-matter networks. Our results support that the proposed Joint-GCN outperforms existing multi-modal graph learning approaches for analyzing structural and functional networks.
Collapse
Affiliation(s)
- Yueting Li
- Stanford University, Stanford, CA 94305, USA
| | - Qingyue Wei
- Stanford University, Stanford, CA 94305, USA
| | - Ehsan Adeli
- Stanford University, Stanford, CA 94305, USA
| | - Kilian M Pohl
- Stanford University, Stanford, CA 94305, USA
- SRI International, Menlo Park, CA 94025, USA
| | - Qingyu Zhao
- Stanford University, Stanford, CA 94305, USA
| |
Collapse
|