1
|
Lian J, Huang F, Huang X, Lau KYY, Ng KS, Chu CCF, Lam SC, Koohli-Moghadam M, Vardhanabhuti V. Admission blood tests predicting survival of SARS-CoV-2 infected patients: a practical implementation of graph convolution network in imbalance dataset. BMC Infect Dis 2024; 24:803. [PMID: 39123113 PMCID: PMC11313168 DOI: 10.1186/s12879-024-09699-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 08/01/2024] [Indexed: 08/12/2024] Open
Abstract
BACKGROUND Predicting an individual's risk of death from COVID-19 is essential for planning and optimising resources. However, since the real-world mortality rate is relatively low, particularly in places like Hong Kong, this makes building an accurate prediction model difficult due to the imbalanced nature of the dataset. This study introduces an innovative application of graph convolutional networks (GCNs) to predict COVID-19 patient survival using a highly imbalanced dataset. Unlike traditional models, GCNs leverage structural relationships within the data, enhancing predictive accuracy and robustness. By integrating demographic and laboratory data into a GCN framework, our approach addresses class imbalance and demonstrates significant improvements in prediction accuracy. METHODS The cohort included all consecutive positive COVID-19 patients fulfilling study criteria admitted to 42 public hospitals in Hong Kong between January 23 and December 31, 2020 (n = 7,606). We proposed the population-based graph convolutional neural network (GCN) model which took blood test results, age and sex as inputs to predict the survival outcomes. Furthermore, we compared our proposed model to the Cox Proportional Hazard (CPH) model, conventional machine learning models, and oversampling machine learning models. Additionally, a subgroup analysis was performed on the test set in order to acquire a deeper understanding of the relationship between each patient node and its neighbours, revealing possible underlying causes of the inaccurate predictions. RESULTS The GCN model was the top-performing model, with an AUC of 0.944, considerably outperforming all other models (p < 0.05), including the oversampled CPH model (0.708), linear regression (0.877), Linear Discriminant Analysis (0.860), K-nearest neighbours (0.834), Gaussian predictor (0.745) and support vector machine (0.847). With Kaplan-Meier estimates, the GCN model demonstrated good discriminability between low- and high-risk individuals (p < 0.0001). Based on subanalysis using the weighted-in score, although the GCN model was able to discriminate well between different predicted groups, the separation was inadequate between false negative (FN) and true negative (TN) groups. CONCLUSION The GCN model considerably outperformed all other machine learning methods and baseline CPH models. Thus, when applied to this imbalanced COVID survival dataset, adopting a population graph representation may be an approach to achieving good prediction.
Collapse
Affiliation(s)
- Jie Lian
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Fan Huang
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Xinhai Huang
- Faculty of Science, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Kitty Yu-Yeung Lau
- WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Kei Shing Ng
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Carlin Chun Fai Chu
- Department of Computing, The Hang Seng University of Hong Kong, Shatin, Hong Kong SAR, China
| | - Simon Ching Lam
- School of Nursing, Tung Wah College, Ho Man Tin, Hong Kong SAR, China
| | - Mohamad Koohli-Moghadam
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
| | - Varut Vardhanabhuti
- Department of Diagnostic Radiology, Li Ka Shing Faculty of Medicine, The University of Hong Kong, Pokfulam, Hong Kong SAR, China.
| |
Collapse
|
2
|
Tan X, Liu Q, Fang Y, Zhu Y, Chen F, Zeng W, Ouyang D, Dong J. Predicting Peptide Permeability Across Diverse Barriers: A Systematic Investigation. Mol Pharm 2024; 21:4116-4127. [PMID: 39031123 DOI: 10.1021/acs.molpharmaceut.4c00478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/22/2024]
Abstract
Peptide-based therapeutics hold immense promise for the treatment of various diseases. However, their effectiveness is often hampered by poor cell membrane permeability, hindering targeted intracellular delivery and oral drug development. This study addressed this challenge by introducing a novel graph neural network (GNN) framework and advanced machine learning algorithms to build predictive models for peptide permeability. Our models offer systematic evaluation across diverse peptides (natural, modified, linear and cyclic) and cell lines [Caco-2, Ralph Russ canine kidney (RRCK) and parallel artificial membrane permeability assay (PAMPA)]. The predictive models for linear and cyclic peptides in Caco-2 and RRCK cell lines were constructed for the first time, with an impressive coefficient of determination (R2) of 0.708, 0.484, 0.553, and 0.528 in the test set, respectively. Notably, the GNN framework behaved better in permeability prediction with larger data sets and improved the accuracy of cyclic peptide prediction in the PAMPA cell line. The R2 increased by about 0.32 compared with the reported models. Furthermore, the important molecular structural features that contribute to good permeability were interpreted; the influence of cell lines, peptide modification, and cyclization on permeability were successfully revealed. To facilitate broader use, we deployed these models on the user-friendly KNIME platform (https://github.com/ifyoungnet/PharmPapp). This work provides a rapid and reliable strategy for systematically assessing peptide permeability, aiding researchers in drug delivery optimization, peptide preselection during drug discovery, and potentially the design of targeted peptide-based materials.
Collapse
Affiliation(s)
- Xiaorong Tan
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| | - Qianhui Liu
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| | - Yanpeng Fang
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| | - Yingli Zhu
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| | - Fei Chen
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| | - Wenbin Zeng
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| | - Defang Ouyang
- Institute of Chinese Medical Sciences (ICMS), State Key Laboratory of Quality Research in Chinese Medicine, University of Macau, Macau 999078, China
| | - Jie Dong
- Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410083, China
| |
Collapse
|
3
|
Wang Q, Wang W, Fang Y, Yap PT, Zhu H, Li HJ, Qiao L, Liu M. Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRI. IEEE Trans Biomed Eng 2024; 71:2391-2401. [PMID: 38412079 PMCID: PMC11257815 DOI: 10.1109/tbme.2024.3370415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/29/2024]
Abstract
Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in the brain and is widely used for brain disorder analysis. Previous studies focus on extracting fMRI representations using machine/deep learning methods, but these features typically lack biological interpretability. The human brain exhibits a remarkable modular structure in spontaneous brain functional networks, with each module comprised of functionally interconnected brain regions-of-interest (ROIs). However, existing learning-based methods cannot adequately utilize such brain modularity prior. In this paper, we propose a brain modularity-constrained dynamic representation learning framework for interpretable fMRI analysis, consisting of dynamic graph construction, dynamic graph learning via a novel modularity-constrained graph neural network (MGNN), and prediction and biomarker detection. The designed MGNN is constrained by three core neurocognitive modules (i.e., salience network, central executive network, and default mode network), encouraging ROIs within the same module to share similar representations. To further enhance discriminative ability of learned features, we encourage the MGNN to preserve network topology of input graphs via a graph topology reconstruction constraint. Experimental results on 534 subjects with rs-fMRI scans from two datasets validate the effectiveness of the proposed method. The identified discriminative brain ROIs and functional connectivities can be regarded as potential fMRI biomarkers to aid in clinical diagnosis.
Collapse
|
4
|
Irastorza-Valera L, Soria-Gómez E, Benitez JM, Montáns FJ, Saucedo-Mora L. Review of the Brain's Behaviour after Injury and Disease for Its Application in an Agent-Based Model (ABM). Biomimetics (Basel) 2024; 9:362. [PMID: 38921242 PMCID: PMC11202129 DOI: 10.3390/biomimetics9060362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2024] [Revised: 05/28/2024] [Accepted: 06/05/2024] [Indexed: 06/27/2024] Open
Abstract
The brain is the most complex organ in the human body and, as such, its study entails great challenges (methodological, theoretical, etc.). Nonetheless, there is a remarkable amount of studies about the consequences of pathological conditions on its development and functioning. This bibliographic review aims to cover mostly findings related to changes in the physical distribution of neurons and their connections-the connectome-both structural and functional, as well as their modelling approaches. It does not intend to offer an extensive description of all conditions affecting the brain; rather, it presents the most common ones. Thus, here, we highlight the need for accurate brain modelling that can subsequently be used to understand brain function and be applied to diagnose, track, and simulate treatments for the most prevalent pathologies affecting the brain.
Collapse
Affiliation(s)
- Luis Irastorza-Valera
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain; (L.I.-V.); (J.M.B.); (F.J.M.)
- PIMM Laboratory, ENSAM–Arts et Métiers ParisTech, 151 Bd de l’Hôpital, 75013 Paris, France
| | - Edgar Soria-Gómez
- Achúcarro Basque Center for Neuroscience, Barrio Sarriena, s/n, 48940 Leioa, Spain;
- Ikerbasque, Basque Foundation for Science, Plaza Euskadi, 5, 48009 Bilbao, Spain
- Department of Neurosciences, University of the Basque Country UPV/EHU, Barrio Sarriena, s/n, 48940 Leioa, Spain
| | - José María Benitez
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain; (L.I.-V.); (J.M.B.); (F.J.M.)
| | - Francisco J. Montáns
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain; (L.I.-V.); (J.M.B.); (F.J.M.)
- Department of Mechanical and Aerospace Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Luis Saucedo-Mora
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain; (L.I.-V.); (J.M.B.); (F.J.M.)
- Department of Materials, University of Oxford, Parks Road, Oxford OX1 3PJ, UK
- Department of Nuclear Science and Engineering, Massachusetts Institute of Technology (MIT), 77 Massachusetts Ave, Cambridge, MA 02139, USA
| |
Collapse
|
5
|
Zeng X, Cai S, Xie L. Attention-guided graph structure learning network for EEG-enabled auditory attention detection. J Neural Eng 2024; 21:036025. [PMID: 38776893 DOI: 10.1088/1741-2552/ad4f1a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Accepted: 05/22/2024] [Indexed: 05/25/2024]
Abstract
Objective: Decoding auditory attention from brain signals is essential for the development of neuro-steered hearing aids. This study aims to overcome the challenges of extracting discriminative feature representations from electroencephalography (EEG) signals for auditory attention detection (AAD) tasks, particularly focusing on the intrinsic relationships between different EEG channels.Approach: We propose a novel attention-guided graph structure learning network, AGSLnet, which leverages potential relationships between EEG channels to improve AAD performance. Specifically, AGSLnet is designed to dynamically capture latent relationships between channels and construct a graph structure of EEG signals.Main result: We evaluated AGSLnet on two publicly available AAD datasets and demonstrated its superiority and robustness over state-of-the-art models. Visualization of the graph structure trained by AGSLnet supports previous neuroscience findings, enhancing our understanding of the underlying neural mechanisms.Significance: This study presents a novel approach for examining brain functional connections, improving AAD performance in low-latency settings, and supporting the development of neuro-steered hearing aids.
Collapse
Affiliation(s)
- Xianzhang Zeng
- School of Intelligent Engineering, South China University of Technology, Guangzhou, People's Republic of China
| | - Siqi Cai
- Department of Electrical and Computer Engineering, National University of Singapore, Singapore, Singapore
| | - Longhan Xie
- School of Intelligent Engineering, South China University of Technology, Guangzhou, People's Republic of China
| |
Collapse
|
6
|
Peng L, Cai S, Wu Z, Shang H, Zhu X, Li X. MMGPL: Multimodal Medical Data Analysis with Graph Prompt Learning. Med Image Anal 2024; 97:103225. [PMID: 38908306 DOI: 10.1016/j.media.2024.103225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Revised: 04/12/2024] [Accepted: 05/27/2024] [Indexed: 06/24/2024]
Abstract
Prompt learning has demonstrated impressive efficacy in the fine-tuning of multimodal large models to a wide range of downstream tasks. Nonetheless, applying existing prompt learning methods for the diagnosis of neurological disorder still suffers from two issues: (i) existing methods typically treat all patches equally, despite the fact that only a small number of patches in neuroimaging are relevant to the disease, and (ii) they ignore the structural information inherent in the brain connection network which is crucial for understanding and diagnosing neurological disorders. To tackle these issues, we introduce a novel prompt learning model by learning graph prompts during the fine-tuning process of multimodal models for diagnosing neurological disorders. Specifically, we first leverage GPT-4 to obtain relevant disease concepts and compute semantic similarity between these concepts and all patches. Secondly, we reduce the weight of irrelevant patches according to the semantic similarity between each patch and disease-related concepts. Moreover, we construct a graph among tokens based on these concepts and employ a graph convolutional network layer to extract the structural information of the graph, which is used to prompt the pre-trained multimodal models for diagnosing neurological disorders. Extensive experiments demonstrate that our method achieves superior performance for neurological disorder diagnosis compared with state-of-the-art methods and validated by clinicians.
Collapse
Affiliation(s)
- Liang Peng
- Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Shenzhen 518000, China
| | - Songyue Cai
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Zongqian Wu
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Huifang Shang
- Department of Neurology, Laboratory of Neurodegenerative Disorders, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Xiaofeng Zhu
- Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Shenzhen 518000, China.
| | - Xiaoxiao Li
- School of Electrical and Computer Engineering, University of British Columbia, Vancouver BC V6T 1Z4, Canada
| |
Collapse
|
7
|
Lin P, Zhu G, Xu X, Wang Z, Li X, Li B. Brain network analysis of working memory in schizophrenia based on multi graph attention network. Brain Res 2024; 1831:148816. [PMID: 38387716 DOI: 10.1016/j.brainres.2024.148816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 01/25/2024] [Accepted: 02/19/2024] [Indexed: 02/24/2024]
Abstract
The cognitive impairment in schizophrenia (SZ) is characterized by significant deficits in working memory task. In order to explore the brain changes of SZ during a working memory task, we performed time-domain and time-frequency analysis of event related potentials (ERP) of SZ during a 0-back task. The P3 wave amplitude was found to be significantly lower in SZ patients than in healthy controls (HC) (p < 0.05). The power in the θ and α bands was significantly enhanced in the SZ group 200 ms after stimulation, while the θ band was significantly enhanced and the β band was weakened in the HC group. Furthermore, phase lag index (PLI) based brain functional connectivity maps showed differences in the connections between parietal and frontotemporal lobes between SZ and HC (p < 0.05). Due to the natural similarity between brain networks and graph data, and the fact that graph attention network can aggregate the features of adjacent nodes, it has more advantages in learning the features of brain regions. We propose a multi graph attention network model combined with adaptive initial residual (AIR) for SZ classification, which achieves an accuracy of 90.90 % and 78.57 % on an open dataset (Zenodo) and our 0-back dataset, respectively. Overall, the proposed methodology offers promising potential for understanding the brain functional connections of schizophrenia.
Collapse
Affiliation(s)
- Ping Lin
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China; College of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
| | - Geng Zhu
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| | - Xinyi Xu
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China; College of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
| | - Zhen Wang
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China
| | - Xiaoou Li
- College of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai 201318, China; College of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China; Shanghai Yangpu Mental Health Center, Shanghai 200093, China.
| | - Bin Li
- Shanghai Yangpu Mental Health Center, Shanghai 200093, China.
| |
Collapse
|
8
|
Motaman S, Ghafouri T, Manavizadeh N. Low power nanoscale S-FED based single ended sense amplifier applied in integrate and fire neuron circuit. Sci Rep 2024; 14:10691. [PMID: 38724680 PMCID: PMC11082184 DOI: 10.1038/s41598-024-61224-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 05/02/2024] [Indexed: 05/12/2024] Open
Abstract
Current advancements in neuromorphic computing systems are focused on decreasing power consumption and enriching computational functions. Correspondingly, state-of-the-art system-on-chip developers are encouraged to design nanoscale devices with minimum power dissipation and high-speed operation. This paper deals with designing a sense amplifier based on side-contacted field-effect diodes to reduce the power-delay product (PDP) and the noise susceptibility, as critical factors in neuron circuits. Our findings reveal that both static and dynamic power consumption of the S-FED-based sense amplifier, equal to 1.86 μW and 1.92 fW/GHz, are × 243.03 and × 332.83 lower than those of the conventional CMOS counterpart, respectively. While the sense-amplifier circuit based on CMOS technology undergoes an output voltage deviation of 170.97 mV, the proposed S-FED-based one enjoys a minor output deviation of 27.31 mV. Meanwhile, the superior HIGH-level and LOW-level noise margins of the S-FED-based sense amplifier to the CMOS counterparts (∆NMH = 70 mV and ∆NML = 120 mV), respectively, can ensure the system-level operation stability of the former one. Subsequent to the attainment of an area-efficient, low-power, and high-speed S-FED-based sense amplifier (PDP = 187.75 × 10-18 W s) as a fundamental building block, devising an innovative integrate-and-fire neuron circuit based on S-FED paves the way to realize a new generation of neuromorphic architectures. To shed light on this context, an S-FED-based integrate-and-fire neuron circuit is designed and analyzed utilizing a sense amplifier and feedback loop to enhance spiking voltage and subsequent noise immunity in addition to an about fourfold increase in firing frequency compared to CMOS-based ones.
Collapse
Affiliation(s)
- SeyedMohamadJavad Motaman
- Nanostructured-Electronic Devices Laboratory, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, 1631714191, Iran
| | - Tara Ghafouri
- Nanostructured-Electronic Devices Laboratory, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, 1631714191, Iran
| | - Negin Manavizadeh
- Nanostructured-Electronic Devices Laboratory, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, 1631714191, Iran.
| |
Collapse
|
9
|
Guo L, Wang J. GSScore: a novel Graphormer-based shell-like scoring method for protein-ligand docking. Brief Bioinform 2024; 25:bbae201. [PMID: 38706316 PMCID: PMC11070652 DOI: 10.1093/bib/bbae201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Revised: 02/05/2024] [Accepted: 04/16/2024] [Indexed: 05/07/2024] Open
Abstract
Protein-ligand interactions (PLIs) are essential for cellular activities and drug discovery. But due to the complexity and high cost of experimental methods, there is a great demand for computational approaches to recognize PLI patterns, such as protein-ligand docking. In recent years, more and more models based on machine learning have been developed to directly predict the root mean square deviation (RMSD) of a ligand docking pose with reference to its native binding pose. However, new scoring methods are pressingly needed in methodology for more accurate RMSD prediction. We present a new deep learning-based scoring method for RMSD prediction of protein-ligand docking poses based on a Graphormer method and Shell-like graph architecture, named GSScore. To recognize near-native conformations from a set of poses, GSScore takes atoms as nodes and then establishes the docking interface of protein-ligand into multiple bipartite graphs within different shell ranges. Benefiting from the Graphormer and Shell-like graph architecture, GSScore can effectively capture the subtle differences between energetically favorable near-native conformations and unfavorable non-native poses without extra information. GSScore was extensively evaluated on diverse test sets including a subset of PDBBind version 2019, CASF2016 as well as DUD-E, and obtained significant improvements over existing methods in terms of RMSE, $R$ (Pearson correlation coefficient), Spearman correlation coefficient and Docking power.
Collapse
Affiliation(s)
- Linyuan Guo
- School of Computer Science and Engineering, Central South University, Rd. Lu Shan Nan, 410083, Changsha, P.R. China
- Hunan Provincial Key Lab on Bioinformatics, Central South University, Rd. Lu Shan Nan, 410083, Changsha, P.R. China
| | - Jianxin Wang
- School of Computer Science and Engineering, Central South University, Rd. Lu Shan Nan, 410083, Changsha, P.R. China
- Hunan Provincial Key Lab on Bioinformatics, Central South University, Rd. Lu Shan Nan, 410083, Changsha, P.R. China
| |
Collapse
|
10
|
Chen P, Yang H, Zheng X, Jia H, Hao J, Xu X, Li C, He X, Chen R, Okubo TS, Cui Z. Group-common and individual-specific effects of structure-function coupling in human brain networks with graph neural networks. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.22.568257. [PMID: 38045396 PMCID: PMC10690242 DOI: 10.1101/2023.11.22.568257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2023]
Abstract
The human cerebral cortex is organized into functionally segregated but synchronized regions bridged by the structural connectivity of white matter pathways. While structure-function coupling has been implicated in cognitive development and neuropsychiatric disorders, studies yield inconsistent findings. The extent to which the structure-function coupling reflects reliable individual differences or primarily group-common characteristics remains unclear, at both the global and regional brain levels. By leveraging two independent, high-quality datasets, we found that the graph neural network accurately predicted unseen individuals' functional connectivity from structural connectivity, reflecting a strong structure-function coupling. This coupling was primarily driven by network topology and was substantially stronger than that of the linear models. Moreover, we observed that structure-function coupling was dominated by group-common effects, with subtle yet significant individual-specific effects. The regional group and individual effects of coupling were hierarchically organized across the cortex along a sensorimotor-association axis, with lower group and higher individual effects in association cortices. These findings emphasize the importance of considering both group and individual effects in understanding cortical structure-function coupling, suggesting insights into interpreting individual differences of the coupling and informing connectivity-guided therapeutics.
Collapse
|
11
|
Zhang Y, Xue L, Zhang S, Yang J, Zhang Q, Wang M, Wang L, Zhang M, Jiang J, Li Y. A novel spatiotemporal graph convolutional network framework for functional connectivity biomarkers identification of Alzheimer's disease. Alzheimers Res Ther 2024; 16:60. [PMID: 38481280 PMCID: PMC10938710 DOI: 10.1186/s13195-024-01425-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 03/03/2024] [Indexed: 03/17/2024]
Abstract
BACKGROUND Functional connectivity (FC) biomarkers play a crucial role in the early diagnosis and mechanistic study of Alzheimer's disease (AD). However, the identification of effective FC biomarkers remains challenging. In this study, we introduce a novel approach, the spatiotemporal graph convolutional network (ST-GCN) combined with the gradient-based class activation mapping (Grad-CAM) model (STGC-GCAM), to effectively identify FC biomarkers for AD. METHODS This multi-center cross-racial retrospective study involved 2,272 participants, including 1,105 cognitively normal (CN) subjects, 790 mild cognitive impairment (MCI) individuals, and 377 AD patients. All participants underwent functional magnetic resonance imaging (fMRI) and T1-weighted MRI scans. In this study, firstly, we optimized the STGC-GCAM model to enhance classification accuracy. Secondly, we identified novel AD-associated biomarkers using the optimized model. Thirdly, we validated the imaging biomarkers using Kaplan-Meier analysis. Lastly, we performed correlation analysis and causal mediation analysis to confirm the physiological significance of the identified biomarkers. RESULTS The STGC-GCAM model demonstrated great classification performance (The average area under the curve (AUC) values for different categories were: CN vs MCI = 0.98, CN vs AD = 0.95, MCI vs AD = 0.96, stable MCI vs progressive MCI = 0.79). Notably, the model identified specific brain regions, including the sensorimotor network (SMN), visual network (VN), and default mode network (DMN), as key differentiators between patients and CN individuals. These brain regions exhibited significant associations with the severity of cognitive impairment (p < 0.05). Moreover, the topological features of important brain regions demonstrated excellent predictive capability for the conversion from MCI to AD (Hazard ratio = 3.885, p < 0.001). Additionally, our findings revealed that the topological features of these brain regions mediated the impact of amyloid beta (Aβ) deposition (bootstrapped average causal mediation effect: β = -0.01 [-0.025, 0.00], p < 0.001) and brain glucose metabolism (bootstrapped average causal mediation effect: β = -0.02 [-0.04, -0.001], p < 0.001) on cognitive status. CONCLUSIONS This study presents the STGC-GCAM framework, which identifies FC biomarkers using a large multi-site fMRI dataset.
Collapse
Affiliation(s)
- Ying Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China
| | - Le Xue
- Department of Nuclear Medicine, the Second Hospital of Zhejiang University School of Medicine, Hangzhou, 310009, Zhejiang, China
| | - Shuoyan Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China
| | - Jiacheng Yang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China
| | - Qi Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China
| | - Min Wang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China
| | - Luyao Wang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China
| | - Mingkai Zhang
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, 100053, China.
| | - Jiehui Jiang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China.
| | - Yunxia Li
- Department of Neurology, Shanghai Pudong Hospital, Fudan University Pudong Medical Center, 2800 Gongwei Road, Shanghai, 201399, Pudong, China.
| |
Collapse
|
12
|
Irastorza-Valera L, Benítez JM, Montáns FJ, Saucedo-Mora L. An Agent-Based Model to Reproduce the Boolean Logic Behaviour of Neuronal Self-Organised Communities through Pulse Delay Modulation and Generation of Logic Gates. Biomimetics (Basel) 2024; 9:101. [PMID: 38392147 PMCID: PMC10886514 DOI: 10.3390/biomimetics9020101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Revised: 01/16/2024] [Accepted: 02/04/2024] [Indexed: 02/24/2024] Open
Abstract
The human brain is arguably the most complex "machine" to ever exist. Its detailed functioning is yet to be fully understood, let alone modelled. Neurological processes have logical signal-processing and biophysical aspects, and both affect the brain's structure, functioning and adaptation. Mathematical approaches based on both information and graph theory have been extensively used in an attempt to approximate its biological functioning, along with Artificial Intelligence frameworks inspired by its logical functioning. In this article, an approach to model some aspects of the brain learning and signal processing is presented, mimicking the metastability and backpropagation found in the real brain while also accounting for neuroplasticity. Several simulations are carried out with this model to demonstrate how dynamic neuroplasticity, neural inhibition and neuron migration can reshape the brain's logical connectivity to synchronise signal processing and obtain certain target latencies. This work showcases the importance of dynamic logical and biophysical remodelling in brain plasticity. Combining mathematical (agents, graph theory, topology and backpropagation) and biomedical ingredients (metastability, neuroplasticity and migration), these preliminary results prove complex brain phenomena can be reproduced-under pertinent simplifications-via affordable computations, which can be construed as a starting point for more ambitiously accurate simulations.
Collapse
Affiliation(s)
- Luis Irastorza-Valera
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain
- PIMM Laboratory, Arts et Métiers Institute of Technology, 151 Bd de l'Hôpital, 75013 Paris, France
| | - José María Benítez
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain
| | - Francisco J Montáns
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain
- Department of Mechanical and Aerospace Engineering, Herbert Wertheim College of Engineering, University of Florida, Gainesville, FL 32611, USA
| | - Luis Saucedo-Mora
- E.T.S. de Ingeniería Aeronáutica y del Espacio, Universidad Politécnica de Madrid, Pza. Cardenal Cisneros 3, 28040 Madrid, Spain
- Department of Materials, University of Oxford, Parks Road, Oxford OX1 3PJ, UK
- Department of Nuclear Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| |
Collapse
|
13
|
Mitchell EC, Story B, Boothe D, Franaszczuk PJ, Maroulas V. A topological deep learning framework for neural spike decoding. Biophys J 2024:S0006-3495(24)00041-9. [PMID: 38402607 DOI: 10.1016/j.bpj.2024.01.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Revised: 01/10/2024] [Accepted: 01/23/2024] [Indexed: 02/27/2024] Open
Abstract
The brain's spatial orientation system uses different neuron ensembles to aid in environment-based navigation. Two of the ways brains encode spatial information are through head direction cells and grid cells. Brains use head direction cells to determine orientation, whereas grid cells consist of layers of decked neurons that overlay to provide environment-based navigation. These neurons fire in ensembles where several neurons fire at once to activate a single head direction or grid. We want to capture this firing structure and use it to decode head direction and animal location from head direction and grid cell activity. Understanding, representing, and decoding these neural structures require models that encompass higher-order connectivity, more than the one-dimensional connectivity that traditional graph-based models provide. To that end, in this work, we develop a topological deep learning framework for neural spike train decoding. Our framework combines unsupervised simplicial complex discovery with the power of deep learning via a new architecture we develop herein called a simplicial convolutional recurrent neural network. Simplicial complexes, topological spaces that use not only vertices and edges but also higher-dimensional objects, naturally generalize graphs and capture more than just pairwise relationships. Additionally, this approach does not require prior knowledge of the neural activity beyond spike counts, which removes the need for similarity measurements. The effectiveness and versatility of the simplicial convolutional neural network is demonstrated on head direction and trajectory prediction via head direction and grid cell datasets.
Collapse
Affiliation(s)
- Edward C Mitchell
- University of Tennessee Knoxville, Knoxville, Tennessee; Joe Gibbs Human Performance Institute, Huntersville, North Carolina
| | - Brittany Story
- University of Tennessee Knoxville, Knoxville, Tennessee; Army Research Lab, Aberdeen, Maryland
| | | | - Piotr J Franaszczuk
- Army Research Lab, Aberdeen, Maryland; Johns Hopkins University, Baltimore, Maryland
| | | |
Collapse
|
14
|
Bai L, Wu Y, Li G, Zhang W, Zhang H, Su J. AI-enabled organoids: Construction, analysis, and application. Bioact Mater 2024; 31:525-548. [PMID: 37746662 PMCID: PMC10511344 DOI: 10.1016/j.bioactmat.2023.09.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 09/09/2023] [Accepted: 09/09/2023] [Indexed: 09/26/2023] Open
Abstract
Organoids, miniature and simplified in vitro model systems that mimic the structure and function of organs, have attracted considerable interest due to their promising applications in disease modeling, drug screening, personalized medicine, and tissue engineering. Despite the substantial success in cultivating physiologically relevant organoids, challenges remain concerning the complexities of their assembly and the difficulties associated with data analysis. The advent of AI-Enabled Organoids, which interfaces with artificial intelligence (AI), holds the potential to revolutionize the field by offering novel insights and methodologies that can expedite the development and clinical application of organoids. This review succinctly delineates the fundamental concepts and mechanisms underlying AI-Enabled Organoids, summarizing the prospective applications on rapid screening of construction strategies, cost-effective extraction of multiscale image features, streamlined analysis of multi-omics data, and precise preclinical evaluation and application. We also explore the challenges and limitations of interfacing organoids with AI, and discuss the future direction of the field. Taken together, the AI-Enabled Organoids hold significant promise for advancing our understanding of organ development and disease progression, ultimately laying the groundwork for clinical application.
Collapse
Affiliation(s)
- Long Bai
- Department of Orthopedics, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200092, China
- Organoid Research Center, Institute of Translational Medicine, Shanghai University, Shanghai, 200444, China
- National Center for Translational Medicine (Shanghai) SHU Branch, Shanghai University, Shanghai, 200444, China
- Wenzhou Institute of Shanghai University, Wenzhou, 325000, China
| | - Yan Wu
- Department of Orthopedics, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200092, China
- Organoid Research Center, Institute of Translational Medicine, Shanghai University, Shanghai, 200444, China
- National Center for Translational Medicine (Shanghai) SHU Branch, Shanghai University, Shanghai, 200444, China
| | - Guangfeng Li
- Organoid Research Center, Institute of Translational Medicine, Shanghai University, Shanghai, 200444, China
- National Center for Translational Medicine (Shanghai) SHU Branch, Shanghai University, Shanghai, 200444, China
- Department of Orthopedics, Shanghai Zhongye Hospital, Shanghai, 201941, China
| | - Wencai Zhang
- Department of Orthopedics, First Affiliated Hospital, Jinan University, Guangzhou, 510632, China
| | - Hao Zhang
- Department of Orthopedics, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200092, China
- Organoid Research Center, Institute of Translational Medicine, Shanghai University, Shanghai, 200444, China
- National Center for Translational Medicine (Shanghai) SHU Branch, Shanghai University, Shanghai, 200444, China
| | - Jiacan Su
- Department of Orthopedics, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200092, China
- Organoid Research Center, Institute of Translational Medicine, Shanghai University, Shanghai, 200444, China
- National Center for Translational Medicine (Shanghai) SHU Branch, Shanghai University, Shanghai, 200444, China
| |
Collapse
|
15
|
Wang H, Zhang L, Wu R, Cen Y. Spatio-temporal fusion of meteorological factors for multi-site PM2.5 prediction: A deep learning and time-variant graph approach. ENVIRONMENTAL RESEARCH 2023; 239:117286. [PMID: 37797668 DOI: 10.1016/j.envres.2023.117286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 09/29/2023] [Accepted: 09/30/2023] [Indexed: 10/07/2023]
Abstract
In the field of environmental science, traditional methods for predicting PM2.5 concentrations primarily focus on singular temporal or spatial dimensions. This approach presents certain limitations when it comes to deeply mining the joint influence of multiple monitoring sites and their inherent connections with meteorological factors. To address this issue, we introduce an innovative deep-learning-based multi-graph model using Beijing as the study case. This model consists of two key modules: firstly, the 'Meteorological Factor Spatio-Temporal Feature Extraction Module'. This module deeply integrates spatio-temporal features of hourly meteorological data by employing Graph Convolutional Networks (GCN) and Long Short-Term Memory (LSTM) for spatial and temporal encoding respectively. Subsequently, through an attention mechanism, it retrieves a feature tensor associated with air pollutants. Secondly, these features are amalgamated with PM2.5 concentration values, allowing the 'PM2.5 Concentration Prediction Module' to predict with enhanced accuracy the joint influence across multiple monitoring sites. Our model exhibits significant advantages over traditional methods in processing the joint impact of multiple sites and their associated meteorological factors. By providing new perspectives and tools for the in-depth understanding of urban air pollutant distribution and optimization of air quality management, this model propels us towards a more comprehensive approach in tackling air pollution issues.
Collapse
Affiliation(s)
- Hongqing Wang
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100094, China; University of Chinese Academy of Sciences, Beijing, 100049, China.
| | - Lifu Zhang
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100094, China.
| | - Rong Wu
- Department of Mathematical Sciences, Tsinghua University, Beijing, 100084, China.
| | - Yi Cen
- Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, 100094, China.
| |
Collapse
|
16
|
Tang X, Guo R, Zhang C, Zhuang X, Qian X. A Causality-Driven Graph Convolutional Network for Postural Abnormality Diagnosis in Parkinsonians. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:3752-3763. [PMID: 37581959 DOI: 10.1109/tmi.2023.3305378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/17/2023]
Abstract
Abnormal posture is a common movement disorder in the progress of Parkinson's disease (PD), and this abnormality can increase the risk of falls or even disabilities. The conventional assessment approach depends on the judgment of well-trained experts via canonical scales. However, this approach requires extensive clinical expertise and is highly subjective. Considering the potential of quantitative susceptibility mapping (QSM) in PD diagnosis, this study explored the QSM-based method for the automated classification between PD patients with and without postural abnormalities. Nevertheless, a major challenge is that unstable non-causal features typically lead to less reliable performance. Therefore, we propose a causality-driven graph-convolutional-network framework based on multi-instance learning, where performance stability is enhanced through the invariant prediction principle and causal interventions. Specifically, we adopt an intervention strategy that combines a non-causal intervenor with causal prediction. A stability constraint is proposed to ensure robust integrated prediction under different interventions. Moreover, an intra-class homogeneity constraint is enforced for each individually-learned causality scoring module to promote the extraction of group-level general features, and hence achieve a balance between subject-specific and group-level features. The proposed method demonstrated promising performance through extensive experiments on a real clinical dataset. Also, the features extracted by our method coincide with those reported in previous medical studies on PD posture abnormalities. In general, our work provides a clinically-valuable approach for automated, objective, and reliable diagnosis of postural abnormalities in Parkinsonians. Our source code is publicly available at https://github.com/SJTUBME-QianLab/CausalGCN-PDPA.
Collapse
|
17
|
Zhang S, Yang J, Zhang Y, Zhong J, Hu W, Li C, Jiang J. The Combination of a Graph Neural Network Technique and Brain Imaging to Diagnose Neurological Disorders: A Review and Outlook. Brain Sci 2023; 13:1462. [PMID: 37891830 PMCID: PMC10605282 DOI: 10.3390/brainsci13101462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 10/06/2023] [Accepted: 10/12/2023] [Indexed: 10/29/2023] Open
Abstract
Neurological disorders (NDs), such as Alzheimer's disease, have been a threat to human health all over the world. It is of great importance to diagnose ND through combining artificial intelligence technology and brain imaging. A graph neural network (GNN) can model and analyze the brain, imaging from morphology, anatomical structure, function features, and other aspects, thus becoming one of the best deep learning models in the diagnosis of ND. Some researchers have investigated the application of GNN in the medical field, but the scope is broad, and its application to NDs is less frequent and not detailed enough. This review focuses on the research progress of GNNs in the diagnosis of ND. Firstly, we systematically investigated the GNN framework of ND, including graph construction, graph convolution, graph pooling, and graph prediction. Secondly, we investigated common NDs using the GNN diagnostic model in terms of data modality, number of subjects, and diagnostic accuracy. Thirdly, we discussed some research challenges and future research directions. The results of this review may be a valuable contribution to the ongoing intersection of artificial intelligence technology and brain imaging.
Collapse
Affiliation(s)
- Shuoyan Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
| | - Jiacheng Yang
- School of Life Sciences, Shanghai University, Shanghai 200444, China
| | - Ying Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
| | - Jiayi Zhong
- School of Life Sciences, Shanghai University, Shanghai 200444, China
| | - Wenjing Hu
- School of Life Sciences, Shanghai University, Shanghai 200444, China
| | - Chenyang Li
- School of Life Sciences, Shanghai University, Shanghai 200444, China
| | - Jiehui Jiang
- Shanghai Institute of Biomedical Engineering, Shanghai University, Shanghai 200444, China
| |
Collapse
|
18
|
Kazi A, Farghadani S, Aganj I, Navab N. IA-GCN: Interpretable Attention based Graph Convolutional Network for Disease Prediction. MACHINE LEARNING IN MEDICAL IMAGING. MLMI (WORKSHOP) 2023; 14348:382-392. [PMID: 37854585 PMCID: PMC10583839 DOI: 10.1007/978-3-031-45673-2_38] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2023]
Abstract
Interpretability in Graph Convolutional Networks (GCNs) has been explored to some extent in general in computer vision; yet, in the medical domain, it requires further examination. Most of the interpretability approaches for GCNs, especially in the medical domain, focus on interpreting the output of the model in a post-hoc fashion. In this paper, we propose an interpretable attention module (IAM) that explains the relevance of the input features to the classification task on a GNN Model. The model uses these interpretations to improve its performance. In a clinical scenario, such a model can assist the clinical experts in better decision-making for diagnosis and treatment planning. The main novelty lies in the IAM, which directly operates on input features. IAM learns the attention for each feature based on the unique interpretability-specific losses. We show the application of our model on two publicly available datasets, Tadpole and the UK Biobank (UKBB). For Tadpole we choose the task of disease classification, and for UKBB, age, and sex prediction. The proposed model achieves an increase in an average accuracy of 3.2% for Tadpole and 1.6% for UKBB sex and 2% for the UKBB age prediction task compared to the state-of-the-art. Further, we show exhaustive validation and clinical interpretation of our results.
Collapse
Affiliation(s)
- Anees Kazi
- Computer Aided Medical Procedures, Technical University of Munich, Germany
- Radiology Department, Martinos Center for Biomedical Imaging, Massachusetts General Hospital, USA
- Harvard Medical School, USA
| | - Soroush Farghadani
- Sharif University of Technology, Tehran, Iran
- University of Toronto, Canada
| | - Iman Aganj
- Radiology Department, Martinos Center for Biomedical Imaging, Massachusetts General Hospital, USA
- Harvard Medical School, USA
| | - Nassir Navab
- Computer Aided Medical Procedures, Technical University of Munich, Germany
- Whiting School of Engineering, Johns Hopkins University, Baltimore, USA
| |
Collapse
|
19
|
Wang Q, Wu M, Fang Y, Wang W, Qiao L, Liu M. Modularity-Constrained Dynamic Representation Learning for Interpretable Brain Disorder Analysis with Functional MRI. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2023; 14220:46-56. [PMID: 38390374 PMCID: PMC10883232 DOI: 10.1007/978-3-031-43907-0_5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/24/2024]
Abstract
Resting-state functional MRI (rs-fMRI) is increasingly used to detect altered functional connectivity patterns caused by brain disorders, thereby facilitating objective quantification of brain pathology. Existing studies typically extract fMRI features using various machine/deep learning methods, but the generated imaging biomarkers are often challenging to interpret. Besides, the brain operates as a modular system with many cognitive/topological modules, where each module contains subsets of densely inter-connected regions-of-interest (ROIs) that are sparsely connected to ROIs in other modules. However, current methods cannot effectively characterize brain modularity. This paper proposes a modularity-constrained dynamic representation learning (MDRL) framework for interpretable brain disorder analysis with rs-fMRI. The MDRL consists of 3 parts: (1) dynamic graph construction, (2) modularity-constrained spatiotemporal graph neural network (MSGNN) for dynamic feature learning, and (3) prediction and biomarker detection. In particular, the MSGNN is designed to learn spatiotemporal dynamic representations of fMRI, constrained by 3 functional modules (i.e., central executive network, salience network, and default mode network). To enhance discriminative ability of learned features, we encourage the MSGNN to reconstruct network topology of input graphs. Experimental results on two public and one private datasets with a total of 1,155 subjects validate that our MDRL outperforms several state-of-the-art methods in fMRI-based brain disorder analysis. The detected fMRI biomarkers have good explainability and can be potentially used to improve clinical diagnosis.
Collapse
Affiliation(s)
- Qianqian Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Mengqi Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Yuqi Fang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Wei Wang
- Department of Radiology, Beijing Youan Hospital, Capital Medical University, Beijing 100069, China
| | - Lishan Qiao
- School of Mathematics Science, Liaocheng University, Shandong 252000, China
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
20
|
Brynildsen JK, Rajan K, Henderson MX, Bassett DS. Network models to enhance the translational impact of cross-species studies. Nat Rev Neurosci 2023; 24:575-588. [PMID: 37524935 PMCID: PMC10634203 DOI: 10.1038/s41583-023-00720-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/17/2023] [Indexed: 08/02/2023]
Abstract
Neuroscience studies are often carried out in animal models for the purpose of understanding specific aspects of the human condition. However, the translation of findings across species remains a substantial challenge. Network science approaches can enhance the translational impact of cross-species studies by providing a means of mapping small-scale cellular processes identified in animal model studies to larger-scale inter-regional circuits observed in humans. In this Review, we highlight the contributions of network science approaches to the development of cross-species translational research in neuroscience. We lay the foundation for our discussion by exploring the objectives of cross-species translational models. We then discuss how the development of new tools that enable the acquisition of whole-brain data in animal models with cellular resolution provides unprecedented opportunity for cross-species applications of network science approaches for understanding large-scale brain networks. We describe how these tools may support the translation of findings across species and imaging modalities and highlight future opportunities. Our overarching goal is to illustrate how the application of network science tools across human and animal model studies could deepen insight into the neurobiology that underlies phenomena observed with non-invasive neuroimaging methods and could simultaneously further our ability to translate findings across species.
Collapse
Affiliation(s)
- Julia K Brynildsen
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
| | - Kanaka Rajan
- Department of Neuroscience, Icahn School of Medicine at Mount Sinai, New York, NY, USA
- The Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Michael X Henderson
- Parkinson's Disease Center, Department of Neurodegenerative Science, Van Andel Institute, Grand Rapids, MI, USA
| | - Dani S Bassett
- Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Electrical & Systems Engineering, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Physics & Astronomy, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Neurology, University of Pennsylvania, Philadelphia, PA, USA.
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, USA.
- Santa Fe Institute, Santa Fe, NM, USA.
| |
Collapse
|
21
|
Kim SY. Personalized Explanations for Early Diagnosis of Alzheimer's Disease Using Explainable Graph Neural Networks with Population Graphs. Bioengineering (Basel) 2023; 10:701. [PMID: 37370632 DOI: 10.3390/bioengineering10060701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 06/05/2023] [Accepted: 06/06/2023] [Indexed: 06/29/2023] Open
Abstract
Leveraging recent advances in graph neural networks, our study introduces an application of graph convolutional networks (GCNs) within a correlation-based population graph, aiming to enhance Alzheimer's disease (AD) prognosis and illuminate the intricacies of AD progression. This methodological approach leverages the inherent structure and correlations in demographic and neuroimaging data to predict amyloid-beta (Aβ) positivity. To validate our approach, we conducted extensive performance comparisons with conventional machine learning models and a GCN model with randomly assigned edges. The results consistently highlighted the superior performance of the correlation-based GCN model across different sample groups in the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, suggesting the importance of accurately reflecting the correlation structure in population graphs for effective pattern recognition and accurate prediction. Furthermore, our exploration of the model's decision-making process using GNNExplainer identified unique sets of biomarkers indicative of Aβ positivity in different groups, shedding light on the heterogeneity of AD progression. This study underscores the potential of our proposed approach for more nuanced AD prognoses, potentially informing more personalized and precise therapeutic strategies. Future research can extend these findings by integrating diverse data sources, employing longitudinal data, and refining the interpretability of the model, which potentially has broad applicability to other complex diseases.
Collapse
Affiliation(s)
- So Yeon Kim
- Department of Artificial Intelligence, Ajou University, Suwon 16499, Republic of Korea
- Department of Software and Computer Engineering, Ajou University, Suwon 16499, Republic of Korea
| |
Collapse
|
22
|
Gürler Z, Gharsallaoui MA, Rekik I. Template-based graph registration network for boosting the diagnosis of brain connectivity disorders. Comput Med Imaging Graph 2023; 103:102140. [PMID: 36470102 DOI: 10.1016/j.compmedimag.2022.102140] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 10/11/2022] [Accepted: 11/02/2022] [Indexed: 11/20/2022]
Abstract
Brain graphs are powerful representations to explore the biological roadmaps of the human brain in its healthy and disordered states. Recently, a few graph neural networks (GNNs) have been designed for brain connectivity synthesis and diagnosis. However, such non-Euclidean deep learning architectures might fail to capture the neural interactions between different brain regions as they are trained without guidance from any prior biological template-i.e., template-free learning. Here we assume that using a population-driven brain connectional template (CBT) that captures well the connectivity patterns fingerprinting a given brain state (e.g., healthy) can better guide the GNN training in its downstream learning task such as classification or regression. To this aim we design a plug-in graph registration network (GRN) that can be coupled with any conventional graph neural network (GNN) so as to boost its learning accuracy and generalizability to unseen samples. Our GRN is a graph generative adversarial network (gGAN), which registers brain graphs to a prior CBT. Next, the registered brain graphs are used to train typical GNN models. Our GRN can be integrated into any GNN working in an end-to-end fashion to boost its prediction accuracy. Our experiments showed that GRN remarkably boosted the prediction accuracy of four conventional GNN models across four neurological datasets.
Collapse
Affiliation(s)
- Zeynep Gürler
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey
| | - Mohammed Amine Gharsallaoui
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; Ecole Polytechnique de Tunisie, Tunisia
| | - Islem Rekik
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; Computing, Imperial-X Translation and Innovation Hub, Imperial College London, London, UK.
| | | |
Collapse
|
23
|
Demirbilek O, Rekik I. Predicting the evolution trajectory of population-driven connectional brain templates using recurrent multigraph neural networks. Med Image Anal 2023; 83:102649. [PMID: 36257134 DOI: 10.1016/j.media.2022.102649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 09/28/2022] [Accepted: 09/30/2022] [Indexed: 11/05/2022]
Abstract
The mapping of the time-dependent evolution of the human brain connectivity using longitudinal and multimodal neuroimaging datasets provides insights into the development of neurological disorders and the way they alter the brain morphology, structure and function over time. Recently, the connectional brain template (CBT) was introduced as a compact representation integrating a population of brain multigraphs, where two brain regions can have multiple connections, into a single graph. Given a population of brain multigraphs observed at a baseline timepoint t1, we aim to learn how to predict the evolution of the population CBT at follow-up timepoints t>t1. Such model will allow us to foresee the evolution of the connectivity patterns of healthy and disordered individuals at the population level. Here we present recurrent multigraph integrator network (ReMI-Net⋆) to forecast population templates at consecutive timepoints from a given single timepoint. In particular, we unprecedentedly design a graph neural network architecture to model the changes in the brain multigraph and identify the biomarkers that differentiate between the typical and atypical populations. Addressing such issues is of paramount importance in diagnosing neurodegenerative disorders at early stages and promoting new clinical studies based on the pinned-down biomarker brain regions or connectivities. In this paper, we demonstrate the design and use of the ReMI-Net⋆ model, which learns both the multigraph node level and time level dependencies concurrently. Thanks to its novel graph convolutional design and normalization layers, ReMI-Net⋆ predicts well-centered, discriminative, and topologically sound connectional templates over time. Additionally, the results show that our model outperforms all benchmarks and state-of-the-art methods by comparing and discovering the atypical connectivity alterations over time. Our ReMI-Net⋆ code is available on GitHub at https://github.com/basiralab/ReMI-Net-Star.
Collapse
Affiliation(s)
- Oytun Demirbilek
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey
| | - Islem Rekik
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; School of Science and Engineering, Computing, University of Dundee, UK.
| | | |
Collapse
|
24
|
McCombe N, Bamrah J, Sanchez‐Bornot JM, Finn DP, McClean PL, Wong‐Lin K. Alzheimer's disease classification using cluster-based labelling for graph neural network on heterogeneous data. Healthc Technol Lett 2022; 9:102-109. [PMID: 36514476 PMCID: PMC9731537 DOI: 10.1049/htl2.12037] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 09/19/2022] [Accepted: 10/03/2022] [Indexed: 12/16/2022] Open
Abstract
Biomarkers for Alzheimer's disease (AD) diagnosis do not always correlate reliably with cognitive symptoms, making clinical diagnosis inconsistent. In this study, the performance of a graphical neural network (GNN) classifier based on data-driven diagnostic classes from unsupervised clustering on heterogeneous data is compared to the performance of a classifier using clinician diagnosis as an outcome. Unsupervised clustering on tau-positron emission tomography (PET) and cognitive and functional assessment data was performed. Five clusters embedded in a non-linear uniform manifold approximation and project (UMAP) space were identified. The individual clusters revealed specific feature characteristics with respect to clinical diagnosis of AD, gender, family history, age, and underlying neurological risk factors (NRFs). In particular, one cluster comprised mainly diagnosed AD cases. All cases within this cluster were re-labelled AD cases. The re-labelled cases are characterized by high cerebrospinal fluid amyloid beta (CSF Aβ) levels at a younger age, even though Aβ data was not used for clustering. A GNN model was trained using the re-labelled data with a multiclass area-under-the-curve (AUC) of 95.2%, higher than the AUC of a GNN trained on clinician diagnosis (91.7%; p = 0.02). Overall, our work suggests that more objective cluster-based diagnostic labels combined with GNN classification may have value in clinical risk stratification and diagnosis of AD.
Collapse
Affiliation(s)
- Niamh McCombe
- Intelligent Systems Research CentreSchool of ComputingEngineering and Intelligent SystemsUlster UniversityDerry∼LondonderryNorthern IrelandUK
| | - Jake Bamrah
- Intelligent Systems Research CentreSchool of ComputingEngineering and Intelligent SystemsUlster UniversityDerry∼LondonderryNorthern IrelandUK
| | - Jose M. Sanchez‐Bornot
- Intelligent Systems Research CentreSchool of ComputingEngineering and Intelligent SystemsUlster UniversityDerry∼LondonderryNorthern IrelandUK
| | - David P. Finn
- Pharmacology and Therapeutics, Galway Neuroscience Centre, Centre for Pain Research, and School of MedicineNational University of Ireland GalwayGalwayIreland
| | - Paula L. McClean
- Northern Ireland Centre for Stratified Medicine, Biomedical Sciences Research Institute, Clinical Translational Research and Innovation Centre (C‐TRIC)Ulster UniversityDerry∼LondonderryNorthern IrelandUK
| | - KongFatt Wong‐Lin
- Intelligent Systems Research CentreSchool of ComputingEngineering and Intelligent SystemsUlster UniversityDerry∼LondonderryNorthern IrelandUK
| | | |
Collapse
|