1
|
Zhang L, Wu Z, Yu X, Lyu Y, Wu Z, Dai H, Zhao L, Wang L, Li G, Wang X, Liu T, Zhu D. Learning lifespan brain anatomical correspondence via cortical developmental continuity transfer. Med Image Anal 2024; 99:103328. [PMID: 39243599 DOI: 10.1016/j.media.2024.103328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 07/04/2024] [Accepted: 08/26/2024] [Indexed: 09/09/2024]
Abstract
Identifying anatomical correspondences in the human brain throughout the lifespan is an essential prerequisite for studying brain development and aging. But given the tremendous individual variability in cortical folding patterns, the heterogeneity of different neurodevelopmental stages, and the scarce of neuroimaging data, it is difficult to infer reliable lifespan anatomical correspondence at finer scales. To solve this problem, in this work, we take the advantage of the developmental continuity of the cerebral cortex and propose a novel transfer learning strategy: the model is trained from scratch using the age group with the largest sample size, and then is transferred and adapted to the other groups following the cortical developmental trajectory. A novel loss function is designed to ensure that during the transfer process the common patterns will be extracted and preserved, while the group-specific new patterns will be captured. The proposed framework was evaluated using multiple datasets covering four lifespan age groups with 1,000+ brains (from 34 gestational weeks to young adult). Our experimental results show that: 1) the proposed transfer strategy can dramatically improve the model performance on populations (e.g., early neurodevelopment) with very limited number of training samples; and 2) with the transfer learning we are able to robustly infer the complicated many-to-many anatomical correspondences among different brains at different neurodevelopmental stages. (Code will be released soon: https://github.com/qidianzl/CDC-transfer).
Collapse
Affiliation(s)
- Lu Zhang
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, 76019, USA
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Xiaowei Yu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, 76019, USA
| | - Yanjun Lyu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, 76019, USA
| | - Zihao Wu
- Department of Computer Science, University of Georgia, Athens, GA, 30602, USA
| | - Haixing Dai
- Department of Computer Science, University of Georgia, Athens, GA, 30602, USA
| | - Lin Zhao
- Department of Computer Science, University of Georgia, Athens, GA, 30602, USA
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Xianqiao Wang
- College of Engineering, University of Georgia, Athens, GA, 30602, USA
| | - Tianming Liu
- Department of Computer Science, University of Georgia, Athens, GA, 30602, USA
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, 76019, USA.
| |
Collapse
|
2
|
Sun H, Liu N, Qiu C, Tao B, Yang C, Tang B, Li H, Zhan K, Cai C, Zhang W, Lui S. Applications of MRI in Schizophrenia: Current Progress in Establishing Clinical Utility. J Magn Reson Imaging 2024. [PMID: 38946400 DOI: 10.1002/jmri.29470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 05/20/2024] [Accepted: 05/20/2024] [Indexed: 07/02/2024] Open
Abstract
Schizophrenia is a severe mental illness that significantly impacts the lives of affected individuals and with increasing mortality rates. Early detection and intervention are crucial for improving outcomes but the lack of validated biomarkers poses great challenges in such efforts. The use of magnetic resonance imaging (MRI) in schizophrenia enables the investigation of the disorder's etiological and neuropathological substrates in vivo. After decades of research, promising findings of MRI have been shown to aid in screening high-risk individuals and predicting illness onset, and predicting symptoms and treatment outcomes of schizophrenia. The integration of machine learning and deep learning techniques makes it possible to develop intelligent diagnostic and prognostic tools with extracted or selected imaging features. In this review, we aimed to provide an overview of current progress and prospects in establishing clinical utility of MRI in schizophrenia. We first provided an overview of MRI findings of brain abnormalities that might underpin the symptoms or treatment response process in schizophrenia patients. Then, we summarized the ongoing efforts in the computer-aided utility of MRI in schizophrenia and discussed the gap between MRI research findings and real-world applications. Finally, promising pathways to promote clinical translation were provided. EVIDENCE LEVEL: 2 TECHNICAL EFFICACY: Stage 3.
Collapse
Affiliation(s)
- Hui Sun
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Naici Liu
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Changjian Qiu
- Mental Health Center, West China Hospital of Sichuan University, Sichuan Clinical Medical Research Center for Mental Disorders, Chengdu, China
| | - Bo Tao
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Chengmin Yang
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Biqiu Tang
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Hongwei Li
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Department of Radiology, The Third Hospital of Mianyang/Sichuan Mental Health Center, Mianyang, China
| | - Kongcai Zhan
- Department of Radiology, Zigong Affiliated Hospital of Southwest Medical University, Zigong Psychiatric Research Center, Zigong, China
| | - Chunxian Cai
- Department of Radiology, the Second People's Hospital of Neijiang, Neijiang, China
| | - Wenjing Zhang
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Su Lui
- Department of Radiology, and Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital of Sichuan University, Chengdu, China
- Huaxi MR Research Center (HMRRC), West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| |
Collapse
|
3
|
Tang H, Ma G, Guo L, Fu X, Huang H, Zhan L. Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Model. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:7363-7375. [PMID: 36374890 PMCID: PMC10183052 DOI: 10.1109/tnnls.2022.3220220] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Recently, brain networks have been widely adopted to study brain dynamics, brain development, and brain diseases. Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. However, current graph learning techniques have several issues on brain network mining. First, most current graph learning models are designed for unsigned graph, which hinders the analysis of many signed network data (e.g., brain functional networks). Meanwhile, the insufficiency of brain network data limits the model performance on clinical phenotypes' predictions. Moreover, few of the current graph learning models are interpretable, which may not be capable of providing biological insights for model outcomes. Here, we propose an interpretable hierarchical signed graph representation learning (HSGPL) model to extract graph-level representations from brain functional networks, which can be used for different prediction tasks. To further improve the model performance, we also propose a new strategy to augment functional brain network data for contrastive learning. We evaluate this framework on different classification and regression tasks using data from human connectome project (HCP) and open access series of imaging studies (OASIS). Our results from extensive experiments demonstrate the superiority of the proposed model compared with several state-of-the-art techniques. In addition, we use graph saliency maps, derived from these prediction tasks, to demonstrate detection and interpretation of phenotypic biomarkers.
Collapse
|
4
|
Jamison KW, Gu Z, Wang Q, Sabuncu MR, Kuceyeski A. Release the Krakencoder: A unified brain connectome translation and fusion tool. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.04.12.589274. [PMID: 38659856 PMCID: PMC11042193 DOI: 10.1101/2024.04.12.589274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/26/2024]
Abstract
Brain connectivity can be estimated in many ways, depending on modality and processing strategy. Here we present the Krakencoder, a joint connectome mapping tool that simultaneously, bidirectionally translates between structural (SC) and functional connectivity (FC), and across different atlases and processing choices via a common latent representation. These mappings demonstrate unprecedented accuracy and individual-level identifiability; the mapping between SC and FC has identifiability 42-54% higher than existing models. The Krakencoder combines all connectome flavors via a shared low-dimensional latent space. This "fusion" representation i) better reflects familial relatedness, ii) preserves age- and sex-relevant information and iii) enhances cognition-relevant information. The Krakencoder can be applied without retraining to new, out-of-age-distribution data while still preserving inter-individual differences in the connectome predictions and familial relationships in the latent representations. The Krakencoder is a significant leap forward in capturing the relationship between multi-modal brain connectomes in an individualized, behaviorally- and demographically-relevant way.
Collapse
Affiliation(s)
- Keith W Jamison
- Department of Computational Biology, Cornell University, Ithaca, NY, USA
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA
| | - Zijin Gu
- School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY, USA
| | - Qinxin Wang
- Department of Biomedical Engineering, Tsinghua University, Beijing, 100084, China
| | - Mert R Sabuncu
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA
- School of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY, USA
| | - Amy Kuceyeski
- Department of Computational Biology, Cornell University, Ithaca, NY, USA
- Department of Radiology, Weill Cornell Medicine, New York, New York, USA
| |
Collapse
|
5
|
Mao W, Chen Y, He Z, Wang Z, Xiao Z, Sun Y, He L, Zhou J, Guo W, Ma C, Zhao L, Kendrick KM, Zhou B, Becker B, Liu T, Zhang T, Jiang X. Brain Structural Connectivity Guided Vision Transformers for Identification of Functional Connectivity Characteristics in Preterm Neonates. IEEE J Biomed Health Inform 2024; 28:2223-2234. [PMID: 38285570 DOI: 10.1109/jbhi.2024.3355020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2024]
Abstract
Preterm birth is the leading cause of death in children under five years old, and is associated with a wide sequence of complications in both short and long term. In view of rapid neurodevelopment during the neonatal period, preterm neonates may exhibit considerable functional alterations compared to term ones. However, the identified functional alterations in previous studies merely achieve moderate classification performance, while more accurate functional characteristics with satisfying discrimination ability for better diagnosis and therapeutic treatment is underexplored. To address this problem, we propose a novel brain structural connectivity (SC) guided Vision Transformer (SCG-ViT) to identify functional connectivity (FC) differences among three neonatal groups: preterm, preterm with early postnatal experience, and term. Particularly, inspired by the neuroscience-derived information, a novel patch token of SC/FC matrix is defined, and the SC matrix is then adopted as an effective mask into the ViT model to screen out input FC patch embeddings with weaker SC, and to focus on stronger ones for better classification and identification of FC differences among the three groups. The experimental results on multi-modal MRI data of 437 neonatal brains from publicly released Developing Human Connectome Project (dHCP) demonstrate that SCG-ViT achieves superior classification ability compared to baseline models, and successfully identifies holistically different FC patterns among the three groups. Moreover, these different FCs are significantly correlated with the differential gene expressions of the three groups. In summary, SCG-ViT provides a powerfully brain-guided pipeline of adopting large-scale and data-intensive deep learning models for medical imaging-based diagnosis.
Collapse
|
6
|
Zhang L, Qu J, Ma H, Chen T, Liu T, Zhu D. Exploring Alzheimer's disease: a comprehensive brain connectome-based survey. PSYCHORADIOLOGY 2024; 4:kkad033. [PMID: 38333558 PMCID: PMC10848159 DOI: 10.1093/psyrad/kkad033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 12/21/2023] [Accepted: 01/03/2024] [Indexed: 02/10/2024]
Abstract
Dementia is an escalating global health challenge, with Alzheimer's disease (AD) at its forefront. Substantial evidence highlights the accumulation of AD-related pathological proteins in specific brain regions and their subsequent dissemination throughout the broader area along the brain network, leading to disruptions in both individual brain regions and their interconnections. Although a comprehensive understanding of the neurodegeneration-brain network link is lacking, it is undeniable that brain networks play a pivotal role in the development and progression of AD. To thoroughly elucidate the intricate network of elements and connections constituting the human brain, the concept of the brain connectome was introduced. Research based on the connectome holds immense potential for revealing the mechanisms underlying disease development, and it has become a prominent topic that has attracted the attention of numerous researchers. In this review, we aim to systematically summarize studies on brain networks within the context of AD, critically analyze the strengths and weaknesses of existing methodologies, and offer novel perspectives and insights, intending to serve as inspiration for future research.
Collapse
Affiliation(s)
- Lu Zhang
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA
| | - Junqi Qu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA
| | - Haotian Ma
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA
| | - Tong Chen
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA
| | - Tianming Liu
- Department of Computer Science, The University of Georgia, Athens, GA 30602, USA
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA
| |
Collapse
|
7
|
Udayakumar P, Subhashini R. Connectome-based schizophrenia prediction using structural connectivity - Deep Graph Neural Network(sc-DGNN). JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2024; 32:1041-1059. [PMID: 38820060 DOI: 10.3233/xst-230426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2024]
Abstract
BACKGROUND Connectome is understanding the complex organization of the human brain's structural and functional connectivity is essential for gaining insights into cognitive processes and disorders. OBJECTIVE To improve the prediction accuracy of brain disorder issues, the current study investigates dysconnected subnetworks and graph structures associated with schizophrenia. METHOD By using the proposed structural connectivity-deep graph neural network (sc-DGNN) model and compared with machine learning (ML) and deep learning (DL) models.This work attempts to focus on eighty-eight subjects of diffusion magnetic resonance imaging (dMRI), three classical ML, and five DL models. RESULT The structural connectivity-deep graph neural network (sc-DGNN) model is proposed to effectively predict dysconnectedness associated with schizophrenia and exhibits superior performance compared to traditional ML and DL (GNNs) methods in terms of accuracy, sensitivity, specificity, precision, F1-score, and Area under receiver operating characteristic (AUC). CONCLUSION The classification task on schizophrenia using structural connectivity matrices and experimental results showed that linear discriminant analysis (LDA) performed 72% accuracy rate in ML models and sc-DGNN performed at a 93% accuracy rate in DL models to distinguish between schizophrenia and healthy patients.
Collapse
Affiliation(s)
- P Udayakumar
- School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, India
| | - R Subhashini
- School of Computer Science Engineering and Information Systems, Vellore Institute of Technology, Vellore, India
| |
Collapse
|
8
|
Zhang L, Wang L, Liu T, Zhu D. Disease2Vec: Encoding Alzheimer's progression via disease embedding tree. Pharmacol Res 2024; 199:107038. [PMID: 38072216 PMCID: PMC11334056 DOI: 10.1016/j.phrs.2023.107038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 11/06/2023] [Accepted: 12/07/2023] [Indexed: 12/17/2023]
Abstract
For decades, a variety of predictive approaches have been proposed and evaluated in terms of their prediction capability for Alzheimer's Disease (AD) and its precursor - mild cognitive impairment (MCI). Most of them focused on prediction or identification of statistical differences among different clinical groups or phases, especially in the context of binary or multi-class classification. The continuous nature of AD development and transition states between successive AD related stages have been typically overlooked. Though a few progression models of AD have been studied recently, they were mainly designed to determine and compare the order of specific biomarkers. How to effectively predict the individual patient's status within a wide spectrum of continuous AD progression has been largely understudied. In this work, we developed a novel learning-based embedding framework to encode the intrinsic relations among AD related clinical stages by a set of meaningful embedding vectors in the latent space (Disease2Vec). We named this process as disease embedding. By Disease2Vec, our framework generates a disease embedding tree (DETree) which effectively represents different clinical stages as a tree trajectory reflecting AD progression and thus can be used to predict clinical status by projecting individuals onto this continuous trajectory. Through this model, DETree can not only perform efficient and accurate prediction for patients at any stages of AD development (across five fine-grained clinical groups instead of typical two groups), but also provide richer status information by examining the projecting locations within a wide and continuous AD progression process. (Code will be available: https://github.com/qidianzl/Disease2Vec.).
Collapse
Affiliation(s)
- Lu Zhang
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA
| | - Li Wang
- Department of Mathematics, The University of Texas at Arlington, Arlington, TX, USA
| | - Tianming Liu
- Department of Computer Science, The University of Georgia, Athens, GA, USA
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA.
| |
Collapse
|
9
|
Hong Y, Cornea E, Girault JB, Bagonis M, Foster M, Kim SH, Prieto JC, Chen H, Gao W, Styner MA, Gilmore JH. Structural and functional connectome relationships in early childhood. Dev Cogn Neurosci 2023; 64:101314. [PMID: 37898019 PMCID: PMC10630618 DOI: 10.1016/j.dcn.2023.101314] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 09/27/2023] [Accepted: 10/12/2023] [Indexed: 10/30/2023] Open
Abstract
There is strong evidence that the functional connectome is highly related to the white matter connectome in older children and adults, though little is known about structure-function relationships in early childhood. We investigated the development of cortical structure-function coupling in children longitudinally scanned at 1, 2, 4, and 6 years of age (N = 360) and in a comparison sample of adults (N = 89). We also applied a novel graph convolutional neural network-based deep learning model with a new loss function to better capture inter-subject heterogeneity and predict an individual's functional connectivity from the corresponding structural connectivity. We found regional patterns of structure-function coupling in early childhood that were consistent with adult patterns. In addition, our deep learning model improved the prediction of individual functional connectivity from its structural counterpart compared to existing models.
Collapse
Affiliation(s)
- Yoonmi Hong
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America.
| | - Emil Cornea
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America
| | - Jessica B Girault
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America; Carolina Institute for Developmental Disabilities, University of North Carolina at Chapel Hill, United States of America
| | - Maria Bagonis
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America
| | - Mark Foster
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America
| | - Sun Hyung Kim
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America
| | - Juan Carlos Prieto
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America
| | - Haitao Chen
- Biomedical Imaging Research Institute (BIRI), Department of Biomedical Sciences and Imaging, Cedars-Sinai Medical Center, United States of America
| | - Wei Gao
- Biomedical Imaging Research Institute (BIRI), Department of Biomedical Sciences and Imaging, Cedars-Sinai Medical Center, United States of America
| | - Martin A Styner
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America; Department of Computer Science, University of North Carolina at Chapel Hill, United States of America
| | - John H Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, United States of America
| |
Collapse
|
10
|
Ye K, Tang H, Dai S, Guo L, Liu JY, Wang Y, Leow A, Thompson PM, Huang H, Zhan L. Bidirectional Mapping with Contrastive Learning on Multimodal Neuroimaging Data. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2023; 14222:138-148. [PMID: 39005889 PMCID: PMC11245326 DOI: 10.1007/978-3-031-43898-1_14] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/16/2024]
Abstract
The modeling of the interaction between brain structure and function using deep learning techniques has yielded remarkable success in identifying potential biomarkers for different clinical phenotypes and brain diseases. However, most existing studies focus on one-way mapping, either projecting brain function to brain structure or inversely. This type of unidirectional mapping approach is limited by the fact that it treats the mapping as a one-way task and neglects the intrinsic unity between these two modalities. Moreover, when dealing with the same biological brain, mapping from structure to function and from function to structure yields dissimilar outcomes, highlighting the likelihood of bias in one-way mapping. To address this issue, we propose a novel bidirectional mapping model, named Bidirectional Mapping with Contrastive Learning (BMCL), to reduce the bias between these two unidirectional mappings via ROI-level contrastive learning. We evaluate our framework on clinical phenotype and neurodegenerative disease predictions using two publicly available datasets (HCP and OASIS). Our results demonstrate the superiority of BMCL compared to several state-of-the-art methods.
Collapse
Affiliation(s)
- Kai Ye
- University of Pittsburgh, Pittsburgh, PA 15260, USA
| | - Haoteng Tang
- University of Texas Rio Grande Valley, Edinburg, TX 78539, USA
| | - Siyuan Dai
- University of Pittsburgh, Pittsburgh, PA 15260, USA
| | - Lei Guo
- University of Pittsburgh, Pittsburgh, PA 15260, USA
| | - Johnny Yuehan Liu
- Thomas Jefferson High School for Science and Technology, Alexandria, VA 22312, USA
| | - Yalin Wang
- Arizona State University, Tempe, AZ 85287, USA
| | - Alex Leow
- University of Illinois at Chicago, Chicago, IL 60612, USA
| | - Paul M Thompson
- University of Southern California, Los Angeles, CA 90032, USA
| | - Heng Huang
- University of Maryland, College Park, MD 20742, USA
| | - Liang Zhan
- University of Pittsburgh, Pittsburgh, PA 15260, USA
| |
Collapse
|
11
|
Cai H, Sheng X, Wu G, Hu B, Cheung YM, Chen J. Brain Network Classification for Accurate Detection of Alzheimer's Disease via Manifold Harmonic Discriminant Analysis. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; PP:10.1109/TNNLS.2023.3301456. [PMID: 37566497 PMCID: PMC10858979 DOI: 10.1109/tnnls.2023.3301456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/13/2023]
Abstract
Mounting evidence shows that Alzheimer's disease (AD) manifests the dysfunction of the brain network much earlier before the onset of clinical symptoms, making its early diagnosis possible. Current brain network analyses treat high-dimensional network data as a regular matrix or vector, which destroys the essential network topology, thereby seriously affecting diagnosis accuracy. In this context, harmonic waves provide a solid theoretical background for exploring brain network topology. However, the harmonic waves are originally intended to discover neurological disease propagation patterns in the brain, which makes it difficult to accommodate brain disease diagnosis with high heterogeneity. To address this challenge, this article proposes a network manifold harmonic discriminant analysis (MHDA) method for accurately detecting AD. Each brain network is regarded as an instance drawn on a Stiefel manifold. Every instance is represented by a set of orthonormal eigenvectors (i.e., harmonic waves) derived from its Laplacian matrix, which fully respects the topological structure of the brain network. An MHDA method within the Stiefel space is proposed to identify the group-dependent common harmonic waves, which can be used as group-specific references for downstream analyses. Extensive experiments are conducted to demonstrate the effectiveness of the proposed method in stratifying cognitively normal (CN) controls, mild cognitive impairment (MCI), and AD.
Collapse
Affiliation(s)
- Hongmin Cai
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, Guangdong, China
| | - Xiaoqi Sheng
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, Guangdong, China
| | - Guorong Wu
- Department of Psychiatry and Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Bin Hu
- School of Medical Technology at Beijing Institute of Technology, Beijing Institute of Technology, Beijing, China
| | - Yiu-Ming Cheung
- Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR, China
| | - Jiazhou Chen
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, Guangdong, China
| |
Collapse
|
12
|
Cao Y, Kuai H, Liang P, Pan JS, Yan J, Zhong N. BNLoop-GAN: a multi-loop generative adversarial model on brain network learning to classify Alzheimer's disease. Front Neurosci 2023; 17:1202382. [PMID: 37424996 PMCID: PMC10326383 DOI: 10.3389/fnins.2023.1202382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2023] [Accepted: 05/09/2023] [Indexed: 07/11/2023] Open
Abstract
Recent advancements in AI, big data analytics, and magnetic resonance imaging (MRI) have revolutionized the study of brain diseases such as Alzheimer's Disease (AD). However, most AI models used for neuroimaging classification tasks have limitations in their learning strategies, that is batch training without the incremental learning capability. To address such limitations, the systematic Brain Informatics methodology is reconsidered to realize evidence combination and fusion computing with multi-modal neuroimaging data through continuous learning. Specifically, we introduce the BNLoop-GAN (Loop-based Generative Adversarial Network for Brain Network) model, utilizing multiple techniques such as conditional generation, patch-based discrimination, and Wasserstein gradient penalty to learn the implicit distribution of brain networks. Moreover, a multiple-loop-learning algorithm is developed to combine evidence with better sample contribution ranking during training processes. The effectiveness of our approach is demonstrated through a case study on the classification of individuals with AD and healthy control groups using various experimental design strategies and multi-modal brain networks. The BNLoop-GAN model with multi-modal brain networks and multiple-loop-learning can improve classification performance.
Collapse
Affiliation(s)
- Yu Cao
- Faculty of Information Technology, Beijing University of Technology, Beijing, China
- Beijing International Collaboration Base on Brain Informatics and Wisdom Services, Beijing, China
| | - Hongzhi Kuai
- Faculty of Engineering, Maebashi Institute of Technology, Maebashi, Gunma, Japan
| | - Peipeng Liang
- School of Psychology and Beijing Key Laboratory of Learning and Cognition, Capital Normal University, Beijing, China
| | - Jeng-Shyang Pan
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, China
| | - Jianzhuo Yan
- Faculty of Information Technology, Beijing University of Technology, Beijing, China
- Beijing International Collaboration Base on Brain Informatics and Wisdom Services, Beijing, China
| | - Ning Zhong
- Beijing International Collaboration Base on Brain Informatics and Wisdom Services, Beijing, China
- Faculty of Engineering, Maebashi Institute of Technology, Maebashi, Gunma, Japan
- School of Psychology and Beijing Key Laboratory of Learning and Cognition, Capital Normal University, Beijing, China
| |
Collapse
|
13
|
Zhang S, Zhang T, He Z, Li X, Zhang L, Zhu D, Jiang X, Liu T, Han J, Guo L. Gyral peaks and patterns in human brains. Cereb Cortex 2023; 33:6708-6722. [PMID: 36646465 PMCID: PMC10422926 DOI: 10.1093/cercor/bhac537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Revised: 12/19/2022] [Accepted: 12/20/2022] [Indexed: 01/18/2023] Open
Abstract
Cortical folding patterns are related to brain function, cognition, and behavior. Since the relationship has not been fully explained on a coarse scale, many efforts have been devoted to the identification of finer grained cortical landmarks, such as sulcal pits and gyral peaks, which were found to remain invariant across subjects and ages and the invariance may be related to gene mediated proto-map. However, gyral peaks were only investigated on macaque monkey brains, but not on human brains where the investigation is challenged due to high inter-individual variabilities. To this end, in this work, we successfully identified 96 gyral peaks both on the left and right hemispheres of human brains, respectively. These peaks are spatially consistent across individuals. Higher or sharper peaks are more consistent across subjects. Both structural and functional graph metrics of peaks are significantly different from other cortical regions, and more importantly, these nodal graph metrics are anti-correlated with the spatial consistency metrics within peaks. In addition, the distribution of peaks and various cortical anatomical, structural/functional connective features show hemispheric symmetry. These findings provide new clues to understanding the cortical landmarks, as well as their relationship with brain functions, cognition, behavior in both healthy and aberrant brains.
Collapse
Affiliation(s)
- Songyao Zhang
- School of Automation, School of Information Technology, and School of Life Science and Technology, Northwestern Polytechnical University, Xi’an 710000, China
| | - Tuo Zhang
- School of Automation, School of Information Technology, and School of Life Science and Technology, Northwestern Polytechnical University, Xi’an 710000, China
| | - Zhibin He
- School of Automation, School of Information Technology, and School of Life Science and Technology, Northwestern Polytechnical University, Xi’an 710000, China
| | - Xiao Li
- School of Automation, School of Information Technology, and School of Life Science and Technology, Northwest University, Xi’an, China
| | - Lu Zhang
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, United States
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, United States
| | - Xi Jiang
- School of Automation, School of Information Technology, and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, Department of Computer Science and Bioimaging Research Center, The University of Georgia, Athens, GA 30605, United States
| | - Junwei Han
- School of Automation, School of Information Technology, and School of Life Science and Technology, Northwestern Polytechnical University, Xi’an 710000, China
| | - Lei Guo
- School of Automation, School of Information Technology, and School of Life Science and Technology, Northwestern Polytechnical University, Xi’an 710000, China
| |
Collapse
|
14
|
Zhang L, Yu X, Lyu Y, Liu T, Zhu D. REPRESENTATIVE FUNCTIONAL CONNECTIVITY LEARNING FOR MULTIPLE CLINICAL GROUPS IN ALZHEIMER'S DISEASE. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2023; 2023. [PMID: 38414667 PMCID: PMC10897952 DOI: 10.1109/isbi53787.2023.10230521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/29/2024]
Abstract
Mild cognitive impairment (MCI) is a high-risk dementia condition which progresses to probable Alzheimer's disease (AD) at approximately 10% to 15% per year. Characterization of group-level differences between two subtypes of MCI - stable MCI (sMCI) and progressive MCI (pMCI) is the key step to understand the mechanisms of MCI progression and enable possible delay of transition from MCI to AD. Functional connectivity (FC) is considered as a promising way to study MCI progression since which may show alterations even in preclinical stages and provide substrates for AD progression. However, the representative FC patterns during AD development for different clinical groups, especially for sMCI and pMCI, have been understudied. In this work, we integrated autoencoder and multi-class classification into a single deep model and successfully learned a set of clinical group related feature vectors. Specifically, we trained two non-linear mappings which realized the mutual transformations between the original FC space and the feature space. By mapping the learned clinical group related feature vectors to the original FC space, representative FCs were constructed for each group. Moreover, based on these feature vectors, our model achieves a high classification accuracy - 68% for multi-class classification (NC vs SMC vs sMCI vs pMCI vs AD). Code has been released.
Collapse
Affiliation(s)
- Lu Zhang
- Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA
| | - Xiaowei Yu
- Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA
| | - Yanjun Lyu
- Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA
| | - Tianming Liu
- Computer Science, The University of Georgia, Athens, USA
| | - Dajiang Zhu
- Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX, USA
| |
Collapse
|
15
|
Tang H, Guo L, Fu X, Wang Y, Mackin S, Ajilore O, Leow AD, Thompson PM, Huang H, Zhan L. Signed graph representation learning for functional-to-structural brain network mapping. Med Image Anal 2023; 83:102674. [PMID: 36442294 PMCID: PMC9904311 DOI: 10.1016/j.media.2022.102674] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 10/04/2022] [Accepted: 10/27/2022] [Indexed: 11/18/2022]
Abstract
MRI-derived brain networks have been widely used to understand functional and structural interactions among brain regions, and factors that affect them, such as brain development and diseases. Graph mining on brain networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Since brain functional and structural networks describe the brain topology from different perspectives, exploring a representation that combines these cross-modality brain networks has significant clinical implications. Most current studies aim to extract a fused representation by projecting the structural network to the functional counterpart. Since the functional network is dynamic and the structural network is static, mapping a static object to a dynamic object may not be optimal. However, mapping in the opposite direction (i.e., from functional to structural networks) are suffered from the challenges introduced by negative links within signed graphs. Here, we propose a novel graph learning framework, named as Deep Signed Brain Graph Mining or DSBGM, with a signed graph encoder that, from an opposite perspective, learns the cross-modality representations by projecting the functional network to the structural counterpart. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets (HCP and OASIS). Our experimental results clearly demonstrate the advantages of our model compared to several state-of-the-art methods.
Collapse
Affiliation(s)
- Haoteng Tang
- University of Pittsburgh, 3700 O'Hara St., Pittsburgh, 15261, PA, USA.
| | - Lei Guo
- University of Pittsburgh, 3700 O'Hara St., Pittsburgh, 15261, PA, USA
| | - Xiyao Fu
- University of Pittsburgh, 3700 O'Hara St., Pittsburgh, 15261, PA, USA
| | - Yalin Wang
- Arizona State University, 699 S Mill Ave., Tempe, 85281, AZ, USA
| | - Scott Mackin
- University of California San Francisco, 505 Parnassus Ave., San Francisco, 94143, CA, USA
| | - Olusola Ajilore
- University of Illinois Chicago, 1601 W. Taylor St., Chicago, 60612, IL, USA
| | - Alex D Leow
- University of Illinois Chicago, 1601 W. Taylor St., Chicago, 60612, IL, USA
| | - Paul M Thompson
- University of Southern California, 2001 N. Soto St., Los Angeles, 90032, CA, USA
| | - Heng Huang
- University of Pittsburgh, 3700 O'Hara St., Pittsburgh, 15261, PA, USA
| | - Liang Zhan
- University of Pittsburgh, 3700 O'Hara St., Pittsburgh, 15261, PA, USA.
| |
Collapse
|
16
|
Zhang L, Zhao L, Liu D, Wu Z, Wang X, Liu T, Zhu D. Cortex2vector: anatomical embedding of cortical folding patterns. Cereb Cortex 2022; 33:5851-5862. [PMID: 36487182 PMCID: PMC10183757 DOI: 10.1093/cercor/bhac465] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 11/01/2022] [Accepted: 11/02/2022] [Indexed: 12/13/2022] Open
Abstract
Abstract
Current brain mapping methods highly depend on the regularity, or commonality, of anatomical structure, by forcing the same atlas to be matched to different brains. As a result, individualized structural information can be overlooked. Recently, we conceptualized a new type of cortical folding pattern called the 3-hinge gyrus (3HG), which is defined as the conjunction of gyri coming from three directions. Many studies have confirmed that 3HGs are not only widely existing on different brains, but also possess both common and individual patterns. In this work, we put further effort, based on the identified 3HGs, to establish the correspondences of individual 3HGs. We developed a learning-based embedding framework to encode individual cortical folding patterns into a group of anatomically meaningful embedding vectors (cortex2vector). Each 3HG can be represented as a combination of these embedding vectors via a set of individual specific combining coefficients. In this way, the regularity of folding pattern is encoded into the embedding vectors, while the individual variations are preserved by the multi-hop combination coefficients. Results show that the learned embeddings can simultaneously encode the commonality and individuality of cortical folding patterns, as well as robustly infer the complicated many-to-many anatomical correspondences among different brains.
Collapse
Affiliation(s)
- Lu Zhang
- Department of Computer Science and Engineering, The University of Texas at Arlington , Arlington, 76010, USA
| | - Lin Zhao
- Department of Computer Science, The University of Georgia , Athens, 30602, USA
| | | | - Zihao Wu
- Department of Computer Science, The University of Georgia , Athens, 30602, USA
| | - Xianqiao Wang
- College of Engineering, The University of Georgia , Athens, 30602, USA
| | - Tianming Liu
- Department of Computer Science, The University of Georgia , Athens, 30602, USA
| | - Dajiang Zhu
- Department of Computer Science and Engineering, The University of Texas at Arlington , Arlington, 76010, USA
| |
Collapse
|
17
|
Longitudinal Infant Functional Connectivity Prediction via Conditional Intensive Triplet Network. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13438:255-264. [PMID: 36563062 PMCID: PMC9769983 DOI: 10.1007/978-3-031-16452-1_25] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Longitudinal infant brain functional connectivity (FC) constructed from resting-state functional MRI (rs-fMRI) has increasingly become a pivotal tool in studying the dynamics of early brain development. However, due to various reasons including high acquisition cost, strong motion artifact, and subject dropout, there has been an extreme shortage of usable longitudinal infant rs-fMRI scans to construct longitudinal FCs, which hinders comprehensive understanding and modeling of brain functional development at early ages. To address this issue, in this paper, we propose a novel conditional intensive triplet network (CITN) for longitudinal prediction of the dynamic development of infant FC, which can traverse FCs within a long duration and predict the target FC at any specific age during infancy. Targeting at accurately modeling of the progression pattern of FC, while maintaining the individual functional uniqueness, our model effectively disentangles the intrinsically mixed age-related and identity-related information from the source FC and predicts the target FC by fusing well-disentangled identity-related information with the specific age-related information. Specifically, we introduce an intensive triplet auto-encoder for effective disentanglement of age-related and identity-related information and an identity conditional module to mix identity-related information with designated age-related information. We train the proposed model in a self-supervised way and design downstream tasks to help robustly disentangle age-related and identity-related features. Experiments on 464 longitudinal infant fMRI scans show the superior performance of the proposed method in longitudinal FC prediction in comparison with state-of-the-art approaches.
Collapse
|
18
|
Lei B, Zhang Y, Liu D, Xu Y, Yue G, Cao J, Hu H, Yu S, Yang P, Wang T, Qiu Y, Xiao X, Wang S. Longitudinal study of early mild cognitive impairment via similarity-constrained group learning and self-attention based SBi-LSTM. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|