Predicting brain structural network using functional connectivity

Krakencoder: a unified brain connectome translation and fusion tool

Brain connectivity can be estimated in many ways, depending on modality and processing strategy. Here, we present the Krakencoder, a joint connectome mapping tool that simultaneously bidirectionally translates between structural and functional connectivity, and between different atlases and processing choices via a common latent representation. These mappings demonstrate exceptional accuracy and individual-level identifiability; the mapping between structural and functional connectivity has identifiability 42-54% higher than existing models. The Krakencoder combines all connectome flavors via a shared low-dimensional latent space. This fusion representation better reflects familial relatedness, preserves age- and sex-relevant information, and enhances cognition-relevant information. The Krakencoder can be applied, without retraining, to new out-of-distribution data while still preserving inter-individual differences in the connectome predictions and familial relationships in the latent representations. The Krakencoder is a notable leap forward in capturing the relationship between multimodal brain connectomes in an individualized, behaviorally and demographically relevant way.

Early Development and Co-Evolution of Microstructural and Functional Brain Connectomes: A Multi-Modal MRI Study in Preterm and Full-Term Infants

Functional networks characterized by coherent neural activity across distributed brain regions have been observed to emerge early in neurodevelopment. Synchronized maturation across regions that relate to functional connectivity (FC) could be partially reflected in the developmental changes in underlying microstructure. Nevertheless, covariation of regional microstructural properties, termed "microstructural connectivity" (MC), and its relationship to the emergence of functional specialization during the early neurodevelopmental period remain poorly understood. We investigated the evolution of MC and FC postnatally across a set of cortical and subcortical regions, focusing on 45 preterm infants scanned longitudinally, and compared to 45 matched full-term neonates as part of the developing Human Connectome Project (dHCP) using direct comparisons of grey-matter connectivity strengths as well as network-based analyses. Our findings revealed a global strengthening of both MC and FC with age, with connection-specific variability influenced by the connection maturational stage. Prematurity at term-equivalent age was associated with significant connectivity disruptions, particularly in FC. During the preterm period, direct comparisons of MC and FC strength showed a positive linear relationship, which seemed to weaken with development. On the other hand, overlaps between MC- and FC-derived networks (estimated with Mutual Information) increased with age, suggesting a potential convergence towards a shared underlying network structure that may support the co-evolution of microstructural and functional systems. Our study offers novel insights into the dynamic interplay between microstructural and functional brain development and highlights the potential of MC as a complementary descriptor for characterizing brain network development and alterations due to perinatal insults such as premature birth.

Structural connectivity of the fore- and mid-brain in prairie voles

Mammals live in complex social systems that require higher order cognition to process and display complex social behaviors. It is suggested that brain networks, such as the social decision-making network (SDMN), have evolved to process such information. Recent functional connectivity studies of the SDMN have revealed distinct network dynamics during different social events across several species. However, the structural mapping of this network is incomplete which limits structural-functional modeling. Here, we assess the structural connectivity of an extended SDMN as well as the fore- and mid-brain afferent projections with the use of cholera toxin subunit-B retrograde tracers and the prairie vole (Microtus ochrogaster), a socially monogamous rodent that displays complex social behaviors. This work greatly expands upon the limited structural connectivity of the vole social brain and highlights important regions within the SDMN and other highly innervated regions that may serve as information hubs.

CSEPC: a deep learning framework for classifying small-sample multimodal medical image data in Alzheimer's disease

BACKGROUND

Alzheimer's disease (AD) is a neurodegenerative disorder that significantly impacts health care worldwide, particularly among the elderly population. The accurate classification of AD stages is essential for slowing disease progression and guiding effective interventions. However, limited sample sizes continue to present a significant challenge in classifying the stages of AD progression. Addressing this obstacle is crucial for improving diagnostic accuracy and optimizing treatment strategies for those affected by AD.

METHODS

In this study, we proposed cross-scale equilibrium pyramid coupling (CSEPC), which is a novel diagnostic algorithm designed for small-sample multimodal medical imaging data. CSEPC leverages scale equilibrium theory and modal coupling properties to integrate semantic features from different imaging modalities and across multiple scales within each modality. The architecture first extracts balanced multiscale features from structural MRI (sMRI) data and functional MRI (fMRI) data using a cross-scale pyramid module. These features are then combined through a contrastive learning-based cosine similarity coupling mechanism to capture intermodality associations effectively. This approach enhances the representation of both inter- and intramodal features while significantly reducing the number of learning parameters, making it highly suitable for small sample environments. We validated the effectiveness of the CSEPC model through experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset and demonstrated its superior performance in diagnosing and staging AD.

RESULTS

Our experimental results demonstrate that the proposed model matches or exceeds the performance of models used in previous studies in AD classification. Specifically, the model achieved an accuracy of 85.67% and an area under the curve (AUC) of 0.98 in classifying the progression from mild cognitive impairment (MCI) to AD. To further validate its effectiveness, we used our method to diagnose different stages of AD. In both classification tasks, our approach delivered superior performance.

CONCLUSIONS

In conclusion, the performance of our model in various tasks has demonstrated its significant potential in the field of small-sample multimodal medical imaging classification, particularly AD classification. This advancement could significantly assist clinicians in effectively managing and intervening in the disease progression of patients with early-stage AD.

Local structural-functional coupling with counterfactual explanations for epilepsy prediction

The structural-functional brain connections coupling (SC-FC coupling) describes the relationship between white matter structural connections (SC) and the corresponding functional activation or functional connections (FC). It has been widely used to identify brain disorders. However, the existing research on SC-FC coupling focuses on global and regional scales, and few studies have investigated the impact of brain disorders on this relationship from the perspective of multi-brain region cooperation (i.e., local scale). Here, we propose the local SC-FC coupling pattern for brain disorders prediction. Compared with previous methods, the proposed patterns quantify the relationship between SC and FC in terms of subgraphs rather than whole connections or single brain regions. Specifically, we first construct structural and functional connections using diffusion tensor imaging (DTI) and resting-state functional magnetic resonance imaging (rs-fMRI) data, subsequently organizing them into a multimodal brain network. Then, we extract subgraphs from these multimodal brain networks and select them based on their frequencies to generate local SC-FC coupling patterns. Finally, we employ these patterns to identify brain disorders while refining abnormal patterns to generate counterfactual explanations. Results on a real epilepsy dataset suggest that the proposed method not only outperforms existing methods in accuracy but also provides insights into the local SC-FC coupling pattern and their changes in brain disorders. Code available at https://github.com/UAIBC-Brain/Local-SC-FC-coupling-pattern.

Applications of MRI in Schizophrenia: Current Progress in Establishing Clinical Utility

Schizophrenia is a severe mental illness that significantly impacts the lives of affected individuals and with increasing mortality rates. Early detection and intervention are crucial for improving outcomes but the lack of validated biomarkers poses great challenges in such efforts. The use of magnetic resonance imaging (MRI) in schizophrenia enables the investigation of the disorder's etiological and neuropathological substrates in vivo. After decades of research, promising findings of MRI have been shown to aid in screening high-risk individuals and predicting illness onset, and predicting symptoms and treatment outcomes of schizophrenia. The integration of machine learning and deep learning techniques makes it possible to develop intelligent diagnostic and prognostic tools with extracted or selected imaging features. In this review, we aimed to provide an overview of current progress and prospects in establishing clinical utility of MRI in schizophrenia. We first provided an overview of MRI findings of brain abnormalities that might underpin the symptoms or treatment response process in schizophrenia patients. Then, we summarized the ongoing efforts in the computer-aided utility of MRI in schizophrenia and discussed the gap between MRI research findings and real-world applications. Finally, promising pathways to promote clinical translation were provided. EVIDENCE LEVEL: 2 TECHNICAL EFFICACY: Stage 3.

A Novel Recognition and Classification Approach for Motor Imagery Based on Spatio-Temporal Features

Motor imagery, as a paradigm of brain-computer interface, holds vast potential in the field of medical rehabilitation. Addressing the challenges posed by the non-stationarity and low signal-to-noise ratio of EEG signals, the effective extraction of features from motor imagery signals for accurate recognition stands as a key focus in motor imagery brain-computer interface technology. This paper proposes a motor imagery EEG signal classification model that combines functional brain networks with graph convolutional networks. First, functional brain networks are constructed using different brain functional connectivity metrics, and graph theory features are calculated to deeply analyze the characteristics of brain networks under different motor tasks. Then, the constructed functional brain networks are combined with graph convolutional networks for the classification and recognition of motor imagery tasks. The analysis based on brain functional connectivity reveals that the functional connectivity strength during the both fists task is significantly higher than that of other motor imagery tasks, and the functional connectivity strength during actual movement is generally superior to that of motor imagery tasks. In experiments conducted on the Physionet public dataset, the proposed model achieved a classification accuracy of 88.39% under multi-subject conditions, significantly outperforming traditional methods. Under single-subject conditions, the model effectively addressed the issue of individual variability, achieving an average classification accuracy of 99.31%. These results indicate that the proposed model not only exhibits excellent performance in the classification of motor imagery tasks but also provides new insights into the functional connectivity characteristics of different motor tasks and their corresponding brain regions.

Harmonic Wavelet Neural Network for Discovering Neuropathological Propagation Patterns in Alzheimer's Disease

Emerging researchindicates that the degenerative biomarkers associated with Alzheimer's disease (AD) exhibit a non-random distribution within the cerebral cortex, instead following the structural brain network. The alterations in brain networks occur much earlier than the onset of clinical symptoms, thereby affecting the progression of brain disease. In this context, the utilization of computational methods to ascertain the propagation patterns of neuropathological events would contribute to the comprehension of the pathophysiological mechanism involved in the evolution of AD. Despite the encouraging findings achieved by existing graph-based deep learning approaches in analyzing irregular graph data, their applications in identifying the spreading pathway of neuropathology are limited due to two disadvantages. They include (1) lack of a common brain network as an unbiased reference basis for group comparison, and (2) lack of an appropriate mechanism for the identification of propagation patterns. To this end, we propose a proof-of-concept harmonic wavelet neural network (HWNN) to predict the early stage of AD and localize disease-related significant wavelets, which can be used to characterize the spreading pathways of neuropathological events across the brain network. The extensive experiments constructed on both synthetic and real datasets demonstrate that our proposed method achieves superior performance in classification accuracy and statistical power of identifying propagation patterns, compared with other representative approaches.

Learning lifespan brain anatomical correspondence via cortical developmental continuity transfer

Identifying anatomical correspondences in the human brain throughout the lifespan is an essential prerequisite for studying brain development and aging. But given the tremendous individual variability in cortical folding patterns, the heterogeneity of different neurodevelopmental stages, and the scarce of neuroimaging data, it is difficult to infer reliable lifespan anatomical correspondence at finer scales. To solve this problem, in this work, we take the advantage of the developmental continuity of the cerebral cortex and propose a novel transfer learning strategy: the model is trained from scratch using the age group with the largest sample size, and then is transferred and adapted to the other groups following the cortical developmental trajectory. A novel loss function is designed to ensure that during the transfer process the common patterns will be extracted and preserved, while the group-specific new patterns will be captured. The proposed framework was evaluated using multiple datasets covering four lifespan age groups with 1,000+ brains (from 34 gestational weeks to young adult). Our experimental results show that: 1) the proposed transfer strategy can dramatically improve the model performance on populations (e.g., early neurodevelopment) with very limited number of training samples; and 2) with the transfer learning we are able to robustly infer the complicated many-to-many anatomical correspondences among different brains at different neurodevelopmental stages. (Code will be released soon: https://github.com/qidianzl/CDC-transfer).

Predicting an individual's functional connectivity from their structural connectome: Evaluation of evidence, recommendations, and future prospects

Several recent studies have optimized deep neural networks to learn high-dimensional relationships linking structural and functional connectivity across the human connectome. However, the extent to which these models recapitulate individual-specific characteristics of resting-state functional brain networks remains unclear. A core concern relates to whether current individual predictions outperform simple benchmarks such as group averages and null conditions. Here, we consider two measures to statistically evaluate whether functional connectivity predictions capture individual effects. We revisit our previously published functional connectivity predictions for 1,000 healthy adults and provide multiple lines of evidence supporting that our predictions successfully capture subtle individual-specific variation in connectivity. While predicted individual effects are statistically significant and outperform several benchmarks, we find that effect sizes are small (i.e., 8%-11% improvement relative to group-average benchmarks). As such, initial expectations about individual prediction performance expressed by us and others may require moderation. We conclude that individual predictions can significantly outperform appropriate benchmark conditions and we provide several recommendations for future studies in this area. Future studies should statistically assess the individual prediction performance of their models using one of the measures and benchmarks provided here.

Brain Network Classification for Accurate Detection of Alzheimer's Disease via Manifold Harmonic Discriminant Analysis

Mounting evidence shows that Alzheimer's disease (AD) manifests the dysfunction of the brain network much earlier before the onset of clinical symptoms, making its early diagnosis possible. Current brain network analyses treat high-dimensional network data as a regular matrix or vector, which destroys the essential network topology, thereby seriously affecting diagnosis accuracy. In this context, harmonic waves provide a solid theoretical background for exploring brain network topology. However, the harmonic waves are originally intended to discover neurological disease propagation patterns in the brain, which makes it difficult to accommodate brain disease diagnosis with high heterogeneity. To address this challenge, this article proposes a network manifold harmonic discriminant analysis (MHDA) method for accurately detecting AD. Each brain network is regarded as an instance drawn on a Stiefel manifold. Every instance is represented by a set of orthonormal eigenvectors (i.e., harmonic waves) derived from its Laplacian matrix, which fully respects the topological structure of the brain network. An MHDA method within the Stiefel space is proposed to identify the group-dependent common harmonic waves, which can be used as group-specific references for downstream analyses. Extensive experiments are conducted to demonstrate the effectiveness of the proposed method in stratifying cognitively normal (CN) controls, mild cognitive impairment (MCI), and AD.

Comparing structure-function relationships in brain networks using EEG and fNIRS

Identifying relationships between structural and functional networks is crucial for understanding the large-scale organization of the human brain. The potential contribution of emerging techniques like functional near-infrared spectroscopy to investigate the structure-functional relationship has yet to be explored. In our study, using simultaneous Electroencephalography (EEG) and Functional near-infrared spectroscopy (fNIRS) recordings from 18 subjects, we characterize global and local structure-function coupling using source-reconstructed EEG and fNIRS signals in both resting state and motor imagery tasks, as this relationship during task periods remains underexplored. Employing the mathematical framework of graph signal processing, we investigate how this relationship varies across electrical and hemodynamic networks and different brain states. Results show that fNIRS structure-function coupling resembles slower-frequency EEG coupling at rest, with variations across brain states and oscillations. Locally, the relationship is heterogeneous, with greater coupling in the sensory cortex and increased decoupling in the association cortex, following the unimodal to transmodal gradient. Discrepancies between EEG and fNIRS are noted, particularly in the frontoparietal network. Cross-band representations of neural activity revealed lower correspondence between electrical and hemodynamic activity in the transmodal cortex, irrespective of brain state while showing specificity for the somatomotor network during a motor imagery task. Overall, these findings initiate a multimodal comprehension of structure-function relationship and brain organization when using affordable functional brain imaging.

CE-GAN: Community Evolutionary Generative Adversarial Network for Alzheimer's Disease Risk Prediction

In the studies of neurodegenerative diseases such as Alzheimer's Disease (AD), researchers often focus on the associations among multi-omics pathogeny based on imaging genetics data. However, current studies overlook the communities in brain networks, leading to inaccurate models of disease development. This paper explores the developmental patterns of AD from the perspective of community evolution. We first establish a mathematical model to describe functional degeneration in the brain as the community evolution driven by entropy information propagation. Next, we propose an interpretable Community Evolutionary Generative Adversarial Network (CE-GAN) to predict disease risk. In the generator of CE-GAN, community evolutionary convolutions are designed to capture the evolutionary patterns of AD. The experiments are conducted using functional magnetic resonance imaging (fMRI) data and single nucleotide polymorphism (SNP) data. CE-GAN achieves 91.67% accuracy and 91.83% area under curve (AUC) in AD risk prediction tasks, surpassing advanced methods on the same dataset. In addition, we validated the effectiveness of CE-GAN for pathogeny extraction. The source code of this work is available at https://github.com/fmri123456/CE-GAN.

Release the Krakencoder: A unified brain connectome translation and fusion tool

Brain connectivity can be estimated in many ways, depending on modality and processing strategy. Here we present the Krakencoder, a joint connectome mapping tool that simultaneously, bidirectionally translates between structural (SC) and functional connectivity (FC), and across different atlases and processing choices via a common latent representation. These mappings demonstrate unprecedented accuracy and individual-level identifiability; the mapping between SC and FC has identifiability 42-54% higher than existing models. The Krakencoder combines all connectome flavors via a shared low-dimensional latent space. This "fusion" representation i) better reflects familial relatedness, ii) preserves age- and sex-relevant information and iii) enhances cognition-relevant information. The Krakencoder can be applied without retraining to new, out-of-age-distribution data while still preserving inter-individual differences in the connectome predictions and familial relationships in the latent representations. The Krakencoder is a significant leap forward in capturing the relationship between multi-modal brain connectomes in an individualized, behaviorally- and demographically-relevant way.

Contrastive Brain Network Learning via Hierarchical Signed Graph Pooling Model

Recently, brain networks have been widely adopted to study brain dynamics, brain development, and brain diseases. Graph representation learning techniques on brain functional networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. However, current graph learning techniques have several issues on brain network mining. First, most current graph learning models are designed for unsigned graph, which hinders the analysis of many signed network data (e.g., brain functional networks). Meanwhile, the insufficiency of brain network data limits the model performance on clinical phenotypes' predictions. Moreover, few of the current graph learning models are interpretable, which may not be capable of providing biological insights for model outcomes. Here, we propose an interpretable hierarchical signed graph representation learning (HSGPL) model to extract graph-level representations from brain functional networks, which can be used for different prediction tasks. To further improve the model performance, we also propose a new strategy to augment functional brain network data for contrastive learning. We evaluate this framework on different classification and regression tasks using data from human connectome project (HCP) and open access series of imaging studies (OASIS). Our results from extensive experiments demonstrate the superiority of the proposed model compared with several state-of-the-art techniques. In addition, we use graph saliency maps, derived from these prediction tasks, to demonstrate detection and interpretation of phenotypic biomarkers.

ENHANCING GROUP-WISE CONSISTENCY IN 3-HINGE GYRUS MATCHING VIA ANATOMICAL EMBEDDING AND STRUCTURAL CONNECTIVITY OPTIMIZATION

Recently, a novel cortical folding pattern known as the 3-hinge gyrus (3HG) has been identified. 3HGs are defined as the convergence of the gyri coming from three distinct directions on gyral crests. In contrast to cortical regions, 3HGs are defined at a finer scale and they widely exist across different individuals, representing both commonalities and individualities of cortical folding patterns. It is important to note that 3HGs are identified in individual spaces, lacking natural cross-subject correspondences. To address this issue, we have developed a learning-based method to encode anatomical features of 3HGs into a set of embedding vectors that can be compared across individuals. However, this method solely relies on anatomical features and can be suboptimal because it does not consider the related structural connectivity patterns, as many 3HGs have multiple potential matches using anatomical properties only. In this study, we leverage the multimodal imaging data (T1 MRI and DTI) which are complementary to each other in representing 3HGs, to enhance the precision when identifying one-to-one correspondence for 3HGs. Through extensive experiments, we have demonstrated the effectiveness of our approach in mitigating the one-to-many match issue associated with 3HGs, significantly improving the accuracy of 3HG correspondences. This accomplishment holds considerable implications for group-level analyses based on 3HGs and contributes to the broader utilization of 3HGs in brain studies.

Brain Structural Connectivity Guided Vision Transformers for Identification of Functional Connectivity Characteristics in Preterm Neonates

Preterm birth is the leading cause of death in children under five years old, and is associated with a wide sequence of complications in both short and long term. In view of rapid neurodevelopment during the neonatal period, preterm neonates may exhibit considerable functional alterations compared to term ones. However, the identified functional alterations in previous studies merely achieve moderate classification performance, while more accurate functional characteristics with satisfying discrimination ability for better diagnosis and therapeutic treatment is underexplored. To address this problem, we propose a novel brain structural connectivity (SC) guided Vision Transformer (SCG-ViT) to identify functional connectivity (FC) differences among three neonatal groups: preterm, preterm with early postnatal experience, and term. Particularly, inspired by the neuroscience-derived information, a novel patch token of SC/FC matrix is defined, and the SC matrix is then adopted as an effective mask into the ViT model to screen out input FC patch embeddings with weaker SC, and to focus on stronger ones for better classification and identification of FC differences among the three groups. The experimental results on multi-modal MRI data of 437 neonatal brains from publicly released Developing Human Connectome Project (dHCP) demonstrate that SCG-ViT achieves superior classification ability compared to baseline models, and successfully identifies holistically different FC patterns among the three groups. Moreover, these different FCs are significantly correlated with the differential gene expressions of the three groups. In summary, SCG-ViT provides a powerfully brain-guided pipeline of adopting large-scale and data-intensive deep learning models for medical imaging-based diagnosis.

Graph-Based Conditional Generative Adversarial Networks for Major Depressive Disorder Diagnosis With Synthetic Functional Brain Network Generation

Major Depressive Disorder (MDD) is a pervasive disorder affecting millions of individuals, presenting a significant global health concern. Functional connectivity (FC) derived from resting-state functional Magnetic Resonance Imaging (rs-fMRI) serves as a crucial tool in revealing functional connectivity patterns associated with MDD, playing an essential role in precise diagnosis. However, the limited data availability of FC poses challenges for robust MDD diagnosis. To tackle this, some studies have employed Deep Neural Networks (DNN) architectures to construct Generative Adversarial Networks (GAN) for synthetic FC generation, but this tends to overlook the inherent topology characteristics of FC. To overcome this challenge, we propose a novel Graph Convolutional Networks (GCN)-based Conditional GAN with Class-Aware Discriminator (GC-GAN). GC-GAN utilizes GCN in both the generator and discriminator to capture intricate FC patterns among brain regions, and the class-aware discriminator ensures the diversity and quality of the generated synthetic FC. Additionally, we introduce a topology refinement technique to enhance MDD diagnosis performance by optimizing the topology using the augmented FC dataset. Our framework was evaluated on publicly available rs-fMRI datasets, and the results demonstrate that GC-GAN outperforms existing methods. This indicates the superior potential of GCN in capturing intricate topology characteristics and generating high-fidelity synthetic FC, thus contributing to a more robust MDD diagnosis.

Exploring Alzheimer's disease: a comprehensive brain connectome-based survey

Dementia is an escalating global health challenge, with Alzheimer's disease (AD) at its forefront. Substantial evidence highlights the accumulation of AD-related pathological proteins in specific brain regions and their subsequent dissemination throughout the broader area along the brain network, leading to disruptions in both individual brain regions and their interconnections. Although a comprehensive understanding of the neurodegeneration-brain network link is lacking, it is undeniable that brain networks play a pivotal role in the development and progression of AD. To thoroughly elucidate the intricate network of elements and connections constituting the human brain, the concept of the brain connectome was introduced. Research based on the connectome holds immense potential for revealing the mechanisms underlying disease development, and it has become a prominent topic that has attracted the attention of numerous researchers. In this review, we aim to systematically summarize studies on brain networks within the context of AD, critically analyze the strengths and weaknesses of existing methodologies, and offer novel perspectives and insights, intending to serve as inspiration for future research.

Connectome-based schizophrenia prediction using structural connectivity - Deep Graph Neural Network(sc-DGNN)

BACKGROUND

Connectome is understanding the complex organization of the human brain's structural and functional connectivity is essential for gaining insights into cognitive processes and disorders.

OBJECTIVE

To improve the prediction accuracy of brain disorder issues, the current study investigates dysconnected subnetworks and graph structures associated with schizophrenia.

METHOD

By using the proposed structural connectivity-deep graph neural network (sc-DGNN) model and compared with machine learning (ML) and deep learning (DL) models.This work attempts to focus on eighty-eight subjects of diffusion magnetic resonance imaging (dMRI), three classical ML, and five DL models.

RESULT

The structural connectivity-deep graph neural network (sc-DGNN) model is proposed to effectively predict dysconnectedness associated with schizophrenia and exhibits superior performance compared to traditional ML and DL (GNNs) methods in terms of accuracy, sensitivity, specificity, precision, F1-score, and Area under receiver operating characteristic (AUC).

CONCLUSION

The classification task on schizophrenia using structural connectivity matrices and experimental results showed that linear discriminant analysis (LDA) performed 72% accuracy rate in ML models and sc-DGNN performed at a 93% accuracy rate in DL models to distinguish between schizophrenia and healthy patients.

Disease2Vec: Encoding Alzheimer's progression via disease embedding tree

For decades, a variety of predictive approaches have been proposed and evaluated in terms of their prediction capability for Alzheimer's Disease (AD) and its precursor - mild cognitive impairment (MCI). Most of them focused on prediction or identification of statistical differences among different clinical groups or phases, especially in the context of binary or multi-class classification. The continuous nature of AD development and transition states between successive AD related stages have been typically overlooked. Though a few progression models of AD have been studied recently, they were mainly designed to determine and compare the order of specific biomarkers. How to effectively predict the individual patient's status within a wide spectrum of continuous AD progression has been largely understudied. In this work, we developed a novel learning-based embedding framework to encode the intrinsic relations among AD related clinical stages by a set of meaningful embedding vectors in the latent space (Disease2Vec). We named this process as disease embedding. By Disease2Vec, our framework generates a disease embedding tree (DETree) which effectively represents different clinical stages as a tree trajectory reflecting AD progression and thus can be used to predict clinical status by projecting individuals onto this continuous trajectory. Through this model, DETree can not only perform efficient and accurate prediction for patients at any stages of AD development (across five fine-grained clinical groups instead of typical two groups), but also provide richer status information by examining the projecting locations within a wide and continuous AD progression process. (Code will be available: https://github.com/qidianzl/Disease2Vec.).

Structural and functional connectome relationships in early childhood

There is strong evidence that the functional connectome is highly related to the white matter connectome in older children and adults, though little is known about structure-function relationships in early childhood. We investigated the development of cortical structure-function coupling in children longitudinally scanned at 1, 2, 4, and 6 years of age (N = 360) and in a comparison sample of adults (N = 89). We also applied a novel graph convolutional neural network-based deep learning model with a new loss function to better capture inter-subject heterogeneity and predict an individual's functional connectivity from the corresponding structural connectivity. We found regional patterns of structure-function coupling in early childhood that were consistent with adult patterns. In addition, our deep learning model improved the prediction of individual functional connectivity from its structural counterpart compared to existing models.

Alzheimer's Disease Prediction via Brain Structural-Functional Deep Fusing Network

Fusing structural-functional images of the brain has shown great potential to analyze the deterioration of Alzheimer's disease (AD). However, it is a big challenge to effectively fuse the correlated and complementary information from multimodal neuroimages. In this work, a novel model termed cross-modal transformer generative adversarial network (CT-GAN) is proposed to effectively fuse the functional and structural information contained in functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI). The CT-GAN can learn topological features and generate multimodal connectivity from multimodal imaging data in an efficient end-to-end manner. Moreover, the swapping bi-attention mechanism is designed to gradually align common features and effectively enhance the complementary features between modalities. By analyzing the generated connectivity features, the proposed model can identify AD-related brain connections. Evaluations on the public ADNI dataset show that the proposed CT-GAN can dramatically improve prediction performance and detect AD-related brain regions effectively. The proposed model also provides new insights into detecting AD-related abnormal neural circuits.

A comprehensive survey of complex brain network representation

Recent years have shown great merits in utilizing neuroimaging data to understand brain structural and functional changes, as well as its relationship to different neurodegenerative diseases and other clinical phenotypes. Brain networks, derived from different neuroimaging modalities, have attracted increasing attention due to their potential to gain system-level insights to characterize brain dynamics and abnormalities in neurological conditions. Traditional methods aim to pre-define multiple topological features of brain networks and relate these features to different clinical measures or demographical variables. With the enormous successes in deep learning techniques, graph learning methods have played significant roles in brain network analysis. In this survey, we first provide a brief overview of neuroimaging-derived brain networks. Then, we focus on presenting a comprehensive overview of both traditional methods and state-of-the-art deep-learning methods for brain network mining. Major models, and objectives of these methods are reviewed within this paper. Finally, we discuss several promising research directions in this field.

Bidirectional Mapping with Contrastive Learning on Multimodal Neuroimaging Data

The modeling of the interaction between brain structure and function using deep learning techniques has yielded remarkable success in identifying potential biomarkers for different clinical phenotypes and brain diseases. However, most existing studies focus on one-way mapping, either projecting brain function to brain structure or inversely. This type of unidirectional mapping approach is limited by the fact that it treats the mapping as a one-way task and neglects the intrinsic unity between these two modalities. Moreover, when dealing with the same biological brain, mapping from structure to function and from function to structure yields dissimilar outcomes, highlighting the likelihood of bias in one-way mapping. To address this issue, we propose a novel bidirectional mapping model, named Bidirectional Mapping with Contrastive Learning (BMCL), to reduce the bias between these two unidirectional mappings via ROI-level contrastive learning. We evaluate our framework on clinical phenotype and neurodegenerative disease predictions using two publicly available datasets (HCP and OASIS). Our results demonstrate the superiority of BMCL compared to several state-of-the-art methods.

BNLoop-GAN: a multi-loop generative adversarial model on brain network learning to classify Alzheimer's disease

Recent advancements in AI, big data analytics, and magnetic resonance imaging (MRI) have revolutionized the study of brain diseases such as Alzheimer's Disease (AD). However, most AI models used for neuroimaging classification tasks have limitations in their learning strategies, that is batch training without the incremental learning capability. To address such limitations, the systematic Brain Informatics methodology is reconsidered to realize evidence combination and fusion computing with multi-modal neuroimaging data through continuous learning. Specifically, we introduce the BNLoop-GAN (Loop-based Generative Adversarial Network for Brain Network) model, utilizing multiple techniques such as conditional generation, patch-based discrimination, and Wasserstein gradient penalty to learn the implicit distribution of brain networks. Moreover, a multiple-loop-learning algorithm is developed to combine evidence with better sample contribution ranking during training processes. The effectiveness of our approach is demonstrated through a case study on the classification of individuals with AD and healthy control groups using various experimental design strategies and multi-modal brain networks. The BNLoop-GAN model with multi-modal brain networks and multiple-loop-learning can improve classification performance.

Gyral peaks and patterns in human brains

Cortical folding patterns are related to brain function, cognition, and behavior. Since the relationship has not been fully explained on a coarse scale, many efforts have been devoted to the identification of finer grained cortical landmarks, such as sulcal pits and gyral peaks, which were found to remain invariant across subjects and ages and the invariance may be related to gene mediated proto-map. However, gyral peaks were only investigated on macaque monkey brains, but not on human brains where the investigation is challenged due to high inter-individual variabilities. To this end, in this work, we successfully identified 96 gyral peaks both on the left and right hemispheres of human brains, respectively. These peaks are spatially consistent across individuals. Higher or sharper peaks are more consistent across subjects. Both structural and functional graph metrics of peaks are significantly different from other cortical regions, and more importantly, these nodal graph metrics are anti-correlated with the spatial consistency metrics within peaks. In addition, the distribution of peaks and various cortical anatomical, structural/functional connective features show hemispheric symmetry. These findings provide new clues to understanding the cortical landmarks, as well as their relationship with brain functions, cognition, behavior in both healthy and aberrant brains.

REPRESENTATIVE FUNCTIONAL CONNECTIVITY LEARNING FOR MULTIPLE CLINICAL GROUPS IN ALZHEIMER'S DISEASE

Mild cognitive impairment (MCI) is a high-risk dementia condition which progresses to probable Alzheimer's disease (AD) at approximately 10% to 15% per year. Characterization of group-level differences between two subtypes of MCI - stable MCI (sMCI) and progressive MCI (pMCI) is the key step to understand the mechanisms of MCI progression and enable possible delay of transition from MCI to AD. Functional connectivity (FC) is considered as a promising way to study MCI progression since which may show alterations even in preclinical stages and provide substrates for AD progression. However, the representative FC patterns during AD development for different clinical groups, especially for sMCI and pMCI, have been understudied. In this work, we integrated autoencoder and multi-class classification into a single deep model and successfully learned a set of clinical group related feature vectors. Specifically, we trained two non-linear mappings which realized the mutual transformations between the original FC space and the feature space. By mapping the learned clinical group related feature vectors to the original FC space, representative FCs were constructed for each group. Moreover, based on these feature vectors, our model achieves a high classification accuracy - 68% for multi-class classification (NC vs SMC vs sMCI vs pMCI vs AD). Code has been released.

Signed graph representation learning for functional-to-structural brain network mapping

MRI-derived brain networks have been widely used to understand functional and structural interactions among brain regions, and factors that affect them, such as brain development and diseases. Graph mining on brain networks can facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Since brain functional and structural networks describe the brain topology from different perspectives, exploring a representation that combines these cross-modality brain networks has significant clinical implications. Most current studies aim to extract a fused representation by projecting the structural network to the functional counterpart. Since the functional network is dynamic and the structural network is static, mapping a static object to a dynamic object may not be optimal. However, mapping in the opposite direction (i.e., from functional to structural networks) are suffered from the challenges introduced by negative links within signed graphs. Here, we propose a novel graph learning framework, named as Deep Signed Brain Graph Mining or DSBGM, with a signed graph encoder that, from an opposite perspective, learns the cross-modality representations by projecting the functional network to the structural counterpart. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets (HCP and OASIS). Our experimental results clearly demonstrate the advantages of our model compared to several state-of-the-art methods.

Cortex2vector: anatomical embedding of cortical folding patterns

Current brain mapping methods highly depend on the regularity, or commonality, of anatomical structure, by forcing the same atlas to be matched to different brains. As a result, individualized structural information can be overlooked. Recently, we conceptualized a new type of cortical folding pattern called the 3-hinge gyrus (3HG), which is defined as the conjunction of gyri coming from three directions. Many studies have confirmed that 3HGs are not only widely existing on different brains, but also possess both common and individual patterns. In this work, we put further effort, based on the identified 3HGs, to establish the correspondences of individual 3HGs. We developed a learning-based embedding framework to encode individual cortical folding patterns into a group of anatomically meaningful embedding vectors (cortex2vector). Each 3HG can be represented as a combination of these embedding vectors via a set of individual specific combining coefficients. In this way, the regularity of folding pattern is encoded into the embedding vectors, while the individual variations are preserved by the multi-hop combination coefficients. Results show that the learned embeddings can simultaneously encode the commonality and individuality of cortical folding patterns, as well as robustly infer the complicated many-to-many anatomical correspondences among different brains.

Longitudinal Infant Functional Connectivity Prediction via Conditional Intensive Triplet Network

Longitudinal infant brain functional connectivity (FC) constructed from resting-state functional MRI (rs-fMRI) has increasingly become a pivotal tool in studying the dynamics of early brain development. However, due to various reasons including high acquisition cost, strong motion artifact, and subject dropout, there has been an extreme shortage of usable longitudinal infant rs-fMRI scans to construct longitudinal FCs, which hinders comprehensive understanding and modeling of brain functional development at early ages. To address this issue, in this paper, we propose a novel conditional intensive triplet network (CITN) for longitudinal prediction of the dynamic development of infant FC, which can traverse FCs within a long duration and predict the target FC at any specific age during infancy. Targeting at accurately modeling of the progression pattern of FC, while maintaining the individual functional uniqueness, our model effectively disentangles the intrinsically mixed age-related and identity-related information from the source FC and predicts the target FC by fusing well-disentangled identity-related information with the specific age-related information. Specifically, we introduce an intensive triplet auto-encoder for effective disentanglement of age-related and identity-related information and an identity conditional module to mix identity-related information with designated age-related information. We train the proposed model in a self-supervised way and design downstream tasks to help robustly disentangle age-related and identity-related features. Experiments on 464 longitudinal infant fMRI scans show the superior performance of the proposed method in longitudinal FC prediction in comparison with state-of-the-art approaches.