Brain Connectivity Based Graph Convolutional Networks and Its Application to Infant Age Prediction

Multi-center brain age prediction via dual-modality fusion convolutional network

Accurate prediction of brain age is crucial for identifying deviations between typical individual brain development trajectories and neuropsychiatric disease progression. Although current research has made progress, the effective application of brain age prediction models to multi-center datasets, particularly those with small-sample sizes, remains a significant challenge that is yet to be addressed. To this end, we propose a multi-center data correction method, which employs a domain adaptation correction strategy with Wasserstein distance of optimal transport, along with maximum mean discrepancy to improve the generalizability of brain-age prediction models on small-sample datasets. Additionally, most of the existing brain age models based on neuroimage identify the task of predicting brain age as a regression or classification problem, which may affect the accuracy of the prediction. Therefore, we propose a brain dual-modality fused convolutional neural network model (BrainDCN) for brain age prediction, and optimize this model by introducing a joint loss function of mean absolute error and cross-entropy, which identifies the prediction of brain age as both a regression and classification task. Furthermore, to highlight age-related features, we construct weighting matrices and vectors from a single-center training set and apply them to multi-center datasets to weight important features. We validate the BrainDCN model on the CamCAN dataset and achieve the lowest average absolute error compared to state-of-the-art models, demonstrating its superiority. Notably, the joint loss function and weighted features can further improve the prediction accuracy. More importantly, our proposed multi-center correction method is tested on four neuroimaging datasets and achieves the lowest average absolute error compared to widely used correction methods, highlighting the superior performance of the method in cross-center data integration and analysis. Furthermore, the application to multi-center schizophrenia data shows a mean accelerated aging compared to normal controls. Thus, this research establishes a pivotal methodological foundation for multi-center brain age prediction studies, exhibiting considerable applicability in clinical contexts, which are predominantly characterized by small-sample datasets.

BGCSL: An unsupervised framework reveals the underlying structure of large-scale whole-brain functional connectivity networks

BACKGROUND AND OBJECTIVE

Inferring large-scale brain networks from functional magnetic resonance imaging (fMRI) provides more detailed and richer connectivity information, which is critical for gaining insight into brain structure and function and for predicting clinical phenotypes. However, as the number of network nodes increases, most existing methods suffer from the following limitations: (1) Traditional shallow models often struggle to estimate large-scale brain networks. (2) Existing deep graph structure learning models rely on downstream tasks and labels. (3) They rely on sparse postprocessing operations. To overcome these limitations, this paper proposes a novel framework for revealing large-scale functional brain connectivity networks through graph contrastive structure learning, called BGCSL.

METHODS

Unlike traditional supervised graph structure learning methods, this framework does not rely on labeled information. It consists of two important modules: sparse graph structure learner and graph contrastive learning (GCL). It employs dynamic augmentation in GCL to train a sparse graph structure learner, enabling it to capture the intrinsic structure of the data.

RESULTS

We conducted extensive experiments on 12 synthetic datasets and 2 public functional magnetic resonance imaging datasets, demonstrating the effectiveness of our proposed framework. In the synthetic datasets, particularly in cases where node features are insufficient, BGCSL still maintains state-of-the-art performance. More importantly, on the ABIDE-I and HCP-rest datasets, BGCSL improved the downstream task performance of GCN-based models, including the original GCN, dGCN, and ContrastPool, to varying degrees.

CONCLUSION

Our proposed method holds significant potential as a valuable reference for future large-scale brain network estimation and representation and is conducive to supporting the exploration of more fine-grained biomarkers.

Community Graph Convolution Neural Network for Alzheimer's Disease Classification and Pathogenetic Factors Identification

As a complex neural network system, the brain regions and genes collaborate to effectively store and transmit information. We abstract the collaboration correlations as the brain region gene community network (BG-CN) and present a new deep learning approach, such as the community graph convolutional neural network (Com-GCN), for investigating the transmission of information within and between communities. The results can be used for diagnosing and extracting causal factors for Alzheimer's disease (AD). First, an affinity aggregation model for BG-CN is developed to describe intercommunity and intracommunity information transmission. Second, we design the Com-GCN architecture with intercommunity convolution and intracommunity convolution operations based on the affinity aggregation model. Through sufficient experimental validation on the AD neuroimaging initiative (ADNI) dataset, the design of Com-GCN matches the physiological mechanism better and improves the interpretability and classification performance. Furthermore, Com-GCN can identify lesioned brain regions and disease-causing genes, which may assist precision medicine and drug design in AD and serve as a valuable reference for other neurological disorders.

Biomarker Investigation Using Multiple Brain Measures from MRI Through Explainable Artificial Intelligence in Alzheimer's Disease Classification

As the leading cause of dementia worldwide, Alzheimer's Disease (AD) has prompted significant interest in developing Deep Learning (DL) approaches for its classification. However, it currently remains unclear whether these models rely on established biological indicators. This work compares a novel DL model using structural connectivity (namely, BC-GCN-SE adapted from functional connectivity tasks) with an established model using structural magnetic resonance imaging (MRI) scans (namely, ResNet18). Unlike most studies primarily focusing on performance, our work places explainability at the forefront. Specifically, we define a novel Explainable Artificial Intelligence (XAI) metric, based on gradient-weighted class activation mapping. Its aim is quantitatively measuring how effectively these models fare against established AD biomarkers in their decision-making. The XAI assessment was conducted across 132 brain parcels. Results were compared to AD-relevant regions to measure adherence to domain knowledge. Then, differences in explainability patterns between the two models were assessed to explore the insights offered by each piece of data (i.e., MRI vs. connectivity). Classification performance was satisfactory in terms of both the median true positive (ResNet18: 0.817, BC-GCN-SE: 0.703) and true negative rates (ResNet18: 0.816; BC-GCN-SE: 0.738). Statistical tests (p < 0.05) and ranking of the 15% most relevant parcels revealed the involvement of target areas: the medial temporal lobe for ResNet18 and the default mode network for BC-GCN-SE. Additionally, our findings suggest that different imaging modalities provide complementary information to DL models. This lays the foundation for bioengineering advancements in developing more comprehensive and trustworthy DL models, potentially enhancing their applicability as diagnostic support tools for neurodegenerative diseases.

Brain clocks capture diversity and disparities in aging and dementia across geographically diverse populations

Brain clocks, which quantify discrepancies between brain age and chronological age, hold promise for understanding brain health and disease. However, the impact of diversity (including geographical, socioeconomic, sociodemographic, sex and neurodegeneration) on the brain-age gap is unknown. We analyzed datasets from 5,306 participants across 15 countries (7 Latin American and Caribbean countries (LAC) and 8 non-LAC countries). Based on higher-order interactions, we developed a brain-age gap deep learning architecture for functional magnetic resonance imaging (2,953) and electroencephalography (2,353). The datasets comprised healthy controls and individuals with mild cognitive impairment, Alzheimer disease and behavioral variant frontotemporal dementia. LAC models evidenced older brain ages (functional magnetic resonance imaging: mean directional error = 5.60, root mean square error (r.m.s.e.) = 11.91; electroencephalography: mean directional error = 5.34, r.m.s.e. = 9.82) associated with frontoposterior networks compared with non-LAC models. Structural socioeconomic inequality, pollution and health disparities were influential predictors of increased brain-age gaps, especially in LAC (R² = 0.37, F² = 0.59, r.m.s.e. = 6.9). An ascending brain-age gap from healthy controls to mild cognitive impairment to Alzheimer disease was found. In LAC, we observed larger brain-age gaps in females in control and Alzheimer disease groups compared with the respective males. The results were not explained by variations in signal quality, demographics or acquisition methods. These findings provide a quantitative framework capturing the diversity of accelerated brain aging.

Signed Curvature Graph Representation Learning of Brain Networks for Brain Age Estimation

Graph Neural Networks (GNNs) play a pivotal role in learning representations of brain networks for estimating brain age. However, the over-squashing impedes interactions between long-range nodes, hindering the ability of message-passing mechanism-based GNNs to learn the topological structure of brain networks. Graph rewiring methods and curvature GNNs have been proposed to alleviate over-squashing. However, most graph rewiring methods overlook node features and curvature GNNs neglect the geometric properties of signed curvature. In this study, a Signed Curvature GNN (SCGNN) was proposed to rewire the graph based on node features and curvature, and learn the representation of signed curvature. First, a Mutual Information Ollivier-Ricci Flow (MORF) was proposed to add connections in the neighborhood of edge with the minimal negative curvature based on the maximum mutual information between node features, improving the efficiency of information interaction between nodes. Then, a Signed Curvature Convolution (SCC) was proposed to aggregate node features based on positive and negative curvature, facilitating the model's ability to capture the complex topological structures of brain networks. Additionally, an Ollivier-Ricci Gradient Pooling (ORG-Pooling) was proposed to select the key nodes and topology structures by curvature gradient and attention mechanism, accurately obtaining the global representation for brain age estimation. Experiments conducted on six public datasets with structural magnetic resonance imaging (sMRI), spanning ages from 18 to 91 years, validate that our method achieves promising performance compared with existing methods. Furthermore, we employed the gaps between brain age and chronological age for identifying Alzheimer's Disease (AD), yielding the best classification performance.

Jointly constrained group sparse connectivity representation improves early diagnosis of Alzheimer's disease on routinely acquired T1-weighted imaging-based brain network

Background

Radiomics-based morphological brain networks (radMBN) constructed from routinely acquired structural MRI (sMRI) data have gained attention in Alzheimer's disease (AD). However, the radMBN suffers from limited characterization of AD because sMRI only characterizes anatomical changes and is not a direct measure of neuronal pathology or brain activity.

Purpose

To establish a group sparse representation of the radMBN under a joint constraint of group-level white matter fiber connectivity and individual-level sMRI regional similarity (JCGS-radMBN).

Methods

Two publicly available datasets were adopted, including 120 subjects from ADNI with both T1-weighted image (T1WI) and diffusion MRI (dMRI) for JCGS-radMBN construction, 818 subjects from ADNI and 200 subjects solely with T1WI from AIBL for validation in early AD diagnosis. Specifically, the JCGS-radMBN was conducted by jointly estimating non-zero connections among subjects, with the regularization term constrained by group-level white matter fiber connectivity and individual-level sMRI regional similarity. Then, a triplet graph convolutional network was adopted for early AD diagnosis. The discriminative brain connections were identified using a two-sample t-test, and the neurobiological interpretation was validated by correlating the discriminative brain connections with cognitive scores.

Results

The JCGS-radMBN exhibited superior classification performance over five brain network construction methods. For the typical NC vs. AD classification, the JCGS-radMBN increased by 1-30% in accuracy over the alternatives on ADNI and AIBL. The discriminative brain connections exhibited a strong connectivity to hippocampus, parahippocampal gyrus, and basal ganglia, and had significant correlation with MMSE scores.

Conclusion

The proposed JCGS-radMBN facilitated the AD characterization of brain network established on routinely acquired imaging modality of sMRI.

Supplementary Information

The online version of this article (10.1007/s13755-023-00269-0) contains supplementary material, which is available to authorized users.

Brain age prediction and deviations from normative trajectories in the neonatal connectome

Structural and functional connectomes undergo rapid changes during the third trimester and the first month of postnatal life. Despite progress, our understanding of the developmental trajectories of the connectome in the perinatal period remains incomplete. Brain age prediction uses machine learning to estimate the brain's maturity relative to normative data. The difference between the individual's predicted and chronological age-or brain age gap (BAG)-represents the deviation from these normative trajectories. Here, we assess brain age prediction and BAGs using structural and functional connectomes for infants in the first month of life. We use resting-state fMRI and DTI data from 611 infants (174 preterm; 437 term) from the Developing Human Connectome Project (dHCP) and connectome-based predictive modeling to predict postmenstrual age (PMA). Structural and functional connectomes accurately predict PMA for term and preterm infants. Predicted ages from each modality are correlated. At the network level, nearly all canonical brain networks-even putatively later developing ones-generate accurate PMA prediction. Additionally, BAGs are associated with perinatal exposures and toddler behavioral outcomes. Overall, our results underscore the importance of normative modeling and deviations from these models during the perinatal period.

Comparative analysis of brain age prediction using structural and diffusion MRIs in neonates

Using machine learning techniques to predict brain age from multimodal data has become a crucial biomarker for assessing brain development. Among various types of brain imaging data, structural magnetic resonance imaging (sMRI) and diffusion magnetic resonance imaging (dMRI) are the most commonly used modalities. sMRI focuses on depicting macrostructural features of the brain, while dMRI reveals the orientation of major white matter fibers and changes in tissue microstructure. However, their differential capabilities in reflecting newborn age and clinical implications have not been systematically studied. This study aims to explore the impact of sMRI and dMRI on brain age prediction. Comparing predictions based on T2-weighted(T2w) and fractional anisotropy (FA) images, we found their mean absolute errors (MAE) in predicting infant age to be similar. Exploratory analysis revealed for T2w images, areas such as the cerebral cortex and ventricles contribute most significantly to age prediction, whereas FA images highlight the cerebral cortex and regions of the main white matter tracts. Despite both modalities focusing on the cerebral cortex, they exhibit significant region-wise differences, reflecting developmental disparities in macro- and microstructural aspects of the cortex. Additionally, we examined the effects of prematurity, gender, and hemispherical asymmetry of the brain on age prediction for both modalities. Results showed significant differences (p<0.05) in age prediction biases based on FA images across gender and hemispherical asymmetry, whereas no significant differences were observed with T2w images. This study underscores the differences between T2w and FA images in predicting infant brain age, offering new perspectives for studying infant brain development and aiding more effective assessment and tracking of infant development.

Explainable spatio-temporal graph evolution learning with applications to dynamic brain network analysis during development

Modeling dynamic interactions among network components is crucial to uncovering the evolution mechanisms of complex networks. Recently, spatio-temporal graph learning methods have achieved noteworthy results in characterizing the dynamic changes of inter-node relations (INRs). However, challenges remain: The spatial neighborhood of an INR is underexploited, and the spatio-temporal dependencies in INRs' dynamic changes are overlooked, ignoring the influence of historical states and local information. In addition, the model's explainability has been understudied. To address these issues, we propose an explainable spatio-temporal graph evolution learning (ESTGEL) model to model the dynamic evolution of INRs. Specifically, an edge attention module is proposed to utilize the spatial neighborhood of an INR at multi-level, i.e., a hierarchy of nested subgraphs derived from decomposing the initial node-relation graph. Subsequently, a dynamic relation learning module is proposed to capture the spatio-temporal dependencies of INRs. The INRs are then used as adjacent information to improve the node representation, resulting in comprehensive delineation of dynamic evolution of the network. Finally, the approach is validated with real data on brain development study. Experimental results on dynamic brain networks analysis reveal that brain functional networks transition from dispersed to more convergent and modular structures throughout development. Significant changes are observed in the dynamic functional connectivity (dFC) associated with functions including emotional control, decision-making, and language processing.

An Attention-Based Hemispheric Relation Inference Network for Perinatal Brain Age Prediction

Brain anatomical age is an effective feature to assess the status of the brain, such as atypical development and aging. Although some deep learning models have been developed for estimating infant brain age, the performance of these models was unsatisfactory because few of them considered the developmental characteristics of brain anatomy during the perinatal period-the most rapid and complex developmental stage across the lifespan. The present study proposed an attention-based hemispheric relation inference network (HRINet) that takes advantage of the nature of brain structural lateralization during early development. This model captures the inter-hemispheric relationship using a graph attention mechanism and transmits lateralization information as features to describe the interactive development between bilateral hemispheres. The HRINet was used to estimate the brain age of 531 preterm and full-term neonates from the Developing Human Connectome Project (dHCP) database based on two metrics (mean curvature and sulcal depth) characterizing the folding morphology of the cortex. Our results showed that the HRINet outperformed other benchmark models in fitting the perinatal brain age, with mean absolute error of 0.53 and determination coefficient of 0.89. We also verified the generalizability of the HRINet on an extra independent dataset collected from the Gansu Provincial Maternity and Child-care Hospital. Furthermore, by applying the best-performing model to an independent dataset consisting of 47 scans of preterm infants at term-equivalent age, we showed that the predicted age was significantly lower than the chronological age, suggesting a delayed development of premature brains. Our results demonstrate the effectiveness and generalizability of the HRINet in estimating infant brain age, providing promising clinical applications for assessing neonatal brain maturity.

Brain age prediction and deviations from normative trajectories in the neonatal connectome

Structural and functional connectomes undergo rapid changes during the third trimester and the first month of postnatal life. Despite progress, our understanding of the developmental trajectories of the connectome in the perinatal period remains incomplete. Brain age prediction uses machine learning to estimate the brain's maturity relative to normative data. The difference between the individual's predicted and chronological age-or brain age gap (BAG)-represents the deviation from these normative trajectories. Here, we assess brain age prediction and BAGs using structural and functional connectomes for infants in the first month of life. We used resting-state fMRI and DTI data from 611 infants (174 preterm; 437 term) from the Developing Human Connectome Project (dHCP) and connectome-based predictive modeling to predict postmenstrual age (PMA). Structural and functional connectomes accurately predicted PMA for term and preterm infants. Predicted ages from each modality were correlated. At the network level, nearly all canonical brain networks-even putatively later developing ones-generated accurate PMA prediction. Additionally, BAGs were associated with perinatal exposures and toddler behavioral outcomes. Overall, our results underscore the importance of normative modeling and deviations from these models during the perinatal period.

Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI

Predicting individual behavior from brain imaging data using machine learning is a rapidly growing field in neuroscience. Functional connectivity (FC), which captures interactions between different brain regions, contains valuable information about the organization of the brain and is considered a crucial feature for modeling human behavior. Graph convolutional networks (GCN) have proven to be a powerful tool for extracting graph structure features and have shown promising results in various FC-based classification tasks, such as disease classification and prognosis prediction. Despite this success, few behavior prediction models currently exist based on GCN, and their performance is not satisfactory. To address this gap, a new model called the Multi-Scale FC-based Multi-Order GCN (MSFC-MO-GCN) was proposed in this paper. The model considers the hierarchical structure of the brain system and utilizes FCs inferred from multiple spatial scales as input to comprehensively characterize individual brain organization. To enhance the feature learning ability of GCN, a multi-order graph convolutional layer is incorporated, which uses multi-order neighbors to guide message passing and learns high-order graph information of nodal connections. Additionally, an inter-subject contrast constraint is designed to control the potential information redundancy of FCs among different spatial scales during the feature learning process. Experimental evaluation were conducted on the publicly available dataset from human connectome project. A total of 805 healthy subjects were included and 5 representative behavior metrics were used. The experimental results show that our proposed method outperforms the existing behavior prediction models in all behavior prediction tasks.

Adversarially Trained Persistent Homology Based Graph Convolutional Network for Disease Identification Using Brain Connectivity

Brain disease propagation is associated with characteristic alterations in the structural and functional connectivity networks of the brain. To identify disease-specific network representations, graph convolutional networks (GCNs) have been used because of their powerful graph embedding ability to characterize the non-Euclidean structure of brain networks. However, existing GCNs generally focus on learning the discriminative region of interest (ROI) features, often ignoring important topological information that enables the integration of connectome patterns of brain activity. In addition, most methods fail to consider the vulnerability of GCNs to perturbations in network properties of the brain, which considerably degrades the reliability of diagnosis results. In this study, we propose an adversarially trained persistent homology-based graph convolutional network (ATPGCN) to capture disease-specific brain connectome patterns and classify brain diseases. First, the brain functional/structural connectivity is constructed using different neuroimaging modalities. Then, we develop a novel strategy that concatenates the persistent homology features from a brain algebraic topology analysis with readout features of the global pooling layer of a GCN model to collaboratively learn the individual-level representation. Finally, we simulate the adversarial perturbations by targeting the risk ROIs from clinical prior, and incorporate them into a training loop to evaluate the robustness of the model. The experimental results on three independent datasets demonstrate that ATPGCN outperforms existing classification methods in disease identification and is robust to minor perturbations in network architecture. Our code is available at https://github.com/CYB08/ATPGCN.

The past, current, and future of neonatal intensive care units with artificial intelligence: a systematic review

Machine learning and deep learning are two subsets of artificial intelligence that involve teaching computers to learn and make decisions from any sort of data. Most recent developments in artificial intelligence are coming from deep learning, which has proven revolutionary in almost all fields, from computer vision to health sciences. The effects of deep learning in medicine have changed the conventional ways of clinical application significantly. Although some sub-fields of medicine, such as pediatrics, have been relatively slow in receiving the critical benefits of deep learning, related research in pediatrics has started to accumulate to a significant level, too. Hence, in this paper, we review recently developed machine learning and deep learning-based solutions for neonatology applications. We systematically evaluate the roles of both classical machine learning and deep learning in neonatology applications, define the methodologies, including algorithmic developments, and describe the remaining challenges in the assessment of neonatal diseases by using PRISMA 2020 guidelines. To date, the primary areas of focus in neonatology regarding AI applications have included survival analysis, neuroimaging, analysis of vital parameters and biosignals, and retinopathy of prematurity diagnosis. We have categorically summarized 106 research articles from 1996 to 2022 and discussed their pros and cons, respectively. In this systematic review, we aimed to further enhance the comprehensiveness of the study. We also discuss possible directions for new AI models and the future of neonatology with the rising power of AI, suggesting roadmaps for the integration of AI into neonatal intensive care units.

Determining regional brain growth in premature and mature infants in relation to age at MRI using deep neural networks

Neonatal MRIs are used increasingly in preterm infants. However, it is not always feasible to analyze this data. Having a tool that assesses brain maturation during this period of extraordinary changes would be immensely helpful. Approaches based on deep learning approaches could solve this task since, once properly trained and validated, they can be used in practically any system and provide holistic quantitative information in a matter of minutes. However, one major deterrent for radiologists is that these tools are not easily interpretable. Indeed, it is important that structures driving the results be detailed and survive comparison to the available literature. To solve these challenges, we propose an interpretable pipeline based on deep learning to predict postmenstrual age at scan, a key measure for assessing neonatal brain development. For this purpose, we train a state-of-the-art deep neural network to segment the brain into 87 different regions using normal preterm and term infants from the dHCP study. We then extract informative features for brain age estimation using the segmented MRIs and predict the brain age at scan with a regression model. The proposed framework achieves a mean absolute error of 0.46 weeks to predict postmenstrual age at scan. While our model is based solely on structural T2-weighted images, the results are superior to recent, arguably more complex approaches. Furthermore, based on the extracted knowledge from the trained models, we found that frontal and parietal lobes are among the most important structures for neonatal brain age estimation.