Unsupervised Manifold Learning Using High-Order Morphological Brain Networks Derived From T1-w MRI for Autism Diagnosis

HCBiLSTM-WOA: hybrid convolutional bidirectional long short-term memory with water optimization algorithm for autism spectrum disorder

Autism Spectrum Disorder (ASD) is a type of brain developmental disability that cannot be completely treated, but its impact can be reduced through early interventions. Early identification of neurological disorders will better assist in preserving the subjects' physical and mental health. Although numerous research works exist for detecting autism spectrum disorder, they are cumbersome and insufficient for dealing with real-time datasets. Therefore, to address these issues, this paper proposes an ASD detection mechanism using a novel Hybrid Convolutional Bidirectional Long Short-Term Memory based Water Optimization Algorithm (HCBiLSTM-WOA). The prediction efficiency of the proposed HCBiLSTM-WOA method is investigated using real-time ASD datasets containing both ASD and non-ASD data from toddlers, children, adolescents, and adults. The inconsistent and incomplete representations of the raw ASD dataset are modified using preprocessing procedures such as handling missing values, predicting outliers, data discretization, and data reduction. The preprocessed data obtained is then fed into the proposed HCBiLSTM-WOA classification model to effectively predict the non-ASD and ASD classes. The initially randomly initialized hyperparameters of the HCBiLSTM model are adjusted and tuned using the water optimization algorithm (WOA) to increase the prediction accuracy of ASD. After detecting non-ASD and ASD classes, the HCBiLSTM-WOA method further classifies the ASD cases into respective stages based on the autistic traits observed in toddlers, children, adolescents, and adults. Also, the ethical considerations that should be taken into account when campaign ASD risk communication are complex due to the data privacy and unpredictability surrounding ASD risk factors. The fusion of sophisticated deep learning techniques with an optimization algorithm presents a promising framework for ASD diagnosis. This innovative approach shows potential in effectively managing intricate ASD data, enhancing diagnostic precision, and improving result interpretation. Consequently, it offers clinicians a tool for early and precise detection, allowing for timely intervention in ASD cases. Moreover, the performance of the proposed HCBiLSTM-WOA method is evaluated using various performance indicators such as accuracy, kappa statistics, sensitivity, specificity, log loss, and Area Under the Receiver Operating Characteristics (AUROC). The simulation results reveal the superiority of the proposed HCBiLSTM-WOA method in detecting ASD compared to other existing methods. The proposed method achieves a higher ASD prediction accuracy of about 98.53% than the other methods being compared.

Multi modality fusion transformer with spatio-temporal feature aggregation module for psychiatric disorder diagnosis

Bipolar disorder (BD) is characterized by recurrent episodes of depression and mild mania. In this paper, to address the common issue of insufficient accuracy in existing methods and meet the requirements of clinical diagnosis, we propose a framework called Spatio-temporal Feature Fusion Transformer (STF2Former). It improves on our previous work - MFFormer by introducing a Spatio-temporal Feature Aggregation Module (STFAM) to learn the temporal and spatial features of rs-fMRI data. It promotes intra-modality attention and information fusion across different modalities. Specifically, this method decouples the temporal and spatial dimensions and designs two feature extraction modules for extracting temporal and spatial information separately. Extensive experiments demonstrate the effectiveness of our proposed STFAM in extracting features from rs-fMRI, and prove that our STF2Former can significantly outperform MFFormer and achieve much better results among other state-of-the-art methods.

Early autism diagnosis based on path signature and Siamese unsupervised feature compressor

Autism spectrum disorder has been emerging as a growing public health threat. Early diagnosis of autism spectrum disorder is crucial for timely, effective intervention and treatment. However, conventional diagnosis methods based on communications and behavioral patterns are unreliable for children younger than 2 years of age. Given evidences of neurodevelopmental abnormalities in autism spectrum disorder infants, we resort to a novel deep learning-based method to extract key features from the inherently scarce, class-imbalanced, and heterogeneous structural MR images for early autism diagnosis. Specifically, we propose a Siamese verification framework to extend the scarce data, and an unsupervised compressor to alleviate data imbalance by extracting key features. We also proposed weight constraints to cope with sample heterogeneity by giving different samples different voting weights during validation, and used Path Signature to unravel meaningful developmental features from the two-time point data longitudinally. We further extracted machine learning focused brain regions for autism diagnosis. Extensive experiments have shown that our method performed well under practical scenarios, transcending existing machine learning methods and providing anatomical insights for autism early diagnosis.

Automated diagnosis of autism with artificial intelligence: State of the art

Autism spectrum disorder (ASD) represents a panel of conditions that begin during the developmental period and result in impairments of personal, social, academic, or occupational functioning. Early diagnosis is directly related to a better prognosis. Unfortunately, the diagnosis of ASD requires a long and exhausting subjective process. We aimed to review the state of the art for automated autism diagnosis and recognition in this research. In February 2022, we searched multiple databases and sources of gray literature for eligible studies. We used an adapted version of the QUADAS-2 tool to assess the risk of bias in the studies. A brief report of the methods and results of each study is presented. Data were synthesized for each modality separately using the Split Component Synthesis (SCS) method. We assessed heterogeneity using the I 2 statistics and evaluated publication bias using trim and fill tests combined with ln DOR. Confidence in cumulative evidence was assessed using the GRADE approach for diagnostic studies. We included 344 studies from 186,020 participants (51,129 are estimated to be unique) for nine different modalities in this review, from which 232 reported sufficient data for meta-analysis. The area under the curve was in the range of 0.71-0.90 for all the modalities. The studies on EEG data provided the best accuracy, with the area under the curve ranging between 0.85 and 0.93. We found that the literature is rife with bias and methodological/reporting flaws. Recommendations are provided for future research to provide better studies and fill in the current knowledge gaps.

Graph neural network based unsupervised influential sample selection for brain multigraph population fusion

Graph neural networks (GNNs) have witnessed remarkable proliferation due to the increasing number of applications where data is represented as graphs. GNN-based multigraph population fusion methods for estimating population representative connectional brain templates (CBT) have recently led to improvements, especially in network neuroscience. However, prior studies do not consider how an individual training brain multigraph influences the quality of GNN training for brain multigraph population fusion. To address this issue, we propose two major sample selection methods to quantify the influence of a training brain multigraph on the brain multigraph population fusion task using GNNs, in a fully unsupervised manner: (1) GraphGradIn, in which we use gradients w.r.t GNN weights to trace changes in the centeredness loss of connectional brain template during the training phase; (2) GraphTestIn, in which we exclude a training brain multigraph of interest during the refinement process in the test phase to infer its influence on the CBT centeredness loss. Next, we select the most influential multigraphs to build the training set for brain multigraph population fusion into a CBT. We conducted extensive experiments on brain multigraph datasets to show that using a dataset of influential training samples improves the learned connectional brain template in terms of centeredness, discriminativeness, and topological soundness. Finally, we demonstrate the use of our methods by discovering the connectional fingerprints of healthy and neurologically disordered brain multigraph populations including Alzheimer's disease and Autism spectrum disorder patients. Our source code is available at https://github.com/basiralab/GraphGradIn.

Graph Neural Networks in Network Neuroscience

Noninvasive medical neuroimaging has yielded many discoveries about the brain connectivity. Several substantial techniques mapping morphological, structural and functional brain connectivities were developed to create a comprehensive road map of neuronal activities in the human brain -namely brain graph. Relying on its non-euclidean data type, graph neural network (GNN) provides a clever way of learning the deep graph structure and it is rapidly becoming the state-of-the-art leading to enhanced performance in various network neuroscience tasks. Here we review current GNN-based methods, highlighting the ways that they have been used in several applications related to brain graphs such as missing brain graph synthesis and disease classification. We conclude by charting a path toward a better application of GNN models in network neuroscience field for neurological disorder diagnosis and population graph integration. The list of papers cited in our work is available at https://github.com/basiralab/GNNs-in-Network-Neuroscience.

Comparative survey of multigraph integration methods for holistic brain connectivity mapping

One of the greatest scientific challenges in network neuroscience is to create a representative map of a population of heterogeneous brain networks, which acts as a connectional fingerprint. The connectional brain template (CBT), also named network atlas, presents a powerful tool for capturing the most representative and discriminative traits of a given population while preserving its topological patterns. The idea of a CBT is to integrate a population of heterogeneous brain connectivity networks, derived from different neuroimaging modalities or brain views (e.g., structural and functional), into a unified holistic representation. Here we review current state-of-the-art methods designed to estimate well-centered and representative CBT for populations of single-view and multi-view brain networks. We start by reviewing each CBT learning method, then we introduce the evaluation measures to compare CBT representativeness of populations generated by single-view and multigraph integration methods, separately, based on the following criteria: Centeredness, biomarker-reproducibility, node-level similarity, global-level similarity, and distance-based similarity. We demonstrate that the deep graph normalizer (DGN) method significantly outperforms other multi-graph and all single-view integration methods for estimating CBTs using a variety of healthy and disordered datasets in terms of centeredness, reproducibility (i.e., graph-derived biomarkers reproducibility that disentangle the typical from the atypical connectivity variability), and preserving the topological traits at both local and global graph-levels.

Template-based graph registration network for boosting the diagnosis of brain connectivity disorders

Brain graphs are powerful representations to explore the biological roadmaps of the human brain in its healthy and disordered states. Recently, a few graph neural networks (GNNs) have been designed for brain connectivity synthesis and diagnosis. However, such non-Euclidean deep learning architectures might fail to capture the neural interactions between different brain regions as they are trained without guidance from any prior biological template-i.e., template-free learning. Here we assume that using a population-driven brain connectional template (CBT) that captures well the connectivity patterns fingerprinting a given brain state (e.g., healthy) can better guide the GNN training in its downstream learning task such as classification or regression. To this aim we design a plug-in graph registration network (GRN) that can be coupled with any conventional graph neural network (GNN) so as to boost its learning accuracy and generalizability to unseen samples. Our GRN is a graph generative adversarial network (gGAN), which registers brain graphs to a prior CBT. Next, the registered brain graphs are used to train typical GNN models. Our GRN can be integrated into any GNN working in an end-to-end fashion to boost its prediction accuracy. Our experiments showed that GRN remarkably boosted the prediction accuracy of four conventional GNN models across four neurological datasets.

Predicting the evolution trajectory of population-driven connectional brain templates using recurrent multigraph neural networks

The mapping of the time-dependent evolution of the human brain connectivity using longitudinal and multimodal neuroimaging datasets provides insights into the development of neurological disorders and the way they alter the brain morphology, structure and function over time. Recently, the connectional brain template (CBT) was introduced as a compact representation integrating a population of brain multigraphs, where two brain regions can have multiple connections, into a single graph. Given a population of brain multigraphs observed at a baseline timepoint t₁, we aim to learn how to predict the evolution of the population CBT at follow-up timepoints t>t₁. Such model will allow us to foresee the evolution of the connectivity patterns of healthy and disordered individuals at the population level. Here we present recurrent multigraph integrator network (ReMI-Net^⋆) to forecast population templates at consecutive timepoints from a given single timepoint. In particular, we unprecedentedly design a graph neural network architecture to model the changes in the brain multigraph and identify the biomarkers that differentiate between the typical and atypical populations. Addressing such issues is of paramount importance in diagnosing neurodegenerative disorders at early stages and promoting new clinical studies based on the pinned-down biomarker brain regions or connectivities. In this paper, we demonstrate the design and use of the ReMI-Net^⋆ model, which learns both the multigraph node level and time level dependencies concurrently. Thanks to its novel graph convolutional design and normalization layers, ReMI-Net^⋆ predicts well-centered, discriminative, and topologically sound connectional templates over time. Additionally, the results show that our model outperforms all benchmarks and state-of-the-art methods by comparing and discovering the atypical connectivity alterations over time. Our ReMI-Net^⋆ code is available on GitHub at https://github.com/basiralab/ReMI-Net-Star.

Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review

Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging.

Machine learning for autism spectrum disorder diagnosis using structural magnetic resonance imaging: Promising but challenging

Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder that affects approximately 1% of the population and causes significant burdens. ASD's pathogenesis remains elusive; hence, diagnosis is based on a constellation of behaviors. Structural magnetic resonance imaging (sMRI) studies have shown several abnormalities in volumetric and geometric features of the autistic brain. However, inconsistent findings prevented most contributions from being translated into clinical practice. Establishing reliable biomarkers for ASD using sMRI is crucial for the correct diagnosis and treatment. In recent years, machine learning (ML) and specifically deep learning (DL) have quickly extended to almost every sector, notably in disease diagnosis. Thus, this has led to a shift and improvement in ASD diagnostic methods, fulfilling most clinical diagnostic requirements. However, ASD discovery remains difficult. This review examines the ML-based ASD diagnosis literature over the past 5 years. A literature-based taxonomy of the research landscape has been mapped, and the major aspects of this topic have been covered. First, we provide an overview of ML's general classification pipeline and the features of sMRI. Next, representative studies are highlighted and discussed in detail with respect to methods, and biomarkers. Finally, we highlight many common challenges and make recommendations for future directions. In short, the limited sample size was the main obstacle; Thus, comprehensive data sets and rigorous methods are necessary to check the generalizability of the results. ML technologies are expected to advance significantly in the coming years, contributing to the diagnosis of ASD and helping clinicians soon.

Multigraph classification using learnable integration network with application to gender fingerprinting

Multigraphs with heterogeneous views present one of the most challenging obstacles to classification tasks due to their complexity. Several works based on feature selection have been recently proposed to disentangle the problem of multigraph heterogeneity. However, such techniques have major drawbacks. First, the bulk of such works lies in the vectorization and the flattening operations, failing to preserve and exploit the rich topological properties of the multigraph. Second, they learn the classification process in a dichotomized manner where the cascaded learning steps are pieced in together independently. Hence, such architectures are inherently agnostic to the cumulative estimation error from step to step. To overcome these drawbacks, we introduce MICNet (multigraph integration and classifier network), the first end-to-end graph neural network based model for multigraph classification. First, we learn a single-view graph representation of a heterogeneous multigraph using a GNN based integration model. The integration process in our model helps tease apart the heterogeneity across the different views of the multigraph by generating a subject-specific graph template while preserving its geometrical and topological properties conserving the node-wise information while reducing the size of the graph (i.e., number of views). Second, we classify each integrated template using a geometric deep learning block which enables us to grasp the salient graph features. We train, in end-to-end fashion, these two blocks using a single objective function to optimize the classification performance. We evaluate our MICNet in gender classification using brain multigraphs derived from different cortical measures. We demonstrate that our MICNet significantly outperformed its variants thereby showing its great potential in multigraph classification.

A comparative study of machine learning methods for predicting the evolution of brain connectivity from a baseline timepoint

BACKGROUND

Predicting the evolution of the brain network, also called connectome, by foreseeing changes in the connectivity weights linking pairs of anatomical regions makes it possible to spot connectivity-related neurological disorders in earlier stages and detect the development of potential connectomic anomalies. Remarkably, such a challenging prediction problem remains least explored in the predictive connectomics literature. It is a known fact that machine learning (ML) methods have proven their predictive abilities in a wide variety of computer vision problems. However, ML techniques specifically tailored for the prediction of brain connectivity evolution trajectory from a single timepoint are almost absent.

NEW METHOD

To fill this gap, we organized a Kaggle competition where 20 competing teams designed advanced machine learning pipelines for predicting the brain connectivity evolution from a single timepoint. The teams developed their ML pipelines with combination of data pre-processing, dimensionality reduction and learning methods. Each ML framework inputs a baseline brain connectivity matrix observed at baseline timepoint t₀ and outputs the brain connectivity map at a follow-up timepoint t₁. The longitudinal OASIS-2 dataset was used for model training and evaluation. Both random data split and 5-fold cross-validation strategies were used for ranking and evaluating the generalizability and scalability of each competing ML pipeline.

RESULTS

Utilizing an inclusive approach, we ranked the methods based on two complementary evaluation metrics (mean absolute error (MAE) and Pearson Correlation Coefficient (PCC)) and their performances using different training and testing data perturbation strategies (single random split and cross-validation). The final rank was calculated using the rank product for each competing team across all evaluation measures and validation strategies. Furthermore, we added statistical significance values to each proposed pipeline.

CONCLUSION

In support of open science, the developed 20 ML pipelines along with the connectomic dataset are made available on GitHub (https://github.com/basiralab/Kaggle-BrainNetPrediction-Toolbox). The outcomes of this competition are anticipated to lead the further development of predictive models that can foresee the evolution of the brain connectivity over time, as well as other types of networks (e.g., genetic networks).

Autism Spectrum Disorder Studies Using fMRI Data and Machine Learning: A Review

Machine learning methods have been frequently applied in the field of cognitive neuroscience in the last decade. A great deal of attention has been attracted to introduce machine learning methods to study the autism spectrum disorder (ASD) in order to find out its neurophysiological underpinnings. In this paper, we presented a comprehensive review about the previous studies since 2011, which applied machine learning methods to analyze the functional magnetic resonance imaging (fMRI) data of autistic individuals and the typical controls (TCs). The all-round process was covered, including feature construction from raw fMRI data, feature selection methods, machine learning methods, factors for high classification accuracy, and critical conclusions. Applying different machine learning methods and fMRI data acquired from different sites, classification accuracies were obtained ranging from 48.3% up to 97%, and informative brain regions and networks were located. Through thorough analysis, high classification accuracies were found to usually occur in the studies which involved task-based fMRI data, single dataset for some selection principle, effective feature selection methods, or advanced machine learning methods. Advanced deep learning together with the multi-site Autism Brain Imaging Data Exchange (ABIDE) dataset became research trends especially in the recent 4 years. In the future, advanced feature selection and machine learning methods combined with multi-site dataset or easily operated task-based fMRI data may appear to have the potentiality to serve as a promising diagnostic tool for ASD.

Large-Scale Brain Functional Network Integration for Discrimination of Autism Using a 3-D Deep Learning Model

GOAL

Brain functional networks (BFNs) constructed using resting-state functional magnetic resonance imaging (fMRI) have proven to be an effective way to understand aberrant functional connectivity in autism spectrum disorder (ASD) patients. It is still challenging to utilize these features as potential biomarkers for discrimination of ASD. The purpose of this work is to classify ASD and normal controls (NCs) using BFNs derived from rs-fMRI.

METHODS

A deep learning framework was proposed that integrated convolutional neural network (CNN) and channel-wise attention mechanism to model both intra- and inter-BFN associations simultaneously for ASD diagnosis. We investigate the effects of each BFN on performance and performed inter-network connectivity analysis between each pair of BFNs. We compared the performance of our CNN model with some state-of-the-art algorithms using functional connectivity features.

RESULTS

We collected 79 ASD patients and 105 NCs from the ABIDE-I dataset. The mean accuracy of our classification algorithm was 77.74% for classification of ASD versus NCs.

CONCLUSION

The proposed model is able to integrate information from multiple BFNs to improve detection accuracy of ASD.

SIGNIFICANCE

These findings suggest that large-scale BFNs is promising to serve as reliable biomarkers for diagnosis of ASD.

Brain multigraph prediction using topology-aware adversarial graph neural network

Brain graphs (i.e, connectomes) constructed from medical scans such as magnetic resonance imaging (MRI) have become increasingly important tools to characterize the abnormal changes in the human brain. Due to the high acquisition cost and processing time of multimodal MRI, existing deep learning frameworks based on Generative Adversarial Network (GAN) focused on predicting the missing multimodal medical images from a few existing modalities. While brain graphs help better understand how a particular disorder can change the connectional facets of the brain, synthesizing a target brain multigraph (i.e, multiple brain graphs) from a single source brain graph is strikingly lacking. Additionally, existing graph generation works mainly learn one model for each target domain which limits their scalability in jointly predicting multiple target domains. Besides, while they consider the global topological scale of a graph (i.e., graph connectivity structure), they overlook the local topology at the node scale (e.g., how central a node is in the graph). To address these limitations, we introduce topology-aware graph GAN architecture (topoGAN), which jointly predicts multiple brain graphs from a single brain graph while preserving the topological structure of each target graph. Its three key innovations are: (i) designing a novel graph adversarial auto-encoder for predicting multiple brain graphs from a single one, (ii) clustering the encoded source graphs in order to handle the mode collapse issue of GAN and proposing a cluster-specific decoder, (iii) introducing a topological loss to force the prediction of topologically sound target brain graphs. The experimental results using five target domains demonstrated the outperformance of our method in brain multigraph prediction from a single graph in comparison with baseline approaches.

MGN-Net: A multi-view graph normalizer for integrating heterogeneous biological network populations

With the recent technological advances, biological datasets, often represented by networks (i.e., graphs) of interacting entities, proliferate with unprecedented complexity and heterogeneity. Although modern network science opens new frontiers of analyzing connectivity patterns in such datasets, we still lack data-driven methods for extracting an integral connectional fingerprint of a multi-view graph population, let alone disentangling the typical from the atypical variations across the population samples. We present the multi-view graph normalizer network (MGN-Net²), a graph neural network based method to normalize and integrate a set of multi-view biological networks into a single connectional template that is centered, representative, and topologically sound. We demonstrate the use of MGN-Net by discovering the connectional fingerprints of healthy and neurologically disordered brain network populations including Alzheimer's disease and Autism spectrum disorder patients. Additionally, by comparing the learned templates of healthy and disordered populations, we show that MGN-Net significantly outperforms conventional network integration methods across extensive experiments in terms of producing the most centered templates, recapitulating unique traits of populations, and preserving the complex topology of biological networks. Our evaluations showed that MGN-Net is powerfully generic and easily adaptable in design to different graph-based problems such as identification of relevant connections, normalization and integration.

Gender differences in cortical morphological networks

Cortical morphological networks (CMN), where each network models the relationship in morphology between different cortical brain regions quantified using a specific measurement (e.g., cortical thickness), have not been investigated with respect to gender differences in the human brain. Cortical processes are expected to involve complex interactions between different brain regions, univariate methods thus might overlook informative gender markers. Hence, by leveraging machine learning techniques with the potential to highlight multivariate interacting effects, we found that the most discriminative CMN connections between males and females were derived from the left hemisphere using the mean sulcal depth as measurement. However, for both left and right hemispheres, the first most discriminative morphological connection revealed across all cortical attributes involved (entorhinal cortex ↔ caudal anterior cingulate cortex) and (entorhinal cortex ↔ transverse temporal cortex) respectively, which gives us new insights into behavioral gender differences from an omics perspective and might explain why males and females learn differently.

A Novel Unit-Based Personalized Fingerprint Feature Selection Strategy for Dynamic Functional Connectivity Networks

The sliding-window-based dynamic functional connectivity networks (SW-D-FCN) derive from resting-state functional Magnetic Resonance Imaging has become an increasingly useful tool in the diagnosis of various neurodegenerative diseases. However, it is still challenging to learn how to extract and select the most discriminative features from SW-D-FCN. Conventionally, existing methods opt to select a single discriminative feature set or concatenate a few more from the SW-D-FCN. However, such reductionist strategies may fail to fully capture the personalized discriminative characteristics contained in each functional connectivity (FC) sequence of the SW-D-FCN. To address this issue, we propose a unit-based personalized fingerprint feature selection (UPFFS) strategy to better capture the most discriminative feature associated with a target disease for each unit. Specifically, we regard the FC sequence between any pair of brain regions of interest (ROIs) is regarded as a unit. For each unit, the most discriminative feature is identified by a specific feature evaluation method and all the most discriminative features are then concatenated together as a feature set for the subsequent classification task. In such a way, the personalized fingerprint feature derived from each FC sequence can be fully mined and utilized in classification decision. To illustrate the effectiveness of the proposed strategy, we conduct experiments to distinguish subjects diagnosed with autism spectrum disorder from normal controls. Experimental results show that the proposed strategy can select relevant discriminative features and achieve superior performance to benchmark methods.

Sex effects on cortical morphological networks in healthy young adults

Understanding sex-related differences across the human cerebral cortex is an important step in elucidating the basis of psychological, behavioural and clinical differences between the sexes. Prior structural neuroimaging studies primarily focused on regional sex differences using univariate analyses. Here we focus on sex differences in cortical morphological networks (CMNs) derived using multivariate modelling of regional cortical measures of volume and surface from high-quality structural MRI scans from healthy participants in the Human Connectome Project (HCP) (n = 1,063) and the Southwest University Longitudinal Imaging Multimodal (SLIM) study (n = 549). The functional relevance of the CMNs was inferred using the NeuroSynth decoding function. Sex differences were widespread but not uniform. In general, females had higher volume, thickness and cortical folding in networks that involve prefrontal (both ventral and dorsal regions including the anterior cingulate) and parietal regions while males had higher volume, thickness and cortical folding in networks that primarily include temporal and posterior cortical regions. CMN loading coefficients were used as input features to linear discriminant analyses that were performed separately in the HCP and SLIM; sex was predicted with a high degree of accuracy (81%-85%) across datasets. The availability of behavioral data in the HCP enabled us to show that male-biased surface-based CMNs were associated with externalizing behaviors. These results extend previous literature on regional sex-differences by identifying CMNs that can reliably predict sex, are relevant to the expression of psychopathology and provide the foundation for the future investigation of their functional significance in clinical populations.

Independent components of human brain morphology

Quantification of brain morphology has become an important cornerstone in understanding brain structure. Measures of cortical morphology such as thickness and surface area are frequently used to compare groups of subjects or characterise longitudinal changes. However, such measures are often treated as independent from each other. A recently described scaling law, derived from a statistical physics model of cortical folding, demonstrates that there is a tight covariance between three commonly used cortical morphology measures: cortical thickness, total surface area, and exposed surface area. We show that assuming the independence of cortical morphology measures can hide features and potentially lead to misinterpretations. Using the scaling law, we account for the covariance between cortical morphology measures and derive novel independent measures of cortical morphology. By applying these new measures, we show that new information can be gained; in our example we show that distinct morphological alterations underlie healthy ageing compared to temporal lobe epilepsy, even on the coarse level of a whole hemisphere. We thus provide a conceptual framework for characterising cortical morphology in a statistically valid and interpretable manner, based on theoretical reasoning about the shape of the cortex.

A diagnostic unified classification model for classifying multi-sized and multi-modal brain graphs using graph alignment

BACKGROUND

Presence of multimodal brain graphs derived from different neuroimaging modalities is inarguably one of the most critical challenges in building unified classification models that can be trained and tested on any brain graph regardless of its size and the modality it was derived from.

EXISTING METHODS

One solution is to learn a model for each modality independently, which is cumbersome and becomes more time-consuming as the number of modalities increases. Another traditional solution is to build a model inputting multimodal brain graphs for the target prediction task; however, this is only applicable to datasets where all samples have joint neuro-modalities.

NEW METHOD

In this paper, we propose to build a unified brain graph classification model trained on unpaired multimodal brain graphs, which can classify any brain graph of any size. This is enabled by incorporating a graph alignment step where all multi-modal graphs of different sizes and heterogeneous distributions are mapped to a common template graph. Next, we design a graph alignment strategy to the target fixed-size template and further apply linear discriminant analysis (LDA) to the aligned graphs as a supervised dimensionality reduction technique for the target classification task.

RESULTS

We tested our method on unpaired autistic and healthy brain connectomes derived from functional and morphological MRI datasets (two modalities).

CONCLUSION

Our results showed that our unified model method not only has great promise in solving such a challenging problem but achieves comparable performance to models trained on each modality independently.

Brain graph synthesis by dual adversarial domain alignment and target graph prediction from a source graph

Developing predictive intelligence in neuroscience for learning how to generate multimodal medical data from a single modality can improve neurological disorder diagnosis with minimal data acquisition resources. Existing deep learning frameworks are mainly tailored for images, which might fail in handling geometric data (e.g., brain graphs). Specifically, predicting a target brain graph from a single source brain graph remains largely unexplored. Solving such problem is generally challenged with domain fracturecaused by the difference in distribution between source and target domains. Besides, solving the prediction and domain fracture independently might not be optimal for both tasks. To address these challenges, we unprecedentedly propose a Learning-guided Graph Dual Adversarial Domain Alignment (LG-DADA) framework for predicting a target brain graph from a source brain graph. The proposed LG-DADA is grounded in three fundamental contributions: (1) a source data pre-clustering step using manifold learning to firstly handle source data heterogeneity and secondly circumvent mode collapse in generative adversarial learning, (2) a domain alignment of source domain to the target domain by adversarially learning their latent representations, and (3) a dual adversarial regularization that jointly learns a source embedding of training and testing brain graphs using two discriminators and predict the training target graphs. Results on morphological brain graphs synthesis showed that our method produces better prediction accuracy and visual quality as compared to other graph synthesis methods.

Estimation of gender-specific connectional brain templates using joint multi-view cortical morphological network integration

The estimation of a connectional brain template (CBT) integrating a population of brain networks while capturing shared and differential connectional patterns across individuals remains unexplored in gender fingerprinting. This paper presents the first study to estimate gender-specific CBTs using multi-view cortical morphological networks (CMNs) estimated from conventional T1-weighted magnetic resonance imaging (MRI). Specifically, each CMN view is derived from a specific cortical attribute (e.g. thickness), encoded in a network quantifying the dissimilarity in morphology between pairs of cortical brain regions. To this aim, we propose Multi-View Clustering and Fusion Network (MVCF-Net), a novel multi-view network fusion method, which can jointly identify consistent and differential clusters of multi-view datasets in order to capture simultaneously similar and distinct connectional traits of samples. Our MVCF-Net method estimates a representative and well-centered CBTs for male and female populations, independently, to eventually identify their fingerprinting regions of interest (ROIs) in four main steps. First, we perform multi-view network clustering model based on manifold optimization which groups CMNs into shared and differential clusters while preserving their alignment across views. Second, for each view, we linearly fuse CMNs belonging to each cluster, producing local CBTs. Third, for each cluster, we non-linearly integrate the local CBTs across views, producing a cluster-specific CBT. Finally, by linearly fusing the cluster-specific centers we estimate a final CBT of the input population. MVCF-Net produced the most centered and representative CBTs for male and female populations and identified the most discriminative ROIs marking gender differences. The most two gender-discriminative ROIs involved the lateral occipital cortex and pars opercularis in the left hemisphere and the middle temporal gyrus and lingual gyrus in the right hemisphere.

Adversarial brain multiplex prediction from a single brain network with application to gender fingerprinting

Brain connectivity networks, derived from magnetic resonance imaging (MRI), non-invasively quantify the relationship in function, structure, and morphology between two brain regions of interest (ROIs) and give insights into gender-related connectional differences. However, to the best of our knowledge, studies on gender differences in brain connectivity were limited to investigating pairwise (i.e., low-order) relationships across ROIs, overlooking the complex high-order interconnectedness of the brain as a network. A few recent works on neurological disorders addressed this limitation by introducing the brain multiplex which is composed of a source network intra-layer, a target intra-layer, and a convolutional interlayer capturing the high-level relationship between both intra-layers. However, brain multiplexes are built from at least two different brain networks hindering their application to connectomic datasets with single brain networks (e.g., functional networks). To fill this gap, we propose Adversarial Brain Multiplex Translator (ABMT), the first work for predicting brain multiplexes from a source network using geometric adversarial learning to investigate gender differences in the human brain. Our framework comprises: (i) a geometric source to target network translator mimicking a U-Net architecture with skip connections, (ii) a conditional discriminator which distinguishes between predicted and ground truth target intra-layers, and finally (iii) a multi-layer perceptron (MLP) classifier which supervises the prediction of the target multiplex using the subject class label (e.g., gender). Our experiments on a large dataset demonstrated that predicted multiplexes significantly boost gender classification accuracy compared with source networks and unprecedentedly identify both low and high-order gender-specific brain multiplex connections. Our ABMT source code is available on GitHub at https://github.com/basiralab/ABMT.

Predicting full-scale and verbal intelligence scores from functional Connectomic data in individuals with autism Spectrum disorder

Decoding how intelligence is engrained in the human brain construct is vital in the understanding of particular neurological disorders. While the majority of existing studies focus on characterizing intelligence in neurotypical (NT) brains, investigating how neural correlates of intelligence scores are altered by atypical neurodevelopmental disorders, such as Autism Spectrum Disorders (ASD), is almost absent. To help fill this gap, we use a connectome-based predictive model (CPM) to predict intelligence scores from functional connectome data, derived from resting-state functional magnetic resonance imaging (rsfMRI). The utilized model learns how to select the most significant positive and negative brain connections, independently, to predict the target intelligence scores in NT and ASD populations, respectively. In the first step, using leave-one-out cross-validation we train a linear regressor robust to outliers to identify functional brain connections that best predict the target intelligence score (p - value < 0.01). Next, for each training subject, positive (respectively negative) connections are summed to produce single-subject positive (respectively negative) summary values. These are then paired with the target training scores to train two linear regressors: (a) a positive model which maps each positive summary value to the subject score, and (b) a negative model which maps each negative summary value to the target score. In the testing stage, by selecting the same connections for the left-out testing subject, we compute their positive and negative summary values, which are then fed to the trained negative and positive models for predicting the target score. This framework was applied to NT and ASD populations independently to identify significant functional connections coding for full-scale and verbal intelligence quotients in the brain.

Machine learning (ML) for the diagnosis of autism spectrum disorder (ASD) using brain imaging

Autism spectrum disorder (ASD) is a neurodevelopmental incurable disorder with a long diagnostic period encountered in the early years of life. If diagnosed early, the negative effects of this disease can be reduced by starting special education early. Machine learning (ML), an increasingly ubiquitous technology, can be applied for the early diagnosis of ASD. The aim of this study is to examine and provide a comprehensive state-of-the-art review of ML research for the diagnosis of ASD based on (a) structural magnetic resonance image (MRI), (b) functional MRI and (c) hybrid imaging techniques over the past decade. The accuracy of the studies with a large number of participants is in general lower than those with fewer participants leading to the conclusion that further large-scale studies are needed. An examination of the age of the participants shows that the accuracy of the automated diagnosis of ASD is higher at a younger age range. ML technology is expected to contribute significantly to the early and rapid diagnosis of ASD in the coming years and become available to clinicians in the near future. This review is aimed to facilitate that.

Towards a brain-based predictome of mental illness

Neuroimaging-based approaches have been extensively applied to study mental illness in recent years and have deepened our understanding of both cognitively healthy and disordered brain structure and function. Recent advancements in machine learning techniques have shown promising outcomes for individualized prediction and characterization of patients with psychiatric disorders. Studies have utilized features from a variety of neuroimaging modalities, including structural, functional, and diffusion magnetic resonance imaging data, as well as jointly estimated features from multiple modalities, to assess patients with heterogeneous mental disorders, such as schizophrenia and autism. We use the term "predictome" to describe the use of multivariate brain network features from one or more neuroimaging modalities to predict mental illness. In the predictome, multiple brain network-based features (either from the same modality or multiple modalities) are incorporated into a predictive model to jointly estimate features that are unique to a disorder and predict subjects accordingly. To date, more than 650 studies have been published on subject-level prediction focusing on psychiatric disorders. We have surveyed about 250 studies including schizophrenia, major depression, bipolar disorder, autism spectrum disorder, attention-deficit hyperactivity disorder, obsessive-compulsive disorder, social anxiety disorder, posttraumatic stress disorder, and substance dependence. In this review, we present a comprehensive review of recent neuroimaging-based predictomic approaches, current trends, and common shortcomings and share our vision for future directions.

Machine learning methods for brain network classification: Application to autism diagnosis using cortical morphological networks

BACKGROUND

Autism spectrum disorder (ASD) affects the brain connectivity at different levels. Nonetheless, non-invasively distinguishing such effects using magnetic resonance imaging (MRI) remains very challenging to machine learning diagnostic frameworks due to ASD heterogeneity. So far, existing network neuroscience works mainly focused on functional (derived from functional MRI) and structural (derived from diffusion MRI) brain connectivity, which might not directly capture relational morphological changes between brain regions. Indeed, machine learning (ML) studies for ASD diagnosis using morphological brain networks derived from conventional T1-weighted MRI are very scarce.

NEW METHOD

To fill this gap, we leverage crowdsourcing by organizing a Kaggle competition to build a pool of machine learning pipelines for neurological disorder diagnosis with application to ASD diagnosis using cortical morphological networks derived from T1-weighted MRI.

RESULTS

During the competition, participants were provided with a training dataset and only allowed to check their performance on a public test data. The final evaluation was performed on both public and hidden test datasets based on accuracy, sensitivity, and specificity metrics. Teams were ranked using each performance metric separately and the final ranking was determined based on the mean of all rankings. The first-ranked team achieved 70% accuracy, 72.5% sensitivity, and 67.5% specificity, where the second-ranked team achieved 63.8%, 62.5%, 65% respectively.

CONCLUSION

Leveraging participants to design ML diagnostic methods within a competitive machine learning setting has allowed the exploration and benchmarking of wide spectrum of ML methods for ASD diagnosis using cortical morphological networks.

Diagnosis of Autism Spectrum Disorder Using Central-Moment Features From Low- and High-Order Dynamic Resting-State Functional Connectivity Networks

The sliding-window-based dynamic functional connectivity networks (D-FCNs) derived from resting-state functional magnetic resonance imaging (rs-fMRI) are effective methods for diagnosing various neurological diseases, including autism spectrum disorder (ASD). However, traditional D-FCNs are low-order networks based on pairwise correlation between brain regions, thus overlooking high-level interactions across multiple regions of interest (ROIs). Moreover, D-FCNs suffer from the temporal mismatching issue, i.e., subnetworks in the same temporal window do not have temporal correspondence across different subjects. To address the above problems, we first construct a novel high-order D-FCNs based on the principle of “correlation’s correlation” to further explore the higher level and more complex interaction relationships among multiple ROIs. Furthermore, we propose to use a central-moment method to extract temporal-invariance properties contained in either low- or high-order D-FCNs. Finally, we design and train an ensemble classifier by fusing the features extracted from conventional FCN, low-order D-FCNs, and high-order D-FCNs for the diagnosis of ASD and normal control subjects. Our method achieved the best ASD classification accuracy (83%), and our results revealed the features extracted from different networks fingerprinting the autistic brain at different connectional levels.

Neonatal morphometric similarity mapping for predicting brain age and characterizing neuroanatomic variation associated with preterm birth

Multi-contrast MRI captures information about brain macro- and micro-structure which can be combined in an integrated model to obtain a detailed "fingerprint" of the anatomical properties of an individual's brain. Inter-regional similarities between features derived from structural and diffusion MRI, including regional volumes, diffusion tensor metrics, neurite orientation dispersion and density imaging measures, can be modelled as morphometric similarity networks (MSNs). Here, individual MSNs were derived from 105 neonates (59 preterm and 46 term) who were scanned between 38 and 45 weeks postmenstrual age (PMA). Inter-regional similarities were used as predictors in a regression model of age at the time of scanning and in a classification model to discriminate between preterm and term infant brains. When tested on unseen data, the regression model predicted PMA at scan with a mean absolute error of 0.70  ±  0.56 weeks, and the classification model achieved 92% accuracy. We conclude that MSNs predict chronological brain age accurately; and they provide a data-driven approach to identify networks that characterise typical maturation and those that contribute most to neuroanatomic variation associated with preterm birth.

Morphological Brain Age Prediction using Multi-View Brain Networks Derived from Cortical Morphology in Healthy and Disordered Participants

Brain development and aging are dynamic processes that unfold over years on multiple levels in both healthy and disordered individuals. Recent studies have revealed a disparity between the chronological brain age and the ‘data-driven’ brain age using functional MRI (fMRI) and diffusion MRI (dMRI). Particularly, predicting the ‘brain age’ from connectomic data might help identify relevant connectional biomarkers of neurological disorders that emerge early or late in the lifespan. While prior brain-age prediction studies have relied exclusively on either structural or functional connectomic data, here we unprecedentedly propose to predict the morphological age of the brain by solely using morphological brain networks (derived from T1-weighted images) in both healthy and disordered populations. Besides, although T1-weighted MRI was widely used for brain age prediction, it was leveraged from an image-based analysis perspective not from a connectomic perspective. Our method includes the following steps: (i) building multi-view morphological brain networks (M-MBN), (ii) feature extraction and selection, (iii) training a machine-learning regression model to predict age from M-MBN data, and (iv) utilizing our model to identify connectional brain features related to age in both autistic and healthy populations. We demonstrate that our method significantly outperforms existing approaches and discovered brain connectional morphological features that fingerprint the age of brain cortical morphology in both autistic and healthy individuals. In particular, we discovered that the connectional cortical thickness best predicts the morphological age of the autistic brain.

Applications of machine learning in addiction studies: A systematic review

This study aims to provide a systematic review of the applications of machine learning methods in addiction research. In this study, multiple searches on MEDLINE, Embase and the Cochrane Database of Systematic Reviews were performed. 23 full-text articles were assessed and 17 articles met the inclusion criteria for the final review. The selected studies covered mainly substance addiction (N = 14, 82.4%), including smoking (N = 4), alcohol drinking (N = 3), as well as uses of cocaine (N = 4), opioids (N = 1), and multiple substances (N = 2). Other studies were non-substance addiction (N = 3, 17.6%), including gambling (N = 2) and internet gaming (N = 1). There were eight cross-sectional, seven cohort, one non-randomized controlled, and one crossover trial studies. Majority of the studies employed supervised learning (N = 13), and others employed unsupervised learning (N = 2) and reinforcement learning (N = 2). Among the supervised learning studies, five studies used ensemble learning methods or multiple algorithm comparisons, six used regression, and two used classification. The two included reinforcement learning studies used the direct methods. These results suggest that machine learning methods, particularly supervised learning are increasingly used in addiction psychiatry for informing medical decisions.