Automatic brain caudate nuclei segmentation and classification in diagnostic of Attention-Deficit/Hyperactivity Disorder

Structural or/and functional MRI-based machine learning techniques for attention-deficit/hyperactivity disorder diagnosis: A systematic review and meta-analysis

BACKGROUND

The aim of this study was to investigate the diagnostic value of ML techniques based on sMRI or/and fMRI for ADHD.

METHODS

We conducted a comprehensive search (from database creation date to March 2024) for relevant English articles on sMRI or/and fMRI-based ML techniques for diagnosing ADHD. The pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), summary receiver operating characteristic (SROC) curve and area under the curve (AUC) were calculated to assess the diagnostic value of sMRI or/and fMRI-based ML techniques. The I2 test was used to assess heterogeneity and the source of heterogeneity was investigated by performing a meta-regression analysis. Publication bias was assessed using the Deeks funnel plot asymmetry test.

RESULTS

Forty-three studies were included in the systematic review, 27 of which were included in our meta-analysis. The pooled sensitivity and specificity of sMRI or/and fMRI-based ML techniques for the diagnosis of ADHD were 0.74 (95 % CI 0.65-0.81) and 0.75 (95 % CI 0.67-0.81), respectively. SROC curve showed that AUC was 0.81 (95 % CI 0.77-0.84). Based on these findings, the sMRI or/and fMRI-based ML techniques have relatively good diagnostic value for ADHD.

LIMITATIONS

Our meta-analysis specifically focused on ML techniques based on sMRI or/and fMRI studies. Since EEG-based ML techniques are also used for diagnosing ADHD, further systematic analyses are necessary to explore ML methods based on multimodal medical data.

CONCLUSION

sMRI or/and fMRI-based ML technique is a promising objective diagnostic method for ADHD.

Machine learning in attention-deficit/hyperactivity disorder: new approaches toward understanding the neural mechanisms

Attention-deficit/hyperactivity disorder (ADHD) is a highly prevalent and heterogeneous neurodevelopmental disorder in children and has a high chance of persisting in adulthood. The development of individualized, efficient, and reliable treatment strategies is limited by the lack of understanding of the underlying neural mechanisms. Diverging and inconsistent findings from existing studies suggest that ADHD may be simultaneously associated with multivariate factors across cognitive, genetic, and biological domains. Machine learning algorithms are more capable of detecting complex interactions between multiple variables than conventional statistical methods. Here we present a narrative review of the existing machine learning studies that have contributed to understanding mechanisms underlying ADHD with a focus on behavioral and neurocognitive problems, neurobiological measures including genetic data, structural magnetic resonance imaging (MRI), task-based and resting-state functional MRI (fMRI), electroencephalogram, and functional near-infrared spectroscopy, and prevention and treatment strategies. Implications of machine learning models in ADHD research are discussed. Although increasing evidence suggests that machine learning has potential in studying ADHD, extra precautions are still required when designing machine learning strategies considering the limitations of interpretability and generalization.

Machine Learning and MRI-based Diagnostic Models for ADHD: Are We There Yet?

OBJECTIVE

Machine learning (ML) has been applied to develop magnetic resonance imaging (MRI)-based diagnostic classifiers for attention-deficit/hyperactivity disorder (ADHD). This systematic review examines this literature to clarify its clinical significance and to assess the implications of the various analytic methods applied.

METHODS

A comprehensive literature search on MRI-based diagnostic classifiers for ADHD was performed and data regarding the utilized models and samples were gathered.

RESULTS

We found that, although most studies reported the classification accuracies, they varied in choice of MRI modalities, ML models, cross-validation and testing methods, and sample sizes. We found that the accuracies of cross-validation methods inflated the performance estimation compared with those of a held-out test, compromising the model generalizability. Test accuracies have increased with publication year but were not associated with training sample sizes. Improved test accuracy over time was likely due to the use of better ML methods along with strategies to deal with data imbalances.

CONCLUSION

Ultimately, large multi-modal imaging datasets, and potentially the combination with other types of data, like cognitive data and/or genetics, will be essential to achieve the goal of developing clinically useful imaging classification tools for ADHD in the future.

Automatic detection of autism spectrum disorder (ASD) in children using structural magnetic resonance imaging with machine vision system

Background

Autism spectrum disorder (ASD) is a group of developmental disorders of the nervous system whose main manifestations are defects in social interactions, communication, repetitive behaviors, and limited interests. Over the years, the use of magnetic resonance imaging (MRI) to help identify patterns that are common in people with autism has increased for classification purposes. This study propose a method for classifying ASD patients versus controls using structural MRI information. In order to increase the accuracy of this method, the volume and surface features of the structural images are used simultaneously.

Results

The accuracy of diagnosis respectively was 86.29%, 71.15%, 86.53%, and 88.46% with SVM, RF, KNN, and ANN classifiers. The highest accuracy of diagnosis was obtained using ANN.

Conclusions

Since clinical evaluations for the diagnosis of autism are extremely time-consuming and depend on the expertise of a specialist, the importance of intelligent diagnosis of this disorder becomes clear. The aim of this study was to design an intelligent system to diagnose autism spectrum disorder.

Machine Learning Methods for Diagnosing Autism Spectrum Disorder and Attention- Deficit/Hyperactivity Disorder Using Functional and Structural MRI: A Survey

Here we summarize recent progress in machine learning model for diagnosis of Autism Spectrum Disorder (ASD) and Attention-deficit/Hyperactivity Disorder (ADHD). We outline and describe the machine-learning, especially deep-learning, techniques that are suitable for addressing research questions in this domain, pitfalls of the available methods, as well as future directions for the field. We envision a future where the diagnosis of ASD, ADHD, and other mental disorders is accomplished, and quantified using imaging techniques, such as MRI, and machine-learning models.

Towards a brain-based predictome of mental illness

Neuroimaging-based approaches have been extensively applied to study mental illness in recent years and have deepened our understanding of both cognitively healthy and disordered brain structure and function. Recent advancements in machine learning techniques have shown promising outcomes for individualized prediction and characterization of patients with psychiatric disorders. Studies have utilized features from a variety of neuroimaging modalities, including structural, functional, and diffusion magnetic resonance imaging data, as well as jointly estimated features from multiple modalities, to assess patients with heterogeneous mental disorders, such as schizophrenia and autism. We use the term "predictome" to describe the use of multivariate brain network features from one or more neuroimaging modalities to predict mental illness. In the predictome, multiple brain network-based features (either from the same modality or multiple modalities) are incorporated into a predictive model to jointly estimate features that are unique to a disorder and predict subjects accordingly. To date, more than 650 studies have been published on subject-level prediction focusing on psychiatric disorders. We have surveyed about 250 studies including schizophrenia, major depression, bipolar disorder, autism spectrum disorder, attention-deficit hyperactivity disorder, obsessive-compulsive disorder, social anxiety disorder, posttraumatic stress disorder, and substance dependence. In this review, we present a comprehensive review of recent neuroimaging-based predictomic approaches, current trends, and common shortcomings and share our vision for future directions.

Individual differences v. the average patient: mapping the heterogeneity in ADHD using normative models

BACKGROUND

The present paper presents a fundamentally novel approach to model individual differences of persons with the same biologically heterogeneous mental disorder. Unlike prevalent case-control analyses, that assume a clear distinction between patient and control groups and thereby introducing the concept of an 'average patient', we describe each patient's biology individually, gaining insights into the different facets that characterize persistent attention-deficit/hyperactivity disorder (ADHD).

METHODS

Using a normative modeling approach, we mapped inter-individual differences in reference to normative structural brain changes across the lifespan to examine the degree to which case-control analyses disguise differences between individuals.

RESULTS

At the level of the individual, deviations from the normative model were frequent in persistent ADHD. However, the overlap of more than 2% between participants with ADHD was only observed in few brain loci. On average, participants with ADHD showed significantly reduced gray matter in the cerebellum and hippocampus compared to healthy individuals. While the case-control differences were in line with the literature on ADHD, individuals with ADHD only marginally reflected these group differences.

CONCLUSIONS

Case-control comparisons, disguise inter-individual differences in brain biology in individuals with persistent ADHD. The present results show that the 'average ADHD patient' has limited informative value, providing the first evidence for the necessity to explore different biological facets of ADHD at the level of the individual and practical means to achieve this end.

Classification Accuracy of Neuroimaging Biomarkers in Attention-Deficit/Hyperactivity Disorder: Effects of Sample Size and Circular Analysis

BACKGROUND

Motivated by an inconsistency between reports of high diagnosis-classification accuracies and known heterogeneity in attention-deficit/hyperactivity disorder (ADHD), this study assessed classification accuracy in studies of ADHD as a function of methodological factors that can bias results. We hypothesized that high classification results in ADHD diagnosis are inflated by methodological factors.

METHODS

We reviewed 69 studies (of 95 studies identified) that used neuroimaging features to predict ADHD diagnosis. Based on reported methods, we assessed the prevalence of circular analysis, which inflates classification accuracy, and evaluated the relationship between sample size and accuracy to test if small-sample models tend to report higher classification accuracy, also an indicator of bias.

RESULTS

Circular analysis was detected in 15.9% of ADHD classification studies, lack of independent test set was noted in 13%, and insufficient methodological detail to establish its presence was noted in another 11.6%. Accuracy of classification ranged from 60% to 80% in the 59.4% of reviewed studies that met criteria for independence of feature selection, model construction, and test datasets. Moreover, there was a negative relationship between accuracy and sample size, implying additional bias contributing to reported accuracies at lower sample sizes.

CONCLUSIONS

High classification accuracies in neuroimaging studies of ADHD appear to be inflated by circular analysis and small sample size. Accuracies on independent datasets were consistent with known heterogeneity of the disorder. Steps to resolve these issues, and a shift toward accounting for sample heterogeneity and prediction of future outcomes, will be crucial in future classification studies in ADHD.

Distinguishing Adolescents With Conduct Disorder From Typically Developing Youngsters Based on Pattern Classification of Brain Structural MRI

Background: Conduct disorder (CD) is a mental disorder diagnosed in childhood or adolescence that presents antisocial behaviors, and is associated with structural alterations in brain. However, whether these structural alterations can distinguish CD from healthy controls (HCs) remains unknown. Here, we quantified these structural differences and explored the classification ability of these quantitative features based on machine learning (ML).

Materials and Methods: High-resolution 3D structural magnetic resonance imaging (sMRI) was acquired from 60 CD subjects and 60 age-matched HCs. Voxel-based morphometry (VBM) was used to assess the regional gray matter (GM) volume difference. The significantly different regional GM volumes were then extracted as features, and input into three ML classifiers: logistic regression, random forest and support vector machine (SVM). We trained and tested these ML models for classifying CD from HCs by using fivefold cross-validation (CV).

Results: Eight brain regions with abnormal GM volumes were detected, which mainly distributed in the frontal lobe, parietal lobe, anterior cingulate, cerebellum posterior lobe, lingual gyrus, and insula areas. We found that these ML models achieved comparable classification performance, with accuracy of 77.9 ∼ 80.4%, specificity of 73.3 ∼ 80.4%, sensitivity of 75.4 ∼ 87.5%, and area under the receiver operating characteristic curve (AUC) of 0.76 ∼ 0.80.

Conclusion: Based on sMRI and ML, the regional GM volumes may be used as potential imaging biomarkers for stable and accurate classification of CD.

Progress and roadblocks in the search for brain-based biomarkers of autism and attention-deficit/hyperactivity disorder

Children with neurodevelopmental disorders benefit most from early interventions and treatments. The development and validation of brain-based biomarkers to aid in objective diagnosis can facilitate this important clinical aim. The objective of this review is to provide an overview of current progress in the use of neuroimaging to identify brain-based biomarkers for autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder (ADHD), two prevalent neurodevelopmental disorders. We summarize empirical work that has laid the foundation for using neuroimaging to objectively quantify brain structure and function in ways that are beginning to be used in biomarker development, noting limitations of the data currently available. The most successful machine learning methods that have been developed and applied to date are discussed. Overall, there is increasing evidence that specific features (for example, functional connectivity, gray matter volume) of brain regions comprising the salience and default mode networks can be used to discriminate ASD from typical development. Brain regions contributing to successful discrimination of ADHD from typical development appear to be more widespread, however there is initial evidence that features derived from frontal and cerebellar regions are most informative for classification. The identification of brain-based biomarkers for ASD and ADHD could potentially assist in objective diagnosis, monitoring of treatment response and prediction of outcomes for children with these neurodevelopmental disorders. At present, however, the field has yet to identify reliable and reproducible biomarkers for these disorders, and must address issues related to clinical heterogeneity, methodological standardization and cross-site validation before further progress can be achieved.

Multi-modal, Multi-measure, and Multi-class Discrimination of ADHD with Hierarchical Feature Extraction and Extreme Learning Machine Using Structural and Functional Brain MRI

Structural and functional MRI unveil many hidden properties of the human brain. We performed this multi-class classification study on selected subjects from the publically available attention deficit hyperactivity disorder ADHD-200 dataset of patients and healthy children. The dataset has three groups, namely, ADHD inattentive, ADHD combined, and typically developing. We calculated the global averaged functional connectivity maps across the whole cortex to extract anatomical atlas parcellation based features from the resting-state fMRI (rs-fMRI) data and cortical parcellation based features from the structural MRI (sMRI) data. In addition, the preprocessed image volumes from both of these modalities followed an ANOVA analysis separately using all the voxels. This study utilized the average measure from the most significant regions acquired from ANOVA as features for classification in addition to the multi-modal and multi-measure features of structural and functional MRI data. We extracted most discriminative features by hierarchical sparse feature elimination and selection algorithm. These features include cortical thickness, image intensity, volume, cortical thickness standard deviation, surface area, and ANOVA based features respectively. An extreme learning machine performed both the binary and multi-class classifications in comparison with support vector machines. This article reports prediction accuracy of both unimodal and multi-modal features from test data. We achieved 76.190% (p < 0.0001) classification accuracy in multi-class settings as well as 92.857% (p < 0.0001) classification accuracy in binary settings. In addition, we found ANOVA-based significant regions of the brain that also play a vital role in the classification of ADHD. Thus, from a clinical perspective, this multi-modal group analysis approach with multi-measure features may improve the accuracy of the ADHD differential diagnosis.

Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls

Neuroimaging-based single subject prediction of brain disorders has gained increasing attention in recent years. Using a variety of neuroimaging modalities such as structural, functional and diffusion MRI, along with machine learning techniques, hundreds of studies have been carried out for accurate classification of patients with heterogeneous mental and neurodegenerative disorders such as schizophrenia and Alzheimer's disease. More than 500 studies have been published during the past quarter century on single subject prediction focused on a multiple brain disorders. In the first part of this study, we provide a survey of more than 200 reports in this field with a focus on schizophrenia, mild cognitive impairment (MCI), Alzheimer's disease (AD), depressive disorders, autism spectrum disease (ASD) and attention-deficit hyperactivity disorder (ADHD). Detailed information about those studies such as sample size, type and number of extracted features and reported accuracy are summarized and discussed. To our knowledge, this is by far the most comprehensive review of neuroimaging-based single subject prediction of brain disorders. In the second part, we present our opinion on major pitfalls of those studies from a machine learning point of view. Common biases are discussed and suggestions are provided. Moreover, emerging trends such as decentralized data sharing, multimodal brain imaging, differential diagnosis, disease subtype classification and deep learning are also discussed. Based on this survey, there is extensive evidence showing the great potential of neuroimaging data for single subject prediction of various disorders. However, the main bottleneck of this exciting field is still the limited sample size, which could be potentially addressed by modern data sharing models such as the ones discussed in this paper. Emerging big data technologies and advanced data-intensive machine learning methodologies such as deep learning have coincided with an increasing need for accurate, robust and generalizable single subject prediction of brain disorders during an exciting time. In this report, we survey the past and offer some opinions regarding the road ahead.

Quantifying patterns of brain activity: Distinguishing unaffected siblings from participants with ADHD and healthy individuals

Attention-deficit/hyperactivity disorder (ADHD) is one of the most prevalent and heritable psychiatric disorders. While previous studies have focussed on mapping focal or connectivity differences at the group level, the present study employed pattern recognition to quantify group separation between unaffected siblings, participants with ADHD, and healthy controls on the basis of spatially distributed brain activations. This was achieved using an fMRI-adapted version of the Stop-Signal Task in a sample of 103 unaffected siblings, 184 participants with ADHD, and 128 healthy controls. We used activation maps derived from three task regressors as features in our analyses employing a Gaussian process classifier. We showed that unaffected siblings could be distinguished from participants with ADHD (area under the receiver operating characteristic curve (AUC) = 0.65, p = 0.002, 95% Modified Wald CI: 0.59-0.71 AUC) and healthy controls (AUC = 0.59, p = 0.030, 95% Modified Wald CI: 0.52-0.66 AUC), although the latter did not survive correction for multiple comparisons. Further, participants with ADHD could be distinguished from healthy controls (AUC = 0.64, p = 0.001, 95% Modified Wald CI: 0.58-0.70 AUC). Altogether the present results characterise a pattern of frontolateral, superior temporal and inferior parietal expansion that is associated with risk for ADHD. Unaffected siblings show differences primarily in frontolateral regions. This provides evidence for a neural profile shared between participants with ADHD and their healthy siblings.

Multivariate analyses applied to fetal, neonatal and pediatric MRI of neurodevelopmental disorders

Multivariate analysis (MVA) is a class of statistical and pattern recognition methods that involve the processing of data that contains multiple measurements per sample. MVA can be used to address a wide variety of medical neuroimaging-related challenges including identifying variables associated with a measure of clinical importance (i.e. patient outcome), creating diagnostic tests, assisting in characterizing developmental disorders, understanding disease etiology, development and progression, assisting in treatment monitoring and much more. Compared to adults, imaging of developing immature brains has attracted less attention from MVA researchers. However, remarkable MVA research growth has occurred in recent years. This paper presents the results of a systematic review of the literature focusing on MVA technologies applied to neurodevelopmental disorders in fetal, neonatal and pediatric magnetic resonance imaging (MRI) of the brain. The goal of this manuscript is to provide a concise review of the state of the scientific literature on studies employing brain MRI and MVA in a pre-adult population. Neurological developmental disorders addressed in the MVA research contained in this review include autism spectrum disorder, attention deficit hyperactivity disorder, epilepsy, schizophrenia and more. While the results of this review demonstrate considerable interest from the scientific community in applications of MVA technologies in pediatric/neonatal/fetal brain MRI, the field is still young and considerable research growth remains ahead of us.

Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool

BACKGROUND

Medical Image segmentation is an important image processing step. Comparing images to evaluate the quality of segmentation is an essential part of measuring progress in this research area. Some of the challenges in evaluating medical segmentation are: metric selection, the use in the literature of multiple definitions for certain metrics, inefficiency of the metric calculation implementations leading to difficulties with large volumes, and lack of support for fuzzy segmentation by existing metrics.

RESULT

First we present an overview of 20 evaluation metrics selected based on a comprehensive literature review. For fuzzy segmentation, which shows the level of membership of each voxel to multiple classes, fuzzy definitions of all metrics are provided. We present a discussion about metric properties to provide a guide for selecting evaluation metrics. Finally, we propose an efficient evaluation tool implementing the 20 selected metrics. The tool is optimized to perform efficiently in terms of speed and required memory, also if the image size is extremely large as in the case of whole body MRI or CT volume segmentation. An implementation of this tool is available as an open source project.

CONCLUSION

We propose an efficient evaluation tool for 3D medical image segmentation using 20 evaluation metrics and provide guidelines for selecting a subset of these metrics that is suitable for the data and the segmentation task.

From estimating activation locality to predicting disorder: A review of pattern recognition for neuroimaging-based psychiatric diagnostics

Psychiatric disorders are increasingly being recognised as having a biological basis, but their diagnosis is made exclusively behaviourally. A promising approach for 'biomarker' discovery has been based on pattern recognition methods applied to neuroimaging data, which could yield clinical utility in future. In this review we survey the literature on pattern recognition for making diagnostic predictions in psychiatric disorders, and evaluate progress made in translating such findings towards clinical application. We evaluate studies on many criteria, including data modalities used, the types of features extracted and algorithm applied. We identify problems common to many studies, such as a relatively small sample size and a primary focus on estimating generalisability within a single study. Furthermore, we highlight challenges that are not widely acknowledged in the field including the importance of accommodating disease prevalence, the necessity of more extensive validation using large carefully acquired samples, the need for methodological innovations to improve accuracy and to discriminate between multiple disorders simultaneously. Finally, we identify specific clinical contexts in which pattern recognition can add value in the short to medium term.

The effects of methylphenidate on cerebral activations to salient stimuli in healthy adults

Detection of a salient stimulus is critical to cognitive functioning. A stimulus is salient when it appears infrequently, carries high motivational value, and/or when it dictates changes in behavior. Individuals with neurological conditions that implicate altered catecholaminergic signaling, such as those with attention deficit hyperactivity disorder, are impaired in detecting salient stimuli, a deficit that can be remediated by catecholaminergic medications. However, the effects of these catecholaminergic agents on cerebral activities during saliency processing within the context of the stop-signal task are not clear. Here, we examined the effects of a single oral dose (45 mg) of methylphenidate in 24 healthy adults performing the stop-signal task during functional MRI (fMRI). Compared to 92 demographically matched adults who did not receive any medications, the methylphenidate group showed higher activations in bilateral caudate head, primary motor cortex, and the right inferior parietal cortex during stop as compared to go trials (p < .05, corrected for family-wise error of multiple comparisons). These results show that methylphenidate enhances saliency processing by promoting specific cerebral regional activities. These findings may suggest a neural basis for catecholaminergic treatment of attention disorders.