1
|
Moridian P, Ghassemi N, Jafari M, Salloum-Asfar S, Sadeghi D, Khodatars M, Shoeibi A, Khosravi A, Ling SH, Subasi A, Alizadehsani R, Gorriz JM, Abdulla SA, Acharya UR. Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review. Front Mol Neurosci 2022; 15:999605. [PMID: 36267703 PMCID: PMC9577321 DOI: 10.3389/fnmol.2022.999605] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 08/09/2022] [Indexed: 12/04/2022] Open
Abstract
Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging.
Collapse
Affiliation(s)
- Parisa Moridian
- Faculty of Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Navid Ghassemi
- Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Mahboobeh Jafari
- Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Iran
| | - Salam Salloum-Asfar
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - Delaram Sadeghi
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Marjane Khodatars
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Afshin Shoeibi
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Ultimo, NSW, Australia
| | - Abdulhamit Subasi
- Faculty of Medicine, Institute of Biomedicine, University of Turku, Turku, Finland
- Department of Computer Science, College of Engineering, Effat University, Jeddah, Saudi Arabia
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Juan M. Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Sara A. Abdulla
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - U. Rajendra Acharya
- Ngee Ann Polytechnic, Singapore, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
- Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
| |
Collapse
|
2
|
A CNN Deep Local and Global ASD Classification Approach with Continuous Wavelet Transform Using Task-Based FMRI. SENSORS 2021; 21:s21175822. [PMID: 34502710 PMCID: PMC8433893 DOI: 10.3390/s21175822] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/24/2021] [Accepted: 08/25/2021] [Indexed: 11/17/2022]
Abstract
Autism spectrum disorder (ASD) is a neurodegenerative disorder characterized by lingual and social disabilities. The autism diagnostic observation schedule is the current gold standard for ASD diagnosis. Developing objective computer aided technologies for ASD diagnosis with the utilization of brain imaging modalities and machine learning is one of main tracks in current studies to understand autism. Task-based fMRI demonstrates the functional activation in the brain by measuring blood oxygen level-dependent (BOLD) variations in response to certain tasks. It is believed to hold discriminant features for autism. A novel computer aided diagnosis (CAD) framework is proposed to classify 50 ASD and 50 typically developed toddlers with the adoption of CNN deep networks. The CAD system includes both local and global diagnosis in a response to speech task. Spatial dimensionality reduction with region of interest selection and clustering has been utilized. In addition, the proposed framework performs discriminant feature extraction with continuous wavelet transform. Local diagnosis on cingulate gyri, superior temporal gyrus, primary auditory cortex and angular gyrus achieves accuracies ranging between 71% and 80% with a four-fold cross validation technique. The fused global diagnosis achieves an accuracy of 86% with 82% sensitivity, 92% specificity. A brain map indicating ASD severity level for each brain area is created, which contributes to personalized diagnosis and treatment plans.
Collapse
|
3
|
Haweel R, Shalaby A, Mahmoud A, Seada N, Ghoniemy S, Ghazal M, Casanova MF, Barnes GN, El-Baz A. A robust DWT-CNN-based CAD system for early diagnosis of autism using task-based fMRI. Med Phys 2021; 48:2315-2326. [PMID: 33378589 DOI: 10.1002/mp.14692] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 11/27/2020] [Accepted: 12/17/2020] [Indexed: 02/06/2023] Open
Abstract
PURPOSE Task-based fMRI (TfMRI) is a diagnostic imaging modality for observing the effects of a disease or other condition on the functional activity of the brain. Autism spectrum disorder (ASD) is a pervasive developmental disorder associated with impairments in social and linguistic abilities. Machine learning algorithms have been widely utilized for brain imaging aiming for objective ASD diagnostics. Recently, deep learning methods have been gaining more attention for fMRI classification. The goal of this paper is to develop a convolutional neural network (CNN)-based framework to help in global diagnosis of ASD using TfMRI data that are collected from a response to speech experiment. METHODS To achieve this goal, the proposed framework adopts a novel imaging marker integrating both spatial and temporal information that are related to the functional activity of the brain. The developed pipeline consists of three main components. In the first step, the collected TfMRI data are preprocessed and parcellated using the Harvard-Oxford probabilistic atlas included with the fMRIB Software Library (FSL). Second, a group analysis using FSL is performed between ASD and typically developing (TD) children to identify significantly activated brain areas in response to the speech task. In order to reduce brain spatial dimensionality, a K-means clustering technique is performed on such significant brain areas. Informative blood oxygen level-dependent (BOLD) signals are extracted from each cluster. A compression step for each extracted BOLD signal using discrete wavelet transform (DWT) has been proposed. The adopted wavelets are similar to the expected hemodynamic response which enables DWT to compress the BOLD signal while highlighting its activation information. Finally, a deep learning 2D CNN network is used to classify the patients as ASD or TD based on extracted features from the previous step. RESULTS Preliminary results on 100 TfMRI dataset (50 ASD, 50 TD) obtain 80% correct global classification using tenfold cross validation (with sensitivity = 84%, specificity = 76%). CONCLUSION The experimental results show the high accuracy of the proposed framework and hold promise for the presented framework as a helpful adjunct to currently used ASD diagnostic tools.
Collapse
Affiliation(s)
- Reem Haweel
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, KY, 40208, USA
- Computer Systems Department, Faculty of Computer and Information Sciences, University of Ain Shams, Cairo, 11566, Egypt
| | - Ahmed Shalaby
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, KY, 40208, USA
| | - Ali Mahmoud
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, KY, 40208, USA
| | - Noha Seada
- Computer Systems Department, Faculty of Computer and Information Sciences, University of Ain Shams, Cairo, 11566, Egypt
| | - Said Ghoniemy
- Computer Systems Department, Faculty of Computer and Information Sciences, University of Ain Shams, Cairo, 11566, Egypt
| | - Mohammed Ghazal
- Department of Electrical and Computer Engineering, Abu Dhabi University, Abu Dhabi, 59911, UAE
| | - Manuel F Casanova
- Biomedical Sciences, University of South Carolina, Greenville, SC, 29607, USA
| | - Gregory N Barnes
- Department of Neurology, University of Louisville, Louisville, KY, 40208, USA
| | - Ayman El-Baz
- Department of Bioengineering, University of Louisville, KY, 40208, USA
| |
Collapse
|
4
|
Zhuang J, Dvornek NC, Li X, Ventola P, Duncan JS. Invertible Network for Classification and Biomarker Selection for ASD. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2019; 11766:700-708. [PMID: 32274471 PMCID: PMC7144624 DOI: 10.1007/978-3-030-32248-9_78] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Determining biomarkers for autism spectrum disorder (ASD) is crucial to understanding its mechanisms. Recently deep learning methods have achieved success in the classification task of ASD using fMRI data. However, due to the black-box nature of most deep learning models, it's hard to perform biomarker selection and interpret model decisions. The recently proposed invertible networks can accurately reconstruct the input from its output, and have the potential to unravel the black-box representation. Therefore, we propose a novel method to classify ASD and identify biomarkers for ASD using the connectivity matrix calculated from fMRI as the input. Specifically, with invertible networks, we explicitly determine the decision boundary and the projection of data points onto the boundary. Like linear classifiers, the difference between a point and its projection onto the decision boundary can be viewed as the explanation. We then define the importance as the explanation weighted by the gradient of prediction w.r.t the input, and identify biomarkers based on this importance measure. We perform a regression task to further validate our biomarker selection: compared to using all edges in the connectivity matrix, using the top 10% important edges we generate a lower regression error on 6 different severity scores. Our experiments show that the invertible network is both effective at ASD classification and interpretable, allowing for discovery of reliable biomarkers.
Collapse
Affiliation(s)
- Juntang Zhuang
- Biomedical Engineering, Yale University, New Haven, CT USA
| | - Nicha C Dvornek
- Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT USA
| | - Xiaoxiao Li
- Biomedical Engineering, Yale University, New Haven, CT USA
| | | | - James S Duncan
- Biomedical Engineering, Yale University, New Haven, CT USA
- Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT USA
- Electrical Engineering, Yale University, New Haven, CT USA
| |
Collapse
|
5
|
Zhuang J, Dvornek NC, Zhao Q, Li X, Ventola P, Duncan JS. PREDICTION OF TREATMENT OUTCOME FOR AUTISM FROM STRUCTURE OF THE BRAIN BASED ON SURE INDEPENDENCE SCREENING. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2019; 2019:404-408. [PMID: 32256966 PMCID: PMC7119202 DOI: 10.1109/isbi.2019.8759156] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder, and behavioral treatment interventions have shown promise for young children with ASD. However, there is limited progress in understanding the effect of each type of treatment. In this project, we aim to detect structural changes in the brain after treatment and select structural features associated with treatment outcomes. The difficulty in building large databases of patients who have received specific treatments and the high dimensionality of medical image analysis problems are the challenges in this work. To select predictive features and build accurate models, we use the sure independence screening (SIS) method. SIS is a theoretically and empirically validated method for ultra-high dimensional general linear models, and it achieves both predictive accuracy and correct feature selection by iterative feature selection. Compared with step-wise feature selection methods, SIS removes multiple features in each iteration and is computationally efficient. Compared with other linear models such as elastic-net regression, support vector regression (SVR) and partial least squares regression (PSLR), SIS achieves higher accuracy. We validated the superior performance of SIS in various experiments: First, we extract brain structural features from FreeSurfer, including cortical thickness, surface area, mean curvature and cortical volume. Next, we predict different measures of treatment outcomes based on structural features. We show that SIS achieves the highest correlation between prediction and measurements in all tasks. Furthermore, we report regions selected by SIS as biomarkers for ASD.
Collapse
Affiliation(s)
- Juntang Zhuang
- Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Nicha C Dvornek
- Child Study Center, Yale University, New Haven, CT, USA
- Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Qingyu Zhao
- Department of Psychiatry and Behavioral Sciences, Stanford University,Stanford, USA
| | - Xiaoxiao Li
- Biomedical Engineering, Yale University, New Haven, CT, USA
| | | | - James S Duncan
- Biomedical Engineering, Yale University, New Haven, CT, USA
- Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| |
Collapse
|
6
|
Zhuang J, Dvornek NC, Li X, Ventola P, Duncan JS. Prediction of severity and treatment outcome for ASD from fMRI. PREDICTIVE INTELLIGENCE IN MEDICINE. PRIME (WORKSHOP) 2018; 11121:9-17. [PMID: 32984867 PMCID: PMC7513883 DOI: 10.1007/978-3-030-00320-3_2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/15/2023]
Abstract
Autism spectrum disorder (ASD) is a complex neurodevelop-mental syndrome. Early diagnosis and precise treatment are essential for ASD patients. Although researchers have built many analytical models, there has been limited progress in accurate predictive models for early diagnosis. In this project, we aim to build an accurate model to predict treatment outcome and ASD severity from early stage functional magnetic resonance imaging (fMRI) scans. The difficulty in building large databases of patients who have received specific treatments and the high dimensionality of medical image analysis problems are challenges in this work. We propose a generic and accurate two-level approach for high-dimensional regression problems in medical image analysis. First, we perform region-level feature selection using a predefined brain parcellation. Based on the assumption that voxels within one region in the brain have similar values, for each region we use the bootstrapped mean of voxels within it as a feature. In this way, the dimension of data is reduced from number of voxels to number of regions. Then we detect predictive regions by various feature selection methods. Second, we extract voxels within selected regions, and perform voxel-level feature selection. To use this model in both linear and non-linear cases with limited training examples, we apply two-level elastic net regression and random forest (RF) models respectively. To validate accuracy and robustness of this approach, we perform experiments on both task-fMRI and resting state fMRI datasets. Furthermore, we visualize the influence of each region, and show that the results match well with other findings.
Collapse
Affiliation(s)
- Juntang Zhuang
- Biomedical Engineering, Yale University, New Haven, CT USA
| | - Nicha C Dvornek
- Child Study Center, Yale University, New Haven, CT USA
- Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT USA
| | - Xiaoxiao Li
- Biomedical Engineering, Yale University, New Haven, CT USA
| | | | - James S Duncan
- Biomedical Engineering, Yale University, New Haven, CT USA
- Radiology & Biomedical Imaging, Yale School of Medicine, New Haven, CT USA
- Electrical Engineering, Yale University, New Haven, CT USA
| |
Collapse
|