1
|
Xu Y, Yu Z, Li Y, Liu Y, Li Y, Wang Y. Autism spectrum disorder diagnosis with EEG signals using time series maps of brain functional connectivity and a combined CNN-LSTM model. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 250:108196. [PMID: 38678958 DOI: 10.1016/j.cmpb.2024.108196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 01/30/2024] [Accepted: 04/21/2024] [Indexed: 05/01/2024]
Abstract
BACKGROUND AND OBJECTIVE People with autism spectrum disorder (ASD) often have cognitive impairments. Effective connectivity between different areas of the brain is essential for normal cognition. Electroencephalography (EEG) has been widely used in the detection of neurological diseases. Previous studies on detecting ASD with EEG data have focused on frequency-related features. Most of these studies have augmented data by splitting the dataset into time slices or sliding windows. However, such approaches to data augmentation may cause the testing data to be contaminated by the training data. To solve this problem, this study developed a novel method for detecting ASD with EEG data. METHODS This study quantified the functional connectivity of the subject's brain from EEG signals and defined the individual to be the unit of analysis. Publicly available EEG data were gathered from 97 and 92 subjects with ASD and typical development (TD), respectively, while they were at rest or performing a task. Time-series maps of brain functional connectivity were constructed, and the data were augmented using a deep convolutional generative adversarial network. In addition, a combined network for ASD detection, based on convolutional neural network (CNN) and long short-term memory (LSTM), was designed and implemented. RESULTS Based on functional connectivity, the network achieved classification accuracies of 81.08% and 74.55% on resting state and task state data, respectively. In addition, we found that the functional connectivity of ASD differed from TD primarily in the short-distance functional connectivity of the parietal and occipital lobes and in the distant connections from the right temporoparietal junction region to the left posterior temporal lobe. CONCLUSIONS This paper provides a new perspective for better utilizing EEG to understand ASD. The method proposed in our study is expected to be a reliable tool to assist in the diagnosis of ASD.
Collapse
Affiliation(s)
- Yongjie Xu
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zengjie Yu
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yisheng Li
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Yuehan Liu
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Ye Li
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Yishan Wang
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.
| |
Collapse
|
2
|
Zhao F, Lv K, Ye S, Chen X, Chen H, Fan S, Mao N, Ren Y. Integration of temporal & spatial properties of dynamic functional connectivity based on two-directional two-dimensional principal component analysis for disease analysis. PeerJ 2024; 12:e17078. [PMID: 38618569 PMCID: PMC11011592 DOI: 10.7717/peerj.17078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Accepted: 02/19/2024] [Indexed: 04/16/2024] Open
Abstract
Dynamic functional connectivity, derived from resting-state functional magnetic resonance imaging (rs-fMRI), has emerged as a crucial instrument for investigating and supporting the diagnosis of neurological disorders. However, prevalent features of dynamic functional connectivity predominantly capture either temporal or spatial properties, such as mean and global efficiency, neglecting the significant information embedded in the fusion of spatial and temporal attributes. In addition, dynamic functional connectivity suffers from the problem of temporal mismatch, i.e., the functional connectivity of different subjects at the same time point cannot be matched. To address these problems, this article introduces a novel feature extraction framework grounded in two-directional two-dimensional principal component analysis. This framework is designed to extract features that integrate both spatial and temporal properties of dynamic functional connectivity. Additionally, we propose to use Fourier transform to extract temporal-invariance properties contained in dynamic functional connectivity. Experimental findings underscore the superior performance of features extracted by this framework in classification experiments compared to features capturing individual properties.
Collapse
Affiliation(s)
- Feng Zhao
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Ke Lv
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Shixin Ye
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Xiaobo Chen
- School of Computer Science and Technology, Shandong Technology and Business University, Yantai, China
| | - Hongyu Chen
- School Hospital, Shandong Technology and Business University, Yantai, China
| | - Sizhe Fan
- Canada Qingdao Secondary School (CQSS), Qingdao, China
| | - Ning Mao
- Department of Radiology, Yantai Yuhuangding Hospital, Yantai, China
| | - Yande Ren
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| |
Collapse
|
3
|
Jung W, Jeon E, Kang E, Suk HI. EAG-RS: A Novel Explainability-Guided ROI-Selection Framework for ASD Diagnosis via Inter-Regional Relation Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:1400-1411. [PMID: 38015693 DOI: 10.1109/tmi.2023.3337362] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
Deep learning models based on resting-state functional magnetic resonance imaging (rs-fMRI) have been widely used to diagnose brain diseases, particularly autism spectrum disorder (ASD). Existing studies have leveraged the functional connectivity (FC) of rs-fMRI, achieving notable classification performance. However, they have significant limitations, including the lack of adequate information while using linear low-order FC as inputs to the model, not considering individual characteristics (i.e., different symptoms or varying stages of severity) among patients with ASD, and the non-explainability of the decision process. To cover these limitations, we propose a novel explainability-guided region of interest (ROI) selection (EAG-RS) framework that identifies non-linear high-order functional associations among brain regions by leveraging an explainable artificial intelligence technique and selects class-discriminative regions for brain disease identification. The proposed framework includes three steps: (i) inter-regional relation learning to estimate non-linear relations through random seed-based network masking, (ii) explainable connection-wise relevance score estimation to explore high-order relations between functional connections, and (iii) non-linear high-order FC-based diagnosis-informative ROI selection and classifier learning to identify ASD. We validated the effectiveness of our proposed method by conducting experiments using the Autism Brain Imaging Database Exchange (ABIDE) dataset, demonstrating that the proposed method outperforms other comparative methods in terms of various evaluation metrics. Furthermore, we qualitatively analyzed the selected ROIs and identified ASD subtypes linked to previous neuroscientific studies.
Collapse
|
4
|
Liu Y, Wang H, Ding Y. The Dynamical Biomarkers in Functional Connectivity of Autism Spectrum Disorder Based on Dynamic Graph Embedding. Interdiscip Sci 2024; 16:141-159. [PMID: 38060171 DOI: 10.1007/s12539-023-00592-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Revised: 11/02/2023] [Accepted: 11/02/2023] [Indexed: 12/08/2023]
Abstract
Autism spectrum disorder (ASD) is a neurological and developmental disorder and its early diagnosis is a challenging task. The dynamic brain network (DBN) offers a wealth of information for the diagnosis and treatment of ASD. Mining the spatio-temporal characteristics of DBN is critical for finding dynamic communication across brain regions and, ultimately, identifying the ASD diagnostic biomarker. We proposed the dgEmbed-KNN and the Aggregation-SVM diagnostic models, which use the spatio-temporal information from DBN and interactive information among brain regions represented by dynamic graph embedding. The classification accuracies show that dgEmbed-KNN model performs slightly better than traditional machine learning and deep learning methods, while the Aggregation-SVM model has a very good capacity to diagnose ASD using aggregation brain network connections as features. We discovered over- and under-connections in ASD at the level of dynamic connections, involving brain regions of the postcentral gyrus, the insula, the cerebellum, the caudate nucleus, and the temporal pole. We also found abnormal dynamic interactions associated with ASD within/between the functional subnetworks, including default mode network, visual network, auditory network and saliency network. These can provide potential DBN biomarkers for ASD identification.
Collapse
Affiliation(s)
- Yanting Liu
- School of Science, Jiangnan University, Wuxi, 214122, China
| | - Hao Wang
- School of Science, Jiangnan University, Wuxi, 214122, China
| | - Yanrui Ding
- School of Science, Jiangnan University, Wuxi, 214122, China.
| |
Collapse
|
5
|
Koc E, Kalkan H, Bilgen S. Autism Spectrum Disorder Detection by Hybrid Convolutional Recurrent Neural Networks from Structural and Resting State Functional MRI Images. AUTISM RESEARCH AND TREATMENT 2023; 2023:4136087. [PMID: 38152612 PMCID: PMC10752691 DOI: 10.1155/2023/4136087] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 10/19/2023] [Accepted: 11/22/2023] [Indexed: 12/29/2023]
Abstract
This study aims to increase the accuracy of autism spectrum disorder (ASD) diagnosis based on cognitive and behavioral phenotypes through multiple neuroimaging modalities. We apply machine learning (ML) algorithms to classify ASD patients and healthy control (HC) participants using structural magnetic resonance imaging (s-MRI) together with resting state functional MRI (rs-f-MRI and f-MRI) data from the large multisite data repository ABIDE (autism brain imaging data exchange) and identify important brain connectivity features. The 2D f-MRI images were converted into 3D s-MRI images, and datasets were preprocessed using the Montreal Neurological Institute (MNI) atlas. The data were then denoised to remove any confounding factors. We show, by using three fusion strategies such as early fusion, late fusion, and cross fusion, that, in this implementation, hybrid convolutional recurrent neural networks achieve better performance in comparison to either convolutional neural networks (CNNs) or recurrent neural networks (RNNs). The proposed model classifies subjects as autistic or not according to how functional and anatomical connectivity metrics provide an overall diagnosis based on the autism diagnostic observation schedule (ADOS) standard. Our hybrid network achieved an accuracy of 96% by fusing s-MRI and f-MRI together, which outperforms the methods used in previous studies.
Collapse
Affiliation(s)
- Emel Koc
- Istanbul Okan University, Istanbul, Türkiye
| | | | | |
Collapse
|
6
|
Yang J, Hu M, Hu Y, Zhang Z, Zhong J. Diagnosis of Autism Spectrum Disorder (ASD) Using Recursive Feature Elimination-Graph Neural Network (RFE-GNN) and Phenotypic Feature Extractor (PFE). SENSORS (BASEL, SWITZERLAND) 2023; 23:9647. [PMID: 38139493 PMCID: PMC10747878 DOI: 10.3390/s23249647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 10/19/2023] [Accepted: 10/24/2023] [Indexed: 12/24/2023]
Abstract
Autism spectrum disorder (ASD) poses as a multifaceted neurodevelopmental condition, significantly impacting children's social, behavioral, and communicative capacities. Despite extensive research, the precise etiological origins of ASD remain elusive, with observable connections to brain activity. In this study, we propose a novel framework for ASD detection, extracting the characteristics of functional magnetic resonance imaging (fMRI) data and phenotypic data, respectively. Specifically, we employ recursive feature elimination (RFE) for feature selection of fMRI data and subsequently apply graph neural networks (GNN) to extract informative features from the chosen data. Moreover, we devise a phenotypic feature extractor (PFE) to extract phenotypic features effectively. We then, synergistically fuse the features and validate them on the ABIDE dataset, achieving 78.7% and 80.6% accuracy, respectively, thereby showcasing competitive performance compared to state-of-the-art methods. The proposed framework provides a promising direction for the development of effective diagnostic tools for ASD.
Collapse
Affiliation(s)
| | | | | | | | - Jiancheng Zhong
- College of Information Science and Engineering, Hunan Normal University, Changsha 410081, China; (J.Y.); (M.H.); (Y.H.); (Z.Z.)
| |
Collapse
|
7
|
Alharthi AG, Alzahrani SM. Do it the transformer way: A comprehensive review of brain and vision transformers for autism spectrum disorder diagnosis and classification. Comput Biol Med 2023; 167:107667. [PMID: 37939407 DOI: 10.1016/j.compbiomed.2023.107667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 10/25/2023] [Accepted: 10/31/2023] [Indexed: 11/10/2023]
Abstract
Autism spectrum disorder (ASD) is a condition observed in children who display abnormal patterns of interaction, behavior, and communication with others. Despite extensive research efforts, the underlying causes of this neurodevelopmental disorder and its biomarkers remain unknown. However, advancements in artificial intelligence and machine learning have improved clinicians' ability to diagnose ASD. This review paper investigates various MRI modalities to identify distinct features that characterize individuals with ASD compared to typical control subjects. The review then moves on to explore deep learning models for ASD diagnosis, including convolutional neural networks (CNNs), autoencoders, graph convolutions, attention networks, and other models. CNNs and their variations are particularly effective due to their capacity to learn structured image representations and identify reliable biomarkers for brain disorders. Computer vision transformers often employ CNN architectures with transfer learning techniques like fine-tuning and layer freezing to enhance image classification performance, surpassing traditional machine learning models. This review paper contributes in three main ways. Firstly, it provides a comprehensive overview of a recommended architecture for using vision transformers in the systematic ASD diagnostic process. To this end, the paper investigates various pre-trained vision architectures such as VGG, ResNet, Inception, InceptionResNet, DenseNet, and Swin models that were fine-tuned for ASD diagnosis and classification. Secondly, it discusses the vision transformers of 2020th like BiT, ViT, MobileViT, and ConvNeXt, and applying transfer learning methods in relation to their prospective practicality in ASD classification. Thirdly, it explores brain transformers that are pre-trained on medically rich data and MRI neuroimaging datasets. The paper recommends a systematic architecture for ASD diagnosis using brain transformers. It also reviews recently developed brain transformer-based models, such as METAFormer, Com-BrainTF, Brain Network, ST-Transformer, STCAL, BolT, and BrainFormer, discussing their deep transfer learning architectures and results in ASD detection. Additionally, the paper summarizes and discusses brain-related transformers for various brain disorders, such as MSGTN, STAGIN, and MedTransformer, in relation to their potential usefulness in ASD. The study suggests that developing specialized transformer-based models, following the success of natural language processing (NLP), can offer new directions for image classification problems in ASD brain biomarkers learning and classification. By incorporating the attention mechanism, treating MRI modalities as sequence prediction tasks trained on brain disorder classification problems, and fine-tuned on ASD datasets, brain transformers can show a great promise in ASD diagnosis.
Collapse
Affiliation(s)
- Asrar G Alharthi
- Department of Computer Science, College of Computers and Information Technology, Taif University, Saudi Arabia.
| | - Salha M Alzahrani
- Department of Computer Science, College of Computers and Information Technology, Taif University, Saudi Arabia
| |
Collapse
|
8
|
Lei D, Zhang T, Wu Y, Li W, Li X. Autism spectrum disorder diagnosis based on deep unrolling-based spatial constraint representation. Med Biol Eng Comput 2023; 61:2829-2842. [PMID: 37486440 DOI: 10.1007/s11517-023-02859-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 05/25/2023] [Indexed: 07/25/2023]
Abstract
Accurate diagnosis of autism spectrum disorder (ASD) is crucial for effective treatment and prognosis. Functional brain networks (FBNs) constructed from functional magnetic resonance imaging (fMRI) have become a popular tool for ASD diagnosis. However, existing model-driven approaches used to construct FBNs lack the ability to capture potential non-linear relationships between data and labels. Moreover, most existing studies treat the FBNs construction and disease classification as separate steps, leading to large inter-subject variability in the estimated FBNs and reducing the statistical power of subsequent group comparison. To address these limitations, we propose a new approach to FBNs construction called the deep unrolling-based spatial constraint representation (DUSCR) model and integrate it with a convolutional classifier to create an end-to-end framework for ASD recognition. Specifically, the model spatial constraint representation (SCR) is solved using a proximal gradient descent algorithm, and we unroll it into deep networks using the deep unrolling algorithm. Classification is then performed using a convolutional prototype learning model. We evaluated the effectiveness of the proposed method on the ABIDE I dataset and observed a significant improvement in model performance and classification accuracy. The resting state fMRI images are preprocessed into time series data and 3D coordinates of each region of interest. The data are fed into the DUSCR model, a model for building functional brain networks using deep learning instead of traditional models, that we propose, and then the outputs are fed into the convolutional classifier with prototype learning to determine whether the patient has ASD disease.
Collapse
Affiliation(s)
- Dajiang Lei
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Tao Zhang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Yue Wu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Weisheng Li
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Xinwei Li
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China.
| |
Collapse
|
9
|
Shao L, Fu C, Chen X. A heterogeneous graph convolutional attention network method for classification of autism spectrum disorder. BMC Bioinformatics 2023; 24:363. [PMID: 37759189 PMCID: PMC10536734 DOI: 10.1186/s12859-023-05495-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 09/21/2023] [Indexed: 09/29/2023] Open
Abstract
BACKGROUND Autism spectrum disorder (ASD) is a serious developmental disorder of the brain. Recently, various deep learning methods based on functional magnetic resonance imaging (fMRI) data have been developed for the classification of ASD. Among them, graph neural networks, which generalize deep neural network models to graph structured data, have shown great advantages. However, in graph neural methods, because the graphs constructed are homogeneous, the phenotype information of the subjects cannot be fully utilized. This affects the improvement of the classification performance. METHODS To fully utilize the phenotype information, this paper proposes a heterogeneous graph convolutional attention network (HCAN) model to classify ASD. By combining an attention mechanism and a heterogeneous graph convolutional network, important aggregated features can be extracted in the HCAN. The model consists of a multilayer HCAN feature extractor and a multilayer perceptron (MLP) classifier. First, a heterogeneous population graph was constructed based on the fMRI and phenotypic data. Then, a multilayer HCAN is used to mine graph-based features from the heterogeneous graph. Finally, the extracted features are fed into an MLP for the final classification. RESULTS The proposed method is assessed on the autism brain imaging data exchange (ABIDE) repository. In total, 871 subjects in the ABIDE I dataset are used for the classification task. The best classification accuracy of 82.9% is achieved. Compared to the other methods using exactly the same subjects in the literature, the proposed method achieves superior performance to the best reported result. CONCLUSIONS The proposed method can effectively integrate heterogeneous graph convolutional networks with a semantic attention mechanism so that the phenotype features of the subjects can be fully utilized. Moreover, it shows great potential in the diagnosis of brain functional disorders with fMRI data.
Collapse
Affiliation(s)
- Lizhen Shao
- Beijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, Beijing, 100083, China.
- Lancaster University, Lancaster, LA1 4YX, UK.
| | - Cong Fu
- Beijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, Beijing, 100083, China
- Shunde Graduate School, University of Science and Technology Beijing, Foshan, 528399, China
| | - Xunying Chen
- Beijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, Beijing, 100083, China
- Shunde Graduate School, University of Science and Technology Beijing, Foshan, 528399, China
| |
Collapse
|
10
|
Zhuang W, Jia H, Liu Y, Cong J, Chen K, Yao D, Kang X, Xu P, Zhang T. Identification and analysis of autism spectrum disorder via large-scale dynamic functional network connectivity. Autism Res 2023; 16:1512-1526. [PMID: 37365978 DOI: 10.1002/aur.2974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 06/08/2023] [Indexed: 06/28/2023]
Abstract
Autism spectrum disorder (ASD) is a prevalent neurodevelopmental disorder with severe cognitive impairment. Several studies have reported that brain functional network connectivity (FNC) has great potential for identifying ASD from healthy control (HC) and revealing the relationships between the brain and behaviors of ASD. However, few studies have explored dynamic large-scale FNC as a feature to identify individuals with ASD. This study used a time-sliding window method to study the dynamic FNC (dFNC) on the resting-state fMRI. To avoid arbitrarily determining the window length, we set a window length range of 10-75 TRs (TR = 2 s). We constructed linear support vector machine classifiers for all window length conditions. Using a nested 10-fold cross-validation framework, we obtained a grand average accuracy of 94.88% across window length conditions, which is higher than those reported in previous studies. In addition, we determined the optimal window length using the highest classification accuracy of 97.77%. Based on the optimal window length, we found that the dFNCs were located mainly in dorsal and ventral attention networks (DAN and VAN) and exhibited the highest weight in classification. Specifically, we found that the dFNC between DAN and temporal orbitofrontal network (TOFN) was significantly negatively correlated with social scores of ASD. Finally, using the dFNCs with high classification weights as features, we construct a model to predict the clinical score of ASD. Overall, our findings demonstrated that the dFNC could be a potential biomarker to identify ASD and provide new perspectives to detect cognitive changes in ASD.
Collapse
Affiliation(s)
- Wenwen Zhuang
- Mental Health Education Center and School of Science, Xihua University, Chengdu, China
| | - Hai Jia
- Mental Health Education Center and School of Science, Xihua University, Chengdu, China
| | - Yunhong Liu
- Mental Health Education Center and School of Science, Xihua University, Chengdu, China
| | - Jing Cong
- Mental Health Education Center and School of Science, Xihua University, Chengdu, China
| | - Kai Chen
- Mental Health Education Center and School of Science, Xihua University, Chengdu, China
| | - Dezhong Yao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiaodong Kang
- The Department of Sichuan 81 Rehabilitation Center, Chengdu University of TCM, Chengdu, China
| | - Peng Xu
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Tao Zhang
- Mental Health Education Center and School of Science, Xihua University, Chengdu, China
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
11
|
Helmy E, Elnakib A, ElNakieb Y, Khudri M, Abdelrahim M, Yousaf J, Ghazal M, Contractor S, Barnes GN, El-Baz A. Role of Artificial Intelligence for Autism Diagnosis Using DTI and fMRI: A Survey. Biomedicines 2023; 11:1858. [PMID: 37509498 PMCID: PMC10376963 DOI: 10.3390/biomedicines11071858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 06/22/2023] [Accepted: 06/27/2023] [Indexed: 07/30/2023] Open
Abstract
Autism spectrum disorder (ASD) is a wide range of diseases characterized by difficulties with social skills, repetitive activities, speech, and nonverbal communication. The Centers for Disease Control (CDC) estimates that 1 in 44 American children currently suffer from ASD. The current gold standard for ASD diagnosis is based on behavior observational tests by clinicians, which suffer from being subjective and time-consuming and afford only late detection (a child must have a mental age of at least two to apply for an observation report). Alternatively, brain imaging-more specifically, magnetic resonance imaging (MRI)-has proven its ability to assist in fast, objective, and early ASD diagnosis and detection. With the recent advances in artificial intelligence (AI) and machine learning (ML) techniques, sufficient tools have been developed for both automated ASD diagnosis and early detection. More recently, the development of deep learning (DL), a young subfield of AI based on artificial neural networks (ANNs), has successfully enabled the processing of brain MRI data with improved ASD diagnostic abilities. This survey focuses on the role of AI in autism diagnostics and detection based on two basic MRI modalities: diffusion tensor imaging (DTI) and functional MRI (fMRI). In addition, the survey outlines the basic findings of DTI and fMRI in autism. Furthermore, recent techniques for ASD detection using DTI and fMRI are summarized and discussed. Finally, emerging tendencies are described. The results of this study show how useful AI is for early, subjective ASD detection and diagnosis. More AI solutions that have the potential to be used in healthcare settings will be introduced in the future.
Collapse
Affiliation(s)
- Eman Helmy
- Department of Diagnostic Radiology, Faculty of Medicine, Mansoura University, Elgomheryia Street, Mansoura 3512, Egypt;
| | - Ahmed Elnakib
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Yaser ElNakieb
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Mohamed Khudri
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Mostafa Abdelrahim
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Jawad Yousaf
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (J.Y.); (M.G.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (J.Y.); (M.G.)
| | - Sohail Contractor
- Department of Radiology, University of Louisville, Louisville, KY 40202, USA;
| | - Gregory Neal Barnes
- Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA;
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| |
Collapse
|
12
|
Braik M, Awadallah MA, Al-Betar M, Hammouri AI, Alzubi OA. Cognitively Enhanced Versions of Capuchin Search Algorithm for Feature Selection in Medical Diagnosis: a COVID-19 Case Study. Cognit Comput 2023:1-38. [PMID: 37362196 PMCID: PMC10241154 DOI: 10.1007/s12559-023-10149-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 04/28/2023] [Indexed: 06/28/2023]
Abstract
Feature selection (FS) is a crucial area of cognitive computation that demands further studies. It has recently received a lot of attention from researchers working in machine learning and data mining. It is broadly employed in many different applications. Many enhanced strategies have been created for FS methods in cognitive computation to boost the performance of the methods. The goal of this paper is to present three adaptive versions of the capuchin search algorithm (CSA) that each features a better search ability than the parent CSA. These versions are used to select optimal feature subset based on a binary version of each adapted one and the k-Nearest Neighbor (k-NN) classifier. These versions were matured by applying several strategies, including automated control of inertia weight, acceleration coefficients, and other computational factors, to ameliorate search potency and convergence speed of CSA. In the velocity model of CSA, some growth computational functions, known as exponential, power, and S-shaped functions, were adopted to evolve three versions of CSA, referred to as exponential CSA (ECSA), power CSA (PCSA), and S-shaped CSA (SCSA), respectively. The results of the proposed FS methods on 24 benchmark datasets with different dimensions from various repositories were compared with other k-NN based FS methods from the literature. The results revealed that the proposed methods significantly outperformed the performance of CSA and other well-established FS methods in several relevant criteria. In particular, among the 24 datasets considered, the proposed binary ECSA, which yielded the best overall results among all other proposed versions, is able to excel the others in 18 datasets in terms of classification accuracy, 13 datasets in terms of specificity, 10 datasets in terms of sensitivity, and 14 datasets in terms of fitness values. Simply put, the results on 15, 9, and 5 datasets out of the 24 datasets studied showed that the performance levels of the binary ECSA, PCSA, and SCSA are over 90% in respect of specificity, sensitivity, and accuracy measures, respectively. The thorough results via different comparisons divulge the efficiency of the proposed methods in widening the classification accuracy compared to other methods, ensuring the ability of the proposed methods in exploring the feature space and selecting the most useful features for classification studies.
Collapse
Affiliation(s)
- Malik Braik
- Department of Computer Science, Al-Balqa Applied University, Salt, Jordan
| | - Mohammed A. Awadallah
- Department of Computer Science, Al-Aqsa University, P.O. Box 4051, Gaza, Palestine
- Artificial Intelligence Research Center (AIRC), College of Engineering and Information Technology, Ajman University, Ajman, United Arab Emirates
| | - Mohammed Azmi Al-Betar
- Artificial Intelligence Research Center (AIRC), College of Engineering and Information Technology, Ajman University, Ajman, United Arab Emirates
- Department of Information Technology, Al-Huson University College, Al-Balqa Applied University, Al-Huson, Irbid, Jordan
| | | | - Omar A. Alzubi
- Department of Computer Science, Al-Balqa Applied University, Salt, Jordan
| |
Collapse
|
13
|
Moridian P, Ghassemi N, Jafari M, Salloum-Asfar S, Sadeghi D, Khodatars M, Shoeibi A, Khosravi A, Ling SH, Subasi A, Alizadehsani R, Gorriz JM, Abdulla SA, Acharya UR. Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review. Front Mol Neurosci 2022; 15:999605. [PMID: 36267703 PMCID: PMC9577321 DOI: 10.3389/fnmol.2022.999605] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 08/09/2022] [Indexed: 12/04/2022] Open
Abstract
Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging.
Collapse
Affiliation(s)
- Parisa Moridian
- Faculty of Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Navid Ghassemi
- Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Mahboobeh Jafari
- Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Iran
| | - Salam Salloum-Asfar
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - Delaram Sadeghi
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Marjane Khodatars
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Afshin Shoeibi
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Ultimo, NSW, Australia
| | - Abdulhamit Subasi
- Faculty of Medicine, Institute of Biomedicine, University of Turku, Turku, Finland
- Department of Computer Science, College of Engineering, Effat University, Jeddah, Saudi Arabia
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Juan M. Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Sara A. Abdulla
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - U. Rajendra Acharya
- Ngee Ann Polytechnic, Singapore, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
- Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
| |
Collapse
|
14
|
Wang M, Zhang D, Huang J, Liu M, Liu Q. Consistent connectome landscape mining for cross-site brain disease identification using functional MRI. Med Image Anal 2022; 82:102591. [DOI: 10.1016/j.media.2022.102591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 07/08/2022] [Accepted: 08/18/2022] [Indexed: 11/29/2022]
|
15
|
Wang Y, Fu Y, Luo X. Identification of Pathogenetic Brain Regions via Neuroimaging Data for Diagnosis of Autism Spectrum Disorders. Front Neurosci 2022; 16:900330. [PMID: 35655751 PMCID: PMC9152096 DOI: 10.3389/fnins.2022.900330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 04/11/2022] [Indexed: 11/13/2022] Open
Abstract
Autism spectrum disorder (ASD) is a kind of neurodevelopmental disorder that often occurs in children and has a hidden onset. Patients usually have lagged development of communication ability and social behavior and thus suffer an unhealthy physical and mental state. Evidence has indicated that diseases related to ASD have commonalities in brain imaging characteristics. This study aims to study the pathogenesis of ASD based on brain imaging data to locate the ASD-related brain regions. Specifically, we collected the functional magnetic resonance image data of 479 patients with ASD and 478 normal subjects matched in age and gender and used a machine-learning framework named random support vector machine cluster to extract distinctive brain regions from the preprocessed data. According to the experimental results, compared with other existing approaches, the method used in this study can more accurately distinguish patients from normal individuals based on brain imaging data. At the same time, this study found that the development of ASD was highly correlated with certain brain regions, e.g., lingual gyrus, superior frontal gyrus, medial gyrus, insular lobe, and olfactory cortex. This study explores the effectiveness of a novel machine-learning approach in the study of ASD brain imaging and provides a reference brain area for the medical research and clinical treatment of ASD.
Collapse
Affiliation(s)
- Yu Wang
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, Hunan Normal University, Changsha, China
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
- Hunan Xiangjiang Artificial Intelligence Academy, Changsha, China
| | - Yu Fu
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, Hunan Normal University, Changsha, China
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
- Hunan Xiangjiang Artificial Intelligence Academy, Changsha, China
- *Correspondence: Yu Fu
| | - Xun Luo
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, Hunan Normal University, Changsha, China
- College of Information Science and Engineering, Hunan Normal University, Changsha, China
- Hunan Xiangjiang Artificial Intelligence Academy, Changsha, China
| |
Collapse
|
16
|
Liu L, Tang S, Wu FX, Wang YP, Wang J. An Ensemble Hybrid Feature Selection Method for Neuropsychiatric Disorder Classification. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2022; 19:1459-1471. [PMID: 33471766 DOI: 10.1109/tcbb.2021.3053181] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Magnetic resonance imagings (MRIs) are providing increased access to neuropsychiatric disorders that can be made available for advanced data analysis. However, the single type of data limits the ability of psychiatrists to distinguish the subclasses of this disease. In this paper, we propose an ensemble hybrid features selection method for the neuropsychiatric disorder classification. The method consists of a 3D DenseNet and a XGBoost, which are used to select the image features from structural MRI images and the phenotypic feature from phenotypic records, respectively. The hybrid feature is composed of image features and phenotypic features. The proposed method is validated in the Consortium for Neuropsychiatric Phenomics (CNP) dataset, where samples are classified into one of the four classes (healthy controls (HC), attention deficit hyperactivity disorder (ADHD), bipolar disorder (BD), and schizophrenia (SD)). Experimental results show that the hybrid feature can improve the performance of classification methods. The best accuracy of binary and multi-class classification can reach 91.22 and 78.62 percent, respectively. We analyze the importance of phenotypic features and image features in different classification tasks. The importance of the structure MRI images is highlighted by incorporating phenotypic features with image features to generate hybrid features. We also visualize the features of three neuropsychiatric disorders and analyze their locations in the brain region.
Collapse
|
17
|
Li X, Yang C, An Z, Wang X, Su R, Kang J. Localization and diagnosis of abnormal channels in children with ASD based on WMSSE and ASI. J Neurosci Methods 2022; 375:109595. [DOI: 10.1016/j.jneumeth.2022.109595] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 03/14/2022] [Accepted: 04/08/2022] [Indexed: 11/30/2022]
|
18
|
Cheng J, Liu J, Yue H, Bai H, Pan Y, Wang J. Prediction of Glioma Grade Using Intratumoral and Peritumoral Radiomic Features From Multiparametric MRI Images. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2022; 19:1084-1095. [PMID: 33104503 DOI: 10.1109/tcbb.2020.3033538] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The accurate prediction of glioma grade before surgery is essential for treatment planning and prognosis. Since the gold standard (i.e., biopsy)for grading gliomas is both highly invasive and expensive, and there is a need for a noninvasive and accurate method. In this study, we proposed a novel radiomics-based pipeline by incorporating the intratumoral and peritumoral features extracted from preoperative mpMRI scans to accurately and noninvasively predict glioma grade. To address the unclear peritumoral boundary, we designed an algorithm to capture the peritumoral region with a specified radius. The mpMRI scans of 285 patients derived from a multi-institutional study were adopted. A total of 2153 radiomic features were calculated separately from intratumoral volumes (ITVs)and peritumoral volumes (PTVs)on mpMRI scans, and then refined using LASSO and mRMR feature ranking methods. The top-ranking radiomic features were entered into the classifiers to build radiomic signatures for predicting glioma grade. The prediction performance was evaluated with five-fold cross-validation on a patient-level split. The radiomic signatures utilizing the features of ITV and PTV both show a high accuracy in predicting glioma grade, with AUCs reaching 0.968. By incorporating the features of ITV and PTV, the AUC of IPTV radiomic signature can be increased to 0.975, which outperforms the state-of-the-art methods. Additionally, our proposed method was further demonstrated to have strong generalization performance in an external validation dataset with 65 patients. The source code of our implementation is made publicly available at https://github.com/chengjianhong/glioma_grading.git.
Collapse
|
19
|
|
20
|
A review of methods for classification and recognition of ASD using fMRI data. J Neurosci Methods 2021; 368:109456. [PMID: 34954253 DOI: 10.1016/j.jneumeth.2021.109456] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 12/17/2021] [Accepted: 12/18/2021] [Indexed: 02/06/2023]
Abstract
Autism spectrum disorder (ASD) is a severe neuropsychiatric brain disorder that affects people's social communication and daily routine. Considering the phenomenon of abnormal brain function in the early stage of ASD, functional magnetic resonance imaging (fMRI), an excellent technique that measures brain activity, provides effective data to study ASD. Therefore, based on fMRI data of ASD cases, this paper reviews the progress of machine learning methods and deep learning methods in ASD classification and recognition in the last three years and summarizes the different research results of fMRI data extracted from the Autism Brain Imaging Data Exchange (ABIDE). From the classification performance of classification and recognition of ASD by the two methods, comparing the important classification indicators such as accuracy, sensitivity and specificity, the current challenges and future development trends are reported, which can provide an essential reference for the early diagnosis of ASD cases.
Collapse
|
21
|
Chaddad A, Li J, Lu Q, Li Y, Okuwobi IP, Tanougast C, Desrosiers C, Niazi T. Can Autism Be Diagnosed with Artificial Intelligence? A Narrative Review. Diagnostics (Basel) 2021; 11:2032. [PMID: 34829379 PMCID: PMC8618159 DOI: 10.3390/diagnostics11112032] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 10/31/2021] [Accepted: 10/31/2021] [Indexed: 11/16/2022] Open
Abstract
Radiomics with deep learning models have become popular in computer-aided diagnosis and have outperformed human experts on many clinical tasks. Specifically, radiomic models based on artificial intelligence (AI) are using medical data (i.e., images, molecular data, clinical variables, etc.) for predicting clinical tasks such as autism spectrum disorder (ASD). In this review, we summarized and discussed the radiomic techniques used for ASD analysis. Currently, the limited radiomic work of ASD is related to the variation of morphological features of brain thickness that is different from texture analysis. These techniques are based on imaging shape features that can be used with predictive models for predicting ASD. This review explores the progress of ASD-based radiomics with a brief description of ASD and the current non-invasive technique used to classify between ASD and healthy control (HC) subjects. With AI, new radiomic models using the deep learning techniques will be also described. To consider the texture analysis with deep CNNs, more investigations are suggested to be integrated with additional validation steps on various MRI sites.
Collapse
Affiliation(s)
- Ahmad Chaddad
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
- The Laboratory for Imagery, Vision and Artificial Intelligence, École de Technologie Supérieure (ETS), Montreal, QC H3C 1K3, Canada;
| | - Jiali Li
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Qizong Lu
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Yujie Li
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Idowu Paul Okuwobi
- School of Artificial Intelligence, Guilin Universiy of Electronic Technology, Guilin 541004, China; (J.L.); (Q.L.); (Y.L.); (I.P.O.)
| | - Camel Tanougast
- Laboratoire de Conception, Optimisation et Modélisation des Systèmes, University of Lorraine, 57070 Metz, France;
| | - Christian Desrosiers
- The Laboratory for Imagery, Vision and Artificial Intelligence, École de Technologie Supérieure (ETS), Montreal, QC H3C 1K3, Canada;
| | - Tamim Niazi
- Lady Davis Institute for Medical Research, McGill University, Montreal, QC H3T 1E2, Canada;
| |
Collapse
|
22
|
Yang C, Wang P, Tan J, Liu Q, Li X. Autism spectrum disorder diagnosis using graph attention network based on spatial-constrained sparse functional brain networks. Comput Biol Med 2021; 139:104963. [PMID: 34700253 DOI: 10.1016/j.compbiomed.2021.104963] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 10/13/2021] [Accepted: 10/17/2021] [Indexed: 11/16/2022]
Abstract
The accurate diagnosis of autism spectrum disorder (ASD), a common mental disease in children, has always been an important task in clinical practice. In recent years, the use of graph neural network (GNN) based on functional brain network (FBN) has shown powerful performance for disease diagnosis. The challenge to construct "ideal" FBN from resting-state fMRI data remained. Moreover, it remains unclear whether and to what extent the non-Euclidean structure of different FBNs affect the performance of GNN-based disease classification. In this paper, we proposed a new method named Pearson's correlation-based Spatial Constraints Representation (PSCR) to estimate the FBN structures that were transformed to brain graphs and then fed into a graph attention network (GAT) to diagnose ASD. Extensive experiments on comparing different FBN construction methods and classification frameworks were conducted on the ABIDE I dataset (n = 871). The results demonstrated the superiority of our PSCR method and the influence of different FBNs on the GNN-based classification results. The proposed PSCR and GAT framework achieved promising classification results for ASD (accuracy: 72.40%), which significantly outperformed competing methods. This will help facilitate patient-control separation, and provide a promising solution for future disease diagnosis based on the FBN and GNN framework.
Collapse
Affiliation(s)
- Chunde Yang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China; School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Panyu Wang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Jia Tan
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Qingshui Liu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Xinwei Li
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China.
| |
Collapse
|
23
|
Liu M, Li B, Hu D. Autism Spectrum Disorder Studies Using fMRI Data and Machine Learning: A Review. Front Neurosci 2021; 15:697870. [PMID: 34602966 PMCID: PMC8480393 DOI: 10.3389/fnins.2021.697870] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 08/09/2021] [Indexed: 01/01/2023] Open
Abstract
Machine learning methods have been frequently applied in the field of cognitive neuroscience in the last decade. A great deal of attention has been attracted to introduce machine learning methods to study the autism spectrum disorder (ASD) in order to find out its neurophysiological underpinnings. In this paper, we presented a comprehensive review about the previous studies since 2011, which applied machine learning methods to analyze the functional magnetic resonance imaging (fMRI) data of autistic individuals and the typical controls (TCs). The all-round process was covered, including feature construction from raw fMRI data, feature selection methods, machine learning methods, factors for high classification accuracy, and critical conclusions. Applying different machine learning methods and fMRI data acquired from different sites, classification accuracies were obtained ranging from 48.3% up to 97%, and informative brain regions and networks were located. Through thorough analysis, high classification accuracies were found to usually occur in the studies which involved task-based fMRI data, single dataset for some selection principle, effective feature selection methods, or advanced machine learning methods. Advanced deep learning together with the multi-site Autism Brain Imaging Data Exchange (ABIDE) dataset became research trends especially in the recent 4 years. In the future, advanced feature selection and machine learning methods combined with multi-site dataset or easily operated task-based fMRI data may appear to have the potentiality to serve as a promising diagnostic tool for ASD.
Collapse
Affiliation(s)
- Meijie Liu
- Engineering Training Center, Xi'an University of Science and Technology, Xi'an, China.,College of Missile Engineering, Rocket Force University of Engineering, Xi'an, China
| | - Baojuan Li
- School of Biomedical Engineering, Air Force Medical University, Xi'an, China
| | - Dewen Hu
- College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China
| |
Collapse
|
24
|
Xu M, Calhoun V, Jiang R, Yan W, Sui J. Brain imaging-based machine learning in autism spectrum disorder: methods and applications. J Neurosci Methods 2021; 361:109271. [PMID: 34174282 DOI: 10.1016/j.jneumeth.2021.109271] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Revised: 05/25/2021] [Accepted: 06/19/2021] [Indexed: 01/09/2023]
Abstract
Autism spectrum disorder (ASD) is a neurodevelopmental condition with early childhood onset and high heterogeneity. As the pathogenesis is still elusive, ASD diagnosis is comprised of a constellation of behavioral symptoms. Non-invasive brain imaging techniques, such as magnetic resonance imaging (MRI), provide a valuable objective measurement of the brain. Many efforts have been devoted to developing imaging-based diagnostic tools for ASD based on machine learning (ML) technologies. In this survey, we review recent advances that utilize machine learning approaches to classify individuals with and without ASD. First, we provide a brief overview of neuroimaging-based ASD classification studies, including the analysis of publications and general classification pipeline. Next, representative studies are highlighted and discussed in detail regarding different imaging modalities, methods and sample sizes. Finally, we highlight several common challenges and provide recommendations on future directions. In summary, identifying discriminative biomarkers for ASD diagnosis is challenging, and further establishing more comprehensive datasets and dissecting the individual and group heterogeneity will be critical to achieve better ADS diagnosis performance. Machine learning methods will continue to be developed and are poised to help advance the field in this regard.
Collapse
Affiliation(s)
- Ming Xu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China 100049
| | - Vince Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University, Atlanta, GA, USA 30303
| | - Rongtao Jiang
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190
| | - Weizheng Yan
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University, Atlanta, GA, USA 30303
| | - Jing Sui
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China 100088.
| |
Collapse
|
25
|
Li HD, Yang C, Zhang Z, Yang M, Wu FX, Omenn GS, Wang J. IsoResolve: predicting splice isoform functions by integrating gene and isoform-level features with domain adaptation. Bioinformatics 2021; 37:522-530. [PMID: 32966552 PMCID: PMC8088322 DOI: 10.1093/bioinformatics/btaa829] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 08/12/2020] [Accepted: 09/09/2020] [Indexed: 11/14/2022] Open
Abstract
MOTIVATION High resolution annotation of gene functions is a central goal in functional genomics. A single gene may produce multiple isoforms with different functions through alternative splicing. Conventional approaches, however, consider a gene as a single entity without differentiating these functionally different isoforms. Towards understanding gene functions at higher resolution, recent efforts have focused on predicting the functions of isoforms. However, the performance of existing methods is far from satisfactory mainly because of the lack of isoform-level functional annotation. RESULTS We present IsoResolve, a novel approach for isoform function prediction, which leverages the information from gene function prediction models with domain adaptation (DA). IsoResolve treats gene-level and isoform-level features as source and target domains, respectively. It uses DA to project the two domains into a latent variable space in such a way that the latent variables from the two domains have similar distribution, which enables the gene domain information to be leveraged for isoform function prediction. We systematically evaluated the performance of IsoResolve in predicting functions. Compared with five state-of-the-art methods, IsoResolve achieved significantly better performance. IsoResolve was further validated by case studies of genes with isoform-level functional annotation. AVAILABILITY AND IMPLEMENTATION IsoResolve is freely available at https://github.com/genemine/IsoResolve. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Hong-Dong Li
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| | - Changhuo Yang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| | - Zhimin Zhang
- College of Chemistry and Chemical Engineering, Central South University, Changsha, Hunan 410083, China
| | - Mengyun Yang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| | - Fang-Xiang Wu
- Division of Biomedical Engineering, University of Saskatchewan, Saskatoon, SK S7N5A9, Canada
| | - Gilbert S Omenn
- Institute for Systems Biology, Seattle, WA 98101, USA.,Department of Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, MI 48109-2218, USA
| | - Jianxin Wang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| |
Collapse
|
26
|
Wang M, Huang J, Liu M, Zhang D. Modeling dynamic characteristics of brain functional connectivity networks using resting-state functional MRI. Med Image Anal 2021; 71:102063. [PMID: 33910109 DOI: 10.1016/j.media.2021.102063] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2020] [Revised: 03/06/2021] [Accepted: 03/29/2021] [Indexed: 01/21/2023]
Abstract
Dynamic network analysis using resting-state functional magnetic resonance imaging (rs-fMRI) provides a great insight into fundamentally dynamic characteristics of human brains, thus providing an efficient solution to automated brain disease identification. Previous studies usually pay less attention to evolution of global network structures over time in each brain's rs-fMRI time series, and also treat network-based feature extraction and classifier training as two separate tasks. To address these issues, we propose a temporal dynamics learning (TDL) method for network-based brain disease identification using rs-fMRI time-series data, through which network feature extraction and classifier training are integrated into the unified framework. Specifically, we first partition rs-fMRI time series into a sequence of segments using overlapping sliding windows, and then construct longitudinally ordered functional connectivity networks. To model the global temporal evolution patterns of these successive networks, we introduce a group-fused Lasso regularizer in our TDL framework, while the specific network architecture is induced by an ℓ1-norm regularizer. Besides, we develop an efficient optimization algorithm to solve the proposed objective function via the Alternating Direction Method of Multipliers (ADMM). Compared with previous studies, the proposed TDL model can not only explicitly model the evolving connectivity patterns of global networks over time, but also capture unique characteristics of each network defined at each segment. We evaluate our TDL on three real autism spectrum disorder (ASD) datasets with rs-fMRI data, achieving superior results in ASD identification compared with several state-of-the-art methods.
Collapse
Affiliation(s)
- Mingliang Wang
- School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing 210044, China; College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
| | - Jiashuang Huang
- School of Information Science and Technology, Nantong University, Nantong 226019, China; College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC 27599, USA.
| | - Daoqiang Zhang
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China.
| |
Collapse
|