1
|
Xu Y, Yu Z, Li Y, Liu Y, Li Y, Wang Y. Autism spectrum disorder diagnosis with EEG signals using time series maps of brain functional connectivity and a combined CNN-LSTM model. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 250:108196. [PMID: 38678958 DOI: 10.1016/j.cmpb.2024.108196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 01/30/2024] [Accepted: 04/21/2024] [Indexed: 05/01/2024]
Abstract
BACKGROUND AND OBJECTIVE People with autism spectrum disorder (ASD) often have cognitive impairments. Effective connectivity between different areas of the brain is essential for normal cognition. Electroencephalography (EEG) has been widely used in the detection of neurological diseases. Previous studies on detecting ASD with EEG data have focused on frequency-related features. Most of these studies have augmented data by splitting the dataset into time slices or sliding windows. However, such approaches to data augmentation may cause the testing data to be contaminated by the training data. To solve this problem, this study developed a novel method for detecting ASD with EEG data. METHODS This study quantified the functional connectivity of the subject's brain from EEG signals and defined the individual to be the unit of analysis. Publicly available EEG data were gathered from 97 and 92 subjects with ASD and typical development (TD), respectively, while they were at rest or performing a task. Time-series maps of brain functional connectivity were constructed, and the data were augmented using a deep convolutional generative adversarial network. In addition, a combined network for ASD detection, based on convolutional neural network (CNN) and long short-term memory (LSTM), was designed and implemented. RESULTS Based on functional connectivity, the network achieved classification accuracies of 81.08% and 74.55% on resting state and task state data, respectively. In addition, we found that the functional connectivity of ASD differed from TD primarily in the short-distance functional connectivity of the parietal and occipital lobes and in the distant connections from the right temporoparietal junction region to the left posterior temporal lobe. CONCLUSIONS This paper provides a new perspective for better utilizing EEG to understand ASD. The method proposed in our study is expected to be a reliable tool to assist in the diagnosis of ASD.
Collapse
Affiliation(s)
- Yongjie Xu
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zengjie Yu
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yisheng Li
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Yuehan Liu
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 100049, China
| | - Ye Li
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Yishan Wang
- Research Center for Biomedical Information Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.
| |
Collapse
|
2
|
Wang H, Jing H, Yang J, Liu C, Hu L, Tao G, Zhao Z, Shen N. Identifying autism spectrum disorder from multi-modal data with privacy-preserving. NPJ MENTAL HEALTH RESEARCH 2024; 3:15. [PMID: 38698164 PMCID: PMC11066078 DOI: 10.1038/s44184-023-00050-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 12/20/2023] [Indexed: 05/05/2024]
Abstract
The application of deep learning models to precision medical diagnosis often requires the aggregation of large amounts of medical data to effectively train high-quality models. However, data privacy protection mechanisms make it difficult to perform medical data collection from different medical institutions. In autism spectrum disorder (ASD) diagnosis, automatic diagnosis using multimodal information from heterogeneous data has not yet achieved satisfactory performance. To address the privacy preservation issue as well as to improve ASD diagnosis, we propose a deep learning framework using multimodal feature fusion and hypergraph neural networks for disease prediction in federated learning (FedHNN). By introducing the federated learning strategy, each local model is trained and computed independently in a distributed manner without data sharing, allowing rapid scaling of medical datasets to achieve robust and scalable deep learning predictive models. To further improve the performance with privacy preservation, we improve the hypergraph model for multimodal fusion to make it suitable for autism spectrum disorder (ASD) diagnosis tasks by capturing the complementarity and correlation between modalities through a hypergraph fusion strategy. The results demonstrate that our proposed federated learning-based prediction model is superior to all local models and outperforms other deep learning models. Overall, our proposed FedHNN has good results in the work of using multi-site data to improve the performance of ASD identification.
Collapse
Affiliation(s)
- Haishuai Wang
- College of Computer Science, Zhejiang University, Hangzhou, China.
| | - Hezi Jing
- College of Computer Science, Tianjin Normal University, Tianjin, China
| | - Jianjun Yang
- Department of General Practice, Shandong Provincial Third Hospital, Shandong University, Jinan, China
| | - Chao Liu
- Department of Orthodontics, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Liwei Hu
- Department of Radiology, Shanghai Children's Medical Center, Shanghai Jiao Tong University, Shanghai, China
| | - Guangyu Tao
- Department of Radiology, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Ziping Zhao
- College of Computer Science, Tianjin Normal University, Tianjin, China.
| | - Ning Shen
- Liangzhu Laboratory, School of Medicine, Zhejiang University, Hangzhou, China.
| |
Collapse
|
3
|
Guan Z, Yu J, Shi Z, Liu X, Yu R, Lai T, Yang C, Dong H, Chen R, Wei L. Dynamic graph transformer network via dual-view connectivity for autism spectrum disorder identification. Comput Biol Med 2024; 174:108415. [PMID: 38599070 DOI: 10.1016/j.compbiomed.2024.108415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Revised: 03/17/2024] [Accepted: 04/03/2024] [Indexed: 04/12/2024]
Abstract
Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that requires objective and accurate identification methods for effective early intervention. Previous population-based methods via functional connectivity (FC) analysis ignore the differences between positive and negative FCs, which provide the potential information complementarity. And they also require additional information to construct a pre-defined graph. Meanwhile, two challenging demand attentions are the imbalance of performance caused by the class distribution and the inherent heterogeneity of multi-site data. In this paper, we propose a novel dynamic graph Transformer network based on dual-view connectivity for ASD Identification. It is based on the Autoencoders, which regard the input feature as individual feature and without any inductive bias. First, a dual-view feature extractor is designed to extract individual and complementary information from positive and negative connectivity. Then Graph Transformer network is innovated with a hot plugging K-Nearest Neighbor (KNN) algorithm module which constructs a dynamic population graph without any additional information. Additionally, we introduce the PolyLoss function and the Vrex method to address the class imbalance and improve the model's generalizability. The evaluation experiment on 1102 subjects from the ABIDE I dataset demonstrates our method can achieve superior performance over several state-of-the-art methods and satisfying generalizability for ASD identification.
Collapse
Affiliation(s)
- Zihao Guan
- College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou, 350002, China; Digital Fujian Research Institute of Big Data for Agriculture and Forestry, Fujian Agriculture and Forestry University, Fuzhou, 350002, China
| | - Jiaming Yu
- College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou, 350002, China; Digital Fujian Research Institute of Big Data for Agriculture and Forestry, Fujian Agriculture and Forestry University, Fuzhou, 350002, China
| | - Zhenshan Shi
- Department of Radiology, The First Affiliated Hospital of Fujian Medical University, Fuzhou, 350002, China
| | - Xiumei Liu
- Developmental and Behavior Pediatrics Department, Fujian Children's Hospital - Fujian Branch of Shanghai Children's Medical Center, Fuzhou, 350002, China; College of Clinical Medicine for Obstetrics Gynecology and Pediatrics, Fujian Medical University, Fuzhou, 350012, China
| | - Renping Yu
- School of Electrical and Information Engineering, Zhengzhou University, Zhengzhou, 450001, China
| | - Taotao Lai
- College of Computer and Control Engineering, Minjiang University, Fuzhou, 350108, China
| | - Changcai Yang
- College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou, 350002, China; Digital Fujian Research Institute of Big Data for Agriculture and Forestry, Fujian Agriculture and Forestry University, Fuzhou, 350002, China
| | - Heng Dong
- College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou, 350002, China; Digital Fujian Research Institute of Big Data for Agriculture and Forestry, Fujian Agriculture and Forestry University, Fuzhou, 350002, China
| | - Riqing Chen
- College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou, 350002, China; Digital Fujian Research Institute of Big Data for Agriculture and Forestry, Fujian Agriculture and Forestry University, Fuzhou, 350002, China
| | - Lifang Wei
- College of Computer and Information Science, Fujian Agriculture and Forestry University, Fuzhou, 350002, China; Digital Fujian Research Institute of Big Data for Agriculture and Forestry, Fujian Agriculture and Forestry University, Fuzhou, 350002, China.
| |
Collapse
|
4
|
Xia Z, Zhou T, Mamoon S, Lu J. Inferring brain causal and temporal-lag networks for recognizing abnormal patterns of dementia. Med Image Anal 2024; 94:103133. [PMID: 38458094 DOI: 10.1016/j.media.2024.103133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2022] [Revised: 11/21/2022] [Accepted: 03/01/2024] [Indexed: 03/10/2024]
Abstract
Brain functional network analysis has become a popular method to explore the laws of brain organization and identify biomarkers of neurological diseases. However, it is still a challenging task to construct an ideal brain network due to the limited understanding of the human brain. Existing methods often ignore the impact of temporal-lag on the results of brain network modeling, which may lead to some unreliable conclusions. To overcome this issue, we propose a novel brain functional network estimation method, which can simultaneously infer the causal mechanisms and temporal-lag values among brain regions. Specifically, our method converts the lag learning into an instantaneous effect estimation problem, and further embeds the search objectives into a deep neural network model as parameters to be learned. To verify the effectiveness of the proposed estimation method, we perform experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) database by comparing the proposed model with several existing methods, including correlation-based and causality-based methods. The experimental results show that our brain networks constructed by the proposed estimation method can not only achieve promising classification performance, but also exhibit some characteristics of physiological mechanisms. Our approach provides a new perspective for understanding the pathogenesis of brain diseases. The source code is released at https://github.com/NJUSTxiazw/CTLN.
Collapse
Affiliation(s)
- Zhengwang Xia
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Tao Zhou
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Saqib Mamoon
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Jianfeng Lu
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China.
| |
Collapse
|
5
|
Lee DJ, Shin DH, Son YH, Han JW, Oh JH, Kim DH, Jeong JH, Kam TE. Spectral Graph Neural Network-Based Multi-Atlas Brain Network Fusion for Major Depressive Disorder Diagnosis. IEEE J Biomed Health Inform 2024; 28:2967-2978. [PMID: 38363664 DOI: 10.1109/jbhi.2024.3366662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2024]
Abstract
Major Depressive Disorder (MDD) imposes a substantial burden within the healthcare domain, impacting millions of individuals worldwide. Functional Magnetic Resonance Imaging (fMRI) has emerged as a promising tool for the objective diagnosis of MDD, enabling the investigation of functional connectivity patterns in the brain associated with this disorder. However, most existing methods focus on a single brain atlas, which limits their ability to capture the complex, multi-scale nature of functional brain networks. To address these limitations, we propose a novel multi-atlas fusion method that incorporates early and late fusion in a unified framework. Our method introduces the concept of the holistic Functional Connectivity Network (FCN), which captures both intra-atlas relationships within individual atlases and inter-regional relationships between atlases with different brain parcellation scales. This comprehensive representation enables the identification of potential disease-related patterns associated with MDD in the early stage of our framework. Moreover, by decoding the holistic FCN from various perspectives through multiple spectral Graph Convolutional Neural Networks and fusing their results with decision-level ensembles, we further improve the performance of MDD diagnosis. Our approach is easily implemented with minimal modifications to existing model structures and demonstrates a robust performance across different baseline models. Our method, evaluated on public resting-state fMRI datasets, surpasses the current multi-atlas fusion methods, enhancing the accuracy of MDD diagnosis. The proposed novel multi-atlas fusion framework provides a more reliable MDD diagnostic technique. Experimental results show our approach outperforms both single- and multi-atlas-based methods, demonstrating its effectiveness in advancing MDD diagnosis.
Collapse
|
6
|
Alharthi AG, Alzahrani SM. Do it the transformer way: A comprehensive review of brain and vision transformers for autism spectrum disorder diagnosis and classification. Comput Biol Med 2023; 167:107667. [PMID: 37939407 DOI: 10.1016/j.compbiomed.2023.107667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 10/25/2023] [Accepted: 10/31/2023] [Indexed: 11/10/2023]
Abstract
Autism spectrum disorder (ASD) is a condition observed in children who display abnormal patterns of interaction, behavior, and communication with others. Despite extensive research efforts, the underlying causes of this neurodevelopmental disorder and its biomarkers remain unknown. However, advancements in artificial intelligence and machine learning have improved clinicians' ability to diagnose ASD. This review paper investigates various MRI modalities to identify distinct features that characterize individuals with ASD compared to typical control subjects. The review then moves on to explore deep learning models for ASD diagnosis, including convolutional neural networks (CNNs), autoencoders, graph convolutions, attention networks, and other models. CNNs and their variations are particularly effective due to their capacity to learn structured image representations and identify reliable biomarkers for brain disorders. Computer vision transformers often employ CNN architectures with transfer learning techniques like fine-tuning and layer freezing to enhance image classification performance, surpassing traditional machine learning models. This review paper contributes in three main ways. Firstly, it provides a comprehensive overview of a recommended architecture for using vision transformers in the systematic ASD diagnostic process. To this end, the paper investigates various pre-trained vision architectures such as VGG, ResNet, Inception, InceptionResNet, DenseNet, and Swin models that were fine-tuned for ASD diagnosis and classification. Secondly, it discusses the vision transformers of 2020th like BiT, ViT, MobileViT, and ConvNeXt, and applying transfer learning methods in relation to their prospective practicality in ASD classification. Thirdly, it explores brain transformers that are pre-trained on medically rich data and MRI neuroimaging datasets. The paper recommends a systematic architecture for ASD diagnosis using brain transformers. It also reviews recently developed brain transformer-based models, such as METAFormer, Com-BrainTF, Brain Network, ST-Transformer, STCAL, BolT, and BrainFormer, discussing their deep transfer learning architectures and results in ASD detection. Additionally, the paper summarizes and discusses brain-related transformers for various brain disorders, such as MSGTN, STAGIN, and MedTransformer, in relation to their potential usefulness in ASD. The study suggests that developing specialized transformer-based models, following the success of natural language processing (NLP), can offer new directions for image classification problems in ASD brain biomarkers learning and classification. By incorporating the attention mechanism, treating MRI modalities as sequence prediction tasks trained on brain disorder classification problems, and fine-tuned on ASD datasets, brain transformers can show a great promise in ASD diagnosis.
Collapse
Affiliation(s)
- Asrar G Alharthi
- Department of Computer Science, College of Computers and Information Technology, Taif University, Saudi Arabia.
| | - Salha M Alzahrani
- Department of Computer Science, College of Computers and Information Technology, Taif University, Saudi Arabia
| |
Collapse
|
7
|
Alharthi AG, Alzahrani SM. Multi-Slice Generation sMRI and fMRI for Autism Spectrum Disorder Diagnosis Using 3D-CNN and Vision Transformers. Brain Sci 2023; 13:1578. [PMID: 38002538 PMCID: PMC10670036 DOI: 10.3390/brainsci13111578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 11/03/2023] [Accepted: 11/09/2023] [Indexed: 11/26/2023] Open
Abstract
Researchers have explored various potential indicators of ASD, including changes in brain structure and activity, genetics, and immune system abnormalities, but no definitive indicator has been found yet. Therefore, this study aims to investigate ASD indicators using two types of magnetic resonance images (MRI), structural (sMRI) and functional (fMRI), and to address the issue of limited data availability. Transfer learning is a valuable technique when working with limited data, as it utilizes knowledge gained from a pre-trained model in a domain with abundant data. This study proposed the use of four vision transformers namely ConvNeXT, MobileNet, Swin, and ViT using sMRI modalities. The study also investigated the use of a 3D-CNN model with sMRI and fMRI modalities. Our experiments involved different methods of generating data and extracting slices from raw 3D sMRI and 4D fMRI scans along the axial, coronal, and sagittal brain planes. To evaluate our methods, we utilized a standard neuroimaging dataset called NYU from the ABIDE repository to classify ASD subjects from typical control subjects. The performance of our models was evaluated against several baselines including studies that implemented VGG and ResNet transfer learning models. Our experimental results validate the effectiveness of the proposed multi-slice generation with the 3D-CNN and transfer learning methods as they achieved state-of-the-art results. In particular, results from 50-middle slices from the fMRI and 3D-CNN showed a profound promise in ASD classifiability as it obtained a maximum accuracy of 0.8710 and F1-score of 0.8261 when using the mean of 4D images across the axial, coronal, and sagittal. Additionally, the use of the whole slices in fMRI except the beginnings and the ends of brain views helped to reduce irrelevant information and showed good performance of 0.8387 accuracy and 0.7727 F1-score. Lastly, the transfer learning with the ConvNeXt model achieved results higher than other transformers when using 50-middle slices sMRI along the axial, coronal, and sagittal planes.
Collapse
Affiliation(s)
| | - Salha M. Alzahrani
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif 21944, Saudi Arabia;
| |
Collapse
|
8
|
Almars AM, Badawy M, Elhosseini MA. ASD 2-TL∗ GTO: Autism spectrum disorders detection via transfer learning with gorilla troops optimizer framework. Heliyon 2023; 9:e21530. [PMID: 38027906 PMCID: PMC10660553 DOI: 10.1016/j.heliyon.2023.e21530] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 10/19/2023] [Accepted: 10/23/2023] [Indexed: 12/01/2023] Open
Abstract
Autism Spectrum Disorder (ASD) treatment requires accurate diagnosis and effective rehabilitation. Artificial intelligence (AI) techniques in medical diagnosis and rehabilitation can aid doctors in detecting a wide range of diseases more effectively. Nevertheless, due to its highly heterogeneous symptoms and complicated nature, ASD diagnostics continues to be a challenge for researchers. This study introduces an intelligent system based on the Artificial Gorilla Troops Optimizer (GTO) metaheuristic optimizer to detect ASD using Deep Learning and Machine Learning. Kaggle and UCI ML Repository are the data sources used in this study. The first dataset is the Autistic Children Data Set, which contains 3,374 facial images of children divided into Autistic and Non-Autistic categories. The second dataset is a compilation of data from three numerical repositories: (1) Autism Screening Adults, (2) Autistic Spectrum Disorder Screening Data for Adolescents, and (3) Autistic Spectrum Disorder Screening Data for Children. When it comes to image dataset experiments, the most notable results are (1) a TF learning ratio greater than or equal to 50 is recommended, (2) all models recommend data augmentation, and (3) the DenseNet169 model reports the lowest loss value of 0.512. Concerning the numeric dataset, five experiments recommend standardization and the final five attributes are optional in the classification process. The performance metrics demonstrate the worthiness of the proposed feature selection technique using GTO more than counterparts in the literature review.
Collapse
Affiliation(s)
- Abdulqader M. Almars
- Taibah University, College of Computer Science and Engineering, Yanbu, 46421, Saudi Arabia
| | - Mahmoud Badawy
- Taibah University, Applied College, Computer Science, and Information Department, Medina, 41461, Saudi Arabia
- Mansoura University, Faculty of Engineering, Computers and Control Systems Engineering Department, Mansoura, 35516, Egypt
| | - Mostafa A. Elhosseini
- Taibah University, College of Computer Science and Engineering, Yanbu, 46421, Saudi Arabia
- Mansoura University, Faculty of Engineering, Computers and Control Systems Engineering Department, Mansoura, 35516, Egypt
| |
Collapse
|
9
|
Ji J, Zhang Y. Deep Hashing Mutual Learning for Brain Network Classification. IEEE J Biomed Health Inform 2023; 27:4489-4499. [PMID: 37318974 DOI: 10.1109/jbhi.2023.3286421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Recently, clinical phenotypic semantic information has begun to play an important role in some brain network classification methods based on deep learning. However, most current methods only consider the phenotypic semantic information of individual brain networks but ignore the potential phenotypic characteristics among group brain networks. To address this problem, we present a deep hashing mutual learning (DHML)-based brain network classification method. Specifically, we first design a separable CNN-based deep hashing learning to extract individual topological features of brain networks and map them into hash codes. Secondly, we construct a group brain network relationship graph based on the similarity of phenotypic semantic information, in which each node is a brain network, and the properties of the nodes are the individual features extracted in the previous step. Then, we adopt a GCN-based deep hashing learning to extract the group topological features of the brain network and map them to hash codes. Finally, the two deep hashing learning models perform mutual learning by measuring the distribution differences between the hash codes to achieve the interaction of individual and group features. The experimental results on the three commonly used brain atlases (AAL Atlas, Dosenbach160 Atlas, and CC200 Atlas) of the ABIDE I dataset show that our proposed DHML method achieves optimal classification performance compared with some state-of-the-art methods.
Collapse
|
10
|
Qiang N, Gao J, Dong Q, Li J, Zhang S, Liang H, Sun Y, Ge B, Liu Z, Wu Z, Liu T, Yue H, Zhao S. A deep learning method for autism spectrum disorder identification based on interactions of hierarchical brain networks. Behav Brain Res 2023; 452:114603. [PMID: 37516208 DOI: 10.1016/j.bbr.2023.114603] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 07/24/2023] [Accepted: 07/26/2023] [Indexed: 07/31/2023]
Abstract
BACKGROUND It has been recently shown that deep learning models exhibited remarkable performance of representing functional Magnetic Resonance Imaging (fMRI) data for the understanding of brain functional activities. With hierarchical structure, deep learning models can infer hierarchical functional brain networks (FBN) from fMRI. However, the applications of the hierarchical FBNs have been rarely studied. METHODS In this work, we proposed a hierarchical recurrent variational auto-encoder (HRVAE) to unsupervisedly model the fMRI data. The trained HRVAE encoder can predict hierarchical temporal features from its three hidden layers, and thus can be regarded as a hierarchical feature extractor. Then LASSO (least absolute shrinkage and selection operator) regression was applied to estimate the corresponding hierarchical FBNs. Based on the hierarchical FBNs from each subject, we constructed a novel classification framework for brain disorder identification and test it on the Autism Brain Imaging Data Exchange (ABIDE) dataset, a world-wide multi-site database of autism spectrum disorder (ASD). We analyzed the hierarchy organization of FBNs, and finally used the overlaps of hierarchical FBNs as features to differentiate ASD from typically developing controls (TDC). RESULTS The experimental results on 871 subjects from ABIDE dataset showed that the HRVAE model can effectively derive hierarchical FBNs including many well-known resting state networks (RSN). Moreover, the classification result improved the state-of-the-art by achieving a very high accuracy of 82.1 %. CONCLUSIONS This work presents a novel data-driven deep learning method using fMRI data for ASD identification, which could provide valuable reference for clinical diagnosis. The classification results suggest that the interactions of hierarchical FBNs have association with brain disorder, which promotes the understanding of FBN hierarchy and could be applied to other brain disorder analysis.
Collapse
Affiliation(s)
- Ning Qiang
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China; Center for Brain and Brain-Inspired Computing Research, Department of Computer Science, Northwestern Polytechnical University, Xi'an, China
| | - Jie Gao
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Qinglin Dong
- Advanced Medical Computing and Analysis, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Jin Li
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Shu Zhang
- Center for Brain and Brain-Inspired Computing Research, Department of Computer Science, Northwestern Polytechnical University, Xi'an, China
| | - Hongtao Liang
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Yifei Sun
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Bao Ge
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China; Center for Brain and Brain-Inspired Computing Research, Department of Computer Science, Northwestern Polytechnical University, Xi'an, China
| | - Zhengliang Liu
- Cortical Architecture Imaging and Discovery Lab, School of Computing, The University of Georgia, Athens, GA, USA
| | - Zihao Wu
- Cortical Architecture Imaging and Discovery Lab, School of Computing, The University of Georgia, Athens, GA, USA
| | - Tianming Liu
- Cortical Architecture Imaging and Discovery Lab, School of Computing, The University of Georgia, Athens, GA, USA
| | - Huiji Yue
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China.
| | - Shijie Zhao
- School of Automation, Northwestern Polytechnical University, Xi'an, China.
| |
Collapse
|
11
|
Qureshi MS, Qureshi MB, Asghar J, Alam F, Aljarbouh A. Prediction and Analysis of Autism Spectrum Disorder Using Machine Learning Techniques. JOURNAL OF HEALTHCARE ENGINEERING 2023; 2023:4853800. [PMID: 37469788 PMCID: PMC10352530 DOI: 10.1155/2023/4853800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 03/05/2022] [Accepted: 04/05/2022] [Indexed: 07/21/2023]
Abstract
Autism spectrum disorder is a severe, life-prolonged neurodevelopmental disease typified by disabilities that are chronic or limited in the development of socio-communication skills, thinking abilities, activities, and behavior. In children aged two to three years, the symptoms of autism are more evident and easier to recognize. The major part of the existing literature on autism spectrum disorder is covered by a prediction system based on traditional machine learning algorithms such as support vector machine, random forest, multiple layer perceptron, naive Bayes, convolution neural network, and deep neural network. The proposed models are validated by using performance measurement parameters such as accuracy, precision, and recall. In this research, autism spectrum disorder prediction has been investigated and compared using common parameters such as application type, simulation method, comparison methodology, and input data. The key purpose of this study is to give a centralized framework to use for researchers working on autism spectrum disorder prediction. The best results were obtained by using the random forest algorithm as it performs better than other traditional machine learning algorithms. The achieved accuracy is 89.23%. The workflow representations of the investigated frameworks assist readers in comprehending the fundamental workings and architectures of these frameworks.
Collapse
Affiliation(s)
- Muhammad Shuaib Qureshi
- Department of Computer Science, School of Arts and Sciences, University of Central Asia, Naryn, Kyrgyzstan
| | | | - Junaid Asghar
- Gomal Centre of Pharmaceutical Sciences, Faculty of Pharmacy, Gomal University Dera Ismail Khan, KPK, Pakistan
| | - Fatima Alam
- Department of Computer Science, Shaheed Zulfikar Ali Bhutto Institute of Science and Technology, Islamabad 44000, Pakistan
| | - Ayman Aljarbouh
- Department of Computer Science, School of Arts and Sciences, University of Central Asia, Naryn, Kyrgyzstan
| |
Collapse
|
12
|
Kang L, Chen J, Huang J, Jiang J. Autism spectrum disorder recognition based on multi-view ensemble learning with multi-site fMRI. Cogn Neurodyn 2023; 17:345-355. [PMID: 37007200 PMCID: PMC10050260 DOI: 10.1007/s11571-022-09828-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 05/12/2022] [Accepted: 05/27/2022] [Indexed: 11/03/2022] Open
Abstract
Autism spectrum disorders (ASD) is a neurodevelopmental disorder that causes repetitive stereotyped behavior and social difficulties, early diagnosis and intervention are beneficial to improve treatment effect. Although multi-site data expand sample size, they suffer from inter-site heterogeneitys, which degrades the performance of identitying ASD from normal controls (NC). To solve the problem, in this paper a multi-view ensemble learning network based on deep learning is proposed to improve the classification performance with multi-site functional MRI (fMRI). Specifically, the LSTM-Conv model was firstly proposed to obtain dynamic spatiotemporal features of the mean time series of fMRI data; then the low/high-level brain functional connectivity features of the brain functional network were extracted by principal component analysis algorithm and a 3-layer stacked denoising autoencoder; finally, feature selection and ensemble learning were carried out for the above three brain functional features, and a classification accuracy of 72% was obtained on multi-site data of ABIDE dataset. The experimental result illustrates that the proposed method can effectively improve the classification performance of ASD and NC. Compared with single-view learning, multi-view ensemble learning can mine various brain functional features of fMRI data from different perspectives and alleviate the problems caused by data heterogeneity. In addition, this study also employed leave-one-out cross validation to test the single-site data, and the results showed that the proposed method has strong generalization capability, in which the highest classification accuracy of 92.9% was obtained at the CMU site.
Collapse
Affiliation(s)
- Li Kang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518061 China
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen, China
| | - Jin Chen
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518061 China
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen, China
| | - Jianjun Huang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518061 China
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen, China
| | - Jingwan Jiang
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518061 China
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen, China
| |
Collapse
|
13
|
ElNakieb Y, Ali MT, Elnakib A, Shalaby A, Mahmoud A, Soliman A, Barnes GN, El-Baz A. Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study. BIOENGINEERING (BASEL, SWITZERLAND) 2023; 10:bioengineering10010056. [PMID: 36671628 PMCID: PMC9855190 DOI: 10.3390/bioengineering10010056] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/22/2022] [Accepted: 12/27/2022] [Indexed: 01/04/2023]
Abstract
In addition to the standard observational assessment for autism spectrum disorder (ASD), recent advancements in neuroimaging and machine learning (ML) suggest a rapid and objective alternative using brain imaging. This work presents a pipelined framework, using functional magnetic resonance imaging (fMRI) that allows not only an accurate ASD diagnosis but also the identification of the brain regions contributing to the diagnosis decision. The proposed framework includes several processing stages: preprocessing, brain parcellation, feature representation, feature selection, and ML classification. For feature representation, the proposed framework uses both a conventional feature representation and a novel dynamic connectivity representation to assist in the accurate classification of an autistic individual. Based on a large publicly available dataset, this extensive research highlights different decisions along the proposed pipeline and their impact on diagnostic accuracy. A large publicly available dataset of 884 subjects from the Autism Brain Imaging Data Exchange I (ABIDE-I) initiative is used to validate our proposed framework, achieving a global balanced accuracy of 98.8% with five-fold cross-validation and proving the potential of the proposed feature representation. As a result of this comprehensive study, we achieve state-of-the-art accuracy, confirming the benefits of the proposed feature representation and feature engineering in extracting useful information as well as the potential benefits of utilizing ML and neuroimaging in the diagnosis and understanding of autism.
Collapse
Affiliation(s)
- Yaser ElNakieb
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Mohamed T. Ali
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Elnakib
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Shalaby
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ali Mahmoud
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Soliman
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Gregory Neal Barnes
- Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
- Correspondence:
| |
Collapse
|
14
|
Wang Y, Tang S, Ma R, Zamit I, Wei Y, Pan Y. Multi-modal intermediate integrative methods in neuropsychiatric disorders: A review. Comput Struct Biotechnol J 2022; 20:6149-6162. [DOI: 10.1016/j.csbj.2022.11.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 11/04/2022] [Accepted: 11/04/2022] [Indexed: 11/09/2022] Open
|
15
|
Moridian P, Ghassemi N, Jafari M, Salloum-Asfar S, Sadeghi D, Khodatars M, Shoeibi A, Khosravi A, Ling SH, Subasi A, Alizadehsani R, Gorriz JM, Abdulla SA, Acharya UR. Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review. Front Mol Neurosci 2022; 15:999605. [PMID: 36267703 PMCID: PMC9577321 DOI: 10.3389/fnmol.2022.999605] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 08/09/2022] [Indexed: 12/04/2022] Open
Abstract
Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging.
Collapse
Affiliation(s)
- Parisa Moridian
- Faculty of Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Navid Ghassemi
- Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Mahboobeh Jafari
- Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Iran
| | - Salam Salloum-Asfar
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - Delaram Sadeghi
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Marjane Khodatars
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Afshin Shoeibi
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Ultimo, NSW, Australia
| | - Abdulhamit Subasi
- Faculty of Medicine, Institute of Biomedicine, University of Turku, Turku, Finland
- Department of Computer Science, College of Engineering, Effat University, Jeddah, Saudi Arabia
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Juan M. Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Sara A. Abdulla
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - U. Rajendra Acharya
- Ngee Ann Polytechnic, Singapore, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
- Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
| |
Collapse
|
16
|
Qin C, Zhu X, Ye L, Peng L, Li L, Wang J, Ma J, Liu T. Autism detection based on multiple time scale model. J Neural Eng 2022; 19. [PMID: 35985297 DOI: 10.1088/1741-2552/ac8b39] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Accepted: 08/19/2022] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Current autism clinical detection relies on doctor observation and filling of clinical scales, which is subjective and easily misdetection. Existing autism research of functional magnetic resonance imaging (fMRI) over-compresses the time-scale information and has poor generalization ability. This study extracts multiple time scale brain features of fMRI, providing objective detection. APPROACH We first use least absolute shrinkage and selection operator (LASSO) to build a sparse network and extract features with a time scale of 1. Then, we use hidden markov model (HMM) to extract features that describe the dynamic changes of the brain, with a time scale of 2. Additionally, to analyze the features of the potential network activity of autism from a higher time scale, we use long short-term memory (LSTM) to construct an auto-encoder to re-encode the original data and extract the features of the at a higher time scale, with a time scale of T, and T is the time length of fMRI. We use Recursive Feature Elimination (RFE) for feature selection for three different time scale features, merge them into multiple time scale features, and finally use one-dimensional convolution neural network (1DCNN) for classification. MAIN RESULTS Compared with well-established models, our method has achieved better results. The accuracy of our method is 76.0%, and the area under the roc curve is 0.83, tested on the completely independent data, so our method has better generalization ability. SIGNIFICANCE This research analyzes fMRI sequences from multiple time scale to detect autism, and it also provides a new framework and research ideas for subsequent fMRI analysis.
Collapse
Affiliation(s)
- Chi Qin
- Xi'an Jiaotong University, School of Life Science and Technology, Xi'an, 710049, CHINA
| | - Xiaofei Zhu
- Tangdu Hospital Fourth Military Medical University, Department of Radiology, Xi'an, Shaanxi, 710038, CHINA
| | - Lin Ye
- Xi'an Jiaotong University, School of Life Science and Technology, Xi'an, 710049, CHINA
| | - Li Peng
- Tongji Hospital of Tongji Medical College of Huazhong University of Science and Technology, Department of Radiology, Wuhan, Hubei, 430030, CHINA
| | - Long Li
- Xi'an Jiaotong University, School of Life Science and Technology, Xi'an, 710049, CHINA
| | - Jue Wang
- Xi'an Jiaotong University, School of Life Science and Technology, Xi'an, 710049, CHINA
| | - Jin Ma
- Air Force Medical University, School of Aerospace Medicine, Xi'an, 710032, CHINA
| | - Tian Liu
- Xi'an Jiaotong University, School of Life Science and Technology, Xi'an, 710049, CHINA
| |
Collapse
|
17
|
Reproducible neuroimaging features for diagnosis of autism spectrum disorder with machine learning. Sci Rep 2022; 12:3057. [PMID: 35197468 PMCID: PMC8866395 DOI: 10.1038/s41598-022-06459-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Accepted: 01/25/2022] [Indexed: 12/31/2022] Open
Abstract
Autism spectrum disorder (ASD) is the fourth most common neurodevelopmental disorder, with a prevalence of 1 in 160 children. Accurate diagnosis relies on experts, but such individuals are scarce. This has led to increasing interest in the development of machine learning (ML) models that can integrate neuroimaging features from functional and structural MRI (fMRI and sMRI) to help reveal central nervous system alterations characteristic of ASD. We optimized and compared the performance of 12 of the most popular and powerful ML models. Each was separately trained using 15 different combinations of fMRI and sMRI features and optimized with an unbiased model search. Deep learning models predicted ASD with the highest diagnostic accuracy and generalized well to other MRI datasets. Our model achieves state-of-the-art 80% area under the ROC curve (AUROC) in diagnosis on test data from the IMPAC dataset; and 86% and 79% AUROC on the external ABIDE I and ABIDE II datasets (with further improvement to 93% and 90% after supervised domain adaptation). The highest performing models identified reproducible putative biomarkers for accurate ASD diagnosis in accord with known ASD markers as well as novel cerebellar biomarkers. Such reproducibility lends credence to their tremendous potential for defining and using a set of truly generalizable ASD biomarkers that will advance scientific understanding of neuronal changes in ASD.
Collapse
|
18
|
A review of methods for classification and recognition of ASD using fMRI data. J Neurosci Methods 2021; 368:109456. [PMID: 34954253 DOI: 10.1016/j.jneumeth.2021.109456] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 12/17/2021] [Accepted: 12/18/2021] [Indexed: 02/06/2023]
Abstract
Autism spectrum disorder (ASD) is a severe neuropsychiatric brain disorder that affects people's social communication and daily routine. Considering the phenomenon of abnormal brain function in the early stage of ASD, functional magnetic resonance imaging (fMRI), an excellent technique that measures brain activity, provides effective data to study ASD. Therefore, based on fMRI data of ASD cases, this paper reviews the progress of machine learning methods and deep learning methods in ASD classification and recognition in the last three years and summarizes the different research results of fMRI data extracted from the Autism Brain Imaging Data Exchange (ABIDE). From the classification performance of classification and recognition of ASD by the two methods, comparing the important classification indicators such as accuracy, sensitivity and specificity, the current challenges and future development trends are reported, which can provide an essential reference for the early diagnosis of ASD cases.
Collapse
|
19
|
Khodatars M, Shoeibi A, Sadeghi D, Ghaasemi N, Jafari M, Moridian P, Khadem A, Alizadehsani R, Zare A, Kong Y, Khosravi A, Nahavandi S, Hussain S, Acharya UR, Berk M. Deep learning for neuroimaging-based diagnosis and rehabilitation of Autism Spectrum Disorder: A review. Comput Biol Med 2021; 139:104949. [PMID: 34737139 DOI: 10.1016/j.compbiomed.2021.104949] [Citation(s) in RCA: 80] [Impact Index Per Article: 26.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Revised: 10/02/2021] [Accepted: 10/13/2021] [Indexed: 01/23/2023]
Abstract
Accurate diagnosis of Autism Spectrum Disorder (ASD) followed by effective rehabilitation is essential for the management of this disorder. Artificial intelligence (AI) techniques can aid physicians to apply automatic diagnosis and rehabilitation procedures. AI techniques comprise traditional machine learning (ML) approaches and deep learning (DL) techniques. Conventional ML methods employ various feature extraction and classification techniques, but in DL, the process of feature extraction and classification is accomplished intelligently and integrally. DL methods for diagnosis of ASD have been focused on neuroimaging-based approaches. Neuroimaging techniques are non-invasive disease markers potentially useful for ASD diagnosis. Structural and functional neuroimaging techniques provide physicians substantial information about the structure (anatomy and structural connectivity) and function (activity and functional connectivity) of the brain. Due to the intricate structure and function of the brain, proposing optimum procedures for ASD diagnosis with neuroimaging data without exploiting powerful AI techniques like DL may be challenging. In this paper, studies conducted with the aid of DL networks to distinguish ASD are investigated. Rehabilitation tools provided for supporting ASD patients utilizing DL networks are also assessed. Finally, we will present important challenges in the automated detection and rehabilitation of ASD and propose some future works.
Collapse
Affiliation(s)
- Marjane Khodatars
- Dept. of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Afshin Shoeibi
- Faculty of Electrical Engineering, FPGA Lab, K. N. Toosi University of Technology, Tehran, Iran; Computer Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran.
| | - Delaram Sadeghi
- Dept. of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Navid Ghaasemi
- Faculty of Electrical Engineering, FPGA Lab, K. N. Toosi University of Technology, Tehran, Iran; Computer Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Mahboobeh Jafari
- Electrical and Computer Engineering Faculty, Semnan University, Semnan, Iran
| | - Parisa Moridian
- Faculty of Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Ali Khadem
- Department of Biomedical Engineering, Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran.
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Victoria, 3217, Australia
| | - Assef Zare
- Faculty of Electrical Engineering, Gonabad Branch, Islamic Azad University, Gonabad, Iran
| | - Yinan Kong
- School of Engineering, Macquarie University, Sydney, 2109, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Victoria, 3217, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Victoria, 3217, Australia
| | | | - U Rajendra Acharya
- Ngee Ann Polytechnic, Singapore, 599489, Singapore; Dept. of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan; Dept. of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore
| | - Michael Berk
- Deakin University, IMPACT - the Institute for Mental and Physical Health and Clinical Translation, School of Medicine, Barwon Health, Geelong, Australia; Orygen, The National Centre of Excellence in Youth Mental Health, Centre for Youth Mental Health, Florey Institute for Neuroscience and Mental Health and the Department of Psychiatry, The University of Melbourne, Melbourne, Australia
| |
Collapse
|
20
|
Li HD, Yang C, Zhang Z, Yang M, Wu FX, Omenn GS, Wang J. IsoResolve: predicting splice isoform functions by integrating gene and isoform-level features with domain adaptation. Bioinformatics 2021; 37:522-530. [PMID: 32966552 PMCID: PMC8088322 DOI: 10.1093/bioinformatics/btaa829] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 08/12/2020] [Accepted: 09/09/2020] [Indexed: 11/14/2022] Open
Abstract
MOTIVATION High resolution annotation of gene functions is a central goal in functional genomics. A single gene may produce multiple isoforms with different functions through alternative splicing. Conventional approaches, however, consider a gene as a single entity without differentiating these functionally different isoforms. Towards understanding gene functions at higher resolution, recent efforts have focused on predicting the functions of isoforms. However, the performance of existing methods is far from satisfactory mainly because of the lack of isoform-level functional annotation. RESULTS We present IsoResolve, a novel approach for isoform function prediction, which leverages the information from gene function prediction models with domain adaptation (DA). IsoResolve treats gene-level and isoform-level features as source and target domains, respectively. It uses DA to project the two domains into a latent variable space in such a way that the latent variables from the two domains have similar distribution, which enables the gene domain information to be leveraged for isoform function prediction. We systematically evaluated the performance of IsoResolve in predicting functions. Compared with five state-of-the-art methods, IsoResolve achieved significantly better performance. IsoResolve was further validated by case studies of genes with isoform-level functional annotation. AVAILABILITY AND IMPLEMENTATION IsoResolve is freely available at https://github.com/genemine/IsoResolve. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Hong-Dong Li
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| | - Changhuo Yang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| | - Zhimin Zhang
- College of Chemistry and Chemical Engineering, Central South University, Changsha, Hunan 410083, China
| | - Mengyun Yang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| | - Fang-Xiang Wu
- Division of Biomedical Engineering, University of Saskatchewan, Saskatoon, SK S7N5A9, Canada
| | - Gilbert S Omenn
- Institute for Systems Biology, Seattle, WA 98101, USA.,Department of Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, MI 48109-2218, USA
| | - Jianxin Wang
- Hunan Provincial Key Lab on Bioinformatics, School of Computer Science and Engineering
| |
Collapse
|
21
|
A Deep Learning Approach to Predict Autism Spectrum Disorder Using Multisite Resting-State fMRI. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11083636] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Autism spectrum disorder (ASD) is a complex and degenerative neuro-developmental disorder. Most of the existing methods utilize functional magnetic resonance imaging (fMRI) to detect ASD with a very limited dataset which provides high accuracy but results in poor generalization. To overcome this limitation and to enhance the performance of the automated autism diagnosis model, in this paper, we propose an ASD detection model using functional connectivity features of resting-state fMRI data. Our proposed model utilizes two commonly used brain atlases, Craddock 200 (CC200) and Automated Anatomical Labelling (AAL), and two rarely used atlases Bootstrap Analysis of Stable Clusters (BASC) and Power. A deep neural network (DNN) classifier is used to perform the classification task. Simulation results indicate that the proposed model outperforms state-of-the-art methods in terms of accuracy. The mean accuracy of the proposed model was 88%, whereas the mean accuracy of the state-of-the-art methods ranged from 67% to 85%. The sensitivity, F1-score, and area under receiver operating characteristic curve (AUC) score of the proposed model were 90%, 87%, and 96%, respectively. Comparative analysis on various scoring strategies show the superiority of BASC atlas over other aforementioned atlases in classifying ASD and control.
Collapse
|