1
|
Chen Y, Yan J, Jiang M, Zhang T, Zhao Z, Zhao W, Zheng J, Yao D, Zhang R, Kendrick KM, Jiang X. Adversarial Learning Based Node-Edge Graph Attention Networks for Autism Spectrum Disorder Identification. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:7275-7286. [PMID: 35286265 DOI: 10.1109/tnnls.2022.3154755] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Graph neural networks (GNNs) have received increasing interest in the medical imaging field given their powerful graph embedding ability to characterize the non-Euclidean structure of brain networks based on magnetic resonance imaging (MRI) data. However, previous studies are largely node-centralized and ignore edge features for graph classification tasks, resulting in moderate performance of graph classification accuracy. Moreover, the generalizability of GNN model is still far from satisfactory in brain disorder [e.g., autism spectrum disorder (ASD)] identification due to considerable individual differences in symptoms among patients as well as data heterogeneity among different sites. In order to address the above limitations, this study proposes a novel adversarial learning-based node-edge graph attention network (AL-NEGAT) for ASD identification based on multimodal MRI data. First, both node and edge features are modeled based on structural and functional MRI data to leverage complementary brain information and preserved in the constructed weighted adjacent matrix for individuals through the attention mechanism in the proposed NEGAT. Second, two AL methods are employed to improve the generalizability of NEGAT. Finally, a gradient-based saliency map strategy is utilized for model interpretation to identify important brain regions and connections contributing to the classification. Experimental results based on the public Autism Brain Imaging Data Exchange I (ABIDE I) data demonstrate that the proposed framework achieves a classification accuracy of 74.7% between ASD and typical developing (TD) groups based on 1007 subjects across 17 different sites and outperforms the state-of-the-art methods, indicating satisfying classification ability and generalizability of the proposed AL-NEGAT model. Our work provides a powerful tool for brain disorder identification.
Collapse
|
2
|
Zhang S, Chen X, Shen X, Ren B, Yu Z, Yang H, Jiang X, Shen D, Zhou Y, Zhang XY. A-GCL: Adversarial graph contrastive learning for fMRI analysis to diagnose neurodevelopmental disorders. Med Image Anal 2023; 90:102932. [PMID: 37657365 DOI: 10.1016/j.media.2023.102932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2023] [Revised: 07/06/2023] [Accepted: 08/08/2023] [Indexed: 09/03/2023]
Abstract
Accurate diagnosis of neurodevelopmental disorders is a challenging task due to the time-consuming cognitive tests and potential human bias in clinics. To address this challenge, we propose a novel adversarial self-supervised graph neural network (GNN) based on graph contrastive learning, named A-GCL, for diagnosing neurodevelopmental disorders using functional magnetic resonance imaging (fMRI) data. Taking advantage of the success of GNNs in psychiatric disease diagnosis using fMRI, our proposed A-GCL model is expected to improve the performance of diagnosis and provide more robust results. A-GCL takes graphs constructed from the fMRI images as input and uses contrastive learning to extract features for classification. The graphs are constructed with 3 bands of the amplitude of low-frequency fluctuation (ALFF) as node features and Pearson's correlation coefficients (PCC) of the average fMRI time series in different brain regions as edge weights. The contrastive learning creates an edge-dropped graph from a trainable Bernoulli mask to extract features that are invariant to small variations of the graph. Experiment results on three datasets - Autism Brain Imaging Data Exchange (ABIDE) I, ABIDE II, and attention deficit hyperactivity disorder (ADHD) - with 3 atlases - AAL1, AAL3, Shen268 - demonstrate the superiority and generalizability of A-GCL compared to the other GNN-based models. Extensive ablation studies verify the robustness of the proposed approach to atlas selection and model variation. Explanatory results reveal key functional connections and brain regions associated with neurodevelopmental disorders.
Collapse
Affiliation(s)
- Shengjie Zhang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China
| | - Xiang Chen
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China
| | - Xin Shen
- Department of Mathematics, Beijing Normal University, Beijing, 100032, China
| | - Bohan Ren
- Department of School of Cyber Science and Technology, Beihang University, Beijing, 100191, China
| | - Ziqi Yu
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China
| | - Haibo Yang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China
| | - Xi Jiang
- Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Dinggang Shen
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, 201210, China; Shanghai United Imaging Intelligence Co., Ltd., Shanghai, 200030, China; Shanghai Clinical Research and Trial Center, Shanghai, 201210, China
| | - Yuan Zhou
- School of Data Science, Fudan University, Shanghai, 200433, China.
| | - Xiao-Yong Zhang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200433, China; MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, 200433, China.
| |
Collapse
|
3
|
Lei D, Zhang T, Wu Y, Li W, Li X. Autism spectrum disorder diagnosis based on deep unrolling-based spatial constraint representation. Med Biol Eng Comput 2023; 61:2829-2842. [PMID: 37486440 DOI: 10.1007/s11517-023-02859-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 05/25/2023] [Indexed: 07/25/2023]
Abstract
Accurate diagnosis of autism spectrum disorder (ASD) is crucial for effective treatment and prognosis. Functional brain networks (FBNs) constructed from functional magnetic resonance imaging (fMRI) have become a popular tool for ASD diagnosis. However, existing model-driven approaches used to construct FBNs lack the ability to capture potential non-linear relationships between data and labels. Moreover, most existing studies treat the FBNs construction and disease classification as separate steps, leading to large inter-subject variability in the estimated FBNs and reducing the statistical power of subsequent group comparison. To address these limitations, we propose a new approach to FBNs construction called the deep unrolling-based spatial constraint representation (DUSCR) model and integrate it with a convolutional classifier to create an end-to-end framework for ASD recognition. Specifically, the model spatial constraint representation (SCR) is solved using a proximal gradient descent algorithm, and we unroll it into deep networks using the deep unrolling algorithm. Classification is then performed using a convolutional prototype learning model. We evaluated the effectiveness of the proposed method on the ABIDE I dataset and observed a significant improvement in model performance and classification accuracy. The resting state fMRI images are preprocessed into time series data and 3D coordinates of each region of interest. The data are fed into the DUSCR model, a model for building functional brain networks using deep learning instead of traditional models, that we propose, and then the outputs are fed into the convolutional classifier with prototype learning to determine whether the patient has ASD disease.
Collapse
Affiliation(s)
- Dajiang Lei
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Tao Zhang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Yue Wu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Weisheng Li
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Xinwei Li
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China.
| |
Collapse
|
4
|
Artiles O, Al Masry Z, Saeed F. Confounding Effects on the Performance of Machine Learning Analysis of Static Functional Connectivity Computed from rs-fMRI Multi-site Data. Neuroinformatics 2023; 21:651-668. [PMID: 37581850 DOI: 10.1007/s12021-023-09639-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/16/2023] [Indexed: 08/16/2023]
Abstract
Resting-state functional magnetic resonance imaging (rs-fMRI) is a non-invasive imaging technique widely used in neuroscience to understand the functional connectivity of the human brain. While rs-fMRI multi-site data can help to understand the inner working of the brain, the data acquisition and processing of this data has many challenges. One of the challenges is the variability of the data associated with different acquisitions sites, and different MRI machines vendors. Other factors such as population heterogeneity among different sites, with variables such as age and gender of the subjects, must also be considered. Given that most of the machine-learning models are developed using these rs-fMRI multi-site data sets, the intrinsic confounding effects can adversely affect the generalizability and reliability of these computational methods, as well as the imposition of upper limits on the classification scores. This work aims to identify the phenotypic and imaging variables producing the confounding effects, as well as to control these effects. Our goal is to maximize the classification scores obtained from the machine learning analysis of the Autism Brain Imaging Data Exchange (ABIDE) rs-fMRI multi-site data. To achieve this goal, we propose novel methods of stratification to produce homogeneous sub-samples of the 17 ABIDE sites, as well as the generation of new features from the static functional connectivity values, using multiple linear regression models, ComBat harmonization models, and normalization methods. The main results obtained with our statistical models and methods are an accuracy of 76.4%, sensitivity of 82.9%, and specificity of 77.0%, which are 8.8%, 20.5%, and 7.5% above the baseline classification scores obtained from the machine learning analysis of the static functional connectivity computed from the ABIDE rs-fMRI multi-site data.
Collapse
Affiliation(s)
- Oswaldo Artiles
- Knight Foundation School of Computing and Information Sciences, Florida International University, 11200 SW 8th Street CASE 354, Miami, Florida, 33199, USA
| | - Zeina Al Masry
- SUPMICROTECH, CNRS, institut FEMTO-ST, 24 rue Alain Savary, Besançon, F-25000, France
| | - Fahad Saeed
- Knight Foundation School of Computing and Information Sciences, Florida International University, 11200 SW 8th Street CASE 354, Miami, Florida, 33199, USA.
| |
Collapse
|
5
|
Zhang C, Ma Y, Qiao L, Zhang L, Liu M. Learning to Fuse Multiple Brain Functional Networks for Automated Autism Identification. BIOLOGY 2023; 12:971. [PMID: 37508401 PMCID: PMC10376072 DOI: 10.3390/biology12070971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 07/03/2023] [Accepted: 07/06/2023] [Indexed: 07/30/2023]
Abstract
Functional connectivity network (FCN) has become a popular tool to identify potential biomarkers for brain dysfunction, such as autism spectrum disorder (ASD). Due to its importance, researchers have proposed many methods to estimate FCNs from resting-state functional MRI (rs-fMRI) data. However, the existing FCN estimation methods usually only capture a single relationship between brain regions of interest (ROIs), e.g., linear correlation, nonlinear correlation, or higher-order correlation, thus failing to model the complex interaction among ROIs in the brain. Additionally, such traditional methods estimate FCNs in an unsupervised way, and the estimation process is independent of the downstream tasks, which makes it difficult to guarantee the optimal performance for ASD identification. To address these issues, in this paper, we propose a multi-FCN fusion framework for rs-fMRI-based ASD classification. Specifically, for each subject, we first estimate multiple FCNs using different methods to encode rich interactions among ROIs from different perspectives. Then, we use the label information (ASD vs. healthy control (HC)) to learn a set of fusion weights for measuring the importance/discrimination of those estimated FCNs. Finally, we apply the adaptively weighted fused FCN on the ABIDE dataset to identify subjects with ASD from HCs. The proposed FCN fusion framework is straightforward to implement and can significantly improve diagnostic accuracy compared to traditional and state-of-the-art methods.
Collapse
Affiliation(s)
- Chaojun Zhang
- The School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101, China
- The School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Yunling Ma
- The School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Lishan Qiao
- The School of Mathematics Science, Liaocheng University, Liaocheng 252000, China
| | - Limei Zhang
- The School of Computer Science and Technology, Shandong Jianzhu University, Jinan 250101, China
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
6
|
Chen Z, Hu B, Liu X, Becker B, Eickhoff SB, Miao K, Gu X, Tang Y, Dai X, Li C, Leonov A, Xiao Z, Feng Z, Chen J, Chuan-Peng H. Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry. BMC Med 2023; 21:241. [PMID: 37400814 DOI: 10.1186/s12916-023-02941-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 06/13/2023] [Indexed: 07/05/2023] Open
Abstract
BACKGROUND The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation. METHODS Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses. RESULTS A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β = - 2.75, p < .001, R2adj = 0.40; r = - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF10 > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance. CONCLUSIONS Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.
Collapse
Affiliation(s)
- Zhiyi Chen
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China.
- Faculty of Psychology, Southwest University, Chongqing, China.
| | - Bowen Hu
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Xuerong Liu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Benjamin Becker
- The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People's Hospital, Chengdu, China
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Simon B Eickhoff
- Institute of Systems Neuroscience, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Kuan Miao
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Xingmei Gu
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Yancheng Tang
- School of Business and Management, Shanghai International Studies University, Shanghai, China
| | - Xin Dai
- Faculty of Psychology, Southwest University, Chongqing, China
| | - Chao Li
- Department of Radiology, The Third Affiliated Hospital, Sun Yat-Sen University, Guangdong, China
| | - Artemiy Leonov
- School of Psychology, Clark University, Worcester, MA, USA
| | - Zhibing Xiao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zhengzhi Feng
- Experimental Research Center for Medical and Psychological Science (ERC-MPS), School of Psychology, Third Military Medical University, Chongqing, China
| | - Ji Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China.
- Department of Psychiatry, The Fourth Affiliated Hospital, Zhejiang University School of Medicine, Yiwu, Zhejiang, China.
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
7
|
Helmy E, Elnakib A, ElNakieb Y, Khudri M, Abdelrahim M, Yousaf J, Ghazal M, Contractor S, Barnes GN, El-Baz A. Role of Artificial Intelligence for Autism Diagnosis Using DTI and fMRI: A Survey. Biomedicines 2023; 11:1858. [PMID: 37509498 PMCID: PMC10376963 DOI: 10.3390/biomedicines11071858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 06/22/2023] [Accepted: 06/27/2023] [Indexed: 07/30/2023] Open
Abstract
Autism spectrum disorder (ASD) is a wide range of diseases characterized by difficulties with social skills, repetitive activities, speech, and nonverbal communication. The Centers for Disease Control (CDC) estimates that 1 in 44 American children currently suffer from ASD. The current gold standard for ASD diagnosis is based on behavior observational tests by clinicians, which suffer from being subjective and time-consuming and afford only late detection (a child must have a mental age of at least two to apply for an observation report). Alternatively, brain imaging-more specifically, magnetic resonance imaging (MRI)-has proven its ability to assist in fast, objective, and early ASD diagnosis and detection. With the recent advances in artificial intelligence (AI) and machine learning (ML) techniques, sufficient tools have been developed for both automated ASD diagnosis and early detection. More recently, the development of deep learning (DL), a young subfield of AI based on artificial neural networks (ANNs), has successfully enabled the processing of brain MRI data with improved ASD diagnostic abilities. This survey focuses on the role of AI in autism diagnostics and detection based on two basic MRI modalities: diffusion tensor imaging (DTI) and functional MRI (fMRI). In addition, the survey outlines the basic findings of DTI and fMRI in autism. Furthermore, recent techniques for ASD detection using DTI and fMRI are summarized and discussed. Finally, emerging tendencies are described. The results of this study show how useful AI is for early, subjective ASD detection and diagnosis. More AI solutions that have the potential to be used in healthcare settings will be introduced in the future.
Collapse
Affiliation(s)
- Eman Helmy
- Department of Diagnostic Radiology, Faculty of Medicine, Mansoura University, Elgomheryia Street, Mansoura 3512, Egypt;
| | - Ahmed Elnakib
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Yaser ElNakieb
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Mohamed Khudri
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Mostafa Abdelrahim
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Jawad Yousaf
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (J.Y.); (M.G.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (J.Y.); (M.G.)
| | - Sohail Contractor
- Department of Radiology, University of Louisville, Louisville, KY 40202, USA;
| | - Gregory Neal Barnes
- Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA;
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| |
Collapse
|
8
|
Chen Z, Liu X, Yang Q, Wang YJ, Miao K, Gong Z, Yu Y, Leonov A, Liu C, Feng Z, Chuan-Peng H. Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review. JAMA Netw Open 2023; 6:e231671. [PMID: 36877519 PMCID: PMC9989906 DOI: 10.1001/jamanetworkopen.2023.1671] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/07/2023] Open
Abstract
IMPORTANCE Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated. OBJECTIVE To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis. EVIDENCE REVIEW PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality. FINDINGS A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%). CONCLUSIONS AND RELEVANCE This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.
Collapse
Affiliation(s)
- Zhiyi Chen
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Xuerong Liu
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Qingwu Yang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Yan-Jiang Wang
- Department of Neurology, Daping Hospital, Third Military Medical University, Chongqing, China
| | - Kuan Miao
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Zheng Gong
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Yang Yu
- School of Psychology, Third Military Medical University, Chongqing, China
| | - Artemiy Leonov
- Department of Psychology, Clark University, Worcester, Massachusetts
| | - Chunlei Liu
- School of Psychology, Qufu Normal University, Qufu, China
| | - Zhengzhi Feng
- School of Psychology, Third Military Medical University, Chongqing, China
- Experimental Research Center for Medical and Psychological Science, Third Military Medical University, Chongqing, China
| | - Hu Chuan-Peng
- School of Psychology, Nanjing Normal University, Nanjing, China
| |
Collapse
|
9
|
ElNakieb Y, Ali MT, Elnakib A, Shalaby A, Mahmoud A, Soliman A, Barnes GN, El-Baz A. Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study. BIOENGINEERING (BASEL, SWITZERLAND) 2023; 10:bioengineering10010056. [PMID: 36671628 PMCID: PMC9855190 DOI: 10.3390/bioengineering10010056] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/22/2022] [Accepted: 12/27/2022] [Indexed: 01/04/2023]
Abstract
In addition to the standard observational assessment for autism spectrum disorder (ASD), recent advancements in neuroimaging and machine learning (ML) suggest a rapid and objective alternative using brain imaging. This work presents a pipelined framework, using functional magnetic resonance imaging (fMRI) that allows not only an accurate ASD diagnosis but also the identification of the brain regions contributing to the diagnosis decision. The proposed framework includes several processing stages: preprocessing, brain parcellation, feature representation, feature selection, and ML classification. For feature representation, the proposed framework uses both a conventional feature representation and a novel dynamic connectivity representation to assist in the accurate classification of an autistic individual. Based on a large publicly available dataset, this extensive research highlights different decisions along the proposed pipeline and their impact on diagnostic accuracy. A large publicly available dataset of 884 subjects from the Autism Brain Imaging Data Exchange I (ABIDE-I) initiative is used to validate our proposed framework, achieving a global balanced accuracy of 98.8% with five-fold cross-validation and proving the potential of the proposed feature representation. As a result of this comprehensive study, we achieve state-of-the-art accuracy, confirming the benefits of the proposed feature representation and feature engineering in extracting useful information as well as the potential benefits of utilizing ML and neuroimaging in the diagnosis and understanding of autism.
Collapse
Affiliation(s)
- Yaser ElNakieb
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Mohamed T. Ali
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Elnakib
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Shalaby
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ali Mahmoud
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Soliman
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Gregory Neal Barnes
- Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
- Correspondence:
| |
Collapse
|
10
|
Alzheimer disease stages identification based on correlation transfer function system using resting-state functional magnetic resonance imaging. PLoS One 2022; 17:e0264710. [PMID: 35413053 PMCID: PMC9004771 DOI: 10.1371/journal.pone.0264710] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 02/15/2022] [Indexed: 11/21/2022] Open
Abstract
Alzheimer’s disease (AD) affects the quality of life as it causes; memory loss, difficulty in thinking, learning, and performing familiar tasks. Resting-state functional magnetic resonance imaging (rs-fMRI) has been widely used to investigate and analyze different brain regions for AD identification. This study investigates the effectiveness of using correlated transfer function (CorrTF) as a new biomarker to extract the essential features from rs-fMRI, along with support vector machine (SVM) ordered hierarchically, in order to distinguish between the different AD stages. Additionally, we explored the regions, showing significant changes based on the CorrTF extracted features’ strength among different AD stages. First, the process was initialized by applying the preprocessing on rs-fMRI data samples to reduce noise and retain the essential information. Then, the automated anatomical labeling (AAL) atlas was employed to divide the brain into 116 regions, where the intensity time series was calculated, and the CorrTF features were extracted for each region. The proposed framework employed the SVM classifier in two different methodologies, hierarchical and flat multi-classification schemes, to differentiate between the different AD stages for early detection purposes. The ADNI rs-fMRI dataset, employed in this study, consists of 167, 102, 129, and 114 normal, early, late mild cognitive impairment (MCI), and AD subjects, respectively. The proposed schemes achieved an average accuracy of 98.2% and 95.5% for hierarchical and flat multi-classification tasks, respectively, calculated using ten folds cross-validation. Therefore, CorrTF is considered a promising biomarker for AD early-stage identification. Moreover, the significant changes in the strengths of CorrTF connections among the different AD stages can help us identify and explore the affected brain regions and their latent associations during the progression of AD.
Collapse
|
11
|
rs-fMRI and machine learning for ASD diagnosis: a systematic review and meta-analysis. Sci Rep 2022; 12:6030. [PMID: 35411059 PMCID: PMC9001715 DOI: 10.1038/s41598-022-09821-6] [Citation(s) in RCA: 27] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Accepted: 03/23/2022] [Indexed: 02/08/2023] Open
Abstract
AbstractAutism Spectrum Disorder (ASD) diagnosis is still based on behavioral criteria through a lengthy and time-consuming process. Much effort is being made to identify brain imaging biomarkers and develop tools that could facilitate its diagnosis. In particular, using Machine Learning classifiers based on resting-state fMRI (rs-fMRI) data is promising, but there is an ongoing need for further research on their accuracy and reliability. Therefore, we conducted a systematic review and meta-analysis to summarize the available evidence in the literature so far. A bivariate random-effects meta-analytic model was implemented to investigate the sensitivity and specificity across the 55 studies that offered sufficient information for quantitative analysis. Our results indicated overall summary sensitivity and specificity estimates of 73.8% and 74.8%, respectively. SVM stood out as the most used classifier, presenting summary estimates above 76%. Studies with bigger samples tended to obtain worse accuracies, except in the subgroup analysis for ANN classifiers. The use of other brain imaging or phenotypic data to complement rs-fMRI information seems promising, achieving higher sensitivities when compared to rs-fMRI data alone (84.7% versus 72.8%). Finally, our analysis showed AUC values between acceptable and excellent. Still, given the many limitations indicated in our study, further well-designed studies are warranted to extend the potential use of those classification algorithms to clinical settings.
Collapse
|
12
|
Liang Y, Xu G. Multi-level Functional Connectivity Fusion Classification Framework for Brain Disease Diagnosis. IEEE J Biomed Health Inform 2022; 26:2714-2725. [PMID: 35290195 DOI: 10.1109/jbhi.2022.3159031] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Brain disease diagnosis is a new hotspot in the cross research of artificial intelligence and neuroscience. Quantitative analysis of functional magnetic resonance imaging (fMRI) data can provide valuable biomarkers that contributes to clinical diagnosis, and the analysis of functional connectivity (FC) has become the primary method. However, previous studies mainly focus on brain disease classification based on the low-order FC features, ignoring the potential role of high-order functional relationships among brain regions. To solve this problem, this study proposed a novel multi-level FC fusion classification framework (MFC) for brain disease diagnosis. We firstly designed a deep neural network (DNN) model to extract and learn abstract feature representations for the constructed low-order and high-order FC patterns. Both unsupervised and supervised learning steps were performed during the DNN model training, and the prototype learning was introduced in the supervised fine-tuning to improve the intra-class compactness and inter-class separability of the feature representation. Then, we combined the learned multi-level abstract FC features and trained an ensemble classifier with a hierarchical stacking learning strategy for the brain disease classification. Systematic experiments were conducted on two real large-scale fMRI datasets. Results showed that the proposed MFC model obtained robust classification performance for different preprocessing pipelines, different brain parcellations, and different cross-validation schemes, suggesting the effectiveness and generality of the proposed MFC model. Overall, this study provides a promising solution to combine the informative low-order and high-order FC patterns to further promote the classification of brain diseases.
Collapse
|
13
|
Reproducible neuroimaging features for diagnosis of autism spectrum disorder with machine learning. Sci Rep 2022; 12:3057. [PMID: 35197468 PMCID: PMC8866395 DOI: 10.1038/s41598-022-06459-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Accepted: 01/25/2022] [Indexed: 12/31/2022] Open
Abstract
Autism spectrum disorder (ASD) is the fourth most common neurodevelopmental disorder, with a prevalence of 1 in 160 children. Accurate diagnosis relies on experts, but such individuals are scarce. This has led to increasing interest in the development of machine learning (ML) models that can integrate neuroimaging features from functional and structural MRI (fMRI and sMRI) to help reveal central nervous system alterations characteristic of ASD. We optimized and compared the performance of 12 of the most popular and powerful ML models. Each was separately trained using 15 different combinations of fMRI and sMRI features and optimized with an unbiased model search. Deep learning models predicted ASD with the highest diagnostic accuracy and generalized well to other MRI datasets. Our model achieves state-of-the-art 80% area under the ROC curve (AUROC) in diagnosis on test data from the IMPAC dataset; and 86% and 79% AUROC on the external ABIDE I and ABIDE II datasets (with further improvement to 93% and 90% after supervised domain adaptation). The highest performing models identified reproducible putative biomarkers for accurate ASD diagnosis in accord with known ASD markers as well as novel cerebellar biomarkers. Such reproducibility lends credence to their tremendous potential for defining and using a set of truly generalizable ASD biomarkers that will advance scientific understanding of neuronal changes in ASD.
Collapse
|
14
|
Yang C, Wang P, Tan J, Liu Q, Li X. Autism spectrum disorder diagnosis using graph attention network based on spatial-constrained sparse functional brain networks. Comput Biol Med 2021; 139:104963. [PMID: 34700253 DOI: 10.1016/j.compbiomed.2021.104963] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 10/13/2021] [Accepted: 10/17/2021] [Indexed: 11/16/2022]
Abstract
The accurate diagnosis of autism spectrum disorder (ASD), a common mental disease in children, has always been an important task in clinical practice. In recent years, the use of graph neural network (GNN) based on functional brain network (FBN) has shown powerful performance for disease diagnosis. The challenge to construct "ideal" FBN from resting-state fMRI data remained. Moreover, it remains unclear whether and to what extent the non-Euclidean structure of different FBNs affect the performance of GNN-based disease classification. In this paper, we proposed a new method named Pearson's correlation-based Spatial Constraints Representation (PSCR) to estimate the FBN structures that were transformed to brain graphs and then fed into a graph attention network (GAT) to diagnose ASD. Extensive experiments on comparing different FBN construction methods and classification frameworks were conducted on the ABIDE I dataset (n = 871). The results demonstrated the superiority of our PSCR method and the influence of different FBNs on the GNN-based classification results. The proposed PSCR and GAT framework achieved promising classification results for ASD (accuracy: 72.40%), which significantly outperformed competing methods. This will help facilitate patient-control separation, and provide a promising solution for future disease diagnosis based on the FBN and GNN framework.
Collapse
Affiliation(s)
- Chunde Yang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China; School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Panyu Wang
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Jia Tan
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Qingshui Liu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Xinwei Li
- School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, China.
| |
Collapse
|
15
|
Liang Y, Liu B, Zhang H. A Convolutional Neural Network Combined With Prototype Learning Framework for Brain Functional Network Classification of Autism Spectrum Disorder. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2193-2202. [PMID: 34648452 DOI: 10.1109/tnsre.2021.3120024] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The application of deep learning methods in brain disease diagnosis is becoming a new research hotspot. This study constructed brain functional networks based on the functional magnetic resonance imaging (fMRI) data, and proposed a novel convolutional neural network combined with a prototype learning (CNNPL) framework to classify brain functional networks for the diagnosis of autism spectrum disorder (ASD). At the bottom of CNNPL, traditional CNN was employed as the basic feature extractor, while at the top of CNNPL multiple prototypes were automatically learnt on the features to represent different categories. A generalized prototype loss based on distance cross-entropy was proposed to jointly learn the parameters of the CNN feature extractor and the prototypes. The classification was implemented with prototype matching. A transfer learning strategy was introduced to our CNNPL for weight initialization in the subsequent fine-tuning phase to promote model training. We conducted systematic experiments on the aggregate multi-sites ASD dataset. Experimental results revealed that our model outperforms the current state-of-the-art methods in ASD classification and can reliably learn inter-site biomarkers, indicating the robustness of our model on large-scale dataset with inter-site variability. Furthermore, our model demonstrated robust learning capability for high-level organization of brain functionality. Our study also identified important brain regions as biomarkers associated with ASD classification. Together, our proposed model provides a promising solution for learning and classifying brain functional networks, and thus contributes to the biomarker extraction and imaging diagnosis of ASD.
Collapse
|
16
|
Machine learning with neuroimaging data to identify autism spectrum disorder: a systematic review and meta-analysis. Neuroradiology 2021; 63:2057-2072. [PMID: 34420058 DOI: 10.1007/s00234-021-02774-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 07/14/2021] [Indexed: 10/20/2022]
Abstract
PURPOSE Autism Spectrum Disorder (ASD) is diagnosed through observation or interview assessments, which is time-consuming, subjective, and with questionable validity and reliability. Thus, we aimed to evaluate the role of machine learning (ML) with neuroimaging data to provide a reliable classification of ASD. METHODS A systematic search of PubMed, Scopus, and Embase was conducted to identify relevant publications. Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) was used to assess the studies' quality. A bivariate random-effects model meta-analysis was employed to evaluate the pooled sensitivity, the pooled specificity, and the diagnostic performance through the hierarchical summary receiver operating characteristic (HSROC) curve of ML with neuroimaging data in classifying ASD. Meta-regression was also performed. RESULTS Forty-four studies (5697 ASD and 6013 typically developing individuals [TD] in total) were included in the quantitative analysis. The pooled sensitivity for differentiating ASD from TD individuals was 86.25 95% confidence interval [CI] (81.24, 90.08), while the pooled specificity was 83.31 95% CI (78.12, 87.48) with a combined area under the HSROC (AUC) of 0.889. Higgins I2 (> 90%) and Cochran's Q (p < 0.0001) suggest a high degree of heterogeneity. In the bivariate model meta-regression, a higher pooled specificity was observed in studies not using a brain atlas (90.91 95% CI [80.67, 96.00], p = 0.032). In addition, a greater pooled sensitivity was seen in studies recruiting both males and females (89.04 95% CI [83.84, 92.72], p = 0.021), and combining imaging modalities (94.12 95% [85.43, 97.76], p = 0.036). CONCLUSION ML with neuroimaging data is an exciting prospect in detecting individuals with ASD but further studies are required to improve its reliability for usage in clinical practice.
Collapse
|
17
|
Ji J, Chen Z, Yang C. Convolutional Neural Network with Sparse Strategies to Classify Dynamic Functional Connectivity. IEEE J Biomed Health Inform 2021; 26:1219-1228. [PMID: 34314368 DOI: 10.1109/jbhi.2021.3100559] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Classification of dynamic functional connectivity (DFC) is becoming a promising approach for diagnosing various neurodegenerative diseases. However, the existing methods generally face the problem of overfitting. To solve it, this paper proposes a convolutional neural network with three sparse strategies named SCNN to classify DFC. Firstly, an element-wise filter is designed to impose sparse constraints on the DFC matrix by replacing the redundant elements with zeroes, where the DFC matrix is specially constructed to quantify the spatial and temporal variation of DFC. Secondly, a 11 convolutional filter is adopted to reduce the dimensionality of the sparse DFC matrix, and remove meaningless features resulted from zero elements in the subsequent convolution process. Finally, an extra sparse optimization classifier is employed to optimize the parameters of the above two filters, which can effectively improve the ability of SCNN to extract discriminative features. Experimental results on multiple resting-state fMRI datasets demonstrate that the proposed model provides a better classification performance of DFC compared with several state-of-the-art methods, and can identify the abnormal brain functional connectivity.
Collapse
|
18
|
Xu M, Calhoun V, Jiang R, Yan W, Sui J. Brain imaging-based machine learning in autism spectrum disorder: methods and applications. J Neurosci Methods 2021; 361:109271. [PMID: 34174282 DOI: 10.1016/j.jneumeth.2021.109271] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Revised: 05/25/2021] [Accepted: 06/19/2021] [Indexed: 01/09/2023]
Abstract
Autism spectrum disorder (ASD) is a neurodevelopmental condition with early childhood onset and high heterogeneity. As the pathogenesis is still elusive, ASD diagnosis is comprised of a constellation of behavioral symptoms. Non-invasive brain imaging techniques, such as magnetic resonance imaging (MRI), provide a valuable objective measurement of the brain. Many efforts have been devoted to developing imaging-based diagnostic tools for ASD based on machine learning (ML) technologies. In this survey, we review recent advances that utilize machine learning approaches to classify individuals with and without ASD. First, we provide a brief overview of neuroimaging-based ASD classification studies, including the analysis of publications and general classification pipeline. Next, representative studies are highlighted and discussed in detail regarding different imaging modalities, methods and sample sizes. Finally, we highlight several common challenges and provide recommendations on future directions. In summary, identifying discriminative biomarkers for ASD diagnosis is challenging, and further establishing more comprehensive datasets and dissecting the individual and group heterogeneity will be critical to achieve better ADS diagnosis performance. Machine learning methods will continue to be developed and are poised to help advance the field in this regard.
Collapse
Affiliation(s)
- Ming Xu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China 100049
| | - Vince Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University, Atlanta, GA, USA 30303
| | - Rongtao Jiang
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China 100190
| | - Weizheng Yan
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University, Atlanta, GA, USA 30303
| | - Jing Sui
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China 100088.
| |
Collapse
|
19
|
Paakki J, Rahko JS, Kotila A, Mattila M, Miettunen H, Hurtig TM, Jussila KK, Kuusikko‐Gauffin S, Moilanen IK, Tervonen O, Kiviniemi VJ. Co-activation pattern alterations in autism spectrum disorder-A volume-wise hierarchical clustering fMRI study. Brain Behav 2021; 11:e02174. [PMID: 33998178 PMCID: PMC8213933 DOI: 10.1002/brb3.2174] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Revised: 04/05/2021] [Accepted: 04/23/2021] [Indexed: 12/14/2022] Open
Abstract
INTRODUCTION There has been a growing effort to characterize the time-varying functional connectivity of resting state (RS) fMRI brain networks (RSNs). Although voxel-wise connectivity studies have examined different sliding window lengths, nonsequential volume-wise approaches have been less common. METHODS Inspired by earlier co-activation pattern (CAP) studies, we applied hierarchical clustering (HC) to classify the image volumes of the RS-fMRI data on 28 adolescents with autism spectrum disorder (ASD) and their 27 typically developing (TD) controls. We compared the distribution of the ASD and TD groups' volumes in CAPs as well as their voxel-wise means. For simplification purposes, we conducted a group independent component analysis to extract 14 major RSNs. The RSNs' average z-scores enabled us to meaningfully regroup the RSNs and estimate the percentage of voxels within each RSN for which there was a significant group difference. These results were jointly interpreted to find global group-specific patterns. RESULTS We found similar brain state proportions in 58 CAPs (clustering interval from 2 to 30). However, in many CAPs, the voxel-wise means differed significantly within a matrix of 14 RSNs. The rest-activated default mode-positive and default mode-negative brain state properties vary considerably in both groups over time. This division was seen clearly when the volumes were partitioned into two CAPs and then further examined along the HC dendrogram of the diversifying brain CAPs. The ASD group network activations followed a more heterogeneous distribution and some networks maintained higher baselines; throughout the brain deactivation state, the ASD participants had reduced deactivation in 12/14 networks. During default mode-negative CAPs, the ASD group showed simultaneous visual network and either dorsal attention or default mode network overactivation. CONCLUSION Nonsequential volume gathering into CAPs and the comparison of voxel-wise signal changes provide a complementary perspective to connectivity and an alternative to sliding window analysis.
Collapse
Affiliation(s)
- Jyri‐Johan Paakki
- Faculty of Medicine, Health and Biosciences Doctoral ProgrammeUniversity of Oulu Graduate SchoolUniversity of OuluOuluFinland
- The Faculty of MedicineResearch Unit of Medical Imaging, Physics and TechnologyOulu Functional NeuroImaging GroupUniversity of OuluOuluFinland
- Department of Diagnostic RadiologyMedical Research CenterOulu University HospitalOuluFinland
| | - Jukka S. Rahko
- Faculty of Medicine, Health and Biosciences Doctoral ProgrammeUniversity of Oulu Graduate SchoolUniversity of OuluOuluFinland
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
| | - Aija Kotila
- Faculty of HumanitiesResearch Unit of LogopedicsUniversity of OuluOuluFinland
| | - Marja‐Leena Mattila
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
| | - Helena Miettunen
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
| | - Tuula M. Hurtig
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
- Research Unit of Clinical Neuroscience, PsychiatryUniversity of OuluOuluFinland
| | - Katja K. Jussila
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
| | - Sanna Kuusikko‐Gauffin
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
| | - Irma K. Moilanen
- PEDEGO Research UnitFaculty of MedicineChild PsychiatryUniversity of OuluOuluFinland
- Institute of Clinical MedicineClinic of Child PsychiatryUniversity and University Hospital of OuluOuluFinland
| | - Osmo Tervonen
- The Faculty of MedicineResearch Unit of Medical Imaging, Physics and TechnologyOulu Functional NeuroImaging GroupUniversity of OuluOuluFinland
- Department of Diagnostic RadiologyMedical Research CenterOulu University HospitalOuluFinland
| | - Vesa J. Kiviniemi
- The Faculty of MedicineResearch Unit of Medical Imaging, Physics and TechnologyOulu Functional NeuroImaging GroupUniversity of OuluOuluFinland
- Department of Diagnostic RadiologyMedical Research CenterOulu University HospitalOuluFinland
| |
Collapse
|
20
|
Quaak M, van de Mortel L, Thomas RM, van Wingen G. Deep learning applications for the classification of psychiatric disorders using neuroimaging data: Systematic review and meta-analysis. Neuroimage Clin 2021; 30:102584. [PMID: 33677240 PMCID: PMC8209481 DOI: 10.1016/j.nicl.2021.102584] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Revised: 01/18/2021] [Accepted: 01/29/2021] [Indexed: 12/20/2022]
Abstract
Deep learning (DL) methods have been increasingly applied to neuroimaging data to identify patients with psychiatric and neurological disorders. This review provides an overview of the different DL applications within psychiatry and compares DL model accuracy to standard machine learning (SML). Fifty-three articles were included for qualitative analysis, primarily investigating autism spectrum disorder (ASD; n = 22), schizophrenia (SZ; n = 22) and attention-deficit/hyperactivity disorder (ADHD; n = 9). Thirty-two of the thirty-five studies that directly compared DL to SML reported a higher accuracy for DL. Only sixteen studies could be included in a meta-regression to quantitatively compare DL and SML performance. This showed a higher odds ratio for DL models, though the comparison attained significance only for ASD. Our results suggest that deep learning of neuroimaging data is a promising tool for the classification of individual psychiatric patients. However, it is not yet used to its full potential: most studies use pre-engineered features, whereas one of the main advantages of DL is its ability to learn representations of minimally processed data. Our current evaluation is limited by minimal reporting of performance measures to enable quantitative comparisons, and the restriction to ADHD, SZ and ASD as current research focusses on large publicly available datasets. To truly uncover the added value of DL, we need carefully designed comparisons of SML and DL models which are yet rarely performed.
Collapse
Affiliation(s)
- Mirjam Quaak
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands
| | - Laurens van de Mortel
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands
| | - Rajat Mani Thomas
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands
| | - Guido van Wingen
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Meibergdreef 5, 1105 AZ Amsterdam, The Netherlands.
| |
Collapse
|
21
|
Population Graph-Based Multi-Model Ensemble Method for Diagnosing Autism Spectrum Disorder. SENSORS 2020; 20:s20216001. [PMID: 33105909 PMCID: PMC7660214 DOI: 10.3390/s20216001] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 10/16/2020] [Accepted: 10/19/2020] [Indexed: 11/17/2022]
Abstract
With the advancement of brain imaging techniques and a variety of machine learning methods, significant progress has been made in brain disorder diagnosis, in particular Autism Spectrum Disorder. The development of machine learning models that can differentiate between healthy subjects and patients is of great importance. Recently, graph neural networks have found increasing application in domains where the population's structure is modeled as a graph. The application of graphs for analyzing brain imaging datasets helps to discover clusters of individuals with a specific diagnosis. However, the choice of the appropriate population graph becomes a challenge in practice, as no systematic way exists for defining it. To solve this problem, we propose a population graph-based multi-model ensemble, which improves the prediction, regardless of the choice of the underlying graph. First, we construct a set of population graphs using different combinations of imaging and phenotypic features and evaluate them using Graph Signal Processing tools. Subsequently, we utilize a neural network architecture to combine multiple graph-based models. The results demonstrate that the proposed model outperforms the state-of-the-art methods on Autism Brain Imaging Data Exchange (ABIDE) dataset.
Collapse
|
22
|
Vargason T, Grivas G, Hollowood-Jones KL, Hahn J. Towards a Multivariate Biomarker-Based Diagnosis of Autism Spectrum Disorder: Review and Discussion of Recent Advancements. Semin Pediatr Neurol 2020; 34:100803. [PMID: 32446437 PMCID: PMC7248126 DOI: 10.1016/j.spen.2020.100803] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
An ever-evolving understanding of autism spectrum disorder (ASD) pathophysiology necessitates that diagnostic standards also evolve from being observation-based to include quantifiable clinical measurements. The multisystem nature of ASD motivates the use of multivariate methods of statistical analysis over common univariate approaches for discovering clinical biomarkers relevant to this goal. In addition to characterization of important behavioral patterns for improving current diagnostic instruments, multivariate analyses to date have allowed for thorough investigation of neuroimaging-based, genetic, and metabolic abnormalities in individuals with ASD. This review highlights current research using multivariate statistical analyses to quantify the value of these behavioral and physiological markers for ASD diagnosis. A detailed discussion of a blood-based diagnostic test for ASD using specific metabolite concentrations is also provided. The advancement of ASD biomarker research promises to provide earlier and more accurate diagnoses of the disorder.
Collapse
Affiliation(s)
- Troy Vargason
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY; Center for Biotechnology and Interdisciplinary Studies, Rensselaer Polytechnic Institute, Troy, NY
| | - Genevieve Grivas
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY; Center for Biotechnology and Interdisciplinary Studies, Rensselaer Polytechnic Institute, Troy, NY
| | - Kathryn L Hollowood-Jones
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY; Center for Biotechnology and Interdisciplinary Studies, Rensselaer Polytechnic Institute, Troy, NY
| | - Juergen Hahn
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY; Center for Biotechnology and Interdisciplinary Studies, Rensselaer Polytechnic Institute, Troy, NY; Department of Chemical and Biological Engineering, Rensselaer Polytechnic Institute, Troy, NY.
| |
Collapse
|
23
|
Huang F, Tan EL, Yang P, Huang S, Ou-Yang L, Cao J, Wang T, Lei B. Self-weighted adaptive structure learning for ASD diagnosis via multi-template multi-center representation. Med Image Anal 2020; 63:101662. [PMID: 32442865 DOI: 10.1016/j.media.2020.101662] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Revised: 01/13/2020] [Accepted: 01/31/2020] [Indexed: 11/25/2022]
Abstract
As a kind of neurodevelopmental disease, autism spectrum disorder (ASD) can cause severe social, communication, interaction, and behavioral challenges. To date, many imaging-based machine learning techniques have been proposed to address ASD diagnosis issues. However, most of these techniques are restricted to a single template or dataset from one imaging center. In this paper, we propose a novel multi-template multi-center ensemble classification scheme for automatic ASD diagnosis. Specifically, based on different pre-defined templates, we construct multiple functional connectivity (FC) brain networks for each subject based on our proposed Pearson's correlation-based sparse low-rank representation. After extracting features from these FC networks, informative features to learn optimal similarity matrix are then selected by our self-weighted adaptive structure learning (SASL) model. For each template, the SASL method automatically assigns an optimal weight learned from the structural information without additional weights and parameters. Finally, an ensemble strategy based on the multi- template multi-center representations is applied to derive the final diagnosis results. Extensive experiments are conducted on the publicly available Autism Brain Imaging Data Exchange (ABIDE) database to demonstrate the efficacy of our proposed method. Experimental results verify that our proposed method boosts ASD diagnosis performance and outperforms state-of-the-art methods.
Collapse
Affiliation(s)
- Fanglin Huang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, China
| | - Ee-Leng Tan
- School of Electrical and Electronic Engineering, Nanyang Technological University, 639798, Singapore
| | - Peng Yang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, China
| | - Shan Huang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, China
| | - Le Ou-Yang
- Guangdong Key Laboratory of Intelligent Information Processing and Shenzhen Key Laboratory of Media Security, College of Information Engineering, Shenzhen University, Shenzhen 518060, China
| | - Jiuwen Cao
- Artificial Intelligence Institute, Hangzhou Dianzi University, Zhejiang 310010, China
| | - Tianfu Wang
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, China.
| | - Baiying Lei
- National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen 518060, China.
| |
Collapse
|
24
|
Kam TE, Zhang H, Jiao Z, Shen D. Deep Learning of Static and Dynamic Brain Functional Networks for Early MCI Detection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:478-487. [PMID: 31329111 PMCID: PMC7122732 DOI: 10.1109/tmi.2019.2928790] [Citation(s) in RCA: 56] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
While convolutional neural network (CNN) has been demonstrating powerful ability to learn hierarchical spatial features from medical images, it is still difficult to apply it directly to resting-state functional MRI (rs-fMRI) and the derived brain functional networks (BFNs). We propose a novel CNN framework to simultaneously learn embedded features from BFNs for brain disease diagnosis. Since BFNs can be built by considering both static and dynamic functional connectivity (FC), we first decompose rs-fMRI into multiple static BFNs with modified independent component analysis. Then, the voxel-wise variability in dynamic FC is used to quantify BFN dynamics. A set of paired 3D images representing static/dynamic BFNs can be fed into 3D CNNs, from which we can hierarchically and simultaneously learn static/dynamic BFN features. As a result, the dynamic BFN features can complement static BFN features and, at the meantime, different BFNs can help each other toward a joint and better classification. We validate our method with a publicly accessible, large cohort of rs-fMRI dataset in early-stage mild cognitive impairment (eMCI) diagnosis, which is one of the most challenging problems to the clinicians. By comparing with a conventional method, our method shows significant diagnostic performance improvement by almost 10%. This result demonstrates the effectiveness of deep learning in preclinical Alzheimer's disease diagnosis, based on the complex and high-dimensional voxel-wise spatiotemporal patterns of the resting-state brain functional connectomics. The framework provides a new but intuitive way to fully exploit deeply embedded diagnostic features from rs-fMRI for a better-individualized diagnosis of various neurological diseases.
Collapse
|
25
|
Tracking the Brain State Transition Process of Dynamic Function Connectivity Based on Resting State fMRI. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2019; 2019:9027803. [PMID: 31687008 PMCID: PMC6800976 DOI: 10.1155/2019/9027803] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/22/2019] [Revised: 08/19/2019] [Accepted: 09/05/2019] [Indexed: 11/17/2022]
Abstract
BOLD-fMRI technology provides a good foundation for the research of human brain dynamic functional connectivity and brain state analysis. However, due to the complexity of brain function connectivity and the high dimensionality expression of brain dynamic attributions, more research studies are focusing on tracking the time-varying characteristics through the transition between different brain states. The transition process is considered to occur instantaneously at some special time point in the above research studies, whereas our work found the brain state transition may be completed in a time section gradually rather than instantaneously. In this paper, a brain state conversion rate model is constructed to observe the procedure of brain state transition trend at each time point, and the state change can be observed by the values of conversion rate. According to the results, the transition of status always lasts for a few time points, and a brain state network model with both steady state and transition state is presented. Network topological overlap coefficient is built to analyze the features of time-varying networks. With this method, some common regular patterns of time-varying characteristics can be observed strongly in healthy children but not in the autism children. This distinct can help us to distinguish children with autism from healthy children.
Collapse
|
26
|
Jun E, Kang E, Choi J, Suk HI. Modeling regional dynamics in low-frequency fluctuation and its application to Autism spectrum disorder diagnosis. Neuroimage 2019; 184:669-686. [PMID: 30248456 DOI: 10.1016/j.neuroimage.2018.09.043] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2018] [Revised: 09/14/2018] [Accepted: 09/17/2018] [Indexed: 01/07/2023] Open
|
27
|
Zhou Y, Zhang L, Teng S, Qiao L, Shen D. Improving Sparsity and Modularity of High-Order Functional Connectivity Networks for MCI and ASD Identification. Front Neurosci 2018; 12:959. [PMID: 30618582 PMCID: PMC6305547 DOI: 10.3389/fnins.2018.00959] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2018] [Accepted: 12/03/2018] [Indexed: 01/01/2023] Open
Abstract
High-order correlation has recently been proposed to model brain functional connectivity network (FCN) for identifying neurological disorders, such as mild cognitive impairment (MCI) and autism spectrum disorder (ASD). In practice, the high-order FCN (HoFCN) can be derived from multiple low-order FCNs that are estimated separately in a series of sliding windows, and thus it in fact provides a way of integrating dynamic information encoded in a sequence of low-order FCNs. However, the estimation of low-order FCN may be unreliable due to the fact that the use of limited volumes/samples in a sliding window can significantly reduce the statistical power, which in turn affects the reliability of the resulted HoFCN. To address this issue, we propose to enhance HoFCN based on a regularized learning framework. More specifically, we first calculate an initial HoFCN using a recently developed method based on maximum likelihood estimation. Then, we learn an optimal neighborhood network of the initially estimated HoFCN with sparsity and modularity priors as regularizers. Finally, based on the improved HoFCNs, we conduct experiments to identify MCI and ASD patients from their corresponding normal controls. Experimental results show that the proposed methods outperform the baseline methods, and the improved HoFCNs with modularity prior consistently achieve the best performance.
Collapse
Affiliation(s)
- Yueying Zhou
- School of Mathematics Science, Liaocheng University, Liaocheng, China
| | - Limei Zhang
- School of Mathematics Science, Liaocheng University, Liaocheng, China
| | - Shenghua Teng
- College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, China
| | - Lishan Qiao
- School of Mathematics Science, Liaocheng University, Liaocheng, China.,College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao, China
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States.,Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| |
Collapse
|
28
|
Sakai K, Yamada K. Machine learning studies on major brain diseases: 5-year trends of 2014–2018. Jpn J Radiol 2018; 37:34-72. [DOI: 10.1007/s11604-018-0794-4] [Citation(s) in RCA: 73] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2018] [Accepted: 11/14/2018] [Indexed: 12/17/2022]
|
29
|
A Novel Deep Learning Framework on Brain Functional Networks for Early MCI Diagnosis. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2018; 11072:293-301. [PMID: 31106304 DOI: 10.1007/978-3-030-00931-1_34] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
Although alternations of brain functional networks (BFNs) derived from resting-state functional magnetic resonance imaging (rs-fMRI) have been considered as promising biomarkers for early Alzheimer's disease (AD) diagnosis, it is still challenging to perform individualized diagnosis, especially at the very early stage of preclinical stage of AD, i.e., early mild cognitive impairment (eMCI). Recently, convolutional neural networks (CNNs) show powerful ability in computer vision and image analysis applications, but there is still a gap for directly applying CNNs to rs-fMRI-based disease diagnosis. In this paper, we propose a novel multiple-BFN-based 3D CNN framework that can automatically and deeply learn complex, high-level, hierarchical diagnostic features from various independent component analysis-derived BFNs. More importantly, the embedded features of different BFNs could comprehensively support each other towards a more accurate eMCI diagnosis in a unified model. The performance of the proposed method is validated by a large-sample, multisite, rigorously controlled publicly accessible dataset. The proposed framework can also be conveniently and straightforwardly applied to individualized diagnosis of various neurological and psychiatric diseases.
Collapse
|