101
|
Arbabshirani MR, Plis S, Sui J, Calhoun VD. Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls. Neuroimage 2017; 145:137-165. [PMID: 27012503 PMCID: PMC5031516 DOI: 10.1016/j.neuroimage.2016.02.079] [Citation(s) in RCA: 529] [Impact Index Per Article: 75.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2015] [Revised: 02/03/2016] [Accepted: 02/25/2016] [Indexed: 01/18/2023] Open
Abstract
Neuroimaging-based single subject prediction of brain disorders has gained increasing attention in recent years. Using a variety of neuroimaging modalities such as structural, functional and diffusion MRI, along with machine learning techniques, hundreds of studies have been carried out for accurate classification of patients with heterogeneous mental and neurodegenerative disorders such as schizophrenia and Alzheimer's disease. More than 500 studies have been published during the past quarter century on single subject prediction focused on a multiple brain disorders. In the first part of this study, we provide a survey of more than 200 reports in this field with a focus on schizophrenia, mild cognitive impairment (MCI), Alzheimer's disease (AD), depressive disorders, autism spectrum disease (ASD) and attention-deficit hyperactivity disorder (ADHD). Detailed information about those studies such as sample size, type and number of extracted features and reported accuracy are summarized and discussed. To our knowledge, this is by far the most comprehensive review of neuroimaging-based single subject prediction of brain disorders. In the second part, we present our opinion on major pitfalls of those studies from a machine learning point of view. Common biases are discussed and suggestions are provided. Moreover, emerging trends such as decentralized data sharing, multimodal brain imaging, differential diagnosis, disease subtype classification and deep learning are also discussed. Based on this survey, there is extensive evidence showing the great potential of neuroimaging data for single subject prediction of various disorders. However, the main bottleneck of this exciting field is still the limited sample size, which could be potentially addressed by modern data sharing models such as the ones discussed in this paper. Emerging big data technologies and advanced data-intensive machine learning methodologies such as deep learning have coincided with an increasing need for accurate, robust and generalizable single subject prediction of brain disorders during an exciting time. In this report, we survey the past and offer some opinions regarding the road ahead.
Collapse
Affiliation(s)
- Mohammad R Arbabshirani
- The Mind Research Network, Albuquerque, NM 87106, USA; Geisinger Health System, Danville, PA 17822, USA
| | - Sergey Plis
- The Mind Research Network, Albuquerque, NM 87106, USA
| | - Jing Sui
- The Mind Research Network, Albuquerque, NM 87106, USA; Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Vince D Calhoun
- The Mind Research Network, Albuquerque, NM 87106, USA; Department of ECE, University of New Mexico, Albuquerque, NM, USA
| |
Collapse
|
102
|
Subbaraju V, Suresh MB, Sundaram S, Narasimhan S. Identifying differences in brain activities and an accurate detection of autism spectrum disorder using resting state functional-magnetic resonance imaging : A spatial filtering approach. Med Image Anal 2017; 35:375-389. [DOI: 10.1016/j.media.2016.08.003] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2016] [Revised: 07/28/2016] [Accepted: 08/15/2016] [Indexed: 10/21/2022]
|
103
|
Ghiassian S, Greiner R, Jin P, Brown MRG. Using Functional or Structural Magnetic Resonance Images and Personal Characteristic Data to Identify ADHD and Autism. PLoS One 2016; 11:e0166934. [PMID: 28030565 PMCID: PMC5193362 DOI: 10.1371/journal.pone.0166934] [Citation(s) in RCA: 58] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2016] [Accepted: 11/07/2016] [Indexed: 11/24/2022] Open
Abstract
A clinical tool that can diagnose psychiatric illness using functional or structural magnetic resonance (MR) brain images has the potential to greatly assist physicians and improve treatment efficacy. Working toward the goal of automated diagnosis, we propose an approach for automated classification of ADHD and autism based on histogram of oriented gradients (HOG) features extracted from MR brain images, as well as personal characteristic data features. We describe a learning algorithm that can produce effective classifiers for ADHD and autism when run on two large public datasets. The algorithm is able to distinguish ADHD from control with hold-out accuracy of 69.6% (over baseline 55.0%) using personal characteristics and structural brain scan features when trained on the ADHD-200 dataset (769 participants in training set, 171 in test set). It is able to distinguish autism from control with hold-out accuracy of 65.0% (over baseline 51.6%) using functional images with personal characteristic data when trained on the Autism Brain Imaging Data Exchange (ABIDE) dataset (889 participants in training set, 222 in test set). These results outperform all previously presented methods on both datasets. To our knowledge, this is the first demonstration of a single automated learning process that can produce classifiers for distinguishing patients vs. controls from brain imaging data with above-chance accuracy on large datasets for two different psychiatric illnesses (ADHD and autism). Working toward clinical applications requires robustness against real-world conditions, including the substantial variability that often exists among data collected at different institutions. It is therefore important that our algorithm was successful with the large ADHD-200 and ABIDE datasets, which include data from hundreds of participants collected at multiple institutions. While the resulting classifiers are not yet clinically relevant, this work shows that there is a signal in the (f)MRI data that a learning algorithm is able to find. We anticipate this will lead to yet more accurate classifiers, over these and other psychiatric disorders, working toward the goal of a clinical tool for high accuracy differential diagnosis.
Collapse
Affiliation(s)
- Sina Ghiassian
- Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada
- Alberta Machine Learning Institute (AMII), formerly Alberta Innovates Centre for Machine Learning (AICML), Edmonton, Alberta, Canada
| | - Russell Greiner
- Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada
- Alberta Machine Learning Institute (AMII), formerly Alberta Innovates Centre for Machine Learning (AICML), Edmonton, Alberta, Canada
| | - Ping Jin
- Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada
- Alberta Machine Learning Institute (AMII), formerly Alberta Innovates Centre for Machine Learning (AICML), Edmonton, Alberta, Canada
| | - Matthew R. G. Brown
- Department of Computing Science, University of Alberta, Edmonton, Alberta, Canada
- Department of Psychiatry, University of Alberta, Edmonton, Alberta, Canada
- Alberta Machine Learning Institute (AMII), formerly Alberta Innovates Centre for Machine Learning (AICML), Edmonton, Alberta, Canada
| |
Collapse
|
104
|
Abraham A, Milham MP, Di Martino A, Craddock RC, Samaras D, Thirion B, Varoquaux G. Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example. Neuroimage 2016; 147:736-745. [PMID: 27865923 DOI: 10.1016/j.neuroimage.2016.10.045] [Citation(s) in RCA: 311] [Impact Index Per Article: 38.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2016] [Revised: 10/16/2016] [Accepted: 10/21/2016] [Indexed: 12/30/2022] Open
Abstract
Resting-state functional Magnetic Resonance Imaging (R-fMRI) holds the promise to reveal functional biomarkers of neuropsychiatric disorders. However, extracting such biomarkers is challenging for complex multi-faceted neuropathologies, such as autism spectrum disorders. Large multi-site datasets increase sample sizes to compensate for this complexity, at the cost of uncontrolled heterogeneity. This heterogeneity raises new challenges, akin to those face in realistic diagnostic applications. Here, we demonstrate the feasibility of inter-site classification of neuropsychiatric status, with an application to the Autism Brain Imaging Data Exchange (ABIDE) database, a large (N=871) multi-site autism dataset. For this purpose, we investigate pipelines that extract the most predictive biomarkers from the data. These R-fMRI pipelines build participant-specific connectomes from functionally-defined brain areas. Connectomes are then compared across participants to learn patterns of connectivity that differentiate typical controls from individuals with autism. We predict this neuropsychiatric status for participants from the same acquisition sites or different, unseen, ones. Good choices of methods for the various steps of the pipeline lead to 67% prediction accuracy on the full ABIDE data, which is significantly better than previously reported results. We perform extensive validation on multiple subsets of the data defined by different inclusion criteria. These enables detailed analysis of the factors contributing to successful connectome-based prediction. First, prediction accuracy improves as we include more subjects, up to the maximum amount of subjects available. Second, the definition of functional brain areas is of paramount importance for biomarker discovery: brain areas extracted from large R-fMRI datasets outperform reference atlases in the classification tasks.
Collapse
Affiliation(s)
- Alexandre Abraham
- Parietal Team, Saclay-INRIA le-de-France,Saclay,France; CEA, Neurospin bât 145, 91191 Gif-Sur-Yvette, France.
| | - Michael P Milham
- Center for the Developing Brain, Child Mind Institute, New York, USA; Center for Biomedical Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, USA
| | | | - R Cameron Craddock
- Center for the Developing Brain, Child Mind Institute, New York, USA; Center for Biomedical Imaging and Neuromodulation, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, USA
| | - Dimitris Samaras
- Stony Brook University, NY 11794, USA; Ecole Centrale, 92290 Châtenay Malabry, France
| | - Bertrand Thirion
- Parietal Team, Saclay-INRIA le-de-France,Saclay,France; CEA, Neurospin bât 145, 91191 Gif-Sur-Yvette, France
| | - Gael Varoquaux
- Parietal Team, Saclay-INRIA le-de-France,Saclay,France; CEA, Neurospin bât 145, 91191 Gif-Sur-Yvette, France
| |
Collapse
|
105
|
Levman J, Takahashi E. Multivariate analyses applied to fetal, neonatal and pediatric MRI of neurodevelopmental disorders. Neuroimage Clin 2015; 9:532-44. [PMID: 26640765 PMCID: PMC4625213 DOI: 10.1016/j.nicl.2015.09.017] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2015] [Revised: 09/23/2015] [Accepted: 09/25/2015] [Indexed: 01/15/2023]
Abstract
Multivariate analysis (MVA) is a class of statistical and pattern recognition methods that involve the processing of data that contains multiple measurements per sample. MVA can be used to address a wide variety of medical neuroimaging-related challenges including identifying variables associated with a measure of clinical importance (i.e. patient outcome), creating diagnostic tests, assisting in characterizing developmental disorders, understanding disease etiology, development and progression, assisting in treatment monitoring and much more. Compared to adults, imaging of developing immature brains has attracted less attention from MVA researchers. However, remarkable MVA research growth has occurred in recent years. This paper presents the results of a systematic review of the literature focusing on MVA technologies applied to neurodevelopmental disorders in fetal, neonatal and pediatric magnetic resonance imaging (MRI) of the brain. The goal of this manuscript is to provide a concise review of the state of the scientific literature on studies employing brain MRI and MVA in a pre-adult population. Neurological developmental disorders addressed in the MVA research contained in this review include autism spectrum disorder, attention deficit hyperactivity disorder, epilepsy, schizophrenia and more. While the results of this review demonstrate considerable interest from the scientific community in applications of MVA technologies in pediatric/neonatal/fetal brain MRI, the field is still young and considerable research growth remains ahead of us.
Collapse
Affiliation(s)
- Jacob Levman
- Division of Newborn Medicine, Department of Medicine, Boston Children's Hospital, Harvard Medical School, 1 Autumn Street #456, Boston, MA 02115, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13th Street, Charlestown, MA 02129, USA
| | - Emi Takahashi
- Division of Newborn Medicine, Department of Medicine, Boston Children's Hospital, Harvard Medical School, 1 Autumn Street #456, Boston, MA 02115, USA
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, 149 13th Street, Charlestown, MA 02129, USA
| |
Collapse
|