101
|
Bayesian Gaussian Process Classification from Event-Related Brain Potentials in Alzheimer’s Disease. Artif Intell Med 2017. [DOI: 10.1007/978-3-319-59758-4_7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
102
|
Mendelson AF, Zuluaga MA, Lorenzi M, Hutton BF, Ourselin S. Selection bias in the reported performances of AD classification pipelines. NEUROIMAGE-CLINICAL 2016; 14:400-416. [PMID: 28271040 PMCID: PMC5322215 DOI: 10.1016/j.nicl.2016.12.018] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2016] [Revised: 12/09/2016] [Accepted: 12/16/2016] [Indexed: 12/26/2022]
Abstract
The last decade has seen a great proliferation of supervised learning pipelines for individual diagnosis and prognosis in Alzheimer's disease. As more pipelines are developed and evaluated in the search for greater performance, only those results that are relatively impressive will be selected for publication. We present an empirical study to evaluate the potential for optimistic bias in classification performance results as a result of this selection. This is achieved using a novel, resampling-based experiment design that effectively simulates the optimisation of pipeline specifications by individuals or collectives of researchers using cross validation with limited data. Our findings indicate that bias can plausibly account for an appreciable fraction (often greater than half) of the apparent performance improvement associated with the pipeline optimisation, particularly in small samples. We discuss the consistency of our findings with patterns observed in the literature and consider strategies for bias reduction and mitigation. Demonstration and measurement of selection bias in AD classification experiments Bias accounts for much of the performance improvement seen with pipeline optimisation. Assessment of key risk factors and guidance on best research practices Evidence of selection bias in results collected by a recent literature review
Collapse
Affiliation(s)
- Alex F Mendelson
- Translational Imaging Group, Centre for Medical Image Computing University College London, London, UK
| | - Maria A Zuluaga
- Translational Imaging Group, Centre for Medical Image Computing University College London, London, UK
| | - Marco Lorenzi
- Translational Imaging Group, Centre for Medical Image Computing University College London, London, UK
| | - Brian F Hutton
- Institute of Nuclear Medicine, University College London, London, UK; Centre for Medical Radiation Physics, University of Wollongong, NSW, Australia
| | - Sébastien Ourselin
- Translational Imaging Group, Centre for Medical Image Computing University College London, London, UK; Dementia Research Centre, University College London, UK
| | | |
Collapse
|
103
|
|
104
|
Alahmadi HH, Shen Y, Fouad S, Luft CDB, Bentham P, Kourtzi Z, Tino P. Classifying Cognitive Profiles Using Machine Learning with Privileged Information in Mild Cognitive Impairment. Front Comput Neurosci 2016; 10:117. [PMID: 27909405 PMCID: PMC5112260 DOI: 10.3389/fncom.2016.00117] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2016] [Accepted: 10/31/2016] [Indexed: 11/28/2022] Open
Abstract
Early diagnosis of dementia is critical for assessing disease progression and potential treatment. State-or-the-art machine learning techniques have been increasingly employed to take on this diagnostic task. In this study, we employed Generalized Matrix Learning Vector Quantization (GMLVQ) classifiers to discriminate patients with Mild Cognitive Impairment (MCI) from healthy controls based on their cognitive skills. Further, we adopted a “Learning with privileged information” approach to combine cognitive and fMRI data for the classification task. The resulting classifier operates solely on the cognitive data while it incorporates the fMRI data as privileged information (PI) during training. This novel classifier is of practical use as the collection of brain imaging data is not always possible with patients and older participants. MCI patients and healthy age-matched controls were trained to extract structure from temporal sequences. We ask whether machine learning classifiers can be used to discriminate patients from controls and whether differences between these groups relate to individual cognitive profiles. To this end, we tested participants in four cognitive tasks: working memory, cognitive inhibition, divided attention, and selective attention. We also collected fMRI data before and after training on a probabilistic sequence learning task and extracted fMRI responses and connectivity as features for machine learning classifiers. Our results show that the PI guided GMLVQ classifiers outperform the baseline classifier that only used the cognitive data. In addition, we found that for the baseline classifier, divided attention is the only relevant cognitive feature. When PI was incorporated, divided attention remained the most relevant feature while cognitive inhibition became also relevant for the task. Interestingly, this analysis for the fMRI GMLVQ classifier suggests that (1) when overall fMRI signal is used as inputs to the classifier, the post-training session is most relevant; and (2) when the graph feature reflecting underlying spatiotemporal fMRI pattern is used, the pre-training session is most relevant. Taken together these results suggest that brain connectivity before training and overall fMRI signal after training are both diagnostic of cognitive skills in MCI.
Collapse
Affiliation(s)
- Hanin H Alahmadi
- School of Computer Science, The University of Birmingham Birmingham, UK
| | - Yuan Shen
- School of Computer Science, The University of Birmingham Birmingham, UK
| | - Shereen Fouad
- School of Dentistry, The University of Birmingham Birmingham, UK
| | - Caroline Di B Luft
- School of Biological and Chemical Sciences, Queen Mary University of London London, UK
| | - Peter Bentham
- School of Clinical and Experimental Medicine, The University of Birmingham Birmingham, UK
| | - Zoe Kourtzi
- Department of Psychology, The University of Cambridge Cambridge, UK
| | - Peter Tino
- School of Computer Science, The University of Birmingham Birmingham, UK
| |
Collapse
|
105
|
Khazaee A, Ebrahimzadeh A, Babajani-Feremi A. Classification of patients with MCI and AD from healthy controls using directed graph measures of resting-state fMRI. Behav Brain Res 2016; 322:339-350. [PMID: 27345822 DOI: 10.1016/j.bbr.2016.06.043] [Citation(s) in RCA: 77] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2016] [Revised: 06/21/2016] [Accepted: 06/23/2016] [Indexed: 01/03/2023]
Abstract
Brain network alterations in patients with Alzheimer's disease (AD) has been the subject of much investigation, but the biological mechanisms underlying these alterations remain poorly understood. Here, we aim to identify the changes in brain networks in patients with AD and mild cognitive impairment (MCI), and provide an accurate algorithm for classification of these patients from healthy control subjects (HC) by using a graph theoretical approach and advanced machine learning methods. Multivariate Granger causality analysis was performed on resting-state functional magnetic resonance imaging (rs-fMRI) data of 34 AD, 89 MCI, and 45 HC to calculate various directed graph measures. The graph measures were used as the original feature set for the machine learning algorithm. Filter and wrapper feature selection methods were applied to the original feature set to select an optimal subset of features. An accuracy of 93.3% was achieved for classification of AD, MCI, and HC using the optimal features and the naïve Bayes classifier. We also performed a hub node analysis and found that the number of hubs in HC, MCI, and AD were 12, 10, and 9, respectively, suggesting that patients with AD experience disturbance of critical communication areas in their brain network as AD progresses. The findings of this study provide insight into the neurophysiological mechanisms underlying MCI and AD. The proposed classification method highlights the potential of directed graph measures of rs-fMRI data for identification of the early stage of AD.
Collapse
Affiliation(s)
- Ali Khazaee
- Department of Electrical Engineering, University of Bojnord, Bojnord, Iran
| | - Ata Ebrahimzadeh
- Department of Electrical Engineering, Babol University of Technology, Babol, Iran
| | - Abbas Babajani-Feremi
- Department of Pediatrics, Division of Clinical Neurosciences, University of Tennessee Health Science Center, Memphis, TN, USA; Neuroscience Institute, Le Bonheur Children's Hospital, Memphis, TN, USA; Department of Anatomy and Neurobiology, University of Tennessee Health Science Center, Memphis, TN, USA.
| | | |
Collapse
|
106
|
A semi-mechanism approach based on MRI and proteomics for prediction of conversion from mild cognitive impairment to Alzheimer's disease. Sci Rep 2016; 6:26712. [PMID: 27273250 PMCID: PMC4896009 DOI: 10.1038/srep26712] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2016] [Accepted: 05/04/2016] [Indexed: 01/18/2023] Open
Abstract
Mild cognitive impairment (MCI) is a precursor phase of Alzheimer’s disease (AD). As current treatments may be effective only at the early stages of AD, it is important to track MCI patients who will convert to AD. The aim of this study is to develop a high performance semi-mechanism based approach to predict the conversion from MCI to AD and improve our understanding of MCI-to-AD conversion mechanism. First, analysis of variance (ANOVA) test and lasso regression are employed to identify the markers related to the conversion. Then the Bayesian network based on selected markers is established to predict MCI-to-AD conversion. The structure of Bayesian network suggests that the conversion may start with fibrin clot formation, verbal memory impairment, eating pattern changing and hyperinsulinemia. The Bayesian network achieves a high 10-fold cross-validated prediction performance with 96% accuracy, 95% sensitivity, 65% specificity, area under the receiver operating characteristic curve of 0.82 on data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. The semi-mechanism based approach provides not only high prediction performance but also clues of mechanism for MCI-to-AD conversion.
Collapse
|
107
|
Tian L, Ma L, Wang L. Alterations of functional connectivities from early to middle adulthood: Clues from multivariate pattern analysis of resting-state fMRI data. Neuroimage 2016; 129:389-400. [DOI: 10.1016/j.neuroimage.2016.01.039] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2015] [Revised: 12/08/2015] [Accepted: 01/19/2016] [Indexed: 01/25/2023] Open
|
108
|
Beheshti I, Demirel H. Feature-ranking-based Alzheimer’s disease classification from structural MRI. Magn Reson Imaging 2016; 34:252-63. [PMID: 26657976 DOI: 10.1016/j.mri.2015.11.009] [Citation(s) in RCA: 82] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2015] [Revised: 08/25/2015] [Accepted: 11/29/2015] [Indexed: 11/25/2022]
|
109
|
Khazaee A, Ebrahimzadeh A, Babajani-Feremi A. Application of advanced machine learning methods on resting-state fMRI network for identification of mild cognitive impairment and Alzheimer’s disease. Brain Imaging Behav 2015; 10:799-817. [DOI: 10.1007/s11682-015-9448-7] [Citation(s) in RCA: 112] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
110
|
Qin J, Chen SG, Hu D, Zeng LL, Fan YM, Chen XP, Shen H. Predicting individual brain maturity using dynamic functional connectivity. Front Hum Neurosci 2015; 9:418. [PMID: 26236224 PMCID: PMC4503925 DOI: 10.3389/fnhum.2015.00418] [Citation(s) in RCA: 73] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2015] [Accepted: 07/06/2015] [Indexed: 01/27/2023] Open
Abstract
Neuroimaging-based functional connectivity (FC) analyses have revealed significant developmental trends in specific intrinsic connectivity networks linked to cognitive and behavioral maturation. However, knowledge of how brain functional maturation is associated with FC dynamics at rest is limited. Here, we examined age-related differences in the temporal variability of FC dynamics with data publicly released by the Nathan Kline Institute (NKI; n = 183, ages 7-30) and showed that dynamic inter-region interactions can be used to accurately predict individual brain maturity across development. Furthermore, we identified a significant age-dependent trend underlying dynamic inter-network FC, including increasing variability of the connections between the visual network, default mode network (DMN) and cerebellum as well as within the cerebellum and DMN and decreasing variability within the cerebellum and between the cerebellum and DMN as well as the cingulo-opercular network. Overall, the results suggested significant developmental changes in dynamic inter-network interaction, which may shed new light on the functional organization of typical developmental brains.
Collapse
Affiliation(s)
- Jian Qin
- College of Mechatronics and Automation, National University of Defense Technology, Changsha China
| | - Shan-Guang Chen
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing China
| | - Dewen Hu
- College of Mechatronics and Automation, National University of Defense Technology, Changsha China
| | - Ling-Li Zeng
- College of Mechatronics and Automation, National University of Defense Technology, Changsha China
| | - Yi-Ming Fan
- College of Mechatronics and Automation, National University of Defense Technology, Changsha China
| | - Xiao-Ping Chen
- National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing China
| | - Hui Shen
- College of Mechatronics and Automation, National University of Defense Technology, Changsha China
| |
Collapse
|