1
|
Yu X, Liu J, Lu Y, Funahashi S, Murai T, Wu J, Li Q, Zhang Z. Early diagnosis of Alzheimer's disease using a group self-calibrated coordinate attention network based on multimodal MRI. Sci Rep 2024; 14:24210. [PMID: 39406789 PMCID: PMC11480216 DOI: 10.1038/s41598-024-74508-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2024] [Accepted: 09/26/2024] [Indexed: 10/19/2024] Open
Abstract
Convolutional neural networks (CNNs) for extracting structural information from structural magnetic resonance imaging (sMRI), combined with functional magnetic resonance imaging (fMRI) and neuropsychological features, has emerged as a pivotal tool for early diagnosis of Alzheimer's disease (AD). However, the fixed-size convolutional kernels in CNNs have limitations in capturing global features, reducing the effectiveness of AD diagnosis. We introduced a group self-calibrated coordinate attention network (GSCANet) designed for the precise diagnosis of AD using multimodal data, including encompassing Haralick texture features, functional connectivity, and neuropsychological scores. GSCANet utilizes a parallel group self-calibrated module to enhance original spatial features, expanding the field of view and embedding spatial data into channel information through a coordinate attention module, which ensures long-term contextual interaction. In a four-classification comparison (AD vs. early MCI (EMCI) vs. late MCI (LMCI) vs. normal control (NC)), GSCANet demonstrated an accuracy of 78.70%. For the three-classification comparison (AD vs. MCI vs. NC), it achieved an accuracy of 83.33%. Moreover, our method exhibited impressive accuracies in the AD vs. NC (92.81%) and EMCI vs. LMCI (84.67%) classifications. GSCANet improves classification performance at different stages of AD by employing group self-calibrated to expand features receptive field and integrating coordinated attention to facilitate significant interactions among channels and spaces. Providing insights into AD mechanisms and showcasing scalability for various disease predictions.
Collapse
Affiliation(s)
- Xiaojie Yu
- Zhongshan Institute of Changchun University of Science and Technology, Zhongshan, 528437, China
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Jingyuan Liu
- Zhongshan Institute of Changchun University of Science and Technology, Zhongshan, 528437, China
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Yinping Lu
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Shintaro Funahashi
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Toshiya Murai
- Department of Psychiatry, Graduate School of Medicine, Kyoto University, Kyoto, 606-8501, Japan
| | - Jinglong Wu
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China
| | - Qi Li
- Zhongshan Institute of Changchun University of Science and Technology, Zhongshan, 528437, China.
| | - Zhilin Zhang
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China.
- Department of Psychiatry, Graduate School of Medicine, Kyoto University, Kyoto, 606-8501, Japan.
| |
Collapse
|
2
|
Pasnoori N, Flores-Garcia T, Barkana BD. Histogram-based features track Alzheimer's progression in brain MRI. Sci Rep 2024; 14:257. [PMID: 38167618 PMCID: PMC10761829 DOI: 10.1038/s41598-023-50631-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Accepted: 12/22/2023] [Indexed: 01/05/2024] Open
Abstract
Alzheimer's disease is a form of general dementia marked by amyloid plaques, neurofibrillary tangles, and neuron degeneration. The disease has no cure, and early detection is critical in improving patient outcomes. Magnetic resonance imaging (MRI) is important in measuring neurodegeneration during the disease. Computer-aided image processing tools have been used to aid medical professionals in ascertaining a diagnosis of Alzheimer's in its early stages. As characteristics of non and very-mild dementia stages overlap, tracking the progression is challenging. Our work developed an adaptive multi-thresholding algorithm based on the morphology of the smoothed histogram to define features identifying neurodegeneration and track its progression as non, very mild, mild, and moderate. Gray and white matter volume, statistical moments, multi-thresholds, shrinkage, gray-to-white matter ratio, and three distance and angle values are mathematically derived. Decision tree, discriminant analysis, Naïve Bayes, SVM, KNN, ensemble, and neural network classifiers are designed to evaluate the proposed methodology with the performance metrics accuracy, recall, specificity, precision, F1 score, Matthew's correlation coefficient, and Kappa values. Experimental results showed that the proposed features successfully label the neurodegeneration stages.
Collapse
Affiliation(s)
- Nikaash Pasnoori
- Biomedical Engineering Department, University of Bridgeport, Bridgeport, CT, 06604, USA
| | - Thania Flores-Garcia
- Computer Engineering Department, University of Bridgeport, Bridgeport, CT, 06604, USA
| | - Buket D Barkana
- Biomedical Engineering Department, The University of Akron, Akron, OH, 44325-0302, USA.
| |
Collapse
|
3
|
Nguyen HD, Clément M, Mansencal B, Coupé P. Towards better interpretable and generalizable AD detection using collective artificial intelligence. Comput Med Imaging Graph 2023; 104:102171. [PMID: 36640484 DOI: 10.1016/j.compmedimag.2022.102171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 12/24/2022] [Accepted: 12/24/2022] [Indexed: 01/03/2023]
Abstract
Alzheimer's Disease is the most common cause of dementia. Accurate diagnosis and prognosis of this disease are essential to design an appropriate treatment plan, increasing the life expectancy of the patient. Intense research has been conducted on the use of machine learning to identify Alzheimer's Disease from neuroimaging data, such as structural magnetic resonance imaging. In recent years, advances of deep learning in computer vision suggest a new research direction for this problem. Current deep learning-based approaches in this field, however, have a number of drawbacks, including the interpretability of model decisions, a lack of generalizability information and a lower performance compared to traditional machine learning techniques. In this paper, we design a two-stage framework to overcome these limitations. In the first stage, an ensemble of 125 U-Nets is used to grade the input image, producing a 3D map that reflects the disease severity at voxel-level. This map can help to localize abnormal brain areas caused by the disease. In the second stage, we model a graph per individual using the generated grading map and other information about the subject. We propose to use a graph convolutional neural network classifier for the final classification. As a result, our framework demonstrates comparative performance to the state-of-the-art methods in different datasets for both diagnosis and prognosis. We also demonstrate that the use of a large ensemble of U-Nets offers a better generalization capacity for our framework.
Collapse
Affiliation(s)
- Huy-Dung Nguyen
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France.
| | - Michaël Clément
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France
| | - Boris Mansencal
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France
| | - Pierrick Coupé
- Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, 33400 Talence, France
| |
Collapse
|
4
|
Hu J, Wang Y, Guo D, Qu Z, Sui C, He G, Wang S, Chen X, Wang C, Liu X. Diagnostic performance of magnetic resonance imaging-based machine learning in Alzheimer's disease detection: a meta-analysis. Neuroradiology 2023; 65:513-527. [PMID: 36477499 DOI: 10.1007/s00234-022-03098-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 11/28/2022] [Indexed: 12/12/2022]
Abstract
PURPOSE Advanced machine learning (ML) algorithms can assist rapid medical image recognition and realize automatic, efficient, noninvasive, and convenient diagnosis. We aim to further evaluate the diagnostic performance of ML to distinguish patients with probable Alzheimer's disease (AD) from normal older adults based on structural magnetic resonance imaging (MRI). METHODS The Medline, Embase, and Cochrane Library databases were searched for relevant literature published up until July 2021. We used the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) to evaluate all included studies' quality and potential bias. Random-effects models were used to calculate pooled sensitivity and specificity, and the Deeks' test was used to assess publication bias. RESULTS We included 24 models based on different brain features extracted by ML algorithms in 19 papers. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, and area under the summary receiver operating characteristic curve for ML in detecting AD were 0.85 (95%CI 0.81-0.89), 0.88 (95%CI 0.84-0.91), 7.15 (95%CI 5.40-9.47), 0.17 (95%CI 0.12-0.22), 43.34 (95%CI 26.89-69.84), and 0.93 (95%CI 0.91-0.95). CONCLUSION ML using structural MRI data performed well in diagnosing probable AD patients and normal elderly. However, more high-quality, large-scale prospective studies are needed to further enhance the reliability and generalizability of ML for clinical applications before it can be introduced into clinical practice.
Collapse
Affiliation(s)
- Jiayi Hu
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Yashan Wang
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Dingjie Guo
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Zihan Qu
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Chuanying Sui
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Guangliang He
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Song Wang
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Xiaofei Chen
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Chunpeng Wang
- School of Mathematics and Statistics, Northeast Normal University, Changchun, Jilin, China.
| | - Xin Liu
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China.
| |
Collapse
|
5
|
Mirabnahrazam G, Ma D, Beaulac C, Lee S, Popuri K, Lee H, Cao J, Galvin JE, Wang L, Beg MF. Predicting time-to-conversion for dementia of Alzheimer's type using multi-modal deep survival analysis. Neurobiol Aging 2023; 121:139-156. [PMID: 36442416 PMCID: PMC10535369 DOI: 10.1016/j.neurobiolaging.2022.10.005] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 10/08/2022] [Accepted: 10/11/2022] [Indexed: 11/27/2022]
Abstract
Dementia of Alzheimer's Type (DAT) is a complex disorder influenced by numerous factors, and it is difficult to predict individual progression trajectory from normal or mildly impaired cognition to DAT. An in-depth examination of multiple modalities of data may yield an accurate estimate of time-to-conversion to DAT for preclinical subjects at various stages of disease development. We used a deep-learning model designed for survival analyses to predict subjects' time-to-conversion to DAT using the baseline data of 401 subjects with 63 features from MRI, genetic, and CDC (Cognitive tests, Demographic, and CSF) data in the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Our study demonstrated that CDC data outperform genetic or MRI data in predicting DAT time-to-conversion for subjects with Mild Cognitive Impairment (MCI). On the other hand, genetic data provided the most predictive power for subjects with Normal Cognition (NC) at the time of the visit. Furthermore, combining MRI and genetic features improved the time-to-event prediction over using either modality alone. Finally, adding CDC to any combination of features only worked as well as using only the CDC features.
Collapse
Affiliation(s)
- Ghazal Mirabnahrazam
- School of Engineering, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Da Ma
- School of Medicine, Wake Forest University, Winston-Salem, NC, USA; School of Engineering, Simon Fraser University, Burnaby, British Columbia, Canada.
| | - Cédric Beaulac
- Department of Mathematics and Statistics, University of Victoria, Victoria, British Columbia, Canada; School of Engineering, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Sieun Lee
- Mental Health & Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK; School of Engineering, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Karteek Popuri
- Department of Computer Science, Memorial University of Newfoundland, St. John's, Newfoundland & Labrador, Canada; School of Engineering, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Hyunwoo Lee
- Division of Neurology, Department of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jiguo Cao
- Department of Statistics and Actuarial Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - James E Galvin
- Comprehensive Center for Brain Health, Department of Neurology, University of Miami Miller School of Medicine, Miami, FL, USA
| | - Lei Wang
- Psychiatry and Behavioral Health, Ohio State University Wexner Medical Center, Columbus, OH, USA
| | - Mirza Faisal Beg
- School of Engineering, Simon Fraser University, Burnaby, British Columbia, Canada.
| |
Collapse
|
6
|
Alzheimer’s disease classification using distilled multi-residual network. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04084-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
7
|
Song YH, Yi JY, Noh Y, Jang H, Seo SW, Na DL, Seong JK. On the reliability of deep learning-based classification for Alzheimer's disease: Multi-cohorts, multi-vendors, multi-protocols, and head-to-head validation. Front Neurosci 2022; 16:851871. [PMID: 36161156 PMCID: PMC9490270 DOI: 10.3389/fnins.2022.851871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Accepted: 07/27/2022] [Indexed: 01/18/2023] Open
Abstract
Structural changes in the brain due to Alzheimer's disease dementia (ADD) can be observed through brain T1-weighted magnetic resonance imaging (MRI) images. Many ADD diagnostic studies using brain MRI images have been conducted with machine-learning and deep-learning models. Although reliability is a key in clinical application and applicability of low-resolution MRI (LRMRI) is a key to broad clinical application, both are not sufficiently studied in the deep-learning area. In this study, we developed a 2-dimensional convolutional neural network-based classification model by adopting several methods, such as using instance normalization layer, Mixup, and sharpness aware minimization. To train the model, MRI images from 2,765 cognitively normal individuals and 1,192 patients with ADD from the Samsung medical center cohort were exploited. To assess the reliability of our classification model, we designed external validation in multiple scenarios: (1) multi-cohort validation using four additional cohort datasets including more than 30 different centers in multiple countries, (2) multi-vendor validation using three different MRI vendor subgroups, (3) LRMRI image validation, and finally, (4) head-to-head validation using ten pairs of MRI images from ten individual subjects scanned in two different centers. For multi-cohort validation, we used the MRI images from 739 subjects from the Alzheimer's Disease Neuroimaging Initiative cohort, 125 subjects from the Dementia Platform of Korea cohort, 234 subjects from the Premier cohort, and 139 subjects from the Gachon University Gil Medical Center. We further assessed classification performance across different vendors and protocols for each dataset. We achieved a mean AUC and classification accuracy of 0.9868 and 0.9482 in 5-fold cross-validation. In external validation, we obtained a comparable AUC of 0.9396 and classification accuracy of 0.8757 to other cross-validation studies in the ADNI cohorts. Furthermore, we observed the possibility of broad clinical application through LRMRI image validation by achieving a mean AUC and classification accuracy of 0.9404 and 0.8765 at cross-validation and AUC and classification accuracy of 0.8749 and 0.8281 at the ADNI cohort external validation.
Collapse
Affiliation(s)
- Yeong-Hun Song
- Department of Artificial Intelligence, Korea University, Seoul, South Korea
| | - Jun-Young Yi
- Department of Artificial Intelligence, Korea University, Seoul, South Korea
| | - Young Noh
- Department of Neurology, Gil Medical Center, Gachon University College of Medicine, Incheon, South Korea
| | - Hyemin Jang
- Department of Neurology, Samsung Medical Center, School of Medicine, Sungkyunkwan University, Seoul, South Korea
| | - Sang Won Seo
- Department of Neurology, Samsung Medical Center, School of Medicine, Sungkyunkwan University, Seoul, South Korea
| | - Duk L. Na
- Department of Neurology, Samsung Medical Center, School of Medicine, Sungkyunkwan University, Seoul, South Korea
| | - Joon-Kyung Seong
- Department of Artificial Intelligence, Korea University, Seoul, South Korea
- School of Biomedical Engineering, Korea University, Seoul, South Korea
- Interdisciplinary Program in Precision Public Health, College of Health Science, Korea University, Seoul, South Korea
| |
Collapse
|
8
|
Chen Z, Wang Z, Zhao M, Zhao Q, Liang X, Li J, Song X. A new classification network for diagnosing Alzheimer's disease in class-imbalance MRI datasets. Front Neurosci 2022; 16:807085. [PMID: 36090283 PMCID: PMC9453266 DOI: 10.3389/fnins.2022.807085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 07/26/2022] [Indexed: 11/13/2022] Open
Abstract
Automatic identification of Alzheimer's Disease (AD) through magnetic resonance imaging (MRI) data can effectively assist to doctors diagnose and treat Alzheimer's. Current methods improve the accuracy of AD recognition, but they are insufficient to address the challenge of small interclass and large intraclass differences. Some studies attempt to embed patch-level structure in neural networks which enhance pathologic details, but the enormous size and time complexity render these methods unfavorable. Furthermore, several self-attention mechanisms fail to provide contextual information to represent discriminative regions, which limits the performance of these classifiers. In addition, the current loss function is adversely affected by outliers of class imbalance and may fall into local optimal values. Therefore, we propose a 3D Residual RepVGG Attention network (ResRepANet) stacked with several lightweight blocks to identify the MRI of brain disease, which can also trade off accuracy and flexibility. Specifically, we propose a Non-local Context Spatial Attention block (NCSA) and embed it in our proposed ResRepANet, which aggregates global contextual information in spatial features to improve semantic relevance in discriminative regions. In addition, in order to reduce the influence of outliers, we propose a Gradient Density Multiple-weighting Mechanism (GDMM) to automatically adjust the weights of each MRI image via a normalizing gradient norm. Experiments are conducted on datasets from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and Australian Imaging, Biomarker and Lifestyle Flagship Study of Aging (AIBL). Experiments on both datasets show that the accuracy, sensitivity, specificity, and Area Under the Curve are consistently better than for state-of-the-art methods.
Collapse
Affiliation(s)
- Ziyang Chen
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Zhuowei Wang
- School of Computers, Guangdong University of Technology, Guangzhou, China
- *Correspondence: Zhuowei Wang
| | - Meng Zhao
- School of Computer Science and Engineering, Tianjin University of Technology, Tianjin, China
| | - Qin Zhao
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Xuehu Liang
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Jiajian Li
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Xiaoyu Song
- Department of Electrical and Computer Engineering, Portland State University, Portland, OR, United States
| |
Collapse
|
9
|
Shi H, Ma D, Nie Y, Faisal Beg M, Pei J, Cao J, Neuroimaging Initiative TAD. Early diagnosis of Alzheimer's disease on ADNI data using novel longitudinal score based on functional principal component analysis. J Med Imaging (Bellingham) 2021; 8:024502. [PMID: 33898638 DOI: 10.1117/1.jmi.8.2.024502] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Accepted: 03/12/2021] [Indexed: 11/14/2022] Open
Abstract
Methods: Alzheimer's disease (AD) is a worldwide prevalent age-related neurodegenerative disease with no available cure yet. Early prognosis is therefore crucial for planning proper clinical intervention. It is especially true for people diagnosed with mild cognitive impairment, to whom the prediction of whether and when the future disease onset would happen is particularly valuable. However, such prognostic prediction has been proven to be challenging, and previous studies have only achieved limited success. Approach: In this study, we seek to extract the principal component of the longitudinal disease progression trajectory in the early stage of AD, measured as the magnetic resonance imaging (MRI)-derived structural volume, to predict the onset of AD for mild cognitive impaired patients two years ahead. Results: Cross-validation results of LASSO regression using the longitudinal functional principal component (FPC) features show significant improved predictive power compared to training using the baseline volume 12 months before AD conversion [area under the receiver operating characteristic curve (AUC) of 0.802 versus 0.732] and 24 months before AD conversion (AUC of 0.816 versus 0.717). Conclusions: We present a framework using the FPCA to extract features from MRI-derived information collected from multiple timepoints. The results of our study demonstrate the advantageous predictive power of the population-based longitudinal features to predict the disease onset compared with using only cross-sectional data-based on volumetric features extracted from a single timepoint, demonstrating the improved prediction power using FPC-derived longitudinal features.
Collapse
Affiliation(s)
- Haolun Shi
- Simon Fraser University, Department of Statistics and Actuarial Science, Burnaby, BC, Canada
| | - Da Ma
- Simon Fraser University, School of Engineering Science, Burnaby, BC, Canada
| | - Yunlong Nie
- Simon Fraser University, Department of Statistics and Actuarial Science, Burnaby, BC, Canada
| | - Mirza Faisal Beg
- Simon Fraser University, School of Engineering Science, Burnaby, BC, Canada
| | - Jian Pei
- Simon Fraser University, Department of Statistics and Actuarial Science, Burnaby, BC, Canada.,Simon Fraser University, School of Computing Science, Burnaby, BC, Canada
| | - Jiguo Cao
- Simon Fraser University, Department of Statistics and Actuarial Science, Burnaby, BC, Canada.,Simon Fraser University, School of Computing Science, Burnaby, BC, Canada
| | - The Alzheimer's Disease Neuroimaging Initiative
- Simon Fraser University, Department of Statistics and Actuarial Science, Burnaby, BC, Canada.,Simon Fraser University, School of Engineering Science, Burnaby, BC, Canada.,Simon Fraser University, School of Computing Science, Burnaby, BC, Canada
| |
Collapse
|
10
|
Ma D, Yee E, Stocks JK, Jenkins LM, Popuri K, Chausse G, Wang L, Probst S, Beg MF. Blinded Clinical Evaluation for Dementia of Alzheimer's Type Classification Using FDG-PET: A Comparison Between Feature-Engineered and Non-Feature-Engineered Machine Learning Methods. J Alzheimers Dis 2021; 80:715-726. [PMID: 33579858 PMCID: PMC8978589 DOI: 10.3233/jad-201591] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
BACKGROUND Advanced machine learning methods can aid in the identification of dementia risk using neuroimaging-derived features including FDG-PET. However, to enable the translation of these methods and test their usefulness in clinical practice, it is crucial to conduct independent validation on real clinical samples, which has yet to be properly delineated in the current literature. OBJECTIVE In this paper, we present our efforts to enable such clinical translational through the evaluation and comparison of two machine-learning methods for discrimination between dementia of Alzheimer's type (DAT) and Non-DAT controls. METHODS FDG-PET-based dementia scores were generated on an independent clinical sample whose clinical diagnosis was blinded to the algorithm designers. A feature-engineered approach (multi-kernel probability classifier) and a non-feature-engineered approach (3D convolutional neural network) were analyzed. Both classifiers were pre-trained on cognitively normal subjects as well as subjects with DAT. These two methods provided a probabilistic dementia score for this previously unseen clinical data. Performance of the algorithms were compared against ground-truth dementia rating assessed by experienced nuclear physicians. RESULTS Blinded clinical evaluation on both classifiers showed good separation between the cognitively normal subjects and the patients diagnosed with DAT. The non-feature-engineered dementia score showed higher sensitivity among subjects whose diagnosis was in agreement between the machine-learning models, while the feature-engineered approach showed higher specificity in non-consensus cases. CONCLUSION In this study, we demonstrated blinded evaluation using data from an independent clinical sample for assessing the performance in DAT classification models in a clinical setting. Our results showed good generalizability for two machine-learning approaches, marking an important step for the translation of pre-trained machine-learning models into clinical practice.
Collapse
Affiliation(s)
- Da Ma
- School of Engineering Science, Simon Fraser University, Burnaby, Canada
| | - Evangeline Yee
- School of Engineering Science, Simon Fraser University, Burnaby, Canada
| | - Jane K. Stocks
- Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Lisanne M. Jenkins
- Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Karteek Popuri
- School of Engineering Science, Simon Fraser University, Burnaby, Canada
| | | | - Lei Wang
- Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | | | - Mirza Faisal Beg
- School of Engineering Science, Simon Fraser University, Burnaby, Canada
| |
Collapse
|