1
|
Wang T, Ding Z, Yang X, Chen Y, Liu Y, Kong X, Sun Y. Detection of mild cognitive impairment based on attention mechanism and parallel dilated convolution. PeerJ Comput Sci 2024; 10:e2056. [PMID: 38855222 PMCID: PMC11157520 DOI: 10.7717/peerj-cs.2056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Accepted: 04/22/2024] [Indexed: 06/11/2024]
Abstract
Mild cognitive impairment (MCI) is a precursor to neurodegenerative diseases such as Alzheimer's disease, and an early diagnosis and intervention can delay its progression. However, the brain MRI images of MCI patients have small changes and blurry shapes. At the same time, MRI contains a large amount of redundant information, which leads to the poor performance of current MCI detection methods based on deep learning. This article proposes an MCI detection method that integrates the attention mechanism and parallel dilated convolution. By introducing an attention mechanism, it highlights the relevant information of the lesion area in the image, suppresses irrelevant areas, eliminates redundant information in MRI images, and improves the ability to mine detailed information. Parallel dilated convolution is used to obtain a larger receptive field without downsampling, thereby enhancing the ability to acquire contextual information and improving the accuracy of small target classification while maintaining detailed information on large-scale feature maps. Experimental results on the public dataset ADNI show that the detection accuracy of the method on MCI reaches 81.63%, which is approximately 6.8% higher than the basic model. The method is expected to be used in clinical practice in the future to provide earlier intervention and treatment for MCI patients, thereby improving their quality of life.
Collapse
Affiliation(s)
- Tao Wang
- Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, Anhui, China
| | - Zenghui Ding
- Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, Anhui, China
| | - Xianjun Yang
- Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, Anhui, China
| | - Yanyan Chen
- Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, Anhui, China
| | - Yu Liu
- Affiliated Psychological Hospital of Anhui Medical University, Hefei, Anhui, China
- Hefei Fourth People’s Hospital, Hefei, Anhui, China
| | - Xiaoming Kong
- Affiliated Psychological Hospital of Anhui Medical University, Hefei, Anhui, China
- Hefei Fourth People’s Hospital, Hefei, Anhui, China
| | - Yining Sun
- Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, Anhui, China
| |
Collapse
|
2
|
Song B, Yoshida S. Explainability of three-dimensional convolutional neural networks for functional magnetic resonance imaging of Alzheimer's disease classification based on gradient-weighted class activation mapping. PLoS One 2024; 19:e0303278. [PMID: 38771733 PMCID: PMC11108152 DOI: 10.1371/journal.pone.0303278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 04/22/2024] [Indexed: 05/23/2024] Open
Abstract
Currently, numerous studies focus on employing fMRI-based deep neural networks to diagnose neurological disorders such as Alzheimer's Disease (AD), yet only a handful have provided results regarding explainability. We address this gap by applying several prevalent explainability methods such as gradient-weighted class activation mapping (Grad-CAM) to an fMRI-based 3D-VGG16 network for AD diagnosis to improve the model's explainability. The aim is to explore the specific Region of Interest (ROI) of brain the model primarily focuses on when making predictions, as well as whether there are differences in these ROIs between AD and normal controls (NCs). First, we utilized multiple resting-state functional activity maps including ALFF, fALFF, ReHo, and VMHC to reduce the complexity of fMRI data, which differed from many studies that utilized raw fMRI data. Compared to methods utilizing raw fMRI data, this manual feature extraction approach may potentially alleviate the model's burden. Subsequently, 3D-VGG16 were employed for AD classification, where the final fully connected layers were replaced with a Global Average Pooling (GAP) layer, aimed at mitigating overfitting while preserving spatial information within the feature maps. The model achieved a maximum of 96.4% accuracy on the test set. Finally, several 3D CAM methods were employed to interpret the models. In the explainability results of the models with relatively high accuracy, the highlighted ROIs were primarily located in the precuneus and the hippocampus for AD subjects, while the models focused on the entire brain for NC. This supports current research on ROIs involved in AD. We believe that explaining deep learning models would not only provide support for existing research on brain disorders, but also offer important referential recommendations for the study of currently unknown etiologies.
Collapse
Affiliation(s)
- Boyue Song
- Graduate School of Engineering, Kochi University of Technology, Kami City, Kochi Prefecture, Japan
| | - Shinichi Yoshida
- School of Information, Kochi University of Technology, Kami City, Kochi Prefecture, Japan
| | | |
Collapse
|
3
|
O'Connell S, Cannon DM, Broin PÓ. Predictive modelling of brain disorders with magnetic resonance imaging: A systematic review of modelling practices, transparency, and interpretability in the use of convolutional neural networks. Hum Brain Mapp 2023; 44:6561-6574. [PMID: 37909364 PMCID: PMC10681646 DOI: 10.1002/hbm.26521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Revised: 09/28/2023] [Accepted: 10/10/2023] [Indexed: 11/03/2023] Open
Abstract
Brain disorders comprise several psychiatric and neurological disorders which can be characterized by impaired cognition, mood alteration, psychosis, depressive episodes, and neurodegeneration. Clinical diagnoses primarily rely on a combination of life history information and questionnaires, with a distinct lack of discriminative biomarkers in use for psychiatric disorders. Symptoms across brain conditions are associated with functional alterations of cognitive and emotional processes, which can correlate with anatomical variation; structural magnetic resonance imaging (MRI) data of the brain are therefore an important focus of research, particularly for predictive modelling. With the advent of large MRI data consortia (such as the Alzheimer's Disease Neuroimaging Initiative) facilitating a greater number of MRI-based classification studies, convolutional neural networks (CNNs)-deep learning models well suited to image processing tasks-have become increasingly popular for research into brain conditions. This has resulted in a myriad of studies reporting impressive predictive performances, demonstrating the potential clinical value of deep learning systems. However, methodologies can vary widely across studies, making them difficult to compare and/or reproduce, potentially limiting their clinical application. Here, we conduct a qualitative systematic literature review of 55 studies carrying out CNN-based predictive modelling of brain disorders using MRI data and evaluate them based on three principles-modelling practices, transparency, and interpretability. We propose several recommendations to enhance the potential for the integration of CNNs into clinical care.
Collapse
Affiliation(s)
- Shane O'Connell
- School of Mathematical and Statistical Sciences, College of Science and EngineeringUniversity of GalwayGalwayIreland
| | - Dara M. Cannon
- Clinical Neuroimaging Laboratory, Galway Neuroscience Centre, College of MedicineNursing and Health SciencesUniversity of GalwayGalwayIreland
| | - Pilib Ó. Broin
- School of Mathematical and Statistical Sciences, College of Science and EngineeringUniversity of GalwayGalwayIreland
| |
Collapse
|
4
|
Chen Y, Wang Y, Song Z, Fan Y, Gao T, Tang X. Abnormal white matter changes in Alzheimer's disease based on diffusion tensor imaging: A systematic review. Ageing Res Rev 2023; 87:101911. [PMID: 36931328 DOI: 10.1016/j.arr.2023.101911] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 03/01/2023] [Accepted: 03/13/2023] [Indexed: 03/17/2023]
Abstract
Alzheimer's disease (AD) is a degenerative neurological disease in elderly individuals. Subjective cognitive decline (SCD), mild cognitive impairment (MCI) and further development to dementia (d-AD) are considered to be major stages of the progressive pathological development of AD. Diffusion tensor imaging (DTI), one of the most important modalities of MRI, can describe the microstructure of white matter through its tensor model. It is widely used in understanding the central nervous system mechanism and finding appropriate potential biomarkers for the early stages of AD. Based on the multilevel analysis methods of DTI (voxelwise, fiberwise and networkwise), we summarized that AD patients mainly showed extensive microstructural damage, structural disconnection and topological abnormalities in the corpus callosum, fornix, and medial temporal lobe, including the hippocampus and cingulum. The diffusion features and structural connectomics of specific regions can provide information for the early assisted recognition of AD. The classification accuracy of SCD and normal controls can reach 92.68% at present. And due to the further changes of brain structure and function, the classification accuracy of MCI, d-AD and normal controls can reach more than 97%. Finally, we summarized the limitations of current DTI-based AD research and propose possible future research directions.
Collapse
Affiliation(s)
- Yu Chen
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
| | - Yifei Wang
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China
| | - Zeyu Song
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
| | - Yingwei Fan
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
| | - Tianxin Gao
- School of Life Science, Beijing Institute of Technology, Beijing 100081, China.
| | - Xiaoying Tang
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China; School of Life Science, Beijing Institute of Technology, Beijing 100081, China.
| |
Collapse
|
5
|
Marcisz A, Polanska J. Can T1-Weighted Magnetic Resonance Imaging Significantly Improve Mini-Mental State Examination-Based Distinguishing Between Mild Cognitive Impairment and Early-Stage Alzheimer's Disease? J Alzheimers Dis 2023; 92:941-957. [PMID: 36806505 PMCID: PMC10116132 DOI: 10.3233/jad-220806] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/23/2023] [Indexed: 02/19/2023]
Abstract
BACKGROUND Detecting early-stage Alzheimer's disease (AD) is still problematic in clinical practice. This work aimed to find T1-weighted MRI-based markers for AD and mild cognitive impairment (MCI) to improve the screening process. OBJECTIVE Our assumption was to build a screening model that would be accessible and easy to use for physicians in their daily clinical routine. METHODS The multinomial logistic regression was used to detect status: AD, MCI, and normal control (NC) combined with the Bayesian information criterion for model selection. Several T1-weighted MRI-based radiomic features were considered explanatory variables in the prediction model. RESULTS The best radiomic predictor was the relative brain volume. The proposed method confirmed its quality by achieving a balanced accuracy of 95.18%, AUC of 93.25%, NPV of 97.93%, and PPV of 90.48% for classifying AD versus NC for the European DTI Study on Dementia (EDSD). The comparison of the two models: with the MMSE score only as an independent variable and corrected for the relative brain value and age, shows that the addition of the T1-weighted MRI-based biomarker improves the quality of MCI detection (AUC: 67.04% versus 71.08%) while maintaining quality for AD (AUC: 93.35% versus 93.25%). Additionally, among MCI patients predicted as AD inconsistently with the original diagnosis, 60% from ADNI and 76.47% from EDSD were re-diagnosed as AD within a 48-month follow-up. It shows that our model can detect AD patients a few years earlier than a standard medical diagnosis. CONCLUSION The created method is non-invasive, inexpensive, clinically accessible, and efficiently supports AD/MCI screening.
Collapse
Affiliation(s)
- Anna Marcisz
- Department of Data Science and Engineering, The Silesian University of Technology, Gliwice, Poland
| | | | - Joanna Polanska
- Department of Data Science and Engineering, The Silesian University of Technology, Gliwice, Poland
| |
Collapse
|
6
|
Subramanyam Rallabandi V, Seetharaman K. Classification of cognitively normal controls, mild cognitive impairment and Alzheimer’s disease using transfer learning approach. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
7
|
Multi-modality MRI for Alzheimer's disease detection using deep learning. Phys Eng Sci Med 2022; 45:1043-1053. [PMID: 36063346 DOI: 10.1007/s13246-022-01165-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 07/20/2022] [Indexed: 12/15/2022]
Abstract
Diffusion tensor imaging (DTI) is a new technology in magnetic resonance imaging, which allows us to observe the insightful structure of the human body in vivo and non-invasively. It identifies the microstructure of white matter (WM) connectivity by estimating the movement of water molecules at each voxel. This makes possible the identification of the damage to WM integrity caused by Alzheimer's disease (AD) at its early stage, called mild cognitive impairment (MCI). Furthermore, the brain's gray matter (GM) atrophy characterizes the main structural changes in AD, which can be sensitively detected by structural MRI (sMRI) modality. In this research, we aimed to classify the Alzheimer's diseases stages by developing a novel multi-modality MRI (DTI and sMRI) fusion strategy to detect WM alterations and GM atrophy in AD patients. The latter is based on a 2-dimensional deep convolutional neural network (CNN) features extractor and a support vector machine (SVM) classifier. The fusion framework consists of merging features extracted from DTI scalar metrics [(fractional anisotropy (FA) and mean diffusivity (MD)], and GM using 2D-CNN and feeding them to SVM to classify AD versus cognitively normal (CN), AD versus MCI, and MCI versus CN. Our novel multimodal AD method demonstrates a superior performance with an accuracy of 99.79%, 99.6%, and 97.00% for AD/CN, AD/MCI, and MCI/CN respectively.
Collapse
|
8
|
Kalkan H, Akkaya UM, Inal-Gültekin G, Sanchez-Perez AM. Prediction of Alzheimer’s Disease by a Novel Image-Based Representation of Gene Expression. Genes (Basel) 2022; 13:genes13081406. [PMID: 36011317 PMCID: PMC9407775 DOI: 10.3390/genes13081406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 08/03/2022] [Accepted: 08/04/2022] [Indexed: 11/16/2022] Open
Abstract
Early intervention can delay the progress of Alzheimer’s Disease (AD), but currently, there are no effective prediction tools. The goal of this study is to generate a reliable artificial intelligence (AI) model capable of detecting the high risk of AD, based on gene expression arrays from blood samples. To that end, a novel image-formation method is proposed to transform single-dimension gene expressions into a discriminative 2-dimensional (2D) image to use convolutional neural networks (CNNs) for classification. Three publicly available datasets were pooled, and a total of 11,618 common genes’ expression values were obtained. The genes were then categorized for their discriminating power using the Fisher distance (AD vs. control (CTL)) and mapped to a 2D image by linear discriminant analysis (LDA). Then, a six-layer CNN model with 292,493 parameters were used for classification. An accuracy of 0.842 and an area under curve (AUC) of 0.875 were achieved for the AD vs. CTL classification. The proposed method obtained higher accuracy and AUC compared with other reported methods. The conversion to 2D in CNN offers a unique advantage for improving accuracy and can be easily transferred to the clinic to drastically improve AD (or any disease) early detection.
Collapse
Affiliation(s)
- Habil Kalkan
- Department of Computer Engineering, Gebze Technical University, 41400 Kocaeli, Turkey
- Correspondence: (H.K.); (A.M.S.-P.)
| | - Umit Murat Akkaya
- Department of Computer Engineering, Gebze Technical University, 41400 Kocaeli, Turkey
| | - Güldal Inal-Gültekin
- Department of Physiology, Faculty of Medicine, Istanbul Okan University, 34959 Istanbul, Turkey
| | - Ana Maria Sanchez-Perez
- Faculty of Health Science and Institute of Advanced Materials (INAM), University Jaume I, 12071 Castellon, Spain
- Correspondence: (H.K.); (A.M.S.-P.)
| |
Collapse
|
9
|
Tu Y, Lin S, Qiao J, Zhuang Y, Zhang P. Alzheimer's disease diagnosis via multimodal feature fusion. Comput Biol Med 2022; 148:105901. [PMID: 35908497 DOI: 10.1016/j.compbiomed.2022.105901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/26/2022] [Accepted: 07/16/2022] [Indexed: 11/19/2022]
Abstract
Alzheimer's disease (AD) is the most common neurodegenerative disorder in the elderly. Early diagnosis of AD plays a vital role in slowing down the progress of AD because there is no effective drug to treat the disease. Some deep learning models have recently been presented for AD diagnosis and have more satisfactory performance than classic machine learning methods. Nevertheless, most of the existing computer-aided diagnostic models used neuroimaging features for diagnosis, ignoring patients' clinical and biological information. This makes the AD diagnosis inaccurate. In this study, we propose a novel multimodal feature transformation and fusion model for AD diagnosis. The feature transformation aims to avoid the difference in feature dimensions between different modal data and further mine the significant features for AD diagnosis. A geometric algebra-based feature extension method is proposed to obtain different levels of high-dimensional features from patients' clinical and personal biological data. Then, an influence degree-based feature filtration algorithm is proposed to filtrate those features that have no apparent guiding significance for AD diagnosis. Finally, an ANN (Artificial Neural Network)-based framework is designed to fuse transformed features with neuroimaging features extracted by CNN (Convolutional Neural Network) for AD diagnosis. The more in-depth feature mining of patients' clinical information and biological information can significantly improve the performance of computer-aided AD diagnosis. The experiments are obtained on the ADNI dataset. Our proposed model can converge faster and achieves 96.2% accuracy in AD diagnostic task and 87.4% accuracy in MCI (Mild Cognitive Impairment) diagnostic task. Compared with other methods, our proposed approach has an excellent performance in AD diagnosis and surpasses SOTA (state-of-the-art) methods. Therefore, our model can provide more reasonable suggestions for clinicians to diagnose and treat disease.
Collapse
Affiliation(s)
- Yue Tu
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Shukuan Lin
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Jianzhong Qiao
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Yilin Zhuang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Peng Zhang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
10
|
De Stefano N, Battaglini M, Pareto D, Cortese R, Zhang J, Oesingmann N, Prados F, Rocca MA, Valsasina P, Vrenken H, Gandini Wheeler-Kingshott CAM, Filippi M, Barkhof F, Rovira À. MAGNIMS recommendations for harmonization of MRI data in MS multicenter studies. Neuroimage Clin 2022; 34:102972. [PMID: 35245791 PMCID: PMC8892169 DOI: 10.1016/j.nicl.2022.102972] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Revised: 02/22/2022] [Accepted: 02/23/2022] [Indexed: 11/24/2022]
Abstract
Sharing data from cooperative studies is essential to develop new biomarkers in MS. Differences in MRI acquisition, analysis, storage represent a substantial constraint. We review the state of the art and developments in the harmonization of MRI. We provide recommendations to harmonize large MRI datasets in the MS field.
There is an increasing need of sharing harmonized data from large, cooperative studies as this is essential to develop new diagnostic and prognostic biomarkers. In the field of multiple sclerosis (MS), the issue has become of paramount importance due to the need to translate into the clinical setting some of the most recent MRI achievements. However, differences in MRI acquisition parameters, image analysis and data storage across sites, with their potential bias, represent a substantial constraint. This review focuses on the state of the art, recent technical advances, and desirable future developments of the harmonization of acquisition, analysis and storage of large-scale multicentre MRI data of MS cohorts. Huge efforts are currently being made to achieve all the requirements needed to provide harmonized MRI datasets in the MS field, as proper management of large imaging datasets is one of our greatest opportunities and challenges in the coming years. Recommendations based on these achievements will be provided here. Despite the advances that have been made, the complexity of these tasks requires further research by specialized academical centres, with dedicated technical and human resources. Such collective efforts involving different professional figures are of crucial importance to offer to MS patients a personalised management while minimizing consumption of resources.
Collapse
Affiliation(s)
- Nicola De Stefano
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy.
| | - Marco Battaglini
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Deborah Pareto
- Section of Neuroradiology, Department of Radiology, Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Rosa Cortese
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Jian Zhang
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | | | - Ferran Prados
- Queen Square Multiple Sclerosis Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom; Center for Medical Imaging Computing, Medical Physics and Biomedical Engineering, UCL, London, WC1V 6LJ, United Kingdom; e-Health Center, Universitat Oberta de Catalunya, Barcelona, Spain
| | - Maria A Rocca
- Neuroimaging Research Unit, Division of Neuroscience, and Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Vita-Salute San Raffaele University, Milan, Italy
| | - Paola Valsasina
- Neuroimaging Research Unit, Division of Neuroscience, and Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Hugo Vrenken
- Amsterdam Neuroscience, MS Center Amsterdam, Department of Radiology and Nuclear Medicine, Amsterdam UMC, Amsterdam, Netherlands
| | - Claudia A M Gandini Wheeler-Kingshott
- Queen Square Multiple Sclerosis Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom; Brain MRI 3T Research Center, C. Mondino National Neurological Institute, Pavia, Italy; Department of Brain and Behavioural Sciences, University of Pavia, Pavia, Italy
| | - Massimo Filippi
- Neuroimaging Research Unit, Division of Neuroscience, and Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Neurology Unit, IRCCS San Raffaele Scientific Institute, Milan, Italy; Vita-Salute San Raffaele University, Milan, Italy; Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy; Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Frederik Barkhof
- Queen Square Multiple Sclerosis Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, University College London, London, United Kingdom; Center for Medical Imaging Computing, Medical Physics and Biomedical Engineering, UCL, London, WC1V 6LJ, United Kingdom; Amsterdam Neuroscience, MS Center Amsterdam, Department of Radiology and Nuclear Medicine, Amsterdam UMC, Amsterdam, Netherlands
| | - Àlex Rovira
- Section of Neuroradiology, Department of Radiology, Hospital Universitari Vall d'Hebron, Universitat Autònoma de Barcelona, Barcelona, Spain
| |
Collapse
|
11
|
Frizzell TO, Glashutter M, Liu CC, Zeng A, Pan D, Hajra SG, D’Arcy RC, Song X. Artificial intelligence in brain MRI analysis of Alzheimer's disease over the past 12 years: A systematic review. Ageing Res Rev 2022; 77:101614. [PMID: 35358720 DOI: 10.1016/j.arr.2022.101614] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 03/02/2022] [Accepted: 03/24/2022] [Indexed: 12/17/2022]
Abstract
INTRODUCTION Multiple structural brain changes in Alzheimer's disease (AD) and mild cognitive impairment (MCI) have been revealed on magnetic resonance imaging (MRI). There is a fast-growing effort in applying artificial intelligence (AI) to analyze these data. Here, we review and evaluate the AI studies in brain MRI analysis with synthesis. METHODS A systematic review of the literature, spanning the years from 2009 to 2020, was completed using the PubMed database. AI studies using MRI imaging to investigate normal aging, mild cognitive impairment, and AD-dementia were retrieved for review. Bias assessment was completed using the PROBAST criteria. RESULTS 97 relevant studies were included in the review. The studies were typically focused on the classification of AD, MCI, and normal aging (71% of the reported studies) and the prediction of MCI conversion to AD (25%). The best performance was achieved by using the deep learning-based convolution neural network algorithms (weighted average accuracy 89%), in contrast to 76-86% using Logistic Regression, Support Vector Machines, and other AI methods. DISCUSSION The synthesized evidence is paramount to developing sophisticated AI approaches to reliably capture and quantify multiple subtle MRI changes in the whole brain that exemplify the complexity and heterogeneity of AD and brain aging.
Collapse
|
12
|
Qu C, Zou Y, Ma Y, Chen Q, Luo J, Fan H, Jia Z, Gong Q, Chen T. Diagnostic Performance of Generative Adversarial Network-Based Deep Learning Methods for Alzheimer’s Disease: A Systematic Review and Meta-Analysis. Front Aging Neurosci 2022; 14:841696. [PMID: 35527734 PMCID: PMC9068970 DOI: 10.3389/fnagi.2022.841696] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 03/03/2022] [Indexed: 12/28/2022] Open
Abstract
Alzheimer’s disease (AD) is the most common form of dementia. Currently, only symptomatic management is available, and early diagnosis and intervention are crucial for AD treatment. As a recent deep learning strategy, generative adversarial networks (GANs) are expected to benefit AD diagnosis, but their performance remains to be verified. This study provided a systematic review on the application of the GAN-based deep learning method in the diagnosis of AD and conducted a meta-analysis to evaluate its diagnostic performance. A search of the following electronic databases was performed by two researchers independently in August 2021: MEDLINE (PubMed), Cochrane Library, EMBASE, and Web of Science. The Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool was applied to assess the quality of the included studies. The accuracy of the model applied in the diagnosis of AD was determined by calculating odds ratios (ORs) with 95% confidence intervals (CIs). A bivariate random-effects model was used to calculate the pooled sensitivity and specificity with their 95% CIs. Fourteen studies were included, 11 of which were included in the meta-analysis. The overall quality of the included studies was high according to the QUADAS-2 assessment. For the AD vs. cognitively normal (CN) classification, the GAN-based deep learning method exhibited better performance than the non-GAN method, with significantly higher accuracy (OR 1.425, 95% CI: 1.150–1.766, P = 0.001), pooled sensitivity (0.88 vs. 0.83), pooled specificity (0.93 vs. 0.89), and area under the curve (AUC) of the summary receiver operating characteristic curve (SROC) (0.96 vs. 0.93). For the progressing MCI (pMCI) vs. stable MCI (sMCI) classification, the GAN method exhibited no significant increase in the accuracy (OR 1.149, 95% CI: 0.878–1.505, P = 0.310) or the pooled sensitivity (0.66 vs. 0.66). The pooled specificity and AUC of the SROC in the GAN group were slightly higher than those in the non-GAN group (0.81 vs. 0.78 and 0.81 vs. 0.80, respectively). The present results suggested that the GAN-based deep learning method performed well in the task of AD vs. CN classification. However, the diagnostic performance of GAN in the task of pMCI vs. sMCI classification needs to be improved. Systematic Review Registration: [PROSPERO], Identifier: [CRD42021275294].
Collapse
Affiliation(s)
- Changxing Qu
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
- State Key Laboratory of Oral Diseases, National Clinical Research Center for Oral Diseases, West China School of Stomatology, Sichuan University, Chengdu, China
| | - Yinxi Zou
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
- West China School of Medicine, Sichuan University, Chengdu, China
| | - Yingqiao Ma
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
| | - Qin Chen
- Department of Neurology, West China Hospital, Sichuan University, Chengdu, China
| | - Jiawei Luo
- West China Biomedical Big Data Center, West China Clinical Medical College of Sichuan University, Chengdu, China
| | - Huiyong Fan
- College of Education Science, Bohai University, Jinzhou, China
| | - Zhiyun Jia
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
| | - Qiyong Gong
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
- Department of Radiology, West China Xiamen Hospital of Sichuan University, Xiamen, China
- Qiyong Gong,
| | - Taolin Chen
- Huaxi MR Research Center (HMRRC), Department of Radiology, West China Hospital, Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Functional and Molecular Imaging Key Laboratory of Sichuan Province, Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
- *Correspondence: Taolin Chen,
| |
Collapse
|
13
|
Keenan KE, Delfino JG, Jordanova KV, Poorman ME, Chirra P, Chaudhari AS, Baessler B, Winfield J, Viswanath SE, deSouza NM. Challenges in ensuring the generalizability of image quantitation methods for MRI. Med Phys 2022; 49:2820-2835. [PMID: 34455593 PMCID: PMC8882689 DOI: 10.1002/mp.15195] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 08/17/2021] [Accepted: 08/17/2021] [Indexed: 01/31/2023] Open
Abstract
Image quantitation methods including quantitative MRI, multiparametric MRI, and radiomics offer great promise for clinical use. However, many of these methods have limited clinical adoption, in part due to issues of generalizability, that is, the ability to translate methods and models across institutions. Researchers can assess generalizability through measurement of repeatability and reproducibility, thus quantifying different aspects of measurement variance. In this article, we review the challenges to ensuring repeatability and reproducibility of image quantitation methods as well as present strategies to minimize their variance to enable wider clinical implementation. We present possible solutions for achieving clinically acceptable performance of image quantitation methods and briefly discuss the impact of minimizing variance and achieving generalizability towards clinical implementation and adoption.
Collapse
Affiliation(s)
- Kathryn E. Keenan
- Physical Measurement Laboratory, National Institute of Standards and Technology, 325 Broadway, Boulder, CO 80305, USA
| | - Jana G. Delfino
- Center for Devices and Radiological Health, US Food and Drug Administration, 10993 New Hampshire Ave, Silver Spring, MD 20993, USA
| | - Kalina V. Jordanova
- Physical Measurement Laboratory, National Institute of Standards and Technology, 325 Broadway, Boulder, CO 80305, USA
| | - Megan E. Poorman
- Physical Measurement Laboratory, National Institute of Standards and Technology, 325 Broadway, Boulder, CO 80305, USA
| | - Prathyush Chirra
- Dept of Biomedical Engineering, Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH 44106, USA
| | - Akshay S. Chaudhari
- Department of Radiology, Stanford University, 450 Serra Mall, Stanford, CA 94305, USA
- Department of Biomedical Data Science, Stanford University, 450 Serra Mall, Stanford, CA 94305, USA
| | - Bettina Baessler
- University Hospital of Zurich and University of Zurich, Raemistrasse 100, 8091 Zurich, Switzerland
| | - Jessica Winfield
- Cancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, 123 Old Brompton Road, London, SW7 3RP, UK
- MRI Unit, Royal Marsden NHS Foundation Trust, Downs Road, Sutton, Surrey, SM2 5PT, UK
| | - Satish E. Viswanath
- Dept of Biomedical Engineering, Case Western Reserve University, 10900 Euclid Ave, Cleveland, OH 44106, USA
| | - Nandita M. deSouza
- Cancer Research UK Cancer Imaging Centre, Division of Radiotherapy and Imaging, The Institute of Cancer Research, 123 Old Brompton Road, London, SW7 3RP, UK
- MRI Unit, Royal Marsden NHS Foundation Trust, Downs Road, Sutton, Surrey, SM2 5PT, UK
| |
Collapse
|
14
|
Deepa N, Chokkalingam S. Optimization of VGG16 utilizing the Arithmetic Optimization Algorithm for early detection of Alzheimer’s disease. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103455] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
15
|
Machine Learning Framework for the Prediction of Alzheimer’s Disease Using Gene Expression Data Based on Efficient Gene Selection. Symmetry (Basel) 2022. [DOI: 10.3390/sym14030491] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
In recent years, much research has focused on using machine learning (ML) for disease prediction based on gene expression (GE) data. However, many diseases have received considerable attention, whereas some, including Alzheimer’s disease (AD), have not, perhaps due to data shortage. The present work is intended to fill this gap by introducing a symmetric framework to predict AD from GE data, with the aim to produce the most accurate prediction using the smallest number of genes. The framework works in four stages after it receives a training dataset: pre-processing, gene selection (GS), classification, and AD prediction. The symmetry of the model is manifested in all of its stages. In the pre-processing stage gene columns in the training dataset are pre-processed identically. In the GS stage, the same user-defined filter metrics are invoked on every gene individually, and so are the same user-defined wrapper metrics. In the classification stage, a number of user-defined ML models are applied identically using the minimal set of genes selected in the preceding stage. The core of the proposed framework is a meticulous GS algorithm which we have designed to nominate eight subsets of the original set of genes provided in the training dataset. Exploring the eight subsets, the algorithm selects the best one to describe AD, and also the best ML model to predict the disease using this subset. For credible results, the framework calculates performance metrics using repeated stratified k-fold cross validation. To evaluate the framework, we used an AD dataset of 1157 cases and 39,280 genes, obtained by combining a number of smaller public datasets. The cases were split in two partitions, 1000 for training/testing, using 10-fold CV repeated 30 times, and 157 for validation. From the testing/training phase, the framework identified only 1058 genes to be the most relevant and the support vector machine (SVM) model to be the most accurate with these genes. In the final validation, we used the 157 cases that were never seen by the SVM classifier. For credible performance evaluation, we evaluated the classifier via six metrics, for which we obtained impressive values. Specifically, we obtained 0.97, 0.97, 0.98, 0.945, 0.972, and 0.975 for the sensitivity (recall), specificity, precision, kappa index, AUC, and accuracy, respectively.
Collapse
|
16
|
Li R, Wang X, Lawler K, Garg S, Bai Q, Alty J. Applications of Artificial Intelligence to aid detection of dementia: a scoping review on current capabilities and future directions. J Biomed Inform 2022; 127:104030. [DOI: 10.1016/j.jbi.2022.104030] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 01/21/2022] [Accepted: 02/12/2022] [Indexed: 12/17/2022]
|
17
|
Sethi M, Ahuja S, Rani S, Koundal D, Zaguia A, Enbeyle W. An Exploration: Alzheimer's Disease Classification Based on Convolutional Neural Network. BIOMED RESEARCH INTERNATIONAL 2022; 2022:8739960. [PMID: 35103240 PMCID: PMC8800619 DOI: 10.1155/2022/8739960] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 12/08/2021] [Indexed: 12/15/2022]
Abstract
Alzheimer's disease (AD) is the most generally known neurodegenerative disorder, leading to a steady deterioration in cognitive ability. Deep learning models have shown outstanding performance in the diagnosis of AD, and these models do not need any handcrafted feature extraction over conventional machine learning algorithms. Since the 2012 AlexNet accomplishment, the convolutional neural network (CNN) has been progressively utilized by the medical community to assist practitioners to early diagnose AD. This paper explores the current cutting edge applications of CNN on single and multimodality (combination of two or more modalities) neuroimaging data for the classification of AD. An exhaustive systematic search is conducted on four notable databases: Google Scholar, IEEE Xplore, ACM Digital Library, and PubMed in June 2021. The objective of this study is to examine the effectiveness of classification approaches on AD to analyze different kinds of datasets, neuroimaging modalities, preprocessing techniques, and data handling methods. However, CNN has achieved great success in the classification of AD; still, there are a lot of challenges particularly due to scarcity of medical imaging data and its possible scope in this field.
Collapse
Affiliation(s)
- Monika Sethi
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India
| | - Sachin Ahuja
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India
| | - Shalli Rani
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India
| | - Deepika Koundal
- Department of Systemics, School of Computer Science, University of Petroleum and Energy Studies, Dehradun, India
| | - Atef Zaguia
- Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. BOX 11099, Taif 21944, Saudi Arabia
| | | |
Collapse
|
18
|
Quesada J, Sathidevi L, Liu R, Ahad N, Jackson JM, Azabou M, Xiao J, Liding C, Jin M, Urzay C, Gray-Roncal W, Johnson EC, Dyer EL. MTNeuro: A Benchmark for Evaluating Representations of Brain Structure Across Multiple Levels of Abstraction. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2022; 35:5299-5314. [PMID: 38414814 PMCID: PMC10898440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 02/29/2024]
Abstract
There are multiple scales of abstraction from which we can describe the same image, depending on whether we are focusing on fine-grained details or a more global attribute of the image. In brain mapping, learning to automatically parse images to build representations of both small-scale features (e.g., the presence of cells or blood vessels) and global properties of an image (e.g., which brain region the image comes from) is a crucial and open challenge. However, most existing datasets and benchmarks for neuroanatomy consider only a single downstream task at a time. To bridge this gap, we introduce a new dataset, annotations, and multiple downstream tasks that provide diverse ways to readout information about brain structure and architecture from the same image. Our multi-task neuroimaging benchmark (MTNeuro) is built on volumetric, micrometer-resolution X-ray microtomography images spanning a large thalamocortical section of mouse brain, encompassing multiple cortical and subcortical regions. We generated a number of different prediction challenges and evaluated several supervised and self-supervised models for brain-region prediction and pixel-level semantic segmentation of microstructures. Our experiments not only highlight the rich heterogeneity of this dataset, but also provide insights into how self-supervised approaches can be used to learn representations that capture multiple attributes of a single image and perform well on a variety of downstream tasks. Datasets, code, and pre-trained baseline models are provided at: https://mtneuro.github.io/.
Collapse
Affiliation(s)
| | | | - Ran Liu
- Georgia Institute of Technology
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
19
|
Sethi M, Ahuja S, Rani S, Bawa P, Zaguia A. Classification of Alzheimer's Disease Using Gaussian-Based Bayesian Parameter Optimization for Deep Convolutional LSTM Network. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:4186666. [PMID: 34646334 PMCID: PMC8505090 DOI: 10.1155/2021/4186666] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2021] [Revised: 09/21/2021] [Accepted: 09/22/2021] [Indexed: 01/22/2023]
Abstract
Alzheimer's disease (AD) is one of the most important causes of mortality in elderly people, and it is often challenging to use traditional manual procedures when diagnosing a disease in the early stages. The successful implementation of machine learning (ML) techniques has also shown their effectiveness and its reliability as one of the better options for an early diagnosis of AD. But the heterogeneous dimensions and composition of the disease data have undoubtedly made diagnostics more difficult, needing a sufficient model choice to overcome the difficulty. Therefore, in this paper, four different 2D and 3D convolutional neural network (CNN) frameworks based on Bayesian search optimization are proposed to develop an optimized deep learning model to predict the early onset of AD binary and ternary classification on magnetic resonance imaging (MRI) scans. Moreover, certain hyperparameters such as learning rate, optimizers, and hidden units are to be set and adjusted for the performance boosting of the deep learning model. Bayesian optimization enables to leverage advantage throughout the experiments: A persistent hyperparameter space testing provides not only the output but also about the nearest conclusions. In this way, the series of experiments needed to explore space can be substantially reduced. Finally, alongside the use of Bayesian approaches, long short-term memory (LSTM) through the process of augmentation has resulted in finding the better settings of the model that too in less iterations with an relative improvement (RI) of 7.03%, 12.19%, 10.80%, and 11.99% over the four systems optimized with manual hyperparameters tuning such that hyperparameters that look more appealing from past data as well as the conventional techniques of manual selection.
Collapse
Affiliation(s)
- Monika Sethi
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, India
| | - Sachin Ahuja
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, India
| | - Shalli Rani
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, India
| | - Puneet Bawa
- Centre of Excellence for Speech and Multimodal Laboratory, Chitkara University Institute of Engineering & Technology, Chitkara University, Punjab, India
| | - Atef Zaguia
- Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
| |
Collapse
|
20
|
Perez-Gonzalez J, Jiménez-Ángeles L, Rojas Saavedra K, Barbará Morales E, Medina-Bañuelos V. Mild cognitive impairment classification using combined structural and diffusion imaging biomarkers. Phys Med Biol 2021; 66. [PMID: 34167090 DOI: 10.1088/1361-6560/ac0e77] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 06/24/2021] [Indexed: 11/11/2022]
Abstract
Alzheimer's disease is a multifactorial neurodegenerative disorder preceded by a prodromal stage called mild cognitive impairment (MCI). Early diagnosis of MCI is crucial for delaying the progression and optimizing the treatment. In this study we propose a random forest (RF) classifier to distinguish between MCI and healthy control subjects (HC), identifying the most relevant features computed from structural T1-weighted and diffusion-weighted magnetic resonance images (sMRI and DWI), combined with neuro-psychological scores. To train the RF we used a set of 60 subjects (HC = 30, MCI = 30) drawn from the Alzheimer's disease neuroimaging initiative database, while testing with unseen data was carried out on a 23-subjects Mexican cohort (HC = 12, MCI = 11). Features from hippocampus, thalamus and amygdala, for left and right hemispheres were fed to the RF, with the most relevant being previously selected by applying extra trees classifier and the mean decrease in impurity index. All the analyzed brain structures presented changes in sMRI and DWI features for MCI, but those computed from sMRI contribute the most to distinguish from HC. However, sMRI+DWI improves classification performance in training area under the receiver operating characteristic curve (AUROC = 93.5 ± 8%, accuracy = 88.8 ± 9%) and testing with unseen data (AUROC = 93.79%, accuracy = 91.3%), having a better performance when neuro-psychological scores were included. Compared to other classifiers the proposed RF provide the best performance for HC/MCI discrimination and the application of a feature selection step improves its performance. These findings imply that multimodal analysis gives better results than unimodal analysis and hence may be a useful tool to assist in early MCI diagnosis.
Collapse
Affiliation(s)
- Jorge Perez-Gonzalez
- Unidad Académica del Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas en el Estado de Yucatán, UNAM, Yucatán, México
| | - Luis Jiménez-Ángeles
- Department of Biomedical Systems Engineering, Engineering Faculty, UNAM, Mexico City, México
| | - Karla Rojas Saavedra
- Health Sciences Department, Universidad del Valle de México, Mexico City, México
| | | | | |
Collapse
|
21
|
续 宝, 丁 冲, 徐 桂. [Research on the application of convolution neural network in the diagnosis of Alzheimer's disease]. SHENG WU YI XUE GONG CHENG XUE ZA ZHI = JOURNAL OF BIOMEDICAL ENGINEERING = SHENGWU YIXUE GONGCHENGXUE ZAZHI 2021; 38:169-177. [PMID: 33899442 PMCID: PMC10307567 DOI: 10.7507/1001-5515.202007019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 11/24/2020] [Indexed: 11/03/2022]
Abstract
With the wide application of deep learning technology in disease diagnosis, especially the outstanding performance of convolutional neural network (CNN) in computer vision and image processing, more and more studies have proposed to use this algorithm to achieve the classification of Alzheimer's disease (AD), mild cognitive impairment (MCI) and normal cognition (CN). This article systematically reviews the application progress of several classic convolutional neural network models in brain image analysis and diagnosis at different stages of Alzheimer's disease, and discusses the existing problems and gives the possible development directions in order to provide some references.
Collapse
Affiliation(s)
- 宝红 续
- 河北工业大学 天津市生物电工与智能健康重点实验室(天津 300130)Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin 300130, P.R.China
- 河北工业大学 省部共建电工装备可靠性与智能化国家重点实验室(天津 300130)State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, P.R.China
| | - 冲 丁
- 河北工业大学 天津市生物电工与智能健康重点实验室(天津 300130)Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin 300130, P.R.China
- 河北工业大学 省部共建电工装备可靠性与智能化国家重点实验室(天津 300130)State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, P.R.China
| | - 桂芝 徐
- 河北工业大学 天津市生物电工与智能健康重点实验室(天津 300130)Tianjin Key Laboratory of Bioelectromagnetic Technology and Intelligent Health, Hebei University of Technology, Tianjin 300130, P.R.China
- 河北工业大学 省部共建电工装备可靠性与智能化国家重点实验室(天津 300130)State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin 300130, P.R.China
| |
Collapse
|
22
|
Ahmed S, Kim BC, Lee KH, Jung HY. Ensemble of ROI-based convolutional neural network classifiers for staging the Alzheimer disease spectrum from magnetic resonance imaging. PLoS One 2020; 15:e0242712. [PMID: 33290403 PMCID: PMC7723284 DOI: 10.1371/journal.pone.0242712] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2020] [Accepted: 11/07/2020] [Indexed: 11/26/2022] Open
Abstract
Patches from three orthogonal views of selected cerebral regions can be utilized to learn convolutional neural network (CNN) models for staging the Alzheimer disease (AD) spectrum including preclinical AD, mild cognitive impairment due to AD, and dementia due to AD and normal controls. Hippocampi, amygdalae and insulae were selected from the volumetric analysis of structured magnetic resonance images (MRIs). Three-view patches (TVPs) from these regions were fed to the CNN for training. MRIs were classified with the SoftMax-normalized scores of individual model predictions on TVPs. The significance of each region of interest (ROI) for staging the AD spectrum was evaluated and reported. The results of the ensemble classifier are compared with state-of-the-art methods using the same evaluation metrics. Patch-based ROI ensembles provide comparable diagnostic performance for AD staging. In this work, TVP-based ROI analysis using a CNN provides informative landmarks in cerebral MRIs and may have significance in clinical studies and computer-aided diagnosis system design.
Collapse
Affiliation(s)
- Samsuddin Ahmed
- Department of Computer Engineering, Chosun University, Gwangju, South Korea
| | - Byeong C. Kim
- Gwangju Alzheimer’s disease and Related Dementias Cohort Research Center, Chosun University, Gwangju, Korea
- Department of Neurology, Chonnam National University Medical School, Gwangju, South Korea
| | - Kun Ho Lee
- Gwangju Alzheimer’s disease and Related Dementias Cohort Research Center, Chosun University, Gwangju, Korea
- Department of Biomedical Science, Chosun University, Gwangju, South Korea
- Korea Brain Research Institute, Daegu, Korea
| | - Ho Yub Jung
- Department of Computer Engineering, Chosun University, Gwangju, South Korea
| | | |
Collapse
|
23
|
Ljubic B, Roychoudhury S, Cao XH, Pavlovski M, Obradovic S, Nair R, Glass L, Obradovic Z. Influence of medical domain knowledge on deep learning for Alzheimer's disease prediction. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 197:105765. [PMID: 33011665 PMCID: PMC7502243 DOI: 10.1016/j.cmpb.2020.105765] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 09/16/2020] [Indexed: 05/03/2023]
Abstract
BACKGROUND AND OBJECTIVE Alzheimer's disease (AD) is the most common type of dementia that can seriously affect a person's ability to perform daily activities. Estimates indicate that AD may rank third as a cause of death for older people, after heart disease and cancer. Identification of individuals at risk for developing AD is imperative for testing therapeutic interventions. The objective of the study was to determine could diagnostics of AD from EMR data alone (without relying on diagnostic imaging) be significantly improved by applying clinical domain knowledge in data preprocessing and positive dataset selection rather than setting naïve filters. METHODS Data were extracted from the repository of heterogeneous ambulatory EMR data, collected from primary care medical offices all over the U.S. Medical domain knowledge was applied to build a positive dataset from data relevant to AD. Selected Clinically Relevant Positive (SCRP) datasets were used as inputs to a Long-Short-Term Memory (LSTM) Recurrent Neural Network (RNN) deep learning model to predict will the patient develop AD. RESULTS Risk scores prediction of AD using the drugs domain information in an SCRP AD dataset of 2,324 patients achieved high out-of-sample score - 0.98-0.99 Area Under the Precision-Recall Curve (AUPRC) when using 90% of SCRP dataset for training. AUPRC dropped to 0.89 when training the model using less than 1,500 cases from the SCRP dataset. The model was still significantly better than when using naïve dataset selection. CONCLUSION The LSTM RNN method that used data relevant to AD performed significantly better when learning from the SCRP dataset than when datasets were selected naïvely. The integration of qualitative medical knowledge for dataset selection and deep learning technology provided a mechanism for significant improvement of AD prediction. Accurate and early prediction of AD is significant in the identification of patients for clinical trials, which can possibly result in the discovery of new drugs for treatments of AD. Also, the contribution of the proposed predictions of AD is a better selection of patients who need imaging diagnostics for differential diagnosis of AD from other degenerative brain disorders.
Collapse
Affiliation(s)
- Branimir Ljubic
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Shoumik Roychoudhury
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Xi Hang Cao
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Martin Pavlovski
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Stefan Obradovic
- Department of Computer Science, Brendan Iribe Center for Computer Science and Engineering, University of Maryland, 8125 Paint Branch Drive, College Park, MD 20742, USA
| | | | | | - Zoran Obradovic
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA.
| |
Collapse
|
24
|
Lee P, Kim HR, Jeong Y. Detection of gray matter microstructural changes in Alzheimer's disease continuum using fiber orientation. BMC Neurol 2020; 20:362. [PMID: 33008321 PMCID: PMC7532608 DOI: 10.1186/s12883-020-01939-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Accepted: 09/23/2020] [Indexed: 12/19/2022] Open
Abstract
BACKGROUND This study aimed to investigate feasible gray matter microstructural biomarkers with high sensitivity for early Alzheimer's disease (AD) detection. We propose a diffusion tensor imaging (DTI) measure, "radiality", as an early AD biomarker. It is the dot product of the normal vector of the cortical surface and primary diffusion direction, which reflects the fiber orientation within the cortical column. METHODS We analyzed neuroimages from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database, including images from 78 cognitively normal (CN), 50 early mild cognitive impairment (EMCI), 34 late mild cognitive impairment (LMCI), and 39 AD patients. We then evaluated the cortical thickness (CTh), mean diffusivity (MD), which are conventional AD magnetic resonance imaging (MRI) biomarkers, and the amount of accumulated amyloid and tau using positron emission tomography (PET). Radiality was projected on the gray matter surface to compare and validate the changes with different stages alongside other neuroimage biomarkers. RESULTS The results revealed decreased radiality primarily in the entorhinal, insula, frontal, and temporal cortex with further progression of disease. In particular, radiality could delineate the difference between the CN and EMCI groups, while the other biomarkers could not. We examined the relationship between radiality and other biomarkers to validate its pathological evidence in AD. Overall, radiality showed a high association with conventional biomarkers. Additional ROI analysis revealed the dynamics of AD-related changes as stages onward. CONCLUSION Radiality in cortical gray matter showed AD-specific changes and relevance with other conventional AD biomarkers with high sensitivity. Moreover, radiality could identify the group differences seen in EMCI, representative of changes in early AD, which supports its superiority in early diagnosis compared to that possible with conventional biomarkers. We provide evidence of structural changes with cognitive impairment and suggest radiality as a sensitive biomarker for identifying early AD.
Collapse
Affiliation(s)
- Peter Lee
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daehak-ro 291, Yuseong-gu, Daejeon, 34141, Republic of Korea
- KI for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Hang-Rai Kim
- KI for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Yong Jeong
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daehak-ro 291, Yuseong-gu, Daejeon, 34141, Republic of Korea.
- KI for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.
- Graduate School of Medical Science and Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea.
| |
Collapse
|
25
|
Machine Learning for the Classification of Alzheimer’s Disease and Its Prodromal Stage Using Brain Diffusion Tensor Imaging Data: A Systematic Review. Processes (Basel) 2020. [DOI: 10.3390/pr8091071] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
Alzheimer’s disease is notoriously the most common cause of dementia in the elderly, affecting an increasing number of people. Although widespread, its causes and progression modalities are complex and still not fully understood. Through neuroimaging techniques, such as diffusion Magnetic Resonance (MR), more sophisticated and specific studies of the disease can be performed, offering a valuable tool for both its diagnosis and early detection. However, processing large quantities of medical images is not an easy task, and researchers have turned their attention towards machine learning, a set of computer algorithms that automatically adapt their output towards the intended goal. In this paper, a systematic review of recent machine learning applications on diffusion tensor imaging studies of Alzheimer’s disease is presented, highlighting the fundamental aspects of each work and reporting their performance score. A few examined studies also include mild cognitive impairment in the classification problem, while others combine diffusion data with other sources, like structural magnetic resonance imaging (MRI) (multimodal analysis). The findings of the retrieved works suggest a promising role for machine learning in evaluating effective classification features, like fractional anisotropy, and in possibly performing on different image modalities with higher accuracy.
Collapse
|