1
|
Hassan N, Musa Miah AS, Shin J. Residual-Based Multi-Stage Deep Learning Framework for Computer-Aided Alzheimer's Disease Detection. J Imaging 2024; 10:141. [PMID: 38921618 PMCID: PMC11204904 DOI: 10.3390/jimaging10060141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Revised: 06/06/2024] [Accepted: 06/06/2024] [Indexed: 06/27/2024] Open
Abstract
Alzheimer's Disease (AD) poses a significant health risk globally, particularly among the elderly population. Recent studies underscore its prevalence, with over 50% of elderly Japanese facing a lifetime risk of dementia, primarily attributed to AD. As the most prevalent form of dementia, AD gradually erodes brain cells, leading to severe neurological decline. In this scenario, it is important to develop an automatic AD-detection system, and many researchers have been working to develop an AD-detection system by taking advantage of the advancement of deep learning (DL) techniques, which have shown promising results in various domains, including medical image analysis. However, existing approaches for AD detection often suffer from limited performance due to the complexities associated with training hierarchical convolutional neural networks (CNNs). In this paper, we introduce a novel multi-stage deep neural network architecture based on residual functions to address the limitations of existing AD-detection approaches. Inspired by the success of residual networks (ResNets) in image-classification tasks, our proposed system comprises five stages, each explicitly formulated to enhance feature effectiveness while maintaining model depth. Following feature extraction, a deep learning-based feature-selection module is applied to mitigate overfitting, incorporating batch normalization, dropout and fully connected layers. Subsequently, machine learning (ML)-based classification algorithms, including Support Vector Machines (SVM), Random Forest (RF) and SoftMax, are employed for classification tasks. Comprehensive evaluations conducted on three benchmark datasets, namely ADNI1: Complete 1Yr 1.5T, MIRAID and OASIS Kaggle, demonstrate the efficacy of our proposed model. Impressively, our model achieves accuracy rates of 99.47%, 99.10% and 99.70% for ADNI1: Complete 1Yr 1.5T, MIRAID and OASIS datasets, respectively, outperforming existing systems in binary class problems. Our proposed model represents a significant advancement in the AD-analysis domain.
Collapse
Affiliation(s)
- Najmul Hassan
- School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Japan;
| | | | - Jungpil Shin
- School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Japan;
| |
Collapse
|
2
|
Dakdareh SG, Abbasian K. Diagnosis of Alzheimer's Disease and Mild Cognitive Impairment Using Convolutional Neural Networks. J Alzheimers Dis Rep 2024; 8:317-328. [PMID: 38405350 PMCID: PMC10894608 DOI: 10.3233/adr-230118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Accepted: 01/04/2024] [Indexed: 02/27/2024] Open
Abstract
Background Alzheimer's disease and mild cognitive impairment are common diseases in the elderly, affecting more than 50 million people worldwide in 2020. Early diagnosis is crucial for managing these diseases, but their complexity poses a challenge. Convolutional neural networks have shown promise in accurate diagnosis. Objective The main objective of this research is to diagnose Alzheimer's disease and mild cognitive impairment in healthy individuals using convolutional neural networks. Methods This study utilized three different convolutional neural network models, two of which were pre-trained models, namely AlexNet and DenseNet, while the third model was a CNN1D-LSTM neural network. Results Among the neural network models used, the AlexNet demonstrated the highest accuracy, exceeding 98%, in diagnosing mild cognitive impairment and Alzheimer's disease in healthy individuals. Furthermore, the accuracy of the DenseNet and CNN1D-LSTM models is 88% and 91.89%, respectively. Conclusions The research highlights the potential of convolutional neural networks in diagnosing mild cognitive impairment and Alzheimer's disease. The use of pre-trained neural networks and the integration of various patient data contribute to achieving accurate results. The high accuracy achieved by the AlexNet neural network underscores its effectiveness in disease classification. These findings pave the way for future research and improvements in the field of diagnosing these diseases using convolutional neural networks, ultimately aiding in early detection and effective management of mild cognitive impairment and Alzheimer's disease.
Collapse
Affiliation(s)
| | - Karim Abbasian
- Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran
| |
Collapse
|
3
|
Dai Y, Hsu YC, Fernandes BS, Zhang K, Li X, Enduru N, Liu A, Manuel AM, Jiang X, Zhao Z. Disentangling Accelerated Cognitive Decline from the Normal Aging Process and Unraveling Its Genetic Components: A Neuroimaging-Based Deep Learning Approach. J Alzheimers Dis 2024; 97:1807-1827. [PMID: 38306043 DOI: 10.3233/jad-231020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2024]
Abstract
Background The progressive cognitive decline, an integral component of Alzheimer's disease (AD), unfolds in tandem with the natural aging process. Neuroimaging features have demonstrated the capacity to distinguish cognitive decline changes stemming from typical brain aging and AD between different chronological points. Objective To disentangle the normal aging effect from the AD-related accelerated cognitive decline and unravel its genetic components using a neuroimaging-based deep learning approach. Methods We developed a deep-learning framework based on a dual-loss Siamese ResNet network to extract fine-grained information from the longitudinal structural magnetic resonance imaging (MRI) data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study. We then conducted genome-wide association studies (GWAS) and post-GWAS analyses to reveal the genetic basis of AD-related accelerated cognitive decline. Results We used our model to process data from 1,313 individuals, training it on 414 cognitively normal people and predicting cognitive assessment for all participants. In our analysis of accelerated cognitive decline GWAS, we identified two genome-wide significant loci: APOE locus (chromosome 19 p13.32) and rs144614292 (chromosome 11 p15.1). Variant rs144614292 (G > T) has not been reported in previous AD GWA studies. It is within the intronic region of NELL1, which is expressed in neurons and plays a role in controlling cell growth and differentiation. The cell-type-specific enrichment analysis and functional enrichment of GWAS signals highlighted the microglia and immune-response pathways. Conclusions Our deep learning model effectively extracted relevant neuroimaging features and predicted individual cognitive decline. We reported a novel variant (rs144614292) within the NELL1 gene.
Collapse
Affiliation(s)
- Yulin Dai
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Yu-Chun Hsu
- Center for Secure Artificial Intelligence for Healthcare, School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Brisa S Fernandes
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Kai Zhang
- Center for Secure Artificial Intelligence for Healthcare, School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Xiaoyang Li
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
- Department of Biostatistics and Data Science, School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Nitesh Enduru
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
- Department of Epidemiology, Human Genetics and Environmental Sciences, School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Andi Liu
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
- Department of Epidemiology, Human Genetics and Environmental Sciences, School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Astrid M Manuel
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Xiaoqian Jiang
- Center for Secure Artificial Intelligence for Healthcare, School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Zhongming Zhao
- Center for Precision Health, McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, USA
- Department of Epidemiology, Human Genetics and Environmental Sciences, School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX, USA
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
4
|
Wang K, Theeke LA, Liao C, Wang N, Lu Y, Xiao D, Xu C. Deep learning analysis of UPLC-MS/MS-based metabolomics data to predict Alzheimer's disease. J Neurol Sci 2023; 453:120812. [PMID: 37776718 DOI: 10.1016/j.jns.2023.120812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 08/22/2023] [Accepted: 09/14/2023] [Indexed: 10/02/2023]
Abstract
OBJECTIVE Metabolic biomarkers can potentially inform disease progression in Alzheimer's disease (AD). The purpose of this study is to identify and describe a new set of diagnostic biomarkers for developing deep learning (DL) tools to predict AD using Ultra Performance Liquid Chromatography Mass Spectrometry (UPLC-MS/MS)-based metabolomics data. METHODS A total of 177 individuals, including 78 with AD and 99 with cognitive normal (CN), were selected from the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort along with 150 metabolomic biomarkers. We performed feature selection using the Least Absolute Shrinkage and Selection Operator (LASSO). The H2O DL function was used to build multilayer feedforward neural networks to predict AD. RESULTS The LASSO selected 21 metabolic biomarkers. To develop DL models, the 21 biomarkers identified by LASSO were imported into the H2O package. The data was split into 70% for training and 30% for validation. The best DL model with two layers and 18 neurons achieved an accuracy of 0.881, F1-score of 0.892, and AUC of 0.873. Several metabolomic biomarkers involved in glucose and lipid metabolism, in particular bile acid metabolites, were associated with APOE-ε4 allele and clinical biomarkers (Aβ42, tTau, pTau), cognitive assessments [the Alzheimer's Disease Assessment Scale-cognitive subscale 13 (ADAS13), the Mini-Mental State Examination (MMSE)], and hippocampus volume. CONCLUSIONS This study identified a new set of diagnostic metabolomic biomarkers for developing DL tools to predict AD. These biomarkers may help with early diagnosis, prognostic risk stratification, and/or early treatment interventions for patients at risk for AD.
Collapse
Affiliation(s)
- Kesheng Wang
- School of Nursing, Health Sciences Center, West Virginia University, Morgantown, WV 26506, USA.
| | - Laurie A Theeke
- School of Nursing, The George Washington University, Ashburn, VA 20147, USA
| | - Christopher Liao
- Department of Electrical and Computer Engineering, Boston University, MA 02215, USA
| | - Nianyang Wang
- Department of Health Policy and Management, School of Public Health, University of Maryland, College Park, MD 20742, USA
| | - Yongke Lu
- Department of Biomedical Sciences, Joan C. Edwards School of Medicine, Marshall University, Huntington, WV 25755, USA
| | - Danqing Xiao
- Department of STEM, School of Arts and Sciences, Regis College, Weston, MA 02493, USA
| | - Chun Xu
- Department of Health and Biomedical Sciences, College of Health Professions, University of Texas Rio Grande Valley, Brownsville, TX 78520, USA.
| |
Collapse
|
5
|
Dai Y, Yu-Chun H, Fernandes BS, Zhang K, Xiaoyang L, Enduru N, Liu A, Manuel AM, Jiang X, Zhao Z. Disentangling accelerated cognitive decline from the normal aging process and unraveling its genetic components: A neuroimaging-based deep learning approach. RESEARCH SQUARE 2023:rs.3.rs-3328861. [PMID: 37720047 PMCID: PMC10503860 DOI: 10.21203/rs.3.rs-3328861/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
Background The progressive cognitive decline that is an integral component of AD unfolds in tandem with the natural aging process. Neuroimaging features have demonstrated the capacity to distinguish cognitive decline changes stemming from typical brain aging and Alzheimer's disease between different chronological points. Methods We developed a deep-learning framework based on dual-loss Siamese ResNet network to extract fine-grained information from the longitudinal structural magnetic resonance imaging (MRI) data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study. We then conducted genome-wide association studies (GWAS) and post-GWAS analyses to reveal the genetic basis of AD-related accelerated cognitive decline. Results We used our model to process data from 1,313 individuals, training it on 414 cognitively normal people and predicting cognitive assessment for all participants. In our analysis of accelerated cognitive decline GWAS, we identified two genome-wide significant loci: APOE locus (chromosome 19 p13.32) and rs144614292 (chromosome 11 p15.1). Variant rs144614292 (G>T) has not been reported in previous AD GWA studies. It is within the intronic region of NELL1, which is expressed in neuron and plays a role in controlling cell growth and differentiation. In addition, MUC7 and PROL1/OPRPNon chromosome 4 were significant at the gene level. The cell-type-specific enrichment analysis and functional enrichment of GWAS signals highlighted the microglia and immune-response pathways. Furthermore, we found that the cognitive decline slope GWAS was positively correlated with previous AD GWAS. Conclusion Our deep learning model was demonstrated effective on extracting relevant neuroimaging features and predicting individual cognitive decline. We reported a novel variant (rs144614292) within the NELL1 gene. Our approach has the potential to disentangle accelerated cognitive decline from the normal aging process and to determine its related genetic factors, leveraging opportunities for early intervention.
Collapse
Affiliation(s)
- Yulin Dai
- The University of Texas Health Science Center at Houston
| | - Hsu Yu-Chun
- The University of Texas Health Science Center at Houston
| | | | - Kai Zhang
- The University of Texas Health Science Center at Houston
| | - Li Xiaoyang
- The University of Texas Health Science Center at Houston
| | - Nitesh Enduru
- The University of Texas Health Science Center at Houston
| | - Andi Liu
- The University of Texas Health Science Center at Houston
| | | | - Xiaoqian Jiang
- The University of Texas Health Science Center at Houston
| | - Zhongming Zhao
- The University of Texas Health Science Center at Houston
| |
Collapse
|
6
|
Liu Z, Lv Q, Yang Z, Li Y, Lee CH, Shen L. Recent progress in transformer-based medical image analysis. Comput Biol Med 2023; 164:107268. [PMID: 37494821 DOI: 10.1016/j.compbiomed.2023.107268] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 05/30/2023] [Accepted: 07/16/2023] [Indexed: 07/28/2023]
Abstract
The transformer is primarily used in the field of natural language processing. Recently, it has been adopted and shows promise in the computer vision (CV) field. Medical image analysis (MIA), as a critical branch of CV, also greatly benefits from this state-of-the-art technique. In this review, we first recap the core component of the transformer, the attention mechanism, and the detailed structures of the transformer. After that, we depict the recent progress of the transformer in the field of MIA. We organize the applications in a sequence of different tasks, including classification, segmentation, captioning, registration, detection, enhancement, localization, and synthesis. The mainstream classification and segmentation tasks are further divided into eleven medical image modalities. A large number of experiments studied in this review illustrate that the transformer-based method outperforms existing methods through comparisons with multiple evaluation metrics. Finally, we discuss the open challenges and future opportunities in this field. This task-modality review with the latest contents, detailed information, and comprehensive comparison may greatly benefit the broad MIA community.
Collapse
Affiliation(s)
- Zhaoshan Liu
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore.
| | - Qiujie Lv
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore; School of Intelligent Systems Engineering, Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, 518107, China.
| | - Ziduo Yang
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore; School of Intelligent Systems Engineering, Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, 518107, China.
| | - Yifan Li
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore.
| | - Chau Hung Lee
- Department of Radiology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, Singapore, 308433, Singapore.
| | - Lei Shen
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore.
| |
Collapse
|
7
|
Hu Z, Li Y, Wang Z, Zhang S, Hou W. Conv-Swinformer: Integration of CNN and shift window attention for Alzheimer's disease classification. Comput Biol Med 2023; 164:107304. [PMID: 37549456 DOI: 10.1016/j.compbiomed.2023.107304] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Revised: 07/14/2023] [Accepted: 07/28/2023] [Indexed: 08/09/2023]
Abstract
Deep learning (DL) algorithms based on brain MRI images have achieved great success in the prediction of Alzheimer's disease (AD), with classification accuracy exceeding even that of the most experienced clinical experts. As a novel feature fusion method, Transformer has achieved excellent performance in many computer vision tasks, which also greatly promotes the application of Transformer in medical images. However, when Transformer is used for 3D MRI image feature fusion, existing DL models treat the input local features equally, which is inconsistent with the fact that adjacent voxels have stronger semantic connections than spatially distant voxels. In addition, due to the relatively small size of the dataset for medical images, it is difficult to capture local lesion features in limited iterative training by treating all input features equally. This paper proposes a deep learning model Conv-Swinformer that focuses on extracting and integrating local fine-grained features. Conv-Swinformer consists of a CNN module and a Transformer encoder module. The CNN module summarizes the planar features of the MRI slices, and the Transformer module establishes semantic connections in 3D space for these planar features. By introducing the shift window attention mechanism in the Transformer encoder, the attention is focused on a small spatial area of the MRI image, which effectively reduces unnecessary background semantic information and enables the model to capture local features more accurately. In addition, the layer-by-layer enlarged attention window can further integrate local fine-grained features, thus enhancing the model's attention ability. Compared with DL algorithms that indiscriminately fuse local features of MRI images, Conv-Swinformer can fine-grained extract local lesion features, thus achieving better classification results.
Collapse
Affiliation(s)
- Zhentao Hu
- School of Artificial Intelligence, Henan University, Zhengzhou, 450046, China
| | - Yanyang Li
- School of Artificial Intelligence, Henan University, Zhengzhou, 450046, China
| | - Zheng Wang
- School of Artificial Intelligence, Henan University, Zhengzhou, 450046, China.
| | - Shuo Zhang
- School of Artificial Intelligence, Henan University, Zhengzhou, 450046, China
| | - Wei Hou
- College of Computer and Information Engineering, Henan University, Kaifeng, 475004, China
| |
Collapse
|
8
|
Tomitaka A, Vashist A, Kolishetti N, Nair M. Machine learning assisted-nanomedicine using magnetic nanoparticles for central nervous system diseases. NANOSCALE ADVANCES 2023; 5:4354-4367. [PMID: 37638161 PMCID: PMC10448356 DOI: 10.1039/d3na00180f] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 07/24/2023] [Indexed: 08/29/2023]
Abstract
Magnetic nanoparticles possess unique properties distinct from other types of nanoparticles developed for biomedical applications. Their unique magnetic properties and multifunctionalities are especially beneficial for central nervous system (CNS) disease therapy and diagnostics, as well as targeted and personalized applications using image-guided therapy and theranostics. This review discusses the recent development of magnetic nanoparticles for CNS applications, including Alzheimer's disease, Parkinson's disease, epilepsy, multiple sclerosis, and drug addiction. Machine learning (ML) methods are increasingly applied towards the processing, optimization and development of nanomaterials. By using data-driven approach, ML has the potential to bridge the gap between basic research and clinical research. We review ML approaches used within the various stages of nanomedicine development, from nanoparticle synthesis and characterization to performance prediction and disease diagnosis.
Collapse
Affiliation(s)
- Asahi Tomitaka
- Department of Computer and Information Sciences, College of Natural and Applied Science, University of Houston-Victoria Texas 77901 USA
| | - Arti Vashist
- Department of Immunology and Nano-Medicine, Herbert Wertheim College of Medicine, Florida International University Miami Florida 33199 USA
- Institute of NeuroImmune Pharmacology, Centre for Personalized Nanomedicine, Herbert Wertheim College of Medicine, Florida International University Miami Florida 33199 USA
| | - Nagesh Kolishetti
- Department of Immunology and Nano-Medicine, Herbert Wertheim College of Medicine, Florida International University Miami Florida 33199 USA
- Institute of NeuroImmune Pharmacology, Centre for Personalized Nanomedicine, Herbert Wertheim College of Medicine, Florida International University Miami Florida 33199 USA
| | - Madhavan Nair
- Department of Immunology and Nano-Medicine, Herbert Wertheim College of Medicine, Florida International University Miami Florida 33199 USA
- Institute of NeuroImmune Pharmacology, Centre for Personalized Nanomedicine, Herbert Wertheim College of Medicine, Florida International University Miami Florida 33199 USA
| |
Collapse
|
9
|
Illakiya T, Ramamurthy K, Siddharth MV, Mishra R, Udainiya A. AHANet: Adaptive Hybrid Attention Network for Alzheimer's Disease Classification Using Brain Magnetic Resonance Imaging. Bioengineering (Basel) 2023; 10:714. [PMID: 37370645 PMCID: PMC10294993 DOI: 10.3390/bioengineering10060714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 05/27/2023] [Accepted: 06/03/2023] [Indexed: 06/29/2023] Open
Abstract
Alzheimer's disease (AD) is a progressive neurological problem that causes brain atrophy and affects the memory and thinking skills of an individual. Accurate detection of AD has been a challenging research topic for a long time in the area of medical image processing. Detecting AD at its earliest stage is crucial for the successful treatment of the disease. The proposed Adaptive Hybrid Attention Network (AHANet) has two attention modules, namely Enhanced Non-Local Attention (ENLA) and Coordinate Attention. These modules extract global-level features and local-level features separately from the brain Magnetic Resonance Imaging (MRI), thereby boosting the feature extraction power of the network. The ENLA module extracts spatial and contextual information on a global scale while also capturing important long-range dependencies. The Coordinate Attention module captures local features from the input images. It embeds positional information into the channel attention mechanism for enhanced feature extraction. Moreover, an Adaptive Feature Aggregation (AFA) module is proposed to fuse features from the global and local levels in an effective way. As a result of incorporating the above architectural enhancements into the DenseNet architecture, the proposed network exhibited better performance compared to the existing works. The proposed network was trained and tested on the ADNI dataset, yielding a classification accuracy of 98.53%.
Collapse
Affiliation(s)
- T. Illakiya
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai 600127, India;
| | - Karthik Ramamurthy
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai 600127, India
| | - M. V. Siddharth
- School of Mechanical Engineering, Vellore Institute of Technology, Chennai 600127, India;
| | - Rashmi Mishra
- School of Electronics Engineering, Vellore Institute of Technology, Chennai 600127, India; (R.M.); (A.U.)
| | - Ashish Udainiya
- School of Electronics Engineering, Vellore Institute of Technology, Chennai 600127, India; (R.M.); (A.U.)
| |
Collapse
|
10
|
Goumiri S, Benboudjema D, Pieczynski W. A new hybrid model of convolutional neural networks and hidden Markov chains for image classification. Neural Comput Appl 2023; 35:1-16. [PMID: 37362578 PMCID: PMC10230497 DOI: 10.1007/s00521-023-08644-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Accepted: 05/02/2023] [Indexed: 06/28/2023]
Abstract
Convolutional neural networks (CNNs) have lately proven to be extremely effective in image recognition. Besides CNN, hidden Markov chains (HMCs) are probabilistic models widely used in image processing. This paper presents a new hybrid model composed of both CNNs and HMCs. The CNN model is used for feature extraction and dimensionality reduction and the HMC model for classification. In the new model, named CNN-HMC, convolutional and pooling layers of the CNN model are applied to extract features maps. Also a Peano scan is applied to obtain several HMCs. Expectation-Maximization (EM) algorithm is used to estimate HMC's parameters and to make the Bayesian Maximum Posterior Mode (MPM) classification method used unsupervised. The objective is to enhance the performances of the CNN models for the image classification task. To evaluate the performance of our proposal, it is compared to six models in two series of experiments. In the first series, we consider two CNN-HMC and compare them to two CNNs, 4Conv and Mini AlexNet, respectively. The results show that CNN-HMC model outperforms the classical CNN model, and significantly improves the accuracy of the Mini AlexNet. In the second series, it is compared to four models CNN-SVMs, CNN-LSTMs, CNN-RFs, and CNN-gcForests, which only differ from CNN-HMC by the second classification step. Based on five datasets and four metrics recall, precision, F1-score, and accuracy, results of these comparisons show again the interest of the proposed CNN-HMC. In particular, with a CNN model of 71% of accuracy, the CNN-HMC gives an accuracy ranging between 81.63% and 92.5%.
Collapse
Affiliation(s)
- Soumia Goumiri
- Laboratoire des Méthodes de Conception de Systèmes (LMCS), Ecole nationale Supérieure d’Informatique (ESI), BP, 68M Oued-Smar, 16270 Alger, Algeria
- CERIST, Centre de Recherche sur l’Information Scientifique et Technique, Ben Aknoun, 16030 Algeria
| | - Dalila Benboudjema
- Laboratoire des Méthodes de Conception de Systèmes (LMCS), Ecole nationale Supérieure d’Informatique (ESI), BP, 68M Oued-Smar, 16270 Alger, Algeria
| | - Wojciech Pieczynski
- SAMOVAR, Telecom SudParis, Institut Polytechnique de Paris, 91120 Palaiseau, France
| |
Collapse
|
11
|
Illakiya T, Karthik R. Automatic Detection of Alzheimer's Disease using Deep Learning Models and Neuro-Imaging: Current Trends and Future Perspectives. Neuroinformatics 2023; 21:339-364. [PMID: 36884142 DOI: 10.1007/s12021-023-09625-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 03/09/2023]
Abstract
Deep learning algorithms have a huge influence on tackling research issues in the field of medical image processing. It acts as a vital aid for the radiologists in producing accurate results toward effective disease diagnosis. The objective of this research is to highlight the importance of deep learning models in the detection of Alzheimer's Disease (AD). The main objective of this research is to analyze different deep learning methods used for detecting AD. This study examines 103 research articles published in various research databases. These articles have been selected based on specific criteria to find the most relevant findings in the field of AD detection. The review was carried out based on deep learning techniques such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transfer Learning (TL). To propose accurate methods for the detection, segmentation, and severity grading of AD, the radiological features need to be examined in greater depth. This review attempts to analyze different deep learning methods applied for AD detection using neuroimaging modalities like Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), etc. The focus of this review is restricted to deep learning works based on radiological imaging data for AD detection. There are a few works that have utilized other biomarkers to understand the effect of AD. Also, articles published in English were alone considered for analysis. This work concludes by highlighting the key research issues towards effective AD detection. Though several methods have yielded promising results in AD detection, the progression from Mild Cognitive Impairment (MCI) to AD need to be analyzed in greater depth using DL models.
Collapse
Affiliation(s)
- T Illakiya
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - R Karthik
- Centre for Cyber Physical Systems, School of Electronics Engineering, Vellore Institute of Technology, Chennai, India.
| |
Collapse
|
12
|
Yang F, Wang H, Wei S, Sun G, Chen Y, Tao L. Multi-model adaptive fusion-based graph network for Alzheimer's disease prediction. Comput Biol Med 2023; 153:106518. [PMID: 36641934 DOI: 10.1016/j.compbiomed.2022.106518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 12/22/2022] [Accepted: 12/31/2022] [Indexed: 01/04/2023]
Abstract
Alzheimer's disease (AD) is a common cognitive disorder. Recently, many computer-aided diagnostic techniques have been used for AD prediction utilizing deep learning technology, among which graph neural networks have received increasing attention owing to their ability to model sample relationships on large population graphs. Most of the existing graph-based methods predict diseases according to a single model, which makes it difficult to select an appropriate node embedding algorithm for a certain classification task. Moreover, integrating data from different patterns into a unified model to improve the quality of disease diagnosis remains a challenge. Hence, in this study, we aimed to develop a multi-model fusion framework for AD prediction. A spectral graph attention model was used to aggregate intra- and inter-cluster node embeddings of normal and diseased populations, whereafter, a bilinear aggregation model was applied as an auxiliary model to enhance the abnormality degree in different categories of populations, and finally, an adaptive fusion module was designed to dynamically fuse the results of both models and enhance AD prediction. Compared to other comparison methods, the model proposed in this study provides the best results.
Collapse
Affiliation(s)
- Fusheng Yang
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, School of Computer Science and Technology, Anhui University, 230601, China.
| | - Huabin Wang
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, School of Computer Science and Technology, Anhui University, 230601, China.
| | - Shicheng Wei
- School of Electrical and Information Engineering, University of Sydney, Sydney, 2006, Australia.
| | - Guangming Sun
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, School of Computer Science and Technology, Anhui University, 230601, China.
| | - Yonglin Chen
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, School of Computer Science and Technology, Anhui University, 230601, China.
| | - Liang Tao
- Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging, School of Computer Science and Technology, Anhui University, 230601, China.
| |
Collapse
|
13
|
Abbas Q, Hussain A, Baig AR. CAD-ALZ: A Blockwise Fine-Tuning Strategy on Convolutional Model and Random Forest Classifier for Recognition of Multistage Alzheimer's Disease. Diagnostics (Basel) 2023; 13:167. [PMID: 36611459 PMCID: PMC9818479 DOI: 10.3390/diagnostics13010167] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/24/2022] [Accepted: 12/31/2022] [Indexed: 01/05/2023] Open
Abstract
Mental deterioration or Alzheimer's (ALZ) disease is progressive and causes both physical and mental dependency. There is a need for a computer-aided diagnosis (CAD) system that can help doctors make an immediate decision. (1) Background: Currently, CAD systems are developed based on hand-crafted features, machine learning (ML), and deep learning (DL) techniques. Those CAD systems frequently require domain-expert knowledge and massive datasets to extract deep features or model training, which causes problems with class imbalance and overfitting. Additionally, there are still manual approaches used by radiologists due to the lack of dataset availability and to train the model with cost-effective computation. Existing works rely on performance improvement by neglecting the problems of the limited dataset, high computational complexity, and unavailability of lightweight and efficient feature descriptors. (2) Methods: To address these issues, a new approach, CAD-ALZ, is developed by extracting deep features through a ConvMixer layer with a blockwise fine-tuning strategy on a very small original dataset. At first, we apply the data augmentation method to images to increase the size of datasets. In this study, a blockwise fine-tuning strategy is employed on the ConvMixer model to detect robust features. Afterwards, a random forest (RF) is used to classify ALZ disease stages. (3) Results: The proposed CAD-ALZ model obtained significant results by using six evaluation metrics such as the F1-score, Kappa, accuracy, precision, sensitivity, and specificity. The CAD-ALZ model performed with a sensitivity of 99.69% and an F1-score of 99.61%. (4) Conclusions: The suggested CAD-ALZ approach is a potential technique for clinical use and computational efficiency compared to state-of-the-art approaches. The CAD-ALZ model code is freely available on GitHub for the scientific community.
Collapse
Affiliation(s)
- Qaisar Abbas
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Ayyaz Hussain
- Department of Computer Science, Quaid-i-Azam University, Islamabad 44000, Pakistan
| | - Abdul Rauf Baig
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| |
Collapse
|
14
|
Bi XA, Mao Y, Luo S, Wu H, Zhang L, Luo X, Xu L. A novel generation adversarial network framework with characteristics aggregation and diffusion for brain disease classification and feature selection. Brief Bioinform 2022; 23:6762742. [PMID: 36259367 DOI: 10.1093/bib/bbac454] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 09/01/2022] [Accepted: 09/23/2022] [Indexed: 12/14/2022] Open
Abstract
Imaging genetics provides unique insights into the pathological studies of complex brain diseases by integrating the characteristics of multi-level medical data. However, most current imaging genetics research performs incomplete data fusion. Also, there is a lack of effective deep learning methods to analyze neuroimaging and genetic data jointly. Therefore, this paper first constructs the brain region-gene networks to intuitively represent the association pattern of pathogenetic factors. Second, a novel feature information aggregation model is constructed to accurately describe the information aggregation process among brain region nodes and gene nodes. Finally, a deep learning method called feature information aggregation and diffusion generative adversarial network (FIAD-GAN) is proposed to efficiently classify samples and select features. We focus on improving the generator with the proposed convolution and deconvolution operations, with which the interpretability of the deep learning framework has been dramatically improved. The experimental results indicate that FIAD-GAN can not only achieve superior results in various disease classification tasks but also extract brain regions and genes closely related to AD. This work provides a novel method for intelligent clinical decisions. The relevant biomedical discoveries provide a reliable reference and technical basis for the clinical diagnosis, treatment and pathological analysis of disease.
Collapse
Affiliation(s)
- Xia-An Bi
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, and College of Information Science and Engineering in Hunan Normal University, Changsha, P.R. China
| | - Yuhua Mao
- Department of Computing, School of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Sheng Luo
- Department of Computing, School of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Hao Wu
- Department of Computing, School of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Lixia Zhang
- School of Information Science and Engineering, Hunan Normal University, Changsha, P.R. China
| | - Xun Luo
- College of Information Science and Engineering in Hunan Normal University, Changsha, P.R. China
| | - Luyun Xu
- College of Business in Hunan Normal University, Changsha, P.R. China
| |
Collapse
|
15
|
Nanni L, Brahnam S, Paci M, Ghidoni S. Comparison of Different Convolutional Neural Network Activation Functions and Methods for Building Ensembles for Small to Midsize Medical Data Sets. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22166129. [PMID: 36015898 PMCID: PMC9415767 DOI: 10.3390/s22166129] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 08/09/2022] [Accepted: 08/12/2022] [Indexed: 05/08/2023]
Abstract
CNNs and other deep learners are now state-of-the-art in medical imaging research. However, the small sample size of many medical data sets dampens performance and results in overfitting. In some medical areas, it is simply too labor-intensive and expensive to amass images numbering in the hundreds of thousands. Building Deep CNN ensembles of pre-trained CNNs is one powerful method for overcoming this problem. Ensembles combine the outputs of multiple classifiers to improve performance. This method relies on the introduction of diversity, which can be introduced on many levels in the classification workflow. A recent ensembling method that has shown promise is to vary the activation functions in a set of CNNs or within different layers of a single CNN. This study aims to examine the performance of both methods using a large set of twenty activations functions, six of which are presented here for the first time: 2D Mexican ReLU, TanELU, MeLU + GaLU, Symmetric MeLU, Symmetric GaLU, and Flexible MeLU. The proposed method was tested on fifteen medical data sets representing various classification tasks. The best performing ensemble combined two well-known CNNs (VGG16 and ResNet50) whose standard ReLU activation layers were randomly replaced with another. Results demonstrate the superiority in performance of this approach.
Collapse
Affiliation(s)
- Loris Nanni
- Department of Information Engineering, University of Padua, Via Gradenigo 6, 35131 Padova, Italy
| | - Sheryl Brahnam
- Department of Information Technology and Cybersecurity, Missouri State University, 901 S. National Street, Springfield, MO 65804, USA
- Correspondence:
| | - Michelangelo Paci
- BioMediTech, Faculty of Medicine and Health Technology, Tampere University, Arvo Ylpön katu 34, D 219, FI-33520 Tampere, Finland
| | - Stefano Ghidoni
- Department of Information Engineering, University of Padua, Via Gradenigo 6, 35131 Padova, Italy
| |
Collapse
|
16
|
A CAD System for Alzheimer's Disease Classification Using Neuroimaging MRI 2D Slices. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:8680737. [PMID: 35983528 PMCID: PMC9381208 DOI: 10.1155/2022/8680737] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 04/21/2022] [Accepted: 05/27/2022] [Indexed: 11/22/2022]
Abstract
Developments in medical care have inspired wide interest in the current decade, especially to their services to individuals living prolonged and healthier lives. Alzheimer's disease (AD) is the most chronic neurodegeneration and dementia-causing disorder. Economic expense of treating AD patients is expected to grow. The requirement of developing a computer-aided technique for early AD categorization becomes even more essential. Deep learning (DL) models offer numerous benefits against machine learning tools. Several latest experiments that exploited brain magnetic resonance imaging (MRI) scans and convolutional neural networks (CNN) for AD classification showed promising conclusions. CNN's receptive field aids in the extraction of main recognizable features from these MRI scans. In order to increase classification accuracy, a new adaptive model based on CNN and support vector machines (SVM) is presented in the research, combining both the CNN's capabilities in feature extraction and SVM in classification. The objective of this research is to build a hybrid CNN-SVM model for classifying AD using the MRI ADNI dataset. Experimental results reveal that the hybrid CNN-SVM model outperforms the CNN model alone, with relative improvements of 3.4%, 1.09%, 0.85%, and 2.82% on the testing dataset for AD vs. cognitive normal (CN), CN vs. mild cognitive impairment (MCI), AD vs. MCI, and CN vs. MCI vs. AD, respectively. Finally, the proposed approach has been further experimented on OASIS dataset leading to accuracy of 86.2%.
Collapse
|
17
|
Wang H, Feng T, Zhao Z, Bai X, Han G, Wang J, Dai Z, Wang R, Zhao W, Ren F, Gao F. Classification of Alzheimer's Disease Based on Deep Learning of Brain Structural and Metabolic Data. Front Aging Neurosci 2022; 14:927217. [PMID: 35903535 PMCID: PMC9315355 DOI: 10.3389/fnagi.2022.927217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2022] [Accepted: 06/08/2022] [Indexed: 11/30/2022] Open
Abstract
To improve the diagnosis and classification of Alzheimer's disease (AD), a modeling method is proposed based on the combining magnetic resonance images (MRI) brain structural data with metabolite levels of the frontal and parietal regions. First, multi-atlas brain segmentation technology based on T1-weighted images and edited magnetic resonance spectroscopy (MRS) were used to extract data of 279 brain regions and levels of 12 metabolites from regions of interest (ROIs) in the frontal and parietal regions. The t-test combined with false discovery rate (FDR) correction was used to reduce the dimensionality in the data, and MRI structural data of 54 brain regions and levels of 4 metabolites that obviously correlated with AD were screened out. Lastly, the stacked auto-encoder neural network (SAE) was used to classify AD and healthy controls (HCs), which judged the effect of classification method by fivefold cross validation. The results indicated that the mean accuracy of the five experimental model increased from 96 to 100%, the AUC value increased from 0.97 to 1, specificity increased from 90 to 100%, and F1 value increased from 0.97 to 1. Comparing the effect of each metabolite on model performance revealed that the gamma-aminobutyric acid (GABA) + levels in the parietal region resulted in the most significant improvement in model performance, with the accuracy rate increasing from 96 to 98%, the AUC value increased from 0.97 to 0.99 and the specificity increasing from 90 to 95%. Moreover, the GABA + levels in the parietal region was significantly correlated with Mini Mental State Examination (MMSE) scores of patients with AD (r = 0.627), and the F statistics were largest (F = 25.538), which supports the hypothesis that dysfunctional GABAergic system play an important role in the pathogenesis of AD. Overall, our findings support that a comprehensive method that combines MRI structural and metabolic data of brain regions can improve model classification efficiency of AD.
Collapse
Affiliation(s)
- Huiquan Wang
- School of Life Sciences, Tiangong University, Tianjin, China
| | - Tianzi Feng
- School of Electrical and Information Engineering, Tiangong University, Tianjin, China
| | - Zhe Zhao
- School of Electrical and Information Engineering, Tiangong University, Tianjin, China
| | - Xue Bai
- Department of Radiology, Qilu Hospital of Shandong University, Jinan, China
| | - Guang Han
- School of Life Sciences, Tiangong University, Tianjin, China
| | - Jinhai Wang
- School of Life Sciences, Tiangong University, Tianjin, China
| | - Zongrui Dai
- Westa College, Southwest University, Chongqing, China
| | - Rong Wang
- School of Life Sciences, Tiangong University, Tianjin, China
| | - Weibiao Zhao
- School of Life Sciences, Tiangong University, Tianjin, China
| | - Fuxin Ren
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China
| | - Fei Gao
- Department of Radiology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China
| |
Collapse
|
18
|
Tufail AB, Anwar N, Othman MTB, Ullah I, Khan RA, Ma YK, Adhikari D, Rehman AU, Shafiq M, Hamam H. Early-Stage Alzheimer's Disease Categorization Using PET Neuroimaging Modality and Convolutional Neural Networks in the 2D and 3D Domains. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22124609. [PMID: 35746389 PMCID: PMC9230850 DOI: 10.3390/s22124609] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 06/06/2022] [Accepted: 06/15/2022] [Indexed: 05/27/2023]
Abstract
Alzheimer's Disease (AD) is a health apprehension of significant proportions that is negatively impacting the ageing population globally. It is characterized by neuronal loss and the formation of structures such as neurofibrillary tangles and amyloid plaques in the early as well as later stages of the disease. Neuroimaging modalities are routinely used in clinical practice to capture brain alterations associated with AD. On the other hand, deep learning methods are routinely used to recognize patterns in underlying data distributions effectively. This work uses Convolutional Neural Network (CNN) architectures in both 2D and 3D domains to classify the initial stages of AD into AD, Mild Cognitive Impairment (MCI) and Normal Control (NC) classes using the positron emission tomography neuroimaging modality deploying data augmentation in a random zoomed in/out scheme. We used novel concepts such as the blurring before subsampling principle and distant domain transfer learning to build 2D CNN architectures. We performed three binaries, that is, AD/NC, AD/MCI, MCI/NC and one multiclass classification task AD/NC/MCI. The statistical comparison revealed that 3D-CNN architecture performed the best achieving an accuracy of 89.21% on AD/NC, 71.70% on AD/MCI, 62.25% on NC/MCI and 59.73% on AD/NC/MCI classification tasks using a five-fold cross-validation hyperparameter selection approach. Data augmentation helps in achieving superior performance on the multiclass classification task. The obtained results support the application of deep learning models towards early recognition of AD.
Collapse
Affiliation(s)
- Ahsan Bin Tufail
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150001, China; (A.B.T.); (Y.-K.M.)
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Sahiwal Campus, Sahiwal 57000, Pakistan
| | - Nazish Anwar
- Registered Medical Practitioner, Pakistan Medical Commission, Islamabad 44000, Pakistan;
| | - Mohamed Tahar Ben Othman
- Department of Computer Science, College of Computer, Qassim University, Buraydah 51452, Saudi Arabia
| | - Inam Ullah
- College of Internet of Things (IoT) Engineering, Changzhou Campus, Hohai University (HHU), Changzhou 213022, China;
| | - Rehan Ali Khan
- Department of Electrical Engineering, University of Science and Technology Bannu, Bannu 28100, Pakistan;
| | - Yong-Kui Ma
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150001, China; (A.B.T.); (Y.-K.M.)
| | - Deepak Adhikari
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Ateeq Ur Rehman
- Department of Electrical Engineering, Government College University Lahore, Lahore 54000, Pakistan;
| | - Muhammad Shafiq
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Korea
| | - Habib Hamam
- Faculty of Engineering, Université de Moncton, Moncton, NB E1A3E9, Canada;
- International Institute of Technology and Management, Libreville BP1989, Gabon
- Spectrum of Knowledge Production & Skills Development, Sfax 3027, Tunisia
- Department of Electrical and Electronic Engineering Science, School of Electrical Engineering, University of Johannesburg, Johannesburg 2006, South Africa
| |
Collapse
|
19
|
Chen L, Qiao H, Zhu F. Alzheimer's Disease Diagnosis With Brain Structural MRI Using Multiview-Slice Attention and 3D Convolution Neural Network. Front Aging Neurosci 2022; 14:871706. [PMID: 35557839 PMCID: PMC9088013 DOI: 10.3389/fnagi.2022.871706] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 03/17/2022] [Indexed: 01/01/2023] Open
Abstract
Numerous artificial intelligence (AI) based approaches have been proposed for automatic Alzheimer's disease (AD) prediction with brain structural magnetic resonance imaging (sMRI). Previous studies extract features from the whole brain or individual slices separately, ignoring the properties of multi-view slices and feature complementarity. For this reason, we present a novel AD diagnosis model based on the multiview-slice attention and 3D convolution neural network (3D-CNN). Specifically, we begin by extracting the local slice-level characteristic in various dimensions using multiple sub-networks. Then we proposed a slice-level attention mechanism to emphasize specific 2D-slices to exclude the redundancy features. After that, a 3D-CNN was employed to capture the global subject-level structural changes. Finally, all these 2D and 3D features were fused to obtain more discriminative representations. We conduct the experiments on 1,451 subjects from ADNI-1 and ADNI-2 datasets. Experimental results showed the superiority of our model over the state-of-the-art approaches regarding dementia classification. Specifically, our model achieves accuracy values of 91.1 and 80.1% on ADNI-1 for AD diagnosis and mild cognitive impairment (MCI) convention prediction, respectively.
Collapse
Affiliation(s)
- Lin Chen
- Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China
| | - Hezhe Qiao
- Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Fan Zhu
- Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China
| |
Collapse
|
20
|
Liu Z, Lu H, Pan X, Xu M, Lan R, Luo X. Diagnosis of Alzheimer’s disease via an attention-based multi-scale convolutional neural network. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.107942] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|