1
|
Tang C, Xi M, Sun J, Wang S, Zhang Y. MACFNet: Detection of Alzheimer's disease via multiscale attention and cross-enhancement fusion network. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 254:108259. [PMID: 38865795 DOI: 10.1016/j.cmpb.2024.108259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 05/10/2024] [Accepted: 05/29/2024] [Indexed: 06/14/2024]
Abstract
BACKGROUND AND OBJECTIVE Alzheimer's disease (AD) is a dreaded degenerative disease that results in a profound decline in human cognition and memory. Due to its intricate pathogenesis and the lack of effective therapeutic interventions, early diagnosis plays a paramount role in AD. Recent research based on neuroimaging has shown that the application of deep learning methods by multimodal neural images can effectively detect AD. However, these methods only concatenate and fuse the high-level features extracted from different modalities, ignoring the fusion and interaction of low-level features across modalities. It consequently leads to unsatisfactory classification performance. METHOD In this paper, we propose a novel multi-scale attention and cross-enhanced fusion network, MACFNet, which enables the interaction of multi-stage low-level features between inputs to learn shared feature representations. We first construct a novel Cross-Enhanced Fusion Module (CEFM), which fuses low-level features from different modalities through a multi-stage cross-structure. In addition, an Efficient Spatial Channel Attention (ECSA) module is proposed, which is able to focus on important AD-related features in images more efficiently and achieve feature enhancement from different modalities through two-stage residual concatenation. Finally, we also propose a multiscale attention guiding block (MSAG) based on dilated convolution, which can obtain rich receptive fields without increasing model parameters and computation, and effectively improve the efficiency of multiscale feature extraction. RESULTS Experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that our MACFNet has better classification performance than existing multimodal methods, with classification accuracies of 99.59 %, 98.85 %, 99.61 %, and 98.23 % for AD vs. CN, AD vs. MCI, CN vs. MCI and AD vs. CN vs. MCI, respectively, and specificity of 98.92 %, 97.07 %, 99.58 % and 99.04 %, and sensitivity of 99.91 %, 99.89 %, 99.63 % and 97.75 %, respectively. CONCLUSIONS The proposed MACFNet is a high-accuracy multimodal AD diagnostic framework. Through the cross mechanism and efficient attention, MACFNet can make full use of the low-level features of different modal medical images and effectively pay attention to the local and global information of the images. This work provides a valuable reference for multi-mode AD diagnosis.
Collapse
Affiliation(s)
- Chaosheng Tang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
| | - Mengbo Xi
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
| | - Junding Sun
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China.
| | - Shuihua Wang
- Department of Biological Sciences, Xi'an Jiaotong-Liverpool University, Suzhou, Jiangsu 215123, China.
| | - Yudong Zhang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China; School of Computing and Mathematical Sciences, University of Leicester, Leicester, LE1 7RH, UK; Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia.
| |
Collapse
|
2
|
Liu X, Li W, Miao S, Liu F, Han K, Bezabih TT. HAMMF: Hierarchical attention-based multi-task and multi-modal fusion model for computer-aided diagnosis of Alzheimer's disease. Comput Biol Med 2024; 176:108564. [PMID: 38744010 DOI: 10.1016/j.compbiomed.2024.108564] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 04/15/2024] [Accepted: 05/05/2024] [Indexed: 05/16/2024]
Abstract
Alzheimer's disease (AD) is a progressive neurodegenerative condition, and early intervention can help slow its progression. However, integrating multi-dimensional information and deep convolutional networks increases the model parameters, affecting diagnosis accuracy and efficiency and hindering clinical diagnostic model deployment. Multi-modal neuroimaging can offer more precise diagnostic results, while multi-task modeling of classification and regression tasks can enhance the performance and stability of AD diagnosis. This study proposes a Hierarchical Attention-based Multi-task Multi-modal Fusion model (HAMMF) that leverages multi-modal neuroimaging data to concurrently learn AD classification tasks, cognitive score regression, and age regression tasks using attention-based techniques. Firstly, we preprocess MRI and PET image data to obtain two modal data, each containing distinct information. Next, we incorporate a novel Contextual Hierarchical Attention Module (CHAM) to aggregate multi-modal features. This module employs channel and spatial attention to extract fine-grained pathological features from unimodal image data across various dimensions. Using these attention mechanisms, the Transformer can effectively capture correlated features of multi-modal inputs. Lastly, we adopt multi-task learning in our model to investigate the influence of different variables on diagnosis, with a primary classification task and a secondary regression task for optimal multi-task prediction performance. Our experiments utilized MRI and PET images from 720 subjects in the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. The results show that our proposed model achieves an overall accuracy of 93.15% for AD/NC recognition, and the visualization results demonstrate its strong pathological feature recognition performance.
Collapse
Affiliation(s)
- Xiao Liu
- School of Computer Engineering and Science, Shanghai University, Shanghai, China
| | - Weimin Li
- School of Computer Engineering and Science, Shanghai University, Shanghai, China.
| | - Shang Miao
- School of Computer Engineering and Science, Shanghai University, Shanghai, China
| | - Fangyu Liu
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China; University of Chinese Academy of Sciences, Beijing, China; BGI-Shenzhen, Shenzhen, China
| | - Ke Han
- Medical and Health Center, Liaocheng People's Hospital, LiaoCheng, China
| | - Tsigabu T Bezabih
- School of Computer Engineering and Science, Shanghai University, Shanghai, China
| |
Collapse
|
3
|
Ye J, Zeng A, Pan D, Zhang Y, Zhao J, Chen Q, Liu Y. MAD-Former: A Traceable Interpretability Model for Alzheimer's Disease Recognition Based on Multi-Patch Attention. IEEE J Biomed Health Inform 2024; 28:3637-3648. [PMID: 38442047 PMCID: PMC11315578 DOI: 10.1109/jbhi.2024.3368500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/07/2024]
Abstract
The integration of structural magnetic resonance imaging (sMRI) and deep learning techniques is one of the important research directions for the automatic diagnosis of Alzheimer's disease (AD). Despite the satisfactory performance achieved by existing voxel-based models based on convolutional neural networks (CNNs), such models only handle AD-related brain atrophy at a single spatial scale and lack spatial localization of abnormal brain regions based on model interpretability. To address the above limitations, we propose a traceable interpretability model for AD recognition based on multi-patch attention (MAD-Former). MAD-Former consists of two parts: recognition and interpretability. In the recognition part, we design a 3D brain feature extraction network to extract local features, followed by constructing a dual-branch attention structure with different patch sizes to achieve global feature extraction, forming a multi-scale spatial feature extraction framework. Meanwhile, we propose an important attention similarity position loss function to assist in model decision-making. The interpretability part proposes a traceable method that can obtain a 3D ROI space through attention-based selection and receptive field tracing. This space encompasses key brain tissues that influence model decisions. Experimental results reveal the significant role of brain tissues such as the Fusiform Gyrus (FuG) in AD recognition. MAD-Former achieves outstanding performance in different tasks on ADNI and OASIS datasets, demonstrating reliable model interpretability.
Collapse
|
4
|
Fathi S, Ahmadi A, Dehnad A, Almasi-Dooghaee M, Sadegh M. A Deep Learning-Based Ensemble Method for Early Diagnosis of Alzheimer's Disease using MRI Images. Neuroinformatics 2024; 22:89-105. [PMID: 38042764 PMCID: PMC10917836 DOI: 10.1007/s12021-023-09646-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/16/2023] [Indexed: 12/04/2023]
Abstract
Recently, the early diagnosis of Alzheimer's disease has gained major attention due to the growing prevalence of the disease and the resulting costs imposed on individuals and society. The main objective of this study was to propose an ensemble method based on deep learning for the early diagnosis of AD using MRI images. The methodology of this study consisted of collecting the dataset, preprocessing, creating the individual and ensemble models, evaluating the models based on ADNI data, and validating the trained model based on the local dataset. The proposed method was an ensemble approach selected through a comparative analysis of various ensemble scenarios. Finally, the six best individual CNN-based classifiers were selected to combine and constitute the ensemble model. The evaluation showed an accuracy rate of 98.57, 96.37, 94.22, 99.83, 93.88, and 93.92 for NC/AD, NC/EMCI, EMCI/LMCI, LMCI/AD, four-way and three-way classification groups, respectively. The validation results on the local dataset revealed an accuracy of 88.46 for three-way classification. Our performance results were higher than most reviewed studies and comparable with others. Although comparative analysis showed superior results of ensemble methods against individual architectures, there were no significant differences among various ensemble approaches. The validation results revealed the low performance of individual models in practice. In contrast, the ensemble method showed promising results. However, further studies on various and larger datasets are required to validate the generalizability of the model.
Collapse
Affiliation(s)
- Sina Fathi
- Department of Health Information Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Ahmadi
- Surrey Business School, University of Surrey, Guildford Surrey, GU2 7XH, UK.
| | - Afsaneh Dehnad
- School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mostafa Almasi-Dooghaee
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Melika Sadegh
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
5
|
Zhang Z, Gao L, Li P, Jin G, Wang J. DAUF: A disease-related attentional UNet framework for progressive and stable mild cognitive impairment identification. Comput Biol Med 2023; 165:107401. [PMID: 37678136 DOI: 10.1016/j.compbiomed.2023.107401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2023] [Revised: 08/02/2023] [Accepted: 08/26/2023] [Indexed: 09/09/2023]
Abstract
Identifying progressive mild cognitive impairment (pMCI) and stable mild cognitive impairment (sMCI) plays a significant role in early Alzheimer's disease (AD) diagnosis, which can effectively boost the life quality of patients. Recently, convolutional neural network (CNN)- based methods using structural magnetic resonance imaging (sMRI) images have shown effective for AD identification. However, these CNN-based methods fail to effectively explore the feature extraction of disease-related multi-scale tissues, such as ventricles, hippocampi and cerebral cortex. To address this issue, we propose an end-to-end disease-related attentional UNet framework (DAUF) for identifying pMCI and sMCI, by embedding a devised dual disease-related attention module (D2AM) and a novel tree-structured feature fusion classifier (TFFC). Specifically, D2AM leverages the complementarity between feature maps and attention maps and the complementary features from the encoder and decoder, so as to highlight discriminative semantic and detailed features. Additionally, TFFC is a powerfully joint multi-scale feature fusion and classification head, by employing the homogeneity among multi-scale features, so that the discriminative features of the multi-scale tissues are adequately fused for enhancing classification performance. Finally, extensive experiments demonstrate the superior performance of DAUF, with the effectiveness of D2AM and TFFC on identifying pMCI and sMCI subjects.
Collapse
Affiliation(s)
- Zhehao Zhang
- First Affiliated Hospital of Ningbo University, Ningbo, 315020, China; Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315210, China
| | - Linlin Gao
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315210, China; Zhejiang Key Laboratory of Mobile Network Application Technology, Ningbo University, Ningbo 315210, China; Zhejiang Engineering Research Center of Advanced Mass Spectrometry and Clinical Application, Ningbo University, Ningbo 315210, China.
| | - Pengyuan Li
- IBM Research-Almaden, San Jose, CA 95120, USA
| | - Guang Jin
- Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315210, China
| | - Jianhua Wang
- First Affiliated Hospital of Ningbo University, Ningbo, 315020, China.
| |
Collapse
|
6
|
Nie L, Sun Z, Shan F, Li C, Ding X, Shen C. An artificial intelligence framework for the diagnosis of prosthetic joint infection based on 99mTc-MDP dynamic bone scintigraphy. Eur Radiol 2023; 33:6794-6803. [PMID: 37115217 DOI: 10.1007/s00330-023-09687-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2022] [Revised: 01/30/2023] [Accepted: 02/26/2023] [Indexed: 04/29/2023]
Abstract
OBJECTIVES Dynamic bone scintigraphy (DBS) is the first widely reliable and simple imaging modality in nuclear medicine that can be used to diagnose prosthetic joint infection (PJI). We aimed to apply artificial intelligence to diagnose PJI in patients after total hip or knee arthroplasty (THA or TKA) based on 99mTc-methylene diphosphonate (99mTc-MDP) DBS. METHODS A total of 449 patients (255 THAs and 194 TKAs) with a final diagnosis were retrospectively enrolled and analyzed. The dataset was divided into a training and validation set and an independent test set. A customized framework composed of two data preprocessing algorithms and a diagnosis model (dynamic bone scintigraphy effective neural network, DBS-eNet) was compared with mainstream modified classification models and experienced nuclear medicine specialists on corresponding datasets. RESULTS In the fivefold cross-validation test, diagnostic accuracies of 86.48% for prosthetic knee infection (PKI) and 86.33% for prosthetic hip infection (PHI) were obtained using the proposed framework. On the independent test set, the diagnostic accuracies and AUC values were 87.74% and 0.957 for PKI and 86.36% and 0.906 for PHI, respectively. The customized framework demonstrated better overall diagnostic performance compared to other classification models and showed superiority in diagnosing PKI and consistency in diagnosing PHI compared to specialists. CONCLUSION The customized framework can be used to effectively and accurately diagnose PJI based on 99mTc-MDP DBS. The excellent diagnostic performance of this method indicates its potential clinical practical value in the future. KEY POINTS • The proposed framework in the current study achieved high diagnostic performance for prosthetic knee infection (PKI) and prosthetic hip infection (PHI) with AUC values of 0.957 and 0.906, respectively. • The customized framework demonstrated better overall diagnostic performance compared to other classification models. • Compared to experienced nuclear medicine physicians, the customized framework showed superiority in diagnosing PKI and consistency in diagnosing PHI.
Collapse
Affiliation(s)
- Liangbing Nie
- School of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China
| | - Zhenkui Sun
- Department of Nuclear Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
- Bone Nonunion & Bone Infection MDT, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Fengling Shan
- Department of Nuclear Medicine, Shanghai Pudong Hospital, Fudan University Pudong Medical Center, Shanghai, 201399, China
| | - Chengfan Li
- School of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China
| | - Xuehai Ding
- School of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China
| | - Chentian Shen
- Department of Nuclear Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China.
- Bone Nonunion & Bone Infection MDT, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China.
| |
Collapse
|
7
|
Wen J, Li Y, Fang M, Zhu L, Feng DD, Li P. Fine-Grained and Multiple Classification for Alzheimer's Disease With Wavelet Convolution Unit Network. IEEE Trans Biomed Eng 2023; 70:2592-2603. [PMID: 37030751 DOI: 10.1109/tbme.2023.3256042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
Abstract
In this article, we propose a novel wavelet convolution unit for the image-oriented neural network to integrate wavelet analysis with a vanilla convolution operator to extract deep abstract features more efficiently. On one hand, in order to acquire non-local receptive fields and avoid information loss, we define a new convolution operation by composing a traditional convolution function and approximate and detailed representations after single-scale wavelet decomposition of source images. On the other hand, multi-scale wavelet decomposition is introduced to obtain more comprehensive multi-scale feature information. Then, we fuse all these cross-scale features to improve the problem of inaccurate localization of singular points. Given the novel wavelet convolution unit, we further design a network based on it for fine-grained Alzheimer's disease classifications (i.e., Alzheimer's disease, Normal controls, early mild cognitive impairment, late mild cognitive impairment). Up to now, only a few methods have studied one or several fine-grained classifications, and even fewer methods can achieve both fine-grained and multi-class classifications. We adopt the novel network and diffuse tensor images to achieve fine-grained classifications, which achieved state-of-the-art accuracy for all eight kinds of fine-grained classifications, up to 97.30%, 95.78%, 95.00%, 94.00%, 97.89%, 95.71%, 95.07%, 93.79%. In order to build a reference standard for Alzheimer's disease classifications, we actually implemented all twelve coarse-grained and fine-grained classifications. The results show that the proposed method achieves solidly high accuracy for them. Its classification ability greatly exceeds any kind of existing Alzheimer's disease classification method.
Collapse
|
8
|
Morsy SE, Zayed N, Yassine IA. Hierarchical based classification method based on fusion of Gaussian map descriptors for Alzheimer diagnosis using T 1-weighted magnetic resonance imaging. Sci Rep 2023; 13:13734. [PMID: 37612307 PMCID: PMC10447428 DOI: 10.1038/s41598-023-40635-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 08/14/2023] [Indexed: 08/25/2023] Open
Abstract
Alzheimer's disease (AD) is considered one of the most spouting elderly diseases. In 2015, AD is reported the US's sixth cause of death. Substantially, non-invasive imaging is widely employed to provide biomarkers supporting AD screening, diagnosis, and progression. In this study, Gaussian descriptors-based features are proposed to be efficient new biomarkers using Magnetic Resonance Imaging (MRI) T1-weighted images to differentiate between Alzheimer's disease (AD), Mild Cognitive Impairment (MCI), and Normal controls (NC). Several Gaussian map-based features are extracted such as Gaussian shape operator, Gaussian curvature, and mean curvature. The aforementioned features are then introduced to the Support Vector Machine (SVM). They were, first, calculated separately for the Hippocampus and Amygdala. Followed by the fusion of the features. Moreover, Fusion of the regions before feature extraction was also employed. Alzheimer's disease Neuroimaging Initiative (ADNI) dataset, formed of 45, 55, and 65 cases for AD, MCI, and NC respectively, is appointed in this study. The shape operator feature outperformed the other features, with 74.6%, and 98.9% accuracy in the case of normal vs. abnormal, and AD vs. MCI classification respectively.
Collapse
Affiliation(s)
- Shereen E Morsy
- Systems and Biomedical Engineering, Cairo University, Cairo, Egypt
| | - Nourhan Zayed
- Computer and Systems Department, Electronics Research Institute, Cairo, Egypt.
- Mechanical Engineering Department, The British University in Egypt, Cairo, Egypt.
| | - Inas A Yassine
- Systems and Biomedical Engineering, Cairo University, Cairo, Egypt
| |
Collapse
|
9
|
Azeem M, Javaid S, Khalil RA, Fahim H, Althobaiti T, Alsharif N, Saeed N. Neural Networks for the Detection of COVID-19 and Other Diseases: Prospects and Challenges. Bioengineering (Basel) 2023; 10:850. [PMID: 37508877 PMCID: PMC10416184 DOI: 10.3390/bioengineering10070850] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 07/09/2023] [Accepted: 07/12/2023] [Indexed: 07/30/2023] Open
Abstract
Artificial neural networks (ANNs) ability to learn, correct errors, and transform a large amount of raw data into beneficial medical decisions for treatment and care has increased in popularity for enhanced patient safety and quality of care. Therefore, this paper reviews the critical role of ANNs in providing valuable insights for patients' healthcare decisions and efficient disease diagnosis. We study different types of ANNs in the existing literature that advance ANNs' adaptation for complex applications. Specifically, we investigate ANNs' advances for predicting viral, cancer, skin, and COVID-19 diseases. Furthermore, we propose a deep convolutional neural network (CNN) model called ConXNet, based on chest radiography images, to improve the detection accuracy of COVID-19 disease. ConXNet is trained and tested using a chest radiography image dataset obtained from Kaggle, achieving more than 97% accuracy and 98% precision, which is better than other existing state-of-the-art models, such as DeTraC, U-Net, COVID MTNet, and COVID-Net, having 93.1%, 94.10%, 84.76%, and 90% accuracy and 94%, 95%, 85%, and 92% precision, respectively. The results show that the ConXNet model performed significantly well for a relatively large dataset compared with the aforementioned models. Moreover, the ConXNet model reduces the time complexity by using dropout layers and batch normalization techniques. Finally, we highlight future research directions and challenges, such as the complexity of the algorithms, insufficient available data, privacy and security, and integration of biosensing with ANNs. These research directions require considerable attention for improving the scope of ANNs for medical diagnostic and treatment applications.
Collapse
Affiliation(s)
- Muhammad Azeem
- School of Science, Engineering & Environment, University of Salford, Manchester M5 4WT, UK;
| | - Shumaila Javaid
- Department of Control Science and Engineering, College of Electronics and Information Engineering, Tongji University, Shanghai 201804, China; (S.J.); (H.F.)
| | - Ruhul Amin Khalil
- Department of Electrical Engineering, University of Engineering and Technology, Peshawar 25120, Pakistan;
- Department of Electrical and Communication Engineering, United Arab Emirates University (UAEU), Al-Ain 15551, United Arab Emirates
| | - Hamza Fahim
- Department of Control Science and Engineering, College of Electronics and Information Engineering, Tongji University, Shanghai 201804, China; (S.J.); (H.F.)
| | - Turke Althobaiti
- Department of Computer Science, Faculty of Science, Northern Border University, Arar 73222, Saudi Arabia;
| | - Nasser Alsharif
- Department of Administrative and Financial Sciences, Ranyah University Collage, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia;
| | - Nasir Saeed
- Department of Electrical and Communication Engineering, United Arab Emirates University (UAEU), Al-Ain 15551, United Arab Emirates
| |
Collapse
|
10
|
Tang C, Wei M, Sun J, Wang S, Zhang Y. CsAGP: Detecting Alzheimer's disease from multimodal images via dual-transformer with cross-attention and graph pooling. JOURNAL OF KING SAUD UNIVERSITY. COMPUTER AND INFORMATION SCIENCES 2023; 35:101618. [PMID: 38559705 PMCID: PMC7615783 DOI: 10.1016/j.jksuci.2023.101618] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Alzheimer's disease (AD) is a terrible and degenerative disease commonly occurring in the elderly. Early detection can prevent patients from further damage, which is crucial in treating AD. Over the past few decades, it has been demonstrated that neuroimaging can be a critical diagnostic tool for AD, and the feature fusion of different neuroimaging modalities can enhance diagnostic performance. Most previous studies in multimodal feature fusion have only concatenated the high-level features extracted by neural networks from various neuroimaging images simply. However, a major problem of these studies is over-looking the low-level feature interactions between modalities in the feature extraction stage, resulting in suboptimal performance in AD diagnosis. In this paper, we develop a dual-branch vision transformer with cross-attention and graph pooling, namely CsAGP, which enables multi-level feature interactions between the inputs to learn a shared feature representation. Specifically, we first construct a brand-new cross-attention fusion module (CAFM), which processes MRI and PET images by two independent branches of differing computational complexity. These features are fused merely by the cross-attention mechanism to enhance each other. After that, a concise graph pooling algorithm-based Reshape-Pooling-Reshape (RPR) framework is developed for token selection to reduce token redundancy in the proposed model. Extensive experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) database demonstrated that the suggested method obtains 99.04%, 97.43%, 98.57%, and 98.72% accuracy for the classification of AD vs. CN, AD vs. MCI, CN vs. MCI, and AD vs. CN vs. MCI, respectively.
Collapse
Affiliation(s)
- Chaosheng Tang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
| | - Mingyang Wei
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
| | - Junding Sun
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
| | - Shuihua Wang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Yudong Zhang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan 454000, PR China
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | | |
Collapse
|
11
|
Zhang N, Zeng Z, Jin Y. Guest editorial: Robust, explainable, and privacy-preserving deep learning. Knowl Based Syst 2023. [DOI: 10.1016/j.knosys.2023.110287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
|
12
|
Cobbinah BM, Sorg C, Yang Q, Ternblom A, Zheng C, Han W, Che L, Shao J. Reducing variations in multi-center Alzheimer's disease classification with convolutional adversarial autoencoder. Med Image Anal 2022; 82:102585. [PMID: 36057187 DOI: 10.1016/j.media.2022.102585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Revised: 07/22/2022] [Accepted: 08/15/2022] [Indexed: 11/29/2022]
Abstract
Based on brain magnetic resonance imaging (MRI), multiple variations ranging from MRI scanners to center-specific parameter settings, imaging protocols, and brain region-of-interest (ROI) definitions pose a big challenge for multi-center Alzheimer's disease characterization and classification. Existing approaches to reduce such variations require intricate multi-step, often manual preprocessing pipelines, including skull stripping, segmentation, registration, cortical reconstruction, and ROI outlining. Such procedures are time-consuming, and more importantly, tend to be user biased. Contrasting costly and biased preprocessing pipelines, the question arises whether we can design a deep learning model to automatically reduce these variations from multiple centers for Alzheimer's disease classification? In this study, we used T1 and T2-weighted structural MRI from Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset based on three groups with 375 subjects, respectively: patients with Alzheimer's disease (AD) dementia, with mild cognitive impairment (MCI), and healthy controls (HC); to test our approach, we defined AD classification as classifying an individual's structural image to one of the three group labels. We first introduced a convolutional adversarial autoencoder (CAAE) to reduce the variations existing in multi-center raw MRI scans by automatically registering them into a common aligned space. Afterward, a convolutional residual soft attention network (CRAT) was further proposed for AD classification. Canonical classification procedures demonstrated that our model achieved classification accuracies of 91.8%, 90.05%, and 88.10% for the 2-way classification tasks using the RAW aligned MRI scans, including AD vs. HC, AD vs. MCI, and MCI vs. HC, respectively. Thus, our automated approach achieves comparable or even better classification performance by comparing it with many baselines with dedicated conventional preprocessing pipelines. Furthermore, the uncovered brain hotpots, i.e., hippocampus, amygdala, and temporal pole, are consistent with previous studies.
Collapse
Affiliation(s)
- Bernard M Cobbinah
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Christian Sorg
- Department of Neuroradiology, TUM-NIC Neuroimaging Center of Technical University Munich, Germany
| | - Qinli Yang
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Arvid Ternblom
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Changgang Zheng
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Wei Han
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Liwei Che
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China
| | - Junming Shao
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731 Chengdu, China; Center for Information in BioMedicine, University of Electronic Science and Technology of China, 611731 Chengdu, China; Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China, Huzhou 313001, China.
| |
Collapse
|
13
|
Khojaste-Sarakhsi M, Haghighi SS, Ghomi SF, Marchiori E. Deep learning for Alzheimer's disease diagnosis: A survey. Artif Intell Med 2022; 130:102332. [DOI: 10.1016/j.artmed.2022.102332] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 04/29/2022] [Accepted: 05/30/2022] [Indexed: 11/28/2022]
|
14
|
Zhang J, He X, Qing L, Xu Y, Liu Y, Chen H. Multi-scale discriminative regions analysis in FDG-PET imaging for early diagnosis of Alzheimer's disease. J Neural Eng 2022; 19. [PMID: 35882218 DOI: 10.1088/1741-2552/ac8450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 07/26/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Alzheimer's disease (AD) is a degenerative brain disorder, one of the main causes of death in elderly people, so early diagnosis of AD is vital to prompt access to medication and medical care. Fluorodeoxyglucose positron emission tomography (FDG-PET) proves to be effective to help understand neurological changes via measuring glucose uptake. Our aim is to explore information-rich regions of FDG-PET imaging, which enhance the accuracy and interpretability of AD-related diagnosis. APPROACH We develop a novel method for early diagnosis of AD based on multi-scale discriminative regions in FDG-PET imaging, which considers the diagnosis interpretability. Specifically, a multi-scale region localization (MSRL) module is discussed to automatically identify disease-related discriminative regions in full-volume FDG-PET images in an unsupervised manner, upon which a confidence score is designed to evaluate the prioritization of regions according to the density distribution of anomalies. Then, the proposed multi-scale region classification (MSRC) module adaptively fuses multi-scale region representations and makes decision fusion, which not only reduces useless information but also offers complementary information. Most of previous methods concentrate on discriminating AD from cognitively normal (CN), while mild cognitive impairment (MCI), a transitional state, facilitates early diagnosis. Therefore, our method is further applied to multiple AD-related diagnosis tasks, not limited to AD vs. CN. MAIN RESULTS Experimental results on the ADNI dataset show that the proposed method achieves superior performance over state-of-the-art FDG-PET-based approaches. Besides, some cerebral cortices highlighted by extracted regions cohere with medical research, further demonstrating the superiority. SIGNIFICANCE This work offers an effective method to achieve AD diagnosis and detect disease-affected regions in FDG-PET imaging. Our results could be beneficial for providing an additional opinion on the clinical diagnosis.
Collapse
Affiliation(s)
- Jin Zhang
- Sichuan University, College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China, Chengdu, Sichuan, 610065, CHINA
| | - Xiaohai He
- Sichuan University, College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China, Chengdu, Sichuan, 610065, CHINA
| | - Linbo Qing
- Sichuan University, College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China, Chengdu, Sichuan, 610065, CHINA
| | - Yining Xu
- Sichuan University, College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China, Chengdu, Sichuan, 610065, CHINA
| | - Yan Liu
- Chengdu Third People's Hospital, Department of Neurology, The Affiliated Hospital of Southwest Jiaotong University, The Third People's Hospital of Chengdu, Chengdu, Sichuan, China, Chengdu, Sichuan, 610014, CHINA
| | - Honggang Chen
- Sichuan University, College of Electronics and Information Engineering, Sichuan University, Chengdu, Sichuan, China, Chengdu, Sichuan, 610065, CHINA
| |
Collapse
|
15
|
Feng Y, Zheng R, Cui X, Wang T, Jiang T, Gao F, Cao J. 3D residual-attention-deep-network-based childhood epilepsy syndrome classification. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.108856] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
16
|
Fathi S, Ahmadi M, Dehnad A. Early diagnosis of Alzheimer's disease based on deep learning: A systematic review. Comput Biol Med 2022; 146:105634. [DOI: 10.1016/j.compbiomed.2022.105634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 04/25/2022] [Accepted: 04/25/2022] [Indexed: 11/03/2022]
|
17
|
Research on Image Segmentation Algorithm Based on Multimodal Hierarchical Attention Mechanism and Genetic Neural Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:9980928. [PMID: 35707183 PMCID: PMC9192265 DOI: 10.1155/2022/9980928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 04/11/2022] [Accepted: 05/05/2022] [Indexed: 11/24/2022]
Abstract
Multimodal tasks based on attention mechanism and language face numerous problems. Based on multimodal hierarchical attention mechanism and genetic neural network, this paper studies the application of image segmentation algorithm in data completion and 3D scene reconstruction. The algorithm refers to the process of concentrating attention that humans subjectively pay attention to and calculates the difference between each pixel in the genetic neural network test image in the color space and the average value of the target image, which solves the problem of static feature maps and dynamic feature maps of image sequences. In addition, in view of the problem that the number of attention enhancement feature extraction modules is too large and the parameters are too large, the recursive mechanism is used as the feature extraction branch, and new model parameters are not added when the network depth is increased. The simulation results show that the accuracy of the improved image saliency detection algorithm based on the attention mechanism reaches 89.7%, and the difference between the average value of the single-point pixel and the target image is reduced to 0.132, which further promotes the practicability and reliability of the image segmentation model.
Collapse
|
18
|
Baghdadi NA, Malki A, Balaha HM, Badawy M, Elhosseini M. A 3C-TL-GTO: Alzheimer Automatic Accurate Classification Using Transfer Learning and Artificial Gorilla Troops Optimizer. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22114250. [PMID: 35684871 PMCID: PMC9185328 DOI: 10.3390/s22114250] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 05/24/2022] [Accepted: 05/28/2022] [Indexed: 05/10/2023]
Abstract
Alzheimer's disease (AD) is a chronic disease that affects the elderly. There are many different types of dementia, but Alzheimer's disease is one of the leading causes of death. AD is a chronic brain disorder that leads to problems with language, disorientation, mood swings, bodily functions, memory loss, cognitive decline, mood or personality changes, and ultimately death due to dementia. Unfortunately, no cure has yet been developed for it, and it has no known causes. Clinically, imaging tools can aid in the diagnosis, and deep learning has recently emerged as an important component of these tools. Deep learning requires little or no image preprocessing and can infer an optimal data representation from raw images without prior feature selection. As a result, they produce a more objective and less biased process. The performance of a convolutional neural network (CNN) is primarily affected by the hyperparameters chosen and the dataset used. A deep learning model for classifying Alzheimer's patients has been developed using transfer learning and optimized by Gorilla Troops for early diagnosis. This study proposes the A3C-TL-GTO framework for MRI image classification and AD detection. The A3C-TL-GTO is an empirical quantitative framework for accurate and automatic AD classification, developed and evaluated with the Alzheimer's Dataset (four classes of images) and the Alzheimer's Disease Neuroimaging Initiative (ADNI). The proposed framework reduces the bias and variability of preprocessing steps and hyperparameters optimization to the classifier model and dataset used. Our strategy, evaluated on MRIs, is easily adaptable to other imaging methods. According to our findings, the proposed framework was an excellent instrument for this task, with a significant potential advantage for patient care. The ADNI dataset, an online dataset on Alzheimer's disease, was used to obtain magnetic resonance imaging (MR) brain images. The experimental results demonstrate that the proposed framework achieves 96.65% accuracy for the Alzheimer's Dataset and 96.25% accuracy for the ADNI dataset. Moreover, a better performance in terms of accuracy is demonstrated over other state-of-the-art approaches.
Collapse
Affiliation(s)
- Nadiah A. Baghdadi
- College of Nursing, Princess Nourah Bint Abdulrahman University, Riyadh 11671, Saudi Arabia;
| | - Amer Malki
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia; (A.M.); (M.E.)
| | - Hossam Magdy Balaha
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| | - Mahmoud Badawy
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
- Correspondence:
| | - Mostafa Elhosseini
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia; (A.M.); (M.E.)
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| |
Collapse
|