1
|
Mehmood A, Shahid F, Khan R, Ibrahim MM, Zheng Z. Utilizing Siamese 4D-AlzNet and Transfer Learning to Identify Stages of Alzheimer's Disease. Neuroscience 2024; 545:69-85. [PMID: 38492797 DOI: 10.1016/j.neuroscience.2024.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 03/05/2024] [Accepted: 03/10/2024] [Indexed: 03/18/2024]
Abstract
Alzheimer's disease (AD) is the general form of dementia, leading to a progressive neurological disorder characterized by memory loss due to brain cell damage. Artificial Intelligence (AI) assists in the early identification and prediction of AD patients, determining future risks and benefits for radiologists and doctors to save time and cost. Since deep learning (DL) approaches work well with massive datasets and have recently become helpful for AD detection, there remains an area for improvement in automating detection performance. Present approaches somehow addressed the challenges of limited annotated data samples for binary classification. This contrasts with prior state-of-the-art techniques, which were constrained by their incapacity to capture abstract-level information. In this paper, we proposed a Siamese 4D-AlzNet model comprised of four parallel convolutional neural network (CNN) streams (Five CNN layer blocks) and customized transfer learning models (Frozen VGG-19, Frozen VGG-16, and customized AlexNet). Siamese 4D-AlzNet was vertically and horizontally stored, and the spatial features were passed to the final layer for classification. For experiments, T1-weighted MRI images comprised of four distinct subject classes, normal control (NC), mild cognitive impairment (MCI), late mild cognitive impairment (LMCI), and AD, have been employed. Our proposed models achieved outstanding accuracy, with a remarkable 95.05% accuracy distinguishing between normal and AD subjects. The performance across remaining binary class pairs consistently exceeded 90%. We thoroughly compared our model with the latest methods using the same dataset as our reference. Our proposed model improved NC-AD and MCI-AD classification accuracy by 2% 7%.
Collapse
Affiliation(s)
- Atif Mehmood
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; Zhejiang Institute of Photoelectronics & Zhejiang Institute for Advanced Light Source, Zhejiang Normal University, Jinhua, Zhejiang 321004, China
| | - Farah Shahid
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China; Zhejiang Institute of Photoelectronics & Zhejiang Institute for Advanced Light Source, Zhejiang Normal University, Jinhua, Zhejiang 321004, China.
| | - Rizwan Khan
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China
| | - Mostafa M Ibrahim
- Department of Electrical Engineering, Faculty of Engineering, Minia University, Minia 61519, Egypt
| | - Zhonglong Zheng
- School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China.
| |
Collapse
|
2
|
Alp S, Akan T, Bhuiyan MS, Disbrow EA, Conrad SA, Vanchiere JA, Kevil CG, Bhuiyan MAN. Joint transformer architecture in brain 3D MRI classification: its application in Alzheimer's disease classification. Sci Rep 2024; 14:8996. [PMID: 38637671 PMCID: PMC11026447 DOI: 10.1038/s41598-024-59578-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 04/12/2024] [Indexed: 04/20/2024] Open
Abstract
Alzheimer's disease (AD), a neurodegenerative disease that mostly affects the elderly, slowly impairs memory, cognition, and daily tasks. AD has long been one of the most debilitating chronic neurological disorders, affecting mostly people over 65. In this study, we investigated the use of Vision Transformer (ViT) for Magnetic Resonance Image processing in the context of AD diagnosis. ViT was utilized to extract features from MRIs, map them to a feature sequence, perform sequence modeling to maintain interdependencies, and classify features using a time series transformer. The proposed model was evaluated using ADNI T1-weighted MRIs for binary and multiclass classification. Two data collections, Complete 1Yr 1.5T and Complete 3Yr 3T, from the ADNI database were used for training and testing. A random split approach was used, allocating 60% for training and 20% for testing and validation, resulting in sample sizes of (211, 70, 70) and (1378, 458, 458), respectively. The performance of our proposed model was compared to various deep learning models, including CNN with BiL-STM and ViT with Bi-LSTM. The suggested technique diagnoses AD with high accuracy (99.048% for binary and 99.014% for multiclass classification), precision, recall, and F-score. Our proposed method offers researchers an approach to more efficient early clinical diagnosis and interventions.
Collapse
Affiliation(s)
- Sait Alp
- Department of Computer Engineering, Erzurum Technical University, Erzurum, Turkey
| | - Taymaz Akan
- Division of Clinical Informatics, Department of Medicine, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Center for Brain Health, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
| | - Md Shenuarin Bhuiyan
- Department of Pathology and Translational Pathobiology, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
| | - Elizabeth A Disbrow
- Center for Brain Health, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Department of Pharmacology, Toxicology and Neuroscience, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Department of Neurology, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Department of Psychiatry, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
| | - Steven A Conrad
- Division of Clinical Informatics, Department of Medicine, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Department of Pediatrics, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
| | - John A Vanchiere
- Department of Pharmacology, Toxicology and Neuroscience, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Department of Pediatrics, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
| | - Christopher G Kevil
- Department of Pathology and Translational Pathobiology, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
- Department of Molecular and Cellular Physiology, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA
| | - Mohammad A N Bhuiyan
- Division of Clinical Informatics, Department of Medicine, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA.
- Center for Brain Health, Louisiana State University Health Sciences Center - Shreveport, Shreveport, LA, 71103-4228, USA.
| |
Collapse
|
3
|
El-Assy AM, Amer HM, Ibrahim HM, Mohamed MA. A novel CNN architecture for accurate early detection and classification of Alzheimer's disease using MRI data. Sci Rep 2024; 14:3463. [PMID: 38342924 PMCID: PMC10859371 DOI: 10.1038/s41598-024-53733-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 02/04/2024] [Indexed: 02/13/2024] Open
Abstract
Alzheimer's disease (AD) is a debilitating neurodegenerative disorder that requires accurate diagnosis for effective management and treatment. In this article, we propose an architecture for a convolutional neural network (CNN) that utilizes magnetic resonance imaging (MRI) data from the Alzheimer's disease Neuroimaging Initiative (ADNI) dataset to categorize AD. The network employs two separate CNN models, each with distinct filter sizes and pooling layers, which are concatenated in a classification layer. The multi-class problem is addressed across three, four, and five categories. The proposed CNN architecture achieves exceptional accuracies of 99.43%, 99.57%, and 99.13%, respectively. These high accuracies demonstrate the efficacy of the network in capturing and discerning relevant features from MRI images, enabling precise classification of AD subtypes and stages. The network architecture leverages the hierarchical nature of convolutional layers, pooling layers, and fully connected layers to extract both local and global patterns from the data, facilitating accurate discrimination between different AD categories. Accurate classification of AD carries significant clinical implications, including early detection, personalized treatment planning, disease monitoring, and prognostic assessment. The reported accuracy underscores the potential of the proposed CNN architecture to assist medical professionals and researchers in making precise and informed judgments regarding AD patients.
Collapse
Affiliation(s)
- A M El-Assy
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt.
| | - Hanan M Amer
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - H M Ibrahim
- Communication and Electronics Engineering Department, Nile Higher Institute for Engineering and Technology-IEEE Com Society Member, Mansoura, Egypt
| | - M A Mohamed
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
4
|
Nguyen HH, Blaschko MB, Saarakkala S, Tiulpin A. Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting From Multimodal Data. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:529-541. [PMID: 37672368 PMCID: PMC10880139 DOI: 10.1109/tmi.2023.3312524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/08/2023]
Abstract
Deep neural networks are often applied to medical images to automate the problem of medical diagnosis. However, a more clinically relevant question that practitioners usually face is how to predict the future trajectory of a disease. Current methods for prognosis or disease trajectory forecasting often require domain knowledge and are complicated to apply. In this paper, we formulate the prognosis prediction problem as a one-to-many prediction problem. Inspired by a clinical decision-making process with two agents-a radiologist and a general practitioner - we predict prognosis with two transformer-based components that share information with each other. The first transformer in this framework aims to analyze the imaging data, and the second one leverages its internal states as inputs, also fusing them with auxiliary clinical data. The temporal nature of the problem is modeled within the transformer states, allowing us to treat the forecasting problem as a multi-task classification, for which we propose a novel loss. We show the effectiveness of our approach in predicting the development of structural knee osteoarthritis changes and forecasting Alzheimer's disease clinical status directly from raw multi-modal data. The proposed method outperforms multiple state-of-the-art baselines with respect to performance and calibration, both of which are needed for real-world applications. An open-source implementation of our method is made publicly available at https://github.com/Oulu-IMEDS/CLIMATv2.
Collapse
|
5
|
Champendal M, Müller H, Prior JO, Dos Reis CS. A scoping review of interpretability and explainability concerning artificial intelligence methods in medical imaging. Eur J Radiol 2023; 169:111159. [PMID: 37976760 DOI: 10.1016/j.ejrad.2023.111159] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 09/26/2023] [Accepted: 10/19/2023] [Indexed: 11/19/2023]
Abstract
PURPOSE To review eXplainable Artificial Intelligence/(XAI) methods available for medical imaging/(MI). METHOD A scoping review was conducted following the Joanna Briggs Institute's methodology. The search was performed on Pubmed, Embase, Cinhal, Web of Science, BioRxiv, MedRxiv, and Google Scholar. Studies published in French and English after 2017 were included. Keyword combinations and descriptors related to explainability, and MI modalities were employed. Two independent reviewers screened abstracts, titles and full text, resolving differences through discussion. RESULTS 228 studies met the criteria. XAI publications are increasing, targeting MRI (n = 73), radiography (n = 47), CT (n = 46). Lung (n = 82) and brain (n = 74) pathologies, Covid-19 (n = 48), Alzheimer's disease (n = 25), brain tumors (n = 15) are the main pathologies explained. Explanations are presented visually (n = 186), numerically (n = 67), rule-based (n = 11), textually (n = 11), and example-based (n = 6). Commonly explained tasks include classification (n = 89), prediction (n = 47), diagnosis (n = 39), detection (n = 29), segmentation (n = 13), and image quality improvement (n = 6). The most frequently provided explanations were local (78.1 %), 5.7 % were global, and 16.2 % combined both local and global approaches. Post-hoc approaches were predominantly employed. The used terminology varied, sometimes indistinctively using explainable (n = 207), interpretable (n = 187), understandable (n = 112), transparent (n = 61), reliable (n = 31), and intelligible (n = 3). CONCLUSION The number of XAI publications in medical imaging is increasing, primarily focusing on applying XAI techniques to MRI, CT, and radiography for classifying and predicting lung and brain pathologies. Visual and numerical output formats are predominantly used. Terminology standardisation remains a challenge, as terms like "explainable" and "interpretable" are sometimes being used indistinctively. Future XAI development should consider user needs and perspectives.
Collapse
Affiliation(s)
- Mélanie Champendal
- School of Health Sciences HESAV, HES-SO, University of Applied Sciences Western Switzerland, Lausanne, CH, Switzerland; Faculty of Biology and Medicine, University of Lausanne, Lausanne, CH, Switzerland.
| | - Henning Müller
- Informatics Institute, University of Applied Sciences Western Switzerland (HES-SO Valais) Sierre, CH, Switzerland; Medical faculty, University of Geneva, CH, Switzerland.
| | - John O Prior
- Faculty of Biology and Medicine, University of Lausanne, Lausanne, CH, Switzerland; Nuclear Medicine and Molecular Imaging Department, Lausanne University Hospital (CHUV), Lausanne, CH, Switzerland.
| | - Cláudia Sá Dos Reis
- School of Health Sciences HESAV, HES-SO, University of Applied Sciences Western Switzerland, Lausanne, CH, Switzerland.
| |
Collapse
|
6
|
Odusami M, Maskeliūnas R, Damaševičius R. Optimized Convolutional Fusion for Multimodal Neuroimaging in Alzheimer's Disease Diagnosis: Enhancing Data Integration and Feature Extraction. J Pers Med 2023; 13:1496. [PMID: 37888107 PMCID: PMC10608760 DOI: 10.3390/jpm13101496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 09/28/2023] [Accepted: 10/12/2023] [Indexed: 10/28/2023] Open
Abstract
Multimodal neuroimaging has gained traction in Alzheimer's Disease (AD) diagnosis by integrating information from multiple imaging modalities to enhance classification accuracy. However, effectively handling heterogeneous data sources and overcoming the challenges posed by multiscale transform methods remains a significant hurdle. This article proposes a novel approach to address these challenges. To harness the power of diverse neuroimaging data, we employ a strategy that leverages optimized convolution techniques. These optimizations include varying kernel sizes and the incorporation of instance normalization, both of which play crucial roles in feature extraction from magnetic resonance imaging (MRI) and positron emission tomography (PET) images. Specifically, varying kernel sizes allow us to adapt the receptive field to different image characteristics, enhancing the model's ability to capture relevant information. Furthermore, we employ transposed convolution, which increases spatial resolution of feature maps, and it is optimized with varying kernel sizes and instance normalization. This heightened resolution facilitates the alignment and integration of data from disparate MRI and PET data. The use of larger kernels and strides in transposed convolution expands the receptive field, enabling the model to capture essential cross-modal relationships. Instance normalization, applied to each modality during the fusion process, mitigates potential biases stemming from differences in intensity, contrast, or scale between modalities. This enhancement contributes to improved model performance by reducing complexity and ensuring robust fusion. The performance of the proposed fusion method is assessed on three distinct neuroimaging datasets, which include: Alzheimer's Disease Neuroimaging Initiative (ADNI), consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, AD, and Early Mild Cognitive); Open Access Series of Imaging Studies (OASIS), consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, Mild Dementia, Very Mild Dementia); and whole-brain atlas neuroimaging (AANLIB) (consisting of 50 participants each at various stages of AD for both MRI and PET (Cognitive Normal, AD). To evaluate the quality of the fused images generated via our method, we employ a comprehensive set of evaluation metrics, including Structural Similarity Index Measurement (SSIM), which assesses the structural similarity between two images; Peak Signal-to-Noise Ratio (PSNR), which measures how closely the generated image resembles the ground truth; Entropy (E), which assesses the amount of information preserved or lost during fusion; the Feature Similarity Indexing Method (FSIM), which assesses the structural and feature similarities between two images; and Edge-Based Similarity (EBS), which measures the similarity of edges between the fused and ground truth images. The obtained fused image is further evaluated using a Mobile Vision Transformer. In the classification of AD vs. Cognitive Normal, the model achieved an accuracy of 99.00%, specificity of 99.00%, and sensitivity of 98.44% on the AANLIB dataset.
Collapse
Affiliation(s)
- Modupe Odusami
- Department of Multimedia Engineering, Kaunas University of Technology, 51423 Kaunas, Lithuania
| | - Rytis Maskeliūnas
- Department of Multimedia Engineering, Kaunas University of Technology, 51423 Kaunas, Lithuania
| | - Robertas Damaševičius
- Department of Applied Informatics, Vytautas Magnus University, 53361 Kaunas, Lithuania
| |
Collapse
|
7
|
Mohamed AA, Marques O. Diagnostic Efficacy and Clinical Relevance of Artificial Intelligence in Detecting Cognitive Decline. Cureus 2023; 15:e47004. [PMID: 37965412 PMCID: PMC10641267 DOI: 10.7759/cureus.47004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/13/2023] [Indexed: 11/16/2023] Open
Abstract
Cognitive impairment is an age-associated disorder of increasing prevalence as the aging population continues to grow. Classified based on the level of cognitive decline, memory, function, and capacity to conduct activities of daily living, cognitive impairment ranges from mild cognitive impairment to dementia. When considering the insidious nature of the etiologies responsible for varying degrees of cognitive impairment, early diagnosis may provide a clinical benefit through the facilitation of early treatment. Typical diagnosis relies heavily on evaluation in a primary care setting. However, there is evidence that other diagnostic tools may aid in an earlier diagnosis of the different underlying pathologies responsible for cognitive impairment. Artificial intelligence represents a new intersecting field with healthcare that may aid in the early detection of neurodegenerative disorders. When assessing the role of AI in detecting cognitive decline, it is important to consider both the diagnostic efficacy of AI algorithms and the clinical relevance and impact of early interventions as a result of early detection. Thus, this review highlights promising investigations and developments in the space of artificial intelligence and healthcare and their potential to impact patient outcomes.
Collapse
Affiliation(s)
- Ali A Mohamed
- Neurological Surgery, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, USA
- Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, USA
| | - Oge Marques
- Biomedical Sciences, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, USA
- Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, USA
| |
Collapse
|
8
|
Odusami M, Maskeliūnas R, Damaševičius R. Pareto Optimized Adaptive Learning with Transposed Convolution for Image Fusion Alzheimer's Disease Classification. Brain Sci 2023; 13:1045. [PMID: 37508977 PMCID: PMC10377099 DOI: 10.3390/brainsci13071045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 06/30/2023] [Accepted: 07/04/2023] [Indexed: 07/30/2023] Open
Abstract
Alzheimer's disease (AD) is a neurological condition that gradually weakens the brain and impairs cognition and memory. Multimodal imaging techniques have become increasingly important in the diagnosis of AD because they can help monitor disease progression over time by providing a more complete picture of the changes in the brain that occur over time in AD. Medical image fusion is crucial in that it combines data from various image modalities into a single, better-understood output. The present study explores the feasibility of employing Pareto optimized deep learning methodologies to integrate Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) images through the utilization of pre-existing models, namely the Visual Geometry Group (VGG) 11, VGG16, and VGG19 architectures. Morphological operations are carried out on MRI and PET images using Analyze 14.0 software and after which PET images are manipulated for the desired angle of alignment with MRI image using GNU Image Manipulation Program (GIMP). To enhance the network's performance, transposed convolution layer is incorporated into the previously extracted feature maps before image fusion. This process generates feature maps and fusion weights that facilitate the fusion process. This investigation concerns the assessment of the efficacy of three VGG models in capturing significant features from the MRI and PET data. The hyperparameters of the models are tuned using Pareto optimization. The models' performance is evaluated on the ADNI dataset utilizing the Structure Similarity Index Method (SSIM), Peak Signal-to-Noise Ratio (PSNR), Mean-Square Error (MSE), and Entropy (E). Experimental results show that VGG19 outperforms VGG16 and VGG11 with an average of 0.668, 0.802, and 0.664 SSIM for CN, AD, and MCI stages from ADNI (MRI modality) respectively. Likewise, an average of 0.669, 0.815, and 0.660 SSIM for CN, AD, and MCI stages from ADNI (PET modality) respectively.
Collapse
Affiliation(s)
- Modupe Odusami
- Faculty of Informatics, Kaunas University of Technology, 51368 Kaunas, Lithuania
| | - Rytis Maskeliūnas
- Faculty of Informatics, Kaunas University of Technology, 51368 Kaunas, Lithuania
| | - Robertas Damaševičius
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
| |
Collapse
|
9
|
Tian X, Liu Y, Wang L, Zeng X, Huang Y, Wang Z. An extensible hierarchical graph convolutional network for early Alzheimer's disease identification. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 238:107597. [PMID: 37216716 DOI: 10.1016/j.cmpb.2023.107597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 04/30/2023] [Accepted: 05/10/2023] [Indexed: 05/24/2023]
Abstract
BACKGROUND AND OBJECTIVE For early identification of Alzheimer's disease (AD) based on multi-modal magnetic resonance imaging (MRI) data, it is important to make comprehensive use of image features and non-image information to analyze the gray matter atrophy and the structural/functional connectivity abnormalities for different courses of AD. METHODS In this study, we propose an extensible hierarchical graph convolutional network (EH-GCN) for early AD identification. Based on the extracted image features from multi-modal MRI data using the presented multi-branch residual network (ResNet), the brain regions-of-interests (ROIs) based GCN is built to extract structural and functional connectivity features between different ROIs of the brain. In order to further improve the performance of AD identification, an optimized spatial GCN is proposed as convolution operator in the population-based GCN to avoid rebuilding the graph network and take advantage of relationships between subjects. Finally, the proposed EH-GCN is built by embedding the image features and internal brain connectivity features into the spatial population-based GCN, which provides an extensible way to improve early AD identification performance by adding imaging features and non-image information from multi-modal data. RESULTS Experiments are performed on two datasets, which illustrate the effectiveness of the extracted structural/functional connectivity features and the high computational efficiency of the proposed method. The classification accuracy of AD vs NC, AD vs MCI and MCI vs NC classification tasks reaches 88.71%, 82.71% and 79.68% respectively. The extracted connectivity features between ROIs indicate that functional abnormalities are earlier than gray matter atrophy and abnormalities of structural connections, which is consistent with the clinical manifestations. The proposed method allows for the addition of other modal image features and non-image information from multi-modal data to continuously improve the performance of clinical data analysis. CONCLUSIONS The proposed method can help us comprehensively analyze the role of gray matter atrophy, the damage of white matter nerve fiber tracts and the degradation of functional connectivity for different courses of AD, which could be useful for further extraction of clinical biomarkers for early AD identification.
Collapse
Affiliation(s)
- Xu Tian
- School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China
| | - Yan Liu
- School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China.
| | - Ling Wang
- School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiangzhu Zeng
- Department of Radiology, Peking University Third Hospital, Beijing, China.
| | - Yulang Huang
- School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China
| | - Zeng Wang
- Department of Radiology, Peking University Third Hospital, Beijing, China
| |
Collapse
|
10
|
Hosseinzadeh M, Gorji A, Fathi Jouzdani A, Rezaeijo SM, Rahmim A, Salmanpour MR. Prediction of Cognitive Decline in Parkinson's Disease Using Clinical and DAT SPECT Imaging Features, and Hybrid Machine Learning Systems. Diagnostics (Basel) 2023; 13:diagnostics13101691. [PMID: 37238175 DOI: 10.3390/diagnostics13101691] [Citation(s) in RCA: 30] [Impact Index Per Article: 30.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 04/28/2023] [Accepted: 05/04/2023] [Indexed: 05/28/2023] Open
Abstract
BACKGROUND We aimed to predict Montreal Cognitive Assessment (MoCA) scores in Parkinson's disease patients at year 4 using handcrafted radiomics (RF), deep (DF), and clinical (CF) features at year 0 (baseline) applied to hybrid machine learning systems (HMLSs). METHODS 297 patients were selected from the Parkinson's Progressive Marker Initiative (PPMI) database. The standardized SERA radiomics software and a 3D encoder were employed to extract RFs and DFs from single-photon emission computed tomography (DAT-SPECT) images, respectively. The patients with MoCA scores over 26 were indicated as normal; otherwise, scores under 26 were indicated as abnormal. Moreover, we applied different combinations of feature sets to HMLSs, including the Analysis of Variance (ANOVA) feature selection, which was linked with eight classifiers, including Multi-Layer Perceptron (MLP), K-Neighbors Classifier (KNN), Extra Trees Classifier (ETC), and others. We employed 80% of the patients to select the best model in a 5-fold cross-validation process, and the remaining 20% were employed for hold-out testing. RESULTS For the sole usage of RFs and DFs, ANOVA and MLP resulted in averaged accuracies of 59 ± 3% and 65 ± 4% for 5-fold cross-validation, respectively, with hold-out testing accuracies of 59 ± 1% and 56 ± 2%, respectively. For sole CFs, a higher performance of 77 ± 8% for 5-fold cross-validation and a hold-out testing performance of 82 + 2% were obtained from ANOVA and ETC. RF+DF obtained a performance of 64 ± 7%, with a hold-out testing performance of 59 ± 2% through ANOVA and XGBC. Usage of CF+RF, CF+DF, and RF+DF+CF enabled the highest averaged accuracies of 78 ± 7%, 78 ± 9%, and 76 ± 8% for 5-fold cross-validation, and hold-out testing accuracies of 81 ± 2%, 82 ± 2%, and 83 ± 4%, respectively. CONCLUSIONS We demonstrated that CFs vitally contribute to predictive performance, and combining them with appropriate imaging features and HMLSs can result in the best prediction performance.
Collapse
Affiliation(s)
- Mahdi Hosseinzadeh
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC V5E 3J7, Canada
- Department of Electrical & Computer Engineering, University of Tarbiat Modares, Tehran 14115111, Iran
| | - Arman Gorji
- Neuroscience and Artificial Intelligence Research Group (NAIRG), Student Research Committee, Hamadan University of Medical Sciences, Hamadan 6517838736, Iran
| | - Ali Fathi Jouzdani
- Neuroscience and Artificial Intelligence Research Group (NAIRG), Student Research Committee, Hamadan University of Medical Sciences, Hamadan 6517838736, Iran
| | - Seyed Masoud Rezaeijo
- Department of Medical Physics, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz 6135715794, Iran
| | - Arman Rahmim
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
- Departments of Radiology and Physics, University of British Columbia, Vancouver, BC V6T 1Z4, Canada
| | - Mohammad R Salmanpour
- Technological Virtual Collaboration (TECVICO Corp.), Vancouver, BC V5E 3J7, Canada
- Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC V5Z 1L3, Canada
| |
Collapse
|
11
|
Khalid A, Senan EM, Al-Wagih K, Al-Azzam MMA, Alkhraisha ZM. Automatic Analysis of MRI Images for Early Prediction of Alzheimer's Disease Stages Based on Hybrid Features of CNN and Handcrafted Features. Diagnostics (Basel) 2023; 13:diagnostics13091654. [PMID: 37175045 PMCID: PMC10178535 DOI: 10.3390/diagnostics13091654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 05/02/2023] [Accepted: 05/05/2023] [Indexed: 05/15/2023] Open
Abstract
Alzheimer's disease (AD) is considered one of the challenges facing health care in the modern century; until now, there has been no effective treatment to cure it, but there are drugs to slow its progression. Therefore, early detection of Alzheimer's is vital to take needful measures before it develops into brain damage which cannot be treated. Magnetic resonance imaging (MRI) techniques have contributed to the diagnosis and prediction of its progression. MRI images require highly experienced doctors and radiologists, and the analysis of MRI images takes time to analyze each slice. Thus, deep learning techniques play a vital role in analyzing a huge amount of MRI images with high accuracy to detect Alzheimer's and predict its progression. Because of the similarities in the characteristics of the early stages of Alzheimer's, this study aimed to extract the features in several methods and integrate the features extracted from more than one method into the same features matrix. This study contributed to the development of three methodologies, each with two systems, with all systems aimed at achieving satisfactory accuracy for the detection of AD and predicting the stages of its progression. The first methodology is by Feed Forward Neural Network (FFNN) with the features of GoogLeNet and DenseNet-121 models separately. The second methodology is by FFNN network with combined features between GoogLeNet and Dense-121 models before and after high-dimensionality reduction of features using the Principal Component Analysis (PCA) algorithm. The third methodology is by FFNN network with combined features between GoogLeNet and Dense-121 models separately and features extracted by Discrete Wavelet Transform (DWT), Local Binary Pattern (LBP) and Gray Level Co-occurrence Matrix (GLCM) methods called handcrafted features. All systems yielded super results in detecting AD and predicting the stages of its progression. With the combined features of the DenseNet-121 and handcrafted, the FFNN achieved an accuracy of 99.7%, sensitivity of 99.64%, AUC of 99.56%, precision of 99.63%, and a specificity of 99.67%.
Collapse
Affiliation(s)
- Ahmed Khalid
- Computer Department, Applied College, Najran University, Najran 66462, Saudi Arabia
| | - Ebrahim Mohammed Senan
- Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, Alrazi University, Sana'a, Yemen
| | - Khalil Al-Wagih
- Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, Alrazi University, Sana'a, Yemen
| | | | | |
Collapse
|
12
|
Li H, Tan Y, Miao J, Liang P, Gong J, He H, Jiao Y, Zhang F, Xing Y, Wu D. Attention-based and micro designed EfficientNetB2 for diagnosis of Alzheimer’s disease. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
|
13
|
Moguilner S, Whelan R, Adams H, Valcour V, Tagliazucchi E, Ibáñez A. Visual deep learning of unprocessed neuroimaging characterises dementia subtypes and generalises across non-stereotypic samples. EBioMedicine 2023; 90:104540. [PMID: 36972630 PMCID: PMC10066533 DOI: 10.1016/j.ebiom.2023.104540] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 03/02/2023] [Accepted: 03/10/2023] [Indexed: 03/28/2023] Open
Abstract
BACKGROUND Dementia's diagnostic protocols are mostly based on standardised neuroimaging data collected in the Global North from homogeneous samples. In other non-stereotypical samples (participants with diverse admixture, genetics, demographics, MRI signals, or cultural origins), classifications of disease are difficult due to demographic and region-specific sample heterogeneities, lower quality scanners, and non-harmonised pipelines. METHODS We implemented a fully automatic computer-vision classifier using deep learning neural networks. A DenseNet was applied on raw (unpreprocessed) data from 3000 participants (behavioural variant frontotemporal dementia-bvFTD, Alzheimer's disease-AD, and healthy controls; both male and female as self-reported by participants). We tested our results in demographically matched and unmatched samples to discard possible biases and performed multiple out-of-sample validations. FINDINGS Robust classification results across all groups were achieved from standardised 3T neuroimaging data from the Global North, which also generalised to standardised 3T neuroimaging data from Latin America. Moreover, DenseNet also generalised to non-standardised, routine 1.5T clinical images from Latin America. These generalisations were robust in samples with heterogenous MRI recordings and were not confounded by demographics (i.e., were robust in both matched and unmatched samples, and when incorporating demographic variables in a multifeatured model). Model interpretability analysis using occlusion sensitivity evidenced core pathophysiological regions for each disease (mainly the hippocampus in AD, and the insula in bvFTD) demonstrating biological specificity and plausibility. INTERPRETATION The generalisable approach outlined here could be used in the future to aid clinician decision-making in diverse samples. FUNDING The specific funding of this article is provided in the acknowledgements section.
Collapse
Affiliation(s)
- Sebastian Moguilner
- Global Brain Health Institute (GBHI), University of California San Francisco (UCSF), San Francisco, CA, USA; Global Brain Health Institute (GBHI), Trinity College Dublin, Dublin, Ireland; Latin American Brain Health (BrainLat), Universidad Adolfo Ibáñez, Santiago, Chile; Cognitive Neuroscience Center (CNC), Universidad de San Andrés, Buenos Aires, Argentina; Department of Neurology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
| | - Robert Whelan
- Global Brain Health Institute (GBHI), University of California San Francisco (UCSF), San Francisco, CA, USA; Global Brain Health Institute (GBHI), Trinity College Dublin, Dublin, Ireland; Trinity College Institute of Neuroscience (TCIN), Trinity College Dublin, Dublin, Ireland
| | - Hieab Adams
- Latin American Brain Health (BrainLat), Universidad Adolfo Ibáñez, Santiago, Chile; Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Victor Valcour
- Global Brain Health Institute (GBHI), University of California San Francisco (UCSF), San Francisco, CA, USA; Global Brain Health Institute (GBHI), Trinity College Dublin, Dublin, Ireland
| | - Enzo Tagliazucchi
- Latin American Brain Health (BrainLat), Universidad Adolfo Ibáñez, Santiago, Chile; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina; Department of Physics, University of Buenos Aires, Caba, Argentina
| | - Agustín Ibáñez
- Global Brain Health Institute (GBHI), University of California San Francisco (UCSF), San Francisco, CA, USA; Global Brain Health Institute (GBHI), Trinity College Dublin, Dublin, Ireland; Latin American Brain Health (BrainLat), Universidad Adolfo Ibáñez, Santiago, Chile; Cognitive Neuroscience Center (CNC), Universidad de San Andrés, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina; Trinity College Institute of Neuroscience (TCIN), Trinity College Dublin, Dublin, Ireland.
| |
Collapse
|
14
|
Divya R, Shantha Selva Kumari R. Detection of Alzheimer’s disease from temporal lobe grey matter slices using 3D CNN. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2023.2173548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Affiliation(s)
- R. Divya
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, India
| | - R. Shantha Selva Kumari
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, India
| | | |
Collapse
|
15
|
Astolfi RS, da Silva DS, Guedes IS, Nascimento CS, Damaševičius R, Jagatheesaperumal SK, de Albuquerque VHC, Leite JAD. Computer-Aided Ankle Ligament Injury Diagnosis from Magnetic Resonance Images Using Machine Learning Techniques. SENSORS (BASEL, SWITZERLAND) 2023; 23:1565. [PMID: 36772604 PMCID: PMC9919370 DOI: 10.3390/s23031565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2022] [Revised: 01/16/2023] [Accepted: 01/28/2023] [Indexed: 06/18/2023]
Abstract
Ankle injuries caused by the Anterior Talofibular Ligament (ATFL) are the most common type of injury. Thus, finding new ways to analyze these injuries through novel technologies is critical for assisting medical diagnosis and, as a result, reducing the subjectivity of this process. As a result, the purpose of this study is to compare the ability of specialists to diagnose lateral tibial tuberosity advancement (LTTA) injury using computer vision analysis on magnetic resonance imaging (MRI). The experiments were carried out on a database obtained from the Vue PACS-Carestream software, which contained 132 images of ATFL and normal (healthy) ankles. Because there were only a few images, image augmentation techniques was used to increase the number of images in the database. Following that, various feature extraction algorithms (GLCM, LBP, and HU invariant moments) and classifiers such as Multi-Layer Perceptron (MLP), Support Vector Machine (SVM), k-Nearest Neighbors (kNN), and Random Forest (RF) were used. Based on the results from this analysis, for cases that lack clear morphologies, the method delivers a hit rate of 85.03% with an increase of 22% over the human expert-based analysis.
Collapse
Affiliation(s)
- Rodrigo S. Astolfi
- Graduate Program in Surgery, Federal University of Ceará, Fortaleza 60455-970, CE, Brazil
| | - Daniel S. da Silva
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, CE, Brazil
| | - Ingrid S. Guedes
- Graduate Program in Surgery, Federal University of Ceará, Fortaleza 60455-970, CE, Brazil
| | - Caio S. Nascimento
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, CE, Brazil
| | - Robertas Damaševičius
- Department of Software Engineering, Kaunas University of Technology, 51368 Kaunas, Lithuania
| | - Senthil K. Jagatheesaperumal
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi 626005, TN, India
| | | | - José Alberto D. Leite
- Graduate Program in Surgery, Federal University of Ceará, Fortaleza 60455-970, CE, Brazil
| |
Collapse
|
16
|
Xing X, Rafique MU, Liang G, Blanton H, Zhang Y, Wang C, Jacobs N, Lin AL. Efficient Training on Alzheimer's Disease Diagnosis with Learnable Weighted Pooling for 3D PET Brain Image Classification. ELECTRONICS 2023; 12:467. [PMID: 36778519 PMCID: PMC9910214 DOI: 10.3390/electronics12020467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Three-dimensional convolutional neural networks (3D CNNs) have been widely applied to analyze Alzheimer's disease (AD) brain images for a better understanding of the disease progress or predicting the conversion from cognitively impaired (CU) or mild cognitive impairment status. It is well-known that training 3D-CNN is computationally expensive and with the potential of overfitting due to the small sample size available in the medical imaging field. Here we proposed a novel 3D-2D approach by converting a 3D brain image to a 2D fused image using a Learnable Weighted Pooling (LWP) method to improve efficient training and maintain comparable model performance. By the 3D-to-2D conversion, the proposed model can easily forward the fused 2D image through a pre-trained 2D model while achieving better performance over different 3D and 2D baselines. In the implementation, we chose to use ResNet34 for feature extraction as it outperformed other 2D CNN backbones. We further showed that the weights of the slices are location-dependent and the model performance relies on the 3D-to-2D fusion view, with the best outcomes from the coronal view. With the new approach, we were able to reduce 75% of the training time and increase the accuracy to 0.88, compared with conventional 3D CNNs, for classifying amyloid-beta PET imaging from the AD patients from the CU participants using the publicly available Alzheimer's Disease Neuroimaging Initiative dataset. The novel 3D-2D model may have profound implications for timely AD diagnosis in clinical settings in the future.
Collapse
Affiliation(s)
- Xin Xing
- Department of Computer Science, University of Kentucky,Lexington, KY 40506, USA
- Department of Radiology, University of Missouri, Columbia, MO 65212, USA
| | | | - Gongbo Liang
- Department of Computing and Cyber Security, Texas A & M University-San Antonio, San Antonio, TX 78224, USA
| | - Hunter Blanton
- Department of Computer Science, University of Kentucky,Lexington, KY 40506, USA
| | - Yu Zhang
- Department of Computer Science, University of Kentucky,Lexington, KY 40506, USA
| | - Chris Wang
- Department of Computer Science, University of Missouri, Columbia, MO 65211, USA
| | - Nathan Jacobs
- Department of Computer Science & Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA
| | - Ai-Ling Lin
- Department of Radiology, University of Missouri, Columbia, MO 65212, USA
- Department of Biological Sciences, University of Missouri, Columbia, MO 65211, USA
- Institute for Data Science and Informatics, University of Missouri, Columbia, MO 65211, USA
| |
Collapse
|
17
|
Differential Diagnosis of Alzheimer Disease vs. Mild Cognitive Impairment Based on Left Temporal Lateral Lobe Hypomethabolism on 18F-FDG PET/CT and Automated Classifiers. Diagnostics (Basel) 2022; 12:diagnostics12102425. [PMID: 36292114 PMCID: PMC9601187 DOI: 10.3390/diagnostics12102425] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 09/22/2022] [Accepted: 10/04/2022] [Indexed: 11/17/2022] Open
Abstract
Purpose: We evaluate the ability of Artificial Intelligence with automatic classification methods applied to semi-quantitative data from brain 18F-FDG PET/CT to improve the differential diagnosis between Alzheimer Disease (AD) and Mild Cognitive Impairment (MCI). Procedures: We retrospectively analyzed a total of 150 consecutive patients who underwent diagnostic evaluation for suspected AD (n = 67) or MCI (n = 83). All patients received brain 18F-FDG PET/CT according to the international guidelines, and images were analyzed both Qualitatively (QL) and Quantitatively (QN), the latter by a fully automated post-processing software that produced a z score metabolic map of 25 anatomically different cortical regions. A subset of n = 122 cases with a confirmed diagnosis of AD (n = 53) or MDI (n = 69) by 18–24-month clinical follow-up was finally included in the study. Univariate analysis and three automated classification models (classification tree –ClT-, ridge classifier –RC- and linear Support Vector Machine –lSVM-) were considered to estimate the ability of the z scores to discriminate between AD and MCI cases in. Results: The univariate analysis returned 14 areas where the z scores were significantly different between AD and MCI groups, and the classification accuracy ranged between 74.59% and 76.23%, with ClT and RC providing the best results. The best classification strategy consisted of one single split with a cut-off value of ≈ −2.0 on the z score from temporal lateral left area: cases below this threshold were classified as AD and those above the threshold as MCI. Conclusions: Our findings confirm the usefulness of brain 18F-FDG PET/CT QL and QN analyses in differentiating AD from MCI. Moreover, the combined use of automated classifications models can improve the diagnostic process since its use allows identification of a specific hypometabolic area involved in AD cases in respect to MCI. This data improves the traditional 18F-FDG PET/CT image interpretation and the diagnostic assessment of cognitive disorders.
Collapse
|
18
|
Merone M, D'Addario SL, Mirino P, Bertino F, Guariglia C, Ventura R, Capirchio A, Baldassarre G, Silvetti M, Caligiore D. A multi-expert ensemble system for predicting Alzheimer transition using clinical features. Brain Inform 2022; 9:20. [PMID: 36056985 PMCID: PMC9440971 DOI: 10.1186/s40708-022-00168-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/16/2022] [Indexed: 11/18/2022] Open
Abstract
Alzheimer’s disease (AD) diagnosis often requires invasive examinations (e.g., liquor analyses), expensive tools (e.g., brain imaging) and highly specialized personnel. The diagnosis commonly is established when the disorder has already caused severe brain damage, and the clinical signs begin to be apparent. Instead, accessible and low-cost approaches for early identification of subjects at high risk for developing AD years before they show overt symptoms are fundamental to provide a critical time window for more effective clinical management, treatment, and care planning. This article proposes an ensemble-based machine learning algorithm for predicting AD development within 9 years from first overt signs and using just five clinical features that are easily detectable with neuropsychological tests. The validation of the system involved both healthy individuals and mild cognitive impairment (MCI) patients drawn from the ADNI open dataset, at variance with previous studies that considered only MCI. The system shows higher levels of balanced accuracy, negative predictive value, and specificity than other similar solutions. These results represent a further important step to build a preventive fast-screening machine-learning-based tool to be used as a part of routine healthcare screenings.
Collapse
Affiliation(s)
- Mario Merone
- Unit of Computer Systems and Bioinformatics, Department of Engineering, Università Campus Bio-Medico di Roma, Via Alvaro del Portillo 21, 00128, Rome, Italy
| | - Sebastian Luca D'Addario
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy.,IRCCS Fondazione Santa Lucia, Via Ardeatina, 306 and Via Del Fosso di Fiorano, 64, 00143, Rome, Italy
| | - Pierandrea Mirino
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy.,AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy
| | - Francesca Bertino
- Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy
| | - Cecilia Guariglia
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,IRCCS Fondazione Santa Lucia, Via Ardeatina, 306 and Via Del Fosso di Fiorano, 64, 00143, Rome, Italy
| | - Rossella Ventura
- Department of Psychology, Sapienza University, Piazzale Aldo Moro 5, 00185, Rome, Italy.,IRCCS Fondazione Santa Lucia, Via Ardeatina, 306 and Via Del Fosso di Fiorano, 64, 00143, Rome, Italy
| | - Adriano Capirchio
- AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy
| | - Gianluca Baldassarre
- AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy.,Laboratory of Embodied Natural and Artificial Intelligence, Institute of Cognitive Sciences and Technologies, National Research Council (LENAI-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy
| | - Massimo Silvetti
- Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy
| | - Daniele Caligiore
- Computational and Translational Neuroscience Laboratory, Institute of Cognitive Sciences and Technologies, National Research Council (CTNLab-ISTC-CNR), Via San Martino della Battaglia 44, 00185, Rome, Italy. .,AI2Life s.r.l., Innovative Start-Up, ISTC-CNR Spin-Off, Via Sebino 32, 00199, Rome, Italy.
| |
Collapse
|
19
|
Yan B, Li Y, Li L, Yang X, Li TQ, Yang G, Jiang M. Quantifying the impact of Pyramid Squeeze Attention mechanism and filtering approaches on Alzheimer's disease classification. Comput Biol Med 2022; 148:105944. [PMID: 35969934 DOI: 10.1016/j.compbiomed.2022.105944] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 07/23/2022] [Accepted: 08/06/2022] [Indexed: 11/20/2022]
Abstract
Brain medical imaging and deep learning are important foundations for diagnosing and predicting Alzheimer's disease. In this study, we explored the impact of different image filtering approaches and Pyramid Squeeze Attention (PSA) mechanism on the image classification of Alzheimer's disease. First, during the image preprocessing, we register MRI images and remove skulls, then apply median filtering, Gaussian blur filtering, and anisotropic diffusion filtering to obtain different experimental images. After that, we add the Squeeze and Excitation (SE) mechanism and Pyramid Squeeze Attention (PSA) mechanism to the Fully Convolutional Network (FCN) model respectively, to obtain each MRI image's corresponding feature information of disease probability map. Besides, we also construct Multi-Layer Perceptron (MLP) model's framework, combining feature information of disease probability map with age, gender, and Mini-Mental State Examination (MMSE) of each sample, to get the final classification performance of model. Among them, the accuracy of the MLP-C model combining anisotropic diffusion filtering with the Pyramid Squeeze Attention mechanism can reach 98.85%. The corresponding quantitative experimental results show that different image filtering approaches and attention mechanisms provide effective assistance for the diagnosis and classification of Alzheimer's disease.
Collapse
Affiliation(s)
- Bin Yan
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, China
| | - Yang Li
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, China
| | - Lin Li
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, China
| | - Xiaocheng Yang
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, China
| | - Tie-Qiang Li
- Department of Clinical Science, Intervention and Technology, Karolinska Institutet, 171 77, Stockholm, Sweden.
| | - Guang Yang
- Cardiovascular Research Centre, Royal Brompton Hospital, London, SW3 6NP, UK; National Heart and Lung Institute, Imperial College London, London, SW7 2AZ, UK.
| | - Mingfeng Jiang
- School of Computer Science and Technology, Zhejiang Sci-Tech University, Hangzhou, 310018, China.
| |
Collapse
|
20
|
Alorfi NM. Public Awareness of Alzheimer’s Disease: A Cross-Sectional Study from Saudi Arabia. Int J Gen Med 2022; 15:7535-7546. [PMID: 36199585 PMCID: PMC9527696 DOI: 10.2147/ijgm.s373447] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 08/12/2022] [Indexed: 12/04/2022] Open
Abstract
Background Alzheimer’s disease is considered the most common neurodegenerative and progressive illness. It is also a common type of dementia characterized by brain atrophy, neuronal tissue loss, and the formation of amyloid plaques. Mild memory loss is a commonly expected start of the disease, which can progress to loss of capacity to carry on a conversation and react to certain situations. Objective This study aimed to measure knowledge about Alzheimer’s disease in Saudi Arabia through the use of the Alzheimer’s Disease Knowledge Scale (ADKS) and measure the association between the ADKS with relevant demographic variables. Methods A pre-validated questionnaire containing 30 questions was distributed electronically to anyone older than 18 years old living in Saudi Arabia. Items regarding socio-demographic characteristics and the Alzheimer’s Disease Knowledge Scale (ADKS) were also included. Results Participants did not have a high enough mean score to be regarded as appropriately knowledgeable (mean = 17.35). Higher knowledge scores on Life impact, Risk factors, Assessment and diagnosis, Caregiving, Treatment and management, and ADKS were associated with the female gender. Higher knowledge of caregiving was associated with a postgraduate academic qualification. Higher knowledge on Assessment and Diagnosis was associated with higher age. Higher knowledge on risk factors was associated with having relatives diagnosed with Alzheimer’s disease. Higher knowledge on life impact was associated with having newspaper and journal articles as the source of medical information. Conclusion National awareness campaigns for the community and continuing education courses for caregivers must be placed to aid in increasing awareness regarding Alzheimer’s disease.
Collapse
Affiliation(s)
- Nasser M Alorfi
- Department of Pharmacology and Toxicology, College of Pharmacy, Umm Al-Qura University, Makkah, Saudi Arabia
- Correspondence: Nasser M Alorfi, Department of Pharmacology and Toxicology, College of Pharmacy, Umm Al-Qura University, Makkah, Saudi Arabia, Tel +966500644261, Email
| |
Collapse
|
21
|
Maqsood S, Damaševičius R, Maskeliūnas R. Multi-Modal Brain Tumor Detection Using Deep Neural Network and Multiclass SVM. Medicina (B Aires) 2022; 58:medicina58081090. [PMID: 36013557 PMCID: PMC9413317 DOI: 10.3390/medicina58081090] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 08/03/2022] [Accepted: 08/06/2022] [Indexed: 02/05/2023] Open
Abstract
Background and Objectives: Clinical diagnosis has become very significant in today's health system. The most serious disease and the leading cause of mortality globally is brain cancer which is a key research topic in the field of medical imaging. The examination and prognosis of brain tumors can be improved by an early and precise diagnosis based on magnetic resonance imaging. For computer-aided diagnosis methods to assist radiologists in the proper detection of brain tumors, medical imagery must be detected, segmented, and classified. Manual brain tumor detection is a monotonous and error-prone procedure for radiologists; hence, it is very important to implement an automated method. As a result, the precise brain tumor detection and classification method is presented. Materials and Methods: The proposed method has five steps. In the first step, a linear contrast stretching is used to determine the edges in the source image. In the second step, a custom 17-layered deep neural network architecture is developed for the segmentation of brain tumors. In the third step, a modified MobileNetV2 architecture is used for feature extraction and is trained using transfer learning. In the fourth step, an entropy-based controlled method was used along with a multiclass support vector machine (M-SVM) for the best features selection. In the final step, M-SVM is used for brain tumor classification, which identifies the meningioma, glioma and pituitary images. Results: The proposed method was demonstrated on BraTS 2018 and Figshare datasets. Experimental study shows that the proposed brain tumor detection and classification method outperforms other methods both visually and quantitatively, obtaining an accuracy of 97.47% and 98.92%, respectively. Finally, we adopt the eXplainable Artificial Intelligence (XAI) method to explain the result. Conclusions: Our proposed approach for brain tumor detection and classification has outperformed prior methods. These findings demonstrate that the proposed approach obtained higher performance in terms of both visually and enhanced quantitative evaluation with improved accuracy.
Collapse
|
22
|
Battineni G, Chintalapudi N, Hossain MA, Losco G, Ruocco C, Sagaro GG, Traini E, Nittari G, Amenta F. Artificial Intelligence Models in the Diagnosis of Adult-Onset Dementia Disorders: A Review. Bioengineering (Basel) 2022; 9:bioengineering9080370. [PMID: 36004895 PMCID: PMC9405227 DOI: 10.3390/bioengineering9080370] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 07/25/2022] [Accepted: 08/02/2022] [Indexed: 11/16/2022] Open
Abstract
Background: The progressive aging of populations, primarily in the industrialized western world, is accompanied by the increased incidence of several non-transmittable diseases, including neurodegenerative diseases and adult-onset dementia disorders. To stimulate adequate interventions, including treatment and preventive measures, an early, accurate diagnosis is necessary. Conventional magnetic resonance imaging (MRI) represents a technique quite common for the diagnosis of neurological disorders. Increasing evidence indicates that the association of artificial intelligence (AI) approaches with MRI is particularly useful for improving the diagnostic accuracy of different dementia types. Objectives: In this work, we have systematically reviewed the characteristics of AI algorithms in the early detection of adult-onset dementia disorders, and also discussed its performance metrics. Methods: A document search was conducted with three databases, namely PubMed (Medline), Web of Science, and Scopus. The search was limited to the articles published after 2006 and in English only. The screening of the articles was performed using quality criteria based on the Newcastle–Ottawa Scale (NOS) rating. Only papers with an NOS score 7 were considered for further review. Results: The document search produced a count of 1876 articles and, because of duplication, 1195 papers were not considered. Multiple screenings were performed to assess quality criteria, which yielded 29 studies. All the selected articles were further grouped based on different attributes, including study type, type of AI model used in the identification of dementia, performance metrics, and data type. Conclusions: The most common adult-onset dementia disorders occurring were Alzheimer’s disease and vascular dementia. AI techniques associated with MRI resulted in increased diagnostic accuracy ranging from 73.3% to 99%. These findings suggest that AI should be associated with conventional MRI techniques to obtain a precise and early diagnosis of dementia disorders occurring in old age.
Collapse
Affiliation(s)
- Gopi Battineni
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
- Correspondence: ; Tel.: +39-3331728206
| | - Nalini Chintalapudi
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Mohammad Amran Hossain
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Giuseppe Losco
- School of Architecture and Design, University of Camerino, 63100 Ascoli Piceno, Italy
| | - Ciro Ruocco
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Getu Gamo Sagaro
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Enea Traini
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Giulio Nittari
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| | - Francesco Amenta
- Clinical Research Centre, School of Medicinal and Health Products Sciences, University of Camerino, 62032 Camerino, Italy
| |
Collapse
|
23
|
Ghaffari H, Tavakoli H, Pirzad Jahromi G. Deep transfer learning-based fully automated detection and classification of Alzheimer's disease on brain MRI. Br J Radiol 2022; 95:20211253. [PMID: 35616643 PMCID: PMC10162060 DOI: 10.1259/bjr.20211253] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 04/24/2022] [Accepted: 05/19/2022] [Indexed: 11/05/2022] Open
Abstract
OBJECTIVES To employ different automated convolutional neural network (CNN)-based transfer learning (TL) methods for both binary and multiclass classification of Alzheimer's disease (AD) using brain MRI. METHODS Herein, we applied three popular pre-trained CNN models (ResNet101, Xception, and InceptionV3) using a fine-tuned approach of TL on 3D T1-weighted brain MRI from a subset of ADNI dataset (n = 305 subjects). To evaluate power of TL, the aforementioned networks were also trained from scratch for performance comparison. Initially, Unet network segmentedthe MRI scans into characteristic components of gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF). The proposed networks were trained and tested over the pre-processed and augmented segmented and whole images for both binary (NC/AD + progressive mild cognitive impairment (pMCI)+stable MCI (sMCI)) and 4-class (AD/pMCI/sMCI/NC) classification. Also, two independent test sets from the OASIS (n = 30) and AIBL (n = 60) datasets were used to externally assess the performance of the proposed algorithms. RESULTS The proposed TL-based CNN models achieved better performance compared to the training CNN models from scratch. On the ADNI test set, InceptionV3-TL achieved the highest accuracy of 93.75% and AUC of 92.0% for binary classification, as well as the highest accuracy of 93.75% and AUC of 96.0% for multiclass classification of AD on the whole images. On the OASIS test set, InceptionV3-TL outperformed two other models by achieving 93.33% accuracy with 93.0% AUC in binary classification of AD on the whole images. On the AIBL test set, InceptionV3-TL also outperformed two other models in both binary and multiclass classification tasks on the whole MR images and achieved accuracy/AUC of 93.33%/95.0% and 90.0%/93.0%, respectively. The GM segment as input provided the highest performance in both binary and multiclass classification of AD, as compared to the WM and CSF segments. CONCLUSION This study demonstrates the potential of applying deep TL approach for automated detection and classification of AD using brain MRI with high accuracy and robustness across internal and external test data, suggesting that these models can possibly be used as a supportive tool to assist clinicians in creating objective opinion and correct diagnosis. ADVANCES IN KNOWLEDGE We used CNN-based TL approaches and the augmentation techniques to overcome the insufficient data problem. Our study provides evidence that deep TL algorithms can be used for both binary and multiclass classification of AD with high accuracy.
Collapse
Affiliation(s)
- Hamed Ghaffari
- Neuroscience Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran
| | | | - Gila Pirzad Jahromi
- Neuroscience Research Center, Baqiyatallah University of Medical Sciences, Tehran, Iran
| |
Collapse
|
24
|
End-to-End Deep Learning Architectures Using 3D Neuroimaging Biomarkers for Early Alzheimer’s Diagnosis. MATHEMATICS 2022. [DOI: 10.3390/math10152575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
Abstract
This study uses magnetic resonance imaging (MRI) data to propose end-to-end learning implementing volumetric convolutional neural network (CNN) models for two binary classification tasks: Alzheimer’s disease (AD) vs. cognitively normal (CN) and stable mild cognitive impairment (sMCI) vs. AD. The baseline MP-RAGE T1 MR images of 245 AD patients and 229 with sMCI were obtained from the ADNI dataset, whereas 245 T1 MR images of CN people were obtained from the IXI dataset. All of the images were preprocessed in four steps: N4 bias field correction, denoising, brain extraction, and registration. End-to-end-learning-based deep CNNs were used to discern between different phases of AD. Eight CNN-based architectures were implemented and assessed. The DenseNet264 excelled in both types of classification, with 82.5% accuracy and 87.63% AUC for training and 81.03% accuracy for testing relating to the sMCI vs. AD and 100% accuracy and 100% AUC for training and 99.56% accuracy for testing relating to the AD vs. CN. Deep learning approaches based on CNN and end-to-end learning offer a strong tool for examining minute but complex properties in MR images which could aid in the early detection and prediction of Alzheimer’s disease in clinical settings.
Collapse
|
25
|
Medical Image Classification Using Transfer Learning and Chaos Game Optimization on the Internet of Medical Things. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:9112634. [PMID: 35875781 PMCID: PMC9300353 DOI: 10.1155/2022/9112634] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 06/07/2022] [Accepted: 06/21/2022] [Indexed: 12/23/2022]
Abstract
The Internet of Medical Things (IoMT) has dramatically benefited medical professionals that patients and physicians can access from all regions. Although the automatic detection and prediction of diseases such as melanoma and leukemia is still being investigated and studied in IoMT, existing approaches are not able to achieve a high degree of efficiency. Thus, with a new approach that provides better results, patients would access the adequate treatments earlier and the death rate would be reduced. Therefore, this paper introduces an IoMT proposal for medical images' classification that may be used anywhere, i.e., it is an ubiquitous approach. It was designed in two stages: first, we employ a transfer learning (TL)-based method for feature extraction, which is carried out using MobileNetV3; second, we use the chaos game optimization (CGO) for feature selection, with the aim of excluding unnecessary features and improving the performance, which is key in IoMT. Our methodology was evaluated using ISIC-2016, PH2, and Blood-Cell datasets. The experimental results indicated that the proposed approach obtained an accuracy of 88.39% on ISIC-2016, 97.52% on PH2, and 88.79% on Blood-cell datsets. Moreover, our approach had successful performances for the metrics employed compared to other existing methods.
Collapse
|
26
|
Zhu J, Tan Y, Lin R, Miao J, Fan X, Zhu Y, Liang P, Gong J, He H. Efficient self-attention mechanism and structural distilling model for Alzheimer’s disease diagnosis. Comput Biol Med 2022; 147:105737. [DOI: 10.1016/j.compbiomed.2022.105737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Revised: 05/23/2022] [Accepted: 06/11/2022] [Indexed: 11/27/2022]
|
27
|
Zhu Z, Lu S, Wang SH, Gorriz JM, Zhang YD. DSNN: A DenseNet-Based SNN for Explainable Brain Disease Classification. Front Syst Neurosci 2022; 16:838822. [PMID: 35720439 PMCID: PMC9204288 DOI: 10.3389/fnsys.2022.838822] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Accepted: 04/25/2022] [Indexed: 12/20/2022] Open
Abstract
Aims: Brain diseases refer to intracranial tissue and organ inflammation, vascular diseases, tumors, degeneration, malformations, genetic diseases, immune diseases, nutritional and metabolic diseases, poisoning, trauma, parasitic diseases, etc. Taking Alzheimer’s disease (AD) as an example, the number of patients dramatically increases in developed countries. By 2025, the number of elderly patients with AD aged 65 and over will reach 7.1 million, an increase of nearly 29% over the 5.5 million patients of the same age in 2018. Unless medical breakthroughs are made, AD patients may increase from 5.5 million to 13.8 million by 2050, almost three times the original. Researchers have focused on developing complex machine learning (ML) algorithms, i.e., convolutional neural networks (CNNs), containing millions of parameters. However, CNN models need many training samples. A small number of training samples in CNN models may lead to overfitting problems. With the continuous research of CNN, other networks have been proposed, such as randomized neural networks (RNNs). Schmidt neural network (SNN), random vector functional link (RVFL), and extreme learning machine (ELM) are three types of RNNs.Methods: We propose three novel models to classify brain diseases to cope with these problems. The proposed models are DenseNet-based SNN (DSNN), DenseNet-based RVFL (DRVFL), and DenseNet-based ELM (DELM). The backbone of the three proposed models is the pre-trained “customize” DenseNet. The modified DenseNet is fine-tuned on the empirical dataset. Finally, the last five layers of the fine-tuned DenseNet are substituted by SNN, ELM, and RVFL, respectively.Results: Overall, the DSNN gets the best performance among the three proposed models in classification performance. We evaluate the proposed DSNN by five-fold cross-validation. The accuracy, sensitivity, specificity, precision, and F1-score of the proposed DSNN on the test set are 98.46% ± 2.05%, 100.00% ± 0.00%, 85.00% ± 20.00%, 98.36% ± 2.17%, and 99.16% ± 1.11%, respectively. The proposed DSNN is compared with restricted DenseNet, spiking neural network, and other state-of-the-art methods. Finally, our model obtains the best results among all models.Conclusions: DSNN is an effective model for classifying brain diseases.
Collapse
Affiliation(s)
- Ziquan Zhu
- School of Computing and Mathematical Sciences, University of Leicester, East Midlands, United Kingdom
| | - Siyuan Lu
- School of Computing and Mathematical Sciences, University of Leicester, East Midlands, United Kingdom
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, East Midlands, United Kingdom
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, China
- *Correspondence: Shui-Hua Wang Juan Manuel Gorriz Yu-Dong Zhang
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and Communications, University of Granada, Granada, Spain
- *Correspondence: Shui-Hua Wang Juan Manuel Gorriz Yu-Dong Zhang
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, East Midlands, United Kingdom
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, China
- Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin, China
- *Correspondence: Shui-Hua Wang Juan Manuel Gorriz Yu-Dong Zhang
| |
Collapse
|
28
|
Huang Q, Qiao C, Jing K, Zhu X, Ren K. Biomarkers identification for Schizophrenia via VAE and GSDAE-based data augmentation. Comput Biol Med 2022; 146:105603. [PMID: 35588680 DOI: 10.1016/j.compbiomed.2022.105603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 04/13/2022] [Accepted: 05/07/2022] [Indexed: 11/24/2022]
Abstract
Deep learning has made great progress in analyzing MRI data, while the MRI data with high dimensional but small sample size (HDSSS) brings many limitations to biomarkers identification. Few-shot learning has been proposed to solve such problems and data augmentation is a typical method of it. The variational auto-encoder (VAE) is a generative method based on variational Bayesian inference that is used for data augmentation. Graph regularized sparse deep autoencoder (GSDAE) can reconstruct sparse samples and keep the manifold structure of data which will facilitate biomarkers selection greatly. To generate better HDSSS data for biomarkers identification, a data augmentation method based on VAE and GSDAE is proposed in this paper, termed GS-VDAE. Instead of utilizing the final products of GSDAE, our proposed model embeds the generation procedure into GSDAE for augmentation. In this way, the augmented samples will be rooted in the significant features extracted from the original samples, which can ensure the newly formed samples contain the most significant characteristics of the original samples. The classification accuracy of the samples generated directly from VAE is 0.74, while the classification accuracy of the samples generated from GS-VDAE is 0.84, which proves the validity of our model. Additionally, a regression feature selection method with truncated nuclear norm regularization is chosen for biomarkers selection. The biomarkers selection results of schizophrenia data reveal that the augmented samples obtained by our proposed method can get higher classification accuracy with less ranked features compared with original samples, which proves the validation of our model.
Collapse
Affiliation(s)
- Qi Huang
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, 710049, China.
| | - Chen Qiao
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, 710049, China.
| | - Kaili Jing
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, 710049, China; Department of Mathematics and Statistics, University of Ottawa, Ottawa, K7L 3P7, Canada.
| | - Xu Zhu
- School of Mathematics and Statistics, Xi'an Jiaotong University, Xi'an, 710049, China.
| | - Kai Ren
- Xijing Hospital, Fourth Military Medical University, Xi'an, 710032, China.
| |
Collapse
|