1
|
He P, Shi Z, Cui Y, Wang R, Wu D. A spatiotemporal graph transformer approach for Alzheimer's disease diagnosis with rs-fMRI. Comput Biol Med 2024; 178:108762. [PMID: 38908359 DOI: 10.1016/j.compbiomed.2024.108762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2023] [Revised: 05/24/2024] [Accepted: 06/13/2024] [Indexed: 06/24/2024]
Abstract
Alzheimer's disease (AD) is a neurodegenerative disease accompanied by cognitive impairment. Early diagnosis is crucial for the timely treatment and intervention of AD. Resting-state functional magnetic resonance imaging (rs-fMRI) records the temporal dynamics and spatial dependency in the brain, which have been utilized for automatically diagnosis of AD in the community. Existing approaches of AD diagnosis using rs-fMRI only assess functional connectivity, ignoring the spatiotemporal dependency mining of rs-fMRI. In addition, it is difficult to increase diagnosis accuracy due to the shortage of rs-fMRI sample and the poor anti-noise ability of model. To deal with these problems, this paper proposes a novel approach for the automatic diagnosis of AD, namely spatiotemporal graph transformer network (STGTN). The proposed STGTN can effectively extract spatiotemporal features of rs-fMRI. Furthermore, to solve the sample-limited problem and to improve the anti-noise ability of the proposed model, an adversarial training strategy is adopted for the proposed STGTN to generate adversarial examples (AEs) and augment training samples with AEs. Experimental results indicate that the proposed model achieves the classification accuracy of 92.58%, and 85.27% with the adversarial training strategy for AD vs. normal control (NC), early mild cognitive impairment (eMCI) vs. late mild cognitive impairment (lMCI) respectively, outperforming the state-of-the-art methods. Besides, the spatial attention coefficients reflected from the designed model reveal the importance of brain connections under different classification tasks.
Collapse
Affiliation(s)
- Peng He
- School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, 400065, China; Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, 400065, China.
| | - Zhan Shi
- School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, 400065, China; Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, 400065, China
| | - Yaping Cui
- School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, 400065, China; Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, 400065, China
| | - Ruyan Wang
- School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, 400065, China; Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, 400065, China
| | - Dapeng Wu
- School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Advanced Network and Intelligent Connection Technology Key Laboratory of Chongqing Education Commission of China, Chongqing, 400065, China; Chongqing Key Laboratory of Ubiquitous Sensing and Networking, Chongqing, 400065, China
| |
Collapse
|
2
|
Song B, Yoshida S. Explainability of three-dimensional convolutional neural networks for functional magnetic resonance imaging of Alzheimer's disease classification based on gradient-weighted class activation mapping. PLoS One 2024; 19:e0303278. [PMID: 38771733 PMCID: PMC11108152 DOI: 10.1371/journal.pone.0303278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 04/22/2024] [Indexed: 05/23/2024] Open
Abstract
Currently, numerous studies focus on employing fMRI-based deep neural networks to diagnose neurological disorders such as Alzheimer's Disease (AD), yet only a handful have provided results regarding explainability. We address this gap by applying several prevalent explainability methods such as gradient-weighted class activation mapping (Grad-CAM) to an fMRI-based 3D-VGG16 network for AD diagnosis to improve the model's explainability. The aim is to explore the specific Region of Interest (ROI) of brain the model primarily focuses on when making predictions, as well as whether there are differences in these ROIs between AD and normal controls (NCs). First, we utilized multiple resting-state functional activity maps including ALFF, fALFF, ReHo, and VMHC to reduce the complexity of fMRI data, which differed from many studies that utilized raw fMRI data. Compared to methods utilizing raw fMRI data, this manual feature extraction approach may potentially alleviate the model's burden. Subsequently, 3D-VGG16 were employed for AD classification, where the final fully connected layers were replaced with a Global Average Pooling (GAP) layer, aimed at mitigating overfitting while preserving spatial information within the feature maps. The model achieved a maximum of 96.4% accuracy on the test set. Finally, several 3D CAM methods were employed to interpret the models. In the explainability results of the models with relatively high accuracy, the highlighted ROIs were primarily located in the precuneus and the hippocampus for AD subjects, while the models focused on the entire brain for NC. This supports current research on ROIs involved in AD. We believe that explaining deep learning models would not only provide support for existing research on brain disorders, but also offer important referential recommendations for the study of currently unknown etiologies.
Collapse
Affiliation(s)
- Boyue Song
- Graduate School of Engineering, Kochi University of Technology, Kami City, Kochi Prefecture, Japan
| | - Shinichi Yoshida
- School of Information, Kochi University of Technology, Kami City, Kochi Prefecture, Japan
| | | |
Collapse
|
3
|
Jomeiri A, Navin AH, Shamsi M. Longitudinal MRI analysis using a hybrid DenseNet-BiLSTM method for Alzheimer's disease prediction. Behav Brain Res 2024; 463:114900. [PMID: 38341100 DOI: 10.1016/j.bbr.2024.114900] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 12/16/2023] [Accepted: 02/06/2024] [Indexed: 02/12/2024]
Abstract
Alzheimer's disease is a progressive neurological disorder characterized by brain atrophy and cell death, leading to cognitive decline and impaired functioning. Previous research has primarily focused on using cross-sectional data for Alzheimer's disease identification, but analyzing longitudinal sequential MR images is crucial for improved diagnostic accuracy and understanding disease progression. However, existing deep learning models face challenges in learning spatial and temporal features from such data. To address these challenges, this study presents a novel hybrid DenseNet-BiLSTM method for Alzheimer's disease prediction using longitudinal MRI analysis. The proposed framework combines Convolutional DenseNet for spatial information extraction and joined BiLSTM layers for capturing temporal characteristics and relationships between longitudinal images at different time points. This approach overcomes issues like overfitting, vanishing gradients, and incomplete patient data. We evaluated the model on 684 longitudinal MRI images from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database, including normal controls, individuals with mild cognitive impairment, and Alzheimer's disease patients. The results demonstrate high classification accuracy, with 95.28% for AD/CN, 88.19% for NC/MCI, 83.51% for sMCI/pMCI, and 92.14% for MCI/AD. These findings highlight the substantial improvement in Alzheimer's disease diagnosis achieved through the utilization of longitudinal MRI images. The contributions of this study lie in both the deep learning and medical domains. In the deep learning domain, our hybrid framework effectively learns spatial and temporal features from longitudinal data, addressing the challenges associated with multi-dimensional and sequential time series data. In the medical domain, our study emphasizes the importance of analyzing baseline and longitudinal MR images for accurate diagnosis and understanding disease progression.
Collapse
Affiliation(s)
- Alireza Jomeiri
- Department of Computer Engineering, Qom Branch, Islamic Azad University, Qom, Iran
| | - Ahmad Habibizad Navin
- Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz, Iran.
| | - Mahboubeh Shamsi
- Department of Engineering, Qom University of Technology, Qom, Iran
| |
Collapse
|
4
|
De Waegenaere S, van den Berg M, Keliris GA, Adhikari MH, Verhoye M. Early altered directionality of resting brain network state transitions in the TgF344-AD rat model of Alzheimer's disease. Front Hum Neurosci 2024; 18:1379923. [PMID: 38646161 PMCID: PMC11026683 DOI: 10.3389/fnhum.2024.1379923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 03/18/2024] [Indexed: 04/23/2024] Open
Abstract
Introduction Alzheimer's disease (AD) is a progressive neurodegenerative disease resulting in memory loss and cognitive decline. Synaptic dysfunction is an early hallmark of the disease whose effects on whole-brain functional architecture can be identified using resting-state functional MRI (rsfMRI). Insights into mechanisms of early, whole-brain network alterations can help our understanding of the functional impact of AD's pathophysiology. Methods Here, we obtained rsfMRI data in the TgF344-AD rat model at the pre- and early-plaque stages. This model recapitulates the major pathological and behavioral hallmarks of AD. We used co-activation pattern (CAP) analysis to investigate if and how the dynamic organization of intrinsic brain functional networks states, undetectable by earlier methods, is altered at these early stages. Results We identified and characterized six intrinsic brain states as CAPs, their spatial and temporal features, and the transitions between the different states. At the pre-plaque stage, the TgF344-AD rats showed reduced co-activation of hub regions in the CAPs corresponding to the default mode-like and lateral cortical network. Default mode-like network activity segregated into two distinct brain states, with one state characterized by high co-activation of the basal forebrain. This basal forebrain co-activation was reduced in TgF344-AD animals mainly at the pre-plaque stage. Brain state transition probabilities were altered at the pre-plaque stage between states involving the default mode-like network, lateral cortical network, and basal forebrain regions. Additionally, while the directionality preference in the network-state transitions observed in the wild-type animals at the pre-plaque stage had diminished at the early-plaque stage, TgF344-AD animals continued to show directionality preference at both stages. Discussion Our study enhances the understanding of intrinsic brain state dynamics and how they are impacted at the early stages of AD, providing a nuanced characterization of the early, functional impact of the disease's neurodegenerative process.
Collapse
Affiliation(s)
- Sam De Waegenaere
- Department of Biomedical Sciences, Bio-Imaging Lab, University of Antwerp, Antwerp, Belgium
- μNEURO Research Centre of Excellence, University of Antwerp, Antwerp, Belgium
| | - Monica van den Berg
- Department of Biomedical Sciences, Bio-Imaging Lab, University of Antwerp, Antwerp, Belgium
- μNEURO Research Centre of Excellence, University of Antwerp, Antwerp, Belgium
| | - Georgios A. Keliris
- Institute of Computer Science, Foundation for Research and Technology – Hellas, Heraklion, Greece
| | - Mohit H. Adhikari
- Department of Biomedical Sciences, Bio-Imaging Lab, University of Antwerp, Antwerp, Belgium
- μNEURO Research Centre of Excellence, University of Antwerp, Antwerp, Belgium
| | - Marleen Verhoye
- Department of Biomedical Sciences, Bio-Imaging Lab, University of Antwerp, Antwerp, Belgium
- μNEURO Research Centre of Excellence, University of Antwerp, Antwerp, Belgium
| |
Collapse
|
5
|
Hwang H, Kim SE, Lee HJ, Lee DA, Park KM. Identification of amnestic mild cognitive impairment by structural and functional MRI using a machine-learning approach. Clin Neurol Neurosurg 2024; 238:108177. [PMID: 38402707 DOI: 10.1016/j.clineuro.2024.108177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 02/13/2024] [Accepted: 02/14/2024] [Indexed: 02/27/2024]
Abstract
OBJECTIVE The importance of early treatment for mild cognitive impairment (MCI) has been extensively shown. However, classifying patients presenting with memory complaints in clinical practice as having MCI vs normal results is difficult. Herein, we assessed the feasibility of applying a machine learning approach based on structural volumes and functional connectomic profiles to classify the cognitive levels of cognitively unimpaired (CU) and amnestic MCI (aMCI) groups. We further applied the same method to distinguish aMCI patients with a single memory impairment from those with multiple memory impairments. METHODS Fifty patients with aMCI were enrolled and classified as having either verbal or visual-aMCI (verbal or visual memory impairment), or both aMCI (verbal and visual memory impairments) based on memory test results. In addition, 26 CU patients were enrolled in the control group. All patients underwent structural T1-weighted magnetic resonance imaging (MRI) and resting-state functional MRI. We obtained structural volumes and functional connectomic profiles from structural and functional MRI, respectively, using graph theory. A support vector machine (SVM) algorithm was employed, and k-fold cross-validation was performed to discriminate between groups. RESULTS The SVM classifier based on structural volumes revealed an accuracy of 88.9% at classifying the cognitive levels of patients with CU and aMCI. However, when the structural volumes and functional connectomic profiles were combined, the accuracy increased to 92.9%. In the classification of verbal or visual-aMCI (n = 22) versus both aMCI (n = 28), the SVM classifier based on structural volumes revealed a low accuracy of 36.7%. However, when the structural volumes and functional connectomic profiles were combined, the accuracy increased to 53.1%. CONCLUSION Structural volumes and functional connectomic profiles obtained using a machine learning approach can be used to classify cognitive levels to distinguish between aMCI and CU patients. In addition, combining the functional connectomic profiles with structural volumes results in a better classification performance than the use of structural volumes alone for identifying both "aMCI versus CU" and "verbal- or visual-aMCI versus both aMCI" patients.
Collapse
Affiliation(s)
- Hyunyoung Hwang
- Department of Neurology, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Republic of Korea
| | - Si Eun Kim
- Department of Neurology, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Republic of Korea
| | - Ho-Joon Lee
- Department of Radiology, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Republic of Korea
| | - Dong Ah Lee
- Department of Neurology, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Republic of Korea
| | - Kang Min Park
- Department of Neurology, Haeundae Paik Hospital, Inje University College of Medicine, Busan, Republic of Korea.
| |
Collapse
|
6
|
El-Assy AM, Amer HM, Ibrahim HM, Mohamed MA. A novel CNN architecture for accurate early detection and classification of Alzheimer's disease using MRI data. Sci Rep 2024; 14:3463. [PMID: 38342924 PMCID: PMC10859371 DOI: 10.1038/s41598-024-53733-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 02/04/2024] [Indexed: 02/13/2024] Open
Abstract
Alzheimer's disease (AD) is a debilitating neurodegenerative disorder that requires accurate diagnosis for effective management and treatment. In this article, we propose an architecture for a convolutional neural network (CNN) that utilizes magnetic resonance imaging (MRI) data from the Alzheimer's disease Neuroimaging Initiative (ADNI) dataset to categorize AD. The network employs two separate CNN models, each with distinct filter sizes and pooling layers, which are concatenated in a classification layer. The multi-class problem is addressed across three, four, and five categories. The proposed CNN architecture achieves exceptional accuracies of 99.43%, 99.57%, and 99.13%, respectively. These high accuracies demonstrate the efficacy of the network in capturing and discerning relevant features from MRI images, enabling precise classification of AD subtypes and stages. The network architecture leverages the hierarchical nature of convolutional layers, pooling layers, and fully connected layers to extract both local and global patterns from the data, facilitating accurate discrimination between different AD categories. Accurate classification of AD carries significant clinical implications, including early detection, personalized treatment planning, disease monitoring, and prognostic assessment. The reported accuracy underscores the potential of the proposed CNN architecture to assist medical professionals and researchers in making precise and informed judgments regarding AD patients.
Collapse
Affiliation(s)
- A M El-Assy
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt.
| | - Hanan M Amer
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - H M Ibrahim
- Communication and Electronics Engineering Department, Nile Higher Institute for Engineering and Technology-IEEE Com Society Member, Mansoura, Egypt
| | - M A Mohamed
- Electronics and Communications Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
7
|
Gill T, Locskai LF, Burton AH, Alyenbaawi H, Wheeler T, Burton EA, Allison WT. Delivering Traumatic Brain Injury to Larval Zebrafish. Methods Mol Biol 2024; 2707:3-22. [PMID: 37668902 DOI: 10.1007/978-1-0716-3401-1_1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
We describe a straightforward, scalable method for administering traumatic brain injury (TBI) to zebrafish larvae. The pathological outcomes appear generalizable for all TBI types, but perhaps most closely model closed-skull, diffuse lesion (blast injury) neurotrauma. The injury is delivered by dropping a weight onto the plunger of a fluid-filled syringe containing zebrafish larvae. This model is easy to implement, cost-effective, and provides a high-throughput system that induces brain injury in many larvae at once. Unique to vertebrate TBI models, this method can be used to deliver TBI without anesthetic or other metabolic agents. The methods simulate the main aspects of traumatic brain injury in humans, providing a preclinical model to study the consequences of this prevalent injury type and a way to explore early interventions that may ameliorate subsequent neurodegeneration. We also describe a convenient method for executing pressure measurements to calibrate and validate this method. When used in concert with the genetic tools readily available in zebrafish, this model of traumatic brain injury offers opportunities to examine many mechanisms and outcomes induced by traumatic brain injury. For example, genetically encoded fluorescent reporters have been implemented with this system to measure protein misfolding and neural activity via optogenetics.
Collapse
Affiliation(s)
- Taylor Gill
- Centre for Prions & Protein Folding Disease, University of Alberta, Edmonton, AB, Canada
- Department of Biological Sciences, University of Alberta, Edmonton, AB, Canada
| | - Laszlo F Locskai
- Centre for Prions & Protein Folding Disease, University of Alberta, Edmonton, AB, Canada
- Department of Biological Sciences, University of Alberta, Edmonton, AB, Canada
| | - Alexander H Burton
- Departments of Chemical and Biomedical Engineering, College of Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Hadeel Alyenbaawi
- Department of Medical Laboratories, Majmaah University, Majmaah, Saudi Arabia
| | - Travis Wheeler
- Department of Cell Biology, University of Pittsburgh, Pittsburgh, PA, USA
| | - Edward A Burton
- Department of Neurology, University of Pittsburgh, Pittsburgh, PA, USA
- Geriatric Research, Education and Clinical Center, Pittsburgh VA Healthcare System, Pittsburgh, PA, USA
| | - W Ted Allison
- Centre for Prions & Protein Folding Disease, University of Alberta, Edmonton, AB, Canada.
- Department of Biological Sciences, University of Alberta, Edmonton, AB, Canada.
- Department of Medical Genetics, University of Alberta, Edmonton, AB, Canada.
| |
Collapse
|
8
|
Fathi S, Ahmadi A, Dehnad A, Almasi-Dooghaee M, Sadegh M. A Deep Learning-Based Ensemble Method for Early Diagnosis of Alzheimer's Disease using MRI Images. Neuroinformatics 2024; 22:89-105. [PMID: 38042764 PMCID: PMC10917836 DOI: 10.1007/s12021-023-09646-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/16/2023] [Indexed: 12/04/2023]
Abstract
Recently, the early diagnosis of Alzheimer's disease has gained major attention due to the growing prevalence of the disease and the resulting costs imposed on individuals and society. The main objective of this study was to propose an ensemble method based on deep learning for the early diagnosis of AD using MRI images. The methodology of this study consisted of collecting the dataset, preprocessing, creating the individual and ensemble models, evaluating the models based on ADNI data, and validating the trained model based on the local dataset. The proposed method was an ensemble approach selected through a comparative analysis of various ensemble scenarios. Finally, the six best individual CNN-based classifiers were selected to combine and constitute the ensemble model. The evaluation showed an accuracy rate of 98.57, 96.37, 94.22, 99.83, 93.88, and 93.92 for NC/AD, NC/EMCI, EMCI/LMCI, LMCI/AD, four-way and three-way classification groups, respectively. The validation results on the local dataset revealed an accuracy of 88.46 for three-way classification. Our performance results were higher than most reviewed studies and comparable with others. Although comparative analysis showed superior results of ensemble methods against individual architectures, there were no significant differences among various ensemble approaches. The validation results revealed the low performance of individual models in practice. In contrast, the ensemble method showed promising results. However, further studies on various and larger datasets are required to validate the generalizability of the model.
Collapse
Affiliation(s)
- Sina Fathi
- Department of Health Information Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Ahmadi
- Surrey Business School, University of Surrey, Guildford Surrey, GU2 7XH, UK.
| | - Afsaneh Dehnad
- School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mostafa Almasi-Dooghaee
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Melika Sadegh
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
9
|
Mousa D, Zayed N, Yassine IA. Correlation transfer function analysis as a biomarker for Alzheimer brain plasticity using longitudinal resting-state fMRI data. Sci Rep 2023; 13:21559. [PMID: 38057476 PMCID: PMC10700324 DOI: 10.1038/s41598-023-48693-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Accepted: 11/29/2023] [Indexed: 12/08/2023] Open
Abstract
Neural plasticity is the ability of the brain to alter itself functionally and structurally as a result of its experience. However, longitudinal changes in functional connectivity of the brain are still unrevealed in Alzheimer's disease (AD). This study aims to discover the significant connections (SCs) between brain regions for AD stages longitudinally using correlation transfer function (CorrTF) as a new biomarker for the disease progression. The dataset consists of: 29 normal controls (NC), and 23, 24, and 23 for early, late mild cognitive impairments (EMCI, LMCI), and ADs, respectively, along three distant visits. The brain was divided into 116 regions using the automated anatomical labeling atlas, where the intensity time series is calculated, and the CorrTF connections are extracted for each region. Finally, the standard t-test and ANOVA test were employed to investigate the SCs for each subject's visit. No SCs, along three visits, were found For NC subjects. The most SCs were mainly directed from cerebellum in case of EMCI and LMCI. Furthermore, the hippocampus connectivity increased in LMCI compared to EMCI whereas missed in AD. Additionally, the patterns of longitudinal changes among the different AD stages compared to Pearson Correlation were similar, for SMC, VC, DMN, and Cereb networks, while differed for EAN and SN networks. Our findings define how brain changes over time, which could help detect functional changes linked to each AD stage and better understand the disease behavior.
Collapse
Affiliation(s)
- Doaa Mousa
- Computers and Systems Department, Electronics Research Institute, Cairo, Egypt.
| | - Nourhan Zayed
- Computers and Systems Department, Electronics Research Institute, Cairo, Egypt
- Mechanical Engineering Department, The British University in Egypt, Cairo, Egypt
| | - Inas A Yassine
- Systems and Biomedical Engineering Department, Cairo University, Giza, Egypt
| |
Collapse
|
10
|
Nadler EO, Darragh-Ford E, Desikan BS, Conaway C, Chu M, Hull T, Guilbeault D. Divergences in color perception between deep neural networks and humans. Cognition 2023; 241:105621. [PMID: 37716312 DOI: 10.1016/j.cognition.2023.105621] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Revised: 06/23/2023] [Accepted: 09/09/2023] [Indexed: 09/18/2023]
Abstract
Deep neural networks (DNNs) are increasingly proposed as models of human vision, bolstered by their impressive performance on image classification and object recognition tasks. Yet, the extent to which DNNs capture fundamental aspects of human vision such as color perception remains unclear. Here, we develop novel experiments for evaluating the perceptual coherence of color embeddings in DNNs, and we assess how well these algorithms predict human color similarity judgments collected via an online survey. We find that state-of-the-art DNN architectures - including convolutional neural networks and vision transformers - provide color similarity judgments that strikingly diverge from human color judgments of (i) images with controlled color properties, (ii) images generated from online searches, and (iii) real-world images from the canonical CIFAR-10 dataset. We compare DNN performance against an interpretable and cognitively plausible model of color perception based on wavelet decomposition, inspired by foundational theories in computational neuroscience. While one deep learning model - a convolutional DNN trained on a style transfer task - captures some aspects of human color perception, our wavelet algorithm provides more coherent color embeddings that better predict human color judgments compared to all DNNs we examine. These results hold when altering the high-level visual task used to train similar DNN architectures (e.g., image classification versus image segmentation), as well as when examining the color embeddings of different layers in a given DNN architecture. These findings break new ground in the effort to analyze the perceptual representations of machine learning algorithms and to improve their ability to serve as cognitively plausible models of human vision. Implications for machine learning, human perception, and embodied cognition are discussed.
Collapse
Affiliation(s)
- Ethan O Nadler
- Carnegie Observatories, USA; Department of Physics, University of Southern California, USA.
| | - Elise Darragh-Ford
- Kavli Institute for Particle Astrophysics and Cosmology and Department of Physics, Stanford University, USA
| | - Bhargav Srinivasa Desikan
- School of Computer and Communication Sciences, École Polytechnique Fédérale de Lausanne, Switzerland; Knowledge Lab, University of Chicago, USA
| | | | - Mark Chu
- School of the Arts, Columbia University, USA
| | | | | |
Collapse
|
11
|
Wang X, Chu Y, Wang Q, Cao L, Qiao L, Zhang L, Liu M. Unsupervised contrastive graph learning for resting-state functional MRI analysis and brain disorder detection. Hum Brain Mapp 2023; 44:5672-5692. [PMID: 37668327 PMCID: PMC10619386 DOI: 10.1002/hbm.26469] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 07/08/2023] [Accepted: 08/11/2023] [Indexed: 09/06/2023] Open
Abstract
Resting-state functional magnetic resonance imaging (rs-fMRI) helps characterize regional interactions that occur in the human brain at a resting state. Existing research often attempts to explore fMRI biomarkers that best predict brain disease progression using machine/deep learning techniques. Previous fMRI studies have shown that learning-based methods usually require a large amount of labeled training data, limiting their utility in clinical practice where annotating data is often time-consuming and labor-intensive. To this end, we propose an unsupervised contrastive graph learning (UCGL) framework for fMRI-based brain disease analysis, in which a pretext model is designed to generate informative fMRI representations using unlabeled training data, followed by model fine-tuning to perform downstream disease identification tasks. Specifically, in the pretext model, we first design a bi-level fMRI augmentation strategy to increase the sample size by augmenting blood-oxygen-level-dependent (BOLD) signals, and then employ two parallel graph convolutional networks for fMRI feature extraction in an unsupervised contrastive learning manner. This pretext model can be optimized on large-scale fMRI datasets, without requiring labeled training data. This model is further fine-tuned on to-be-analyzed fMRI data for downstream disease detection in a task-oriented learning manner. We evaluate the proposed method on three rs-fMRI datasets for cross-site and cross-dataset learning tasks. Experimental results suggest that the UCGL outperforms several state-of-the-art approaches in automated diagnosis of three brain diseases (i.e., major depressive disorder, autism spectrum disorder, and Alzheimer's disease) with rs-fMRI data.
Collapse
Affiliation(s)
- Xiaochuan Wang
- The School of Mathematics ScienceLiaocheng UniversityLiaochengChina
| | - Ying Chu
- The School of Mathematics ScienceLiaocheng UniversityLiaochengChina
| | - Qianqian Wang
- The Department of Radiology and BRICUniversity of North Carolina at Chapel HillChapel HillNorth CarolinaUSA
| | - Liang Cao
- Taian Tumor Prevention and Treatment HospitalTaianChina
| | - Lishan Qiao
- The School of Mathematics ScienceLiaocheng UniversityLiaochengChina
| | - Limei Zhang
- School of Computer Science and TechnologyShandong Jianzhu UniversityJinanChina
| | - Mingxia Liu
- The Department of Radiology and BRICUniversity of North Carolina at Chapel HillChapel HillNorth CarolinaUSA
| |
Collapse
|
12
|
Shanmugavadivel K, Sathishkumar VE, Cho J, Subramanian M. Advancements in computer-assisted diagnosis of Alzheimer's disease: A comprehensive survey of neuroimaging methods and AI techniques for early detection. Ageing Res Rev 2023; 91:102072. [PMID: 37709055 DOI: 10.1016/j.arr.2023.102072] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 09/05/2023] [Accepted: 09/10/2023] [Indexed: 09/16/2023]
Abstract
Alzheimer's Disease (AD) is a brain disorder that causes the brain to shrink and eventually causes brain cells to die. This neurological condition progressively hampers cognitive and memory functions, along with the ability to carry out fundamental tasks over time. From the symptoms it is very difficult to detect during its early stage. It has become necessary to develop a computer assisted diagnostic models for the early AD detection. This survey work, discussed about a review of 110 published AD detection methods and techniques from the year 2011 to till-date. This study lies in its comprehensive exploration of AD detection methods using a range of artificial intelligence (AI) techniques and neuroimaging modalities. By collecting and analysing 50 papers related to AD diagnosis datasets, the study provides a comprehensive understanding of the diversity of input types, subjects, and classes used in AD research. Summarizing 60 papers on methodologies gives researchers a succinct overview of various approaches that contribute to enhancing detection accuracy. From the review, data are acquired and pre-processed form multiple modalities of neuroimaging. This paper mainly focused on review of different datasets used, various feature extraction methods, parameters used in neuro images. To diagnosis the Alzheimer's disease, the existing methods utilized three most common artificial intelligence techniques such as machine learning, deep learning, and transfer learning. We conclude this survey work by providing future perspectives for AD diagnosis at early stage.
Collapse
Affiliation(s)
| | - V E Sathishkumar
- Department of Software Engineering, Jeonbuk National University, Jeonju-si, Jeollabuk-do 54896, Republic of Korea
| | - Jaehyuk Cho
- Department of Software Engineering, Jeonbuk National University, Jeonju-si, Jeollabuk-do 54896, Republic of Korea.
| | | |
Collapse
|
13
|
Jiao T, Li F, Cui Y, Wang X, Li B, Shi F, Xia Y, Zhou Q, Zeng Q. Deep Learning With an Attention Mechanism for Differentiating the Origin of Brain Metastasis Using MR images. J Magn Reson Imaging 2023; 58:1624-1635. [PMID: 36965182 DOI: 10.1002/jmri.28695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 03/10/2023] [Accepted: 03/10/2023] [Indexed: 03/27/2023] Open
Abstract
BACKGROUND Brain metastasis (BM) is a serious neurological complication of cancer of different origins. The value of deep learning (DL) to identify multiple types of primary origins remains unclear. PURPOSE To distinguish primary site of BM and identify the best DL models. STUDY TYPE Retrospective. POPULATION A total of 449 BM derived from 214 patients (49.5% for female, mean age 58 years) (100 from small cell lung cancer [SCLC], 125 from non-small cell lung cancer [NSCLC], 116 from breast cancer [BC], and 108 from gastrointestinal cancer [GIC]) were included. FIELD STRENGTH/SEQUENCE A 3-T, T1 turbo spin echo (T1-TSE), T2-TSE, T2FLAIR-TSE, DWI echo-planar imaging (DWI-EPI) and contrast-enhanced T1-TSE (CE T1-TSE). ASSESSMENT Lesions were divided into training (n = 285, 153 patients), testing (n = 122, 93 patients), and independent testing cohorts (n = 42, 34 patients). Three-dimensional residual network (3D-ResNet), named 3D ResNet6 and 3D ResNet 18, was proposed for identifying the four origins based on single MRI and combined MRI (T1WI + T2-FLAIR + DWI, CE-T1WI + DWI, CE-T1WI + T2WI + DWI). DL model was used to distinguish lung cancer from non-lung cancer; then SCLC vs. NSCLC for lung cancer classification and BC vs. GIC for non-lung cancer classification was performed. A subjective visual analysis was implemented and compared with DL models. Gradient-weighted class activation mapping (Grad-CAM) was used to visualize the model by heatmaps. STATISTICAL TESTS The area under the receiver operating characteristics curve (AUC) assess each classification performance. RESULTS 3D ResNet18 with Grad-CAM and AIC showed better performance than 3DResNet6, 3DResNet18 and the radiologist for distinguishing lung cancer from non-lung cancer, SCLC from NSCLC, and BC from GIC. For single MRI sequence, T1WI, DWI, and CE-T1WI performed best for lung cancer vs. non-lung cancer, SCLC vs. NSCLC, and BC vs. GIC classifications. The AUC ranged from 0.675 to 0.876 and from 0.684 to 0.800 regarding the testing and independent testing datasets, respectively. For combined MRI sequences, the combination of CE-T1WI + T2WI + DWI performed better for BC vs. GIC (AUCs of 0.788 and 0.848 on testing and independent testing datasets, respectively), while the combined MRI approach (T1WI + T2-FLAIR + DWI, CE-T1WI + DWI) could not achieve higher AUCs for lung cancer vs. non-lung cancer, SCLC vs. NSCLC. Grad-CAM helped for model visualization by heatmaps that focused on tumor regions. DATA CONCLUSION DL models may help to distinguish the origins of BM based on MRI data. EVIDENCE LEVEL 3 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Tianyu Jiao
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
- Shandong First Medical University, Jinan, China
| | - Fuyan Li
- Department of Radiology, Shandong Provincial Hospital affiliated to Shandong First Medical University, Jinan, China
| | - Yi Cui
- Department of Radiology, Qilu Hospital of Shandong University, Jinan, China
| | - Xiao Wang
- Department of Radiology, Jining No. 1 People's Hospital, Jining, China
| | - Butuo Li
- Department of Radiation Oncology, Shandong Cancer Hospital & Institute, Jinan, China
| | - Feng Shi
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Yuwei Xia
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Qing Zhou
- Shanghai United Imaging Intelligence, Shanghai, China
| | - Qingshi Zeng
- Department of Radiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan, China
| |
Collapse
|
14
|
Hagras EAA, Aldosary S, Khaled H, Hassan TM. Authenticated Public Key Elliptic Curve Based on Deep Convolutional Neural Network for Cybersecurity Image Encryption Application. SENSORS (BASEL, SWITZERLAND) 2023; 23:6589. [PMID: 37514882 PMCID: PMC10383835 DOI: 10.3390/s23146589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Revised: 07/09/2023] [Accepted: 07/17/2023] [Indexed: 07/30/2023]
Abstract
The demand for cybersecurity is growing to safeguard information flow and enhance data privacy. This essay suggests a novel authenticated public key elliptic curve based on a deep convolutional neural network (APK-EC-DCNN) for cybersecurity image encryption application. The public key elliptic curve discrete logarithmic problem (EC-DLP) is used for elliptic curve Diffie-Hellman key exchange (EC-DHKE) in order to generate a shared session key, which is used as the chaotic system's beginning conditions and control parameters. In addition, the authenticity and confidentiality can be archived based on ECC to share the EC parameters between two parties by using the EC-DHKE algorithm. Moreover, the 3D Quantum Chaotic Logistic Map (3D QCLM) has an extremely chaotic behavior of the bifurcation diagram and high Lyapunov exponent, which can be used in high-level security. In addition, in order to achieve the authentication property, the secure hash function uses the output sequence of the DCNN and the output sequence of the 3D QCLM in the proposed authenticated expansion diffusion matrix (AEDM). Finally, partial frequency domain encryption (PFDE) technique is achieved by using the discrete wavelet transform in order to satisfy the robustness and fast encryption process. Simulation results and security analysis demonstrate that the proposed encryption algorithm achieved the performance of the state-of-the-art techniques in terms of quality, security, and robustness against noise- and signal-processing attacks.
Collapse
Affiliation(s)
- Esam A A Hagras
- Faculty of Engineering, Delta University for Science and Technology, Gamasa 35712, Egypt
| | - Saad Aldosary
- Department of Computer Science, Community College, King Saud University, Riyadh 11437, Saudi Arabia
| | - Haitham Khaled
- Department of Electronics and Communications, School of Engineering, Edith Cowan University, Perth, WA 6027, Australia
| | - Tarek M Hassan
- Faculty of Engineering, Delta University for Science and Technology, Gamasa 35712, Egypt
| |
Collapse
|
15
|
Kim SY. Personalized Explanations for Early Diagnosis of Alzheimer's Disease Using Explainable Graph Neural Networks with Population Graphs. Bioengineering (Basel) 2023; 10:701. [PMID: 37370632 DOI: 10.3390/bioengineering10060701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 06/05/2023] [Accepted: 06/06/2023] [Indexed: 06/29/2023] Open
Abstract
Leveraging recent advances in graph neural networks, our study introduces an application of graph convolutional networks (GCNs) within a correlation-based population graph, aiming to enhance Alzheimer's disease (AD) prognosis and illuminate the intricacies of AD progression. This methodological approach leverages the inherent structure and correlations in demographic and neuroimaging data to predict amyloid-beta (Aβ) positivity. To validate our approach, we conducted extensive performance comparisons with conventional machine learning models and a GCN model with randomly assigned edges. The results consistently highlighted the superior performance of the correlation-based GCN model across different sample groups in the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, suggesting the importance of accurately reflecting the correlation structure in population graphs for effective pattern recognition and accurate prediction. Furthermore, our exploration of the model's decision-making process using GNNExplainer identified unique sets of biomarkers indicative of Aβ positivity in different groups, shedding light on the heterogeneity of AD progression. This study underscores the potential of our proposed approach for more nuanced AD prognoses, potentially informing more personalized and precise therapeutic strategies. Future research can extend these findings by integrating diverse data sources, employing longitudinal data, and refining the interpretability of the model, which potentially has broad applicability to other complex diseases.
Collapse
Affiliation(s)
- So Yeon Kim
- Department of Artificial Intelligence, Ajou University, Suwon 16499, Republic of Korea
- Department of Software and Computer Engineering, Ajou University, Suwon 16499, Republic of Korea
| |
Collapse
|
16
|
Chelladurai A, Narayan DL, Divakarachari PB, Loganathan U. fMRI-Based Alzheimer's Disease Detection Using the SAS Method with Multi-Layer Perceptron Network. Brain Sci 2023; 13:893. [PMID: 37371371 DOI: 10.3390/brainsci13060893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 05/24/2023] [Accepted: 05/30/2023] [Indexed: 06/29/2023] Open
Abstract
In the present scenario, Alzheimer's Disease (AD) is one of the incurable neuro-degenerative disorders, which accounts for nearly 60% to 70% of dementia cases. Currently, several machine-learning approaches and neuroimaging modalities are utilized for diagnosing AD. Among the available neuroimaging modalities, functional Magnetic Resonance Imaging (fMRI) is extensively utilized for studying brain activities related to AD. However, analyzing complex brain structures in fMRI is a time-consuming and complex task; so, a novel automated model was proposed in this manuscript for early diagnosis of AD using fMRI images. Initially, the fMRI images are acquired from an online dataset: Alzheimer's Disease Neuroimaging Initiative (ADNI). Further, the quality of the acquired fMRI images was improved by implementing a normalization technique. Then, the Segmentation by Aggregating Superpixels (SAS) method was implemented for segmenting the brain regions (AD, Normal Controls (NC), Mild Cognitive Impairment (MCI), Early Mild Cognitive Impairment (EMCI), Late Mild Cognitive Impairment (LMCI), and Significant Memory Concern (SMC)) from the denoised fMRI images. From the segmented brain regions, feature vectors were extracted by employing Gabor and Gray Level Co-Occurrence Matrix (GLCM) techniques. The obtained feature vectors were dimensionally reduced by implementing Honey Badger Optimization Algorithm (HBOA) and fed to the Multi-Layer Perceptron (MLP) model for classifying the fMRI images as AD, NC, MCI, EMCI, LMCI, and SMC. The extensive investigation indicated that the presented model attained 99.44% of classification accuracy, 88.90% of Dice Similarity Coefficient (DSC), 90.82% of Jaccard Coefficient (JC), and 88.43% of Hausdorff Distance (HD). The attained results are better compared with the conventional segmentation and classification models.
Collapse
Affiliation(s)
- Aarthi Chelladurai
- Department of Electronics and Communication Engineering, Sengunthar Engineering College, Tiruchengode 637205, Tamil Nadu, India
| | - Dayanand Lal Narayan
- Department of Computer Science Engineering, GITAM School of Technology, GITAM University, Bengaluru 561203, Karnataka, India
| | | | - Umasankar Loganathan
- Department of Electrical and Electronics Engineering, S.A. Engineering College, Chennai 600077, Tamilnadu, India
| |
Collapse
|
17
|
Rafique R, Gantassi R, Amin R, Frnda J, Mustapha A, Alshehri AH. Deep fake detection and classification using error-level analysis and deep learning. Sci Rep 2023; 13:7422. [PMID: 37156887 PMCID: PMC10167215 DOI: 10.1038/s41598-023-34629-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Accepted: 05/04/2023] [Indexed: 05/10/2023] Open
Abstract
Due to the wide availability of easy-to-access content on social media, along with the advanced tools and inexpensive computing infrastructure, has made it very easy for people to produce deep fakes that can cause to spread disinformation and hoaxes. This rapid advancement can cause panic and chaos as anyone can easily create propaganda using these technologies. Hence, a robust system to differentiate between real and fake content has become crucial in this age of social media. This paper proposes an automated method to classify deep fake images by employing Deep Learning and Machine Learning based methodologies. Traditional Machine Learning (ML) based systems employing handcrafted feature extraction fail to capture more complex patterns that are poorly understood or easily represented using simple features. These systems cannot generalize well to unseen data. Moreover, these systems are sensitive to noise or variations in the data, which can reduce their performance. Hence, these problems can limit their usefulness in real-world applications where the data constantly evolves. The proposed framework initially performs an Error Level Analysis of the image to determine if the image has been modified. This image is then supplied to Convolutional Neural Networks for deep feature extraction. The resultant feature vectors are then classified via Support Vector Machines and K-Nearest Neighbors by performing hyper-parameter optimization. The proposed method achieved the highest accuracy of 89.5% via Residual Network and K-Nearest Neighbor. The results prove the efficiency and robustness of the proposed technique; hence, it can be used to detect deep fake images and reduce the potential threat of slander and propaganda.
Collapse
Affiliation(s)
- Rimsha Rafique
- Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan, 47050
| | - Rahma Gantassi
- Department of Electrical Engineering, Chonnam National University, Gwangju, 61186, South Korea
| | - Rashid Amin
- Department of Computer Science, University of Engineering and Technology, Taxila, Pakistan, 47050.
- Department of Computer Science, University of Chakwal, Chakwal, 48800, Pakistan.
| | - Jaroslav Frnda
- Department of Quantitative Methods and Economic Informatics, Faculty of Operation and Economics of Transport and Communications, University of Zilina, 01026, Zilina, Slovakia
- Department of Telecommunications, Faculty of Electrical Engineering and Computer Science, VSB Technical University of Ostrava, 70800, Ostrava, Czech Republic
| | - Aida Mustapha
- Faculty of Applied Sciences and Technology, Universiti Tun Hussein Onn Malaysia, KM1 Jalan Pagoh, 84600, Pagoh, Johor, Malaysia
| | - Asma Hassan Alshehri
- Durma College of Science and Humanities, Shaqra University, Shaqra, 11961, Saudi Arabia
| |
Collapse
|
18
|
Agarwal D, Berbís MÁ, Luna A, Lipari V, Ballester JB, de la Torre-Díez I. Automated Medical Diagnosis of Alzheimer´s Disease Using an Efficient Net Convolutional Neural Network. J Med Syst 2023; 47:57. [PMID: 37129723 PMCID: PMC10154284 DOI: 10.1007/s10916-023-01941-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 03/20/2023] [Indexed: 05/03/2023]
Abstract
Alzheimer's disease (AD) poses an enormous challenge to modern healthcare. Since 2017, researchers have been using deep learning (DL) models for the early detection of AD using neuroimaging biomarkers. In this paper, we implement the EfficietNet-b0 convolutional neural network (CNN) with a novel approach-"fusion of end-to-end and transfer learning"-to classify different stages of AD. 245 T1W MRI scans of cognitively normal (CN) subjects, 229 scans of AD subjects, and 229 scans of subjects with stable mild cognitive impairment (sMCI) were employed. Each scan was preprocessed using a standard pipeline. The proposed models were trained and evaluated using preprocessed scans. For the sMCI vs. AD classification task we obtained 95.29% accuracy and 95.35% area under the curve (AUC) for model training and 93.10% accuracy and 93.00% AUC for model testing. For the multiclass AD vs. CN vs. sMCI classification task we obtained 85.66% accuracy and 86% AUC for model training and 87.38% accuracy and 88.00% AUC for model testing. Based on our experimental results, we conclude that CNN-based DL models can be used to analyze complicated MRI scan features in clinical settings.
Collapse
Affiliation(s)
- Deevyankar Agarwal
- Department of Signal Theory and Communications and Telematics Engineering, University of Valladolid, Paseo de Belén 15, 47011, Valladolid, Spain.
| | | | - Antonio Luna
- MRI Unit, Radiology Department, HT Médica, Carmelo Torres No. 2, 23007, Jaén, Spain
| | - Vivian Lipari
- European Atlantic University, Isabel Torres 21, 39011, Santander, Spain
| | | | - Isabel de la Torre-Díez
- Department of Signal Theory and Communications and Telematics Engineering, University of Valladolid, Paseo de Belén 15, 47011, Valladolid, Spain
| |
Collapse
|
19
|
Analysis of intermunicipal journeys for cardiac surgery in Brazilian Unified Health System (SUS): an approach based on network theory. Int J Equity Health 2023; 22:48. [PMID: 36927483 PMCID: PMC10022046 DOI: 10.1186/s12939-023-01857-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 03/03/2023] [Indexed: 03/18/2023] Open
Abstract
INTRODUCTION The transformation of data into information is important to support decision making and, thus, to induce improvements in healthcare services. The regionalized organization of healthcare systems is necessary to ensure the integrity of citizen care. From this perspective, the creation of mechanisms to guide and assess the behavior of a healthcare services network becomes necessary. However, these mechanisms must consider the interaction between different municipalities. The objective of this study is to apply network analysis as a supporting tool in the Brazilian Unified Health System (Sistema Único de Saúde-SUS) management. METHODS The stages of the proposed method are described and applied in a real situation, analyzing the intermunicipal interaction network for cardiovascular surgery in the municipality of Vitória da Conquista, Bahia, Brazil, from 2008 to 2020. The metrics analyzed were journeys indices, flow of patients and distance of the journeys, considering the journeys from and to the municipality in focus. RESULT There was an increase of the incoming flow and in-degree indices combined with a decrease in outgoing flow, showing the growing importance of this municipality as a provider of these services. CONCLUSION The method used in the study has potential to be adopted as a management tool to assess the behavior of the interactions network of the selected service, aiding the regionalized organization of the healthcare system.
Collapse
|
20
|
Illakiya T, Karthik R. Automatic Detection of Alzheimer's Disease using Deep Learning Models and Neuro-Imaging: Current Trends and Future Perspectives. Neuroinformatics 2023; 21:339-364. [PMID: 36884142 DOI: 10.1007/s12021-023-09625-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/16/2023] [Indexed: 03/09/2023]
Abstract
Deep learning algorithms have a huge influence on tackling research issues in the field of medical image processing. It acts as a vital aid for the radiologists in producing accurate results toward effective disease diagnosis. The objective of this research is to highlight the importance of deep learning models in the detection of Alzheimer's Disease (AD). The main objective of this research is to analyze different deep learning methods used for detecting AD. This study examines 103 research articles published in various research databases. These articles have been selected based on specific criteria to find the most relevant findings in the field of AD detection. The review was carried out based on deep learning techniques such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Transfer Learning (TL). To propose accurate methods for the detection, segmentation, and severity grading of AD, the radiological features need to be examined in greater depth. This review attempts to analyze different deep learning methods applied for AD detection using neuroimaging modalities like Positron Emission Tomography (PET), Magnetic Resonance Imaging (MRI), etc. The focus of this review is restricted to deep learning works based on radiological imaging data for AD detection. There are a few works that have utilized other biomarkers to understand the effect of AD. Also, articles published in English were alone considered for analysis. This work concludes by highlighting the key research issues towards effective AD detection. Though several methods have yielded promising results in AD detection, the progression from Mild Cognitive Impairment (MCI) to AD need to be analyzed in greater depth using DL models.
Collapse
Affiliation(s)
- T Illakiya
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - R Karthik
- Centre for Cyber Physical Systems, School of Electronics Engineering, Vellore Institute of Technology, Chennai, India.
| |
Collapse
|
21
|
Mandawkar U, Diwan T. Alzheimer disease classification using tawny flamingo based deep convolutional neural networks via federated learning. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2023.2172524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
Affiliation(s)
- Umakant Mandawkar
- Department of Computer Science & Engineering, Indian Institute of Information Technology, Nagpur, India
- Department of Computer Engineering, SVKM’s Institute of Technology, Dhule, Maharashtra, India
| | - Tausif Diwan
- Department of Computer Science & Engineering, Indian Institute of Information Technology, Nagpur, India
| |
Collapse
|
22
|
Raza N, Naseer A, Tamoor M, Zafar K. Alzheimer Disease Classification through Transfer Learning Approach. Diagnostics (Basel) 2023; 13:diagnostics13040801. [PMID: 36832292 PMCID: PMC9955379 DOI: 10.3390/diagnostics13040801] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 01/13/2023] [Accepted: 01/18/2023] [Indexed: 02/25/2023] Open
Abstract
Alzheimer's disease (AD) is a slow neurological disorder that destroys the thought process, and consciousness, of a human. It directly affects the development of mental ability and neurocognitive functionality. The number of patients with Alzheimer's disease is increasing day by day, especially in old aged people, who are above 60 years of age, and, gradually, it becomes cause of their death. In this research, we discuss the segmentation and classification of the Magnetic resonance imaging (MRI) of Alzheimer's disease, through the concept of transfer learning and customizing of the convolutional neural network (CNN) by specifically using images that are segmented by the Gray Matter (GM) of the brain. Instead of training and computing the proposed model accuracy from the start, we used a pre-trained deep learning model as our base model, and, after that, transfer learning was applied. The accuracy of the proposed model was tested over a different number of epochs, 10, 25, and 50. The overall accuracy of the proposed model was 97.84%.
Collapse
Affiliation(s)
- Noman Raza
- Department of Computer Science, National University of Computer and Emerging Sciences, Lahore 54770, Pakistan
| | - Asma Naseer
- Department of Computer Science, National University of Computer and Emerging Sciences, Lahore 54770, Pakistan
| | - Maria Tamoor
- Department of Computer Science, Forman Christian College, Lahore 54600, Pakistan
| | - Kashif Zafar
- Department of Computer Science, National University of Computer and Emerging Sciences, Lahore 54770, Pakistan
- Correspondence:
| |
Collapse
|
23
|
Optimal classification and generalized prevalence estimates for diagnostic settings with more than two classes. Math Biosci 2023; 358:108982. [PMID: 36804385 DOI: 10.1016/j.mbs.2023.108982] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 01/25/2023] [Accepted: 02/14/2023] [Indexed: 02/19/2023]
Abstract
An accurate multiclass classification strategy is crucial to interpreting antibody tests. However, traditional methods based on confidence intervals or receiver operating characteristics lack clear extensions to settings with more than two classes. We address this problem by developing a multiclass classification based on probabilistic modeling and optimal decision theory that minimizes the convex combination of false classification rates. The classification process is challenging when the relative fraction of the population in each class, or generalized prevalence, is unknown. Thus, we also develop a method for estimating the generalized prevalence of test data that is independent of classification of the test data. We validate our approach on serological data with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) naïve, previously infected, and vaccinated classes. Synthetic data are used to demonstrate that (i) prevalence estimates are unbiased and converge to true values and (ii) our procedure applies to arbitrary measurement dimensions. In contrast to the binary problem, the multiclass setting offers wide-reaching utility as the most general framework and provides new insight into prevalence estimation best practices.
Collapse
|
24
|
Ma H, Cao Y, Li M, Zhan L, Xie Z, Huang L, Gao Y, Jia X. Abnormal amygdala functional connectivity and deep learning classification in multifrequency bands in autism spectrum disorder: A multisite functional magnetic resonance imaging study. Hum Brain Mapp 2023; 44:1094-1104. [PMID: 36346215 PMCID: PMC9875923 DOI: 10.1002/hbm.26141] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2022] [Revised: 10/19/2022] [Accepted: 10/25/2022] [Indexed: 11/11/2022] Open
Abstract
Previous studies have explored resting-state functional connectivity (rs-FC) of the amygdala in patients with autism spectrum disorder (ASD). However, it remains unclear whether there are frequency-specific FC alterations of the amygdala in ASD and whether FC in specific frequency bands can be used to distinguish patients with ASD from typical controls (TCs). Data from 306 patients with ASD and 314 age-matched and sex-matched TCs were collected from 28 sites in the Autism Brain Imaging Data Exchange database. The bilateral amygdala, defined as the seed regions, was used to perform seed-based FC analyses in the conventional, slow-5, and slow-4 frequency bands at each site. Image-based meta-analyses were used to obtain consistent brain regions across 28 sites in the three frequency bands. By combining generative adversarial networks and deep neural networks, a deep learning approach was applied to distinguish patients with ASD from TCs. The meta-analysis results showed frequency band specificity of FC in ASD, which was reflected in the slow-5 frequency band instead of the conventional and slow-4 frequency bands. The deep learning results showed that, compared with the conventional and slow-4 frequency bands, the slow-5 frequency band exhibited a higher accuracy of 74.73%, precision of 74.58%, recall of 75.05%, and area under the curve of 0.811 to distinguish patients with ASD from TCs. These findings may help us to understand the pathological mechanisms of ASD and provide preliminary guidance for the clinical diagnosis of ASD.
Collapse
Affiliation(s)
- Huibin Ma
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Yikang Cao
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Mengting Li
- College of Teacher Education, Zhejiang Normal University, Jinhua, China.,Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University, Jinhua, China
| | - Linlin Zhan
- Faculty of Western Languages, Heilongjiang University, Harbin, China
| | - Zhou Xie
- School of Information and Electronics Technology, Jiamusi University, Jiamusi, China
| | - Lina Huang
- Department of Radiology, Changshu No. 2 People's Hospital, The Affiliated Changshu Hospital of Xuzhou Medical University, Changshu, China
| | - Yanyan Gao
- College of Teacher Education, Zhejiang Normal University, Jinhua, China.,Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University, Jinhua, China
| | - Xize Jia
- Department of Radiology, Changshu No. 2 People's Hospital, The Affiliated Changshu Hospital of Xuzhou Medical University, Changshu, China
| |
Collapse
|
25
|
OViTAD: Optimized Vision Transformer to Predict Various Stages of Alzheimer's Disease Using Resting-State fMRI and Structural MRI Data. Brain Sci 2023; 13:brainsci13020260. [PMID: 36831803 PMCID: PMC9954686 DOI: 10.3390/brainsci13020260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 01/19/2023] [Accepted: 02/01/2023] [Indexed: 02/09/2023] Open
Abstract
Advances in applied machine learning techniques for neuroimaging have encouraged scientists to implement models to diagnose brain disorders such as Alzheimer's disease at early stages. Predicting the exact stage of Alzheimer's disease is challenging; however, complex deep learning techniques can precisely manage this. While successful, these complex architectures are difficult to interrogate and computationally expensive. Therefore, using novel, simpler architectures with more efficient pattern extraction capabilities, such as transformers, is of interest to neuroscientists. This study introduced an optimized vision transformer architecture to predict the group membership by separating healthy adults, mild cognitive impairment, and Alzheimer's brains within the same age group (>75 years) using resting-state functional (rs-fMRI) and structural magnetic resonance imaging (sMRI) data aggressively preprocessed by our pipeline. Our optimized architecture, known as OViTAD is currently the sole vision transformer-based end-to-end pipeline and outperformed the existing transformer models and most state-of-the-art solutions. Our model achieved F1-scores of 97%±0.0 and 99.55%±0.39 from the testing sets for the rs-fMRI and sMRI modalities in the triple-class prediction experiments. Furthermore, our model reached these performances using 30% fewer parameters than a vanilla transformer. Furthermore, the model was robust and repeatable, producing similar estimates across three runs with random data splits (we reported the averaged evaluation metrics). Finally, to challenge the model, we observed how it handled increasing noise levels by inserting varying numbers of healthy brains into the two dementia groups. Our findings suggest that optimized vision transformers are a promising and exciting new approach for neuroimaging applications, especially for Alzheimer's disease prediction.
Collapse
|
26
|
Mahesh R N U, Nelleri A. Multi-Class Classification and Multi-Output Regression of Three-Dimensional Objects Using Artificial Intelligence Applied to Digital Holographic Information. SENSORS (BASEL, SWITZERLAND) 2023; 23:1095. [PMID: 36772135 PMCID: PMC9920031 DOI: 10.3390/s23031095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 12/18/2022] [Accepted: 12/29/2022] [Indexed: 06/18/2023]
Abstract
Digital holographically sensed 3D data processing, which is useful for AI-based vision, is demonstrated. Three prominent methods of learning from datasets such as sensed holograms, computationally retrieved intensity and phase from holograms forming concatenated intensity-phase (whole information) images, and phase-only images (depth information) were utilized for the proposed multi-class classification and multi-output regression tasks of the chosen 3D objects in supervised learning. Each dataset comprised 2268 images obtained from the chosen eighteen 3D objects. The efficacy of our approaches was validated on experimentally generated digital holographic data then further quantified and compared using specific evaluation matrices. The machine learning classifiers had better AUC values for different classes on the holograms and whole information datasets compared to the CNN, whereas the CNN had a better performance on the phase-only image dataset compared to these classifiers. The MLP regressor was found to have a stable prediction in the test and validation sets with a fixed EV regression score of 0.00 compared to the CNN, the other regressors for holograms, and the phase-only image datasets, whereas the RF regressor showed a better performance in the validation set for the whole information dataset with a fixed EV regression score of 0.01 compared to the CNN and other regressors.
Collapse
|
27
|
Garg N, Choudhry MS, Bodade RM. A review on Alzheimer's disease classification from normal controls and mild cognitive impairment using structural MR images. J Neurosci Methods 2023; 384:109745. [PMID: 36395961 DOI: 10.1016/j.jneumeth.2022.109745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 10/04/2022] [Accepted: 11/11/2022] [Indexed: 11/16/2022]
Abstract
Alzheimer's disease (AD) is an irreversible neurodegenerative brain disorder that degrades the memory and cognitive ability in elderly people. The main reason for memory loss and reduction in cognitive ability is the structural changes in the brain that occur due to neuronal loss. These structural changes are most conspicuous in the hippocampus, cortex, and grey matter and can be assessed by using neuroimaging techniques viz. Positron Emission Tomography (PET), structural Magnetic Resonance Imaging (MRI) and functional MRI (fMRI), etc. Out of these neuroimaging techniques, structural MRI has evolved as the best technique as it indicates the best soft tissue contrast and high spatial resolution which is important for AD detection. Currently, the focus of researchers is on predicting the conversion of Mild Cognitive Impairment (MCI) into AD. MCI represents the transition state between expected cognitive changes with normal aging and Alzheimer's disease. Not every MCI patient progresses into Alzheimer's disease. MCI can develop into stable MCI (sMCI, patients are called non-converters) or into progressive MCI (pMCI, patients are diagnosed as MCI converters). This paper discusses the prognosis of MCI to AD conversion and presents a review of structural MRI-based studies for AD detection. AD detection framework includes feature extraction, feature selection, and classification process. This paper reviews the studies for AD detection based on different feature extraction methods and machine learning algorithms for classification. The performance of various feature extraction methods has been compared and it has been observed that the wavelet transform-based feature extraction method would give promising results for AD classification. The present study indicates that researchers are successful in classifying AD from Normal Controls (NrmC) but, it still requires a lot of work to be done for MCI/ NrmC and MCI/AD, which would help in detecting AD at its early stage.
Collapse
Affiliation(s)
- Neha Garg
- Delhi Technological University, Department of Electronics and Communication, Delhi 110042, India.
| | - Mahipal Singh Choudhry
- Delhi Technological University, Department of Electronics and Communication, Delhi 110042, India.
| | - Rajesh M Bodade
- Military College of Telecommunication Engineering (MCTE), Mhow, Indore 453441, Madhya Pradesh, India.
| |
Collapse
|
28
|
Leveraging Computational Intelligence Techniques for Diagnosing Degenerative Nerve Diseases: A Comprehensive Review, Open Challenges, and Future Research Directions. Diagnostics (Basel) 2023; 13:diagnostics13020288. [PMID: 36673100 PMCID: PMC9858227 DOI: 10.3390/diagnostics13020288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 12/28/2022] [Accepted: 01/10/2023] [Indexed: 01/13/2023] Open
Abstract
Degenerative nerve diseases such as Alzheimer's and Parkinson's diseases have always been a global issue of concern. Approximately 1/6th of the world's population suffers from these disorders, yet there are no definitive solutions to cure these diseases after the symptoms set in. The best way to treat these disorders is to detect them at an earlier stage. Many of these diseases are genetic; this enables machine learning algorithms to give inferences based on the patient's medical records and history. Machine learning algorithms such as deep neural networks are also critical for the early identification of degenerative nerve diseases. The significant applications of machine learning and deep learning in early diagnosis and establishing potential therapies for degenerative nerve diseases have motivated us to work on this review paper. Through this review, we covered various machine learning and deep learning algorithms and their application in the diagnosis of degenerative nerve diseases, such as Alzheimer's disease and Parkinson's disease. Furthermore, we also included the recent advancements in each of these models, which improved their capabilities for classifying degenerative nerve diseases. The limitations of each of these methods are also discussed. In the conclusion, we mention open research challenges and various alternative technologies, such as virtual reality and Big data analytics, which can be useful for the diagnosis of degenerative nerve diseases.
Collapse
|
29
|
Khan R, Akbar S, Mehmood A, Shahid F, Munir K, Ilyas N, Asif M, Zheng Z. A transfer learning approach for multiclass classification of Alzheimer's disease using MRI images. Front Neurosci 2023; 16:1050777. [PMID: 36699527 PMCID: PMC9869687 DOI: 10.3389/fnins.2022.1050777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 12/05/2022] [Indexed: 01/11/2023] Open
Abstract
Alzheimer's is an acute degenerative disease affecting the elderly population all over the world. The detection of disease at an early stage in the absence of a large-scale annotated dataset is crucial to the clinical treatment for the prevention and early detection of Alzheimer's disease (AD). In this study, we propose a transfer learning base approach to classify various stages of AD. The proposed model can distinguish between normal control (NC), early mild cognitive impairment (EMCI), late mild cognitive impairment (LMCI), and AD. In this regard, we apply tissue segmentation to extract the gray matter from the MRI scans obtained from the Alzheimer's Disease National Initiative (ADNI) database. We utilize this gray matter to tune the pre-trained VGG architecture while freezing the features of the ImageNet database. It is achieved through the addition of a layer with step-wise freezing of the existing blocks in the network. It not only assists transfer learning but also contributes to learning new features efficiently. Extensive experiments are conducted and results demonstrate the superiority of the proposed approach.
Collapse
Affiliation(s)
- Rizwan Khan
- Department of Computer Science and Mathematics, Zhejiang Normal University, Jinhua, China,*Correspondence: Rizwan Khan ✉
| | - Saeed Akbar
- School of Computer Science, Huazhong University of Science and Technology, Wuhan, China
| | - Atif Mehmood
- Division of Biomedical Imaging, Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm, Sweden,Department of Computer Science, National University of Modern Languages, Islamabad, Pakistan
| | - Farah Shahid
- Department of Computer Science, University of Agriculture, Sub Campus Burewala-Vehari, Faisalabad, Pakistan
| | - Khushboo Munir
- Department of Radiology and Diagnostic Imaging, University of Alberta, Edmonton, AB, Canada
| | - Naveed Ilyas
- Department of Physics, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - M. Asif
- Department of Radiology, Emory Brain Health Center-Neurosurgery, School of Medicine, Emory University, Atlanta, GA, United States
| | - Zhonglong Zheng
- Department of Computer Science and Mathematics, Zhejiang Normal University, Jinhua, China,Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China
| |
Collapse
|
30
|
Abbas Q, Hussain A, Baig AR. CAD-ALZ: A Blockwise Fine-Tuning Strategy on Convolutional Model and Random Forest Classifier for Recognition of Multistage Alzheimer's Disease. Diagnostics (Basel) 2023; 13:167. [PMID: 36611459 PMCID: PMC9818479 DOI: 10.3390/diagnostics13010167] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/24/2022] [Accepted: 12/31/2022] [Indexed: 01/05/2023] Open
Abstract
Mental deterioration or Alzheimer's (ALZ) disease is progressive and causes both physical and mental dependency. There is a need for a computer-aided diagnosis (CAD) system that can help doctors make an immediate decision. (1) Background: Currently, CAD systems are developed based on hand-crafted features, machine learning (ML), and deep learning (DL) techniques. Those CAD systems frequently require domain-expert knowledge and massive datasets to extract deep features or model training, which causes problems with class imbalance and overfitting. Additionally, there are still manual approaches used by radiologists due to the lack of dataset availability and to train the model with cost-effective computation. Existing works rely on performance improvement by neglecting the problems of the limited dataset, high computational complexity, and unavailability of lightweight and efficient feature descriptors. (2) Methods: To address these issues, a new approach, CAD-ALZ, is developed by extracting deep features through a ConvMixer layer with a blockwise fine-tuning strategy on a very small original dataset. At first, we apply the data augmentation method to images to increase the size of datasets. In this study, a blockwise fine-tuning strategy is employed on the ConvMixer model to detect robust features. Afterwards, a random forest (RF) is used to classify ALZ disease stages. (3) Results: The proposed CAD-ALZ model obtained significant results by using six evaluation metrics such as the F1-score, Kappa, accuracy, precision, sensitivity, and specificity. The CAD-ALZ model performed with a sensitivity of 99.69% and an F1-score of 99.61%. (4) Conclusions: The suggested CAD-ALZ approach is a potential technique for clinical use and computational efficiency compared to state-of-the-art approaches. The CAD-ALZ model code is freely available on GitHub for the scientific community.
Collapse
Affiliation(s)
- Qaisar Abbas
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Ayyaz Hussain
- Department of Computer Science, Quaid-i-Azam University, Islamabad 44000, Pakistan
| | - Abdul Rauf Baig
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| |
Collapse
|
31
|
ElNakieb Y, Ali MT, Elnakib A, Shalaby A, Mahmoud A, Soliman A, Barnes GN, El-Baz A. Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study. BIOENGINEERING (BASEL, SWITZERLAND) 2023; 10:bioengineering10010056. [PMID: 36671628 PMCID: PMC9855190 DOI: 10.3390/bioengineering10010056] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 12/22/2022] [Accepted: 12/27/2022] [Indexed: 01/04/2023]
Abstract
In addition to the standard observational assessment for autism spectrum disorder (ASD), recent advancements in neuroimaging and machine learning (ML) suggest a rapid and objective alternative using brain imaging. This work presents a pipelined framework, using functional magnetic resonance imaging (fMRI) that allows not only an accurate ASD diagnosis but also the identification of the brain regions contributing to the diagnosis decision. The proposed framework includes several processing stages: preprocessing, brain parcellation, feature representation, feature selection, and ML classification. For feature representation, the proposed framework uses both a conventional feature representation and a novel dynamic connectivity representation to assist in the accurate classification of an autistic individual. Based on a large publicly available dataset, this extensive research highlights different decisions along the proposed pipeline and their impact on diagnostic accuracy. A large publicly available dataset of 884 subjects from the Autism Brain Imaging Data Exchange I (ABIDE-I) initiative is used to validate our proposed framework, achieving a global balanced accuracy of 98.8% with five-fold cross-validation and proving the potential of the proposed feature representation. As a result of this comprehensive study, we achieve state-of-the-art accuracy, confirming the benefits of the proposed feature representation and feature engineering in extracting useful information as well as the potential benefits of utilizing ML and neuroimaging in the diagnosis and understanding of autism.
Collapse
Affiliation(s)
- Yaser ElNakieb
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Mohamed T. Ali
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Elnakib
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Shalaby
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ali Mahmoud
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Ahmed Soliman
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Gregory Neal Barnes
- Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
- Correspondence:
| |
Collapse
|
32
|
Rahman Siddiquee MM, Shah J, Chong C, Nikolova S, Dumkrieger G, Li B, Wu T, Schwedt TJ. Headache classification and automatic biomarker extraction from structural MRIs using deep learning. Brain Commun 2023; 5:fcac311. [PMID: 36751567 PMCID: PMC9897182 DOI: 10.1093/braincomms/fcac311] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Revised: 08/24/2022] [Accepted: 11/24/2022] [Indexed: 11/29/2022] Open
Abstract
Data-driven machine-learning methods on neuroimaging (e.g. MRI) are of great interest for the investigation and classification of neurological diseases. However, traditional machine learning requires domain knowledge to delineate the brain regions first, followed by feature extraction from the regions. Compared with this semi-automated approach, recently developed deep learning methods have advantages since they do not require such prior knowledge; instead, deep learning methods can automatically find features that differentiate MRIs from different cohorts. In the present study, we developed a deep learning-based classification pipeline distinguishing brain MRIs of individuals with one of three types of headaches [migraine (n = 95), acute post-traumatic headache (n = 48) and persistent post-traumatic headache (n = 49)] from those of healthy controls (n = 532) and identified the brain regions that most contributed to each classification task. Our pipeline included: (i) data preprocessing; (ii) binary classification of healthy controls versus headache type using a 3D ResNet-18; and (iii) biomarker extraction from the trained 3D ResNet-18. During the classification at the second step of our pipeline, we resolved two common issues in deep learning methods, limited training data and imbalanced samples from different categories, by incorporating a large public data set and resampling among the headache cohorts. Our method achieved the following classification accuracies when tested on independent test sets: (i) migraine versus healthy controls-75% accuracy, 66.7% sensitivity and 83.3% specificity; (2) acute post-traumatic headache versus healthy controls-75% accuracy, 66.7% sensitivity and 83.3% specificity; and (3) persistent post-traumatic headache versus healthy controls-91.7% accuracy, 100% sensitivity and 83.3% specificity. The most significant biomarkers identified by the classifier for migraine were caudate, caudal anterior cingulate, superior frontal, thalamus and ventral diencephalon. For acute post-traumatic headache, lateral occipital, cuneus, lingual, pericalcarine and superior parietal regions were identified as most significant biomarkers. Finally, for persistent post-traumatic headache, the most significant biomarkers were cerebellum, middle temporal, inferior temporal, inferior parietal and superior parietal. In conclusion, our study shows that the deep learning methods can automatically detect aberrations in the brain regions associated with different headache types. It does not require any human knowledge as input which significantly reduces human effort. It uncovers the great potential of deep learning methods for classification and automatic extraction of brain imaging-based biomarkers for these headache types.
Collapse
Affiliation(s)
- Md Mahfuzur Rahman Siddiquee
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA.,ASU-Mayo Center for Innovative Imaging, Tempe, AZ, USA
| | - Jay Shah
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA.,ASU-Mayo Center for Innovative Imaging, Tempe, AZ, USA
| | - Catherine Chong
- ASU-Mayo Center for Innovative Imaging, Tempe, AZ, USA.,Department of Neurology, Mayo Clinic, Phoenix, AZ, USA
| | | | | | - Baoxin Li
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA.,ASU-Mayo Center for Innovative Imaging, Tempe, AZ, USA
| | - Teresa Wu
- School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA.,ASU-Mayo Center for Innovative Imaging, Tempe, AZ, USA
| | - Todd J Schwedt
- ASU-Mayo Center for Innovative Imaging, Tempe, AZ, USA.,Department of Neurology, Mayo Clinic, Phoenix, AZ, USA
| |
Collapse
|
33
|
Celard P, Iglesias EL, Sorribes-Fdez JM, Romero R, Vieira AS, Borrajo L. A survey on deep learning applied to medical images: from simple artificial neural networks to generative models. Neural Comput Appl 2023; 35:2291-2323. [PMID: 36373133 PMCID: PMC9638354 DOI: 10.1007/s00521-022-07953-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 10/12/2022] [Indexed: 11/06/2022]
Abstract
Deep learning techniques, in particular generative models, have taken on great importance in medical image analysis. This paper surveys fundamental deep learning concepts related to medical image generation. It provides concise overviews of studies which use some of the latest state-of-the-art models from last years applied to medical images of different injured body areas or organs that have a disease associated with (e.g., brain tumor and COVID-19 lungs pneumonia). The motivation for this study is to offer a comprehensive overview of artificial neural networks (NNs) and deep generative models in medical imaging, so more groups and authors that are not familiar with deep learning take into consideration its use in medicine works. We review the use of generative models, such as generative adversarial networks and variational autoencoders, as techniques to achieve semantic segmentation, data augmentation, and better classification algorithms, among other purposes. In addition, a collection of widely used public medical datasets containing magnetic resonance (MR) images, computed tomography (CT) scans, and common pictures is presented. Finally, we feature a summary of the current state of generative models in medical image including key features, current challenges, and future research paths.
Collapse
Affiliation(s)
- P. Celard
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain ,CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain ,SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - E. L. Iglesias
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain ,CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain ,SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - J. M. Sorribes-Fdez
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain ,CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain ,SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - R. Romero
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain ,CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain ,SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - A. Seara Vieira
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain ,CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain ,SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| | - L. Borrajo
- Computer Science Department, Universidade de Vigo, Escuela Superior de Ingeniería Informática, Campus Universitario As Lagoas, 32004 Ourense, Spain ,CINBIO - Biomedical Research Centre, Universidade de Vigo, Campus Universitario Lagoas-Marcosende, 36310 Vigo, Spain ,SING Research Group, Galicia Sur Health Research Institute (IIS Galicia Sur), SERGAS-UVIGO, Vigo, Spain
| |
Collapse
|
34
|
Warren SL, Moustafa AA. Functional magnetic resonance imaging, deep learning, and Alzheimer's disease: A systematic review. J Neuroimaging 2023; 33:5-18. [PMID: 36257926 PMCID: PMC10092597 DOI: 10.1111/jon.13063] [Citation(s) in RCA: 18] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 09/30/2022] [Accepted: 09/30/2022] [Indexed: 02/01/2023] Open
Abstract
Alzheimer's disease (AD) is currently diagnosed using a mixture of psychological tests and clinical observations. However, these diagnoses are not perfect, and additional diagnostic tools (e.g., MRI) can help improve our understanding of AD as well as our ability to detect the disease. Accordingly, a large amount of research has been invested into innovative diagnostic methods for AD. Functional MRI (fMRI) is a form of neuroimaging technology that has been used to diagnose AD; however, fMRI is incredibly noisy, complex, and thus lacks clinical use. Nonetheless, recent innovations in deep learning technology could enable the simplified and streamlined analysis of fMRI. Deep learning is a form of artificial intelligence that uses computer algorithms based on human neural networks to solve complex problems. For example, in fMRI research, deep learning models can automatically denoise images and classify AD by detecting patterns in participants' brain scans. In this systematic review, we investigate how fMRI (specifically resting-state fMRI) and deep learning methods are used to diagnose AD. In turn, we outline the common deep neural network, preprocessing, and classification methods used in the literature. We also discuss the accuracy, strengths, limitations, and future direction of fMRI deep learning methods. In turn, we aim to summarize the current field for new researchers, suggest specific areas for future research, and highlight the potential of fMRI to aid AD diagnoses.
Collapse
Affiliation(s)
- Samuel L Warren
- School of Psychology, Faculty of Society and Design, Bond University, Gold Coast, Queensland, Australia
| | - Ahmed A Moustafa
- School of Psychology, Faculty of Society and Design, Bond University, Gold Coast, Queensland, Australia.,Department of Human Anatomy and Physiology, Faculty of Health Sciences, University of Johannesburg, Johannesburg, South Africa
| |
Collapse
|
35
|
Mahendran N, Vincent P M DR. Deep belief network-based approach for detecting Alzheimer's disease using the multi-omics data. Comput Struct Biotechnol J 2023; 21:1651-1660. [PMID: 36874164 PMCID: PMC9978469 DOI: 10.1016/j.csbj.2023.02.021] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 02/10/2023] [Accepted: 02/11/2023] [Indexed: 02/15/2023] Open
Abstract
Alzheimer's disease (AD) is the most uncertain form of Dementia in terms of finding out the mechanism. AD does not have a vital genetic factor to relate to. There were no reliable techniques and methods to identify the genetic risk factors associated with AD in the past. Most of the data available were from the brain images. However, recently, there have been drastic advancements in the high-throughput techniques in bioinformatics. It has led to focused researches in discovering the AD causing genetic risk factors. Recent analysis has resulted in considerable prefrontal cortex data with which classification and prediction models can be developed for AD. We have developed a Deep Belief Network-based prediction model using the DNA Methylation and Gene Expression Microarray Data, with High Dimension Low Sample Size (HDLSS) issues. To overcome the HDLSS challenge, we performed a two-layer feature selection considering the biological aspects of the features as well. In the two-layered feature selection approach, first the differentially expressed genes and differentially methylated positions are identified, then both the datasets are combined using Jaccard similarity measure. As the second step, an ensemble-based feature selection approach is implemented to further narrow down the gene selection. The results show that the proposed feature selection technique outperforms the existing commonly used feature selection techniques, such as Support Vector Machine Recursive Feature Elimination (SVM-RFE), and Correlation-based Feature Selection (CBS). Furthermore, the Deep Belief Network-based prediction model performs better than the widely used Machine Learning models. Also, the multi-omics dataset shows promising results compared to the single omics.
Collapse
Affiliation(s)
- Nivedhitha Mahendran
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, India
| | - Durai Raj Vincent P M
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, India
| |
Collapse
|
36
|
Huang J, Jung JY, Nam CS. Estimating effective connectivity in Alzheimer's disease progression: A dynamic causal modeling study. Front Hum Neurosci 2022; 16:1060936. [PMID: 36590062 PMCID: PMC9797690 DOI: 10.3389/fnhum.2022.1060936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 11/24/2022] [Indexed: 12/23/2022] Open
Abstract
Introduction Alzheimer's disease (AD) affects the whole brain from the cellular level to the entire brain network structure. The causal relationship among brain regions concerning the different AD stages is not yet investigated. This study used Dynamic Causal Modeling (DCM) method to assess effective connectivity (EC) and investigate the changes that accompany AD progression. Methods We included the resting-state fMRI data of 34 AD patients, 31 late mild cognitive impairment (LMCI) patients, 34 early MCI (EMCI) patients, and 31 cognitive normal (CN) subjects selected from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. The parametric Empirical Bayes (PEB) method was used to infer the effective connectivities and the corresponding probabilities. A linear regression analysis was carried out to test if the connection strengths could predict subjects' cognitive scores. Results The results showed that the connections reduced from full connection in the CN group to no connection in the AD group. Statistical analysis showed the connectivity strengths were lower for later-stage patients. Linear regression analysis showed that the connection strengths were partially predictive of the cognitive scores. Discussion Our results demonstrated the dwindling connectivity accompanying AD progression on causal relationships among brain regions and indicated the potential of EC as a loyal biomarker in AD progression.
Collapse
Affiliation(s)
- Jiali Huang
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, United States
| | - Jae-Yoon Jung
- Department of Industrial and Management Systems Engineering, Kyung Hee University, Yongin-si, South Korea,Department of Big Data Analytics, Kyung Hee University, Yongin-si, South Korea
| | - Chang S. Nam
- Edward P. Fitts Department of Industrial and Systems Engineering, North Carolina State University, Raleigh, NC, United States,Department of Industrial and Management Systems Engineering, Kyung Hee University, Yongin-si, South Korea,*Correspondence: Chang S. Nam
| |
Collapse
|
37
|
Kibriya H, Amin R. A residual network-based framework for COVID-19 detection from CXR images. Neural Comput Appl 2022; 35:8505-8516. [PMID: 36536673 PMCID: PMC9754308 DOI: 10.1007/s00521-022-08127-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 11/28/2022] [Indexed: 12/23/2022]
Abstract
In late 2019, a new Coronavirus disease (COVID-19) appeared in Wuhan, Hubei Province, China. The virus began to spread throughout many countries, affecting a large population. Polymerase chain reaction is currently being utilized to diagnose COVID-19 in suspected patients; however, its sensitivity is quite low. The researchers also developed automated approaches for reliably and timely identifying COVID-19 from X-ray images. However, traditional machine learning-based image classification algorithms necessitate manual image segmentation and feature extraction, which is a time-consuming task. Due to promising results and robust performance, Convolutional Neural Network (CNN)-based techniques are being used widely to classify COVID-19 from Chest X-rays (CXR). This study explores CNN-based COVID-19 classification methods. A series of experiments aimed at COVID-19 detection and classification validates the viability of our proposed framework. Initially, the dataset is preprocessed and then fed into two Residual Network (ResNet) architectures for deep feature extraction, such as ResNet18 and ResNet50, whereas support vector machines with its multiple kernels, including Quadratic, Linear, Gaussian and Cubic, are used to classify these features. The experimental results suggest that the proposed framework efficiently detects COVID-19 from CXR images. The proposed framework obtained the best accuracy of 97.3% using ResNet50.
Collapse
Affiliation(s)
- Hareem Kibriya
- grid.442854.bDepartment of Computer Sciences, University of Engineering and Technology, Taxila, Pakistan
| | - Rashid Amin
- grid.442854.bDepartment of Computer Sciences, University of Engineering and Technology, Taxila, Pakistan
- Department of Computer Science, University of Chakwal, Chakwal, 48800, Pakistan
| |
Collapse
|
38
|
Multi-stage classification of Alzheimer's disease from 18F-FDG-PET images using deep learning techniques. Phys Eng Sci Med 2022; 45:1301-1315. [PMID: 36357627 DOI: 10.1007/s13246-022-01196-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 10/28/2022] [Indexed: 11/12/2022]
Abstract
The study aims to implement a convolutional neural network framework that uses the 18F-FDG PET modality of brain imaging to detect multiple stages of dementia, including Early Mild Cognitive Impairment (EMCI) and Late Mild Cognitive Impairment (LMCI), and Alzheimer's disease (AD) from Cognitively Normal (CN), and assess the results. 18F-FDG PET imaging modality for brain were procured from Alzheimer's disease neuroimaging initiative's (ADNI) repository. The ResNet50V2 model layers were utilised for feature extraction, with the final convolutional layers fine-tuned for this dataset's multi-classification objectives. Multiple metrics and feature maps were utilized to scrutinize and evaluate the model's statistical and qualitative inference. The multi-classification model achieved an overarching accuracy of 98.44% and Area under the receiver operating characteristic curve of 95% on the testing set. Feature maps aided in deducing finer aspects of the model's overall operation. This framework helped classifying from the 18F-FDG PET brain images, the subtypes of Mild Cognitive Impairment (MCI) which include EMCI, LMCI, from AD, CN groups and achieved an all-inclusive sensitivity of 94% and specificity of 95% respectively.
Collapse
|
39
|
Zhu M, Men Q, Ho ESL, Leung H, Shum HPH. A Two-stream Convolutional Network for Musculoskeletal and Neurological Disorders Prediction. J Med Syst 2022; 46:76. [PMID: 36201114 PMCID: PMC9537228 DOI: 10.1007/s10916-022-01857-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 08/17/2022] [Indexed: 11/24/2022]
Abstract
Musculoskeletal and neurological disorders are the most common causes of walking problems among older people, and they often lead to diminished quality of life. Analyzing walking motion data manually requires trained professionals and the evaluations may not always be objective. To facilitate early diagnosis, recent deep learning-based methods have shown promising results for automated analysis, which can discover patterns that have not been found in traditional machine learning methods. We observe that existing work mostly applies deep learning on individual joint features such as the time series of joint positions. Due to the challenge of discovering inter-joint features such as the distance between feet (i.e. the stride width) from generally smaller-scale medical datasets, these methods usually perform sub-optimally. As a result, we propose a solution that explicitly takes both individual joint features and inter-joint features as input, relieving the system from the need of discovering more complicated features from small data. Due to the distinctive nature of the two types of features, we introduce a two-stream framework, with one stream learning from the time series of joint position and the other from the time series of relative joint displacement. We further develop a mid-layer fusion module to combine the discovered patterns in these two streams for diagnosis, which results in a complementary representation of the data for better prediction performance. We validate our system with a benchmark dataset of 3D skeleton motion that involves 45 patients with musculoskeletal and neurological disorders, and achieve a prediction accuracy of 95.56%, outperforming state-of-the-art methods.
Collapse
Affiliation(s)
- Manli Zhu
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Qianhui Men
- Department of Engineering Science, University of Oxford, Oxford, UK
| | - Edmond S L Ho
- School of Computing Science, University of Glasgow, Glasgow, UK
| | - Howard Leung
- Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
| | - Hubert P H Shum
- Department of Computer Science, Durham University, Durham, UK.
| |
Collapse
|
40
|
Moridian P, Ghassemi N, Jafari M, Salloum-Asfar S, Sadeghi D, Khodatars M, Shoeibi A, Khosravi A, Ling SH, Subasi A, Alizadehsani R, Gorriz JM, Abdulla SA, Acharya UR. Automatic autism spectrum disorder detection using artificial intelligence methods with MRI neuroimaging: A review. Front Mol Neurosci 2022; 15:999605. [PMID: 36267703 PMCID: PMC9577321 DOI: 10.3389/fnmol.2022.999605] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 08/09/2022] [Indexed: 12/04/2022] Open
Abstract
Autism spectrum disorder (ASD) is a brain condition characterized by diverse signs and symptoms that appear in early childhood. ASD is also associated with communication deficits and repetitive behavior in affected individuals. Various ASD detection methods have been developed, including neuroimaging modalities and psychological tests. Among these methods, magnetic resonance imaging (MRI) imaging modalities are of paramount importance to physicians. Clinicians rely on MRI modalities to diagnose ASD accurately. The MRI modalities are non-invasive methods that include functional (fMRI) and structural (sMRI) neuroimaging methods. However, diagnosing ASD with fMRI and sMRI for specialists is often laborious and time-consuming; therefore, several computer-aided design systems (CADS) based on artificial intelligence (AI) have been developed to assist specialist physicians. Conventional machine learning (ML) and deep learning (DL) are the most popular schemes of AI used for diagnosing ASD. This study aims to review the automated detection of ASD using AI. We review several CADS that have been developed using ML techniques for the automated diagnosis of ASD using MRI modalities. There has been very limited work on the use of DL techniques to develop automated diagnostic models for ASD. A summary of the studies developed using DL is provided in the Supplementary Appendix. Then, the challenges encountered during the automated diagnosis of ASD using MRI and AI techniques are described in detail. Additionally, a graphical comparison of studies using ML and DL to diagnose ASD automatically is discussed. We suggest future approaches to detecting ASDs using AI techniques and MRI neuroimaging.
Collapse
Affiliation(s)
- Parisa Moridian
- Faculty of Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Navid Ghassemi
- Department of Computer Engineering, Ferdowsi University of Mashhad, Mashhad, Iran
| | - Mahboobeh Jafari
- Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Iran
| | - Salam Salloum-Asfar
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - Delaram Sadeghi
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Marjane Khodatars
- Department of Medical Engineering, Mashhad Branch, Islamic Azad University, Mashhad, Iran
| | - Afshin Shoeibi
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Ultimo, NSW, Australia
| | - Abdulhamit Subasi
- Faculty of Medicine, Institute of Biomedicine, University of Turku, Turku, Finland
- Department of Computer Science, College of Engineering, Effat University, Jeddah, Saudi Arabia
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Juan M. Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Granada, Spain
| | - Sara A. Abdulla
- Neurological Disorders Research Center, Qatar Biomedical Research Institute, Hamad Bin Khalifa University, Qatar Foundation, Doha, Qatar
| | - U. Rajendra Acharya
- Ngee Ann Polytechnic, Singapore, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
- Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore, Singapore
| |
Collapse
|
41
|
Classification and Interpretability of Mild Cognitive Impairment Based on Resting-State Functional Magnetic Resonance and Ensemble Learning. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:2535954. [PMID: 36035823 PMCID: PMC9417789 DOI: 10.1155/2022/2535954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 06/12/2022] [Accepted: 07/06/2022] [Indexed: 11/22/2022]
Abstract
The combination and integration of multimodal imaging and clinical markers have introduced numerous classifiers to improve diagnostic accuracy in detecting and predicting AD; however, many studies cannot ensure the homogeneity of data sets and consistency of results. In our study, the XGBoost algorithm was used to classify mild cognitive impairment (MCI) and normal control (NC) populations through five rs-fMRI analysis datasets. Shapley Additive exPlanations (SHAP) is used to analyze the interpretability of the model. The highest accuracy for diagnosing MCI was 65.14% (using the mPerAF dataset). The characteristics of the left insula, right middle frontal gyrus, and right cuneus correlated positively with the output value using DC datasets. The characteristics of left cerebellum 6, right inferior frontal gyrus, opercular part, and vermis 6 correlated positively with the output value using fALFF datasets. The characteristics of the right middle temporal gyrus, left middle temporal gyrus, left temporal pole, and middle temporal gyrus correlated positively with the output value using mPerAF datasets. The characteristics of the right middle temporal gyrus, left middle temporal gyrus, and left hippocampus correlated positively with the output value using PerAF datasets. The characteristics of left cerebellum 9, vermis 9, and right precentral gyrus, right amygdala, and left middle occipital gyrus correlated positively with the output value using Wavelet-ALFF datasets. We found that the XGBoost algorithm constructed from rs-fMRI data is effective for the diagnosis and classification of MCI. The accuracy rates obtained by different rs-fMRI data analysis methods are similar, but the important features are different and involve multiple brain regions, which suggests that MCI may have a negative impact on brain function.
Collapse
|
42
|
Kalkan H, Akkaya UM, Inal-Gültekin G, Sanchez-Perez AM. Prediction of Alzheimer’s Disease by a Novel Image-Based Representation of Gene Expression. Genes (Basel) 2022; 13:genes13081406. [PMID: 36011317 PMCID: PMC9407775 DOI: 10.3390/genes13081406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2022] [Revised: 08/03/2022] [Accepted: 08/04/2022] [Indexed: 11/16/2022] Open
Abstract
Early intervention can delay the progress of Alzheimer’s Disease (AD), but currently, there are no effective prediction tools. The goal of this study is to generate a reliable artificial intelligence (AI) model capable of detecting the high risk of AD, based on gene expression arrays from blood samples. To that end, a novel image-formation method is proposed to transform single-dimension gene expressions into a discriminative 2-dimensional (2D) image to use convolutional neural networks (CNNs) for classification. Three publicly available datasets were pooled, and a total of 11,618 common genes’ expression values were obtained. The genes were then categorized for their discriminating power using the Fisher distance (AD vs. control (CTL)) and mapped to a 2D image by linear discriminant analysis (LDA). Then, a six-layer CNN model with 292,493 parameters were used for classification. An accuracy of 0.842 and an area under curve (AUC) of 0.875 were achieved for the AD vs. CTL classification. The proposed method obtained higher accuracy and AUC compared with other reported methods. The conversion to 2D in CNN offers a unique advantage for improving accuracy and can be easily transferred to the clinic to drastically improve AD (or any disease) early detection.
Collapse
Affiliation(s)
- Habil Kalkan
- Department of Computer Engineering, Gebze Technical University, 41400 Kocaeli, Turkey
- Correspondence: (H.K.); (A.M.S.-P.)
| | - Umit Murat Akkaya
- Department of Computer Engineering, Gebze Technical University, 41400 Kocaeli, Turkey
| | - Güldal Inal-Gültekin
- Department of Physiology, Faculty of Medicine, Istanbul Okan University, 34959 Istanbul, Turkey
| | - Ana Maria Sanchez-Perez
- Faculty of Health Science and Institute of Advanced Materials (INAM), University Jaume I, 12071 Castellon, Spain
- Correspondence: (H.K.); (A.M.S.-P.)
| |
Collapse
|
43
|
Khojaste-Sarakhsi M, Haghighi SS, Ghomi SF, Marchiori E. Deep learning for Alzheimer's disease diagnosis: A survey. Artif Intell Med 2022; 130:102332. [DOI: 10.1016/j.artmed.2022.102332] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 04/29/2022] [Accepted: 05/30/2022] [Indexed: 11/28/2022]
|
44
|
Manickam P, Mariappan SA, Murugesan SM, Hansda S, Kaushik A, Shinde R, Thipperudraswamy SP. Artificial Intelligence (AI) and Internet of Medical Things (IoMT) Assisted Biomedical Systems for Intelligent Healthcare. BIOSENSORS 2022; 12:bios12080562. [PMID: 35892459 PMCID: PMC9330886 DOI: 10.3390/bios12080562] [Citation(s) in RCA: 54] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 07/20/2022] [Accepted: 07/21/2022] [Indexed: 05/05/2023]
Abstract
Artificial intelligence (AI) is a modern approach based on computer science that develops programs and algorithms to make devices intelligent and efficient for performing tasks that usually require skilled human intelligence. AI involves various subsets, including machine learning (ML), deep learning (DL), conventional neural networks, fuzzy logic, and speech recognition, with unique capabilities and functionalities that can improve the performances of modern medical sciences. Such intelligent systems simplify human intervention in clinical diagnosis, medical imaging, and decision-making ability. In the same era, the Internet of Medical Things (IoMT) emerges as a next-generation bio-analytical tool that combines network-linked biomedical devices with a software application for advancing human health. In this review, we discuss the importance of AI in improving the capabilities of IoMT and point-of-care (POC) devices used in advanced healthcare sectors such as cardiac measurement, cancer diagnosis, and diabetes management. The role of AI in supporting advanced robotic surgeries developed for advanced biomedical applications is also discussed in this article. The position and importance of AI in improving the functionality, detection accuracy, decision-making ability of IoMT devices, and evaluation of associated risks assessment is discussed carefully and critically in this review. This review also encompasses the technological and engineering challenges and prospects for AI-based cloud-integrated personalized IoMT devices for designing efficient POC biomedical systems suitable for next-generation intelligent healthcare.
Collapse
Affiliation(s)
- Pandiaraj Manickam
- Electrodics and Electrocatalysis Division, CSIR-Central Electrochemical Research Institute (CECRI), Karaikudi, Sivagangai 630003, Tamil Nadu, India; (S.A.M.); (S.M.M.)
- Academy of Scientific & Innovative Research (AcSIR), Ghaziabad 201002, Uttar Pradesh, India; (S.H.); (S.P.T.)
- Correspondence:
| | - Siva Ananth Mariappan
- Electrodics and Electrocatalysis Division, CSIR-Central Electrochemical Research Institute (CECRI), Karaikudi, Sivagangai 630003, Tamil Nadu, India; (S.A.M.); (S.M.M.)
- Academy of Scientific & Innovative Research (AcSIR), Ghaziabad 201002, Uttar Pradesh, India; (S.H.); (S.P.T.)
| | - Sindhu Monica Murugesan
- Electrodics and Electrocatalysis Division, CSIR-Central Electrochemical Research Institute (CECRI), Karaikudi, Sivagangai 630003, Tamil Nadu, India; (S.A.M.); (S.M.M.)
| | - Shekhar Hansda
- Academy of Scientific & Innovative Research (AcSIR), Ghaziabad 201002, Uttar Pradesh, India; (S.H.); (S.P.T.)
- Corrosion and Materials Protection Division, CSIR-Central Electrochemical Research Institute (CECRI), Karaikudi, Sivagangai 630003, Tamil Nadu, India
| | - Ajeet Kaushik
- School of Engineering, University of Petroleum and Energy Studies (UPES), Dehradun 248001, Uttarakhand, India;
- NanoBioTech Laboratory, Department of Environmental Engineering, Florida Polytechnic University, Lakeland, FL 33805-8531, USA
| | - Ravikumar Shinde
- Department of Zoology, Shri Pundlik Maharaj Mahavidyalaya Nandura, Buldana 443404, Maharashtra, India;
| | - S. P. Thipperudraswamy
- Academy of Scientific & Innovative Research (AcSIR), Ghaziabad 201002, Uttar Pradesh, India; (S.H.); (S.P.T.)
- Central Instrument Facility, CSIR-Central Electrochemical Research Institute, Karaikudi, Sivagangai 630003, Tamil Nadu, India
| |
Collapse
|
45
|
End-to-End Deep Learning Architectures Using 3D Neuroimaging Biomarkers for Early Alzheimer’s Diagnosis. MATHEMATICS 2022. [DOI: 10.3390/math10152575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2022]
Abstract
This study uses magnetic resonance imaging (MRI) data to propose end-to-end learning implementing volumetric convolutional neural network (CNN) models for two binary classification tasks: Alzheimer’s disease (AD) vs. cognitively normal (CN) and stable mild cognitive impairment (sMCI) vs. AD. The baseline MP-RAGE T1 MR images of 245 AD patients and 229 with sMCI were obtained from the ADNI dataset, whereas 245 T1 MR images of CN people were obtained from the IXI dataset. All of the images were preprocessed in four steps: N4 bias field correction, denoising, brain extraction, and registration. End-to-end-learning-based deep CNNs were used to discern between different phases of AD. Eight CNN-based architectures were implemented and assessed. The DenseNet264 excelled in both types of classification, with 82.5% accuracy and 87.63% AUC for training and 81.03% accuracy for testing relating to the sMCI vs. AD and 100% accuracy and 100% AUC for training and 99.56% accuracy for testing relating to the AD vs. CN. Deep learning approaches based on CNN and end-to-end learning offer a strong tool for examining minute but complex properties in MR images which could aid in the early detection and prediction of Alzheimer’s disease in clinical settings.
Collapse
|
46
|
Tu Y, Lin S, Qiao J, Zhuang Y, Zhang P. Alzheimer's disease diagnosis via multimodal feature fusion. Comput Biol Med 2022; 148:105901. [PMID: 35908497 DOI: 10.1016/j.compbiomed.2022.105901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/26/2022] [Accepted: 07/16/2022] [Indexed: 11/19/2022]
Abstract
Alzheimer's disease (AD) is the most common neurodegenerative disorder in the elderly. Early diagnosis of AD plays a vital role in slowing down the progress of AD because there is no effective drug to treat the disease. Some deep learning models have recently been presented for AD diagnosis and have more satisfactory performance than classic machine learning methods. Nevertheless, most of the existing computer-aided diagnostic models used neuroimaging features for diagnosis, ignoring patients' clinical and biological information. This makes the AD diagnosis inaccurate. In this study, we propose a novel multimodal feature transformation and fusion model for AD diagnosis. The feature transformation aims to avoid the difference in feature dimensions between different modal data and further mine the significant features for AD diagnosis. A geometric algebra-based feature extension method is proposed to obtain different levels of high-dimensional features from patients' clinical and personal biological data. Then, an influence degree-based feature filtration algorithm is proposed to filtrate those features that have no apparent guiding significance for AD diagnosis. Finally, an ANN (Artificial Neural Network)-based framework is designed to fuse transformed features with neuroimaging features extracted by CNN (Convolutional Neural Network) for AD diagnosis. The more in-depth feature mining of patients' clinical information and biological information can significantly improve the performance of computer-aided AD diagnosis. The experiments are obtained on the ADNI dataset. Our proposed model can converge faster and achieves 96.2% accuracy in AD diagnostic task and 87.4% accuracy in MCI (Mild Cognitive Impairment) diagnostic task. Compared with other methods, our proposed approach has an excellent performance in AD diagnosis and surpasses SOTA (state-of-the-art) methods. Therefore, our model can provide more reasonable suggestions for clinicians to diagnose and treat disease.
Collapse
Affiliation(s)
- Yue Tu
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Shukuan Lin
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Jianzhong Qiao
- School of Computer Science and Engineering, Northeastern University, Shenyang, China.
| | - Yilin Zhuang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| | - Peng Zhang
- School of Computer Science and Engineering, Northeastern University, Shenyang, China
| |
Collapse
|
47
|
Jia H, Lao H. Deep learning and multimodal feature fusion for the aided diagnosis of Alzheimer's disease. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07501-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
48
|
Fathi S, Ahmadi M, Dehnad A. Early diagnosis of Alzheimer's disease based on deep learning: A systematic review. Comput Biol Med 2022; 146:105634. [DOI: 10.1016/j.compbiomed.2022.105634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 04/25/2022] [Accepted: 04/25/2022] [Indexed: 11/03/2022]
|
49
|
Multigroup recognition of dementia patients with dynamic brain connectivity under multimodal cortex parcellation. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
50
|
A Practical Multiclass Classification Network for the Diagnosis of Alzheimer’s Disease. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12136507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Patients who have Alzheimer’s disease (AD) pass through several irreversible stages, which ultimately result in the patient’s death. It is crucial to understand and detect AD at an early stage to slow down its progression due to the non-curable nature of the disease. Diagnostic techniques are primarily based on magnetic resonance imaging (MRI) and expensive high-dimensional 3D imaging data. Classic methods can hardly discriminate among the almost similar pixels of the brain patterns of various age groups. The recent deep learning-based methods can contribute to the detection of the various stages of AD but require large-scale datasets and face several challenges while using the 3D volumes directly. The extant deep learning-based work is mainly focused on binary classification, but it is challenging to detect multiple stages with these methods. In this work, we propose a deep learning-based multiclass classification method to distinguish amongst various stages for the early diagnosis of Alzheimer’s. The proposed method significantly handles data shortage challenges by augmentation and manages to classify the 2D images obtained after the efficient pre-processing of the publicly available Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset. Our method achieves an accuracy of 98.9% with an F1 score of 96.3. Extensive experiments are performed, and overall results demonstrate that the proposed method outperforms the state-of-the-art methods in terms of overall performance.
Collapse
|