1
|
Qiu Z, Yang P, Xiao C, Wang S, Xiao X, Qin J, Liu CM, Wang T, Lei B. 3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer's Disease Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:3161-3175. [PMID: 38607706 DOI: 10.1109/tmi.2024.3386937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/14/2024]
Abstract
Multimodal neuroimaging provides complementary information critical for accurate early diagnosis of Alzheimer's disease (AD). However, the inherent variability between multimodal neuroimages hinders the effective fusion of multimodal features. Moreover, achieving reliable and interpretable diagnoses in the field of multimodal fusion remains challenging. To address them, we propose a novel multimodal diagnosis network based on multi-fusion and disease-induced learning (MDL-Net) to enhance early AD diagnosis by efficiently fusing multimodal data. Specifically, MDL-Net proposes a multi-fusion joint learning (MJL) module, which effectively fuses multimodal features and enhances the feature representation from global, local, and latent learning perspectives. MJL consists of three modules, global-aware learning (GAL), local-aware learning (LAL), and outer latent-space learning (LSL) modules. GAL via a self-adaptive Transformer (SAT) learns the global relationships among the modalities. LAL constructs local-aware convolution to learn the local associations. LSL module introduces latent information through outer product operation to further enhance feature representation. MDL-Net integrates the disease-induced region-aware learning (DRL) module via gradient weight to enhance interpretability, which iteratively learns weight matrices to identify AD-related brain regions. We conduct the extensive experiments on public datasets and the results confirm the superiority of our proposed method. Our code will be available at: https://github.com/qzf0320/MDL-Net.
Collapse
|
2
|
Zhang M, Cui Q, Lü Y, Li W. A feature-aware multimodal framework with auto-fusion for Alzheimer's disease diagnosis. Comput Biol Med 2024; 178:108740. [PMID: 38901184 DOI: 10.1016/j.compbiomed.2024.108740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2024] [Revised: 05/02/2024] [Accepted: 06/08/2024] [Indexed: 06/22/2024]
Abstract
Alzheimer's disease (AD), one of the most common dementias, has about 4.6 million new cases yearly worldwide. Due to the significant amount of suspected AD patients, early screening for the disease has become particularly important. There are diversified types of AD diagnosis data, such as cognitive tests, images, and risk factors, many prior investigations have primarily concentrated on integrating only high-dimensional features and simple fusion concatenation, resulting in less-than-optimal outcomes for AD diagnosis. Therefore, We propose an enhanced multimodal AD diagnostic framework comprising a feature-aware module and an automatic model fusion strategy (AMFS). To preserve the correlation and significance features within a low-dimensional space, the feature-aware module employs a low-dimensional SHapley Additive exPlanation (SHAP) boosting feature selection as the initial step, following this analysis, diverse tiers of low-dimensional features are extracted from patients' biological data. Besides, in the high-dimensional stage, the feature-aware module integrates cross-modal attention mechanisms to capture subtle relationships among different cognitive domains, neuroimaging modalities, and risk factors. Subsequently, we integrate the aforementioned feature-aware module with graph convolutional networks (GCN) to address heterogeneous data in multimodal AD, while also possessing the capability to perceive relationships between different modalities. Lastly, our proposed AMFS autonomously learns optimal parameters for aligning two sub-models. The validation tests using two ADNI datasets show the high accuracies of 95.9% and 91.9% respectively, in AD diagnosis. The methods efficiently select features from multimodal AD data, optimizing model fusion for potential clinical assistance in diagnostics.
Collapse
Affiliation(s)
- Meiwei Zhang
- College of Electrical Engineering, Chongqing University, Chongqing, 400030, China
| | - Qiushi Cui
- College of Electrical Engineering, Chongqing University, Chongqing, 400030, China.
| | - Yang Lü
- Department of Geriatrics, The First Affiliated Hospital of Chongqing Medical University, Chongqing, 400016, China
| | - Wenyuan Li
- College of Electrical Engineering, Chongqing University, Chongqing, 400030, China
| |
Collapse
|
3
|
Dhaygude AD, Ameta GK, Khan IR, Singh PP, Maaliw RR, Lakshmaiya N, Shabaz M, Khan MA, Hussein HS, Alshazly H. Knowledge‐based deep learning system for classifying Alzheimer's disease for multi‐task learning. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2024; 9:805-820. [DOI: 10.1049/cit2.12291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 06/21/2023] [Indexed: 08/25/2024] Open
Abstract
AbstractDeep learning has recently become a viable approach for classifying Alzheimer's disease (AD) in medical imaging. However, existing models struggle to efficiently extract features from medical images and may squander additional information resources for illness classification. To address these issues, a deep three‐dimensional convolutional neural network incorporating multi‐task learning and attention mechanisms is proposed. An upgraded primary C3D network is utilised to create rougher low‐level feature maps. It introduces a new convolution block that focuses on the structural aspects of the magnetic resonance imaging image and another block that extracts attention weights unique to certain pixel positions in the feature map and multiplies them with the feature map output. Then, several fully connected layers are used to achieve multi‐task learning, generating three outputs, including the primary classification task. The other two outputs employ backpropagation during training to improve the primary classification job. Experimental findings show that the authors’ proposed method outperforms current approaches for classifying AD, achieving enhanced classification accuracy and other indicators on the Alzheimer's disease Neuroimaging Initiative dataset. The authors demonstrate promise for future disease classification studies.
Collapse
Affiliation(s)
| | - Gaurav Kumar Ameta
- Department of Computer Science & Engineering Parul Institute of Technology Parul University Vadodara Gujarat India
| | | | | | - Renato R. Maaliw
- College of Engineering Southern Luzon State University Lucban Quezon Philippines
| | - Natrayan Lakshmaiya
- Department of Mechanical Engineering Saveetha School of Engineering SIMATS Chennai Tamil Nadu India
| | - Mohammad Shabaz
- Model Institute of Engineering and Technology Jammu J&K India
| | - Muhammad Attique Khan
- Department of Computer Science HITEC University Taxila Pakistan
- Department of Computer Science and Mathematics Lebanese American University Beirut Lebanon
| | - Hany S. Hussein
- Electrical Engineering Department College of Engineering King Khalid University Abha Saudi Arabia
- Electrical Engineering Department Aswan University Aswan Egypt
| | - Hammam Alshazly
- Faculty of Computers and Information South Valley University Qena Egypt
| |
Collapse
|
4
|
Martinez-Murcia FJ, Arco JE, Jimenez-Mesa C, Segovia F, Illan IA, Ramirez J, Gorriz JM. Bridging Imaging and Clinical Scores in Parkinson's Progression via Multimodal Self-Supervised Deep Learning. Int J Neural Syst 2024; 34:2450043. [PMID: 38770651 DOI: 10.1142/s0129065724500436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Neurodegenerative diseases pose a formidable challenge to medical research, demanding a nuanced understanding of their progressive nature. In this regard, latent generative models can effectively be used in a data-driven modeling of different dimensions of neurodegeneration, framed within the context of the manifold hypothesis. This paper proposes a joint framework for a multi-modal, common latent generative model to address the need for a more comprehensive understanding of the neurodegenerative landscape in the context of Parkinson's disease (PD). The proposed architecture uses coupled variational autoencoders (VAEs) to joint model a common latent space to both neuroimaging and clinical data from the Parkinson's Progression Markers Initiative (PPMI). Alternative loss functions, different normalization procedures, and the interpretability and explainability of latent generative models are addressed, leading to a model that was able to predict clinical symptomatology in the test set, as measured by the unified Parkinson's disease rating scale (UPDRS), with R2 up to 0.86 for same-modality and 0.441 cross-modality (using solely neuroimaging). The findings provide a foundation for further advancements in the field of clinical research and practice, with potential applications in decision-making processes for PD. The study also highlights the limitations and capabilities of the proposed model, emphasizing its direct interpretability and potential impact on understanding and interpreting neuroimaging patterns associated with PD symptomatology.
Collapse
Affiliation(s)
- Francisco J Martinez-Murcia
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Center for Advanced Studies, Ludwig-Maximilien Universität München, München, Germany
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Juan Eloy Arco
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Carmen Jimenez-Mesa
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Fermin Segovia
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Ignacio A Illan
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Javier Ramirez
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| | - Juan Manuel Gorriz
- Department of Signal Processing, Networking and Communications, University of Granada, Granada, Spain
- Center for Advanced Studies, Ludwig-Maximilien Universität München, München, Germany
- Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain
| |
Collapse
|
5
|
Karim SMS, Fahad MS, Rathore RS. Identifying discriminative features of brain network for prediction of Alzheimer's disease using graph theory and machine learning. Front Neuroinform 2024; 18:1384720. [PMID: 38957548 PMCID: PMC11217540 DOI: 10.3389/fninf.2024.1384720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2024] [Accepted: 05/17/2024] [Indexed: 07/04/2024] Open
Abstract
Alzheimer's disease (AD) is a challenging neurodegenerative condition, necessitating early diagnosis and intervention. This research leverages machine learning (ML) and graph theory metrics, derived from resting-state functional magnetic resonance imaging (rs-fMRI) data to predict AD. Using Southwest University Adult Lifespan Dataset (SALD, age 21-76 years) and the Open Access Series of Imaging Studies (OASIS, age 64-95 years) dataset, containing 112 participants, various ML models were developed for the purpose of AD prediction. The study identifies key features for a comprehensive understanding of brain network topology and functional connectivity in AD. Through a 5-fold cross-validation, all models demonstrate substantial predictive capabilities (accuracy in 82-92% range), with the support vector machine model standing out as the best having an accuracy of 92%. Present study suggests that top 13 regions, identified based on most important discriminating features, have lost significant connections with thalamus. The functional connection strengths were consistently declined for substantia nigra, pars reticulata, substantia nigra, pars compacta, and nucleus accumbens among AD subjects as compared to healthy adults and aging individuals. The present finding corroborate with the earlier studies, employing various neuroimagining techniques. This research signifies the translational potential of a comprehensive approach integrating ML, graph theory and rs-fMRI analysis in AD prediction, offering potential biomarker for more accurate diagnostics and early prediction of AD.
Collapse
Affiliation(s)
- S. M. Shayez Karim
- Department of Bioinformatics, Central University of South Bihar, Bihar, India
| | - Md Shah Fahad
- Department of Computer Science and Engineering, Birla Institute of Technology, Ranchi, India
| | - R. S. Rathore
- Department of Bioinformatics, Central University of South Bihar, Bihar, India
| |
Collapse
|
6
|
Ali MM, Medhat Hassan M, Zaki M. Human Pose Estimation for Clinical Analysis of Gait Pathologies. Bioinform Biol Insights 2024; 18:11779322241231108. [PMID: 38757143 PMCID: PMC11097739 DOI: 10.1177/11779322241231108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 01/19/2024] [Indexed: 05/18/2024] Open
Abstract
Gait analysis serves as a critical diagnostic tool for identifying neurologic and musculoskeletal damage. Traditional manual analysis of motion data, however, is labor-intensive and heavily reliant on the expertise and judgment of the therapist. This study introduces a binary classification method for the quantitative assessment of gait impairments, specifically focusing on Duchenne muscular dystrophy (DMD), a prevalent and fatal neuromuscular genetic disorder. The research compares spatiotemporal and sagittal kinematic gait features derived from 2D and 3D human pose estimation trajectories against concurrently recorded 3D motion capture (MoCap) data from healthy children. The proposed model leverages a novel benchmark dataset, collected from YouTube and publicly available datasets of their typically developed peers, to extract time-distance variables (e.g. speed, step length, stride time, and cadence) and sagittal joint angles of the lower extremity (e.g. hip, knee, and knee flexion angles). Machine learning and deep learning techniques are employed to discern patterns that can identify children exhibiting DMD gait disturbances. While the current model is capable of distinguishing between healthy subjects and those with DMD, it does not specifically differentiate between DMD patients and patients with other gait impairments. Experimental results validate the efficacy of our cost-effective method, which relies on recorded RGB video, in detecting gait abnormalities, achieving a prediction accuracy of 96.2% for Support Vector Machine (SVM) and 97% for the deep network.
Collapse
Affiliation(s)
- Manal Mostafa Ali
- Department of Computer and System Engineering, Al-Azhar University, Cairo, Egypt
| | - Maha Medhat Hassan
- Department of Computer and System Engineering, Al-Azhar University, Cairo, Egypt
| | - M Zaki
- Department of Computer and System Engineering, Al-Azhar University, Cairo, Egypt
| |
Collapse
|
7
|
Patel K, Xie Z, Yuan H, Islam SMS, Xie Y, He W, Zhang W, Gottlieb A, Chen H, Giancardo L, Knaack A, Fletcher E, Fornage M, Ji S, Zhi D. Unsupervised deep representation learning enables phenotype discovery for genetic association studies of brain imaging. Commun Biol 2024; 7:414. [PMID: 38580839 PMCID: PMC10997628 DOI: 10.1038/s42003-024-06096-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 03/22/2024] [Indexed: 04/07/2024] Open
Abstract
Understanding the genetic architecture of brain structure is challenging, partly due to difficulties in designing robust, non-biased descriptors of brain morphology. Until recently, brain measures for genome-wide association studies (GWAS) consisted of traditionally expert-defined or software-derived image-derived phenotypes (IDPs) that are often based on theoretical preconceptions or computed from limited amounts of data. Here, we present an approach to derive brain imaging phenotypes using unsupervised deep representation learning. We train a 3-D convolutional autoencoder model with reconstruction loss on 6130 UK Biobank (UKBB) participants' T1 or T2-FLAIR (T2) brain MRIs to create a 128-dimensional representation known as Unsupervised Deep learning derived Imaging Phenotypes (UDIPs). GWAS of these UDIPs in held-out UKBB subjects (n = 22,880 discovery and n = 12,359/11,265 replication cohorts for T1/T2) identified 9457 significant SNPs organized into 97 independent genetic loci of which 60 loci were replicated. Twenty-six loci were not reported in earlier T1 and T2 IDP-based UK Biobank GWAS. We developed a perturbation-based decoder interpretation approach to show that these loci are associated with UDIPs mapped to multiple relevant brain regions. Our results established unsupervised deep learning can derive robust, unbiased, heritable, and interpretable brain imaging phenotypes.
Collapse
Affiliation(s)
- Khush Patel
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Ziqian Xie
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Hao Yuan
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, 77843, USA
| | | | - Yaochen Xie
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, 77843, USA
| | - Wei He
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Wanheng Zhang
- School of Public Health, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Assaf Gottlieb
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Han Chen
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA
- School of Public Health, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Luca Giancardo
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Alexander Knaack
- Department of Neurology and Imaging of Dementia and Aging (IDeA) Laboratory, University of California at Davis, Davis, CA, 95618, USA
| | - Evan Fletcher
- Department of Neurology and Imaging of Dementia and Aging (IDeA) Laboratory, University of California at Davis, Davis, CA, 95618, USA
| | - Myriam Fornage
- School of Public Health, University of Texas Health Science Center, Houston, TX, 77030, USA
- McGovern Medical School, University of Texas Health Science Center, Houston, TX, 77030, USA
| | - Shuiwang Ji
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, 77843, USA
| | - Degui Zhi
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center, Houston, TX, 77030, USA.
| |
Collapse
|
8
|
Khatri U, Kwon GR. Diagnosis of Alzheimer's disease via optimized lightweight convolution-attention and structural MRI. Comput Biol Med 2024; 171:108116. [PMID: 38346370 DOI: 10.1016/j.compbiomed.2024.108116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 01/28/2024] [Accepted: 02/04/2024] [Indexed: 03/21/2024]
Abstract
Alzheimer's disease (AD) poses a substantial public health challenge, demanding accurate screening and diagnosis. Identifying AD in its early stages, including mild cognitive impairment (MCI) and healthy control (HC), is crucial given the global aging population. Structural magnetic resonance imaging (sMRI) is essential for understanding the brain's structural changes due to atrophy. While current deep learning networks overlook voxel long-term dependencies, vision transformers (ViT) excel at recognizing such dependencies in images, making them valuable in AD diagnosis. Our proposed method integrates convolution-attention mechanisms in transformer-based classifiers for AD brain datasets, enhancing performance without excessive computing resources. Replacing multi-head attention with lightweight multi-head self-attention (LMHSA), employing inverted residual (IRU) blocks, and introducing local feed-forward networks (LFFN) yields exceptional results. Training on AD datasets with a gradient-centralized optimizer and Adam achieves an impressive accuracy rate of 94.31% for multi-class classification, rising to 95.37% for binary classification (AD vs. HC) and 92.15% for HC vs. MCI. These outcomes surpass existing AD diagnosis approaches, showcasing the model's efficacy. Identifying key brain regions aids future clinical solutions for AD and neurodegenerative diseases. However, this study focused exclusively on the AD Neuroimaging Initiative (ADNI) cohort, emphasizing the need for a more robust, generalizable approach incorporating diverse databases beyond ADNI in future research.
Collapse
Affiliation(s)
- Uttam Khatri
- Dept. of Information and Communication Engineering, Chosun University, 309 Pilmun-Daero, Dong-Gu, Gwangju, 61452, Republic of Korea
| | - Goo-Rak Kwon
- Dept. of Information and Communication Engineering, Chosun University, 309 Pilmun-Daero, Dong-Gu, Gwangju, 61452, Republic of Korea.
| |
Collapse
|
9
|
De A, Mishra TK, Saraf S, Tripathy B, Reddy SS. A Review on the Use of Modern Computational Methods in Alzheimer's Disease-Detection and Prediction. Curr Alzheimer Res 2024; 20:845-861. [PMID: 38468529 DOI: 10.2174/0115672050301514240307071217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2024] [Revised: 02/07/2024] [Accepted: 02/20/2024] [Indexed: 03/13/2024]
Abstract
Discoveries in the field of medical sciences are blooming rapidly at the cost of voluminous efforts. Presently, multidisciplinary research activities have been especially contributing to catering cutting-edge solutions to critical problems in the domain of medical sciences. The modern age computing resources have proved to be a boon in this context. Effortless solutions have become a reality, and thus, the real beneficiary patients are able to enjoy improved lives. One of the most emerging problems in this context is Alzheimer's disease, an incurable neurological disorder. For this, early diagnosis is made possible with benchmark computing tools and schemes. These benchmark schemes are the results of novel research contributions being made intermittently in the timeline. In this review, an attempt is made to explore all such contributions in the past few decades. A systematic review is made by categorizing these contributions into three folds, namely, First, Second, and Third Generations. However, priority is given to the latest ones as a handful of literature reviews are already available for the classical ones. Key contributions are discussed vividly. The objectives set for this review are to bring forth the latest discoveries in computing methodologies, especially those dedicated to the diagnosis of Alzheimer's disease. A detailed timeline of the contributions is also made available. Performance plots for certain key contributions are also presented for better graphical understanding.
Collapse
Affiliation(s)
- Arka De
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Tusar Kanti Mishra
- Department of Computer Science and Engineering, Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal, Karnataka, 576104, India
| | - Sameeksha Saraf
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Balakrushna Tripathy
- School of Information Technology, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Shiva Shankar Reddy
- Department of Computer Science and Engineering, Sagi Rama Krishnam Raju Engineering College, Bhimavaram, Andhra Pradesh, India
| |
Collapse
|
10
|
Jimenez-Mesa C, Arco JE, Martinez-Murcia FJ, Suckling J, Ramirez J, Gorriz JM. Applications of machine learning and deep learning in SPECT and PET imaging: General overview, challenges and future prospects. Pharmacol Res 2023; 197:106984. [PMID: 37940064 DOI: 10.1016/j.phrs.2023.106984] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 10/04/2023] [Accepted: 11/04/2023] [Indexed: 11/10/2023]
Abstract
The integration of positron emission tomography (PET) and single-photon emission computed tomography (SPECT) imaging techniques with machine learning (ML) algorithms, including deep learning (DL) models, is a promising approach. This integration enhances the precision and efficiency of current diagnostic and treatment strategies while offering invaluable insights into disease mechanisms. In this comprehensive review, we delve into the transformative impact of ML and DL in this domain. Firstly, a brief analysis is provided of how these algorithms have evolved and which are the most widely applied in this domain. Their different potential applications in nuclear imaging are then discussed, such as optimization of image adquisition or reconstruction, biomarkers identification, multimodal fusion and the development of diagnostic, prognostic, and disease progression evaluation systems. This is because they are able to analyse complex patterns and relationships within imaging data, as well as extracting quantitative and objective measures. Furthermore, we discuss the challenges in implementation, such as data standardization and limited sample sizes, and explore the clinical opportunities and future horizons, including data augmentation and explainable AI. Together, these factors are propelling the continuous advancement of more robust, transparent, and reliable systems.
Collapse
Affiliation(s)
- Carmen Jimenez-Mesa
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain
| | - Juan E Arco
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain; Department of Communications Engineering, University of Malaga, 29010, Spain
| | | | - John Suckling
- Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK
| | - Javier Ramirez
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and Communications, University of Granada, 18010, Spain; Department of Psychiatry, University of Cambridge, Cambridge CB21TN, UK.
| |
Collapse
|
11
|
Kantayeva G, Lima J, Pereira AI. Application of machine learning in dementia diagnosis: A systematic literature review. Heliyon 2023; 9:e21626. [PMID: 38027622 PMCID: PMC10663815 DOI: 10.1016/j.heliyon.2023.e21626] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2022] [Revised: 10/09/2023] [Accepted: 10/25/2023] [Indexed: 12/01/2023] Open
Abstract
According to the World Health Organization forecast, over 55 million people worldwide have dementia, and about 10 million new cases are detected yearly. Early diagnosis is essential for patients to plan for the future and deal with the disease. Machine Learning algorithms allow us to solve the problems associated with early disease detection. This work attempts to identify the current relevance of the application of machine learning in dementia prediction in the scientific world and suggests open fields for future research. The literature review was conducted by combining bibliometric and content analysis of articles originating in a period of 20 years in the Scopus database. Twenty-seven thousand five hundred twenty papers were identified firstly, of which a limited number focused on machine learning in dementia diagnosis. After the exclusion process, 202 were selected, and 25 were chosen for analysis. The recent increasing interest in the past five years in the theme of machine learning in dementia shows that it is a relevant field for research with still open questions. The methods used to identify dementia or what features are used to identify or predict this disease are explored in this study. The literature review revealed that most studies used magnetic resonance imaging (MRI) and its types as the main feature, accompanied by demographic data such as age, gender, and the mini-mental state examination score (MMSE). Data are usually acquired from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Classification of Alzheimer's disease is more prevalent than prediction of Mild Cognitive Impairment (MCI) or their combination. The authors preferred machine learning algorithms such as SVM, Ensemble methods, and CNN because of their excellent performance and results in previous studies. However, most use not one machine-learning technique but a combination of techniques. Despite achieving good results in the studies considered, there are new concepts for future investigation declared by the authors and suggestions for improvements by employing promising methods with potentially significant results.
Collapse
Affiliation(s)
- Gauhar Kantayeva
- Research Centre in Digitalization and Intelligent Robotics (CeDRI), Instituto Politecnico de Bragança, Bragança, Portugal
| | - José Lima
- Research Centre in Digitalization and Intelligent Robotics (CeDRI), Instituto Politecnico de Bragança, Bragança, Portugal
| | - Ana I. Pereira
- Research Centre in Digitalization and Intelligent Robotics (CeDRI), Instituto Politecnico de Bragança, Bragança, Portugal
| |
Collapse
|
12
|
Zhang Y, He X, Chan YH, Teng Q, Rajapakse JC. Multi-modal graph neural network for early diagnosis of Alzheimer's disease from sMRI and PET scans. Comput Biol Med 2023; 164:107328. [PMID: 37573721 DOI: 10.1016/j.compbiomed.2023.107328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 07/27/2023] [Accepted: 08/07/2023] [Indexed: 08/15/2023]
Abstract
In recent years, deep learning models have been applied to neuroimaging data for early diagnosis of Alzheimer's disease (AD). Structural magnetic resonance imaging (sMRI) and positron emission tomography (PET) images provide structural and functional information about the brain, respectively. Combining these features leads to improved performance than using a single modality alone in building predictive models for AD diagnosis. However, current multi-modal approaches in deep learning, based on sMRI and PET, are mostly limited to convolutional neural networks, which do not facilitate integration of both image and phenotypic information of subjects. We propose to use graph neural networks (GNN) that are designed to deal with problems in non-Euclidean domains. In this study, we demonstrate how brain networks are created from sMRI or PET images and can be used in a population graph framework that combines phenotypic information with imaging features of the brain networks. Then, we present a multi-modal GNN framework where each modality has its own branch of GNN and a technique that combines the multi-modal data at both the level of node vectors and adjacency matrices. Finally, we perform late fusion to combine the preliminary decisions made in each branch and produce a final prediction. As multi-modality data becomes available, multi-source and multi-modal is the trend of AD diagnosis. We conducted explorative experiments based on multi-modal imaging data combined with non-imaging phenotypic information for AD diagnosis and analyzed the impact of phenotypic information on diagnostic performance. Results from experiments demonstrated that our proposed multi-modal approach improves performance for AD diagnosis. Our study also provides technical reference and support the need for multivariate multi-modal diagnosis methods.
Collapse
Affiliation(s)
- Yanteng Zhang
- College of Electronics and Information Engineering, Sichuan University, Chengdu, 610065, China; School of Computer Science and Engineering, Nanyang Technological University, Singapore, 639798, Singapore
| | - Xiaohai He
- College of Electronics and Information Engineering, Sichuan University, Chengdu, 610065, China
| | - Yi Hao Chan
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, 639798, Singapore
| | - Qizhi Teng
- College of Electronics and Information Engineering, Sichuan University, Chengdu, 610065, China
| | - Jagath C Rajapakse
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, 639798, Singapore.
| |
Collapse
|
13
|
Wen G, Cao P, Liu L, Yang J, Zhang X, Wang F, Zaiane OR. Graph Self-Supervised Learning With Application to Brain Networks Analysis. IEEE J Biomed Health Inform 2023; 27:4154-4165. [PMID: 37159311 DOI: 10.1109/jbhi.2023.3274531] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
The less training data and insufficient supervision limit the performance of the deep supervised models for brain disease diagnosis. It is significant to construct a learning framework that can capture more information in limited data and insufficient supervision. To address these issues, we focus on self-supervised learning and aim to generalize the self-supervised learning to the brain networks, which are non-Euclidean graph data. More specifically, we propose an ensemble masked graph self-supervised framework named BrainGSLs, which incorporates 1) a local topological-aware encoder that takes the partially visible nodes as input and learns these latent representations, 2) a node-edge bi-decoder that reconstructs the masked edges by the representations of both the masked and visible nodes, 3) a signal representation learning module for capturing temporal representations from BOLD signals and 4) a classifier used for the classification. We evaluate our model on three real medical clinical applications: diagnosis of Autism Spectrum Disorder (ASD), diagnosis of Bipolar Disorder (BD) and diagnosis of Major Depressive Disorder (MDD). The results suggest that the proposed self-supervised training has led to remarkable improvement and outperforms state-of-the-art methods. Moreover, our method is able to identify the biomarkers associated with the diseases, which is consistent with the previous studies. We also explore the correlation of these three diseases and find the strong association between ASD and BD. To the best of our knowledge, our work is the first attempt of applying the idea of self-supervised learning with masked autoencoder on the brain network analysis.
Collapse
|
14
|
Garcia Santa Cruz B, Husch A, Hertel F. Machine learning models for diagnosis and prognosis of Parkinson's disease using brain imaging: general overview, main challenges, and future directions. Front Aging Neurosci 2023; 15:1216163. [PMID: 37539346 PMCID: PMC10394631 DOI: 10.3389/fnagi.2023.1216163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 06/28/2023] [Indexed: 08/05/2023] Open
Abstract
Parkinson's disease (PD) is a progressive and complex neurodegenerative disorder associated with age that affects motor and cognitive functions. As there is currently no cure, early diagnosis and accurate prognosis are essential to increase the effectiveness of treatment and control its symptoms. Medical imaging, specifically magnetic resonance imaging (MRI), has emerged as a valuable tool for developing support systems to assist in diagnosis and prognosis. The current literature aims to improve understanding of the disease's structural and functional manifestations in the brain. By applying artificial intelligence to neuroimaging, such as deep learning (DL) and other machine learning (ML) techniques, previously unknown relationships and patterns can be revealed in this high-dimensional data. However, several issues must be addressed before these solutions can be safely integrated into clinical practice. This review provides a comprehensive overview of recent ML techniques analyzed for the automatic diagnosis and prognosis of PD in brain MRI. The main challenges in applying ML to medical diagnosis and its implications for PD are also addressed, including current limitations for safe translation into hospitals. These challenges are analyzed at three levels: disease-specific, task-specific, and technology-specific. Finally, potential future directions for each challenge and future perspectives are discussed.
Collapse
Affiliation(s)
| | - Andreas Husch
- Imaging AI Group, Luxembourg Centre for Systems Biomedicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Frank Hertel
- National Department of Neurosurgery, Centre Hospitalier de Luxembourg, Luxembourg, Luxembourg
| |
Collapse
|
15
|
Anda-Duran ID, Hwang PH, Popp ZT, Low S, Ding H, Rahman S, Igwe A, Kolachalama VB, Lin H, Au R. Matching science to reality: how to deploy a participant-driven digital brain health platform. FRONTIERS IN DEMENTIA 2023; 2:1135451. [PMID: 38706716 PMCID: PMC11067045 DOI: 10.3389/frdem.2023.1135451] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/07/2024]
Abstract
Introduction Advances in digital technologies for health research enable opportunities for digital phenotyping of individuals in research and clinical settings. Beyond providing opportunities for advanced data analytics with data science and machine learning approaches, digital technologies offer solutions to several of the existing barriers in research practice that have resulted in biased samples. Methods A participant-driven, precision brain health monitoring digital platform has been introduced to two longitudinal cohort studies, the Boston University Alzheimer's Disease Research Center (BU ADRC) and the Bogalusa Heart Study (BHS). The platform was developed with prioritization of digital data in native format, multiple OS, validity of derived metrics, feasibility and usability. A platform including nine remote technologies and three staff-guided digital assessments has been introduced in the BU ADRC population, including a multimodal smartphone application also introduced to the BHS population. Participants select which technologies they would like to use and can manipulate their personal platform and schedule over time. Results Participants from the BU ADRC are using an average of 5.9 technologies to date, providing strong evidence for the usability of numerous digital technologies in older adult populations. Broad phenotyping of both cohorts is ongoing, with the collection of data spanning cognitive testing, sleep, physical activity, speech, motor activity, cardiovascular health, mood, gait, balance, and more. Several challenges in digital phenotyping implementation in the BU ADRC and the BHS have arisen, and the protocol has been revised and optimized to minimize participant burden while sustaining participant contact and support. Discussion The importance of digital data in its native format, near real-time data access, passive participant engagement, and availability of technologies across OS has been supported by the pattern of participant technology use and adherence across cohorts. The precision brain health monitoring platform will be iteratively adjusted and improved over time. The pragmatic study design enables multimodal digital phenotyping of distinct clinically characterized cohorts in both rural and urban U.S. settings.
Collapse
Affiliation(s)
- Ileana De Anda-Duran
- Department of Epidemiology, Tulane University School of Public Health and Tropical Medicine, New Orleans, LA, United States
| | - Phillip H. Hwang
- Department of Epidemiology, Boston University School of Public Health, Boston, MA, United States
| | - Zachary Thomas Popp
- Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
| | - Spencer Low
- Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
| | - Huitong Ding
- Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
- Framingham Heart Study, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
| | - Salman Rahman
- Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
| | - Akwaugo Igwe
- Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
| | - Vijaya B. Kolachalama
- Boston University Alzheimer’s Disease Research Center, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
- Department of Medicine, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
- Department of Computer Science and Faculty of Computing & Data Sciences, Boston University, Boston, MA, United States
| | - Honghuang Lin
- Department of Medicine, University of Massachusetts Chan Medical School, Worcester, MA, United States
| | - Rhoda Au
- Department of Epidemiology, Boston University School of Public Health, Boston, MA, United States
- Department of Anatomy and Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
- Framingham Heart Study, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
- Boston University Alzheimer’s Disease Research Center, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
- Department of Neurology, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, United States
| |
Collapse
|
16
|
Uddin KMM, Alam MJ, Jannat-E-Anawar, Uddin MA, Aryal S. A Novel Approach Utilizing Machine Learning for the Early Diagnosis of Alzheimer's Disease. BIOMEDICAL MATERIALS & DEVICES (NEW YORK, N.Y.) 2023; 1:1-17. [PMID: 37363136 PMCID: PMC10088738 DOI: 10.1007/s44174-023-00078-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 03/27/2023] [Indexed: 06/28/2023]
Abstract
Alzheimer's disease (AD) is one of the leading causes of dementia among older people. In addition, a considerable portion of the world's population suffers from metabolic problems, such as Alzheimer's disease and diabetes. Alzheimer's disease affects the brain in a degenerative manner. As the elderly population grows, this illness can cause more people to become inactive by impairing their memory and physical functionality. This might impact their family members and the financial, economic, and social spheres. Researchers have recently investigated different machine learning and deep learning approaches to detect such diseases at an earlier stage. Early diagnosis and treatment of AD help patients to recover from it successfully and with the least harm. This paper proposes a machine learning model that comprises GaussianNB, Decision Tree, Random Forest, XGBoost, Voting Classifier, and GradientBoost to predict Alzheimer's disease. The model is trained using the open access series of imaging studies (OASIS) dataset to evaluate the performance in terms of accuracy, precision, recall, and F1 score. Our findings showed that the voting classifier attained the highest validation accuracy of 96% for the AD dataset. Therefore, ML algorithms have the potential to drastically lower Alzheimer's disease annual mortality rates through accurate detection.
Collapse
Affiliation(s)
| | - Mir Jafikul Alam
- Department of Computer Science and Engineering, Dhaka International University, Dhaka, 1205 Bangladesh
| | - Jannat-E-Anawar
- Department of Computer Science and Engineering, Dhaka International University, Dhaka, 1205 Bangladesh
| | - Md Ashraf Uddin
- School of Information and Technology, Deakin University, Warun Ponds, Geelong, Australia
| | - Sunil Aryal
- School of Information and Technology, Deakin University, Warun Ponds, Geelong, Australia
| |
Collapse
|
17
|
Mulyadi AW, Jung W, Oh K, Yoon JS, Lee KH, Suk HI. Estimating explainable Alzheimer's disease likelihood map via clinically-guided prototype learning. Neuroimage 2023; 273:120073. [PMID: 37037063 DOI: 10.1016/j.neuroimage.2023.120073] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 03/03/2023] [Accepted: 03/30/2023] [Indexed: 04/12/2023] Open
Abstract
Identifying Alzheimer's disease (AD) involves a deliberate diagnostic process owing to its innate traits of irreversibility with subtle and gradual progression. These characteristics make AD biomarker identification from structural brain imaging (e.g., structural MRI) scans quite challenging. Using clinically-guided prototype learning, we propose a novel deep-learning approach through eXplainable AD Likelihood Map Estimation (XADLiME) for AD progression modeling over 3D sMRIs. Specifically, we establish a set of topologically-aware prototypes onto the clusters of latent clinical features, uncovering an AD spectrum manifold. Considering this pseudo map as an enriched reference, we employ an estimating network to approximate the AD likelihood map over a 3D sMRI scan. Additionally, we promote the explainability of such a likelihood map by revealing a comprehensible overview from clinical and morphological perspectives. During the inference, this estimated likelihood map served as a substitute for unseen sMRI scans for effectively conducting the downstream task while providing thorough explainable states.
Collapse
Affiliation(s)
- Ahmad Wisnu Mulyadi
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Wonsik Jung
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Kwanseok Oh
- Department of Artificial Intelligence, Korea University, Seoul 02841, Republic of Korea
| | - Jee Seok Yoon
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Kun Ho Lee
- Gwangju Alzheimer's & Related Dementia Cohort Research Center, Chosun University, Gwangju 61452, Republic of Korea; Department of Biomedical Science, Chosun University, Gwangju 61452, Republic of Korea; Korea Brain Research Institute, Daegu 41062, Republic of Korea
| | - Heung-Il Suk
- Department of Artificial Intelligence, Korea University, Seoul 02841, Republic of Korea; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea.
| |
Collapse
|
18
|
Divya R, Shantha Selva Kumari R. Detection of Alzheimer’s disease from temporal lobe grey matter slices using 3D CNN. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2023.2173548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Affiliation(s)
- R. Divya
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, India
| | - R. Shantha Selva Kumari
- Department of Electronics and Communication Engineering, Mepco Schlenk Engineering College, Sivakasi, India
| | | |
Collapse
|
19
|
Wang C, Wei Y, Li J, Li X, Liu Y, Hu Q, Wang Y. Asymmetry-enhanced attention network for Alzheimer's diagnosis with structural Magnetic Resonance Imaging. Comput Biol Med 2022; 151:106282. [PMID: 36413817 DOI: 10.1016/j.compbiomed.2022.106282] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2022] [Revised: 10/25/2022] [Accepted: 10/30/2022] [Indexed: 11/11/2022]
Abstract
BACKGROUND AND OBJECTIVE With the aging of the global population becoming severe, Alzheimer's disease (AD) has become one of the world's most common senile diseases. Many studies have suggested that the brain's left-right asymmetry is one of the possible diagnostic landmarks for AD. However, most published approaches to classification problems may not adequately explore the asymmetry between the left and right hemispheres. At the same time, the relationship between asymmetry traits and other classifier features remains understudied. METHODS In this paper, we proposed an asymmetry enhanced attention network (ASEAN) for AD diagnosis that effectively combines the anatomical asymmetry characteristics of the brain to enhance the accuracy and stability of classification tasks. First, we proposed a multi-scale asymmetry feature extraction module (MSAF) that can extract the asymmetry features of the brain from various scales. Second, we proposed an asymmetry refinement module (ARM) that considers the dependency between feature maps to suppress the irrelevant regions of the asymmetric feature maps. In addition, a parameter-free attention module was introduced to infer 4D attention weights and improve the network's representation capability. RESULTS The proposed method achieved performance improvements on two databases: Alzheimer's Disease Neuroimaging Initiative (ADNI) and Australian Imaging, Biomarkers and Lifestyle (AIBL). For the classification tasks on ADNI, the proposed method achieves 92.1% accuracy, 96.2% sensitivity, and 91.3% specificity on the AD vs. CN (Cognitively Normal) task. Compared with state-of-the-art methods, the proposed method could achieve comparable results. CONCLUSION The proposed model can extract long-range left-right brain similarity as complementary information and improve the model's diagnostic performance. A large number of experiments also support the model's validity. At the same time, this work provides a valuable reference for other neurological diseases, particularly those that exhibit left-right brain asymmetry during development.
Collapse
Affiliation(s)
- Chuyuan Wang
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
| | - Ying Wei
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China; Information Technology R&D Innovation Center of Peking University, Shaoxing, China; Changsha Hisense Intelligent System Research Institute Co., Ltd., China.
| | - Jiaguang Li
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
| | - Xiang Li
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
| | - Yue Liu
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
| | - Qian Hu
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
| | - Yuefeng Wang
- College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
| | | |
Collapse
|
20
|
Grandinetti J, Gao Y, Gonzalez Y, Deng J, Shen C, Jia X. MR image reconstruction from undersampled data for image-guided radiation therapy using a patient-specific deep manifold image prior. Front Oncol 2022; 12:1013783. [PMID: 36479074 PMCID: PMC9720169 DOI: 10.3389/fonc.2022.1013783] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Accepted: 10/31/2022] [Indexed: 06/13/2024] Open
Abstract
Introduction Recent advancements in radiotherapy (RT) have allowed for the integration of a Magnetic Resonance (MR) imaging scanner with a medical linear accelerator to use MR images for image guidance to position tumors against the treatment beam. Undersampling in MR acquisition is desired to accelerate the imaging process, but unavoidably deteriorates the reconstructed image quality. In RT, a high-quality MR image of a patient is available for treatment planning. In light of this unique clinical scenario, we proposed to exploit the patient-specific image prior to facilitate high-quality MR image reconstruction. Methods Utilizing the planning MR image, we established a deep auto-encoder to form a manifold of image patches of the patient. The trained manifold was then incorporated as a regularization to restore MR images of the same patient from undersampled data. We performed a simulation study using a patient case, a real patient study with three liver cancer patient cases, and a phantom experimental study using data acquired on an in-house small animal MR scanner. We compared the performance of the proposed method with those of the Fourier transform method, a tight-frame based Compressive Sensing method, and a deep learning method with a patient-generic manifold as the image prior. Results In the simulation study with 12.5% radial undersampling and 15% increase in noise, our method improved peak-signal-to-noise ratio by 4.46dB and structural similarity index measure by 28% compared to the patient-generic manifold method. In the experimental study, our method outperformed others by producing reconstructions of visually improved image quality.
Collapse
Affiliation(s)
| | | | | | | | | | - Xun Jia
- Innovative Technology of Radiotherapy Computations and Hardware (iTORCH) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX, United States
| |
Collapse
|
21
|
Comparative Analysis of Performance Metrics for Machine Learning Classifiers with a Focus on Alzheimer's Disease Data. ACTA INFORMATICA PRAGENSIA 2022. [DOI: 10.18267/j.aip.198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
22
|
Zhu M, Men Q, Ho ESL, Leung H, Shum HPH. A Two-stream Convolutional Network for Musculoskeletal and Neurological Disorders Prediction. J Med Syst 2022; 46:76. [PMID: 36201114 PMCID: PMC9537228 DOI: 10.1007/s10916-022-01857-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 08/17/2022] [Indexed: 11/24/2022]
Abstract
Musculoskeletal and neurological disorders are the most common causes of walking problems among older people, and they often lead to diminished quality of life. Analyzing walking motion data manually requires trained professionals and the evaluations may not always be objective. To facilitate early diagnosis, recent deep learning-based methods have shown promising results for automated analysis, which can discover patterns that have not been found in traditional machine learning methods. We observe that existing work mostly applies deep learning on individual joint features such as the time series of joint positions. Due to the challenge of discovering inter-joint features such as the distance between feet (i.e. the stride width) from generally smaller-scale medical datasets, these methods usually perform sub-optimally. As a result, we propose a solution that explicitly takes both individual joint features and inter-joint features as input, relieving the system from the need of discovering more complicated features from small data. Due to the distinctive nature of the two types of features, we introduce a two-stream framework, with one stream learning from the time series of joint position and the other from the time series of relative joint displacement. We further develop a mid-layer fusion module to combine the discovered patterns in these two streams for diagnosis, which results in a complementary representation of the data for better prediction performance. We validate our system with a benchmark dataset of 3D skeleton motion that involves 45 patients with musculoskeletal and neurological disorders, and achieve a prediction accuracy of 95.56%, outperforming state-of-the-art methods.
Collapse
Affiliation(s)
- Manli Zhu
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Qianhui Men
- Department of Engineering Science, University of Oxford, Oxford, UK
| | - Edmond S. L. Ho
- School of Computing Science, University of Glasgow, Glasgow, UK
| | - Howard Leung
- Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
| | | |
Collapse
|
23
|
Arrué L, Cigna-Méndez A, Barbosa T, Borrego-Muñoz P, Struve-Villalobos S, Oviedo V, Martínez-García C, Sepúlveda-Lara A, Millán N, Márquez Montesinos JCE, Muñoz J, Santana PA, Peña-Varas C, Barreto GE, González J, Ramírez D. New Drug Design Avenues Targeting Alzheimer's Disease by Pharmacoinformatics-Aided Tools. Pharmaceutics 2022; 14:1914. [PMID: 36145662 PMCID: PMC9503559 DOI: 10.3390/pharmaceutics14091914] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Revised: 09/03/2022] [Accepted: 09/06/2022] [Indexed: 11/30/2022] Open
Abstract
Neurodegenerative diseases (NDD) have been of great interest to scientists for a long time due to their multifactorial character. Among these pathologies, Alzheimer's disease (AD) is of special relevance, and despite the existence of approved drugs for its treatment, there is still no efficient pharmacological therapy to stop, slow, or repair neurodegeneration. Existing drugs have certain disadvantages, such as lack of efficacy and side effects. Therefore, there is a real need to discover new drugs that can deal with this problem. However, as AD is multifactorial in nature with so many physiological pathways involved, the most effective approach to modulate more than one of them in a relevant manner and without undesirable consequences is through polypharmacology. In this field, there has been significant progress in recent years in terms of pharmacoinformatics tools that allow the discovery of bioactive molecules with polypharmacological profiles without the need to spend a long time and excessive resources on complex experimental designs, making the drug design and development pipeline more efficient. In this review, we present from different perspectives how pharmacoinformatics tools can be useful when drug design programs are designed to tackle complex diseases such as AD, highlighting essential concepts, showing the relevance of artificial intelligence and new trends, as well as different databases and software with their main results, emphasizing the importance of coupling wet and dry approaches in drug design and development processes.
Collapse
Affiliation(s)
- Lily Arrué
- Centro de Investigación de Estudios Avanzados del Maule (CIEAM), Vicerrectoría de Investigación y Postgrado, Universidad Católica del Maule, Talca 3480094, Chile
| | - Alexandra Cigna-Méndez
- Facultad de Ingeniería, Instituto de Ciencias Químicas Aplicadas, Universidad Autónoma de Chile, Santiago 8910060, Chile
| | - Tábata Barbosa
- Departamento de Nutrición y Bioquímica, Facultad de Ciencias, Pontificia Universidad Javeriana, Bogotá 110231, Colombia
| | - Paola Borrego-Muñoz
- Escuela de Medicina, Fundación Universitaria Juan N. Corpas, Bogotá 110311, Colombia
| | - Silvia Struve-Villalobos
- Instituto de Ciencias Biomédicas, Facultad de Ciencias de la Salud, Universidad Autónoma de Chile, Temuco 4780000, Chile
| | - Victoria Oviedo
- Facultad de Ingeniería, Instituto de Ciencias Químicas Aplicadas, Universidad Autónoma de Chile, Santiago 8910060, Chile
| | - Claudia Martínez-García
- Departamento de Farmacia, Facultad de Ciencias, Universidad Nacional de Colombia, Bogotá 111321, Colombia
| | - Alexis Sepúlveda-Lara
- Instituto de Ciencias Biomédicas, Facultad de Ciencias de la Salud, Universidad Autónoma de Chile, Temuco 4780000, Chile
| | - Natalia Millán
- Departamento de Nutrición y Bioquímica, Facultad de Ciencias, Pontificia Universidad Javeriana, Bogotá 110231, Colombia
| | | | - Juana Muñoz
- Departamento de Nutrición y Bioquímica, Facultad de Ciencias, Pontificia Universidad Javeriana, Bogotá 110231, Colombia
| | - Paula A. Santana
- Facultad de Ingeniería, Instituto de Ciencias Químicas Aplicadas, Universidad Autónoma de Chile, Santiago 8910060, Chile
| | - Carlos Peña-Varas
- Departamento de Farmacología, Facultad de Ciencias Biológicas, Universidad de Concepción, Concepción 4030000, Chile
| | - George E. Barreto
- Department of Biological Sciences, University of Limerick, V94 T9PX Limerick, Ireland
| | - Janneth González
- Departamento de Nutrición y Bioquímica, Facultad de Ciencias, Pontificia Universidad Javeriana, Bogotá 110231, Colombia
| | - David Ramírez
- Departamento de Farmacología, Facultad de Ciencias Biológicas, Universidad de Concepción, Concepción 4030000, Chile
| |
Collapse
|
24
|
Huang C, Wang J, Wang SH, Zhang YD. Applicable artificial intelligence for brain disease: A survey. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
25
|
Khojaste-Sarakhsi M, Haghighi SS, Ghomi SF, Marchiori E. Deep learning for Alzheimer's disease diagnosis: A survey. Artif Intell Med 2022; 130:102332. [DOI: 10.1016/j.artmed.2022.102332] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 04/29/2022] [Accepted: 05/30/2022] [Indexed: 11/28/2022]
|
26
|
Lei B, Zhang Y, Liu D, Xu Y, Yue G, Cao J, Hu H, Yu S, Yang P, Wang T, Qiu Y, Xiao X, Wang S. Longitudinal study of early mild cognitive impairment via similarity-constrained group learning and self-attention based SBi-LSTM. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
27
|
Baghdadi NA, Malki A, Balaha HM, Badawy M, Elhosseini M. A 3C-TL-GTO: Alzheimer Automatic Accurate Classification Using Transfer Learning and Artificial Gorilla Troops Optimizer. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22114250. [PMID: 35684871 PMCID: PMC9185328 DOI: 10.3390/s22114250] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Revised: 05/24/2022] [Accepted: 05/28/2022] [Indexed: 05/10/2023]
Abstract
Alzheimer's disease (AD) is a chronic disease that affects the elderly. There are many different types of dementia, but Alzheimer's disease is one of the leading causes of death. AD is a chronic brain disorder that leads to problems with language, disorientation, mood swings, bodily functions, memory loss, cognitive decline, mood or personality changes, and ultimately death due to dementia. Unfortunately, no cure has yet been developed for it, and it has no known causes. Clinically, imaging tools can aid in the diagnosis, and deep learning has recently emerged as an important component of these tools. Deep learning requires little or no image preprocessing and can infer an optimal data representation from raw images without prior feature selection. As a result, they produce a more objective and less biased process. The performance of a convolutional neural network (CNN) is primarily affected by the hyperparameters chosen and the dataset used. A deep learning model for classifying Alzheimer's patients has been developed using transfer learning and optimized by Gorilla Troops for early diagnosis. This study proposes the A3C-TL-GTO framework for MRI image classification and AD detection. The A3C-TL-GTO is an empirical quantitative framework for accurate and automatic AD classification, developed and evaluated with the Alzheimer's Dataset (four classes of images) and the Alzheimer's Disease Neuroimaging Initiative (ADNI). The proposed framework reduces the bias and variability of preprocessing steps and hyperparameters optimization to the classifier model and dataset used. Our strategy, evaluated on MRIs, is easily adaptable to other imaging methods. According to our findings, the proposed framework was an excellent instrument for this task, with a significant potential advantage for patient care. The ADNI dataset, an online dataset on Alzheimer's disease, was used to obtain magnetic resonance imaging (MR) brain images. The experimental results demonstrate that the proposed framework achieves 96.65% accuracy for the Alzheimer's Dataset and 96.25% accuracy for the ADNI dataset. Moreover, a better performance in terms of accuracy is demonstrated over other state-of-the-art approaches.
Collapse
Affiliation(s)
- Nadiah A. Baghdadi
- College of Nursing, Princess Nourah Bint Abdulrahman University, Riyadh 11671, Saudi Arabia;
| | - Amer Malki
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia; (A.M.); (M.E.)
| | - Hossam Magdy Balaha
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| | - Mahmoud Badawy
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
- Correspondence:
| | - Mostafa Elhosseini
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia; (A.M.); (M.E.)
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura 35516, Egypt;
| |
Collapse
|
28
|
Tobón DP, Hossain MS, Muhammad G, Bilbao J, Saddik AE. Deep learning in multimedia healthcare applications: a review. MULTIMEDIA SYSTEMS 2022; 28:1465-1479. [PMID: 35645465 PMCID: PMC9127037 DOI: 10.1007/s00530-022-00948-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Accepted: 04/22/2022] [Indexed: 06/15/2023]
Abstract
The increase in chronic diseases has affected the countries' health system and economy. With the recent COVID-19 virus, humanity has experienced a great challenge, which has led to make efforts to detect it and prevent its spread. Hence, it is necessary to develop new solutions that are based on technology and low cost, to satisfy the citizens' needs. Deep learning techniques is a technological solution that has been used in healthcare lately. Nowadays, with the increase in chips processing capabilities, increase size of data, and the progress in deep learning research, healthcare applications have been proposed to provide citizens' health needs. In addition, a big amount of data is generated every day. Development in Internet of Things, gadgets, and phones has allowed the access to multimedia data. Data such as images, video, audio and text are used as input of applications based on deep learning methods to support healthcare system to diagnose, predict, or treat patients. This review pretends to give an overview of proposed healthcare solutions based on deep learning techniques using multimedia data. We show the use of deep learning in healthcare, explain the different types of multimedia data, show some relevant deep learning multimedia applications in healthcare, and highlight some challenges in this research area.
Collapse
Affiliation(s)
- Diana P. Tobón
- Department of Telecommunications Engineering, Universidad de Medellín, Medellín, Colombia
| | - M. Shamim Hossain
- Department of Software Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, 11543 Saudi Arabia
| | - Ghulam Muhammad
- Department of Computer Engineering, College of Computer and Information Sciences, King Saud University, Riyadh, 11543 Saudi Arabia
| | - Josu Bilbao
- Head of Research Department - ICT (IoT Digital Platforms, Data Analytics & Artificial Intelligence) IKERLAN, Arrasate, Spain
| | - Abdulmotaleb El Saddik
- Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE
- University of Ottawa, Ottawa, Canada
| |
Collapse
|
29
|
Liu L, Tang S, Wu FX, Wang YP, Wang J. An Ensemble Hybrid Feature Selection Method for Neuropsychiatric Disorder Classification. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2022; 19:1459-1471. [PMID: 33471766 DOI: 10.1109/tcbb.2021.3053181] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Magnetic resonance imagings (MRIs) are providing increased access to neuropsychiatric disorders that can be made available for advanced data analysis. However, the single type of data limits the ability of psychiatrists to distinguish the subclasses of this disease. In this paper, we propose an ensemble hybrid features selection method for the neuropsychiatric disorder classification. The method consists of a 3D DenseNet and a XGBoost, which are used to select the image features from structural MRI images and the phenotypic feature from phenotypic records, respectively. The hybrid feature is composed of image features and phenotypic features. The proposed method is validated in the Consortium for Neuropsychiatric Phenomics (CNP) dataset, where samples are classified into one of the four classes (healthy controls (HC), attention deficit hyperactivity disorder (ADHD), bipolar disorder (BD), and schizophrenia (SD)). Experimental results show that the hybrid feature can improve the performance of classification methods. The best accuracy of binary and multi-class classification can reach 91.22 and 78.62 percent, respectively. We analyze the importance of phenotypic features and image features in different classification tasks. The importance of the structure MRI images is highlighted by incorporating phenotypic features with image features to generate hybrid features. We also visualize the features of three neuropsychiatric disorders and analyze their locations in the brain region.
Collapse
|
30
|
Attention-Guided Neural Network for Early Dementia Detection Using MRS data. Comput Med Imaging Graph 2022; 99:102074. [DOI: 10.1016/j.compmedimag.2022.102074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 04/25/2022] [Accepted: 05/12/2022] [Indexed: 11/17/2022]
|
31
|
A CAD system design for Alzheimer's disease diagnosis using temporally consistent clustering and hybrid deep learning models. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103571] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
32
|
Kavitha C, Mani V, Srividhya SR, Khalaf OI, Tavera Romero CA. Early-Stage Alzheimer's Disease Prediction Using Machine Learning Models. Front Public Health 2022; 10:853294. [PMID: 35309200 PMCID: PMC8927715 DOI: 10.3389/fpubh.2022.853294] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 01/26/2022] [Indexed: 11/23/2022] Open
Abstract
Alzheimer's disease (AD) is the leading cause of dementia in older adults. There is currently a lot of interest in applying machine learning to find out metabolic diseases like Alzheimer's and Diabetes that affect a large population of people around the world. Their incidence rates are increasing at an alarming rate every year. In Alzheimer's disease, the brain is affected by neurodegenerative changes. As our aging population increases, more and more individuals, their families, and healthcare will experience diseases that affect memory and functioning. These effects will be profound on the social, financial, and economic fronts. In its early stages, Alzheimer's disease is hard to predict. A treatment given at an early stage of AD is more effective, and it causes fewer minor damage than a treatment done at a later stage. Several techniques such as Decision Tree, Random Forest, Support Vector Machine, Gradient Boosting, and Voting classifiers have been employed to identify the best parameters for Alzheimer's disease prediction. Predictions of Alzheimer's disease are based on Open Access Series of Imaging Studies (OASIS) data, and performance is measured with parameters like Precision, Recall, Accuracy, and F1-score for ML models. The proposed classification scheme can be used by clinicians to make diagnoses of these diseases. It is highly beneficial to lower annual mortality rates of Alzheimer's disease in early diagnosis with these ML algorithms. The proposed work shows better results with the best validation average accuracy of 83% on the test data of AD. This test accuracy score is significantly higher in comparison with existing works.
Collapse
Affiliation(s)
- C. Kavitha
- Department of Computer Science and Engineering, Sathyabama Institute of Science and Technology, Chennai, India,*Correspondence: C. Kavitha
| | - Vinodhini Mani
- Department of Computer Science and Engineering, Sathyabama Institute of Science and Technology, Chennai, India
| | - S. R. Srividhya
- Department of Computer Science and Engineering, Sathyabama Institute of Science and Technology, Chennai, India
| | - Osamah Ibrahim Khalaf
- Al-Nahrain Nanorenewable Energy Research Center, Al-Nahrain University, Baghdad, Iraq
| | | |
Collapse
|
33
|
Predicting progression of Alzheimer’s disease using forward-to-backward bi-directional network with integrative imputation. Neural Netw 2022; 150:422-439. [DOI: 10.1016/j.neunet.2022.03.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 02/23/2022] [Accepted: 03/10/2022] [Indexed: 11/20/2022]
|
34
|
Han R, Liu Z, Chen CP. Multi-scale 3D convolution feature-based Broad Learning System for Alzheimer’s Disease diagnosis via MRI images. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.108660] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
35
|
Li R, Wang X, Lawler K, Garg S, Bai Q, Alty J. Applications of Artificial Intelligence to aid detection of dementia: a scoping review on current capabilities and future directions. J Biomed Inform 2022; 127:104030. [DOI: 10.1016/j.jbi.2022.104030] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 01/21/2022] [Accepted: 02/12/2022] [Indexed: 12/17/2022]
|
36
|
López-García D, Peñalver JMG, Górriz JM, Ruz M. MVPAlab: A machine learning decoding toolbox for multidimensional electroencephalography data. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 214:106549. [PMID: 34910975 DOI: 10.1016/j.cmpb.2021.106549] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 10/30/2021] [Accepted: 11/17/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVE The study of brain function has recently expanded from classical univariate to multivariate analyses. These multivariate, machine learning-based algorithms afford neuroscientists extracting more detailed and richer information from the data. However, the implementation of these procedures is usually challenging, especially for researchers with no coding experience. To address this problem, we have developed MVPAlab, a MATLAB-based, flexible decoding toolbox for multidimensional electroencephalography and magnetoencephalography data. METHODS The MVPAlab Toolbox implements several machine learning algorithms to compute multivariate pattern analyses, cross-classification, temporal generalization matrices and feature and frequency contribution analyses. It also provides access to an extensive set of preprocessing routines for, among others, data normalization, data smoothing, dimensionality reduction and supertrial generation. To draw statistical inferences at the group level, MVPAlab includes a non-parametric cluster-based permutation approach. RESULTS A sample electroencephalography dataset was compiled to test all the MVPAlab main functionalities. Significant clusters (p<0.01) were found for the proposed decoding analyses and different configurations, proving the software capability for discriminating between different experimental conditions. CONCLUSIONS This toolbox has been designed to include an easy-to-use and intuitive graphic user interface and data representation software, which makes MVPAlab a very convenient tool for users with few or no previous coding experience. In addition, MVPAlab is not for beginners only, as it implements several high and low-level routines allowing more experienced users to design their own projects in a highly flexible manner.
Collapse
Affiliation(s)
| | - José M G Peñalver
- Mind, Brain and Behavior Research Center, University of Granada, Spain
| | - Juan M Górriz
- Data Science & Computational Intelligence Institute, University of Granada, Spain
| | - María Ruz
- Mind, Brain and Behavior Research Center, Department of Experimental Psychology, University of Granada, Spain
| |
Collapse
|
37
|
Arco JE, Ortiz A, Ramírez J, Zhang YD, Górriz JM. Tiled Sparse Coding in Eigenspaces for Image Classification. Int J Neural Syst 2021; 32:2250007. [PMID: 34967705 DOI: 10.1142/s0129065722500071] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The automation in the diagnosis of medical images is currently a challenging task. The use of Computer Aided Diagnosis (CAD) systems can be a powerful tool for clinicians, especially in situations when hospitals are overflowed. These tools are usually based on artificial intelligence (AI), a field that has been recently revolutionized by deep learning approaches. blackThese alternatives usually obtain a large performance based on complex solutions, leading to a high computational cost and the need of having large databases. In this work, we propose a classification framework based on sparse coding. Images are blackfirst partitioned into different tiles, and a dictionary is built after applying PCA to these tiles. The original signals are then transformed as a linear combination of the elements of the dictionary. blackThen, they are reconstructed by iteratively deactivating the elements associated with each component. Classification is finally performed employing as features the subsequent reconstruction errors. Performance is evaluated in a real context where distinguishing between four different pathologies: control versus bacterial pneumonia versus viral pneumonia versus COVID-19. blackOur system differentiates between pneumonia patients and controls with an accuracy of 97.74%, whereas in the 4-class context the accuracy is 86.73%. The excellent results and the pioneering use of sparse coding in this scenario evidence that our proposal can assist clinicians when their workload is high.
Collapse
Affiliation(s)
- Juan E Arco
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Andrés Ortiz
- Department of Communications Engineering, University of Malaga 29010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Javier Ramírez
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Yu-Dong Zhang
- School of Informatics, University of Leicester, Leicester LE1 7RH, UK
| | - Juan M Górriz
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| |
Collapse
|
38
|
Tuladhar A, Moore JA, Ismail Z, Forkert ND. Modeling Neurodegeneration in silico With Deep Learning. Front Neuroinform 2021; 15:748370. [PMID: 34867256 PMCID: PMC8640525 DOI: 10.3389/fninf.2021.748370] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 10/21/2021] [Indexed: 11/13/2022] Open
Abstract
Deep neural networks, inspired by information processing in the brain, can achieve human-like performance for various tasks. However, research efforts to use these networks as models of the brain have primarily focused on modeling healthy brain function so far. In this work, we propose a paradigm for modeling neural diseases in silico with deep learning and demonstrate its use in modeling posterior cortical atrophy (PCA), an atypical form of Alzheimer’s disease affecting the visual cortex. We simulated PCA in deep convolutional neural networks (DCNNs) trained for visual object recognition by randomly injuring connections between artificial neurons. Results showed that injured networks progressively lost their object recognition capability. Simulated PCA impacted learned representations hierarchically, as networks lost object-level representations before category-level representations. Incorporating this paradigm in computational neuroscience will be essential for developing in silico models of the brain and neurological diseases. The paradigm can be expanded to incorporate elements of neural plasticity and to other cognitive domains such as motor control, auditory cognition, language processing, and decision making.
Collapse
Affiliation(s)
- Anup Tuladhar
- Department of Radiology, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Jasmine A Moore
- Department of Radiology, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Biomedical Engineering Program, University of Calgary, Calgary, AB, Canada
| | - Zahinoor Ismail
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Department of Community Health Sciences, University of Calgary, Calgary, AB, Canada.,Department of Psychiatry, University of Calgary, Calgary, AB, Canada.,O'Brien Institute for Public Health, University of Calgary, Calgary, AB, Canada
| | - Nils D Forkert
- Department of Radiology, University of Calgary, Calgary, AB, Canada.,Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada.,Department of Clinical Neurosciences, University of Calgary, Calgary, AB, Canada.,Alberta Children's Hospital Research Institute, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
39
|
Shoeibi A, Sadeghi D, Moridian P, Ghassemi N, Heras J, Alizadehsani R, Khadem A, Kong Y, Nahavandi S, Zhang YD, Gorriz JM. Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models. Front Neuroinform 2021; 15:777977. [PMID: 34899226 PMCID: PMC8657145 DOI: 10.3389/fninf.2021.777977] [Citation(s) in RCA: 49] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Accepted: 10/22/2021] [Indexed: 11/13/2022] Open
Abstract
Schizophrenia (SZ) is a mental disorder whereby due to the secretion of specific chemicals in the brain, the function of some brain regions is out of balance, leading to the lack of coordination between thoughts, actions, and emotions. This study provides various intelligent deep learning (DL)-based methods for automated SZ diagnosis via electroencephalography (EEG) signals. The obtained results are compared with those of conventional intelligent methods. To implement the proposed methods, the dataset of the Institute of Psychiatry and Neurology in Warsaw, Poland, has been used. First, EEG signals were divided into 25 s time frames and then were normalized by z-score or norm L2. In the classification step, two different approaches were considered for SZ diagnosis via EEG signals. In this step, the classification of EEG signals was first carried out by conventional machine learning methods, e.g., support vector machine, k-nearest neighbors, decision tree, naïve Bayes, random forest, extremely randomized trees, and bagging. Various proposed DL models, namely, long short-term memories (LSTMs), one-dimensional convolutional networks (1D-CNNs), and 1D-CNN-LSTMs, were used in the following. In this step, the DL models were implemented and compared with different activation functions. Among the proposed DL models, the CNN-LSTM architecture has had the best performance. In this architecture, the ReLU activation function with the z-score and L2-combined normalization was used. The proposed CNN-LSTM model has achieved an accuracy percentage of 99.25%, better than the results of most former studies in this field. It is worth mentioning that to perform all simulations, the k-fold cross-validation method with k = 5 has been used.
Collapse
Affiliation(s)
- Afshin Shoeibi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Delaram Sadeghi
- Department of Medical Engineering, Islamic Azad University of Mashhad, Mashhad, Iran
| | - Parisa Moridian
- Faculty of Engineering, Islamic Azad University of Science and Research, Tehran, Iran
| | - Navid Ghassemi
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Jónathan Heras
- Department of Mathematics and Computer Science, University of La Rioja, Logroño, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Ali Khadem
- Faculty of Electrical Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yinan Kong
- School of Engineering, Macquarie University, Sydney, NSW, Australia
| | - Saeid Nahavandi
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Yu-Dong Zhang
- Department of Informatics, University of Leicester, Leicester, United Kingdom
| | - Juan Manuel Gorriz
- Department of Signal Theory, Telematics and Communications, ETS of Computer and Telecommunications Engineering, University of Granada, Granada, Spain
| |
Collapse
|
40
|
Lao H, Zhang X. Regression and Classification of Alzheimers Disease Diagnosis using NMF-TDNet Features from 3D Brain MR Image. IEEE J Biomed Health Inform 2021; 26:1103-1115. [PMID: 34543210 DOI: 10.1109/jbhi.2021.3113668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
With the development of deep learning and medical imaging technology, many researchers use convolutional neural network(CNN) to obtain deep-level features of medical image in order to better classify Alzheimer's disease (AD) and predict clinical scores. The principal component analysis network (PCANet) is a lightweight deep-learning network that mainly uses principal component analysis (PCA) to generate multilevel filter banks for the centralized learning of samples and then performs binarization and generates blockwise histograms to obtain image features. However, the dimensions of the extracted PCANet features reaching tens of thousands or even hundreds of thousands, and the formation of the multilevel filter banks is sample data dependent, reducing the flexibility of PCANet. In this paper, based on the idea of PCANet, we propose a data-independent network called the nonnegative matrix factorization tensor decomposition network (NMF-TDNet), which improves the computational efficiency and solves the data dependence problem of PCANet. In this network, we use nonnegative matrix factorization (NMF) instead of PCA to create multilevel filter banks for sample learning, then uses the learning results to build a higher-order tensor and perform tensor decomposition (TD) to achieve data dimensionality reduction, producing the final image features. Finally, our method use these features as the input of the support vector machine (SVM) for AD classification diagnosis and clinical score prediction. The performance of our method is extensively evaluated on the ADNI-1, ADNI-2 and OASIS datasets. The experimental results show that NMF-TDNet can achieve data dimensionality reduction (the dimensionality of the extracted features numbers only a few hundred dimensions, far less than the hundreds of thousands required by PCANet) and the NMF-TDNet features as input achieved superior performance than using PCANet features as input.
Collapse
|
41
|
Song X, Mao M, Qian X. Auto-Metric Graph Neural Network Based on a Meta-Learning Strategy for the Diagnosis of Alzheimer's Disease. IEEE J Biomed Health Inform 2021; 25:3141-3152. [PMID: 33493122 DOI: 10.1109/jbhi.2021.3053568] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Alzheimer's disease (AD) is the most common cognitive disorder. In recent years, many computer-aided diagnosis techniques have been proposed for AD diagnosis and progression predictions. Among them, graph neural networks (GNNs) have received extensive attention owing to their ability to effectively fuse multimodal features and model the correlation between samples. However, many GNNs for node classification use an entire dataset to construct a large fixed-graph structure, which cannot be used for independent testing. To overcome this limitation while maintaining the advantages of the GNN, we propose an auto-metric GNN (AMGNN) model for AD diagnosis. First, a metric-based meta-learning strategy is introduced to realize inductive learning for independent testing through multiple node classification tasks. In the meta-tasks, the small graphs help make the model insensitive to the sample size, thus improving the performance under small sample size conditions. Furthermore, an AMGNN layer with a probability constraint is designed to realize node similarity metric learning and effectively fuse multimodal data. We verified the model on two tasks based on the TADPOLE dataset: early AD diagnosis and mild cognitive impairment (MCI) conversion prediction. Our model provides excellent performance on both tasks with accuracies of 94.44% and 87.50% and median accuracies of 94.19% and 86.25%, respectively. These results show that our model improves flexibility while ensuring a good classification performance, thus promoting the development of graph-based deep learning algorithms for disease diagnosis.
Collapse
|
42
|
Ji J, Chen Z, Yang C. Convolutional Neural Network with Sparse Strategies to Classify Dynamic Functional Connectivity. IEEE J Biomed Health Inform 2021; 26:1219-1228. [PMID: 34314368 DOI: 10.1109/jbhi.2021.3100559] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Classification of dynamic functional connectivity (DFC) is becoming a promising approach for diagnosing various neurodegenerative diseases. However, the existing methods generally face the problem of overfitting. To solve it, this paper proposes a convolutional neural network with three sparse strategies named SCNN to classify DFC. Firstly, an element-wise filter is designed to impose sparse constraints on the DFC matrix by replacing the redundant elements with zeroes, where the DFC matrix is specially constructed to quantify the spatial and temporal variation of DFC. Secondly, a 11 convolutional filter is adopted to reduce the dimensionality of the sparse DFC matrix, and remove meaningless features resulted from zero elements in the subsequent convolution process. Finally, an extra sparse optimization classifier is employed to optimize the parameters of the above two filters, which can effectively improve the ability of SCNN to extract discriminative features. Experimental results on multiple resting-state fMRI datasets demonstrate that the proposed model provides a better classification performance of DFC compared with several state-of-the-art methods, and can identify the abnormal brain functional connectivity.
Collapse
|
43
|
Yamaguchi H, Hashimoto Y, Sugihara G, Miyata J, Murai T, Takahashi H, Honda M, Hishimoto A, Yamashita Y. Three-Dimensional Convolutional Autoencoder Extracts Features of Structural Brain Images With a "Diagnostic Label-Free" Approach: Application to Schizophrenia Datasets. Front Neurosci 2021; 15:652987. [PMID: 34305514 PMCID: PMC8294943 DOI: 10.3389/fnins.2021.652987] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Accepted: 06/07/2021] [Indexed: 01/17/2023] Open
Abstract
There has been increasing interest in performing psychiatric brain imaging studies using deep learning. However, most studies in this field disregard three-dimensional (3D) spatial information and targeted disease discrimination, without considering the genetic and clinical heterogeneity of psychiatric disorders. The purpose of this study was to investigate the efficacy of a 3D convolutional autoencoder (3D-CAE) for extracting features related to psychiatric disorders without diagnostic labels. The network was trained using a Kyoto University dataset including 82 patients with schizophrenia (SZ) and 90 healthy subjects (HS) and was evaluated using Center for Biomedical Research Excellence (COBRE) datasets, including 71 SZ patients and 71 HS. We created 16 3D-CAE models with different channels and convolutions to explore the effective range of hyperparameters for psychiatric brain imaging. The number of blocks containing two convolutional layers and one pooling layer was set, ranging from 1 block to 4 blocks. The number of channels in the extraction layer varied from 1, 4, 16, and 32 channels. The proposed 3D-CAEs were successfully reproduced into 3D structural magnetic resonance imaging (MRI) scans with sufficiently low errors. In addition, the features extracted using 3D-CAE retained the relation to clinical information. We explored the appropriate hyperparameter range of 3D-CAE, and it was suggested that a model with 3 blocks may be related to extracting features for predicting the dose of medication and symptom severity in schizophrenia.
Collapse
Affiliation(s)
- Hiroyuki Yamaguchi
- Department of Information Medicine, National Center of Neurology and Psychiatry, National Institute of Neuroscience, Tokyo, Japan.,Department of Psychiatry, School of Medicine, Yokohama City University, Yokohama, Japan
| | - Yuki Hashimoto
- Department of Information Medicine, National Center of Neurology and Psychiatry, National Institute of Neuroscience, Tokyo, Japan
| | - Genichi Sugihara
- Department of Psychiatry and Behavioral Sciences, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
| | - Jun Miyata
- Department of Psychiatry, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Toshiya Murai
- Department of Psychiatry, Graduate School of Medicine, Kyoto University, Kyoto, Japan
| | - Hidehiko Takahashi
- Department of Psychiatry and Behavioral Sciences, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, Tokyo, Japan
| | - Manabu Honda
- Department of Information Medicine, National Center of Neurology and Psychiatry, National Institute of Neuroscience, Tokyo, Japan
| | - Akitoyo Hishimoto
- Department of Psychiatry, School of Medicine, Yokohama City University, Yokohama, Japan
| | - Yuichi Yamashita
- Department of Information Medicine, National Center of Neurology and Psychiatry, National Institute of Neuroscience, Tokyo, Japan
| |
Collapse
|
44
|
Kumar S, Oh I, Schindler S, Lai AM, Payne PRO, Gupta A. Machine learning for modeling the progression of Alzheimer disease dementia using clinical data: a systematic literature review. JAMIA Open 2021; 4:ooab052. [PMID: 34350389 PMCID: PMC8327375 DOI: 10.1093/jamiaopen/ooab052] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Revised: 06/21/2021] [Accepted: 06/30/2021] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVE Alzheimer disease (AD) is the most common cause of dementia, a syndrome characterized by cognitive impairment severe enough to interfere with activities of daily life. We aimed to conduct a systematic literature review (SLR) of studies that applied machine learning (ML) methods to clinical data derived from electronic health records in order to model risk for progression of AD dementia. MATERIALS AND METHODS We searched for articles published between January 1, 2010, and May 31, 2020, in PubMed, Scopus, ScienceDirect, IEEE Explore Digital Library, Association for Computing Machinery Digital Library, and arXiv. We used predefined criteria to select relevant articles and summarized them according to key components of ML analysis such as data characteristics, computational algorithms, and research focus. RESULTS There has been a considerable rise over the past 5 years in the number of research papers using ML-based analysis for AD dementia modeling. We reviewed 64 relevant articles in our SLR. The results suggest that majority of existing research has focused on predicting progression of AD dementia using publicly available datasets containing both neuroimaging and clinical data (neurobehavioral status exam scores, patient demographics, neuroimaging data, and laboratory test values). DISCUSSION Identifying individuals at risk for progression of AD dementia could potentially help to personalize disease management to plan future care. Clinical data consisting of both structured data tables and clinical notes can be effectively used in ML-based approaches to model risk for AD dementia progression. Data sharing and reproducibility of results can enhance the impact, adaptation, and generalizability of this research.
Collapse
Affiliation(s)
- Sayantan Kumar
- Institute for Informatics, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Inez Oh
- Institute for Informatics, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Suzanne Schindler
- Department of Neurology, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Albert M Lai
- Institute for Informatics, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Philip R O Payne
- Institute for Informatics, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Aditi Gupta
- Institute for Informatics, Washington University School of Medicine, St. Louis, Missouri, USA
| |
Collapse
|
45
|
He Y, Wu J, Zhou L, Chen Y, Li F, Qian H. Quantification of Cognitive Function in Alzheimer's Disease Based on Deep Learning. Front Neurosci 2021; 15:651920. [PMID: 33815051 PMCID: PMC8010261 DOI: 10.3389/fnins.2021.651920] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Accepted: 02/08/2021] [Indexed: 12/14/2022] Open
Abstract
Alzheimer disease (AD) is mainly manifested as insidious onset, chronic progressive cognitive decline and non-cognitive neuropsychiatric symptoms, which seriously affects the quality of life of the elderly and causes a very large burden on society and families. This paper uses graph theory to analyze the constructed brain network, and extracts the node degree, node efficiency, and node betweenness centrality parameters of the two modal brain networks. The T test method is used to analyze the difference of graph theory parameters between normal people and AD patients, and brain regions with significant differences in graph theory parameters are selected as brain network features. By analyzing the calculation principles of the conventional convolutional layer and the depth separable convolution unit, the computational complexity of them is compared. The depth separable convolution unit decomposes the traditional convolution process into spatial convolution for feature extraction and point convolution for feature combination, which greatly reduces the number of multiplication and addition operations in the convolution process, while still being able to obtain comparisons. Aiming at the special convolution structure of the depth separable convolution unit, this paper proposes a channel pruning method based on the convolution structure and explains its pruning process. Multimodal neuroimaging can provide complete information for the quantification of Alzheimer’s disease. This paper proposes a cascaded three-dimensional neural network framework based on single-modal and multi-modal images, using MRI and PET images to distinguish AD and MCI from normal samples. Multiple three-dimensional CNN networks are used to extract recognizable information in local image blocks. The high-level two-dimensional CNN network fuses multi-modal features and selects the features of discriminative regions to perform quantitative predictions on samples. The algorithm proposed in this paper can automatically extract and fuse the features of multi-modality and multi-regions layer by layer, and the visual analysis results show that the abnormally changed regions affected by Alzheimer’s disease provide important information for clinical quantification.
Collapse
Affiliation(s)
- Yanxian He
- One Departments of Cadre Ward, General Hospital of Southern Theater Command, PLA, Guangzhou, China.,Branch of National Clinical Research Center for Geriatric Diseases, Chinese PLA General Hospital, Guangzhou, China
| | - Jun Wu
- Branch of National Clinical Research Center for Geriatric Diseases, Chinese PLA General Hospital, Guangzhou, China.,Three Departments of Cadre Ward, General Hospital of Southern Theater Command, PLA, Guangzhou, China
| | - Li Zhou
- Branch of National Clinical Research Center for Geriatric Diseases, Chinese PLA General Hospital, Guangzhou, China.,Two Departments of Cadre Ward, General Hospital of Southern Theater Command, PLA, Guangzhou, China
| | - Yi Chen
- One Departments of Cadre Ward, General Hospital of Southern Theater Command, PLA, Guangzhou, China.,Branch of National Clinical Research Center for Geriatric Diseases, Chinese PLA General Hospital, Guangzhou, China
| | - Fang Li
- Branch of National Clinical Research Center for Geriatric Diseases, Chinese PLA General Hospital, Guangzhou, China.,Four Departments of Cadre Ward, General Hospital of Southern Theater Command, PLA, Guangzhou, China
| | - Hongjin Qian
- One Departments of Cadre Ward, General Hospital of Southern Theater Command, PLA, Guangzhou, China.,Branch of National Clinical Research Center for Geriatric Diseases, Chinese PLA General Hospital, Guangzhou, China
| |
Collapse
|
46
|
Ljubic B, Roychoudhury S, Cao XH, Pavlovski M, Obradovic S, Nair R, Glass L, Obradovic Z. Influence of medical domain knowledge on deep learning for Alzheimer's disease prediction. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 197:105765. [PMID: 33011665 PMCID: PMC7502243 DOI: 10.1016/j.cmpb.2020.105765] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 09/16/2020] [Indexed: 05/03/2023]
Abstract
BACKGROUND AND OBJECTIVE Alzheimer's disease (AD) is the most common type of dementia that can seriously affect a person's ability to perform daily activities. Estimates indicate that AD may rank third as a cause of death for older people, after heart disease and cancer. Identification of individuals at risk for developing AD is imperative for testing therapeutic interventions. The objective of the study was to determine could diagnostics of AD from EMR data alone (without relying on diagnostic imaging) be significantly improved by applying clinical domain knowledge in data preprocessing and positive dataset selection rather than setting naïve filters. METHODS Data were extracted from the repository of heterogeneous ambulatory EMR data, collected from primary care medical offices all over the U.S. Medical domain knowledge was applied to build a positive dataset from data relevant to AD. Selected Clinically Relevant Positive (SCRP) datasets were used as inputs to a Long-Short-Term Memory (LSTM) Recurrent Neural Network (RNN) deep learning model to predict will the patient develop AD. RESULTS Risk scores prediction of AD using the drugs domain information in an SCRP AD dataset of 2,324 patients achieved high out-of-sample score - 0.98-0.99 Area Under the Precision-Recall Curve (AUPRC) when using 90% of SCRP dataset for training. AUPRC dropped to 0.89 when training the model using less than 1,500 cases from the SCRP dataset. The model was still significantly better than when using naïve dataset selection. CONCLUSION The LSTM RNN method that used data relevant to AD performed significantly better when learning from the SCRP dataset than when datasets were selected naïvely. The integration of qualitative medical knowledge for dataset selection and deep learning technology provided a mechanism for significant improvement of AD prediction. Accurate and early prediction of AD is significant in the identification of patients for clinical trials, which can possibly result in the discovery of new drugs for treatments of AD. Also, the contribution of the proposed predictions of AD is a better selection of patients who need imaging diagnostics for differential diagnosis of AD from other degenerative brain disorders.
Collapse
Affiliation(s)
- Branimir Ljubic
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Shoumik Roychoudhury
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Xi Hang Cao
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Martin Pavlovski
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA
| | - Stefan Obradovic
- Department of Computer Science, Brendan Iribe Center for Computer Science and Engineering, University of Maryland, 8125 Paint Branch Drive, College Park, MD 20742, USA
| | | | | | - Zoran Obradovic
- Center for Data Analytics and Biomedical Informatics (DABI), Temple University, 1925 N 12th Street, SERC 035-02, Philadelphia, PA 19122, USA.
| |
Collapse
|
47
|
Multivariate analysis of dual-point amyloid PET intended to assist the diagnosis of Alzheimer’s disease. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.06.081] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
48
|
Ramírez J, Górriz JM, Ortiz A, Cole JH, Dyrba M. Editorial: Deep Learning in Aging Neuroscience. Front Neuroinform 2020; 14:573974. [PMID: 33209104 PMCID: PMC7649163 DOI: 10.3389/fninf.2020.573974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Accepted: 09/16/2020] [Indexed: 11/30/2022] Open
Affiliation(s)
- Javier Ramírez
- Department Signal Theory, Networking and Communications, University of Granada, Granada, Spain
| | - Juan M Górriz
- Department Signal Theory, Networking and Communications, University of Granada, Granada, Spain
| | - Andrés Ortiz
- Department of Communications Engineering, University of Málaga, Málaga, Spain
| | - James H Cole
- Department of Computer Science, Centre for Medical Image Computing, University College London, London, United Kingdom.,Dementia Research Centre, Institute of Neurology, University College London, London, United Kingdom
| | - Martin Dyrba
- German Center for Neurodegenerative Diseases (DZNE), Rostock, Germany
| |
Collapse
|
49
|
Segato A, Marzullo A, Calimeri F, De Momi E. Artificial intelligence for brain diseases: A systematic review. APL Bioeng 2020; 4:041503. [PMID: 33094213 PMCID: PMC7556883 DOI: 10.1063/5.0011697] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Accepted: 09/09/2020] [Indexed: 12/15/2022] Open
Abstract
Artificial intelligence (AI) is a major branch of computer science that is fruitfully used for analyzing complex medical data and extracting meaningful relationships in datasets, for several clinical aims. Specifically, in the brain care domain, several innovative approaches have achieved remarkable results and open new perspectives in terms of diagnosis, planning, and outcome prediction. In this work, we present an overview of different artificial intelligent techniques used in the brain care domain, along with a review of important clinical applications. A systematic and careful literature search in major databases such as Pubmed, Scopus, and Web of Science was carried out using "artificial intelligence" and "brain" as main keywords. Further references were integrated by cross-referencing from key articles. 155 studies out of 2696 were identified, which actually made use of AI algorithms for different purposes (diagnosis, surgical treatment, intra-operative assistance, and postoperative assessment). Artificial neural networks have risen to prominent positions among the most widely used analytical tools. Classic machine learning approaches such as support vector machine and random forest are still widely used. Task-specific algorithms are designed for solving specific problems. Brain images are one of the most used data types. AI has the possibility to improve clinicians' decision-making ability in neuroscience applications. However, major issues still need to be addressed for a better practical use of AI in the brain. To this aim, it is important to both gather comprehensive data and build explainable AI algorithms.
Collapse
Affiliation(s)
- Alice Segato
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan 20133, Italy
| | - Aldo Marzullo
- Department of Mathematics and Computer Science, University of Calabria, Rende 87036, Italy
| | - Francesco Calimeri
- Department of Mathematics and Computer Science, University of Calabria, Rende 87036, Italy
| | - Elena De Momi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan 20133, Italy
| |
Collapse
|
50
|
Zhang L, Wang M, Liu M, Zhang D. A Survey on Deep Learning for Neuroimaging-Based Brain Disorder Analysis. Front Neurosci 2020; 14:779. [PMID: 33117114 PMCID: PMC7578242 DOI: 10.3389/fnins.2020.00779] [Citation(s) in RCA: 56] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2020] [Accepted: 06/02/2020] [Indexed: 12/12/2022] Open
Abstract
Deep learning has recently been used for the analysis of neuroimages, such as structural magnetic resonance imaging (MRI), functional MRI, and positron emission tomography (PET), and it has achieved significant performance improvements over traditional machine learning in computer-aided diagnosis of brain disorders. This paper reviews the applications of deep learning methods for neuroimaging-based brain disorder analysis. We first provide a comprehensive overview of deep learning techniques and popular network architectures by introducing various types of deep neural networks and recent developments. We then review deep learning methods for computer-aided analysis of four typical brain disorders, including Alzheimer's disease, Parkinson's disease, Autism spectrum disorder, and Schizophrenia, where the first two diseases are neurodegenerative disorders and the last two are neurodevelopmental and psychiatric disorders, respectively. More importantly, we discuss the limitations of existing studies and present possible future directions.
Collapse
Affiliation(s)
- Li Zhang
- College of Computer Science and Technology, Nanjing Forestry University, Nanjing, China
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Mingliang Wang
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Mingxia Liu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Daoqiang Zhang
- College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| |
Collapse
|