1
|
Qiu Z, Yang P, Xiao C, Wang S, Xiao X, Qin J, Liu CM, Wang T, Lei B. 3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer's Disease Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:3161-3175. [PMID: 38607706 DOI: 10.1109/tmi.2024.3386937] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/14/2024]
Abstract
Multimodal neuroimaging provides complementary information critical for accurate early diagnosis of Alzheimer's disease (AD). However, the inherent variability between multimodal neuroimages hinders the effective fusion of multimodal features. Moreover, achieving reliable and interpretable diagnoses in the field of multimodal fusion remains challenging. To address them, we propose a novel multimodal diagnosis network based on multi-fusion and disease-induced learning (MDL-Net) to enhance early AD diagnosis by efficiently fusing multimodal data. Specifically, MDL-Net proposes a multi-fusion joint learning (MJL) module, which effectively fuses multimodal features and enhances the feature representation from global, local, and latent learning perspectives. MJL consists of three modules, global-aware learning (GAL), local-aware learning (LAL), and outer latent-space learning (LSL) modules. GAL via a self-adaptive Transformer (SAT) learns the global relationships among the modalities. LAL constructs local-aware convolution to learn the local associations. LSL module introduces latent information through outer product operation to further enhance feature representation. MDL-Net integrates the disease-induced region-aware learning (DRL) module via gradient weight to enhance interpretability, which iteratively learns weight matrices to identify AD-related brain regions. We conduct the extensive experiments on public datasets and the results confirm the superiority of our proposed method. Our code will be available at: https://github.com/qzf0320/MDL-Net.
Collapse
|
2
|
Song Z, Li H, Zhang Y, Zhu C, Jiang M, Song L, Wang Y, Ouyang M, Hu F, Zheng Q. s 2MRI-ADNet: an interpretable deep learning framework integrating Euclidean-graph representations of Alzheimer's disease solely from structural MRI. MAGMA (NEW YORK, N.Y.) 2024:10.1007/s10334-024-01178-3. [PMID: 38869733 DOI: 10.1007/s10334-024-01178-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 05/19/2024] [Accepted: 06/04/2024] [Indexed: 06/14/2024]
Abstract
OBJECTIVE To establish a multi-dimensional representation solely on structural MRI (sMRI) for early diagnosis of AD. METHODS A total of 3377 participants' sMRI from four independent databases were retrospectively identified to construct an interpretable deep learning model that integrated multi-dimensional representations of AD solely on sMRI (called s2MRI-ADNet) by a dual-channel learning strategy of gray matter volume (GMV) from Euclidean space and the regional radiomics similarity network (R2SN) from graph space. Specifically, the GMV feature map learning channel (called GMV-Channel) was to take into consideration spatial information of both long-range spatial relations and detailed localization information, while the node feature and connectivity strength learning channel (called NFCS-Channel) was to characterize the graph-structured R2SN network by a separable learning strategy. RESULTS The s2MRI-ADNet achieved a superior classification accuracy of 92.1% and 91.4% under intra-database and inter-database cross-validation. The GMV-Channel and NFCS-Channel captured complementary group-discriminative brain regions, revealing a complementary interpretation of the multi-dimensional representation of brain structure in Euclidean and graph spaces respectively. Besides, the generalizable and reproducible interpretation of the multi-dimensional representation in capturing complementary group-discriminative brain regions revealed a significant correlation between the four independent databases (p < 0.05). Significant associations (p < 0.05) between attention scores and brain abnormality, between classification scores and clinical measure of cognitive ability, CSF biomarker, metabolism, and genetic risk score also provided solid neurobiological interpretation. CONCLUSION The s2MRI-ADNet solely on sMRI could leverage the complementary multi-dimensional representations of AD in Euclidean and graph spaces, and achieved superior performance in the early diagnosis of AD, facilitating its potential in both clinical translation and popularization.
Collapse
Affiliation(s)
- Zhiwei Song
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Honglun Li
- Department of Radiology, Yantai Yuhuangding Hospital Affiliated with Qingdao University Medical College, Yantai, 264099, China
| | - Yiyu Zhang
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Chuanzhen Zhu
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Minbo Jiang
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Limei Song
- School of Medical Imaging, Weifang Medical University, Weifang, 261000, China
| | - Yi Wang
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
- Key Laboratory of Medical Imaging and Artificial Intelligence of Hunan Province, Xiangnan University, Chenzhou, 423000, Hunan, China
| | - Minhui Ouyang
- Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Fang Hu
- Key Laboratory of Medical Imaging and Artificial Intelligence of Hunan Province, Xiangnan University, Chenzhou, 423000, Hunan, China
| | - Qiang Zheng
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China.
| |
Collapse
|
3
|
Kuai H, Chen J, Tao X, Cai L, Imamura K, Matsumoto H, Liang P, Zhong N. Never-Ending Learning for Explainable Brain Computing. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2307647. [PMID: 38602432 PMCID: PMC11200082 DOI: 10.1002/advs.202307647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 03/24/2024] [Indexed: 04/12/2024]
Abstract
Exploring the nature of human intelligence and behavior is a longstanding pursuit in cognitive neuroscience, driven by the accumulation of knowledge, information, and data across various studies. However, achieving a unified and transparent interpretation of findings presents formidable challenges. In response, an explainable brain computing framework is proposed that employs the never-ending learning paradigm, integrating evidence combination and fusion computing within a Knowledge-Information-Data (KID) architecture. The framework supports continuous brain cognition investigation, utilizing joint knowledge-driven forward inference and data-driven reverse inference, bolstered by the pre-trained language modeling techniques and the human-in-the-loop mechanisms. In particular, it incorporates internal evidence learning through multi-task functional neuroimaging analyses and external evidence learning via topic modeling of published neuroimaging studies, all of which involve human interactions at different stages. Based on two case studies, the intricate uncertainty surrounding brain localization in human reasoning is revealed. The present study also highlights the potential of systematization to advance explainable brain computing, offering a finer-grained understanding of brain activity patterns related to human intelligence.
Collapse
Affiliation(s)
- Hongzhi Kuai
- Faculty of EngineeringMaebashi Institute of TechnologyGunma371–0816Japan
- School of Psychology and Beijing Key Laboratory of Learning and CognitionCapital Normal UniversityBeijing100048China
| | - Jianhui Chen
- Faculty of Information TechnologyBeijing University of TechnologyBeijing100124China
- Beijing International Collaboration Base on Brain Informatics and Wisdom ServicesBeijing100124China
| | - Xiaohui Tao
- School of Mathematics, Physics and ComputingUniversity of Southern QueenslandToowoomba4350Australia
| | - Lingyun Cai
- School of Psychology and Beijing Key Laboratory of Learning and CognitionCapital Normal UniversityBeijing100048China
| | - Kazuyuki Imamura
- Faculty of EngineeringMaebashi Institute of TechnologyGunma371–0816Japan
| | - Hiroki Matsumoto
- Faculty of EngineeringMaebashi Institute of TechnologyGunma371–0816Japan
| | - Peipeng Liang
- School of Psychology and Beijing Key Laboratory of Learning and CognitionCapital Normal UniversityBeijing100048China
| | - Ning Zhong
- Faculty of EngineeringMaebashi Institute of TechnologyGunma371–0816Japan
- School of Psychology and Beijing Key Laboratory of Learning and CognitionCapital Normal UniversityBeijing100048China
- Beijing International Collaboration Base on Brain Informatics and Wisdom ServicesBeijing100124China
| |
Collapse
|
4
|
Odusami M, Maskeliūnas R, Damaševičius R, Misra S. Machine learning with multimodal neuroimaging data to classify stages of Alzheimer's disease: a systematic review and meta-analysis. Cogn Neurodyn 2024; 18:775-794. [PMID: 38826669 PMCID: PMC11143094 DOI: 10.1007/s11571-023-09993-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 06/23/2023] [Accepted: 07/17/2023] [Indexed: 06/04/2024] Open
Abstract
In recent years, Alzheimer's disease (AD) has been a serious threat to human health. Researchers and clinicians alike encounter a significant obstacle when trying to accurately identify and classify AD stages. Several studies have shown that multimodal neuroimaging input can assist in providing valuable insights into the structural and functional changes in the brain related to AD. Machine learning (ML) algorithms can accurately categorize AD phases by identifying patterns and linkages in multimodal neuroimaging data using powerful computational methods. This study aims to assess the contribution of ML methods to the accurate classification of the stages of AD using multimodal neuroimaging data. A systematic search is carried out in IEEE Xplore, Science Direct/Elsevier, ACM DigitalLibrary, and PubMed databases with forward snowballing performed on Google Scholar. The quantitative analysis used 47 studies. The explainable analysis was performed on the classification algorithm and fusion methods used in the selected studies. The pooled sensitivity and specificity, including diagnostic efficiency, were evaluated by conducting a meta-analysis based on a bivariate model with the hierarchical summary receiver operating characteristics (ROC) curve of multimodal neuroimaging data and ML methods in the classification of AD stages. Wilcoxon signed-rank test is further used to statistically compare the accuracy scores of the existing models. With a 95% confidence interval of 78.87-87.71%, the combined sensitivity for separating participants with mild cognitive impairment (MCI) from healthy control (NC) participants was 83.77%; for separating participants with AD from NC, it was 94.60% (90.76%, 96.89%); for separating participants with progressive MCI (pMCI) from stable MCI (sMCI), it was 80.41% (74.73%, 85.06%). With a 95% confidence interval (78.87%, 87.71%), the Pooled sensitivity for distinguishing mild cognitive impairment (MCI) from healthy control (NC) participants was 83.77%, with a 95% confidence interval (90.76%, 96.89%), the Pooled sensitivity for distinguishing AD from NC was 94.60%, likewise (MCI) from healthy control (NC) participants was 83.77% progressive MCI (pMCI) from stable MCI (sMCI) was 80.41% (74.73%, 85.06%), and early MCI (EMCI) from NC was 86.63% (82.43%, 89.95%). Pooled specificity for differentiating MCI from NC was 79.16% (70.97%, 87.71%), AD from NC was 93.49% (91.60%, 94.90%), pMCI from sMCI was 81.44% (76.32%, 85.66%), and EMCI from NC was 85.68% (81.62%, 88.96%). The Wilcoxon signed rank test showed a low P-value across all the classification tasks. Multimodal neuroimaging data with ML is a promising future in classifying the stages of AD but more research is required to increase the validity of its application in clinical practice.
Collapse
Affiliation(s)
- Modupe Odusami
- Department of Multimedia Engineering, Kaunas University of Technology, Kaunas, Lithuania
| | - Rytis Maskeliūnas
- Department of Multimedia Engineering, Kaunas University of Technology, Kaunas, Lithuania
| | | | - Sanjay Misra
- Department of Applied Data Science, Institute for Energy Technology, Halden, Norway
| |
Collapse
|
5
|
Li Y, Zhang L, Yu H, Wang J, Wang S, Liu J, Zheng Q. A comprehensive segmentation of chest X-ray improves deep learning-based WHO radiologically confirmed pneumonia diagnosis in children. Eur Radiol 2024; 34:3471-3482. [PMID: 37930411 DOI: 10.1007/s00330-023-10367-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 08/29/2023] [Accepted: 08/31/2023] [Indexed: 11/07/2023]
Abstract
OBJECTIVES To investigate a comprehensive segmentation of chest X-ray (CXR) in promoting deep learning-based World Health Organization's (WHO) radiologically confirmed pneumonia diagnosis in children. METHODS A total of 4400 participants between January 2016 and June 2021were identified for a cross-sectional study and divided into primary endpoint pneumonia (PEP), other infiltrates, and normal groups according to WHO's diagnostic criteria. The CXR was divided into six segments of left lung, right lung, mediastinum, diaphragm, ext-left lung, and ext-right lung by adopting the RA-UNet. To demonstrate the benefits of lung field segmentation in pneumonia diagnosis, the segmented images and images that were not segmented, which constituted seven segmentation combinations, were fed into the CBAM-ResNet under a three-category classification comparison. The interpretability of the CBAM-ResNet for pneumonia diagnosis was also performed by adopting a Grad-CAM module. RESULTS The RA-UNet achieved a high spatial overlap between manual and automatic segmentation (averaged DSC = 0.9639). The CBAM-ResNet when fed with the six segments achieved superior three-category diagnosis performance (accuracy = 0.8243) over other segmentation combinations and deep learning models under comparison, which was increased by around 6% in accuracy, precision, specificity, sensitivity, F1-score, and around 3% in AUC. The Grad-CAM could capture the pneumonia lesions more accurately, generating a more interpretable visualization and enhancing the superiority and reliability of our study in assisting pediatric pneumonia diagnosis. CONCLUSIONS The comprehensive segmentation of CXR could improve deep learning-based pneumonia diagnosis in childhood with a more reasonable WHO's radiological standardized pneumonia classification instead of conventional dichotomous bacterial pneumonia and viral pneumonia. CLINICAL RELEVANCE STATEMENT The comprehensive segmentation of chest X-ray improves deep learning-based WHO confirmed pneumonia diagnosis in children, laying a strong foundation for the potential inclusion of computer-aided pediatric CXR readings in precise classification of pneumonia and PCV vaccine trials efficacy in children. KEY POINTS • The chest X-ray was comprehensively segmented into six anatomical structures of left lung, right lung, mediastinum, diaphragm, ext-left lung, and ext-right lung. • The comprehensive segmentation improved the three-category classification of primary endpoint pneumonia, other infiltrates, and normal with an increase by around 6% in accuracy, precision, specificity, sensitivity, F1-score, and around 3% in AUC. • The comprehensive segmentation gave rise to a more accurate and interpretable visualization results in capturing the pneumonia lesions.
Collapse
Affiliation(s)
- Yuemei Li
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Lin Zhang
- Department of Radiology, Xiamen Children's Hospital, Children's Hospital of Fudan University at Xiamen, Xiamen, Fujian, China
| | - Hu Yu
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Jian Wang
- Department of Radiology, Xiamen Children's Hospital, Children's Hospital of Fudan University at Xiamen, Xiamen, Fujian, China
| | - Shuo Wang
- Yantai University Trier College of Sustainable Technology, Yantai, 264005, Shandong Province, China
- Trier University of Applied Sciences, D-54208, Trier, Germany
| | - Jungang Liu
- Department of Radiology, Xiamen Children's Hospital, Children's Hospital of Fudan University at Xiamen, Xiamen, Fujian, China.
| | - Qiang Zheng
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China.
| |
Collapse
|
6
|
Zhang Y, Xue L, Zhang S, Yang J, Zhang Q, Wang M, Wang L, Zhang M, Jiang J, Li Y. A novel spatiotemporal graph convolutional network framework for functional connectivity biomarkers identification of Alzheimer's disease. Alzheimers Res Ther 2024; 16:60. [PMID: 38481280 PMCID: PMC10938710 DOI: 10.1186/s13195-024-01425-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 03/03/2024] [Indexed: 03/17/2024]
Abstract
BACKGROUND Functional connectivity (FC) biomarkers play a crucial role in the early diagnosis and mechanistic study of Alzheimer's disease (AD). However, the identification of effective FC biomarkers remains challenging. In this study, we introduce a novel approach, the spatiotemporal graph convolutional network (ST-GCN) combined with the gradient-based class activation mapping (Grad-CAM) model (STGC-GCAM), to effectively identify FC biomarkers for AD. METHODS This multi-center cross-racial retrospective study involved 2,272 participants, including 1,105 cognitively normal (CN) subjects, 790 mild cognitive impairment (MCI) individuals, and 377 AD patients. All participants underwent functional magnetic resonance imaging (fMRI) and T1-weighted MRI scans. In this study, firstly, we optimized the STGC-GCAM model to enhance classification accuracy. Secondly, we identified novel AD-associated biomarkers using the optimized model. Thirdly, we validated the imaging biomarkers using Kaplan-Meier analysis. Lastly, we performed correlation analysis and causal mediation analysis to confirm the physiological significance of the identified biomarkers. RESULTS The STGC-GCAM model demonstrated great classification performance (The average area under the curve (AUC) values for different categories were: CN vs MCI = 0.98, CN vs AD = 0.95, MCI vs AD = 0.96, stable MCI vs progressive MCI = 0.79). Notably, the model identified specific brain regions, including the sensorimotor network (SMN), visual network (VN), and default mode network (DMN), as key differentiators between patients and CN individuals. These brain regions exhibited significant associations with the severity of cognitive impairment (p < 0.05). Moreover, the topological features of important brain regions demonstrated excellent predictive capability for the conversion from MCI to AD (Hazard ratio = 3.885, p < 0.001). Additionally, our findings revealed that the topological features of these brain regions mediated the impact of amyloid beta (Aβ) deposition (bootstrapped average causal mediation effect: β = -0.01 [-0.025, 0.00], p < 0.001) and brain glucose metabolism (bootstrapped average causal mediation effect: β = -0.02 [-0.04, -0.001], p < 0.001) on cognitive status. CONCLUSIONS This study presents the STGC-GCAM framework, which identifies FC biomarkers using a large multi-site fMRI dataset.
Collapse
Affiliation(s)
- Ying Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China
| | - Le Xue
- Department of Nuclear Medicine, the Second Hospital of Zhejiang University School of Medicine, Hangzhou, 310009, Zhejiang, China
| | - Shuoyan Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China
| | - Jiacheng Yang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China
| | - Qi Zhang
- School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China
| | - Min Wang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China
| | - Luyao Wang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China
| | - Mingkai Zhang
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, 100053, China.
| | - Jiehui Jiang
- Institute of Biomedical Engineering, School of Life Sciences, Shanghai University, Shanghai, 200444, China.
| | - Yunxia Li
- Department of Neurology, Shanghai Pudong Hospital, Fudan University Pudong Medical Center, 2800 Gongwei Road, Shanghai, 201399, Pudong, China.
| |
Collapse
|
7
|
Fathi S, Ahmadi A, Dehnad A, Almasi-Dooghaee M, Sadegh M. A Deep Learning-Based Ensemble Method for Early Diagnosis of Alzheimer's Disease using MRI Images. Neuroinformatics 2024; 22:89-105. [PMID: 38042764 PMCID: PMC10917836 DOI: 10.1007/s12021-023-09646-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/16/2023] [Indexed: 12/04/2023]
Abstract
Recently, the early diagnosis of Alzheimer's disease has gained major attention due to the growing prevalence of the disease and the resulting costs imposed on individuals and society. The main objective of this study was to propose an ensemble method based on deep learning for the early diagnosis of AD using MRI images. The methodology of this study consisted of collecting the dataset, preprocessing, creating the individual and ensemble models, evaluating the models based on ADNI data, and validating the trained model based on the local dataset. The proposed method was an ensemble approach selected through a comparative analysis of various ensemble scenarios. Finally, the six best individual CNN-based classifiers were selected to combine and constitute the ensemble model. The evaluation showed an accuracy rate of 98.57, 96.37, 94.22, 99.83, 93.88, and 93.92 for NC/AD, NC/EMCI, EMCI/LMCI, LMCI/AD, four-way and three-way classification groups, respectively. The validation results on the local dataset revealed an accuracy of 88.46 for three-way classification. Our performance results were higher than most reviewed studies and comparable with others. Although comparative analysis showed superior results of ensemble methods against individual architectures, there were no significant differences among various ensemble approaches. The validation results revealed the low performance of individual models in practice. In contrast, the ensemble method showed promising results. However, further studies on various and larger datasets are required to validate the generalizability of the model.
Collapse
Affiliation(s)
- Sina Fathi
- Department of Health Information Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Ahmadi
- Surrey Business School, University of Surrey, Guildford Surrey, GU2 7XH, UK.
| | - Afsaneh Dehnad
- School of Health Management and Information Sciences, Iran University of Medical Sciences, Tehran, Iran
| | - Mostafa Almasi-Dooghaee
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Melika Sadegh
- Neurology Department, Firoozgar Hospital, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
8
|
Qiang YR, Zhang SW, Li JN, Li Y, Zhou QY. Diagnosis of Alzheimer's disease by joining dual attention CNN and MLP based on structural MRIs, clinical and genetic data. Artif Intell Med 2023; 145:102678. [PMID: 37925204 DOI: 10.1016/j.artmed.2023.102678] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 07/12/2023] [Accepted: 10/03/2023] [Indexed: 11/06/2023]
Abstract
Alzheimer's disease (AD) is an irreversible central nervous degenerative disease, while mild cognitive impairment (MCI) is a precursor state of AD. Accurate early diagnosis of AD is conducive to the prevention and early intervention treatment of AD. Although some computational methods have been developed for AD diagnosis, most employ only neuroimaging, ignoring other data (e.g., genetic, clinical) that may have potential disease information. In addition, the results of some methods lack interpretability. In this work, we proposed a novel method (called DANMLP) of joining dual attention convolutional neural network (CNN) and multilayer perceptron (MLP) for computer-aided AD diagnosis by integrating multi-modality data of the structural magnetic resonance imaging (sMRI), clinical data (i.e., demographics, neuropsychology), and APOE genetic data. Our DANMLP consists of four primary components: (1) the Patch-CNN for extracting the image characteristics from each local patch, (2) the position self-attention block for capturing the dependencies between features within a patch, (3) the channel self-attention block for capturing dependencies of inter-patch features, (4) two MLP networks for extracting the clinical features and outputting the AD classification results, respectively. Compared with other state-of-the-art methods in the 5CV test, DANMLP achieves 93% and 82.4% classification accuracy for the AD vs. MCI and MCI vs. NC tasks on the ADNI database, which is 0.2%∼15.2% and 3.4%∼26.8% higher than that of other five methods, respectively. The individualized visualization of focal areas can also help clinicians in the early diagnosis of AD. These results indicate that DANMLP can be effectively used for diagnosing AD and MCI patients.
Collapse
Affiliation(s)
- Yan-Rui Qiang
- Key Laboratory of Information Fusion Technology, School of Automation, Northwestern Polytechnical University, Xi'an, 710072, China
| | - Shao-Wu Zhang
- Key Laboratory of Information Fusion Technology, School of Automation, Northwestern Polytechnical University, Xi'an, 710072, China.
| | - Jia-Ni Li
- Key Laboratory of Information Fusion Technology, School of Automation, Northwestern Polytechnical University, Xi'an, 710072, China
| | - Yan Li
- Key Laboratory of Information Fusion Technology, School of Automation, Northwestern Polytechnical University, Xi'an, 710072, China
| | - Qin-Yi Zhou
- Key Laboratory of Information Fusion Technology, School of Automation, Northwestern Polytechnical University, Xi'an, 710072, China
| |
Collapse
|
9
|
Zhao K, Chen P, Alexander-Bloch A, Wei Y, Dyrba M, Yang F, Kang X, Wang D, Fan D, Ye S, Tang Y, Yao H, Zhou B, Lu J, Yu C, Wang P, Liao Z, Chen Y, Huang L, Zhang X, Han Y, Li S, Liu Y. A neuroimaging biomarker for Individual Brain-Related Abnormalities In Neurodegeneration (IBRAIN): a cross-sectional study. EClinicalMedicine 2023; 65:102276. [PMID: 37954904 PMCID: PMC10632687 DOI: 10.1016/j.eclinm.2023.102276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 09/27/2023] [Accepted: 09/29/2023] [Indexed: 11/14/2023] Open
Abstract
Background Alzheimer's disease (AD) is a prevalent neurodegenerative disorder that poses a worldwide public health challenge. A neuroimaging biomarker would significantly improve early diagnosis and intervention, ultimately enhancing the quality of life for affected individuals and reducing the burden on healthcare systems. Methods Cross-sectional and longitudinal data (10,099 participants with 13,380 scans) from 12 independent datasets were used in the present study (this study was performed between September 1, 2021 and February 15, 2023). The Individual Brain-Related Abnormalities In Neurodegeneration (IBRAIN) score was developed via integrated regional- and network-based measures under an ensemble machine learning model based on structural MRI data. We systematically assessed whether IBRAIN could be a neuroimaging biomarker for AD. Findings IBRAIN accurately differentiated individuals with AD from NCs (AUC = 0.92) and other neurodegenerative diseases, including Frontotemporal dementia (FTD), Parkinson's disease (PD), Vascular dementia (VaD) and Amyotrophic Lateral Sclerosis (ALS) (AUC = 0.92). IBRAIN was significantly correlated to clinical measures and gene expression, enriched in immune process and protein metabolism. The IBRAIN score exhibited a significant ability to reveal the distinct progression of prodromal AD (i.e., Mild cognitive impairment, MCI) (Hazard Ratio (HR) = 6.52 [95% CI: 4.42∼9.62], p < 1 × 10-16), which offers similar powerful performance with Cerebrospinal Fluid (CSF) Aβ (HR = 3.78 [95% CI: 2.63∼5.43], p = 2.13 × 10-14) and CSF Tau (HR = 3.77 [95% CI: 2.64∼5.39], p = 9.53 × 10-15) based on the COX and Log-rank test. Notably, the IBRAIN shows comparable sensitivity (beta = -0.70, p < 1 × 10-16) in capturing longitudinal changes in individuals with conversion to AD than CSF Aβ (beta = -0.26, p = 4.40 × 10-9) and CSF Tau (beta = 0.12, p = 1.02 × 10-5). Interpretation Our findings suggested that IBRAIN is a biologically relevant, specific, and sensitive neuroimaging biomarker that can serve as a clinical measure to uncover prodromal AD progression. It has strong potential for application in future clinical practice and treatment trials. Funding Science and Technology Innovation 2030 Major Projects, the National Natural Science Foundation of China, Beijing Natural Science Funds, the Fundamental Research Funds for the CentralUniversity, and the Startup Funds for Talents at Beijing Normal University.
Collapse
Affiliation(s)
- Kun Zhao
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China
| | - Pindong Chen
- School of Artificial Intelligence, University of Chinese Academy of Sciences & Brainnetome Centre, Chinese Academy of Sciences, Beijing, China
| | - Aaron Alexander-Bloch
- Department of Psychiatry, University of Pennsylvania, Philadelphia, USA
- Department of Child and Adolescent Psychiatry and Behavioral Science, Children's Hospital of Philadelphia, Philadelphia, USA
| | - Yongbin Wei
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China
| | - Martin Dyrba
- German Centre for Neurodegenerative Diseases (DZNE), Rostock, Germany
| | - Fan Yang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Beijing, China
| | - Xiaopeng Kang
- School of Artificial Intelligence, University of Chinese Academy of Sciences & Brainnetome Centre, Chinese Academy of Sciences, Beijing, China
| | - Dawei Wang
- Department of Radiology, Qilu Hospital of Shandong University, Ji'nan, China
| | - Dongsheng Fan
- Department of Neurology, Peking University Third Hospital, Beijing, China
- Key Laboratory for Neuroscience, National Health Commission/Ministry of Education, Peking University, Beijing, China
- Beijing Key Laboratory of Biomarker and Translational Research in Neurodegenerative Diseases, Beijing, China
| | - Shan Ye
- Department of Neurology, Peking University Third Hospital, Beijing, China
- Key Laboratory for Neuroscience, National Health Commission/Ministry of Education, Peking University, Beijing, China
- Beijing Key Laboratory of Biomarker and Translational Research in Neurodegenerative Diseases, Beijing, China
| | - Yi Tang
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, China
| | - Hongxiang Yao
- Department of Radiology, The Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General Hospital, Beijing, China
| | - Bo Zhou
- Department of Neurology, The Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General Hospital, Beijing, China
| | - Jie Lu
- Department of Radiology, Xuanwu Hospital of Capital Medical University, Beijing, China
| | - Chunshui Yu
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, China
| | - Pan Wang
- Department of Neurology, Tianjin Huanhu Hospital, Tianjin, China
| | - Zhengluan Liao
- Department of Psychiatry, People's Hospital of Hangzhou Medical College, Zhejiang Provincial People's Hospital, Hangzhou, China
| | - Yan Chen
- Department of Psychiatry, People's Hospital of Hangzhou Medical College, Zhejiang Provincial People's Hospital, Hangzhou, China
| | - Longjian Huang
- Affiliated Hospital of Youjiang Medical University for Nationalities, Baise, China
| | - Xi Zhang
- Department of Neurology, The Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General Hospital, Beijing, China
| | - Ying Han
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, China
- National Clinical Research Centre for Geriatric Disorders, Beijing, China
- Centre of Alzheimer's Disease, Beijing Institute for Brain Disorders, Beijing, China
| | - Shuyu Li
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Yong Liu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences & Brainnetome Centre, Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
10
|
Zhang Y, Li X, Ji Y, Ding H, Suo X, He X, Xie Y, Liang M, Zhang S, Yu C, Qin W. MRAβ: A multimodal MRI-derived amyloid-β biomarker for Alzheimer's disease. Hum Brain Mapp 2023; 44:5139-5152. [PMID: 37578386 PMCID: PMC10502620 DOI: 10.1002/hbm.26452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Revised: 04/30/2023] [Accepted: 08/01/2023] [Indexed: 08/15/2023] Open
Abstract
Florbetapir 18 F (AV45), a highly sensitive and specific positron emission tomographic (PET) molecular biomarker binding to the amyloid-β of Alzheimer's disease (AD), is constrained by radiation and cost. We sought to combat it by combining multimodal magnetic resonance imaging (MRI) images and a collaborative generative adversarial networks model (CollaGAN) to develop a multimodal MRI-derived Amyloid-β (MRAβ) biomarker. We collected multimodal MRI and PET AV45 data of 380 qualified participants from the ADNI dataset and 64 subjects from OASIS3 dataset. A five-fold cross-validation CollaGAN were applied to generate MRAβ. In the ADNI dataset, we found MRAβ could characterize the subject-level AV45 spatial variations in both AD and mild cognitive impairment (MCI). Voxel-wise two-sample t-tests demonstrated amyloid-β depositions identified by MRAβ in AD and MCI were significantly higher than healthy controls (HCs) in widespread cortices (p < .05, corrected) and were much similar to those by AV45 (r > .92, p < .001). Moreover, a 3D ResNet classifier demonstrated that MRAβ was comparable to AV45 in discriminating AD from HC in both the ADNI and OASIS3 datasets, and in discriminate MCI from HC in ADNI. Finally, we found MRAβ could mimic cortical hyper-AV45 in HCs who later converted to MCI (r = .79, p < .001) and was comparable to AV45 in discriminating them from stable HC (p > .05). In summary, our work illustrates that MRAβ synthesized by multimodal MRI could mimic the cerebral amyloid-β depositions like AV45 and lends credence to the feasibility of advancing MRI toward molecular-explainable biomarkers.
Collapse
Affiliation(s)
- Yu Zhang
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
| | - Xi Li
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
- Department of RadiologyFirst Clinical Medical College and First Hospital of Shanxi Medical UniversityTaiyuanShanxi ProvinceChina
| | - Yi Ji
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
| | - Hao Ding
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
- School of Medical ImagingTianjin Medical UniversityTianjinChina
| | - Xinjun Suo
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
| | - Xiaoxi He
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
| | - Yingying Xie
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
| | - Meng Liang
- School of Medical ImagingTianjin Medical UniversityTianjinChina
| | - Shijie Zhang
- Department of PharmacologyTianjin Medical UniversityTianjinChina
| | - Chunshui Yu
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
- School of Medical ImagingTianjin Medical UniversityTianjinChina
| | - Wen Qin
- Department of Radiology and Tianjin Key Lab of Functional ImagingTianjin Medical University General HospitalTianjinChina
| |
Collapse
|
11
|
Qu Y, Wang P, Yao H, Wang D, Song C, Yang H, Zhang Z, Chen P, Kang X, Du K, Fan L, Zhou B, Han T, Yu C, Zhang X, Zuo N, Jiang T, Zhou Y, Liu B, Han Y, Lu J, Liu Y. Reproducible Abnormalities and Diagnostic Generalizability of White Matter in Alzheimer's Disease. Neurosci Bull 2023; 39:1533-1543. [PMID: 37014553 PMCID: PMC10533766 DOI: 10.1007/s12264-023-01041-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 11/29/2022] [Indexed: 04/05/2023] Open
Abstract
Alzheimer's disease (AD) is associated with the impairment of white matter (WM) tracts. The current study aimed to verify the utility of WM as the neuroimaging marker of AD with multisite diffusion tensor imaging datasets [321 patients with AD, 265 patients with mild cognitive impairment (MCI), 279 normal controls (NC)], a unified pipeline, and independent site cross-validation. Automated fiber quantification was used to extract diffusion profiles along tracts. Random-effects meta-analyses showed a reproducible degeneration pattern in which fractional anisotropy significantly decreased in the AD and MCI groups compared with NC. Machine learning models using tract-based features showed good generalizability among independent site cross-validation. The diffusion metrics of the altered regions and the AD probability predicted by the models were highly correlated with cognitive ability in the AD and MCI groups. We highlighted the reproducibility and generalizability of the degeneration pattern of WM tracts in AD.
Collapse
Affiliation(s)
- Yida Qu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Pan Wang
- Department of Neurology, Tianjin Huanhu Hospital, Tianjin University, Tianjin, 300222, China
| | - Hongxiang Yao
- Department of Neurology, Tianjin Huanhu Hospital, Tianjin University, Tianjin, 300222, China
| | - Dawei Wang
- Department of Radiology, Department of Epidemiology and Health Statistics, School of Public Health, Qilu Hospital of Shandong University, Ji'nan, 250063, China
| | - Chengyuan Song
- Department of Neurology, Qilu Hospital of Shandong University, Ji'nan, 250063, China
| | - Hongwei Yang
- Department of Radiology, Xuanwu Hospital of Capital Medical University, Beijing, 100053, China
| | - Zengqiang Zhang
- Branch of Chinese, PLA General Hospital, Sanya, 572022, China
| | - Pindong Chen
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Xiaopeng Kang
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Kai Du
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Lingzhong Fan
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Bo Zhou
- Department of Neurology, The Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General Hospital, Beijing, 100089, China
| | - Tong Han
- Department of Radiology, Tianjin Huanhu Hospital, Tianjin, 300222, China
| | - Chunshui Yu
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, China
| | - Xi Zhang
- Department of Neurology, The Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General Hospital, Beijing, 100089, China
| | - Nianming Zuo
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Tianzi Jiang
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Yuying Zhou
- Department of Neurology, Tianjin Huanhu Hospital, Tianjin University, Tianjin, 300222, China
| | - Bing Liu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China
- State Key Lab of Cognition Neuroscience & Learning, Beijing Normal University, Beijing, 100091, China
| | - Ying Han
- Department of Neurology, Xuanwu Hospital of Capital Medical University, Beijing, 100053, China
- Beijing Institute of Geriatrics, Beijing, 100053, China
- National Clinical Research Center for Geriatric Disorders, Beijing, 100053, China
- Center of Alzheimer's Disease, Beijing Institute for Brain Disorders, Beijing, 100053, China
| | - Jie Lu
- Department of Radiology, Xuanwu Hospital of Capital Medical University, Beijing, 100053, China.
| | - Yong Liu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| |
Collapse
|
12
|
Zhang Y, Li H, Zheng Q. A comprehensive characterization of hippocampal feature ensemble serves as individualized brain signature for Alzheimer's disease: deep learning analysis in 3238 participants worldwide. Eur Radiol 2023; 33:5385-5397. [PMID: 36892643 DOI: 10.1007/s00330-023-09519-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 12/19/2022] [Accepted: 02/02/2023] [Indexed: 03/10/2023]
Abstract
OBJECTIVES Hippocampal characterization is one of the most significant hallmarks of Alzheimer's disease (AD); rather, the single-level feature is insufficient. A comprehensive hippocampal characterization is pivotal for developing a well-performing biomarker for AD. To verify whether a comprehensive characterization of hippocampal features of gray matter volume, segmentation probability, and radiomics features could better distinguish AD from normal control (NC), and to investigate whether the classification decision score could serve as a robust and individualized brain signature. METHODS A total of 3238 participants' structural MRI from four independent databases were employed to conduct a 3D residual attention network (3DRA-Net) to classify NC, mild cognitive impairment (MCI), and AD. The generalization was validated under inter-database cross-validation. The neurobiological basis of the classification decision score as a neuroimaging biomarker was systematically investigated by association with clinical profiles, as well as longitudinal trajectory analysis to reveal AD progression. All image analyses were performed only upon the single modality of T1-weighted MRI. RESULTS Our study exhibited an outstanding performance (ACC = 91.6%, AUC = 0.95) of the comprehensive characterization of hippocampal features in distinguishing AD (n = 282) from NC (n = 603) in Alzheimer's Disease Neuroimaging Initiative cohort, and ACC = 89.2% and AUC = 0.93 under external validation. More importantly, the constructed score was significantly correlated with clinical profiles (p < 0.05), and dynamically altered over the AD longitudinal progression, provided compelling evidence of a solid neurobiological basis. CONCLUSIONS This systemic study highlights the potential of the comprehensive characterization of hippocampal features to provide an individualized, generalizable, and biologically plausible neuroimaging biomarker for early detection of AD. KEY POINTS • The comprehensive characterization of hippocampal features exhibited ACC = 91.6% (AUC = 0.95) in classifying AD from NC under intra-database cross-validation, and ACC = 89.2% (AUC = 0.93) in external validation. • The constructed classification score was significantly associated with clinical profiles, and dynamically altered over the AD longitudinal progression, which highlighted its potential of being an individualized, generalizable, and biologically plausible neuroimaging biomarker for early detection of AD.
Collapse
Affiliation(s)
- Yiyu Zhang
- School of Computer and Control Engineering, Yantai University, No. 30, Qingquan Road, Laishan District, Yantai City, 264005, Shandong Province, China
| | - Hongming Li
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Qiang Zheng
- School of Computer and Control Engineering, Yantai University, No. 30, Qingquan Road, Laishan District, Yantai City, 264005, Shandong Province, China.
| |
Collapse
|
13
|
Park C, Jung W, Suk HI. Deep joint learning of pathological region localization and Alzheimer's disease diagnosis. Sci Rep 2023; 13:11664. [PMID: 37468538 DOI: 10.1038/s41598-023-38240-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 07/05/2023] [Indexed: 07/21/2023] Open
Abstract
The identification of Alzheimer's disease (AD) using structural magnetic resonance imaging (sMRI) has been studied based on the subtle morphological changes in the brain. One of the typical approaches is a deep learning-based patch-level feature representation. For this approach, however, the predetermined patches before learning the diagnostic model can limit classification performance. To mitigate this problem, we propose the BrainBagNet with a position-based gate (PG), which applies position information of brain images represented through the 3D coordinates. Our proposed method represents the patch-level class evidence based on both MR scan and position information for image-level prediction. To validate the effectiveness of our proposed framework, we conducted comprehensive experiments comparing it with state-of-the-art methods, utilizing two publicly available datasets: the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the Australian Imaging, Biomarkers and Lifestyle (AIBL) dataset. Furthermore, our experimental results demonstrate that our proposed method outperforms the existing competing methods in terms of classification performance for both AD diagnosis and mild cognitive impairment conversion prediction tasks. In addition, we performed various analyses of the results from diverse perspectives to obtain further insights into the underlying mechanisms and strengths of our proposed framework. Based on the results of our experiments, we demonstrate that our proposed framework has the potential to advance deep-learning-based patch-level feature representation studies for AD diagnosis and MCI conversion prediction. In addition, our method provides valuable insights, such as interpretability, and the ability to capture subtle changes, into the underlying pathological processes of AD and MCI, benefiting both researchers and clinicians.
Collapse
Affiliation(s)
- Changhyun Park
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Republic of Korea
| | - Wonsik Jung
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Republic of Korea
| | - Heung-Il Suk
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Republic of Korea.
- Department of Artificial Intelligence, Korea University, Seoul, 02841, Republic of Korea.
| |
Collapse
|
14
|
Jing R, Chen P, Wei Y, Si J, Zhou Y, Wang D, Song C, Yang H, Zhang Z, Yao H, Kang X, Fan L, Han T, Qin W, Zhou B, Jiang T, Lu J, Han Y, Zhang X, Liu B, Yu C, Wang P, Liu Y. Altered large-scale dynamic connectivity patterns in Alzheimer's disease and mild cognitive impairment patients: A machine learning study. Hum Brain Mapp 2023; 44:3467-3480. [PMID: 36988434 PMCID: PMC10203807 DOI: 10.1002/hbm.26291] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2022] [Revised: 02/27/2023] [Accepted: 03/15/2023] [Indexed: 03/30/2023] Open
Abstract
Alzheimer's disease (AD) is a common neurodegeneration disease associated with substantial disruptions in the brain network. However, most studies investigated static resting-state functional connections, while the alteration of dynamic functional connectivity in AD remains largely unknown. This study used group independent component analysis and the sliding-window method to estimate the subject-specific dynamic connectivity states in 1704 individuals from three data sets. Informative inherent states were identified by the multivariate pattern classification method, and classifiers were built to distinguish ADs from normal controls (NCs) and to classify mild cognitive impairment (MCI) patients with informative inherent states similar to ADs or not. In addition, MCI subgroups with heterogeneous functional states were examined in the context of different cognition decline trajectories. Five informative states were identified by feature selection, mainly involving functional connectivity belonging to the default mode network and working memory network. The classifiers discriminating AD and NC achieved the mean area under the receiver operating characteristic curve of 0.87 with leave-one-site-out cross-validation. Alterations in connectivity strength, fluctuation, and inter-synchronization were found in AD and MCIs. Moreover, individuals with MCI were clustered into two subgroups, which had different degrees of atrophy and different trajectories of cognition decline progression. The present study uncovered the alteration of dynamic functional connectivity in AD and highlighted that the dynamic states could be powerful features to discriminate patients from NCs. Furthermore, it demonstrated that these states help to identify MCIs with faster cognition decline and might contribute to the early prevention of AD.
Collapse
Affiliation(s)
- Rixing Jing
- School of Instrument Science and Opto‐Electronics EngineeringBeijing Information Science and Technology UniversityBeijingChina
| | - Pindong Chen
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of Automation, Chinese Academy of SciencesBeijingChina
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesBeijingChina
| | - Yongbin Wei
- School of Artificial IntelligenceBeijing University of Posts and TelecommunicationsBeijingChina
| | - Juanning Si
- School of Instrument Science and Opto‐Electronics EngineeringBeijing Information Science and Technology UniversityBeijingChina
| | - Yuying Zhou
- Department of NeurologyTianjin Huanhu Hospital, Tianjin UniversityTianjinChina
| | - Dawei Wang
- Department of RadiologyQilu Hospital of Shandong UniversityJi'nanChina
| | - Chengyuan Song
- Department of NeurologyQilu Hospital of Shandong UniversityJi'nanChina
| | - Hongwei Yang
- Department of RadiologyXuanwu Hospital of Capital Medical UniversityBeijingChina
| | | | - Hongxiang Yao
- Department of Radiology, the Second Medical CentreNational Clinical Research Centre for Geriatric Diseases, Chinese PLA General HospitalBeijingChina
| | - Xiaopeng Kang
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of Automation, Chinese Academy of SciencesBeijingChina
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesBeijingChina
| | - Lingzhong Fan
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of Automation, Chinese Academy of SciencesBeijingChina
| | - Tong Han
- Department of RadiologyTianjin Huanhu HospitalTianjinChina
| | - Wen Qin
- Department of RadiologyTianjin Medical University General HospitalTianjinChina
| | - Bo Zhou
- Department of Neurologythe Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General HospitalBeijingChina
| | - Tianzi Jiang
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of Automation, Chinese Academy of SciencesBeijingChina
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesBeijingChina
| | - Jie Lu
- Department of RadiologyXuanwu Hospital of Capital Medical UniversityBeijingChina
| | - Ying Han
- Department of NeurologyXuanwu Hospital of Capital Medical UniversityBeijingChina
- Beijing Institute of GeriatricsBeijingChina
- National Clinical Research Center for Geriatric DisordersBeijingChina
| | - Xi Zhang
- Department of Neurologythe Second Medical Centre, National Clinical Research Centre for Geriatric Diseases, Chinese PLA General HospitalBeijingChina
| | - Bing Liu
- State Key Laboratory of Cognition Neuroscience & LearningBeijing Normal UniversityBeijingChina
| | - Chunshui Yu
- Department of RadiologyTianjin Medical University General HospitalTianjinChina
| | - Pan Wang
- Department of NeurologyTianjin Huanhu Hospital, Tianjin UniversityTianjinChina
| | - Yong Liu
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of Automation, Chinese Academy of SciencesBeijingChina
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesBeijingChina
- School of Artificial IntelligenceBeijing University of Posts and TelecommunicationsBeijingChina
| | | |
Collapse
|
15
|
de Vries BM, Zwezerijnen GJC, Burchell GL, van Velden FHP, Menke-van der Houven van Oordt CW, Boellaard R. Explainable artificial intelligence (XAI) in radiology and nuclear medicine: a literature review. Front Med (Lausanne) 2023; 10:1180773. [PMID: 37250654 PMCID: PMC10213317 DOI: 10.3389/fmed.2023.1180773] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 04/17/2023] [Indexed: 05/31/2023] Open
Abstract
Rational Deep learning (DL) has demonstrated a remarkable performance in diagnostic imaging for various diseases and modalities and therefore has a high potential to be used as a clinical tool. However, current practice shows low deployment of these algorithms in clinical practice, because DL algorithms lack transparency and trust due to their underlying black-box mechanism. For successful employment, explainable artificial intelligence (XAI) could be introduced to close the gap between the medical professionals and the DL algorithms. In this literature review, XAI methods available for magnetic resonance (MR), computed tomography (CT), and positron emission tomography (PET) imaging are discussed and future suggestions are made. Methods PubMed, Embase.com and Clarivate Analytics/Web of Science Core Collection were screened. Articles were considered eligible for inclusion if XAI was used (and well described) to describe the behavior of a DL model used in MR, CT and PET imaging. Results A total of 75 articles were included of which 54 and 17 articles described post and ad hoc XAI methods, respectively, and 4 articles described both XAI methods. Major variations in performance is seen between the methods. Overall, post hoc XAI lacks the ability to provide class-discriminative and target-specific explanation. Ad hoc XAI seems to tackle this because of its intrinsic ability to explain. However, quality control of the XAI methods is rarely applied and therefore systematic comparison between the methods is difficult. Conclusion There is currently no clear consensus on how XAI should be deployed in order to close the gap between medical professionals and DL algorithms for clinical implementation. We advocate for systematic technical and clinical quality assessment of XAI methods. Also, to ensure end-to-end unbiased and safe integration of XAI in clinical workflow, (anatomical) data minimization and quality control methods should be included.
Collapse
Affiliation(s)
- Bart M. de Vries
- Department of Radiology and Nuclear Medicine, Cancer Center Amsterdam, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Gerben J. C. Zwezerijnen
- Department of Radiology and Nuclear Medicine, Cancer Center Amsterdam, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | | | | | | | - Ronald Boellaard
- Department of Radiology and Nuclear Medicine, Cancer Center Amsterdam, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| |
Collapse
|
16
|
Martin SA, Townend FJ, Barkhof F, Cole JH. Interpretable machine learning for dementia: A systematic review. Alzheimers Dement 2023; 19:2135-2149. [PMID: 36735865 PMCID: PMC10955773 DOI: 10.1002/alz.12948] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 12/05/2022] [Accepted: 12/20/2022] [Indexed: 02/05/2023]
Abstract
INTRODUCTION Machine learning research into automated dementia diagnosis is becoming increasingly popular but so far has had limited clinical impact. A key challenge is building robust and generalizable models that generate decisions that can be reliably explained. Some models are designed to be inherently "interpretable," whereas post hoc "explainability" methods can be used for other models. METHODS Here we sought to summarize the state-of-the-art of interpretable machine learning for dementia. RESULTS We identified 92 studies using PubMed, Web of Science, and Scopus. Studies demonstrate promising classification performance but vary in their validation procedures and reporting standards and rely heavily on popular data sets. DISCUSSION Future work should incorporate clinicians to validate explanation methods and make conclusive inferences about dementia-related disease pathology. Critically analyzing model explanations also requires an understanding of the interpretability methods itself. Patient-specific explanations are also required to demonstrate the benefit of interpretable machine learning in clinical practice.
Collapse
Affiliation(s)
- Sophie A. Martin
- Centre for Medical Image ComputingDepartment of Computer ScienceUniversity College LondonLondonUK
- Dementia Research CentreQueen Square Institute of NeurologyUniversity College LondonLondonUK
| | - Florence J. Townend
- Centre for Medical Image ComputingDepartment of Computer ScienceUniversity College LondonLondonUK
| | - Frederik Barkhof
- Centre for Medical Image ComputingDepartment of Computer ScienceUniversity College LondonLondonUK
- Dementia Research CentreQueen Square Institute of NeurologyUniversity College LondonLondonUK
- Amsterdam UMC, Department of Radiology & Nuclear MedicineVrije UniversiteitAmsterdamNetherlands
| | - James H. Cole
- Centre for Medical Image ComputingDepartment of Computer ScienceUniversity College LondonLondonUK
- Dementia Research CentreQueen Square Institute of NeurologyUniversity College LondonLondonUK
| |
Collapse
|
17
|
Zheng Q, Liu B, Gao Y, Bai L, Cheng Y, Li H. HGM-cNet: Integrating hippocampal gray matter probability map into a cascaded deep learning framework improves hippocampus segmentation. Eur J Radiol 2023; 162:110771. [PMID: 36948058 DOI: 10.1016/j.ejrad.2023.110771] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Revised: 03/07/2023] [Accepted: 03/09/2023] [Indexed: 03/17/2023]
Abstract
A robust cascaded deep learning framework with integrated hippocampal gray matter (HGM) probability map was developed to improve the hippocampus segmentation (called HGM-cNet) due to its significance in various neuropsychiatric disorders such as Alzheimer's disease (AD). Particularly, the HGM-cNet cascaded two identical convolutional neural networks (CNN), where each CNN was devised by incorporating Attention Block, Residual Block, and DropBlock into the typical encoder-decoder architecture. The two CNNs were skip-connected between encoder components at each scale. The adoption of the cascaded deep learning framework was to conveniently incorporate the HGM probability map with the feature map generated by the first CNN. Experiments on 135T1-weighted MRI scans and manual hippocampal labels from publicly available ADNI-HarP dataset demonstrated that the proposed HGM-cNet outperformed seven multi-atlas-based hippocampus segmentation methods and six deep learning methods under comparison in most evaluation metrics. The Dice (average > 0.89 for both left and right hippocampus) was increased by around or more than 1% over other methods. The HGM-cNet also achieved a superior hippocampus segmentation performance in each group of cognitive normal, mild cognitive impairment, and AD. The stability, conveniences and generalizability of the cascaded deep learning framework with integrated HGM probability map in improving hippocampus segmentation was validated by replacing the proposed CNN with 3D-UNet, Atten-UNet, HippoDeep, QuickNet, DeepHarp, and TransBTS models. The integration of the HGM probability map in the cascaded deep learning framework was also demonstrated to facilitate capturing hippocampal atrophy more accurately than alternative methods in AD analysis. The codes are publicly available at https://github.com/Liu1436510768/HGM-cNet.git.
Collapse
Affiliation(s)
- Qiang Zheng
- School of Computer and Control Engineering, Yantai University, Yantai 264005, China
| | - Bin Liu
- School of Computer and Control Engineering, Yantai University, Yantai 264005, China
| | - Yan Gao
- Department of Dermatology, Yankuang New Journey General Hospital, Zoucheng 273500, China
| | - Lijun Bai
- Department of Geriatrics, Traditional Chinese Medicine Hospital of Penglai, Yantai 265600, China
| | - Yu Cheng
- Department of Medical Oncology, Affiliated Yantai Yuhuangding Hospital of Qingdao University Medical College, Yantai 264099, China
| | - Honglun Li
- Department of Medical Radiology, Affiliated Yantai Yuhuangding Hospital of Qingdao University Medical College, Yantai 264099, China.
| |
Collapse
|
18
|
Li M, Dahmani L, Hubbard CS, Hu Y, Wang M, Wang D, Liu H. Individualized functional connectome identified generalizable biomarkers for psychiatric symptoms in transdiagnostic patients. Neuropsychopharmacology 2023; 48:633-641. [PMID: 36402836 PMCID: PMC9938230 DOI: 10.1038/s41386-022-01500-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 10/30/2022] [Accepted: 11/01/2022] [Indexed: 11/21/2022]
Abstract
Substantial clinical heterogeneity and comorbidity inherent amongst mental disorders limit the identification of neuroimaging biomarkers that can reliably track clinical symptoms. Strategies that enable generation of meaningful and replicable neurobiological markers at the individual level will push the field of neuropsychiatry forward in developing efficacious personalized treatment. The current study included 142 adult patients with a primary diagnosis of schizophrenia (SCZ), bipolar (BP), or attention deficit/hyperactivity disorder (ADHD), and 67 patient ratings across four behavioral measures. Using functional connectivity derived from a personalized fMRI approach, we identified several candidate imaging markers related to dimensional phenotypes across disorders, assessed the internal and external generalizability of these markers, and compared the probability of replicating findings across datasets using individual and group-averaged defined functional regions. We identified subject-specific connections related to three different clinical domains (attention deficit, appetite-energy, psychosis-positive) in a discovery dataset. Importantly, these connectivity biomarkers were robust and were reproduced in an independent validation dataset. For markers related to neurovegetative symptoms (attention deficit, appetite-energy symptoms), the brain connections involved showed similar connectivity patterns across the different diagnoses. However, psychosis-positive symptoms were associated with connections of varying strength across disorders. Finally, we found that markers for symptom domains were replicable for individually-specified connections, but not for group template-derived connections. Our personalized strategies allowed us to identify meaningful and generalizable imaging markers for symptom domains in patients who exhibit high levels of heterogeneity. These biomarkers may shed new light on the connectivity underpinnings of psychiatric symptoms and lead to personalized interventions.
Collapse
Affiliation(s)
| | - Louisa Dahmani
- Department of Medical Imaging, Zhengzhou University People's Hospital & Henan Provincial People's Hospital, Zhengzhou, China
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, 02129, USA
| | - Catherine S Hubbard
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, 29425, USA
| | - Yongbo Hu
- Department of Neuroscience, Medical University of South Carolina, Charleston, SC, 29425, USA
| | - Meiyun Wang
- Changping Laboratory, Beijing, China.
- Department of Medical Imaging, Zhengzhou University People's Hospital & Henan Provincial People's Hospital, Zhengzhou, China.
| | - Danhong Wang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA, 02129, USA
| | - Hesheng Liu
- Changping Laboratory, Beijing, China.
- Peking University, Beijing, China.
| |
Collapse
|
19
|
Hu J, Wang Y, Guo D, Qu Z, Sui C, He G, Wang S, Chen X, Wang C, Liu X. Diagnostic performance of magnetic resonance imaging-based machine learning in Alzheimer's disease detection: a meta-analysis. Neuroradiology 2023; 65:513-527. [PMID: 36477499 DOI: 10.1007/s00234-022-03098-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 11/28/2022] [Indexed: 12/12/2022]
Abstract
PURPOSE Advanced machine learning (ML) algorithms can assist rapid medical image recognition and realize automatic, efficient, noninvasive, and convenient diagnosis. We aim to further evaluate the diagnostic performance of ML to distinguish patients with probable Alzheimer's disease (AD) from normal older adults based on structural magnetic resonance imaging (MRI). METHODS The Medline, Embase, and Cochrane Library databases were searched for relevant literature published up until July 2021. We used the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) to evaluate all included studies' quality and potential bias. Random-effects models were used to calculate pooled sensitivity and specificity, and the Deeks' test was used to assess publication bias. RESULTS We included 24 models based on different brain features extracted by ML algorithms in 19 papers. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, and area under the summary receiver operating characteristic curve for ML in detecting AD were 0.85 (95%CI 0.81-0.89), 0.88 (95%CI 0.84-0.91), 7.15 (95%CI 5.40-9.47), 0.17 (95%CI 0.12-0.22), 43.34 (95%CI 26.89-69.84), and 0.93 (95%CI 0.91-0.95). CONCLUSION ML using structural MRI data performed well in diagnosing probable AD patients and normal elderly. However, more high-quality, large-scale prospective studies are needed to further enhance the reliability and generalizability of ML for clinical applications before it can be introduced into clinical practice.
Collapse
Affiliation(s)
- Jiayi Hu
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Yashan Wang
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Dingjie Guo
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Zihan Qu
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Chuanying Sui
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Guangliang He
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Song Wang
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Xiaofei Chen
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China
| | - Chunpeng Wang
- School of Mathematics and Statistics, Northeast Normal University, Changchun, Jilin, China.
| | - Xin Liu
- Department of Epidemiology and Statistics, School of Public Health, Jilin University, Changchun, 130021, Jilin, China.
| |
Collapse
|
20
|
Liu C, Huang F, Qiu A. Monte Carlo Ensemble Neural Network for the diagnosis of Alzheimer's disease. Neural Netw 2023; 159:14-24. [PMID: 36525914 DOI: 10.1016/j.neunet.2022.10.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Revised: 10/13/2022] [Accepted: 10/31/2022] [Indexed: 11/25/2022]
Abstract
Convolutional neural networks (CNNs) have been increasingly used in the computer-aided diagnosis of Alzheimer's Disease (AD). This study takes the advantage of the 2D-slice CNN fast computation and ensemble approaches to develop a Monte Carlo Ensemble Neural Network (MCENN) by introducing Monte Carlo sampling and an ensemble neural network in the integration with ResNet50. Our goals are to improve the 2D-slice CNN performance and to design the MCENN model insensitive to image resolution. Unlike traditional ensemble approaches with multiple base learners, our MCENN model incorporates one neural network learner and generates a large number of possible classification decisions via Monte Carlo sampling of feature importance within the combined slices. This can overcome the main weakness of the lack of 3D brain anatomical information in 2D-slice CNNs and develop a neural network to learn the 3D relevance of the features across multiple slices. Brain images from Alzheimer's Disease Neuroimaging Initiative (ADNI, 7199 scans), the Open Access Series of Imaging Studies-3 (OASIS-3, 1992 scans), and a clinical sample (239 scans) are used to evaluate the performance of the MCENN model for the classification of cognitively normal (CN), patients with mild cognitive impairment (MCI) and AD. Our MCENN with a small number of slices and minimal image processing (rigid transformation, intensity normalization, skull stripping) achieves the AD classification accuracy of 90%, better than existing 2D-slice CNNs (accuracy: 63%∼84%) and 3D CNNs (accuracy: 74%∼88%). Furthermore, the MCENN is robust to be trained in the ADNI dataset and applied to the OASIS-3 dataset and the clinical sample. Our experiments show that the AD classification accuracy of the MCENN model is comparable when using high- and low-resolution brain images, suggesting the insensitivity of the MCENN to image resolution. Hence, the MCENN does not require high-resolution 3D brain structural images and comprehensive image processing, which supports its potential use in a clinical setting.
Collapse
Affiliation(s)
- Chaoqiang Liu
- Department of Biomedical Engineering, National University of Singapore, Singapore
| | - Fei Huang
- School of Computer Engineering and Science, Shanghai University, China
| | - Anqi Qiu
- Department of Biomedical Engineering, National University of Singapore, Singapore; NUS (Suzhou) Research Institute, National University of Singapore, China; School of Computer Engineering and Science, Shanghai University, China; Institute of Data Science, National University of Singapore, Singapore; The N.1 Institute for Health, National University of Singapore, Singapore; The Johns Hopkins University, MD, USA.
| | | |
Collapse
|
21
|
Shi Y, Wang Z, Chen P, Cheng P, Zhao K, Zhang H, Shu H, Gu L, Gao L, Wang Q, Zhang H, Xie C, Liu Y, Zhang Z. Episodic Memory-Related Imaging Features as Valuable Biomarkers for the Diagnosis of Alzheimer's Disease: A Multicenter Study Based on Machine Learning. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2023; 8:171-180. [PMID: 33712376 DOI: 10.1016/j.bpsc.2020.12.007] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 12/16/2020] [Accepted: 12/16/2020] [Indexed: 10/22/2022]
Abstract
BACKGROUND Individualized and reliable biomarkers are crucial for diagnosing Alzheimer's disease (AD). However, lack of accessibility and neurobiological correlation are the main obstacles to their clinical application. Machine learning algorithms can effectively identify personalized biomarkers based on the prominent symptoms of AD. METHODS Episodic memory-related magnetic resonance imaging (MRI) features of 143 patients with amnesic mild cognitive impairment (MCI) were identified using a multivariate relevance vector regression algorithm. The support vector machine classification model was constructed using these MRI features and verified in 2 independent datasets (N = 994). The neurobiological basis was also investigated based on cognitive assessments, neuropathologic biomarkers of cerebrospinal fluid, and positron emission tomography images of amyloid-β plaques. RESULTS The combination of gray matter volume and amplitude of low-frequency fluctuation MRI features accurately predicted episodic memory impairment in individual patients with amnesic MCI (r = 0.638) when measured using an episodic memory assessment panel. The MRI features that contributed to episodic memory prediction were primarily distributed across the default mode network and limbic network. The classification model based on these features distinguished patients with AD from normal control subjects with more than 86% accuracy. Furthermore, most identified episodic memory-related regions showed significantly different amyloid-β positron emission tomography measurements among the AD, MCI, and normal control groups. Moreover, the classification outputs significantly correlated with cognitive assessment scores and cerebrospinal fluid pathological biomarkers' levels in the MCI and AD groups. CONCLUSIONS Neuroimaging features can reflect individual episodic memory function and serve as potential diagnostic biomarkers of AD.
Collapse
Affiliation(s)
- Yachen Shi
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Zan Wang
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Pindong Chen
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China
| | - Piaoyue Cheng
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Kun Zhao
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Biological Science and Medical Engineering, Beihang University, Beijing, China
| | - Hongxing Zhang
- Department of Psychology, Xinxiang Medical University, Xinxiang, China; Second Affiliated Hospital of Xinxiang Medical University, Xinxiang, China
| | - Hao Shu
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Lihua Gu
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Lijuan Gao
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Qing Wang
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Haisan Zhang
- Second Affiliated Hospital of Xinxiang Medical University, Xinxiang, China
| | - Chunming Xie
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China
| | - Yong Liu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; Center for Excellence in Brain Science and Intelligence Technology, Institute of Automation, Chinese Academy of Sciences, Beijing, China; University of Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China.
| | - Zhijun Zhang
- Department of Neurology, Affiliated ZhongDa Hospital, School of Medicine, Institution of Neuropsychiatry, Southeast University, Nanjing, China; School of Life Science and Technology, The Key Laboratory of Developmental Genes and Human Disease, Southeast University, Nanjing, China; Department of Psychology, Xinxiang Medical University, Xinxiang, China; Second Affiliated Hospital of Xinxiang Medical University, Xinxiang, China.
| | | |
Collapse
|
22
|
Huang P, Zhang M. Magnetic Resonance Imaging Studies of Neurodegenerative Disease: From Methods to Translational Research. Neurosci Bull 2023; 39:99-112. [PMID: 35771383 PMCID: PMC9849544 DOI: 10.1007/s12264-022-00905-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 05/07/2022] [Indexed: 01/22/2023] Open
Abstract
Neurodegenerative diseases (NDs) have become a significant threat to an aging human society. Numerous studies have been conducted in the past decades to clarify their pathologic mechanisms and search for reliable biomarkers. Magnetic resonance imaging (MRI) is a powerful tool for investigating structural and functional brain alterations in NDs. With the advantages of being non-invasive and non-radioactive, it has been frequently used in both animal research and large-scale clinical investigations. MRI may serve as a bridge connecting micro- and macro-level analysis and promoting bench-to-bed translational research. Nevertheless, due to the abundance and complexity of MRI techniques, exploiting their potential is not always straightforward. This review aims to briefly introduce research progress in clinical imaging studies and discuss possible strategies for applying MRI in translational ND research.
Collapse
Affiliation(s)
- Peiyu Huang
- Department of Radiology, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310009 China
| | - Minming Zhang
- Department of Radiology, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310009 China
| |
Collapse
|
23
|
Lei R, Yu Y, Li Q, Yao Q, Wang J, Gao M, Wu Z, Ren W, Tan Y, Zhang B, Chen L, Lin Z, Yao H. Deep learning magnetic resonance imaging predicts platinum sensitivity in patients with epithelial ovarian cancer. Front Oncol 2022; 12:895177. [PMID: 36505880 PMCID: PMC9727155 DOI: 10.3389/fonc.2022.895177] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Accepted: 10/18/2022] [Indexed: 11/24/2022] Open
Abstract
Objective The aim of the study is to develop and validate a deep learning model to predict the platinum sensitivity of patients with epithelial ovarian cancer (EOC) based on contrast-enhanced magnetic resonance imaging (MRI). Methods In this retrospective study, 93 patients with EOC who received platinum-based chemotherapy (≥4 cycles) and debulking surgery at the Sun Yat-sen Memorial Hospital from January 2011 to January 2020 were enrolled and randomly assigned to the training and validation cohorts (2:1). Two different models were built based on either the primary tumor or whole volume of the abdomen as the volume of interest (VOI) within the same cohorts, and then a pre-trained convolutional neural network Med3D (Resnet 10 version) was transferred to automatically extract 1,024 features from two MRI sequences (CE-T1WI and T2WI) of each patient to predict platinum sensitivity. The performance of the two models was compared. Results A total of 93 women (mean age, 50.5 years ± 10.5 [standard deviation]) were evaluated (62 in the training cohort and 31 in the validation cohort). The AUCs of the whole abdomen model were 0.97 and 0.98 for the training and validation cohorts, respectively, which was better than the primary tumor model (AUCs of 0.88 and 0.81 in the training and validation cohorts, respectively). In k-fold cross-validation and stratified analysis, the whole abdomen model maintained a stable performance, and the decision function value generated by the model was a prognostic indicator that successfully discriminates high- and low-risk recurrence patients. Conclusion The non-manually segmented whole-abdomen deep learning model based on MRI exhibited satisfactory predictive performance for platinum sensitivity and may assist gynecologists in making optimal treatment decisions.
Collapse
Affiliation(s)
- Ruilin Lei
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Gynecological Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Medical Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yunfang Yu
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Medical Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Faculty of Medicine, Macau University of Science and Technology, Macao, Macao SAR, China
| | - Qingjian Li
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Medical Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Phase I Clinical Trial Centre, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Qinyue Yao
- Cells Vision Medical Technology Inc., Guangzhou, China
| | - Jin Wang
- Cells Vision Medical Technology Inc., Guangzhou, China
| | - Ming Gao
- Department of Radiology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Zhuo Wu
- Department of Radiology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Wei Ren
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Medical Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Phase I Clinical Trial Centre, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yujie Tan
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Medical Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Phase I Clinical Trial Centre, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Bingzhong Zhang
- Department of Gynecological Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China
| | - Liliang Chen
- Cells Vision Medical Technology Inc., Guangzhou, China
| | - Zhongqiu Lin
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Gynecological Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,*Correspondence: Zhongqiu Lin, ; Herui Yao,
| | - Herui Yao
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Medical Research Center, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Department of Medical Oncology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Phase I Clinical Trial Centre, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,Breast Tumor Centre, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China,*Correspondence: Zhongqiu Lin, ; Herui Yao,
| |
Collapse
|
24
|
Zheng Q, Zhang Y, Li H, Tong X, Ouyang M. How segmentation methods affect hippocampal radiomic feature accuracy in Alzheimer's disease analysis? Eur Radiol 2022; 32:6965-6976. [PMID: 35999372 DOI: 10.1007/s00330-022-09081-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 06/30/2022] [Accepted: 08/03/2022] [Indexed: 11/30/2022]
Abstract
OBJECTIVES Hippocampal radiomic features (HRFs) can serve as biomarkers in Alzheimer's disease (AD). However, how different hippocampal segmentation methods affect HRFs in AD is still unknown. The aim of the study was to investigate how different segmentation methods affect HRF accuracy in AD analysis. METHODS A total of 1650 subjects were identified from the Alzheimer's Disease Neuroimaging Initiative database (ADNI). The mini-mental state examination (MMSE) and Alzheimer's disease assessment scale (ADAS-cog13) were also adopted. After calculating the HRFs of intensity, shape, and textural features from each side of the hippocampus in structural magnetic resonance imaging (sMRI), the consistency of HRFs calculated from 7 different hippocampal segmentation methods was validated, and the performance of machine learning-based classification of AD vs. normal control (NC) adopting the different HRFs was also examined. Additional 571 subjects from the European DTI Study on Dementia database (EDSD) were to validate the consistency of results. RESULTS Between different segmentations, HRFs showed a high measurement consistency (R > 0.7), a high significant consistency between NC, mild cognitive impairment (MCI), and AD (T-value plot, R > 0.8), and consistent significant correlations between HRFs and MMSE/ADAS-cog13 (p < 0.05). The best NC vs. AD classification was obtained when the hippocampus was sufficiently segmented by primitive majority voting (threshold = 0.2). High consistent results were reproduced from independent EDSD cohort. CONCLUSIONS HRFs exhibited high consistency across different hippocampal segmentation methods, and the best performance in AD classification was obtained when HRFs were extracted by the naïve majority voting method with a more sufficient segmentation and relatively low hippocampus segmentation accuracy. KEY POINTS • The hippocampal radiomic features exhibited high measurement/statistical/clinical consistency across different hippocampal segmentation methods. • The best performance in AD classification was obtained when hippocampal radiomics were extracted by the naïve majority voting method with a more sufficient segmentation and relatively low hippocampus segmentation accuracy.
Collapse
Affiliation(s)
- Qiang Zheng
- School of Computer and Control Engineering, Yantai University, No30, Qingquan Road, Laishan District, Yantai, 264005, Shandong, China.
| | - Yiyu Zhang
- School of Computer and Control Engineering, Yantai University, No30, Qingquan Road, Laishan District, Yantai, 264005, Shandong, China
| | - Honglun Li
- Departments of Medical Oncology and Radiology, Affiliated Yantai Yuhuangding Hospital of Qingdao University Medical College, Yantai, 264000, China
| | - Xiangrong Tong
- School of Computer and Control Engineering, Yantai University, No30, Qingquan Road, Laishan District, Yantai, 264005, Shandong, China
| | - Minhui Ouyang
- Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
| |
Collapse
|
25
|
Khojaste-Sarakhsi M, Haghighi SS, Ghomi SF, Marchiori E. Deep learning for Alzheimer's disease diagnosis: A survey. Artif Intell Med 2022; 130:102332. [DOI: 10.1016/j.artmed.2022.102332] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 04/29/2022] [Accepted: 05/30/2022] [Indexed: 11/28/2022]
|
26
|
Tan X, Wu J, Ma X, Kang S, Yue X, Rao Y, Li Y, Huang H, Chen Y, Lyu W, Qin C, Li M, Feng Y, Liang Y, Qiu S. Convolutional Neural Networks for Classification of T2DM Cognitive Impairment Based on Whole Brain Structural Features. Front Neurosci 2022; 16:926486. [PMID: 35928014 PMCID: PMC9344913 DOI: 10.3389/fnins.2022.926486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 06/22/2022] [Indexed: 11/18/2022] Open
Abstract
Purpose Cognitive impairment is generally found in individuals with type 2 diabetes mellitus (T2DM). Although they may not have visible symptoms of cognitive impairment in the early stages of the disorder, they are considered to be at high risk. Therefore, the classification of these patients is important for preventing the progression of cognitive impairment. Methods In this study, a convolutional neural network was used to construct a model for classifying 107 T2DM patients with and without cognitive impairment based on T1-weighted structural MRI. The Montreal cognitive assessment score served as an index of the cognitive status of the patients. Results The classifier could identify T2DM-related cognitive decline with a classification accuracy of 84.85% and achieved an area under the curve of 92.65%. Conclusions The model can help clinicians analyze and predict cognitive impairment in patients and enable early treatment.
Collapse
Affiliation(s)
- Xin Tan
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
- Medical Imaging Center, First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Jinjian Wu
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Xiaomeng Ma
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Shangyu Kang
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Xiaomei Yue
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yawen Rao
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yifan Li
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Haoming Huang
- Medical Imaging Center, First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yuna Chen
- Medical Imaging Center, First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Wenjiao Lyu
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Chunhong Qin
- Medical Imaging Center, First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Mingrui Li
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yue Feng
- First Clinical Medical College, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yi Liang
- Medical Imaging Center, First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
- Yi Liang
| | - Shijun Qiu
- Medical Imaging Center, First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
- *Correspondence: Shijun Qiu
| |
Collapse
|
27
|
Du K, Chen P, Zhao K, Qu Y, Kang X, Liu Y. Impaired time-distance reconfiguration patterns in Alzheimer's disease: a dynamic functional connectivity study with 809 individuals from 7 sites. BMC Bioinformatics 2022; 23:280. [PMID: 35836122 PMCID: PMC9284684 DOI: 10.1186/s12859-022-04776-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Accepted: 06/08/2022] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND The dynamic functional connectivity (dFC) has been used successfully to investigate the dysfunction of Alzheimer's disease (AD) patients. The reconfiguration intensity of nodal dFC, which means the degree of alteration between FCs at different time scales, could provide additional information for understanding the reconfiguration of brain connectivity. RESULTS In this paper, we introduced a feature named time distance nodal connectivity diversity (tdNCD), and then evaluated the network reconfiguration intensity in every specific brain region in AD using a large multicenter dataset (N = 809 from 7 independent sites). Our results showed that the dysfunction involved in three subnetworks in AD, including the default mode network (DMN), the subcortical network (SCN), and the cerebellum network (CBN). The nodal tdNCD inside the DMN increased in AD compared to normal controls, and the nodal dynamic FC of the SCN and the CBN decreased in AD. Additionally, the classification analysis showed that the classification performance was better when combined tdNCD and FC to classify AD from normal control (ACC = 81%, SEN = 83.4%, SPE = 80.6%, and F1-score = 79.4%) than that only using FC (ACC = 78.2%, SEN = 76.2%, SPE = 76.5%, and F1-score = 77.5%) with a leave-one-site-out cross-validation. Besides, the performance of the three classes classification was improved from 50% (only using FC) to 53.3% (combined FC and tdNCD) (macro F1-score accuracy from 46.8 to 48.9%). More importantly, the classification model showed significant clinically predictive correlations (two classes classification: R = -0.38, P < 0.001; three classes classification: R = -0.404, P < 0.001). More importantly, several commonly used machine learning models confirmed that the tdNCD would provide additional information for classifying AD from normal controls. CONCLUSIONS The present study demonstrated dynamic reconfiguration of nodal FC abnormities in AD. The tdNCD highlights the potential for further understanding core mechanisms of brain dysfunction in AD. Evaluating the tdNCD FC provides a promising way to understand AD processes better and investigate novel diagnostic brain imaging biomarkers for AD.
Collapse
Affiliation(s)
- Kai Du
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Pindong Chen
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Kun Zhao
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
- Beijing Advanced Innovation Centre for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, China
| | - Yida Qu
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Xiaopeng Kang
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Yong Liu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
| |
Collapse
|
28
|
Fathi S, Ahmadi M, Dehnad A. Early diagnosis of Alzheimer's disease based on deep learning: A systematic review. Comput Biol Med 2022; 146:105634. [DOI: 10.1016/j.compbiomed.2022.105634] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 04/25/2022] [Accepted: 04/25/2022] [Indexed: 11/03/2022]
|
29
|
Structural and functional connectivity abnormalities of the default mode network in patients with Alzheimer's disease and mild cognitive impairment within two independent datasets. Methods 2022; 205:29-38. [PMID: 35671900 DOI: 10.1016/j.ymeth.2022.06.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 05/29/2022] [Accepted: 06/03/2022] [Indexed: 12/14/2022] Open
Abstract
Alzheimer's disease (AD) is a chronic neurodegenerative disease characterized by progressive dementia, and amnestic mild cognitive impairment (aMCI) has been defined as a transitional stage between normal aging and AD. Accumulating evidence has shown that altered functional connectivity (FC) and structural connectivity (SC) in the default mode network (DMN) is the prominent hallmarks of AD. However, the relationship between the changes in SC and FC of the DMN is not yet clear. In the present study, we derived the FC and SC matrices of the DMN with functional magnetic resonance imaging (fMRI) and diffusion-weighted imaging (DWI) data and further assessed FC and SC abnormalities within a discovery dataset of 120 participants (39 normal controls, 34 patients with aMCI and 47 patients with AD), as well as a replication dataset of 122 participants (43 normal controls, 37 patients with aMCI and 42 patients with AD). Disrupted SC and FC were found among DMN components (e.g., the posterior cingulate cortex (PCC), medial prefrontal cortex (mPFC), and hippocampus) in patients in the aMCI and AD groups in the discovery dataset; most of the disrupted connections were also identified in the replication dataset. More importantly, some SC and FC elements were significantly correlated with the cognitive ability of patients with aMCI and AD. In addition, we found structural-functional decoupling between the PCC and the right hippocampus in patients in the aMCI and AD groups. These findings of the alteration of DMN connectivity in neurodegenerative cohorts deepen our understanding of the pathophysiological mechanisms of AD.
Collapse
|
30
|
Liu Y, Varoquaux G. Understanding Brain Network Dynamics in Autism Begs for Generalization. Biol Psychiatry 2022; 91:916-917. [PMID: 35589311 DOI: 10.1016/j.biopsych.2022.03.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 03/11/2022] [Indexed: 11/26/2022]
Affiliation(s)
- Yong Liu
- School of Artificial Intelligence and the Center for Artificial Intelligence in Medical Imaging, Beijing University of Posts and Telecommunications, Beijing, China.
| | | |
Collapse
|
31
|
Zhao M, Yan W, Luo N, Zhi D, Fu Z, Du Y, Yu S, Jiang T, Calhoun VD, Sui J. An attention-based hybrid deep learning framework integrating brain connectivity and activity of resting-state functional MRI data. Med Image Anal 2022; 78:102413. [PMID: 35305447 PMCID: PMC9035078 DOI: 10.1016/j.media.2022.102413] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 10/27/2021] [Accepted: 03/01/2022] [Indexed: 12/30/2022]
Abstract
Functional magnetic resonance imaging (fMRI) as a promising tool to investigate psychotic disorders can be decomposed into useful imaging features such as time courses (TCs) of independent components (ICs) and functional network connectivity (FNC) calculated by TC cross-correlation. TCs reflect the temporal dynamics of brain activity and the FNC characterizes temporal coherence across intrinsic brain networks. Both features have been used as input to deep learning approaches with decent results. However, few studies have tried to leverage their complementary information to learn optimal representations at multiple facets. Motivated by this, we proposed a Hybrid Deep Learning Framework integrating brain Connectivity and Activity (HDLFCA) together by combining convolutional recurrent neural network (C-RNN) and deep neural network (DNN), aiming to improve classification accuracy and interpretability simultaneously. Specifically, C-RNNAM was proposed to extract temporal dynamic dependencies with an attention module (AM) to automatically learn discriminative knowledge from TC nodes, while DNN was applied to identify the most group-discriminative FNC patterns with layer-wise relevance propagation (LRP). Then, both prediction outputs were concatenated to build a new feature matrix, generating the final decision by logistic regression. The effectiveness of HDLFCA was validated on both multi-site schizophrenia (SZ, n ∼ 1100) and public autism datasets (ABIDE, n ∼ 1522) by outperforming 12 alternative models at 2.8-8.9% accuracy, including 8 models using either static FNC or TCs and 4 models using dynamic FNC. Appreciable classification accuracy was achieved for HC vs. SZ (85.3%) and HC vs. Autism (72.4%) respectively. More importantly, the most group-discriminative brain regions can be easily attributed and visualized, providing meaningful biological interpretability and highlighting the great potential of the proposed HDLFCA model in the identification of valid neuroimaging biomarkers.
Collapse
Affiliation(s)
- Min Zhao
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Weizheng Yan
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Na Luo
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Dongmei Zhi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zening Fu
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Yuhui Du
- School of Computer and Information Technology, Shanxi University, Taiyuan, China
| | - Shan Yu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Tianzi Jiang
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Vince D Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Jing Sui
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA; State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
| |
Collapse
|
32
|
Chen L, Qiao H, Zhu F. Alzheimer's Disease Diagnosis With Brain Structural MRI Using Multiview-Slice Attention and 3D Convolution Neural Network. Front Aging Neurosci 2022; 14:871706. [PMID: 35557839 PMCID: PMC9088013 DOI: 10.3389/fnagi.2022.871706] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 03/17/2022] [Indexed: 01/01/2023] Open
Abstract
Numerous artificial intelligence (AI) based approaches have been proposed for automatic Alzheimer's disease (AD) prediction with brain structural magnetic resonance imaging (sMRI). Previous studies extract features from the whole brain or individual slices separately, ignoring the properties of multi-view slices and feature complementarity. For this reason, we present a novel AD diagnosis model based on the multiview-slice attention and 3D convolution neural network (3D-CNN). Specifically, we begin by extracting the local slice-level characteristic in various dimensions using multiple sub-networks. Then we proposed a slice-level attention mechanism to emphasize specific 2D-slices to exclude the redundancy features. After that, a 3D-CNN was employed to capture the global subject-level structural changes. Finally, all these 2D and 3D features were fused to obtain more discriminative representations. We conduct the experiments on 1,451 subjects from ADNI-1 and ADNI-2 datasets. Experimental results showed the superiority of our model over the state-of-the-art approaches regarding dementia classification. Specifically, our model achieves accuracy values of 91.1 and 80.1% on ADNI-1 for AD diagnosis and mild cognitive impairment (MCI) convention prediction, respectively.
Collapse
Affiliation(s)
- Lin Chen
- Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China
| | - Hezhe Qiao
- Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Fan Zhu
- Chongqing Key Laboratory of Big Data and Intelligent Computing, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing, China
| |
Collapse
|
33
|
Zhao K, Zheng Q, Dyrba M, Rittman T, Li A, Che T, Chen P, Sun Y, Kang X, Li Q, Liu B, Liu Y, Li S. Regional Radiomics Similarity Networks Reveal Distinct Subtypes and Abnormality Patterns in Mild Cognitive Impairment. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2104538. [PMID: 35098696 PMCID: PMC9036024 DOI: 10.1002/advs.202104538] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Revised: 12/30/2021] [Indexed: 05/28/2023]
Abstract
Individuals with mild cognitive impairment (MCI) of different subtypes show distinct alterations in network patterns. The first aim of this study is to identify the subtypes of MCI by employing a regional radiomics similarity network (R2SN). The second aim is to characterize the abnormality patterns associated with the clinical manifestations of each subtype. An individual-level R2SN is constructed for N = 605 normal controls (NCs), N = 766 MCI patients, and N = 283 Alzheimer's disease (AD) patients. MCI patients' R2SN profiles are clustered into two subtypes using nonnegative matrix factorization. The patterns of brain alterations, gene expression, and the risk of cognitive decline in each subtype are evaluated. MCI patients are clustered into "similar to the pattern of NCs" (N-CI, N = 252) and "similar to the pattern of AD" (A-CI, N = 514) subgroups. Significant differences are observed between the subtypes with respect to the following: 1) clinical measures; 2) multimodal neuroimaging; 3) the proportion of progression to dementia (61.54% for A-CI and 21.77% for N-CI) within three years; 4) enriched genes for potassium-ion transport and synaptic transmission. Stratification into the two subtypes provides new insight for risk assessment and precise early intervention for MCI patients.
Collapse
Affiliation(s)
- Kun Zhao
- Beijing Advanced Innovation Centre for Biomedical EngineeringSchool of Biological Science and Medical EngineeringBeihang UniversityBeijing100191China
- School of Artificial IntelligenceBeijing University of Posts and TelecommunicationsBeijing100876China
| | - Qiang Zheng
- School of Computer and Control EngineeringYantai UniversityYantai264005China
| | - Martin Dyrba
- German Center for Neurodegenerative Diseases (DZNE)Rostock18147Germany
| | - Timothy Rittman
- Department of Clinical NeurosciencesUniversity of CambridgeCambridge Biomedical CampusCambridgeCB2 0SZUK
| | - Ang Li
- State Key Laboratory of Brain and Cognitive Science, Institute of BiophysicsChinese Academy of SciencesBeijing100101China
| | - Tongtong Che
- Beijing Advanced Innovation Centre for Biomedical EngineeringSchool of Biological Science and Medical EngineeringBeihang UniversityBeijing100191China
| | - Pindong Chen
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of AutomationChinese Academy of SciencesBeijing100190China
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesChinese Academy of SciencesBeijing100049China
| | - Yuqing Sun
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of AutomationChinese Academy of SciencesBeijing100190China
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesChinese Academy of SciencesBeijing100049China
| | - Xiaopeng Kang
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of AutomationChinese Academy of SciencesBeijing100190China
- School of Artificial IntelligenceUniversity of Chinese Academy of SciencesChinese Academy of SciencesBeijing100049China
| | - Qiongling Li
- State Key Laboratory of Cognition Neuroscience & LearningBeijing Normal UniversityBeijing100875China
| | - Bing Liu
- State Key Laboratory of Cognition Neuroscience & LearningBeijing Normal UniversityBeijing100875China
| | - Yong Liu
- School of Artificial IntelligenceBeijing University of Posts and TelecommunicationsBeijing100876China
- Brainnetome Center & National Laboratory of Pattern RecognitionInstitute of AutomationChinese Academy of SciencesBeijing100190China
| | - Shuyu Li
- Beijing Advanced Innovation Centre for Biomedical EngineeringSchool of Biological Science and Medical EngineeringBeihang UniversityBeijing100191China
- State Key Laboratory of Cognition Neuroscience & LearningBeijing Normal UniversityBeijing100875China
| | | |
Collapse
|
34
|
Qiu A, Xu L, Liu C. Predicting diagnosis 4 years prior to Alzheimer's disease incident. Neuroimage Clin 2022; 34:102993. [PMID: 35344803 PMCID: PMC8958535 DOI: 10.1016/j.nicl.2022.102993] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 03/23/2022] [Accepted: 03/23/2022] [Indexed: 11/24/2022]
Abstract
This study employed a deep learning longitudinal model, graph convolutional and recurrent neural network (graph-CNN-RNN), on a series of brain structural MRI scans for AD prognosis. It characterized whole-brain morphology via incorporating longitudinal cortical and subcortical morphology and defined a probabilistic risk for the prediction of AD as a function of age prior to clinical diagnosis. The graph-CNN-RNN model was trained on half of the Alzheimer's Disease Neuroimaging Initiative dataset (ADNI, n = 1559) and validated on the other half of the ADNI dataset and the Open Access Series of Imaging Studies-3 (OASIS-3, n = 930). Our findings demonstrated that the graph-CNN-RNN can reliably and robustly diagnose AD at the accuracy rate of 85% and above across all the time points for both datasets. The graph-CNN-RNN predicted the AD conversion from 0 to 4 years before the AD onset at ∼80% of accuracy. The AD probabilistic risk was associated with clinical traits, cognition, and amyloid burden assessed using [18F]-Florbetapir (AV45) positron emission tomography (PET) across all the time points. The graph-CNN-RNN provided the quantitative trajectory of brain morphology from prognosis to overt stages of AD. Such a deep learning tool and the AD probabilistic risk have great potential in clinical applications for AD prognosis.
Collapse
Affiliation(s)
- Anqi Qiu
- Department of Biomedical Engineering, National University of Singapore, Singapore; The N.1 Institute for Health, National University of Singapore, Singapore; Institute of Data Science, National University of Singapore, Singapore; NUS (Suzhou) Research Institute, Suzhou, China; School of Computer Engineering and Science, Shanghai University, China; Department of Biomedical Engineering, the Johns Hopkins University, USA.
| | - Liyuan Xu
- School of Computer Engineering and Science, Shanghai University, China
| | - Chaoqiang Liu
- Department of Biomedical Engineering, National University of Singapore, Singapore
| |
Collapse
|
35
|
Wu J, Zhao K, Li Z, Wang D, Ding Y, Wei Y, Zhang H, Liu Y. A systematic analysis of diagnostic performance for Alzheimer's disease using structural MRI. PSYCHORADIOLOGY 2022; 2:287-295. [PMID: 38665142 PMCID: PMC10939341 DOI: 10.1093/psyrad/kkac001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Revised: 01/13/2022] [Accepted: 02/14/2022] [Indexed: 04/28/2024]
Abstract
Background Alzheimer's disease (AD) is one of the most common neurodegenerative disorders in the elderly. Although numerous structural magnetic resonance imaging (sMRI) studies have reported diagnostic models that could distinguish AD from normal controls (NCs) with 80-95% accuracy, limited efforts have been made regarding the clinically practical computer-aided diagnosis (CAD) system for AD. Objective To explore the potential factors that hinder the clinical translation of the AD-related diagnostic models based on sMRI. Methods To systematically review the diagnostic models for AD based on sMRI, we identified relevant studies published in the past 15 years on PubMed, Web of Science, Scopus, and Ovid. To evaluate the heterogeneity and publication bias among those studies, we performed subgroup analysis, meta-regression, Begg's test, and Egger's test. Results According to our screening criterion, 101 studies were included. Our results demonstrated that high diagnostic accuracy for distinguishing AD from NC was obtained in recently published studies, accompanied by significant heterogeneity. Meta-analysis showed that many factors contributed to the heterogeneity of high diagnostic accuracy of AD using sMRI, which included but was not limited to the following aspects: (i) different datasets; (ii) different machine learning models, e.g. traditional machine learning or deep learning model; (iii) different cross-validation methods, e.g. k-fold cross-validation leads to higher accuracies than leave-one-out cross-validation, but both overestimate the accuracy when compared to validation in independent samples; (iv) different sample sizes; and (v) the publication times. We speculate that these complicated variables might be the adverse factor for developing a clinically applicable system for the early diagnosis of AD. Conclusions Our findings proved that previous studies reported promising results for classifying AD from NC with different models using sMRI. However, considering the many factors hindering clinical radiology practice, there would still be a long way to go to improve.
Collapse
Affiliation(s)
- Jiangping Wu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
| | - Kun Zhao
- Beijing Advanced Innovation Centre for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Zhuangzhuang Li
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
| | - Dong Wang
- School of Information Science and Engineering, Shandong Normal University, Ji'nan, 250014, China
| | - Yanhui Ding
- School of Information Science and Engineering, Shandong Normal University, Ji'nan, 250014, China
| | - Yongbin Wei
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
| | - Han Zhang
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
| | - Yong Liu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China
- Center for Artificial Intelligence in Medical Imaging, Beijing University of Posts and Telecommunications, Beijing, 100876, China
| |
Collapse
|
36
|
Quantifying the reproducibility of graph neural networks using multigraph data representation. Neural Netw 2022; 148:254-265. [DOI: 10.1016/j.neunet.2022.01.018] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Revised: 01/10/2022] [Accepted: 01/26/2022] [Indexed: 11/20/2022]
|
37
|
Qiao H, Chen L, Zhu F. Ranking convolutional neural network for Alzheimer's disease mini-mental state examination prediction at multiple time-points. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 213:106503. [PMID: 34798407 DOI: 10.1016/j.cmpb.2021.106503] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 10/22/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE Alzheimer's disease (AD) is a fatal neurodegenerative disease. Predicting Mini-mental state examination (MMSE) based on magnetic resonance imaging (MRI) plays an important role in monitoring the progress of AD. Existing machine learning based methods cast MMSE prediction as a single metric regression problem simply and ignore the relationship between subjects with various scores. METHODS In this study, we proposed a ranking convolutional neural network (rankCNN) to address the prediction of MMSE through muti-classification. Specifically, we use a 3D convolutional neural network with sharing weights to extract the feature from MRI, followed by multiple sub-networks which transform the cognitive regression into a series of simpler binary classification. In addition, we further use a ranking layer to measure the ranking information between samples to strengthen the ability of the classification by extracting more discriminative features. RESULTS We evaluated the proposed model on ADNI-1 and ADNI-2 datasets with a total of 1,569 subjects. The Root Mean Squared Error (RMSE) of our proposed model at baseline is 2.238 and 2.434 on ADNI-1 and ADNI-2, respectively. Extensive experimental results on ADNI-1 and ADNI-2 datasets demonstrate that our proposed model is superior to several state-of-the-art methods at both baseline and future MMSE prediction of subjects. CONCLUSION This paper provides a new method that can effectively predict the MMSE at baseline and future time points using baseline MRI, making it possible to use MRI for accurate early diagnosis of AD. The source code is freely available at https://github.com/fengduqianhe/ADrankCNN-master.
Collapse
Affiliation(s)
- Hezhe Qiao
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China; University of Chinese Academy of Sciences, Beijing 100049, China.
| | - Lin Chen
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.
| | - Fan Zhu
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.
| |
Collapse
|
38
|
Qu Y, Wang P, Liu B, Kang X, Chen P, Du K, Liu Y. Altered Connection and Diagnosis Utility of White Matter in Alzheimer's Disease: A Multi-site Automated Fiber Quantification Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:2923-2927. [PMID: 34891857 DOI: 10.1109/embc46164.2021.9630117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Alzheimer's disease (AD) is a typical neurodegenerative disease that is associated with cognitive decline, memory loss, and functional disconnection. Diffusion tensor imaging (DTI) has been widely used to investigate the integrity and degeneration of white matter in AD. In this study, with one of the world's largest DTI biobanks (865 individuals), we aim to explore the diagnosis utility and stability of tractbased features (extracted by automated fiber quantification (AFQ) pipeline) in AD. First, we studied the clinical association of tract-based features by detecting AD-associated alterations of diffusion properties along fiber bundles. Then, a binary classification experiment between AD and normal controls was performed using tract-based diffusion properties as features and support vector machine (SVM) as a classifier with an independent site cross-validation strategy. The average accuracy of 77.90% (the highest was 88.89%) showed that white matter properties as biomarkers had a relatively stable role in the clinical diagnosis of AD.Clinical Relevance- White matter characteristics are valid and robust biomarkers of AD, which have high accuracy and generalizability in the AD diagnosis in a large multi-site dataset.
Collapse
|
39
|
Dockès J, Varoquaux G, Poline JB. Preventing dataset shift from breaking machine-learning biomarkers. Gigascience 2021; 10:giab055. [PMID: 34585237 PMCID: PMC8478611 DOI: 10.1093/gigascience/giab055] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 07/06/2021] [Accepted: 08/02/2021] [Indexed: 01/20/2023] Open
Abstract
Machine learning brings the hope of finding new biomarkers extracted from cohorts with rich biomedical measurements. A good biomarker is one that gives reliable detection of the corresponding condition. However, biomarkers are often extracted from a cohort that differs from the target population. Such a mismatch, known as a dataset shift, can undermine the application of the biomarker to new individuals. Dataset shifts are frequent in biomedical research, e.g., because of recruitment biases. When a dataset shift occurs, standard machine-learning techniques do not suffice to extract and validate biomarkers. This article provides an overview of when and how dataset shifts break machine-learning-extracted biomarkers, as well as detection and correction strategies.
Collapse
Affiliation(s)
- Jérôme Dockès
- McGill University, 845 Sherbrooke St W, Montreal, Quebec H3A 0G4, Canada
| | - Gaël Varoquaux
- McGill University, 845 Sherbrooke St W, Montreal, Quebec H3A 0G4, Canada
- INRIA
| | | |
Collapse
|
40
|
Zhao K, Zheng Q, Che T, Dyrba M, Li Q, Ding Y, Zheng Y, Liu Y, Li S. Regional radiomics similarity networks (R2SNs) in the human brain: Reproducibility, small-world properties and a biological basis. Netw Neurosci 2021; 5:783-797. [PMID: 34746627 PMCID: PMC8567836 DOI: 10.1162/netn_a_00200] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 05/08/2021] [Indexed: 12/13/2022] Open
Abstract
A structural covariance network (SCN) has been used successfully in structural magnetic resonance imaging (sMRI) studies. However, most SCNs have been constructed by a unitary marker that is insensitive for discriminating different disease phases. The aim of this study was to devise a novel regional radiomics similarity network (R2SN) that could provide more comprehensive information in morphological network analysis. R2SNs were constructed by computing the Pearson correlations between the radiomics features extracted from any pair of regions for each subject (AAL atlas). We further assessed the small-world property of R2SNs, and we evaluated the reproducibility in different datasets and through test-retest analysis. The relationships between the R2SNs and general intelligence/interregional coexpression of genes were also explored. R2SNs could be replicated in different datasets, regardless of the use of different feature subsets. R2SNs showed high reproducibility in the test-retest analysis (intraclass correlation coefficient > 0.7). In addition, the small-word property (σ > 2) and the high correlation between gene expression (R = 0.29, p < 0.001) and general intelligence were determined for R2SNs. Furthermore, the results have also been repeated in the Brainnetome atlas. R2SNs provide a novel, reliable, and biologically plausible method to understand human morphological covariance based on sMRI.
Collapse
Affiliation(s)
- Kun Zhao
- School of Biological Science & Medical Engineering, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, China
| | - Qiang Zheng
- School of Computer and Control Engineering, Yantai University, Yantai, China
| | - Tongtong Che
- School of Biological Science & Medical Engineering, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, China
| | - Martin Dyrba
- German Center for Neurodegenerative Diseases (DZNE), Rostock, Germany
| | - Qiongling Li
- School of Biological Science & Medical Engineering, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, China
| | - Yanhui Ding
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
| | - Yuanjie Zheng
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
| | - Yong Liu
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China
- Brainnetome Center & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China
- University of Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing, China
| | - Shuyu Li
- School of Biological Science & Medical Engineering, Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, China
| |
Collapse
|
41
|
Zhu W, Huang H, Yang S, Luo X, Zhu W, Xu S, Meng Q, Zuo C, Liu Y, Wang W. Cortical and Subcortical Grey Matter Abnormalities in White Matter Hyperintensities and Subsequent Cognitive Impairment. Neurosci Bull 2021; 37:789-803. [PMID: 33826095 PMCID: PMC8192646 DOI: 10.1007/s12264-021-00657-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 10/28/2020] [Indexed: 01/18/2023] Open
Abstract
Grey matter (GM) alterations may contribute to cognitive decline in individuals with white matter hyperintensities (WMH) but no consensus has yet emerged. Here, we investigated cortical thickness and grey matter volume in 23 WMH patients with mild cognitive impairment (WMH-MCI), 43 WMH patients without cognitive impairment, and 55 healthy controls. Both WMH groups showed GM atrophy in the bilateral thalamus, fronto-insular cortices, and several parietal-temporal regions, and the WMH-MCI group showed more extensive and severe GM atrophy. The GM atrophy in the thalamus and fronto-insular cortices was associated with cognitive decline in the WMH-MCI patients and may mediate the relationship between WMH and cognition in WMH patients. Furthermore, the main results were well replicated in an independent dataset from the Alzheimer's Disease Neuroimaging Initiative database and in other control analyses. These comprehensive results provide robust evidence of specific GM alterations underlying WMH and subsequent cognitive impairment.
Collapse
Affiliation(s)
- Wenhao Zhu
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Hao Huang
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Shiqi Yang
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Xiang Luo
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Wenzhen Zhu
- Department of Radiology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Shabei Xu
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Qi Meng
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Chengchao Zuo
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Yong Liu
- Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, 100876, China.
- University of the Chinese Academy of Sciences, Beijing, 100049, China.
| | - Wei Wang
- Department of Neurology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China.
| |
Collapse
|
42
|
Ding Y, Zhao K, Che T, Du K, Sun H, Liu S, Zheng Y, Li S, Liu B, Liu Y. Quantitative Radiomic Features as New Biomarkers for Alzheimer's Disease: An Amyloid PET Study. Cereb Cortex 2021; 31:3950-3961. [PMID: 33884402 DOI: 10.1093/cercor/bhab061] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 01/29/2021] [Accepted: 02/22/2021] [Indexed: 12/20/2022] Open
Abstract
Growing evidence indicates that amyloid-beta (Aβ) accumulation is one of the most common neurobiological biomarkers in Alzheimer's disease (AD). The primary aim of this study was to explore whether the radiomic features of Aβ positron emission tomography (PET) images are used as predictors and provide a neurobiological foundation for AD. The radiomics features of Aβ PET imaging of each brain region of the Brainnetome Atlas were computed for classification and prediction using a support vector machine model. The results showed that the area under the receiver operating characteristic curve (AUC) was 0.93 for distinguishing AD (N = 291) from normal control (NC; N = 334). Additionally, the AUC was 0.83 for the prediction of mild cognitive impairment (MCI) converting (N = 88) (vs. no conversion, N = 100) to AD. In the MCI and AD groups, the systemic analysis demonstrated that the classification outputs were significantly associated with clinical measures (apolipoprotein E genotype, polygenic risk scores, polygenic hazard scores, cerebrospinal fluid Aβ, and Tau, cognitive ability score, the conversion time for progressive MCI subjects and cognitive changes). These findings provide evidence that the radiomic features of Aβ PET images can serve as new biomarkers for clinical applications in AD/MCI, further providing evidence for predicting whether MCI subjects will convert to AD.
Collapse
Affiliation(s)
- Yanhui Ding
- School of Information Science and Engineering, Shandong Normal University, Ji'nan 250014, China
| | - Kun Zhao
- School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China.,Brainnetome Center & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Tongtong Che
- School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
| | - Kai Du
- Brainnetome Center & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,Center for Excellence in Brain Science and Intelligence Technology, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,University of Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing 100049, China
| | - Hongzan Sun
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang 110004, China
| | - Shu Liu
- Brainnetome Center & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,University of Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing 100049, China
| | - Yuanjie Zheng
- School of Information Science and Engineering, Shandong Normal University, Ji'nan 250014, China
| | - Shuyu Li
- School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China
| | - Bing Liu
- Brainnetome Center & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,Center for Excellence in Brain Science and Intelligence Technology, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,University of Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing 100049, China
| | - Yong Liu
- Brainnetome Center & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,Center for Excellence in Brain Science and Intelligence Technology, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.,University of Chinese Academy of Sciences, Chinese Academy of Sciences, Beijing 100049, China.,Pazhou Lab, Guangzhou 510330, China.,School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China
| | | |
Collapse
|
43
|
Qu Y, Wang P, Liu B, Song C, Wang D, Yang H, Zhang Z, Chen P, Kang X, Du K, Yao H, Zhou B, Han T, Zuo N, Han Y, Lu J, Yu C, Zhang X, Jiang T, Zhou Y, Liu Y. AI4AD: Artificial intelligence analysis for Alzheimer's disease classification based on a multisite DTI database. BRAIN DISORDERS 2021. [DOI: 10.1016/j.dscb.2021.100005] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
|
44
|
Manco L, Maffei N, Strolin S, Vichi S, Bottazzi L, Strigari L. Basic of machine learning and deep learning in imaging for medical physicists. Phys Med 2021; 83:194-205. [DOI: 10.1016/j.ejmp.2021.03.026] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Revised: 03/07/2021] [Accepted: 03/16/2021] [Indexed: 02/08/2023] Open
|
45
|
Ren H, Zhu J, Su X, Chen S, Zeng S, Lan X, Zou LY, Sughrue ME, Guo Y. Application of Structural and Functional Connectome Mismatch for Classification and Individualized Therapy in Alzheimer Disease. Front Public Health 2020; 8:584430. [PMID: 33330326 PMCID: PMC7732457 DOI: 10.3389/fpubh.2020.584430] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 10/09/2020] [Indexed: 12/12/2022] Open
Abstract
While machine learning approaches to analyzing Alzheimer disease connectome neuroimaging data have been studied, many have limited ability to provide insight in individual patterns of disease and lack the ability to provide actionable information about where in the brain a specific patient's disease is located. We studied a cohort of patients with Alzheimer disease who underwent resting state functional magnetic resonance imaging and diffusion tractography imaging. These images were processed, and a structural and functional connectivity matrix was generated using the HCP cortical and subcortical atlas. By generating a machine learning model, individual-level structural and functional anomalies detection and characterization were explored in this study. Our study found that structural disease burden in Alzheimer's patients is mainly focused in the subcortical structures and the Default mode network (DMN). Interestingly, functional anomalies were less consistent between individuals and less common in general in these patients. More intriguing was that some structural anomalies were noted in all patients in the study, namely a reduction in fibers involving parcellations in the right anterior cingulate. Alternately, the functional consequences of connectivity loss were cortical and variable. Integrated structural/functional connectomics might provide a useful tool for assessing AD progression, while few concerns have been made for analyzing the mismatch between these two. We performed a preliminary exploration into a set of Alzheimer disease data, intending to improve a personalized approach to understanding individual connectomes in an actionable manner. Specifically, we found that there were consistent patterns of white matter fiber loss, mainly focused around the DMN and deep subcortical structures, which were present in nearly all patients with clinical AD. Functional magnetic resonance imaging shows abnormal functional connectivity different within the patients, which may be used as the individual target for further therapeutic strategies making, like non-invasive stimulation technology.
Collapse
Affiliation(s)
- Huixia Ren
- Department of Neurology, The Second Clinical Medical College, Shenzhen People's Hospital, Jinan University, Shenzhen, China
- The First Affiliated Hospital, Jinan University, Guangzhou, China
| | - Jin Zhu
- Department of Medical Imaging, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Xiaolin Su
- Department of Neurology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Siyan Chen
- Department of Neurology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Silin Zeng
- Department of Neurology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Xiaoyong Lan
- Department of Neurology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Liang-Yu Zou
- Department of Neurology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| | - Michael E. Sughrue
- Centre for Minimally Invasive Neurosurgery, Prince of Wales Hospital, Sydney, NSW, Australia
| | - Yi Guo
- Department of Neurology, Shenzhen People's Hospital (The Second Clinical Medical College, Jinan University; The First Affiliated Hospital, Southern University of Science and Technology), Shenzhen, China
| |
Collapse
|