1
|
Ren CX, Xu GX, Dai DQ, Lin L, Sun Y, Liu QS. Cross-site prognosis prediction for nasopharyngeal carcinoma from incomplete multi-modal data. Med Image Anal 2024; 93:103103. [PMID: 38368752 DOI: 10.1016/j.media.2024.103103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 12/05/2023] [Accepted: 02/05/2024] [Indexed: 02/20/2024]
Abstract
Accurate prognosis prediction for nasopharyngeal carcinoma based on magnetic resonance (MR) images assists in the guidance of treatment intensity, thus reducing the risk of recurrence and death. To reduce repeated labor and sufficiently explore domain knowledge, aggregating labeled/annotated data from external sites enables us to train an intelligent model for a clinical site with unlabeled data. However, this task suffers from the challenges of incomplete multi-modal examination data fusion and image data heterogeneity among sites. This paper proposes a cross-site survival analysis method for prognosis prediction of nasopharyngeal carcinoma from domain adaptation viewpoint. Utilizing a Cox model as the basic framework, our method equips it with a cross-attention based multi-modal fusion regularization. This regularization model effectively fuses the multi-modal information from multi-parametric MR images and clinical features onto a domain-adaptive space, despite the absence of some modalities. To enhance the feature discrimination, we also extend the contrastive learning technique to censored data cases. Compared with the conventional approaches which directly deploy a trained survival model in a new site, our method achieves superior prognosis prediction performance in cross-site validation experiments. These results highlight the key role of cross-site adaptability of our method and support its value in clinical practice.
Collapse
Affiliation(s)
- Chuan-Xian Ren
- School of Mathematics, Sun Yat-sen University, Guangzhou 510275, China.
| | - Geng-Xin Xu
- School of Mathematics, Sun Yat-sen University, Guangzhou 510275, China
| | - Dao-Qing Dai
- School of Mathematics, Sun Yat-sen University, Guangzhou 510275, China
| | - Li Lin
- Department of Radiation Oncology, Sun Yat-sen University Cancer Center; State Key Laboratory of Oncology in South China; Collaborative Innovation Center for Cancer Medicine; Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou 510060, China
| | - Ying Sun
- Department of Radiation Oncology, Sun Yat-sen University Cancer Center; State Key Laboratory of Oncology in South China; Collaborative Innovation Center for Cancer Medicine; Guangdong Key Laboratory of Nasopharyngeal Carcinoma Diagnosis and Therapy, Guangzhou 510060, China
| | - Qing-Shan Liu
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| |
Collapse
|
2
|
Crystal O, Maralani PJ, Black S, Fischer C, Moody AR, Khademi A. Brain Age Estimation on a Dementia Cohort Using FLAIR MRI Biomarkers. AJNR Am J Neuroradiol 2023; 44:1384-1390. [PMID: 38050032 PMCID: PMC10714845 DOI: 10.3174/ajnr.a8059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 10/13/2023] [Indexed: 12/06/2023]
Abstract
BACKGROUND AND PURPOSE The prodromal stage of Alzheimer's disease presents an imperative intervention window. This work focuses on using brain age prediction models and biomarkers from FLAIR MR imaging to identify subjects who progress to Alzheimer's disease (converting mild cognitive impairment) or those who remain stable (stable mild cognitive impairment). MATERIALS AND METHODS A machine learning model was trained to predict the age of normal control subjects on the basis of volume, intensity, and texture features from 3239 FLAIR MRI volumes. The brain age gap estimation (BrainAGE) was computed as the difference between the predicted and true age, and it was used as a biomarker for both cross-sectional and longitudinal analyses. Differences in biomarker means, slopes, and intercepts were investigated using ANOVA and Tukey post hoc test. Correlation analysis was performed between brain age gap estimation and established Alzheimer's disease indicators. RESULTS The brain age prediction model showed accurate results (mean absolute error = 2.46 years) when testing on held out normal control data. The computed BrainAGE metric showed significant differences between the stable mild cognitive impairment and converting mild cognitive impairment groups in cross-sectional and longitudinal analyses, most notably showing significant differences up to 4 years before conversion to Alzheimer's disease. A significant correlation was found between BrainAGE and previously established Alzheimer's disease conversion biomarkers. CONCLUSIONS The BrainAGE metric can allow clinicians to consider a single explainable value that summarizes all the biomarkers because it considers many dimensions of disease and can determine whether the subject has normal aging patterns or if he or she is trending into a high-risk category using a single value.
Collapse
Affiliation(s)
- Owen Crystal
- From the Department of Electrical, Computer and Biomedical Engineering (O.C., A.K.), Toronto Metropolitan University, Toronto, Ontario, Canada
- Institute of Biomedical Engineering, Science and Technology (O.C., A.K.), Toronto, Ontario, Canada
| | - Pejman J Maralani
- Department of Medical Imaging (P.J.M., A.R.M., A.K.), University of Toronto, Toronto, Ontario, Canada
| | - Sandra Black
- Institute of Medical Science (S.B., C.F.), University of Toronto, Toronto, Ontario, Canada
- Department of Neurology (S.B.), University of Toronto, Toronto, Ontario, Canada
- Hurvitz Brain Sciences Research Program (S.B.), Sunnybrook Research Institute, Toronto, Ontario, Canada
- Division of Neurology (S.B.), Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
- L.C. Campbell Cognitive Neurology Research Unit (S.B.), Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| | - Corinne Fischer
- Institute of Medical Science (S.B., C.F.), University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry (C.F.), St. Michael's Hospital, Toronto, Ontario, Canada
- Keenan Research Center (C.F., A.K.), St. Michael's Hospital, Toronto, Ontario, Canada
| | - Alan R Moody
- Department of Medical Imaging (P.J.M., A.R.M., A.K.), University of Toronto, Toronto, Ontario, Canada
| | - April Khademi
- From the Department of Electrical, Computer and Biomedical Engineering (O.C., A.K.), Toronto Metropolitan University, Toronto, Ontario, Canada
- Department of Medical Imaging (P.J.M., A.R.M., A.K.), University of Toronto, Toronto, Ontario, Canada
- Keenan Research Center (C.F., A.K.), St. Michael's Hospital, Toronto, Ontario, Canada
- Institute of Biomedical Engineering, Science and Technology (O.C., A.K.), Toronto, Ontario, Canada
- Vector Institute for Artificial Intelligence (A.K.), Toronto, Ontario, Canada
| |
Collapse
|
3
|
Crystal O, Maralani PJ, Black S, Fischer C, Moody AR, Khademi A. Detecting conversion from mild cognitive impairment to Alzheimer's disease using FLAIR MRI biomarkers. Neuroimage Clin 2023; 40:103533. [PMID: 37952286 PMCID: PMC10666029 DOI: 10.1016/j.nicl.2023.103533] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 10/05/2023] [Accepted: 10/26/2023] [Indexed: 11/14/2023]
Abstract
Mild cognitive impairment (MCI) is the prodromal phase of Alzheimer's disease (AD) and while it presents as an imperative intervention window, it is difficult to detect which subjects convert to AD (cMCI) and which ones remain stable (sMCI). The objective of this work was to investigate fluid-attenuated inversion recovery (FLAIR) MRI biomarkers and their ability to differentiate between sMCI and cMCI subjects in cross-sectional and longitudinal data. Three types of biomarkers were investigated: volume, intensity and texture. Volume biomarkers included total brain volume, cerebrospinal fluid volume (CSF), lateral ventricular volume, white matter lesion volume, subarachnoid CSF, and grey matter (GM) and white matter (WM), all normalized to intracranial volume. The mean intensity, kurtosis, and skewness of the GM and WM made up the intensity features. Texture features quantified homogeneity and microstructural tissue changes of GM and WM regions. Composite indices were also considered, which are biomarkers that represent an aggregate sum (z-score normalization and summation) of all biomarkers. The FLAIR MRI biomarkers successfully identified high-risk subjects as significant differences (p < 0.05) were found between the means of the sMCI and cMCI groups and the rate of change over time for several individual biomarkers as well as the composite indices for both cross-sectional and longitudinal analyses. Classification accuracy and feature importance analysis showed volume biomarkers to be most predictive, however, best performance was obtained when complimenting the volume biomarkers with the intensity and texture features. Using all the biomarkers, accuracy of 86.2 % and 69.2 % was achieved for normal control-AD and sMCI-cMCI classification respectively. Survival analysis demonstrated that the majority of the biomarkers showed a noticeable impact on the AD conversion probability 4 years prior to conversion. Composite indices were the top performers for all analyses including feature importance, classification, and survival analysis. This demonstrated their ability to summarize various dimensions of disease into single-valued metrics. Significant correlation (p < 0.05) with phosphorylated-tau and amyloid-beta CSF biomarkers was found with all the FLAIR biomarkers. The proposed biomarker system is easily attained as FLAIR is routinely acquired, models are not computationally intensive and the results are explainable, thus making this pipeline easily integrated into clinical workflow.
Collapse
Affiliation(s)
- Owen Crystal
- Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON, Canada; Keenan Research Center, St. Michael's Hospital, Toronto, ON, Canada.
| | - Pejman J Maralani
- Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - Sandra Black
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada; Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, Toronto, ON, Canada; Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON, Canada; L.C. Campbell Cognitive Neurology Research Unit, Sunnybrook Health Sciences Centre, Toronto, ON, Canada; Department of Neurology, University of Toronto, Toronto, ON, Canada
| | - Corinne Fischer
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada; Department of Psychiatry, St. Michael's Hospital, Toronto, ON, Canada; Keenan Research Center, St. Michael's Hospital, Toronto, ON, Canada
| | - Alan R Moody
- Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - April Khademi
- Electrical, Computer and Biomedical Engineering, Toronto Metropolitan University, Toronto, ON, Canada; Department of Medical Imaging, University of Toronto, Toronto, ON, Canada; Keenan Research Center, St. Michael's Hospital, Toronto, ON, Canada; Institute of Biomedical Engineering, Science and Technology (iBEST), Toronto, ON, Canada October 5, 2023; Vector Institute for Artificial Intelligence, Toronto, ON, Canada
| |
Collapse
|
4
|
Lee M, Kwak HG, Kim HJ, Won DO, Lee SW. SeriesSleepNet: an EEG time series model with partial data augmentation for automatic sleep stage scoring. Front Physiol 2023; 14:1188678. [PMID: 37700762 PMCID: PMC10494443 DOI: 10.3389/fphys.2023.1188678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2023] [Accepted: 08/10/2023] [Indexed: 09/14/2023] Open
Abstract
Introduction: We propose an automatic sleep stage scoring model, referred to as SeriesSleepNet, based on convolutional neural network (CNN) and bidirectional long short-term memory (bi-LSTM) with partial data augmentation. We used single-channel raw electroencephalography signals for automatic sleep stage scoring. Methods: Our framework was focused on time series information, so we applied partial data augmentation to learn the connected time information in small series. In specific, the CNN module learns the time information of one epoch (intra-epoch) whereas the bi-LSTM trains the sequential information between the adjacent epochs (inter-epoch). Note that the input of the bi-LSTM is the augmented CNN output. Moreover, the proposed loss function was used to fine-tune the model by providing additional weights. To validate the proposed framework, we conducted two experiments using the Sleep-EDF and SHHS datasets. Results and Discussion: The results achieved an overall accuracy of 0.87 and 0.84 and overall F1-score of 0.80 and 0.78 and kappa value of 0.81 and 0.78 for five-class classification, respectively. We showed that the SeriesSleepNet was superior to the baselines based on each component in the proposed framework. Our architecture also outperformed the state-of-the-art methods with overall F1-score, accuracy, and kappa value. Our framework could provide information on sleep disorders or quality of sleep to automatically classify sleep stages with high performance.
Collapse
Affiliation(s)
- Minji Lee
- Department of Biomedical Software Engineering, The Catholic University of Korea, Bucheon, Republic of Korea
| | - Heon-Gyu Kwak
- Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea
| | - Hyeong-Jin Kim
- Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea
| | - Dong-Ok Won
- Department of Artificial Intelligence Convergence, Hallym University, Chuncheon, Republic of Korea
| | - Seong-Whan Lee
- Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea
| |
Collapse
|
5
|
Jo HN, Kweon YS, Shin GH, Kwak HG, Lee SW. Neurophysiological Response Based on Auditory Sense for Brain Modulation Using Monaural Beat. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38082845 DOI: 10.1109/embc40787.2023.10340294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Brain modulation is a modification process of brain activity through external stimulations. However, which condition can induce the activation is still unclear. Therefore, we aimed to identify brain activation conditions using 40 Hz monaural beat (MB). Under this stimulation, auditory sense status which is determined by frequency and power range is the condition to consider. Hence, we designed five sessions to compare; no stimulation, audible (AB), inaudible in frequency, inaudible in power, and inaudible in frequency and power. Ten healthy participants underwent each stimulation session for ten minutes with electroencephalogram (EEG) recording. For analysis, we calculated the power spectral density (PSD) of EEG for each session and compared them in frequency, time, and five brain regions. As a result, we observed the prominent power peak at 40 Hz in only AB. The induced EEG amplitude increase started at one minute and increased until the end of the session. These results of AB had significant differences in frontal, central, temporal, parietal, and occipital regions compared to other stimulations. From the statistical analysis, the PSD of the right temporal region was significantly higher than the left. We figure out the role that the auditory sense is important to lead brain activation. These findings help to understand the neurophysiological principle and effects of auditory stimulation.
Collapse
|
6
|
Song L, Huang CR, Pan SZ, Zhu JG, Cheng ZQ, Yu X, Xue L, Xia F, Zhang JY, Wu DP, Miao LY. A model based on machine learning for the prediction of cyclosporin A trough concentration in Chinese allo-HSCT patients. Expert Rev Clin Pharmacol 2023; 16:83-91. [PMID: 36373407 DOI: 10.1080/17512433.2023.2142561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Cyclosporin A is a calcineurin inhibitor which has a narrow therapeutic window and high interindividual variability. Various population pharmacokinetic models have been reported; however, professional software and technical personnel were needed and the variables of the models were limited. Therefore, the aim of this study was to establish a model based on machine learning to predict CsA trough concentrations in Chinese allo-HSCT patients. METHODS A total of 7874 cases of CsA therapeutic drug monitoring data from 2069 allo-HSCT patients were retrospectively included. Sequential forward selection was used to select variable subsets, and eight different algorithms were applied to establish the prediction model. RESULTS XGBoost exhibited the highest prediction ability. Except for the variables that were identified by previous studies, some rarely reported variables were found, such as norethindrone, WBC, PAB, and hCRP. The prediction accuracy within ±30% of the actual trough concentration was above 0.80, and the predictive ability of the models was demonstrated to be effective in external validation. CONCLUSION In this study, models based on machine learning technology were established to predict CsA levels 3-4 days in advance during the early inpatient phase after HSCT. A new perspective for CsA clinical application is provided.
Collapse
Affiliation(s)
- Lin Song
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China.,College of Pharmaceutical Sciences, Soochow University, Suzhou, China
| | - Chen-Rong Huang
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China
| | - Shi-Zheng Pan
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China.,College of Pharmaceutical Sciences, Soochow University, Suzhou, China
| | - Jian-Guo Zhu
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China
| | - Zong-Qi Cheng
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China
| | - Xun Yu
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China
| | - Ling Xue
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China
| | - Fan Xia
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China
| | | | - De-Pei Wu
- National Clinical Research Center for Hematologic Diseases, Jiangsu Institute of Hematology, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Li-Yan Miao
- Department of Pharmacy, the First Affiliated Hospital of Soochow University, Suzhou, China.,College of Pharmaceutical Sciences, Soochow University, Suzhou, China.,National Clinical Research Center for Hematologic Diseases, The First Affiliated Hospital of Soochow University, Suzhou, China
| |
Collapse
|
7
|
Xu L, Wu H, He C, Wang J, Zhang C, Nie F, Chen L. Multi-modal sequence learning for Alzheimer’s disease progression prediction with incomplete variable-length longitudinal data. Med Image Anal 2022; 82:102643. [DOI: 10.1016/j.media.2022.102643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 08/27/2022] [Accepted: 09/23/2022] [Indexed: 11/28/2022]
|
8
|
Rojas-Hernández R, Díaz-de-León-Santiago JL, Barceló-Alonso G, Bautista-López J, Trujillo-Mora V, Salgado-Ramírez JC. Lossless Medical Image Compression by Using Difference Transform. ENTROPY 2022; 24:e24070951. [PMID: 35885174 PMCID: PMC9323066 DOI: 10.3390/e24070951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 07/01/2022] [Accepted: 07/05/2022] [Indexed: 12/04/2022]
Abstract
This paper introduces a new method of compressing digital images by using the Difference Transform applied in medical imaging. The Difference Transform algorithm performs the decorrelation process of image data, and in this way improves the encoding process, achieving a file with a smaller size than the original. The proposed method proves to be competitive and in many cases better than the standards used for medical images such as TIFF or PNG. In addition, the Difference Transform can replace other transforms like Cosine or Wavelet.
Collapse
Affiliation(s)
- Rafael Rojas-Hernández
- Ingeniería en Computación, Universidad Autónoma del Estado de México, Zumpango 55600, Mexico; (R.R.-H.); (J.B.-L.); (V.T.-M.)
| | - Juan Luis Díaz-de-León-Santiago
- Centro de Investigación en Computación, Instituto Politécnico Nacional (CIC-IPN), Mexico City 07700, Mexico
- Correspondence: (J.L.D.-d.-L.S.); (J.C.S.-R.)
| | | | - Jorge Bautista-López
- Ingeniería en Computación, Universidad Autónoma del Estado de México, Zumpango 55600, Mexico; (R.R.-H.); (J.B.-L.); (V.T.-M.)
| | - Valentin Trujillo-Mora
- Ingeniería en Computación, Universidad Autónoma del Estado de México, Zumpango 55600, Mexico; (R.R.-H.); (J.B.-L.); (V.T.-M.)
| | - Julio César Salgado-Ramírez
- Ingeniería Biomédica, Universidad Politécnica de Pachuca(UPP), Zempoala 43830, Mexico
- Correspondence: (J.L.D.-d.-L.S.); (J.C.S.-R.)
| |
Collapse
|
9
|
Liu K, Li Q, Yao L, Guo X. The Coupled Representation of Hierarchical Features for Mild Cognitive Impairment and Alzheimer's Disease Classification. Front Neurosci 2022; 16:902528. [PMID: 35720713 PMCID: PMC9205193 DOI: 10.3389/fnins.2022.902528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 04/25/2022] [Indexed: 11/15/2022] Open
Abstract
Structural magnetic resonance imaging (MRI) features have played an increasingly crucial role in discriminating patients with Alzheimer's disease (AD) and mild cognitive impairment (MCI) from normal controls (NC). However, the large number of structural MRI studies only extracted low-level neuroimaging features or simply concatenated multitudinous features while ignoring the interregional covariate information. The appropriate representation and integration of multilevel features will be preferable for the precise discrimination in the progression of AD. In this study, we proposed a novel inter-coupled feature representation method and built an integration model considering the two-level (the regions of interest (ROI) level and the network level) coupled features based on structural MRI data. For the intra-coupled interactions about the network-level features, we performed the ROI-level (intra- and inter-) coupled interaction within each network by feature expansion and coupling learning. For the inter-coupled interaction of the network-level features, we measured the coupled relationships among different networks via Canonical correlation analysis. We evaluated the classification performance using coupled feature representations on the Alzheimer's Disease Neuroimaging Initiative (ADNI) database. Results showed that the coupled integration model with hierarchical features achieved the optimal classification performance with an accuracy of 90.44% for AD and NC groups, with an accuracy of 87.72% for the MCI converter (MCI-c) and MCI non-converter (MCI-nc) groups. These findings suggested that our two-level coupled interaction representation of hierarchical features has been the effective means for the precise discrimination of MCI-c from MCI-nc groups and, therefore, helpful in the characterization of different AD courses.
Collapse
Affiliation(s)
- Ke Liu
- School of Artificial Intelligence, Beijing Normal University, Beijing, China
- Engineering Research Center of Intelligent Technology and Educational Application, Beijing Normal University, Beijing, China
| | - Qing Li
- School of Artificial Intelligence, Beijing Normal University, Beijing, China
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Li Yao
- School of Artificial Intelligence, Beijing Normal University, Beijing, China
- Engineering Research Center of Intelligent Technology and Educational Application, Beijing Normal University, Beijing, China
| | - Xiaojuan Guo
- School of Artificial Intelligence, Beijing Normal University, Beijing, China
- Engineering Research Center of Intelligent Technology and Educational Application, Beijing Normal University, Beijing, China
- Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| |
Collapse
|
10
|
Wei X, Du X, Xie Y, Suo X, He X, Ding H, Zhang Y, Ji Y, Chai C, Liang M, Yu C, Liu Y, Qin W. Mapping cerebral atrophic trajectory from amnestic mild cognitive impairment to Alzheimer's disease. Cereb Cortex 2022; 33:1310-1327. [PMID: 35368064 PMCID: PMC9930625 DOI: 10.1093/cercor/bhac137] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 02/13/2022] [Accepted: 03/13/2022] [Indexed: 11/14/2022] Open
Abstract
Alzheimer's disease (AD) patients suffer progressive cerebral atrophy before dementia onset. However, the region-specific atrophic processes and the influences of age and apolipoprotein E (APOE) on atrophic trajectory are still unclear. By mapping the region-specific nonlinear atrophic trajectory of whole cerebrum from amnestic mild cognitive impairment (aMCI) to AD based on longitudinal structural magnetic resonance imaging data from Alzheimer's disease Neuroimaging Initiative (ADNI) database, we unraveled a quadratic accelerated atrophic trajectory of 68 cerebral regions from aMCI to AD, especially in the superior temporal pole, caudate, and hippocampus. Besides, interaction analyses demonstrated that APOE ε4 carriers had faster atrophic rates than noncarriers in 8 regions, including the caudate, hippocampus, insula, etc.; younger patients progressed faster than older patients in 32 regions, especially for the superior temporal pole, hippocampus, and superior temporal gyrus; and 15 regions demonstrated complex interaction among age, APOE, and disease progression, including the caudate, hippocampus, etc. (P < 0.05/68, Bonferroni correction). Finally, Cox proportional hazards regression model based on the identified region-specific biomarkers could effectively predict the time to AD conversion within 10 years. In summary, cerebral atrophic trajectory mapping could help a comprehensive understanding of AD development and offer potential biomarkers for predicting AD conversion.
Collapse
Affiliation(s)
| | | | | | | | - Xiaoxi He
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China
| | - Hao Ding
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China,School of Medical Imaging, Tianjin Medical University, Tianjin 300070, China
| | - Yu Zhang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China
| | - Yi Ji
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China
| | - Chao Chai
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China
| | - Meng Liang
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China,School of Medical Imaging, Tianjin Medical University, Tianjin 300070, China
| | - Chunshui Yu
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin 300052, China,Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Tianjin 300052, China,School of Medical Imaging, Tianjin Medical University, Tianjin 300070, China
| | - Yong Liu
- Corresponding author: Wen Qin, Department of Radiology, and Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Anshan Road No 154, Heping District, Tianjin 300052, China. ; Yong Liu, School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China.
| | - Wen Qin
- Corresponding author: Wen Qin, Department of Radiology, and Tianjin Key Lab of Functional Imaging, Tianjin Medical University General Hospital, Anshan Road No 154, Heping District, Tianjin 300052, China. ; Yong Liu, School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China.
| | | |
Collapse
|
11
|
Feng J, Zhang SW, Chen L, Zuo C. Detection of Alzheimer’s Disease Using Features of Brain Region-of-Interest-Based Individual Network Constructed with the sMRI Image. Comput Med Imaging Graph 2022; 98:102057. [DOI: 10.1016/j.compmedimag.2022.102057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Revised: 02/18/2022] [Accepted: 03/17/2022] [Indexed: 10/18/2022]
|
12
|
Low-Rank Matrix Denoising Algorithm-Based MRI Image Feature for Therapeutic Effect Evaluation of NCRT on Rectal Cancer. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:3080640. [PMID: 34880974 PMCID: PMC8648445 DOI: 10.1155/2021/3080640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 10/31/2021] [Accepted: 11/03/2021] [Indexed: 11/17/2022]
Abstract
This study aimed to explore the therapeutic effects of neoadjuvant chemoradiotherapy (NCRT) on rectal cancer patients using the MRI based on low-rank matrix denoising algorithm, which was then compared with the postoperative pathological examination to evaluate its application value in tumor staging after NCRT treatment. 15 patients with rectal cancer who met the requirements of radiotherapy and chemotherapy after conventional MRI were selected as the research subjects. The conventional MRI images before and after NCRT treatment were divided in two groups. One group was not processed and set as the conventional group; the other group was processed with low-rank matrix denoising algorithm and set as the optimized group. The two groups of images were observed for the changes in the ADC value and length and thickness of the tumor before and after NCRT treatment. The two groups were compared with the pathological examination for the complete remission of pathology (pCR) after the NCRT treatment and the tumor stage results. The results showed that Root Mean Square Error (RMSE) and Peak Signal to Noise Ratio (PSNR) (18.9121 and 74.9911 dB) after introducing the low-rank matrix denoising algorithm were significantly better than those before (20.1234 and 70.1234 dB) (P < 0.05); there were notable differences in the tumor index data within the two groups before and after NCRT treatment (P < 0.05), indicating that the NCRT treatment was effective. The pathological examination results of pCR data of the two groups were not much different (P > 0.05); the examination results between the two groups were different, but no notable difference was noted (P < 0.05); in the optimized group, there was no notable difference between the MRI results and the pathological examination results (P < 0.05), while in the conventional group, there were notable differences in the MRI results and pathological examination results (P < 0.05). In conclusion, MRI images based on low-rank matrix denoising algorithm are clearer, which can improve the diagnosis rate of patients and better display the changes of the microenvironment after NCRT treatment. It also indicates that NCRT treatment has significant clinical effects in the treatment of rectal cancer patients, which is worth promoting.
Collapse
|
13
|
Walden LM, Hu S, Madabhushi A, Prescott JW. Amyloid Deposition Is Greater in Cerebral Gyri than in Cerebral Sulci with Worsening Clinical Diagnosis Across the Alzheimer's Disease Spectrum. J Alzheimers Dis 2021; 83:423-433. [PMID: 34334397 DOI: 10.3233/jad-210308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Histopathologic studies have demonstrated differential amyloid-β (Aβ) burden between cortical sulci and gyri in Alzheimer's disease (AD), with sulci having a greater Aβ burden. OBJECTIVE To characterize Aβ deposition in the sulci and gyri of the cerebral cortex in vivo among subjects with normal cognition (NC), mild cognitive impairment (MCI), and AD, and to evaluate if these differences could improve discrimination between diagnostic groups. METHODS T1-weighted 3T MR and florbetapir (amyloid) positron emission tomography (PET) data were obtained from the Alzheimer's Disease Neuroimaging Initiative (ADNI). T1 images were segmented and the cortex was separated into sulci/gyri based on pial surface curvature measurements. T1 images were registered to PET images and regional standardized uptake value ratios (SUVr) were calculated. A linear mixed effects model was used to analyze the relationship between clinical variables and amyloid PET SUVr measurements in the sulci/gyri. Receiver operating characteristic (ROC) analysis was performed to define amyloid positivity. Logistic models were used to evaluate predictive performance of clinical diagnosis using amyloid PET SUVr measurements in sulci/gyri. RESULTS 719 subjects were included: 272 NC, 315 MCI, and 132 AD. Gyral and sulcal Aβ increased with worsening cognition, however there was a greater increase in gyral Aβ. Females had a greater gyral and sulcal Aβ burden. Focusing on sulcal and gyral Aβ did not improve predictive power for diagnostic groups. CONCLUSION While there were significant differences in Aβ deposition in cerebral sulci and gyri across the AD spectrum, these differences did not translate into improved prediction of diagnosis. Females were found to have greater gyral and sulcal Aβ burden.
Collapse
Affiliation(s)
- Lucas M Walden
- MetroHealth, Department of Radiology, Cleveland, OH, USA
| | - Song Hu
- MetroHealth, Department of Radiology, Cleveland, OH, USA
| | - Anant Madabhushi
- Case Western Reserve University, Department of Biomedical Engineering, Center for Computational Imaging & Personalized Diagnostics, Cleveland, OH, USA.,Louis Stokes Cleveland VA Medical Center, Cleveland, OH, USA
| | - Jeffrey W Prescott
- MetroHealth, Department of Radiology, Cleveland, OH, USA.,Case Western Reserve University, School of Medicine, Cleveland, OH, USA
| | | |
Collapse
|
14
|
Fabrizio C, Termine A, Caltagirone C, Sancesario G. Artificial Intelligence for Alzheimer's Disease: Promise or Challenge? Diagnostics (Basel) 2021; 11:1473. [PMID: 34441407 PMCID: PMC8391160 DOI: 10.3390/diagnostics11081473] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 08/12/2021] [Accepted: 08/12/2021] [Indexed: 01/23/2023] Open
Abstract
Decades of experimental and clinical research have contributed to unraveling many mechanisms in the pathogenesis of Alzheimer's disease (AD), but the puzzle is still incomplete. Although we can suppose that there is no complete set of puzzle pieces, the recent growth of open data-sharing initiatives collecting lifestyle, clinical, and biological data from AD patients has provided a potentially unlimited amount of information about the disease, far exceeding the human ability to make sense of it. Moreover, integrating Big Data from multi-omics studies provides the potential to explore the pathophysiological mechanisms of the entire biological continuum of AD. In this context, Artificial Intelligence (AI) offers a wide variety of methods to analyze large and complex data in order to improve knowledge in the AD field. In this review, we focus on recent findings and future challenges for AI in AD research. In particular, we discuss the use of Computer-Aided Diagnosis tools for AD diagnosis and the use of AI to potentially support clinical practices for the prediction of individual risk of AD conversion as well as patient stratification in order to finally develop effective and personalized therapies.
Collapse
Affiliation(s)
- Carlo Fabrizio
- Laboratory of Experimental and Behavioral Neurophysiology, IRCCS Santa Lucia Foundation, 00143 Rome, Italy; (C.F.); (A.T.)
| | - Andrea Termine
- Laboratory of Experimental and Behavioral Neurophysiology, IRCCS Santa Lucia Foundation, 00143 Rome, Italy; (C.F.); (A.T.)
| | - Carlo Caltagirone
- Department of Clinical and Behavioral Neurology, IRCCS Santa Lucia Foundation, 00179 Rome, Italy;
| | - Giulia Sancesario
- Biobank, IRCCS Santa Lucia Foundation, 00179 Rome, Italy
- European Center for Brain Research, Experimental Neuroscience, 00143 Rome, Italy
| |
Collapse
|
15
|
Lu P, Colliot O. Multilevel Survival Modeling with Structured Penalties for Disease Prediction from Imaging Genetics data. IEEE J Biomed Health Inform 2021; 26:798-808. [PMID: 34329174 DOI: 10.1109/jbhi.2021.3100918] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This paper introduces a framework for disease prediction from multimodal genetic and imaging data. We propose a multilevel survival model which allows predicting the time of occurrence of a future disease state in patients initially exhibiting mild symptoms. This new multilevel setting allows modeling the interactions between genetic and imaging variables. This is in contrast with classical additive models which treat all modalities in the same manner and can result in undesirable elimination of specific modalities when their contributions are unbalanced. Moreover, the use of a survival model allows overcoming the limitations of previous approaches based on classification which consider a fixed time frame. Furthermore, we introduce specific penalties taking into account the structure of the different types of data, such as a group lasso penalty over the genetic modality and a L2-penalty over the imaging modality. Finally, we propose a fast optimization algorithm, based on a proximal gradient method. The approach was applied to the prediction of Alzheimer's disease (AD) among patients with mild cognitive impairment (MCI) based on genetic (single nucleotide polymorphisms - SNP) and imaging (anatomical MRI measures) data from the ADNI database. The experiments demonstrate the effectiveness of the method for predicting the time of conversion to AD. It revealed how genetic variants and brain imaging alterations interact in the prediction of future disease status. The approach is generic and could potentially be useful for the prediction of other diseases.
Collapse
|
16
|
Alzheimer's disease diagnosis framework from incomplete multimodal data using convolutional neural networks. J Biomed Inform 2021; 121:103863. [PMID: 34229061 DOI: 10.1016/j.jbi.2021.103863] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 06/09/2021] [Accepted: 07/01/2021] [Indexed: 11/23/2022]
Abstract
Alzheimer's disease (AD) is a severe irreversible neurodegenerative disease that has great sufferings on patients and eventually leads to death. Early detection of AD and its prodromal stage, mild cognitive impairment (MCI) which can be either stable (sMCI) or progressive (pMCI), is highly desirable for effective treatment planning and tailoring therapy. Recent studies recommended using multimodal data fusion of genetic (single nucleotide polymorphisms, SNPs) and neuroimaging data (magnetic resonance imaging (MRI) and positron emission tomography (PET)) to discriminate AD/MCI from normal control (NC) subjects. However, missing multimodal data in the cohort under study is inevitable. In addition, data heterogeneity between phenotypes and genotypes biomarkers makes learning capability of the models more challenging. Also, the current studies mainly focus on identifying brain disease classification and ignoring the regression task. Furthermore, they utilize multistage for predicting the brain disease progression. To address these issues, we propose a novel multimodal neuroimaging and genetic data fusion for joint classification and clinical score regression tasks using the maximum number of available samples in one unified framework using convolutional neural network (CNN). Specifically, we initially perform a technique based on linear interpolation to fill the missing features for each incomplete sample. Then, we learn the neuroimaging features from MRI, PET, and SNPs using CNN to alleviate the heterogeneity among genotype and phenotype data. Meanwhile, the high learned features from each modality are combined for jointly identifying brain diseases and predicting clinical scores. To validate the performance of the proposed method, we test our method on 805 subjects from Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. Also, we verify the similarity between the synthetic and real data using statistical analysis. Moreover, the experimental results demonstrate that the proposed method can yield better performance in both classification and regression tasks. Specifically, our proposed method achieves accuracy of 98.22%, 93.11%, and 97.35% for NC vs. AD, NC vs. sMCI, and NC vs. pMCI, respectively. On the other hand, our method attains the lowest root mean square error and the highest correlation coefficient for different clinical scores regression tasks compared with the state-of-the-art methods.
Collapse
|
17
|
Ouyang J, Zhao Q, Sullivan EV, Pfefferbaum A, Tapert SF, Adeli E, Pohl KM. Longitudinal Pooling & Consistency Regularization to Model Disease Progression From MRIs. IEEE J Biomed Health Inform 2021; 25:2082-2092. [PMID: 33270567 PMCID: PMC8221531 DOI: 10.1109/jbhi.2020.3042447] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Many neurological diseases are characterized by gradual deterioration of brain structure andfunction. Large longitudinal MRI datasets have revealed such deterioration, in part, by applying machine and deep learning to predict diagnosis. A popular approach is to apply Convolutional Neural Networks (CNN) to extract informative features from each visit of the longitudinal MRI and then use those features to classify each visit via Recurrent Neural Networks (RNNs). Such modeling neglects the progressive nature of the disease, which may result in clinically implausible classifications across visits. To avoid this issue, we propose to combine features across visits by coupling feature extraction with a novel longitudinal pooling layer and enforce consistency of the classification across visits in line with disease progression. We evaluate the proposed method on the longitudinal structural MRIs from three neuroimaging datasets: Alzheimer's Disease Neuroimaging Initiative (ADNI, N=404), a dataset composed of 274 normal controls and 329 patients with Alcohol Use Disorder (AUD), and 255 youths from the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA). In allthree experiments our method is superior to other widely used approaches for longitudinal classification thus making a unique contribution towards more accurate tracking of the impact of conditions on the brain. The code is available at https://github.com/ouyangjiahong/longitudinal-pooling.
Collapse
|
18
|
Jung W, Jun E, Suk HI. Deep recurrent model for individualized prediction of Alzheimer's disease progression. Neuroimage 2021; 237:118143. [PMID: 33991694 DOI: 10.1016/j.neuroimage.2021.118143] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 03/15/2021] [Accepted: 04/13/2021] [Indexed: 01/27/2023] Open
Abstract
Alzheimer's disease (AD) is known as one of the major causes of dementia and is characterized by slow progression over several years, with no treatments or available medicines. In this regard, there have been efforts to identify the risk of developing AD in its earliest time. While many of the previous works considered cross-sectional analysis, more recent studies have focused on the diagnosis and prognosis of AD with longitudinal or time series data in a way of disease progression modeling. Under the same problem settings, in this work, we propose a novel computational framework that can predict the phenotypic measurements of MRI biomarkers and trajectories of clinical status along with cognitive scores at multiple future time points. However, in handling time series data, it generally faces many unexpected missing observations. In regard to such an unfavorable situation, we define a secondary problem of estimating those missing values and tackle it in a systematic way by taking account of temporal and multivariate relations inherent in time series data. Concretely, we propose a deep recurrent network that jointly tackles the four problems of (i) missing value imputation, (ii) phenotypic measurements forecasting, (iii) trajectory estimation of a cognitive score, and (iv) clinical status prediction of a subject based on his/her longitudinal imaging biomarkers. Notably, the learnable parameters of all the modules in our predictive models are trained in an end-to-end manner by taking the morphological features and cognitive scores as input, with our circumspectly defined loss function. In our experiments over The Alzheimers Disease Prediction Of Longitudinal Evolution (TADPOLE) challenge cohort, we measured performance for various metrics and compared our method to competing methods in the literature. Exhaustive analyses and ablation studies were also conducted to better confirm the effectiveness of our method.
Collapse
Affiliation(s)
- Wonsik Jung
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Eunji Jun
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Heung-Il Suk
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea; Department of Artificial Intelligence, Korea University, Seoul 02841, Republic of Korea.
| | | |
Collapse
|
19
|
Vivar G, Kazi A, Burwinkel H, Zwergal A, Navab N, Ahmadi SA. Simultaneous imputation and classification using Multigraph Geometric Matrix Completion (MGMC): Application to neurodegenerative disease classification. Artif Intell Med 2021; 117:102097. [PMID: 34127236 DOI: 10.1016/j.artmed.2021.102097] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 05/04/2021] [Accepted: 05/05/2021] [Indexed: 10/21/2022]
Abstract
Large-scale population-based studies in medicine are a key resource towards better diagnosis, monitoring, and treatment of diseases. They also serve as enablers of clinical decision support systems, in particular computer-aided diagnosis (CADx) using machine learning (ML). Numerous ML approaches for CADx have been proposed in literature. However, these approaches assume feature-complete data, which is often not the case in clinical data. To account for missing data, incomplete data samples are either removed or imputed, which could lead to data bias and may negatively affect classification performance. As a solution, we propose an end-to-end learning of imputation and disease prediction of incomplete medical datasets via Multi-graph Geometric Matrix Completion (MGMC). MGMC uses multiple recurrent graph convolutional networks, where each graph represents an independent population model based on a key clinical meta-feature like age, sex, or cognitive function. Graph signal aggregation from local patient neighborhoods, combined with multi-graph signal fusion via self-attention, has a regularizing effect on both matrix reconstruction and classification performance. Our proposed approach is able to impute class relevant features as well as perform accurate and robust classification on two publicly available medical datasets. We empirically show the superiority of our proposed approach in terms of classification and imputation performance when compared with state-of-the-art approaches. MGMC enables disease prediction in multimodal and incomplete medical datasets. These findings could serve as baseline for future CADx approaches which utilize incomplete datasets.
Collapse
Affiliation(s)
- Gerome Vivar
- Department of Computer Aided Medical Procedures (CAMP), Technical University of Munich (TUM), Boltzmannstr. 3, 85748 Garching, Germany; German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians University (LMU), Fraunhoferstr. 20, 82152, Planegg, Germany
| | - Anees Kazi
- Department of Computer Aided Medical Procedures (CAMP), Technical University of Munich (TUM), Boltzmannstr. 3, 85748 Garching, Germany
| | - Hendrik Burwinkel
- Department of Computer Aided Medical Procedures (CAMP), Technical University of Munich (TUM), Boltzmannstr. 3, 85748 Garching, Germany
| | - Andreas Zwergal
- German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians University (LMU), Fraunhoferstr. 20, 82152, Planegg, Germany
| | - Nassir Navab
- Department of Computer Aided Medical Procedures (CAMP), Technical University of Munich (TUM), Boltzmannstr. 3, 85748 Garching, Germany
| | - Seyed-Ahmad Ahmadi
- Department of Computer Aided Medical Procedures (CAMP), Technical University of Munich (TUM), Boltzmannstr. 3, 85748 Garching, Germany; German Center for Vertigo and Balance Disorders (DSGZ), Ludwig-Maximilians University (LMU), Fraunhoferstr. 20, 82152, Planegg, Germany.
| | | |
Collapse
|
20
|
Teng X, Pei S, Lin YR. StoCast: Stochastic Disease Forecasting With Progression Uncertainty. IEEE J Biomed Health Inform 2021; 25:850-861. [PMID: 32750951 DOI: 10.1109/jbhi.2020.3006719] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Forecasting patients' disease progressions with rich longitudinal clinical data has drawn much attention in recent years due to its impactful application in healthcare and the medical field. Researchers have tackled this problem by leveraging traditional machine learning, statistical techniques and deep learning based models. However, existing methods suffer from either deterministic internal structures or over-simplified stochastic components, failing to deal with complex uncertain scenarios such as progression uncertainty (i.e., multiple possible trajectories) and data uncertainty (i.e., imprecise observations and misdiagnosis). To overcome these major uncertainty issues, we propose a novel deep generative model, Stochastic Disease Forecasting Model (StoCast), along with an associated neural network architecture StoCastNet, that can be trained efficiently via stochastic optimization techniques. Our StoCast model uses internal stochastic components to deal with departures of observed data from patients' true health states, and more importantly, is able to produce a comprehensive estimate of future disease progression trajectories. Based on two public datasets related to Alzheimer's disease and Parkinson's disease, we demonstrate how our StoCast model achieves robust and superior performance than deterministic baseline approaches, and conveys richer information that can potentially assist doctors to make decisions with greater confidence in a complex uncertain scenario.
Collapse
|
21
|
Mill RD, Gordon BA, Balota DA, Cole MW. Predicting dysfunctional age-related task activations from resting-state network alterations. Neuroimage 2020; 221:117167. [PMID: 32682094 PMCID: PMC7810059 DOI: 10.1016/j.neuroimage.2020.117167] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Revised: 06/25/2020] [Accepted: 07/11/2020] [Indexed: 11/12/2022] Open
Abstract
Alzheimer's disease (AD) is linked to changes in fMRI task activations and fMRI resting-state functional connectivity (restFC), which can emerge early in the illness timecourse. These fMRI correlates of unhealthy aging have been studied in largely separate subfields. Taking inspiration from neural network simulations, we propose a unifying mechanism wherein restFC alterations associated with AD disrupt the flow of activations between brain regions, leading to aberrant task activations. We apply this activity flow model in a large sample of clinically normal older adults, which was segregated into healthy (low-risk) and at-risk subgroups based on established imaging (positron emission tomography amyloid) and genetic (apolipoprotein) AD risk factors. Modeling the flow of healthy activations over at-risk AD connectivity effectively transformed the healthy aged activations into unhealthy (at-risk) aged activations. This enabled reliable prediction of at-risk AD task activations, and these predicted activations were related to individual differences in task behavior. These results support activity flow over altered intrinsic functional connections as a mechanism underlying Alzheimer's-related dysfunction, even in very early stages of the illness. Beyond these mechanistic insights, this approach raises clinical potential by enabling prediction of task activations and associated cognitive dysfunction in individuals without requiring them to perform in-scanner cognitive tasks.
Collapse
Affiliation(s)
- Ravi D Mill
- Center for Molecular and Behavioral Neuroscience, Rutgers University, 197 University Avenue, Newark, NJ 07102, USA.
| | - Brian A Gordon
- Department of Radiology, Washington University in St Louis, St Louis, MO 63110, USA
| | - David A Balota
- Department of Psychological and Brain Sciences, Washington University in St Louis, St Louis, MO 63130, USA
| | - Michael W Cole
- Center for Molecular and Behavioral Neuroscience, Rutgers University, 197 University Avenue, Newark, NJ 07102, USA
| |
Collapse
|
22
|
Ansart M, Epelbaum S, Bassignana G, Bône A, Bottani S, Cattai T, Couronné R, Faouzi J, Koval I, Louis M, Thibeau-Sutre E, Wen J, Wild A, Burgos N, Dormont D, Colliot O, Durrleman S. Predicting the progression of mild cognitive impairment using machine learning: A systematic, quantitative and critical review. Med Image Anal 2020; 67:101848. [PMID: 33091740 DOI: 10.1016/j.media.2020.101848] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2019] [Revised: 08/17/2020] [Accepted: 08/31/2020] [Indexed: 11/25/2022]
Abstract
We performed a systematic review of studies focusing on the automatic prediction of the progression of mild cognitive impairment to Alzheimer's disease (AD) dementia, and a quantitative analysis of the methodological choices impacting performance. This review included 172 articles, from which 234 experiments were extracted. For each of them, we reported the used data set, the feature types, the algorithm type, performance and potential methodological issues. The impact of these characteristics on the performance was evaluated using a multivariate mixed effect linear regressions. We found that using cognitive, fluorodeoxyglucose-positron emission tomography or potentially electroencephalography and magnetoencephalography variables significantly improved predictive performance compared to not including them, whereas including other modalities, in particular T1 magnetic resonance imaging, did not show a significant effect. The good performance of cognitive assessments questions the wide use of imaging for predicting the progression to AD and advocates for exploring further fine domain-specific cognitive assessments. We also identified several methodological issues, including the absence of a test set, or its use for feature selection or parameter tuning in nearly a fourth of the papers. Other issues, found in 15% of the studies, cast doubts on the relevance of the method to clinical practice. We also highlight that short-term predictions are likely not to be better than predicting that subjects stay stable over time. These issues highlight the importance of adhering to good practices for the use of machine learning as a decision support system for the clinical practice.
Collapse
Affiliation(s)
- Manon Ansart
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France.
| | - Stéphane Epelbaum
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France; Institute of Memory and Alzheimer's Disease (IM2A), Centre of excellence of neurodegenerative disease (CoEN), National Reference Center for Rare or Early Dementias, Department of Neurology, Pitié-Salpêtrière Hospital, AP-HP, Boulevard de l'hôpital, Paris, F-75013, France
| | - Giulia Bassignana
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Alexandre Bône
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Simona Bottani
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Tiziana Cattai
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France; Dept. of Information Engineering, Electronics and Telecommunication, Sapienza University of Rome, Italy
| | - Raphaël Couronné
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Johann Faouzi
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Igor Koval
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Maxime Louis
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Elina Thibeau-Sutre
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Junhao Wen
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Adam Wild
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Ninon Burgos
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France
| | - Didier Dormont
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France; AP-HP, Pitié-Salpêtrière hospital, Department of Neuroradiology, Paris, France
| | - Olivier Colliot
- Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France; Inria, Aramis project-team, Paris, F-75013, France; Institute of Memory and Alzheimer's Disease (IM2A), Centre of excellence of neurodegenerative disease (CoEN), National Reference Center for Rare or Early Dementias, Department of Neurology, Pitié-Salpêtrière Hospital, AP-HP, Boulevard de l'hôpital, Paris, F-75013, France; AP-HP, Pitié-Salpêtrière hospital, Department of Neuroradiology, Paris, France
| | - Stanley Durrleman
- Inria, Aramis project-team, Paris, F-75013, France; Institut du Cerveau et de la Moelle épinière, ICM, Paris, F-75013, France; Inserm, U 1127, Paris, F-75013, France; CNRS, UMR 7225, Paris, F-75013, France; Sorbonne Université, Paris, F-75013, France
| |
Collapse
|
23
|
Tjandra D, Migrino RQ, Giordani B, Wiens J. Cohort discovery and risk stratification for Alzheimer's disease: an electronic health record-based approach. ALZHEIMER'S & DEMENTIA (NEW YORK, N. Y.) 2020; 6:e12035. [PMID: 32548236 PMCID: PMC7293993 DOI: 10.1002/trc2.12035] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Accepted: 04/18/2020] [Indexed: 11/17/2022]
Abstract
BACKGROUND We sought to leverage data routinely collected in electronic health records (EHRs), with the goal of developing patient risk stratification tools for predicting risk of developing Alzheimer's disease (AD). METHOD Using EHR data from the University of Michigan (UM) hospitals and consensus-based diagnoses from the Michigan Alzheimer's Disease Research Center, we developed and validated a cohort discovery tool for identifying patients with AD. Applied to all UM patients, these labels were used to train an EHR-based machine learning model for predicting AD onset within 10 years. RESULTS Applied to a test cohort of 1697 UM patients, the model achieved an area under the receiver operating characteristics curve of 0.70 (95% confidence interval = 0.63-0.77). Important predictive factors included cardiovascular factors and laboratory blood testing. CONCLUSION Routinely collected EHR data can be used to predict AD onset with modest accuracy. Mining routinely collected data could shed light on early indicators of AD appearance and progression.
Collapse
Affiliation(s)
- Donna Tjandra
- Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn ArborMichiganUSA
| | - Raymond Q. Migrino
- Phoenix Veterans Affairs Health Care SystemPhoenixArizonaUSA
- Department of MedicineUniversity of Arizona College of Medicine‐PhoenixPhoenixArizonaUSA
| | - Bruno Giordani
- Department of Psychiatry, Neuropsychology ProgramUniversity of Michigan Ann ArborAnn ArborMichiganUSA
| | - Jenna Wiens
- Department of Electrical Engineering and Computer ScienceUniversity of MichiganAnn ArborMichiganUSA
| |
Collapse
|
24
|
Martí-Juan G, Sanroma-Guell G, Piella G. A survey on machine and statistical learning for longitudinal analysis of neuroimaging data in Alzheimer's disease. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 189:105348. [PMID: 31995745 DOI: 10.1016/j.cmpb.2020.105348] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Revised: 01/10/2020] [Accepted: 01/18/2020] [Indexed: 05/02/2023]
Abstract
BACKGROUND AND OBJECTIVES Recently, longitudinal studies of Alzheimer's disease have gathered a substantial amount of neuroimaging data. New methods are needed to successfully leverage and distill meaningful information on the progression of the disease from the deluge of available data. Machine learning has been used successfully for many different tasks, including neuroimaging related problems. In this paper, we review recent statistical and machine learning applications in Alzheimer's disease using longitudinal neuroimaging. METHODS We search for papers using longitudinal imaging data, focused on Alzheimer's Disease and published between 2007 and 2019 on four different search engines. RESULTS After the search, we obtain 104 relevant papers. We analyze their approach to typical challenges in longitudinal data analysis, such as missing data and variability in the number and extent of acquisitions. CONCLUSIONS Reviewed works show that machine learning methods using longitudinal data have potential for disease progression modelling and computer-aided diagnosis. We compare results and models, and propose future research directions in the field.
Collapse
Affiliation(s)
- Gerard Martí-Juan
- BCN Medtech, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain.
| | | | - Gemma Piella
- BCN Medtech, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain
| |
Collapse
|
25
|
Discriminative margin-sensitive autoencoder for collective multi-view disease analysis. Neural Netw 2020; 123:94-107. [DOI: 10.1016/j.neunet.2019.11.013] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2019] [Revised: 08/18/2019] [Accepted: 11/13/2019] [Indexed: 12/18/2022]
|
26
|
Analysis of the Quantization Noise in Discrete Wavelet Transform Filters for 3D Medical Imaging. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10041223] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Denoising and compression of 2D and 3D images are important problems in modern medical imaging systems. Discrete wavelet transform (DWT) is used to solve them in practice. We analyze the quantization noise effect in coefficients of DWT filters for 3D medical imaging in this paper. The method for wavelet filters coefficients quantizing is proposed, which allows minimizing resources in hardware implementation by simplifying rounding operations. We develop the method for estimating the maximum error of 3D grayscale and color images DWT with various bits per color (BPC). The dependence of the peak signal-to-noise ratio (PSNR) of the images processing result on wavelet used, the effective bit-width of filters coefficients and BPC is revealed. We derive formulas for determining the minimum bit-width of wavelet filters coefficients that provide a high (PSNR ≥ 40 dB for images with 8 BPC, for example) and maximum (PSNR = ∞ dB) quality of 3D medical imaging by DWT depending on wavelet used. The experiments of 3D tomographic images processing confirmed the accuracy of theoretical analysis. All data are presented in the fixed-point format in the proposed method of 3D medical images DWT. It is making possible efficient, from the point of view of hardware and time resources, the implementation for image denoising and compression on modern devices such as field-programmable gate arrays and application-specific integrated circuits.
Collapse
|
27
|
Zhou T, Thung KH, Liu M, Shi F, Zhang C, Shen D. Multi-modal latent space inducing ensemble SVM classifier for early dementia diagnosis with neuroimaging data. Med Image Anal 2020; 60:101630. [PMID: 31927474 PMCID: PMC8260095 DOI: 10.1016/j.media.2019.101630] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 12/15/2019] [Accepted: 12/19/2019] [Indexed: 12/21/2022]
Abstract
Fusing multi-modality data is crucial for accurate identification of brain disorder as different modalities can provide complementary perspectives of complex neurodegenerative disease. However, there are at least four common issues associated with the existing fusion methods. First, many existing fusion methods simply concatenate features from each modality without considering the correlations among different modalities. Second, most existing methods often make prediction based on a single classifier, which might not be able to address the heterogeneity of the Alzheimer's disease (AD) progression. Third, many existing methods often employ feature selection (or reduction) and classifier training in two independent steps, without considering the fact that the two pipelined steps are highly related to each other. Forth, there are missing neuroimaging data for some of the participants (e.g., missing PET data), due to the participants' "no-show" or dropout. In this paper, to address the above issues, we propose an early AD diagnosis framework via novel multi-modality latent space inducing ensemble SVM classifier. Specifically, we first project the neuroimaging data from different modalities into a latent space, and then map the learned latent representations into the label space to learn multiple diversified classifiers. Finally, we obtain the more reliable classification results by using an ensemble strategy. More importantly, we present a Complete Multi-modality Latent Space (CMLS) learning model for complete multi-modality data and also an Incomplete Multi-modality Latent Space (IMLS) learning model for incomplete multi-modality data. Extensive experiments using the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset have demonstrated that our proposed models outperform other state-of-the-art methods.
Collapse
Affiliation(s)
- Tao Zhou
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, NC 27599, USA; Inception Institute of Artificial Intelligence, Abu Dhabi 51133, United Arab Emirates.
| | - Kim-Han Thung
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, NC 27599, USA.
| | - Mingxia Liu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, NC 27599, USA.
| | - Feng Shi
- United Imaging Intelligence, Shanghai, China.
| | - Changqing Zhang
- School of Computer Science and Technology, Tianjin University, Tianjin 300072, China.
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, NC 27599, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea.
| |
Collapse
|
28
|
Lin W, Lv D, Han Z, Dong J, Yang L. Major depressive disorder identification by referenced multiset canonical correlation analysis with clinical scores. Med Image Anal 2020; 60:101600. [PMID: 31739280 DOI: 10.1016/j.media.2019.101600] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2018] [Revised: 07/23/2019] [Accepted: 11/01/2019] [Indexed: 11/24/2022]
Abstract
A novel method based on multiset canonical correlation analysis (mCCA) and linear discriminant analysis (LDA) is presented to identify the major depressive disorder (MDD). The new method comprises two parts, namely, the mCCA-rreg and sparse LDA models. The mCCA-rreg model extends the classical canonical correlation model to calculate functional connections by restricting the references to a reference space and adding a spatial regularization term. The reference space is used to ensure that the model extracts important components first from several datasets simultaneously by decreasing the importance of the components in which we are uninterested. The spatial regularization term helps in avoiding the multicollinearity and overfitting problems under the low signal-to-noise ratio circumstance. The sparse LDA model extends the classical LDA model to extract a small subset of discriminative classification features by fusing clinical scores. In the real data experiment, we extract two functional connection modes from 45 subjects by the mCCA-rreg model. Then, we construct classifiers to identify the patients with MDD based on the connections selected by the sparse LDA model. The best accuracy is higher than 95%. The results show that the mCCA-rreg model can retrieve the important components characterized by a preassigned reference space and exclude the noise or components of no interest. The sparse LDA model can extract discriminative classification features related to clinical scores.
Collapse
Affiliation(s)
- Wuhong Lin
- Guangdong Province Key Laboratory of Computational Science, School of Mathematics, Sun Yat-sen University, Guangzhou 510275, P.R.China.
| | - Dongsheng Lv
- Department of Psychiatry, Mental Health Institute of Inner Mongolia Autonomous Region, Hohhot 010010, P.R.China.
| | - Ziliang Han
- Department of Psychiatry, Mental Health Institute of Inner Mongolia Autonomous Region, Hohhot 010010, P.R.China.
| | - Jianwei Dong
- Guangdong Province Key Laboratory of Computational Science, School of Mathematics, Sun Yat-sen University, Guangzhou 510275, P.R.China.
| | - Lihua Yang
- Guangdong Province Key Laboratory of Computational Science, School of Mathematics, Sun Yat-sen University, Guangzhou 510275, P.R.China.
| |
Collapse
|
29
|
Giorgio J, Landau SM, Jagust WJ, Tino P, Kourtzi Z. Modelling prognostic trajectories of cognitive decline due to Alzheimer's disease. Neuroimage Clin 2020; 26:102199. [PMID: 32106025 PMCID: PMC7044529 DOI: 10.1016/j.nicl.2020.102199] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Revised: 01/24/2020] [Accepted: 01/25/2020] [Indexed: 01/13/2023]
Abstract
Alzheimer's disease (AD) is characterised by a dynamic process of neurocognitive changes from normal cognition to mild cognitive impairment (MCI) and progression to dementia. However, not all individuals with MCI develop dementia. Predicting whether individuals with MCI will decline (i.e. progressive MCI) or remain stable (i.e. stable MCI) is impeded by patient heterogeneity due to comorbidities that may lead to MCI diagnosis without progression to AD. Despite the importance of early diagnosis of AD for prognosis and personalised interventions, we still lack robust tools for predicting individual progression to dementia. Here, we propose a novel trajectory modelling approach based on metric learning (Generalised Metric Learning Vector Quantization) that mines multimodal data from MCI patients in the Alzheimer's disease Neuroimaging Initiative (ADNI) cohort to derive individualised prognostic scores of cognitive decline due to AD. We develop an integrated biomarker generation- using partial least squares regression- and classification methodology that extends beyond binary patient classification into discrete subgroups (i.e. stable vs. progressive MCI), determines individual profiles from baseline (i.e. cognitive or biological) data and predicts individual cognitive trajectories (i.e. change in memory scores from baseline). We demonstrate that a metric learning model trained on baseline cognitive data (memory, executive function, affective measurements) discriminates stable vs. progressive MCI individuals with high accuracy (81.4%), revealing an interaction between cognitive (memory, executive functions) and affective scores that may relate to MCI comorbidity (e.g. affective disturbance). Training the model to perform the same binary classification on biological data (mean cortical β-amyloid burden, grey matter density, APOE 4) results in similar prediction accuracy (81.9%). Extending beyond binary classifications, we develop and implement a trajectory modelling approach that shows significantly better performance in predicting individualised rate of future cognitive decline (i.e. change in memory scores from baseline), when the metric learning model is trained with biological (r = -0.68) compared to cognitive (r = -0.4) data. Our trajectory modelling approach reveals interpretable and interoperable markers of progression to AD and has strong potential to guide effective stratification of individuals based on prognostic disease trajectories, reducing MCI patient misclassification, that is critical for clinical practice and discovery of personalised interventions.
Collapse
Affiliation(s)
- Joseph Giorgio
- Department of Psychology, University of Cambridge, Cambridge, United Kingdom
| | - Susan M Landau
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA USA
| | - William J Jagust
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA USA
| | - Peter Tino
- School of Computer Science, University of Birmingham, Birmingham, United Kingdom
| | - Zoe Kourtzi
- Department of Psychology, University of Cambridge, Cambridge, United Kingdom.
| |
Collapse
|
30
|
Zhou T, Liu M, Thung KH, Shen D. Latent Representation Learning for Alzheimer's Disease Diagnosis With Incomplete Multi-Modality Neuroimaging and Genetic Data. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2411-2422. [PMID: 31021792 PMCID: PMC8034601 DOI: 10.1109/tmi.2019.2913158] [Citation(s) in RCA: 74] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
The fusion of complementary information contained in multi-modality data [e.g., magnetic resonance imaging (MRI), positron emission tomography (PET), and genetic data] has advanced the progress of automated Alzheimer's disease (AD) diagnosis. However, multi-modality based AD diagnostic models are often hindered by the missing data, i.e., not all the subjects have complete multi-modality data. One simple solution used by many previous studies is to discard samples with missing modalities. However, this significantly reduces the number of training samples, thus leading to a sub-optimal classification model. Furthermore, when building the classification model, most existing methods simply concatenate features from different modalities into a single feature vector without considering their underlying associations. As features from different modalities are often closely related (e.g., MRI and PET features are extracted from the same brain region), utilizing their inter-modality associations may improve the robustness of the diagnostic model. To this end, we propose a novel latent representation learning method for multi-modality based AD diagnosis. Specifically, we use all the available samples (including samples with incomplete modality data) to learn a latent representation space. Within this space, we not only use samples with complete multi-modality data to learn a common latent representation, but also use samples with incomplete multi-modality data to learn independent modality-specific latent representations. We then project the latent representations to the label space for AD diagnosis. We perform experiments using 737 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database, and the experimental results verify the effectiveness of our proposed method.
Collapse
Affiliation(s)
- Tao Zhou
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
- Inception Institute of Artificial Intelligence, Abu Dhabi 51133, United Arab Emirates
| | - Mingxia Liu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | - Kim-Han Thung
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| |
Collapse
|
31
|
Regional brain atrophy predicts time to conversion to Alzheimer's disease, dependent on baseline volume. Neurobiol Aging 2019; 83:86-94. [PMID: 31585370 DOI: 10.1016/j.neurobiolaging.2019.08.033] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2019] [Revised: 08/29/2019] [Accepted: 08/31/2019] [Indexed: 01/18/2023]
Abstract
A key question for the design of clinical trials for Alzheimer's disease (AD) is whether the timing of conversion from mild cognitive impairment (MCI) to AD can be predicted. This is also an important question for the clinical management of MCI. This study aims to address this question by exploring the contribution of baseline brain volume and annual volume change, using Cox regression, in predicting the time to conversion. Individuals with MCI, who converted to AD (n = 198), reverted to normal (n = 38), or remained stable (n = 96) for at least five years, were included in this study. The results revealed that the volumes of all the brain areas considered were predictive of the time to conversion from MCI to AD. Annual change in volume was also predictive of the time to conversion but only when initial volumes were above a certain threshold. This is important because it suggests that reduction in atrophy rate, which is the outcome of some clinical trials, is not inevitably associated with delay in conversion from MCI to AD.
Collapse
|
32
|
Goudarzvand S, St Sauver J, Mielke MM, Takahashi PY, Lee Y, Sohn S. Early temporal characteristics of elderly patient cognitive impairment in electronic health records. BMC Med Inform Decis Mak 2019; 19:149. [PMID: 31391041 PMCID: PMC6686236 DOI: 10.1186/s12911-019-0858-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
Background The aging population has led to an increase in cognitive impairment (CI) resulting in significant costs to patients, their families, and society. A research endeavor on a large cohort to better understand the frequency and severity of CI is urgent to respond to the health needs of this population. However, little is known about temporal trends of patient health functions (i.e., activity of daily living [ADL]) and how these trends are associated with the onset of CI in elderly patients. Also, the use of a rich source of clinical free text in electronic health records (EHRs) to facilitate CI research has not been well explored. The aim of this study is to characterize and better understand early signals of elderly patient CI by examining temporal trends of patient ADL and analyzing topics of patient medical conditions in clinical free text using topic models. Methods The study cohort consists of physician-diagnosed CI patients (n = 1,435) and cognitively unimpaired (CU) patients (n = 1,435) matched by age and sex, selected from patients 65 years of age or older at the time of enrollment in the Mayo Clinic Biobank. A corpus analysis was performed to examine the basic statistics of event types and practice settings where the physician first diagnosed CI. We analyzed the distribution of ADL in three different age groups over time before the development of CI. Furthermore, we applied three different topic modeling approaches on clinical free text to examine how patients’ medical conditions change over time when they were close to CI diagnosis. Results The trajectories of ADL deterioration became steeper in CI patients than CU patients approximately 1 to 1.5 year(s) before the actual physician diagnosis of CI. The topic modeling showed that the topic terms were mostly correlated and captured the underlying semantics relevant to CI when approaching to CI diagnosis. Conclusions There exist notable differences in temporal trends of basic and instrumental ADL between CI and CU patients. The trajectories of certain individual ADL, such as bathing and responsibility of own medication, were closely associated with CI development. The topic terms obtained by topic modeling methods from clinical free text have a potential to show how CI patients’ conditions evolve and reveal overlooked conditions when they close to CI diagnosis.
Collapse
Affiliation(s)
- Somaieh Goudarzvand
- School of Computing and Engineering, University of Missouri, Kansas City, MO, USA
| | | | | | | | - Yugyung Lee
- School of Computing and Engineering, University of Missouri, Kansas City, MO, USA
| | - Sunghwan Sohn
- Division of Digital Health Sciences, Mayo Clinic, Rochester, MN, USA.
| |
Collapse
|
33
|
Li H, Fan Y. EARLY PREDICTION OF ALZHEIMER'S DISEASE DEMENTIA BASED ON BASELINE HIPPOCAMPAL MRI AND 1-YEAR FOLLOW-UP COGNITIVE MEASURES USING DEEP RECURRENT NEURAL NETWORKS. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2019; 2019:368-371. [PMID: 31803346 DOI: 10.1109/isbi.2019.8759397] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
Multi-modal biological, imaging, and neuropsychological markers have demonstrated promising performance for distinguishing Alzheimer's disease (AD) patients from cognitively normal elders. However, it remains difficult to early predict when and which mild cognitive impairment (MCI) individuals will convert to AD dementia. Informed by pattern classification studies which have demonstrated that pattern classifiers built on longitudinal data could achieve better classification performance than those built on cross-sectional data, we develop a deep learning model based on recurrent neural networks (RNNs) to learn informative representation and temporal dynamics of longitudinal cognitive measures of individual subjects and combine them with baseline hippocampal MRI for building a prognostic model of AD dementia progression. Experimental results on a large cohort of MCI subjects have demonstrated that the deep learning model could learn informative measures from longitudinal data for characterizing the progression of MCI subjects to AD dementia, and the prognostic model could early predict AD progression with high accuracy.
Collapse
Affiliation(s)
- Hongming Li
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Yong Fan
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | | |
Collapse
|
34
|
Wee CY, Liu C, Lee A, Poh JS, Ji H, Qiu A. Cortical graph neural network for AD and MCI diagnosis and transfer learning across populations. Neuroimage Clin 2019; 23:101929. [PMID: 31491832 PMCID: PMC6627731 DOI: 10.1016/j.nicl.2019.101929] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2019] [Revised: 06/02/2019] [Accepted: 07/02/2019] [Indexed: 01/18/2023]
Abstract
Combining machine learning with neuroimaging data has a great potential for early diagnosis of mild cognitive impairment (MCI) and Alzheimer's disease (AD). However, it remains unclear how well the classifiers built on one population can predict MCI/AD diagnosis of other populations. This study aimed to employ a spectral graph convolutional neural network (graph-CNN), that incorporated cortical thickness and geometry, to identify MCI and AD based on 3089 T1-weighted MRI data of the ADNI-2 cohort, and to evaluate its feasibility to predict AD in the ADNI-1 cohort (n = 3602) and an Asian cohort (n = 347). For the ADNI-2 cohort, the graph-CNN showed classification accuracy of controls (CN) vs. AD at 85.8% and early MCI (EMCI) vs. AD at 79.2%, followed by CN vs. late MCI (LMCI) (69.3%), LMCI vs. AD (65.2%), EMCI vs. LMCI (60.9%), and CN vs. EMCI (51.8%). We demonstrated the robustness of the graph-CNN among the existing deep learning approaches, such as Euclidean-domain-based multilayer network and 1D CNN on cortical thickness, and 2D and 3D CNNs on T1-weighted MR images of the ADNI-2 cohort. The graph-CNN also achieved the prediction on the conversion of EMCI to AD at 75% and that of LMCI to AD at 92%. The find-tuned graph-CNN further provided a promising CN vs. AD classification accuracy of 89.4% on the ADNI-1 cohort and >90% on the Asian cohort. Our study demonstrated the feasibility to transfer AD/MCI classifiers learned from one population to the other. Notably, incorporating cortical geometry in CNN has the potential to improve classification performance.
Collapse
Affiliation(s)
- Chong-Yaw Wee
- Department of Biomedical Engineering and Clinical Research Center, National University of Singapore, Singapore
| | - Chaoqiang Liu
- Department of Biomedical Engineering and Clinical Research Center, National University of Singapore, Singapore
| | - Annie Lee
- Department of Biomedical Engineering and Clinical Research Center, National University of Singapore, Singapore
| | - Joann S Poh
- Department of Biomedical Engineering and Clinical Research Center, National University of Singapore, Singapore
| | - Hui Ji
- Department of Mathematics, National University of Singapore, Singapore
| | - Anqi Qiu
- Department of Biomedical Engineering and Clinical Research Center, National University of Singapore, Singapore.
| |
Collapse
|
35
|
Yu B, Zhou L, Wang L, Shi Y, Fripp J, Bourgeat P. Ea-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image Synthesis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:1750-1762. [PMID: 30714911 DOI: 10.1109/tmi.2019.2895894] [Citation(s) in RCA: 96] [Impact Index Per Article: 19.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Magnetic resonance (MR) imaging is a widely used medical imaging protocol that can be configured to provide different contrasts between the tissues in human body. By setting different scanning parameters, each MR imaging modality reflects the unique visual characteristic of scanned body part, benefiting the subsequent analysis from multiple perspectives. To utilize the complementary information from multiple imaging modalities, cross-modality MR image synthesis has aroused increasing research interest recently. However, most existing methods only focus on minimizing pixel/voxel-wise intensity difference but ignore the textural details of image content structure, which affects the quality of synthesized images. In this paper, we propose edge-aware generative adversarial networks (Ea-GANs) for cross-modality MR image synthesis. Specifically, we integrate edge information, which reflects the textural structure of image content and depicts the boundaries of different objects in images, to reduce this gap. Corresponding to different learning strategies, two frameworks are proposed, i.e., a generator-induced Ea-GAN (gEa-GAN) and a discriminator-induced Ea-GAN (dEa-GAN). The gEa-GAN incorporates the edge information via its generator, while the dEa-GAN further does this from both the generator and the discriminator so that the edge similarity is also adversarially learned. In addition, the proposed Ea-GANs are 3D-based and utilize hierarchical features to capture contextual information. The experimental results demonstrate that the proposed Ea-GANs, especially the dEa-GAN, outperform multiple state-of-the-art methods for cross-modality MR image synthesis in both qualitative and quantitative measures. Moreover, the dEa-GAN also shows excellent generality to generic image synthesis tasks on benchmark datasets about facades, maps, and cityscapes.
Collapse
|
36
|
Li H, Fan Y. EARLY PREDICTION OF ALZHEIMER'S DISEASE DEMENTIA BASED ON BASELINE HIPPOCAMPAL MRI AND 1-YEAR FOLLOW-UP COGNITIVE MEASURES USING DEEP RECURRENT NEURAL NETWORKS. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2019; 2019:368-371. [PMID: 31803346 PMCID: PMC6892161 DOI: 10.1109/isbi.2019.8759397 10.1109/isbi.2019.8759397] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/28/2023]
Abstract
Multi-modal biological, imaging, and neuropsychological markers have demonstrated promising performance for distinguishing Alzheimer's disease (AD) patients from cognitively normal elders. However, it remains difficult to early predict when and which mild cognitive impairment (MCI) individuals will convert to AD dementia. Informed by pattern classification studies which have demonstrated that pattern classifiers built on longitudinal data could achieve better classification performance than those built on cross-sectional data, we develop a deep learning model based on recurrent neural networks (RNNs) to learn informative representation and temporal dynamics of longitudinal cognitive measures of individual subjects and combine them with baseline hippocampal MRI for building a prognostic model of AD dementia progression. Experimental results on a large cohort of MCI subjects have demonstrated that the deep learning model could learn informative measures from longitudinal data for characterizing the progression of MCI subjects to AD dementia, and the prognostic model could early predict AD progression with high accuracy.
Collapse
Affiliation(s)
- Hongming Li
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| | - Yong Fan
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| |
Collapse
|
37
|
Zhou T, Thung KH, Liu M, Shen D. Brain-Wide Genome-Wide Association Study for Alzheimer's Disease via Joint Projection Learning and Sparse Regression Model. IEEE Trans Biomed Eng 2019; 66:165-175. [PMID: 29993426 PMCID: PMC6342004 DOI: 10.1109/tbme.2018.2824725] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Brain-wide and genome-wide association (BW-GWA) study is presented in this paper to identify the associations between the brain imaging phenotypes (i.e., regional volumetric measures) and the genetic variants [i.e., single nucleotide polymorphism (SNP)] in Alzheimer's disease (AD). The main challenges of this study include the data heterogeneity, complex phenotype-genotype associations, high-dimensional data (e.g., thousands of SNPs), and the existence of phenotype outliers. Previous BW-GWA studies, while addressing some of these challenges, did not consider the diagnostic label information in their formulations, thus limiting their clinical applicability. To address these issues, we present a novel joint projection and sparse regression model to discover the associations between the phenotypes and genotypes. Specifically, to alleviate the negative influence of data heterogeneity, we first map the genotypes into an intermediate imaging-phenotype-like space. Then, to better reveal the complex phenotype-genotype associations, we project both the mapped genotypes and the original imaging phenotypes into a diagnostic-label-guided joint feature space, where the intraclass projected points are constrained to be close to each other. In addition, we use l2,1-norm minimization on both the regression loss function and the transformation coefficient matrices, to reduce the effect of phenotype outliers and also to encourage sparse feature selections of both the genotypes and phenotypes. We evaluate our method using AD neuroimaging initiative dataset, and the results show that our proposed method outperforms several state-of-the-art methods in term of the average root-mean-square error of genome-to-phenotype predictions. Besides, the associated SNPs and brain regions identified in this study have also been shown in the previous AD-related studies, thus verifying the effectiveness and potential of our proposed method in AD pathogenesis study.
Collapse
Affiliation(s)
- Tao Zhou
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA ()
| | - Kim-Han Thung
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA ()
| | - Mingxia Liu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA ()
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, NC 27599 USA, and also with the Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea ()
| |
Collapse
|
38
|
Zhou T, Thung KH, Zhu X, Shen D. Effective feature learning and fusion of multimodality data using stage-wise deep neural network for dementia diagnosis. Hum Brain Mapp 2018; 40:1001-1016. [PMID: 30381863 DOI: 10.1002/hbm.24428] [Citation(s) in RCA: 110] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2017] [Revised: 09/04/2018] [Accepted: 10/03/2018] [Indexed: 12/13/2022] Open
Abstract
In this article, the authors aim to maximally utilize multimodality neuroimaging and genetic data for identifying Alzheimer's disease (AD) and its prodromal status, Mild Cognitive Impairment (MCI), from normal aging subjects. Multimodality neuroimaging data such as MRI and PET provide valuable insights into brain abnormalities, while genetic data such as single nucleotide polymorphism (SNP) provide information about a patient's AD risk factors. When these data are used together, the accuracy of AD diagnosis may be improved. However, these data are heterogeneous (e.g., with different data distributions), and have different number of samples (e.g., with far less number of PET samples than the number of MRI or SNPs). Thus, learning an effective model using these data is challenging. To this end, we present a novel three-stage deep feature learning and fusion framework, where deep neural network is trained stage-wise. Each stage of the network learns feature representations for different combinations of modalities, via effective training using the maximum number of available samples. Specifically, in the first stage, we learn latent representations (i.e., high-level features) for each modality independently, so that the heterogeneity among modalities can be partially addressed, and high-level features from different modalities can be combined in the next stage. In the second stage, we learn joint latent features for each pair of modality combination by using the high-level features learned from the first stage. In the third stage, we learn the diagnostic labels by fusing the learned joint latent features from the second stage. To further increase the number of samples during training, we also use data at multiple scanning time points for each training subject in the dataset. We evaluate the proposed framework using Alzheimer's disease neuroimaging initiative (ADNI) dataset for AD diagnosis, and the experimental results show that the proposed framework outperforms other state-of-the-art methods.
Collapse
Affiliation(s)
- Tao Zhou
- Department of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina
| | - Kim-Han Thung
- Department of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina
| | - Xiaofeng Zhu
- Department of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina
| | - Dinggang Shen
- Department of Radiology and the Biomedical Research Imaging Center, University of North Carolina, Chapel Hill, North Carolina.,Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea
| |
Collapse
|
39
|
Thung KH, Yap PT, Shen D. Joint Robust Imputation and Classification for Early Dementia Detection Using Incomplete Multi-modality Data. PREDICTIVE INTELLIGENCE IN MEDICINE. PRIME (WORKSHOP) 2018; 11121:51-59. [PMID: 34447978 PMCID: PMC8386184 DOI: 10.1007/978-3-030-00320-3_7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
It is vital to identify Mild Cognitive Impairment (MCI) subjects who will progress to Alzheimer's Disease (AD), so that early treatment can be administered. Recent studies show that using complementary information from multi-modality data may improve the model performance of the above prediction problem. However, multi-modality data is often incomplete, causing the prediction models that rely on complete data unusable. One way to deal with this issue is by first imputing the missing values, and then building a classifier based on the completed data. This two-step approach, however, may generate non-optimal classifier output, as the errors of the imputation may propagate to the classifier during training. To address this issue, we propose a unified framework that jointly performs feature selection, data denoising, missing values imputation, and classifier learning. To this end, we use a low-rank constraint to impute the missing values and denoise the data simultaneously, while using a regression model for feature selection and classification. The feature weights learned by the regression model are integrated into the low rank formulation to focus on discriminative features when denoising and imputing data, while the resulting low-rank matrix is used for classifier learning. These two components interact and correct each other iteratively using Alternating Direction Method of Multiplier (ADMM). The experimental results using incomplete multi-modality ADNI dataset shows that our proposed method outperforms other comparison methods.
Collapse
Affiliation(s)
- Kim-Han Thung
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, USA
| |
Collapse
|
40
|
Multi-modal Neuroimaging Data Fusion via Latent Space Learning for Alzheimer's Disease Diagnosis. PREDICTIVE INTELLIGENCE IN MEDICINE. PRIME (WORKSHOP) 2018; 11121:76-84. [PMID: 30788463 PMCID: PMC6378693 DOI: 10.1007/978-3-030-00320-3_10] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
Abstract
Recent studies have shown that fusing multi-modal neuroimaging data can improve the performance of Alzheimer's Disease (AD) diagnosis. However, most existing methods simply concatenate features from each modality without appropriate consideration of the correlations among multi-modalities. Besides, existing methods often employ feature selection (or fusion) and classifier training in two independent steps without consideration of the fact that the two pipelined steps are highly related to each other. Furthermore, existing methods that make prediction based on a single classifier may not be able to address the heterogeneity of the AD progression. To address these issues, we propose a novel AD diagnosis framework based on latent space learning with ensemble classifiers, by integrating the latent representation learning and ensemble of multiple diversified classifiers learning into a unified framework. To this end, we first project the neuroimaging data from different modalities into a common latent space, and impose a joint sparsity constraint on the concatenated projection matrices. Then, we map the learned latent representations into the label space to learn multiple diversified classifiers and aggregate their predictions to obtain the final classification result. Experimental results on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset show that our method outperforms other state-of-the-art methods.
Collapse
|
41
|
Jiao R, Lin N, Hu Z, Bennett DA, Jin L, Xiong M. Bivariate Causal Discovery and Its Applications to Gene Expression and Imaging Data Analysis. Front Genet 2018; 9:347. [PMID: 30233639 PMCID: PMC6127271 DOI: 10.3389/fgene.2018.00347] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Accepted: 08/09/2018] [Indexed: 01/16/2023] Open
Abstract
The mainstream of research in genetics, epigenetics, and imaging data analysis focuses on statistical association or exploring statistical dependence between variables. Despite their significant progresses in genetic research, understanding the etiology and mechanism of complex phenotypes remains elusive. Using association analysis as a major analytical platform for the complex data analysis is a key issue that hampers the theoretic development of genomic science and its application in practice. Causal inference is an essential component for the discovery of mechanical relationships among complex phenotypes. Many researchers suggest making the transition from association to causation. Despite its fundamental role in science, engineering, and biomedicine, the traditional methods for causal inference require at least three variables. However, quantitative genetic analysis such as QTL, eQTL, mQTL, and genomic-imaging data analysis requires exploring the causal relationships between two variables. This paper will focus on bivariate causal discovery with continuous variables. We will introduce independence of cause and mechanism (ICM) as a basic principle for causal inference, algorithmic information theory and additive noise model (ANM) as major tools for bivariate causal discovery. Large-scale simulations will be performed to evaluate the feasibility of the ANM for bivariate causal discovery. To further evaluate their performance for causal inference, the ANM will be applied to the construction of gene regulatory networks. Also, the ANM will be applied to trait-imaging data analysis to illustrate three scenarios: presence of both causation and association, presence of association while absence of causation, and presence of causation, while lack of association between two variables. Telling cause from effect between two continuous variables from observational data is one of the fundamental and challenging problems in omics and imaging data analysis. Our preliminary simulations and real data analysis will show that the ANMs will be one of choice for bivariate causal discovery in genomic and imaging data analysis.
Collapse
Affiliation(s)
- Rong Jiao
- Department of Biostatistics and Data Science, The University of Texas School of Public Health, Houston, TX, United States
| | - Nan Lin
- Department of Biostatistics and Data Science, The University of Texas School of Public Health, Houston, TX, United States
| | - Zixin Hu
- Ministry of Education Key Laboratory of Contemporary Anthropology, School of Life Sciences, Fudan University, Shanghai, China
| | - David A. Bennett
- Rush Alzheimer's Disease Center, Rush University Medical Center, Chicago, IL, United States
| | - Li Jin
- Ministry of Education Key Laboratory of Contemporary Anthropology, School of Life Sciences, Fudan University, Shanghai, China,Human Phenome Institute, Fudan University, Shanghai, China
| | - Momiao Xiong
- Department of Biostatistics and Data Science, The University of Texas School of Public Health, Houston, TX, United States,*Correspondence: Momiao Xiong
| |
Collapse
|