1
|
Javadi M, Sharma R, Tsiamyrtzis P, Webb AG, Leiss E, Tsekos NV. Let UNet Play an Adversarial Game: Investigating the Effect of Adversarial Training in Enhancing Low-Resolution MRI. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01205-8. [PMID: 39085718 DOI: 10.1007/s10278-024-01205-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 07/08/2024] [Accepted: 07/12/2024] [Indexed: 08/02/2024]
Abstract
Adversarial training has attracted much attention in enhancing the visual realism of images, but its efficacy in clinical imaging has not yet been explored. This work investigated adversarial training in a clinical context, by training 206 networks on the OASIS-1 dataset for improving low-resolution and low signal-to-noise ratio (SNR) magnetic resonance images. Each network corresponded to a different combination of perceptual and adversarial loss weights and distinct learning rate values. For each perceptual loss weighting, we identified its corresponding adversarial loss weighting that minimized structural disparity. Each optimally weighted adversarial loss yielded an average SSIM reduction of 1.5%. We further introduced a set of new metrics to assess other clinically relevant image features: Gradient Error (GE) to measure structural disparities; Sharpness to compute edge clarity; and Edge-Contrast Error (ECE) to quantify any distortion of the pixel distribution around edges. Including adversarial loss increased structural enhancement in visual inspection, which correlated with statistically consistent GE reductions (p-value << 0.05). This also resulted in increased Sharpness; however, the level of statistical significance was dependent on the perceptual loss weighting. Additionally, adversarial loss yielded ECE reductions for smaller perceptual loss weightings, while showing non-significant increases (p-value >> 0.05) when these weightings were higher, demonstrating that the increased Sharpness does not adversely distort the pixel distribution around the edges in the image. These studies clearly suggest that adversarial training significantly improves the performance of an MRI enhancement pipeline, and highlights the need for systematic studies of hyperparameter optimization and investigation of alternative image quality metrics.
Collapse
Affiliation(s)
- Mohammad Javadi
- Medical Robotics and Imaging Lab, Department of Computer Science, University of Houston, 501, Philip G. Hoffman Hall, 4800 Calhoun Road, Houston, TX, 77204, USA
| | - Rishabh Sharma
- Medical Robotics and Imaging Lab, Department of Computer Science, University of Houston, 501, Philip G. Hoffman Hall, 4800 Calhoun Road, Houston, TX, 77204, USA
| | - Panagiotis Tsiamyrtzis
- Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy
- Department of Statistics, Athens University of Economics and Business, Athens, Greece
| | - Andrew G Webb
- C.J. Gorter Center for High Field MRI, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Ernst Leiss
- Department of Computer Science, University of Houston, Houston, TX, USA
| | - Nikolaos V Tsekos
- Medical Robotics and Imaging Lab, Department of Computer Science, University of Houston, 501, Philip G. Hoffman Hall, 4800 Calhoun Road, Houston, TX, 77204, USA.
| |
Collapse
|
2
|
Zhang S, Ge M, Cheng H, Chen S, Li Y, Wang K. Classification of cognitive ability of healthy older individuals using resting-state functional connectivity magnetic resonance imaging and an extreme learning machine. BMC Med Imaging 2024; 24:72. [PMID: 38532313 DOI: 10.1186/s12880-024-01250-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 03/15/2024] [Indexed: 03/28/2024] Open
Abstract
BACKGROUND Quantitative determination of the correlation between cognitive ability and functional biomarkers in the older brain is essential. To identify biomarkers associated with cognitive performance in the older, this study combined an index model specific for resting-state functional connectivity (FC) with a supervised machine learning method. METHODS Performance scores on conventional cognitive test scores and resting-state functional MRI data were obtained for 98 healthy older individuals and 90 healthy youth from two public databases. Based on the test scores, the older cohort was categorized into two groups: excellent and poor. A resting-state FC scores model (rs-FCSM) was constructed for each older individual to determine the relative differences in FC among brain regions compared with that in the youth cohort. Brain areas sensitive to test scores could then be identified using this model. To suggest the effectiveness of constructed model, the scores of these brain areas were used as feature matrix inputs for training an extreme learning machine. classification accuracy (CA) was then tested in separate groups and validated by N-fold cross-validation. RESULTS This learning study could effectively classify the cognitive status of healthy older individuals according to the model scores of frontal lobe, temporal lobe, and parietal lobe with a mean accuracy of 86.67%, which is higher than that achieved using conventional correlation analysis. CONCLUSION This classification study of the rs-FCSM may facilitate early detection of age-related cognitive decline as well as help reveal the underlying pathological mechanisms.
Collapse
Affiliation(s)
- Shiying Zhang
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China.
- Hebei Province Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability, Hebei University of Technology, Tianjin, China.
- Tianjin Hebei University of Technology, 5340 Xiping Road, Beichen District, Tianjin, 300130, China.
| | - Manling Ge
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China.
- Hebei Province Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability, Hebei University of Technology, Tianjin, China.
- Hebei University of Technology, 8 Guangrong Road, Hongqiao District, Tianjin, 300130, China.
| | - Hao Cheng
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China
- Hebei Province Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability, Hebei University of Technology, Tianjin, China
- School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, China
| | - Shenghua Chen
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China
- Hebei Province Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability, Hebei University of Technology, Tianjin, China
| | - Yihui Li
- State Key Laboratory of Reliability and Intelligence of Electrical Equipment, Hebei University of Technology, Tianjin, China
- Hebei Province Key Laboratory of Electromagnetic Field and Electrical Apparatus Reliability, Hebei University of Technology, Tianjin, China
| | - Kaiwei Wang
- School of Health Sciences and Biomedical Engineering, Hebei University of Technology, Tianjin, China
| |
Collapse
|
3
|
Zhang L, Wu J, Wang L, Wang L, Steffens DC, Qiu S, Potter GG, Liu M. Brain Anatomy-Guided MRI Analysis for Assessing Clinical Progression of Cognitive Impairment with Structural MRI. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2023; 14227:109-119. [PMID: 38390033 PMCID: PMC10883230 DOI: 10.1007/978-3-031-43993-3_11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/24/2024]
Abstract
Brain structural MRI has been widely used for assessing future progression of cognitive impairment (CI) based on learning-based methods. Previous studies generally suffer from the limited number of labeled training data, while there exists a huge amount of MRIs in large-scale public databases. Even without task-specific label information, brain anatomical structures provided by these MRIs can be used to boost learning performance intuitively. Unfortunately, existing research seldom takes advantage of such brain anatomy prior. To this end, this paper proposes a brain anatomy-guided representation (BAR) learning framework for assessing the clinical progression of cognitive impairment with T1-weighted MRIs. The BAR consists of a pretext model and a downstream model, with a shared brain anatomy-guided encoder for MRI feature extraction. The pretext model also contains a decoder for brain tissue segmentation, while the downstream model relies on a predictor for classification. We first train the pretext model through a brain tissue segmentation task on 9,544 auxiliary T1-weighted MRIs, yielding a generalizable encoder. The downstream model with the learned encoder is further fine-tuned on target MRIs for prediction tasks. We validate the proposed BAR on two CI-related studies with a total of 391 subjects with T1-weighted MRIs. Experimental results suggest that the BAR outperforms several state-of-the-art (SOTA) methods. The source code and pre-trained models are available at https://github.com/goodaycoder/BAR.
Collapse
Affiliation(s)
- Lintao Zhang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Jinjian Wu
- The First School of Clinical Medicine, Guangzhou University of Chinese Medicine, Guangzhou, Guangdong, China
| | - Lihong Wang
- Department of Psychiatry, University of Connecticut School of Medicine, University of Connecticut, Farmington, CT, USA
| | - Li Wang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - David C Steffens
- Department of Psychiatry, University of Connecticut School of Medicine, University of Connecticut, Farmington, CT, USA
| | - Shijun Qiu
- The First School of Clinical Medicine, Guangzhou University of Chinese Medicine, Guangzhou, Guangdong, China
| | - Guy G Potter
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, Durham, NC, USA
| | - Mingxia Liu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| |
Collapse
|
4
|
Wharton SB, Simpson JE, Ince PG, Richardson CD, Merrick R, Matthews FE, Brayne C. Insights into the pathological basis of dementia from population-based neuropathology studies. Neuropathol Appl Neurobiol 2023; 49:e12923. [PMID: 37462105 PMCID: PMC10946587 DOI: 10.1111/nan.12923] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 06/13/2023] [Accepted: 06/29/2023] [Indexed: 08/17/2023]
Abstract
The epidemiological neuropathology perspective of population and community-based studies allows unbiased assessment of the prevalence of various pathologies and their relationships to late-life dementia. In addition, this approach provides complementary insights to conventional case-control studies, which tend to be more representative of a younger clinical cohort. The Cognitive Function and Ageing Study (CFAS) is a longitudinal study of cognitive impairment and frailty in the general United Kingdom population. In this review, we provide an overview of the major findings from CFAS, alongside other studies, which have demonstrated a high prevalence of pathology in the ageing brain, particularly Alzheimer's disease neuropathological change and vascular pathology. Increasing burdens of these pathologies are the major correlates of dementia, especially neurofibrillary tangles, but there is substantial overlap in pathology between those with and without dementia, particularly at intermediate burdens of pathology and also at the oldest ages. Furthermore, additional pathologies such as limbic-predominant age-related TDP-43 encephalopathy, ageing-related tau astrogliopathy and primary age-related tauopathies contribute to late-life dementia. Findings from ageing population-representative studies have implications for the understanding of dementia pathology in the community. The high prevalence of pathology and variable relationship to dementia status has implications for disease definition and indicate a role for modulating factors on cognitive outcome. The complexity of late-life dementia, with mixed pathologies, indicates a need for a better understanding of these processes across the life-course to direct the best research for reducing risk in later life of avoidable clinical dementia syndromes.
Collapse
Affiliation(s)
- Stephen B. Wharton
- Sheffield Institute for Translational NeuroscienceUniversity of SheffieldSheffieldUK
| | - Julie E. Simpson
- Sheffield Institute for Translational NeuroscienceUniversity of SheffieldSheffieldUK
| | - Paul G. Ince
- Sheffield Institute for Translational NeuroscienceUniversity of SheffieldSheffieldUK
| | | | - Richard Merrick
- Cambridge Public Health, School of Clinical MedicineUniversity of CambridgeSheffieldUK
| | | | - Carol Brayne
- Cambridge Public Health, School of Clinical MedicineUniversity of CambridgeSheffieldUK
| | | |
Collapse
|
5
|
Song C, Liu T, Wang H, Shi H, Jiao Z. Multi-modal feature selection with self-expression topological manifold for end-stage renal disease associated with mild cognitive impairment. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:14827-14845. [PMID: 37679161 DOI: 10.3934/mbe.2023664] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/09/2023]
Abstract
Effectively selecting discriminative brain regions in multi-modal neuroimages is one of the effective means to reveal the neuropathological mechanism of end-stage renal disease associated with mild cognitive impairment (ESRDaMCI). Existing multi-modal feature selection methods usually depend on the Euclidean distance to measure the similarity between data, which tends to ignore the implied data manifold. A self-expression topological manifold based multi-modal feature selection method (SETMFS) is proposed to address this issue employing self-expression topological manifold. First, a dynamic brain functional network is established using functional magnetic resonance imaging (fMRI), after which the betweenness centrality is extracted. The feature matrix of fMRI is constructed based on this centrality measure. Second, the feature matrix of arterial spin labeling (ASL) is constructed by extracting the cerebral blood flow (CBF). Then, the topological relationship matrices are constructed by calculating the topological relationship between each data point in the two feature matrices to measure the intrinsic similarity between the features, respectively. Subsequently, the graph regularization is utilized to embed the self-expression model into topological manifold learning to identify the linear self-expression of the features. Finally, the selected well-represented feature vectors are fed into a multicore support vector machine (MKSVM) for classification. The experimental results show that the classification performance of SETMFS is significantly superior to several state-of-the-art feature selection methods, especially its classification accuracy reaches 86.10%, which is at least 4.34% higher than other comparable methods. This method fully considers the topological correlation between the multi-modal features and provides a reference for ESRDaMCI auxiliary diagnosis.
Collapse
Affiliation(s)
- Chaofan Song
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou 213164, China
| | - Tongqiang Liu
- Department of Nephrology, The Affiliated Changzhou No.2 People's Hospital of Nanjing Medical University, Changzhou 213003, China
| | - Huan Wang
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou 213164, China
| | - Haifeng Shi
- Department of Radiology, The Affiliated Changzhou No.2 People's Hospital of Nanjing Medical University, Changzhou 213003, China
| | - Zhuqing Jiao
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou 213164, China
| |
Collapse
|
6
|
Wang W, Peng J, Hou J, Yuan Z, Xie W, Mao G, Pan Y, Shao Y, Shu Z. Predicting mild cognitive impairment progression to Alzheimer's disease based on machine learning analysis of cortical morphological features. Aging Clin Exp Res 2023:10.1007/s40520-023-02456-1. [PMID: 37405620 DOI: 10.1007/s40520-023-02456-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 05/25/2023] [Indexed: 07/06/2023]
Abstract
PURPOSE To establish a model for predicting mild cognitive impairment (MCI) progression to Alzheimer's disease (AD) using morphological features extracted from a joint analysis of voxel-based morphometry (VBM) and surface-based morphometry (SBM). METHODS We analyzed data from 121 MCI patients from the Alzheimer's Disease Neuroimaging Initiative, 32 of whom progressed to AD during a 4-year follow-up period and were classified as the progression group, while the remaining 89 were classified as the non-progression group. Patients were divided into a training set (n = 84) and a testing set (n = 37). Morphological features measured by VBM and SBM were extracted from the cortex of the training set and dimensionally reduced to construct morphological biomarkers using machine learning methods, which were combined with clinical data to build a multimodal combinatorial model. The model's performance was evaluated using receiver operating characteristic curves on the testing set. RESULTS The Alzheimer's Disease Assessment Scale (ADAS) score, apolipoprotein E (APOE4), and morphological biomarkers were independent predictors of MCI progression to AD. The combinatorial model based on the independent predictors had an area under the curve (AUC) of 0.866 in the training set and 0.828 in the testing set, with sensitivities of 0.773 and 0.900 and specificities of 0.903 and 0.747, respectively. The number of MCI patients classified as high-risk for progression to AD was significantly different from those classified as low-risk in the training set, testing set, and entire dataset, according to the combinatorial model (P < 0.05). CONCLUSION The combinatorial model based on cortical morphological features can identify high-risk MCI patients likely to progress to AD, potentially providing an effective tool for clinical screening.
Collapse
Affiliation(s)
- Wei Wang
- Jinzhou Medical University Postgraduate Education Base (Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College), Hangzhou, Zhejiang, China
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical and Pharmaceutical College, Chongqing, China
| | - Jiaxuan Peng
- Jinzhou Medical University Postgraduate Education Base (Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Jie Hou
- Jinzhou Medical University Postgraduate Education Base (Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Zhongyu Yuan
- Jinzhou Medical University Postgraduate Education Base (Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College), Hangzhou, Zhejiang, China
| | - Wutao Xie
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical and Pharmaceutical College, Chongqing, China
| | - Guohe Mao
- Banan Hospital of Chongqing Medical University, Chongqing, China
| | - Yaling Pan
- Center for Rehabilitation Medicine, Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, No. 158 Shangtang Road, Hangzhou City, Zhejiang Province, China
| | - Yuan Shao
- Center for Rehabilitation Medicine, Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, No. 158 Shangtang Road, Hangzhou City, Zhejiang Province, China
| | - Zhenyu Shu
- Center for Rehabilitation Medicine, Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, No. 158 Shangtang Road, Hangzhou City, Zhejiang Province, China.
| |
Collapse
|
7
|
Xu X, Lin L, Sun S, Wu S. A review of the application of three-dimensional convolutional neural networks for the diagnosis of Alzheimer's disease using neuroimaging. Rev Neurosci 2023:revneuro-2022-0122. [PMID: 36729918 DOI: 10.1515/revneuro-2022-0122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 01/02/2023] [Indexed: 02/03/2023]
Abstract
Alzheimer's disease (AD) is a degenerative disorder that leads to progressive, irreversible cognitive decline. To obtain an accurate and timely diagnosis and detect AD at an early stage, numerous approaches based on convolutional neural networks (CNNs) using neuroimaging data have been proposed. Because 3D CNNs can extract more spatial discrimination information than 2D CNNs, they have emerged as a promising research direction in the diagnosis of AD. The aim of this article is to present the current state of the art in the diagnosis of AD using 3D CNN models and neuroimaging modalities, focusing on the 3D CNN architectures and classification methods used, and to highlight potential future research topics. To give the reader a better overview of the content mentioned in this review, we briefly introduce the commonly used imaging datasets and the fundamentals of CNN architectures. Then we carefully analyzed the existing studies on AD diagnosis, which are divided into two levels according to their inputs: 3D subject-level CNNs and 3D patch-level CNNs, highlighting their contributions and significance in the field. In addition, this review discusses the key findings and challenges from the studies and highlights the lessons learned as a roadmap for future research. Finally, we summarize the paper by presenting some major findings, identifying open research challenges, and pointing out future research directions.
Collapse
Affiliation(s)
- Xinze Xu
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| | - Lan Lin
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| | - Shen Sun
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| | - Shuicai Wu
- Intelligent Physiological Measurement and Clinical Translation, Beijing International Platform for Scientific and Technological Cooperation, Department of Biomedical Engineering, Faculty of Environment and Life Sciences, Beijing University of Technology, Beijing 100124, China
| |
Collapse
|
8
|
Novel Strategy for Alzheimer’s Disease Treatment through Oral Vaccine Therapy with Amyloid Beta. Biologics 2023. [DOI: 10.3390/biologics3010003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Alzheimer’s disease (AD) is a neuropathology characterized by progressive cognitive impairment and dementia. The disease is attributed to senile plaques, which are aggregates of amyloid beta (Aβ) outside nerve cells; neurofibrillary tangles, which are filamentous accumulations of phosphorylated tau in nerve cells; and loss of neurons in the brain tissue. Immunization of an AD mouse model with Aβ-eliminated pre-existing senile plaque amyloids and prevented new accumulation. Furthermore, its effect showed that cognitive function can be improved by passive immunity without side effects, such as lymphocyte infiltration in AD model mice treated with vaccine therapy, indicating the possibility of vaccine therapy for AD. Further, considering the possibility of side effects due to direct administration of Aβ, the practical use of the safe oral vaccine, which expressed Aβ in plants, is expected. Indeed, administration of this oral vaccine to Alzheimer’s model mice reduced Aβ accumulation in the brain. Moreover, almost no expression of inflammatory IgG was observed. Therefore, vaccination prior to Aβ accumulation or at an early stage of accumulation may prevent Aβ from causing AD.
Collapse
|