1
|
Shi S, Xu Y, Xu X, Mo X, Ding J. A Preprocessing Manifold Learning Strategy Based on t-Distributed Stochastic Neighbor Embedding. ENTROPY (BASEL, SWITZERLAND) 2023; 25:1065. [PMID: 37510011 PMCID: PMC10378244 DOI: 10.3390/e25071065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 07/01/2023] [Accepted: 07/05/2023] [Indexed: 07/30/2023]
Abstract
In machine learning and data analysis, dimensionality reduction and high-dimensional data visualization can be accomplished by manifold learning using a t-Distributed Stochastic Neighbor Embedding (t-SNE) algorithm. We significantly improve this manifold learning scheme by introducing a preprocessing strategy for the t-SNE algorithm. In our preprocessing, we exploit Laplacian eigenmaps to reduce the high-dimensional data first, which can aggregate each data cluster and reduce the Kullback-Leibler divergence (KLD) remarkably. Moreover, the k-nearest-neighbor (KNN) algorithm is also involved in our preprocessing to enhance the visualization performance and reduce the computation and space complexity. We compare the performance of our strategy with that of the standard t-SNE on the MNIST dataset. The experiment results show that our strategy exhibits a stronger ability to separate different clusters as well as keep data of the same kind much closer to each other. Moreover, the KLD can be reduced by about 30% at the cost of increasing the complexity in terms of runtime by only 1-2%.
Collapse
Affiliation(s)
- Sha Shi
- State Key Laboratory of Integrated Services Network, Xidian University, 2 South TaiBai Road, Xi'an 710071, China
| | - Yefei Xu
- State Key Laboratory of Integrated Services Network, Xidian University, 2 South TaiBai Road, Xi'an 710071, China
| | - Xiaoyang Xu
- State Key Laboratory of Integrated Services Network, Xidian University, 2 South TaiBai Road, Xi'an 710071, China
| | - Xiaofan Mo
- National Astronomical Observatories, Chinese Academy of Sciences, 20A Datun Road, Chaoyang District, Beijing 100101, China
| | - Jun Ding
- Institute of Information Sensing, Xidian University, 2 South TaiBai Road, Xi'an 710071, China
| |
Collapse
|
2
|
Lian C, Liu M, Zhang J, Shen D. Hierarchical Fully Convolutional Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2020; 42:880-893. [PMID: 30582529 PMCID: PMC6588512 DOI: 10.1109/tpami.2018.2889096] [Citation(s) in RCA: 169] [Impact Index Per Article: 42.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
Structural magnetic resonance imaging (sMRI) has been widely used for computer-aided diagnosis of neurodegenerative disorders, e.g., Alzheimer's disease (AD), due to its sensitivity to morphological changes caused by brain atrophy. Recently, a few deep learning methods (e.g., convolutional neural networks, CNNs) have been proposed to learn task-oriented features from sMRI for AD diagnosis, and achieved superior performance than the conventional learning-based methods using hand-crafted features. However, these existing CNN-based methods still require the pre-determination of informative locations in sMRI. That is, the stage of discriminative atrophy localization is isolated to the latter stages of feature extraction and classifier construction. In this paper, we propose a hierarchical fully convolutional network (H-FCN) to automatically identify discriminative local patches and regions in the whole brain sMRI, upon which multi-scale feature representations are then jointly learned and fused to construct hierarchical classification models for AD diagnosis. Our proposed H-FCN method was evaluated on a large cohort of subjects from two independent datasets (i.e., ADNI-1 and ADNI-2), demonstrating good performance on joint discriminative atrophy localization and brain disease diagnosis.
Collapse
Affiliation(s)
- Chunfeng Lian
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Jun Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, South Korea
| |
Collapse
|
3
|
|
4
|
Zimmer VA, Glocker B, Hahner N, Eixarch E, Sanroma G, Gratacós E, Rueckert D, González Ballester MÁ, Piella G. Learning and combining image neighborhoods using random forests for neonatal brain disease classification. Med Image Anal 2017; 42:189-199. [PMID: 28818743 DOI: 10.1016/j.media.2017.08.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2016] [Revised: 08/01/2017] [Accepted: 08/08/2017] [Indexed: 12/25/2022]
Abstract
It is challenging to characterize and classify normal and abnormal brain development during early childhood. To reduce the complexity of heterogeneous data population, manifold learning techniques are increasingly applied, which find a low-dimensional representation of the data, while preserving all relevant information. The neighborhood definition used for constructing manifold representations of the population is crucial for preserving the similarity structure and it is highly application dependent. The recently proposed neighborhood approximation forests learn a neighborhood structure in a dataset based on a user-defined distance. We propose a framework to learn multiple pairwise distances in a population of brain images and to combine them in an unsupervised manner optimally in a manifold learning step. Unlike other methods that only use a univariate distance measure, our method allows for a natural combination of multiple distances from heterogeneous sources. As a result, it yields a representation of the population that preserves the multiple distances. Furthermore, our method also selects the most predictive features associated with the distances. We evaluate our method in neonatal magnetic resonance images of three groups (term controls, patients affected by intrauterine growth restriction and mild isolated ventriculomegaly). We show that combining multiple distances related to the condition improves the overall characterization and classification of the three clinical groups compared to the use of single distances and classical unsupervised manifold learning.
Collapse
Affiliation(s)
| | - Ben Glocker
- BioMedIA Group, Imperial College London, London, UK
| | - Nadine Hahner
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain; Centre for Biomedical Research on Rare Diseases (CIBER-ER), Barcelona, Spain
| | - Elisenda Eixarch
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain; Centre for Biomedical Research on Rare Diseases (CIBER-ER), Barcelona, Spain
| | | | - Eduard Gratacós
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Déu), IDIBAPS, University of Barcelona, Spain; Centre for Biomedical Research on Rare Diseases (CIBER-ER), Barcelona, Spain
| | | | | | - Gemma Piella
- SIMBioSys, Universitat Pompeu Fabra, Barcelona, Spain
| |
Collapse
|
5
|
Fischer P, Pohl T, Faranesh A, Maier A, Hornegger J. Unsupervised Learning for Robust Respiratory Signal Estimation From X-Ray Fluoroscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:865-877. [PMID: 27654320 PMCID: PMC5489115 DOI: 10.1109/tmi.2016.2609888] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Respiratory signals are required for image gating and motion compensation in minimally invasive interventions. In X-ray fluoroscopy, extraction of a respiratory signal can be challenging due to characteristics of interventional imaging, in particular injection of contrast agent and automatic exposure control. We present a novel method for respiratory signal extraction based on dimensionality reduction that can tolerate these events. Images are divided into patches of multiple sizes. Low-dimensional embeddings are generated for each patch using illumination-invariant kernel PCA. Patches with respiratory information are selected automatically by agglomerative clustering. The signals from this respiratory cluster are combined robustly to a single respiratory signal. In the experiments, we evaluate our method on a variety of scenarios. If the diaphragm is visible, we track its superior-inferior motion as ground truth. Our method has a correlation coefficient of more than 91% with the ground truth irrespective of whether or not contrast agent injection or automatic exposure control occur. Additionally, we show that very similar signals are estimated from biplane sequences and from sequences without visible diaphragm. Since all these cases are handled automatically, the method is robust enough to be considered for use in a clinical setting.
Collapse
|
6
|
Zhang Y, Kwon D, Pohl KM. Computing group cardinality constraint solutions for logistic regression problems. Med Image Anal 2017; 35:58-69. [PMID: 27318592 PMCID: PMC5099121 DOI: 10.1016/j.media.2016.05.011] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2015] [Revised: 05/25/2016] [Accepted: 05/27/2016] [Indexed: 02/03/2023]
Abstract
We derive an algorithm to directly solve logistic regression based on cardinality constraint, group sparsity and use it to classify intra-subject MRI sequences (e.g. cine MRIs) of healthy from diseased subjects. Group cardinality constraint models are often applied to medical images in order to avoid overfitting of the classifier to the training data. Solutions within these models are generally determined by relaxing the cardinality constraint to a weighted feature selection scheme. However, these solutions relate to the original sparse problem only under specific assumptions, which generally do not hold for medical image applications. In addition, inferring clinical meaning from features weighted by a classifier is an ongoing topic of discussion. Avoiding weighing features, we propose to directly solve the group cardinality constraint logistic regression problem by generalizing the Penalty Decomposition method. To do so, we assume that an intra-subject series of images represents repeated samples of the same disease patterns. We model this assumption by combining series of measurements created by a feature across time into a single group. Our algorithm then derives a solution within that model by decoupling the minimization of the logistic regression function from enforcing the group sparsity constraint. The minimum to the smooth and convex logistic regression problem is determined via gradient descent while we derive a closed form solution for finding a sparse approximation of that minimum. We apply our method to cine MRI of 38 healthy controls and 44 adult patients that received reconstructive surgery of Tetralogy of Fallot (TOF) during infancy. Our method correctly identifies regions impacted by TOF and generally obtains statistically significant higher classification accuracy than alternative solutions to this model, i.e., ones relaxing group cardinality constraints.
Collapse
Affiliation(s)
- Yong Zhang
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA.
| | - Dongjin Kwon
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA; Center for Health Sciences, SRI International, Menlo Park, CA 94025, USA
| | - Kilian M Pohl
- Department of Psychiatry & Behavioral Sciences, Stanford University, Palo Alto, CA 94304, USA; Center for Health Sciences, SRI International, Menlo Park, CA 94025, USA
| |
Collapse
|
7
|
Shalbaf A, AlizadehSani Z, Behnam H. Echocardiography without electrocardiogram using nonlinear dimensionality reduction methods. J Med Ultrason (2001) 2015; 42:137-49. [PMID: 26576567 DOI: 10.1007/s10396-014-0588-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2014] [Accepted: 10/08/2014] [Indexed: 11/25/2022]
Abstract
PURPOSE The aim of this study is to evaluate the efficiency of a new automatic image processing technique, based on nonlinear dimensionality reduction (NLDR) to separate a cardiac cycle and also detect end-diastole (ED) (cardiac cycle start) and end-systole (ES) frames on an echocardiography system without using ECG. METHODS Isometric feature mapping (Isomap) and locally linear embeddings (LLE) are the most popular NLDR algorithms. First, Isomap algorithm is applied on recorded echocardiography images. By this approach, the nonlinear embedded information in sequential images is represented in a two-dimensional manifold and each image is characterized by a symbol on the constructed manifold. Cyclicity analysis of the resultant manifold, which is derived from the cyclic nature of the heart motion, is used to perform cardiac cycle length estimation. Then, LLE algorithm is applied on extracted left ventricle (LV) echocardiography images of one cardiac cycle. Finally, the relationship between consecutive symbols of the resultant manifold by the LLE algorithm, which is based on LV volume changes, is used to estimate ED (cycle start) and ES frames. The proposed algorithms are quantitatively compared to those obtained by a highly experienced echocardiographer from ECG as a reference in 20 healthy volunteers and 12 subjects with pathology. RESULTS Mean difference in cardiac cycle length, ED, and ES frame estimation between our method and ECG detection by the experienced echocardiographer is approximately 7, 17, and 17 ms (0.4, 1, and 1 frame), respectively. CONCLUSION The proposed image-based method, based on NLDR, can be used as a useful tool for estimation of cardiac cycle length, ED and ES frames in echocardiography systems, with good agreement to ECG assessment by an experienced echocardiographer in routine clinical evaluation.
Collapse
Affiliation(s)
- Ahmad Shalbaf
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran.
| | - Zahra AlizadehSani
- Cardiovascular Imaging, Shaheed Rajaei Cardiovascular Medical and Research Center, Iran University of Medical Science, Tehran, Iran.
| | - Hamid Behnam
- Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran.
| |
Collapse
|
8
|
|
9
|
Li XW, Li QL, Li SY, Li DY. Local manifold learning for multiatlas segmentation: application to hippocampal segmentation in healthy population and Alzheimer's disease. CNS Neurosci Ther 2015; 21:826-36. [PMID: 26122409 DOI: 10.1111/cns.12415] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2015] [Revised: 05/06/2015] [Accepted: 05/06/2015] [Indexed: 12/01/2022] Open
Abstract
AIMS Automated hippocampal segmentation is an important issue in many neuroscience studies. METHODS We presented and evaluated a novel segmentation method that utilized a manifold learning technique under the multiatlas-based segmentation scenario. A manifold representation of local patches for each voxel was achieved by applying an Isomap algorithm, which can then be used to obtain spatially local weights of atlases for label fusion. The obtained atlas weights potentially depended on all pairwise similarities of the population, which is in contrast to most existing label fusion methods that only rely on similarities between the target image and the atlases. The performance of the proposed method was evaluated for hippocampal segmentation and compared with two representative local weighted label fusion methods, that is, local majority voting and local weighted inverse distance voting, on an in-house dataset of 28 healthy adolescents (age range: 10-17 years) and two ADNI datasets of 100 participants (age range: 60-89 years). We also implemented hippocampal volumetric analysis and evaluated segmentation performance using atlases from a different dataset. RESULTS The median Dice similarities obtained by our proposed method were approximately 0.90 for healthy subjects and above 0.88 for two mixed diagnostic groups of ADNI subjects. CONCLUSION The experimental results demonstrated that the proposed method could obtain consistent and significant improvements over label fusion strategies that are implemented in the original space.
Collapse
Affiliation(s)
- Xin-Wei Li
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.,Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | - Qiong-Ling Li
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.,Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | - Shu-Yu Li
- State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.,Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | - De-Yu Li
- Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Biological Science & Medical Engineering, Beihang University, Beijing, China
| | | |
Collapse
|
10
|
Ma H, Dibildox G, Schultz C, Regar E, van Walsum T. PCA-derived respiratory motion surrogates from X-ray angiograms for percutaneous coronary interventions. Int J Comput Assist Radiol Surg 2015; 10:695-705. [PMID: 25847669 PMCID: PMC4449952 DOI: 10.1007/s11548-015-1185-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2015] [Accepted: 03/20/2015] [Indexed: 11/29/2022]
Abstract
Purpose Intraoperative coronary motion modeling with motion surrogates enables prospective motion prediction in X-ray angiograms (XA) for percutaneous coronary interventions. The motion of coronary arteries is mainly affected by patients breathing and heartbeat. Purpose of our work is therefore to extract coronary motion surrogates that are related to respiratory and cardiac motion. In particular, we focus on respiratory motion surrogates extraction in this paper. Methods We propose a fast automatic method for extracting patient-specific respiratory motion surrogate from cardiac XA. The method starts with an image preprocessing step to remove all tubular and curvilinear structures from XA images, such as vessels and guiding catheters, followed by principal component analysis on pixel intensities. The respiratory motion surrogate of an XA image is then obtained by projecting its vessel-removed image onto the first principal component. Results This breathing motion surrogate was demonstrated to get high correlation with ground truth diaphragm motion (correlation coefficient over 0.9 on average). In comparison with other related methods, the method we developed did not show significant difference (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p>0.05$$\end{document}p>0.05), but did improve robustness and run faster on monoplane and biplane data in retrospective and prospective scenarios. Conclusions we developed and evaluated a method in extraction of respiratory motion surrogate from interventional X-ray images that is easy to implement and runs in real time and thus allows extracting respiratory motion surrogates during interventions.
Collapse
Affiliation(s)
- Hua Ma
- Biomedical Imaging Group Rotterdam, Departments of Radiology and Medical Informatics, Erasmus MC, Rotterdam, The Netherlands,
| | | | | | | | | |
Collapse
|
11
|
Learning a Global Descriptor of Cardiac Motion from a Large Cohort of 1000+ Normal Subjects. FUNCTIONAL IMAGING AND MODELING OF THE HEART 2015. [DOI: 10.1007/978-3-319-20309-6_1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
12
|
Duchateau N, Giraldeau G, Gabrielli L, Fernández-Armenta J, Penela D, Evertz R, Mont L, Brugada J, Berruezo A, Sitges M, Bijnens BH. Quantification of local changes in myocardial motion by diffeomorphic registration via currents: Application to paced hypertrophic obstructive cardiomyopathy in 2D echocardiographic sequences. Med Image Anal 2015; 19:203-19. [DOI: 10.1016/j.media.2014.10.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2014] [Revised: 10/17/2014] [Accepted: 10/21/2014] [Indexed: 10/24/2022]
|
13
|
Panayiotou M, King AP, Housden RJ, Ma Y, Cooklin M, O' Neill M, Gill J, Rinaldi CA, Rhode KS. A statistical method for retrospective cardiac and respiratory motion gating of interventional cardiac x-ray images. Med Phys 2014; 41:071901. [DOI: 10.1118/1.4881140] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
14
|
Ye DH, Desjardins B, Hamm J, Litt H, Pohl KM. Regional manifold learning for disease classification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:1236-1247. [PMID: 24893254 PMCID: PMC5450500 DOI: 10.1109/tmi.2014.2305751] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
While manifold learning from images itself has become widely used in medical image analysis, the accuracy of existing implementations suffers from viewing each image as a single data point. To address this issue, we parcellate images into regions and then separately learn the manifold for each region. We use the regional manifolds as low-dimensional descriptors of high-dimensional morphological image features, which are then fed into a classifier to identify regions affected by disease. We produce a single ensemble decision for each scan by the weighted combination of these regional classification results. Each weight is determined by the regional accuracy of detecting the disease. When applied to cardiac magnetic resonance imaging of 50 normal controls and 50 patients with reconstructive surgery of Tetralogy of Fallot, our method achieves significantly better classification accuracy than approaches learning a single manifold across the entire image domain.
Collapse
Affiliation(s)
| | - Benoit Desjardins
- Department of Radiology, University of Pennsylvania, Philadelphia,
PA 19104 USA
| | - Jihun Hamm
- Department of Computer Science and Engineering, Ohio State
University, Columbus, OH 43210 USA
| | - Harold Litt
- Department of Radiology, University of Pennsylvania, Philadelphia,
PA 19104 USA
| | - Kilian M. Pohl
- Center for Health Sciences, SRI International, Menlo Park, CA 94025
USA, and also with the Department of Psychiatry and Behavioral Sciences,
Stanford University, Stanford, CA 94304 USA
| |
Collapse
|