1
|
Singh Y, Farrelly C, Hathaway QA, Carlsson G. Visualizing radiological data bias through persistence images. Oncotarget 2024; 15:787-789. [PMID: 39535539 PMCID: PMC11559657 DOI: 10.18632/oncotarget.28670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Indexed: 11/16/2024] Open
Abstract
Persistence images, derived from topological data analysis, emerge as a powerful tool for visualizing and mitigating biases in radiological data interpretation and AI model development. This technique transforms complex topological features into stable, interpretable representations, offering unique insights into medical imaging data structure. By providing intuitive visualizations, persistence images enable the identification of subtle structural differences and potential biases in data acquisition, interpretation, and AI model training. Persistence images can also facilitate stratified sampling, matching statistics, and noise filtration, enhancing the accuracy and equity of radiological analysis. Despite challenges in computational complexity and workflow integration, persistence images show promise in developing more accurate, equitable, and trustworthy AI systems in radiology, potentially improving patient outcomes and personalized healthcare delivery.
Collapse
Affiliation(s)
- Yashbir Singh
- Correspondence to:Yashbir Singh, Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| | | | | | | |
Collapse
|
2
|
Singh Y, Farrelly C, Hathaway QA, Carlsson G. Mitigating bias in radiology: The promise of topological data analysis and simplicial complexes. Oncotarget 2024; 15:782-783. [PMID: 39535532 PMCID: PMC11559658 DOI: 10.18632/oncotarget.28668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2024] [Indexed: 11/16/2024] Open
Abstract
Topological Data Analysis (TDA) and simplicial complexes offer a novel approach to address biases in AI-assisted radiology. By capturing complex structures, n-way interactions, and geometric relationships in medical images, TDA enhances feature extraction, improves representation robustness, and increases interpretability. This mathematical framework has the potential to significantly improve the accuracy and fairness of radiological assessments, paving the way for more equitable patient care.
Collapse
Affiliation(s)
- Yashbir Singh
- Correspondence to:Yashbir Singh, Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| | | | | | | |
Collapse
|
3
|
Singh Y, Farrelly C, Hathaway QA, Carlsson G. Persistence landscapes: Charting a path to unbiased radiological interpretation. Oncotarget 2024; 15:790-792. [PMID: 39535533 PMCID: PMC11559655 DOI: 10.18632/oncotarget.28671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Indexed: 11/16/2024] Open
Abstract
Persistence landscapes, a sophisticated tool from topological data analysis, offer a promising approach to address biases in radiological interpretation and AI model development. By transforming complex topological features into statistically analyzable functions, they enable robust comparisons between populations and datasets. Persistence landscapes excel in noise filtration, fusion bias mitigation, and enhancing machine learning models. Despite challenges in computation and integration, they show potential to improve the accuracy and equity of radiological analysis, particularly in multi-modal imaging and AI-assisted interpretation.
Collapse
Affiliation(s)
- Yashbir Singh
- Correspondence to:Yashbir Singh, Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| | | | | | | |
Collapse
|
4
|
Singh Y, Farrelly C, Hathaway QA, Carlsson G. Persistence barcodes: A novel approach to reducing bias in radiological analysis. Oncotarget 2024; 15:784-786. [PMID: 39535538 PMCID: PMC11559656 DOI: 10.18632/oncotarget.28667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2024] [Indexed: 11/16/2024] Open
Abstract
Persistence barcodes emerge as a promising tool in radiological analysis, offering a novel approach to reduce bias and uncover hidden patterns in medical imaging. By leveraging topological data analysis, this technique provides a robust, multi-scale perspective on image features, potentially overcoming limitations in traditional methods and Graph Neural Networks. While challenges in interpretation and implementation remain, persistence barcodes show significant potential for improving diagnostic accuracy, standardization, and ultimately, patient outcomes in the evolving field of radiology.
Collapse
Affiliation(s)
- Yashbir Singh
- Correspondence to:Yashbir Singh, Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA
| | | | | | | |
Collapse
|
5
|
Gu Y, Sun Z, Chen T, Xiao X, Liu Y, Xu Y, Najman L. Dual structure-aware image filterings for semi-supervised medical image segmentation. Med Image Anal 2024; 99:103364. [PMID: 39418830 DOI: 10.1016/j.media.2024.103364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Revised: 07/25/2024] [Accepted: 10/01/2024] [Indexed: 10/19/2024]
Abstract
Semi-supervised image segmentation has attracted great attention recently. The key is how to leverage unlabeled images in the training process. Most methods maintain consistent predictions of the unlabeled images under variations (e.g., adding noise/perturbations, or creating alternative versions) in the image and/or model level. In most image-level variation, medical images often have prior structure information, which has not been well explored. In this paper, we propose novel dual structure-aware image filterings (DSAIF) as the image-level variations for semi-supervised medical image segmentation. Motivated by connected filtering that simplifies image via filtering in structure-aware tree-based image representation, we resort to the dual contrast invariant Max-tree and Min-tree representation. Specifically, we propose a novel connected filtering that removes topologically equivalent nodes (i.e. connected components) having no siblings in the Max/Min-tree. This results in two filtered images preserving topologically critical structure. Applying the proposed DSAIF to mutually supervised networks decreases the consensus of their erroneous predictions on unlabeled images. This helps to alleviate the confirmation bias issue of overfitting to noisy pseudo labels of unlabeled images, and thus effectively improves the segmentation performance. Extensive experimental results on three benchmark datasets demonstrate that the proposed method significantly/consistently outperforms some state-of-the-art methods. The source codes will be publicly available.
Collapse
Affiliation(s)
- Yuliang Gu
- National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China; Institute of Artificial Intelligence, School of Computer Science, Wuhan University, Wuhan, China; Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University, Wuhan, China.
| | - Zhichao Sun
- National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China; Institute of Artificial Intelligence, School of Computer Science, Wuhan University, Wuhan, China; Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University, Wuhan, China.
| | - Tian Chen
- National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China; Institute of Artificial Intelligence, School of Computer Science, Wuhan University, Wuhan, China; Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University, Wuhan, China.
| | - Xin Xiao
- National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China; Institute of Artificial Intelligence, School of Computer Science, Wuhan University, Wuhan, China; Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University, Wuhan, China.
| | - Yepeng Liu
- National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China; Institute of Artificial Intelligence, School of Computer Science, Wuhan University, Wuhan, China; Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University, Wuhan, China.
| | - Yongchao Xu
- National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University, Wuhan, China; Institute of Artificial Intelligence, School of Computer Science, Wuhan University, Wuhan, China; Medical Artificial Intelligence Research Institute of Renmin Hospital, Wuhan University, Wuhan, China.
| | - Laurent Najman
- Univ Gustave Eiffel, CNRS, LIGM, Marne-la-Vallée, France.
| |
Collapse
|
6
|
Maciejewski K, Czerwinska P. Scoping Review: Methods and Applications of Spatial Transcriptomics in Tumor Research. Cancers (Basel) 2024; 16:3100. [PMID: 39272958 PMCID: PMC11394603 DOI: 10.3390/cancers16173100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2024] [Revised: 08/30/2024] [Accepted: 08/30/2024] [Indexed: 09/15/2024] Open
Abstract
Spatial transcriptomics (ST) examines gene expression within its spatial context on tissue, linking morphology and function. Advances in ST resolution and throughput have led to an increase in scientific interest, notably in cancer research. This scoping study reviews the challenges and practical applications of ST, summarizing current methods, trends, and data analysis techniques for ST in neoplasm research. We analyzed 41 articles published by the end of 2023 alongside public data repositories. The findings indicate cancer biology is an important focus of ST research, with a rising number of studies each year. Visium (10x Genomics, Pleasanton, CA, USA) is the leading ST platform, and SCTransform from Seurat R library is the preferred method for data normalization and integration. Many studies incorporate additional data types like single-cell sequencing and immunohistochemistry. Common ST applications include discovering the composition and function of tumor tissues in the context of their heterogeneity, characterizing the tumor microenvironment, or identifying interactions between cells, including spatial patterns of expression and co-occurrence. However, nearly half of the studies lacked comprehensive data processing protocols, hindering their reproducibility. By recommending greater transparency in sharing analysis methods and adapting single-cell analysis techniques with caution, this review aims to improve the reproducibility and reliability of future studies in cancer research.
Collapse
Affiliation(s)
- Kacper Maciejewski
- Undergraduate Research Group "Biobase", Poznan University of Medical Sciences, 61-701 Poznan, Poland
| | - Patrycja Czerwinska
- Undergraduate Research Group "Biobase", Poznan University of Medical Sciences, 61-701 Poznan, Poland
- Department of Cancer Immunology, Poznan University of Medical Sciences, 61-866 Poznan, Poland
- Department of Diagnostics and Cancer Immunology, Greater Poland Cancer Centre, 61-866 Poznan, Poland
| |
Collapse
|
7
|
Manrique-Castano D, Bhaskar D, ElAli A. Dissecting glial scar formation by spatial point pattern and topological data analysis. Sci Rep 2024; 14:19035. [PMID: 39152163 PMCID: PMC11329771 DOI: 10.1038/s41598-024-69426-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Accepted: 08/05/2024] [Indexed: 08/19/2024] Open
Abstract
Glial scar formation represents a fundamental response to central nervous system (CNS) injuries. It is mainly characterized by a well-defined spatial rearrangement of reactive astrocytes and microglia. The mechanisms underlying glial scar formation have been extensively studied, yet quantitative descriptors of the spatial arrangement of reactive glial cells remain limited. Here, we present a novel approach using point pattern analysis (PPA) and topological data analysis (TDA) to quantify spatial patterns of reactive glial cells after experimental ischemic stroke in mice. We provide open and reproducible tools using R and Julia to quantify spatial intensity, cell covariance and conditional distribution, cell-to-cell interactions, and short/long-scale arrangement, which collectively disentangle the arrangement patterns of the glial scar. This approach unravels a substantial divergence in the distribution of GFAP+ and IBA1+ cells after injury that conventional analysis methods cannot fully characterize. PPA and TDA are valuable tools for studying the complex spatial arrangement of reactive glia and other nervous cells following CNS injuries and have potential applications for evaluating glial-targeted restorative therapies.
Collapse
Affiliation(s)
- Daniel Manrique-Castano
- Neuroscience Axis, Research Center of CHU de Québec-Université Laval, Quebec City, QC, Canada.
- Department of Psychiatry and Neuroscience, Faculty of Medicine, Université Laval, Quebec City, QC, Canada.
| | | | - Ayman ElAli
- Neuroscience Axis, Research Center of CHU de Québec-Université Laval, Quebec City, QC, Canada.
- Department of Psychiatry and Neuroscience, Faculty of Medicine, Université Laval, Quebec City, QC, Canada.
| |
Collapse
|
8
|
Singh Y. Beyond pixels: Graph filtration learning unveils new dimensions in hepatocellular carcinoma imaging. Oncotarget 2024; 15:532-534. [PMID: 39046516 PMCID: PMC11268443 DOI: 10.18632/oncotarget.28635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Indexed: 07/25/2024] Open
Abstract
This editorial explores the emerging role of Graph Filtration Learning (GFL) in revolutionizing Hepatocellular carcinoma (HCC) imaging analysis. As traditional pixel-based methods reach their limits, GFL offers a novel approach to capture complex topological features in medical images. By representing imaging data as graphs and leveraging persistent homology, GFL unveils new dimensions of information that were previously inaccessible. This paradigm shift holds promise for enhancing HCC diagnosis, treatment planning, and prognostication. We discuss the principles of GFL, its potential applications in HCC imaging, and the challenges in translating this innovative technique into clinical practice.
Collapse
Affiliation(s)
- Yashbir Singh
- Correspondence to:Yashbir Singh, Department of Radiology, Mayo Clinic, Rochester, MN 55905, USA email
| |
Collapse
|
9
|
Levenson RM, Singh Y, Rieck B, Hathaway QA, Farrelly C, Rozenblit J, Prasanna P, Erickson B, Choudhary A, Carlsson G, Sarkar D. Advancing Precision Medicine: Algebraic Topology and Differential Geometry in Radiology and Computational Pathology. J Transl Med 2024; 104:102060. [PMID: 38626875 DOI: 10.1016/j.labinv.2024.102060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 04/08/2024] [Accepted: 04/10/2024] [Indexed: 05/19/2024] Open
Abstract
Precision medicine aims to provide personalized care based on individual patient characteristics, rather than guideline-directed therapies for groups of diseases or patient demographics. Images-both radiology- and pathology-derived-are a major source of information on presence, type, and status of disease. Exploring the mathematical relationship of pixels in medical imaging ("radiomics") and cellular-scale structures in digital pathology slides ("pathomics") offers powerful tools for extracting both qualitative and, increasingly, quantitative data. These analytical approaches, however, may be significantly enhanced by applying additional methods arising from fields of mathematics such as differential geometry and algebraic topology that remain underexplored in this context. Geometry's strength lies in its ability to provide precise local measurements, such as curvature, that can be crucial for identifying abnormalities at multiple spatial levels. These measurements can augment the quantitative features extracted in conventional radiomics, leading to more nuanced diagnostics. By contrast, topology serves as a robust shape descriptor, capturing essential features such as connected components and holes. The field of topological data analysis was initially founded to explore the shape of data, with functional network connectivity in the brain being a prominent example. Increasingly, its tools are now being used to explore organizational patterns of physical structures in medical images and digitized pathology slides. By leveraging tools from both differential geometry and algebraic topology, researchers and clinicians may be able to obtain a more comprehensive, multi-layered understanding of medical images and contribute to precision medicine's armamentarium.
Collapse
Affiliation(s)
- Richard M Levenson
- Department of Pathology and Laboratory Medicine, University of California Davis, Davis, California.
| | - Yashbir Singh
- Department of Radiology, Mayo Clinic, Rochester, Minnesota.
| | - Bastian Rieck
- Helmholtz Munich and Technical University of Munich, Munich, Germany
| | - Quincy A Hathaway
- Department of Medical Education, West Virginia University, Morgantown, West Virginia
| | | | | | - Prateek Prasanna
- Department of Biomedical Informatics, Stony Brook University, Stony Brook, New York
| | | | | | - Gunnar Carlsson
- Department of Mathematics, Stanford University, Stanford, California
| | - Deepa Sarkar
- Institute of Genomic Health, Ichan school of Medicine, Mount Sinai, New York
| |
Collapse
|
10
|
Uesugi F, Wen Y, Hashimoto A, Ishii M. Prediction of nanocomposite properties and process optimization using persistent homology and machine learning. Micron 2024; 183:103664. [PMID: 38820861 DOI: 10.1016/j.micron.2024.103664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 05/18/2024] [Accepted: 05/22/2024] [Indexed: 06/02/2024]
Abstract
Physical property prediction and synthesis process optimization are key targets in material informatics. In this study, we propose a machine learning approach that utilizes ridge regression to predict the oxygen permeability at fuel cell electrode surfaces and determine the optimal process temperature. These predictions are based on a persistence diagram derived from tomographic images captured using transmission electron microscopy (TEM). Through machine learning analysis of the complex structures present in the Pt/CeO2 nanocomposites, we discovered that l2 regularization considering diverse structural elements is more appropriate than l1 regularization (sparse modeling). Notably, our model successfully captured the activation energy of oxygen permeability, a phenomenon that could not be solely explained by the geometric feature of the Betti numbers, as demonstrated in a previous study. The correspondence between the ridge regression coefficient and persistence diagram revealed the formation process of the local and three-dimensional structures of CeO2 and their contributions to pre-exponential factor and activation energies. This analysis facilitated the determination of the annealing temperature required to achieve the optimal structure and accurately predict the physical properties.
Collapse
Affiliation(s)
- Fumihiko Uesugi
- National Institute for Materials Science, 1-2-1 Sengen, Tsukuba, Ibaraki 305-0047, Japan.
| | - Yu Wen
- National Institute for Materials Science, 1-2-1 Sengen, Tsukuba, Ibaraki 305-0047, Japan; University of Tsukuba, 1-2-1 Sengen, Tsukuba, Ibaraki 305-0047, Japan
| | - Ayako Hashimoto
- National Institute for Materials Science, 1-2-1 Sengen, Tsukuba, Ibaraki 305-0047, Japan; University of Tsukuba, 1-2-1 Sengen, Tsukuba, Ibaraki 305-0047, Japan
| | - Masashi Ishii
- National Institute for Materials Science, 1-1 Namiki, Tsukuba, Ibaraki 305-0044, Japan
| |
Collapse
|
11
|
Siva NK, Singh Y, Hathaway QA, Sengupta PP, Yanamala N. A novel multi-task machine learning classifier for rare disease patterning using cardiac strain imaging data. Sci Rep 2024; 14:10672. [PMID: 38724564 PMCID: PMC11082231 DOI: 10.1038/s41598-024-61201-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 05/02/2024] [Indexed: 05/12/2024] Open
Abstract
To provide accurate predictions, current machine learning-based solutions require large, manually labeled training datasets. We implement persistent homology (PH), a topological tool for studying the pattern of data, to analyze echocardiography-based strain data and differentiate between rare diseases like constrictive pericarditis (CP) and restrictive cardiomyopathy (RCM). Patient population (retrospectively registered) included those presenting with heart failure due to CP (n = 51), RCM (n = 47), and patients without heart failure symptoms (n = 53). Longitudinal, radial, and circumferential strains/strain rates for left ventricular segments were processed into topological feature vectors using Machine learning PH workflow. In differentiating CP and RCM, the PH workflow model had a ROC AUC of 0.94 (Sensitivity = 92%, Specificity = 81%), compared with the GLS model AUC of 0.69 (Sensitivity = 65%, Specificity = 66%). In differentiating between all three conditions, the PH workflow model had an AUC of 0.83 (Sensitivity = 68%, Specificity = 84%), compared with the GLS model AUC of 0.68 (Sensitivity = 52% and Specificity = 76%). By employing persistent homology to differentiate the "pattern" of cardiac deformations, our machine-learning approach provides reasonable accuracy when evaluating small datasets and aids in understanding and visualizing patterns of cardiac imaging data in clinically challenging disease states.
Collapse
Affiliation(s)
- Nanda K Siva
- School of Medicine, West Virginia University, Morgantown, WV, USA
- Division of Cardiology, Heart and Vascular Institute, West Virginia University, Morgantown, WV, USA
| | - Yashbir Singh
- Division of Cardiology, Heart and Vascular Institute, West Virginia University, Morgantown, WV, USA
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Quincy A Hathaway
- School of Medicine, West Virginia University, Morgantown, WV, USA
- Division of Cardiology, Heart and Vascular Institute, West Virginia University, Morgantown, WV, USA
| | - Partho P Sengupta
- Division of Cardiovascular Disease and Hypertension, Rutgers Robert Wood Johnson Medical School, 125 Patterson St, New Brunswick, NJ, 08901, USA.
| | - Naveena Yanamala
- Division of Cardiovascular Disease and Hypertension, Rutgers Robert Wood Johnson Medical School, 125 Patterson St, New Brunswick, NJ, 08901, USA.
- Institute for Software Research, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
12
|
Singh Y, Ammar R, Shehata M. Topological Deep Learning: A New Dimension in Gastroenterology for Metabolic Dysfunction-Associated Fatty Liver. Cureus 2024; 16:e60532. [PMID: 38764708 PMCID: PMC11101912 DOI: 10.7759/cureus.60532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/17/2024] [Indexed: 05/21/2024] Open
Abstract
Topological deep learning (TDL) introduces a novel approach to enhancing diagnostic and monitoring processes for metabolic dysfunction-associated fatty liver disease (MAFLD), a condition that is increasingly prevalent globally and a leading cause of liver transplantation. This editorial explores the integration of topology, a branch of mathematics focused on spatial properties preserved under continuous transformations, with deep learning models to improve the accuracy and efficacy of MAFLD diagnosis and staging from medical imaging. TDL's ability to recognize complex patterns in imaging data that traditional methods might miss can lead to earlier and more precise detection, personalized treatment, and potentially better patient outcomes. Challenges remain, particularly regarding the computational demands and the interpretability of TDL outputs, which necessitate further research and development for clinical application. The potential of TDL to transform the gastroenterological landscape marks a significant step toward the incorporation of advanced mathematical methodologies in medical practice.
Collapse
Affiliation(s)
| | - Ranya Ammar
- Pediatric Medicine, New Medical Centre Hospital, Abu Dhabi, ARE
| | - Mostafa Shehata
- Gastroenterology, Sheikh Shakhbout Medical City, Abu Dhabi, ARE
| |
Collapse
|
13
|
Wang AQ, Karaman BK, Kim H, Rosenthal J, Saluja R, Young SI, Sabuncu MR. A Framework for Interpretability in Machine Learning for Medical Imaging. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2024; 12:53277-53292. [PMID: 39421804 PMCID: PMC11486155 DOI: 10.1109/access.2024.3387702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2024]
Abstract
Interpretability for machine learning models in medical imaging (MLMI) is an important direction of research. However, there is a general sense of murkiness in what interpretability means. Why does the need for interpretability in MLMI arise? What goals does one actually seek to address when interpretability is needed? To answer these questions, we identify a need to formalize the goals and elements of interpretability in MLMI. By reasoning about real-world tasks and goals common in both medical image analysis and its intersection with machine learning, we identify five core elements of interpretability: localization, visual recognizability, physical attribution, model transparency, and actionability. From this, we arrive at a framework for interpretability in MLMI, which serves as a step-by-step guide to approaching interpretability in this context. Overall, this paper formalizes interpretability needs in the context of medical imaging, and our applied perspective clarifies concrete MLMI-specific goals and considerations in order to guide method design and improve real-world usage. Our goal is to provide practical and didactic information for model designers and practitioners, inspire developers of models in the medical imaging field to reason more deeply about what interpretability is achieving, and suggest future directions of interpretability research.
Collapse
Affiliation(s)
- Alan Q Wang
- School of Electrical and Computer Engineering, Cornell University-Cornell Tech, New York City, NY 10044, USA
- Department of Radiology, Weill Cornell Medical School, New York City, NY 10065, USA
| | - Batuhan K Karaman
- School of Electrical and Computer Engineering, Cornell University-Cornell Tech, New York City, NY 10044, USA
- Department of Radiology, Weill Cornell Medical School, New York City, NY 10065, USA
| | - Heejong Kim
- Department of Radiology, Weill Cornell Medical School, New York City, NY 10065, USA
| | - Jacob Rosenthal
- Department of Radiology, Weill Cornell Medical School, New York City, NY 10065, USA
- Weill Cornell/Rockefeller/Sloan Kettering Tri-Institutional M.D.-Ph.D. Program, New York City, NY 10065, USA
| | - Rachit Saluja
- School of Electrical and Computer Engineering, Cornell University-Cornell Tech, New York City, NY 10044, USA
- Department of Radiology, Weill Cornell Medical School, New York City, NY 10065, USA
| | - Sean I Young
- Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129, USA
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA 02139, USA
| | - Mert R Sabuncu
- School of Electrical and Computer Engineering, Cornell University-Cornell Tech, New York City, NY 10044, USA
- Department of Radiology, Weill Cornell Medical School, New York City, NY 10065, USA
| |
Collapse
|
14
|
Zhang M, Ye Z, Yuan E, Lv X, Zhang Y, Tan Y, Xia C, Tang J, Huang J, Li Z. Imaging-based deep learning in kidney diseases: recent progress and future prospects. Insights Imaging 2024; 15:50. [PMID: 38360904 PMCID: PMC10869329 DOI: 10.1186/s13244-024-01636-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Accepted: 01/27/2024] [Indexed: 02/17/2024] Open
Abstract
Kidney diseases result from various causes, which can generally be divided into neoplastic and non-neoplastic diseases. Deep learning based on medical imaging is an established methodology for further data mining and an evolving field of expertise, which provides the possibility for precise management of kidney diseases. Recently, imaging-based deep learning has been widely applied to many clinical scenarios of kidney diseases including organ segmentation, lesion detection, differential diagnosis, surgical planning, and prognosis prediction, which can provide support for disease diagnosis and management. In this review, we will introduce the basic methodology of imaging-based deep learning and its recent clinical applications in neoplastic and non-neoplastic kidney diseases. Additionally, we further discuss its current challenges and future prospects and conclude that achieving data balance, addressing heterogeneity, and managing data size remain challenges for imaging-based deep learning. Meanwhile, the interpretability of algorithms, ethical risks, and barriers of bias assessment are also issues that require consideration in future development. We hope to provide urologists, nephrologists, and radiologists with clear ideas about imaging-based deep learning and reveal its great potential in clinical practice.Critical relevance statement The wide clinical applications of imaging-based deep learning in kidney diseases can help doctors to diagnose, treat, and manage patients with neoplastic or non-neoplastic renal diseases.Key points• Imaging-based deep learning is widely applied to neoplastic and non-neoplastic renal diseases.• Imaging-based deep learning improves the accuracy of the delineation, diagnosis, and evaluation of kidney diseases.• The small dataset, various lesion sizes, and so on are still challenges for deep learning.
Collapse
Affiliation(s)
- Meng Zhang
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
- Medical Equipment Innovation Research Center, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
- Med+X Center for Manufacturing, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Zheng Ye
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Enyu Yuan
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Xinyang Lv
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Yiteng Zhang
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Yuqi Tan
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Chunchao Xia
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China
| | - Jing Tang
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China.
| | - Jin Huang
- Medical Equipment Innovation Research Center, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China.
- Med+X Center for Manufacturing, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China.
| | - Zhenlin Li
- Department of Radiology, West China Hospital, Sichuan University, No. 37 Guoxue Alley, Chengdu, 610041, China.
| |
Collapse
|
15
|
Gouiaa F, Vomo-Donfack KL, Tran-Dinh A, Morilla I. Novel dimensionality reduction method, Taelcore, enhances lung transplantation risk prediction. Comput Biol Med 2024; 169:107969. [PMID: 38199210 DOI: 10.1016/j.compbiomed.2024.107969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 12/23/2023] [Accepted: 01/02/2024] [Indexed: 01/12/2024]
Abstract
In this work, we present a new approach to predict the risk of acute cellular rejection (ACR) after lung transplantation by using machine learning algorithms, such as Multilayer Perceptron (MLP) or Autoencoder (AE), and combining them with topological data analysis (TDA) tools. Our proposed method, named topological autoencoder with best linear combination for optimal reduction of embeddings (Taelcore), effectively reduces the dimensionality of high-dimensional datasets and yields better results compared to other models. We validate the effectiveness of Taelcore in reducing the prediction error rate on four datasets. Furthermore, we demonstrate that Taelcore's topological improvements have a positive effect on the majority of the machine learning algorithms used. By providing a new way to diagnose patients and detect complications early, this work contributes to improved clinical outcomes in lung transplantation.
Collapse
Affiliation(s)
- Fatma Gouiaa
- Université Sorbonne Paris Nord, LAGA, CNRS, UMR 7539, Laboratoire d'excellence Inflamex, Villetaneuse, France
| | - Kelly L Vomo-Donfack
- Université Sorbonne Paris Nord, LAGA, CNRS, UMR 7539, Laboratoire d'excellence Inflamex, Villetaneuse, France
| | - Alexy Tran-Dinh
- Université Paris Cité, AP-HP, Hôpital Bichat Claude Bernard, Département d'anesthésie-Réanimation, INSERM, Paris, France; Universié Paris Cité, LVTS, Inserm U1148, F-75018 Paris, France
| | - Ian Morilla
- Université Sorbonne Paris Nord, LAGA, CNRS, UMR 7539, Laboratoire d'excellence Inflamex, Villetaneuse, France; University of Malaga, Department of Genetics, MLiMO, 29010, Málaga, Spain.
| |
Collapse
|
16
|
Wang M, Wei Y, Zhu M, Yu H, Guo C, Chen Z, Shi W, Ren J, Zhao W, Yang Z, Chen LA. The Value of Topological Radiomics Analysis in Predicting Malignant Risk of Pulmonary Ground-Glass Nodules: A Multi-Center Study. Technol Cancer Res Treat 2024; 23:15330338241287089. [PMID: 39363876 PMCID: PMC11452904 DOI: 10.1177/15330338241287089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 08/01/2017] [Accepted: 08/28/2024] [Indexed: 10/05/2024] Open
Abstract
BACKGROUND Early detection and accurate differentiation of malignant ground-glass nodules (GGNs) in lung CT scans are crucial for the effective treatment of lung adenocarcinoma. However, existing imaging diagnostic methods often struggle to distinguish between benign and malignant GGNs in the early stages. This study aims to predict the malignancy risk of GGNs observed in lung CT scans by applying two radiomics methods: topological data analysis and texture analysis. METHODS A retrospective analysis was conducted on 3223 patients from two centers between January 2018 and June2023. The dataset was divided into training, testing, and validation sets to ensure robust model development and validation. We developed topological features applied to GGNs using radiomics analysis based on homology. This innovative approach emphasizes the integration of topological information, capturing complex geometric and spatial relationships within GGNs. By combining machine learning and deep learning algorithms, we established a predictive model that integrates clinical parameters, previous radiomics features, and topological radiomics features. RESULTS Incorporating topological radiomics into our model significantly enhanced the ability to distinguish between benign and malignant GGNs. The topological radiomics model achieved areas under the curve (AUC) of 0.85 and 0.862 in two independent validation sets, outperforming previous radiomics models. Furthermore, this model demonstrated higher sensitivity compared to models based solely on clinical parameters, with sensitivities of 80.7% in validation set 1 and 82.3% in validation set 2. The most comprehensive model, which combined clinical parameters, previous radiomics features, and topological radiomics features, achieved the highest AUC value of 0.879 across all datasets. CONCLUSION This study validates the potential of topological radiomics in improving the predictive performance for distinguishing between benign and malignant GGNs. By integrating topological features with previous radiomics and clinical parameters, our comprehensive model provides a more accurate and reliable basis for developing treatment strategies for patients with GGNs.
Collapse
Affiliation(s)
- Miaoyu Wang
- Department of Respiratory and Critical Care Medicine, Medical School of Chinese People's Liberation Army, Beijing, China
| | - Yuanhui Wei
- School of Medicine, Nankai University, Tianjin, China
| | - Minghui Zhu
- Department of Respiratory and Critical Care Medicine, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - Hang Yu
- Department of Respiratory and Critical Care Medicine, Medical School of Chinese People's Liberation Army, Beijing, China
| | - Chaomin Guo
- Laboratory Medicine Department, First Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Zhigong Chen
- Department of Thoracic Surgery, Fourth Medical Center of PLA General Hospital, Beijing, China
| | - Wenjia Shi
- Department of Respiratory and Critical Care Medicine, the Eighth Medical Center, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Jiabo Ren
- Department of Respiratory and Critical Care Medicine, Medical School of Chinese People's Liberation Army, Beijing, China
| | - Wei Zhao
- Department of Respiratory and Critical Care Medicine, the Eighth Medical Center, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Zhen Yang
- Department of Respiratory and Critical Care Medicine, the Eighth Medical Center, Chinese People's Liberation Army General Hospital, Beijing, China
| | - Liang-an Chen
- Department of Respiratory and Critical Care Medicine, the Eighth Medical Center, Chinese People's Liberation Army General Hospital, Beijing, China
| |
Collapse
|
17
|
Shehata MA, Malik TA, Alzaabi MHJ, Ali ABAA, Tenaiji KSAA, Singh Y, Wallace MB. Predictors of Pathological Gastroesophageal Reflux among Emirati Patients with Reflux Symptoms Who Undergo Wireless pH Monitoring. Middle East J Dig Dis 2023; 15:242-248. [PMID: 38523885 PMCID: PMC10955985 DOI: 10.34172/mejdd.2023.353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Accepted: 08/25/2023] [Indexed: 03/26/2024] Open
Abstract
Background: Diagnosis of gastroesophageal reflux disease (GERD) relies on recognizing symptoms of reflux and mucosal changes during esophagogastroduodenoscopy. The desired response to acid suppression therapy is reliable resolution of GERD symptoms; however, these are not always reliable, hence the need for pH testing in unclear cases. Our objective was to identify potential predictors of a high DeMeester score among patients with potential GERD symptoms to identify patients most likely to have pathological GERD. Methods: We conducted a retrospective case-control study on patients who underwent wireless pH monitoring from January 2020 to April 2022. Cases were patients with a high DeMeester score (more than 14.7), indicating pathological reflux, and controls were those without. We collected clinical and demographic data, including age, sex, body mass index (BMI), smoking status, non-steroidal anti-inflammatory drugs (NSAIDs) use, and presence of atypical symptoms. Results: 86 patients were enrolled in the study. 46 patients with high DeMeester scores were considered cases, and 40 patients with DeMeester scores less than 14.7 were considered controls. Esophagitis (grade A) was found in 41.1% of the cases and in 22.5% of the control group. In our study, age of more than 50 years compared with age of 20-29 years and being overweight appeared to be predictors of true pathological reflux among patients with reflux symptoms who underwent wireless pH monitoring. Conclusion: Age above 50 years compared with age between 20-29 years and being overweight appeared to be predictors of true pathological reflux among patients with reflux symptoms who underwent wireless oesophageal pH monitoring. The presence of oesophagitis was approximately four times more likely to be associated with true pathological reflux.
Collapse
Affiliation(s)
| | - Talaha Aziz Malik
- Division of Gastroenterology and Hepatology, SSMC, Abu Dhabi, UAE
- Division of Gastroenterology and Hepatology, Mayo Clinic Arizona, USA
| | | | | | | | - Yashbir Singh
- Department of Radiology, Mayo Clinic Rochester in Minnesota, USA
| | - Michael Bradley Wallace
- Division of Gastroenterology and Hepatology, SSMC, Abu Dhabi, UAE
- Division of Gastroenterology and Hepatology, Mayo Clinic Florida, USA
| |
Collapse
|
18
|
Derwae H, Nijs M, Geysels A, Waelkens E, De Moor B. Spatiochemical Characterization of the Pancreas Using Mass Spectrometry Imaging and Topological Data Analysis. Anal Chem 2023. [PMID: 37402207 DOI: 10.1021/acs.analchem.2c05606] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/06/2023]
Abstract
Mass Spectrometry Imaging (MSI) is a technique used to identify the spatial distribution of molecules in tissues. An MSI experiment results in large amounts of high dimensional data, so efficient computational methods are needed to analyze the output. Topological Data Analysis (TDA) has proven to be effective in all kinds of applications. TDA focuses on the topology of the data in high dimensional space. Looking at the shape in a high dimensional data set can lead to new or different insights. In this work, we investigate the use of Mapper, a form of TDA, applied on MSI data. Mapper is used to find data clusters inside two healthy mouse pancreas data sets. The results are compared to previous work using UMAP for MSI data analysis on the same data sets. This work finds that the proposed technique discovers the same clusters in the data as UMAP and is also able to uncover new clusters, such as an additional ring structure inside the pancreatic islets and a better defined cluster containing blood vessels. The technique can be used for a large variety of data types and sizes and can be optimized for specific applications. It is also computationally similar to UMAP for clustering. Mapper is a very interesting method, especially its use in biomedical applications.
Collapse
Affiliation(s)
- Helena Derwae
- STADIUS Center for Dynamical Systems, Signal Processing, and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium
| | - Melanie Nijs
- STADIUS Center for Dynamical Systems, Signal Processing, and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium
| | - Axel Geysels
- STADIUS Center for Dynamical Systems, Signal Processing, and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium
| | - Etienne Waelkens
- Department of Cellular and Molecular Medicine, KU Leuven, 3001 Leuven, Belgium
| | - Bart De Moor
- STADIUS Center for Dynamical Systems, Signal Processing, and Data Analytics, Department of Electrical Engineering (ESAT), KU Leuven, 3001 Leuven, Belgium
- Fellow IEEE, SIAM at STADIUS Center for Dynamical Systems, Signal Processing, and Data Analytics, 3001 Leuven, Belgium
| |
Collapse
|