1
|
Yagis E, Aslani S, Jain Y, Zhou Y, Rahmani S, Brunet J, Bellier A, Werlein C, Ackermann M, Jonigk D, Tafforeau P, Lee PD, Walsh C. Deep Learning for 3D Vascular Segmentation in Phase Contrast Tomography. RESEARCH SQUARE 2024:rs.3.rs-4613439. [PMID: 39070623 PMCID: PMC11276017 DOI: 10.21203/rs.3.rs-4613439/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
Automated blood vessel segmentation is critical for biomedical image analysis, as vessel morphology changes are associated with numerous pathologies. Still, precise segmentation is difficult due to the complexity of vascular structures, anatomical variations across patients, the scarcity of annotated public datasets, and the quality of images. Our goal is to provide a foundation on the topic and identify a robust baseline model for application to vascular segmentation using a new imaging modality, Hierarchical Phase-Contrast Tomography (HiP-CT). We begin with an extensive review of current machine learning approaches for vascular segmentation across various organs. Our work introduces a meticulously curated training dataset, verified by double annotators, consisting of vascular data from three kidneys imaged using Hierarchical Phase-Contrast Tomography (HiP-CT) as part of the Human Organ Atlas Project. HiP-CT, pioneered at the European Synchrotron Radiation Facility in 2020, revolutionizes 3D organ imaging by offering resolution around 20μm/voxel, and enabling highly detailed localized zooms up to 1μm/voxel without physical sectioning. We leverage the nnU-Net framework to evaluate model performance on this high-resolution dataset, using both known and novel samples, and implementing metrics tailored for vascular structures. Our comprehensive review and empirical analysis on HiP-CT data sets a new standard for evaluating machine learning models in high-resolution organ imaging. Our three experiments yielded Dice scores of 0.9523 and 0.9410, and 0.8585, respectively. Nevertheless, DSC primarily assesses voxel-to-voxel concordance, overlooking several crucial characteristics of the vessels and should not be the sole metric for deciding the performance of vascular segmentation. Our results show that while segmentations yielded reasonably high scores-such as centerline Dice values ranging from 0.82 to 0.88, certain errors persisted. Specifically, large vessels that collapsed due to the lack of hydro-static pressure (HiP-CT is an ex vivo technique) were segmented poorly. Moreover, decreased connectivity in finer vessels and higher segmentation errors at vessel boundaries were observed. Such errors, particularly in significant vessels, obstruct the understanding of the structures by interrupting vascular tree connectivity. Through our review and outputs, we aim to set a benchmark for subsequent model evaluations using various modalities, especially with the HiP-CT imaging database.
Collapse
Affiliation(s)
- Ekin Yagis
- Department of Mechanical Engineering, University College London, London, UK
| | - Shahab Aslani
- Department of Mechanical Engineering, University College London, London, UK
- Centre for Medical Image Computing, University College London, London UK
| | - Yashvardhan Jain
- Department of Intelligent Systems Engineering, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, USA
| | - Yang Zhou
- Department of Mechanical Engineering, University College London, London, UK
| | - Shahrokh Rahmani
- Department of Mechanical Engineering, University College London, London, UK
| | - Joseph Brunet
- Department of Mechanical Engineering, University College London, London, UK
- European Synchrotron Radiation Facility, Grenoble, France
| | | | - Christopher Werlein
- Institute of Pathology, Hannover Medical School, Carl-Neuberg-Straße 1, 30625, Hannover, Germany
| | | | - Danny Jonigk
- Member of the German Center for Lung Research (DZL), Biomedical Research in Endstage and Obstructive Lung Disease Hannover (BREATH), Hannover, Germany
| | - Paul Tafforeau
- European Synchrotron Radiation Facility, Grenoble, France
| | - Peter D. Lee
- Department of Mechanical Engineering, University College London, London, UK
| | - Claire Walsh
- Department of Mechanical Engineering, University College London, London, UK
| |
Collapse
|
2
|
Lashgari M, Choudhury RP, Banerjee A. Patient-specific in silico 3D coronary model in cardiac catheterisation laboratories. Front Cardiovasc Med 2024; 11:1398290. [PMID: 39036504 PMCID: PMC11257904 DOI: 10.3389/fcvm.2024.1398290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 06/06/2024] [Indexed: 07/23/2024] Open
Abstract
Coronary artery disease is caused by the buildup of atherosclerotic plaque in the coronary arteries, affecting the blood supply to the heart, one of the leading causes of death around the world. X-ray coronary angiography is the most common procedure for diagnosing coronary artery disease, which uses contrast material and x-rays to observe vascular lesions. With this type of procedure, blood flow in coronary arteries is viewed in real-time, making it possible to detect stenoses precisely and control percutaneous coronary interventions and stent insertions. Angiograms of coronary arteries are used to plan the necessary revascularisation procedures based on the calculation of occlusions and the affected segments. However, their interpretation in cardiac catheterisation laboratories presently relies on sequentially evaluating multiple 2D image projections, which limits measuring lesion severity, identifying the true shape of vessels, and analysing quantitative data. In silico modelling, which involves computational simulations of patient-specific data, can revolutionise interventional cardiology by providing valuable insights and optimising treatment methods. This paper explores the challenges and future directions associated with applying patient-specific in silico models in catheterisation laboratories. We discuss the implications of the lack of patient-specific in silico models and how their absence hinders the ability to accurately predict and assess the behaviour of individual patients during interventional procedures. Then, we introduce the different components of a typical patient-specific in silico model and explore the potential future directions to bridge this gap and promote the development and utilisation of patient-specific in silico models in the catheterisation laboratories.
Collapse
Affiliation(s)
- Mojtaba Lashgari
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, United Kingdom
| | - Robin P. Choudhury
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford, United Kingdom
| | - Abhirup Banerjee
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, United Kingdom
- Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
3
|
Wei J, Pan B, Gan Y, Li X, Liu D, Sang B, Gao X. Temporal Relationship-Aware Treadmill Exercise Test Analysis Network for Coronary Artery Disease Diagnosis. SENSORS (BASEL, SWITZERLAND) 2024; 24:2705. [PMID: 38732812 PMCID: PMC11085865 DOI: 10.3390/s24092705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Revised: 03/07/2024] [Accepted: 03/11/2024] [Indexed: 05/13/2024]
Abstract
The treadmill exercise test (TET) serves as a non-invasive method for the diagnosis of coronary artery disease (CAD). Despite its widespread use, TET reports are susceptible to external influences, heightening the risk of misdiagnosis and underdiagnosis. In this paper, we propose a novel automatic CAD diagnosis approach. The proposed approach introduces a customized preprocessing method to obtain clear electrocardiograms (ECGs) from individual TET reports. Additionally, it presents TETDiaNet, a novel neural network designed to explore the temporal relationships within TET ECGs. Central to TETDiaNet is the TETDia block, which mimics clinicians' diagnostic processes to extract essential diagnostic information. This block encompasses an intra-state contextual learning module and an inter-state contextual learning module, modeling the temporal relationships within a single state and between states, respectively. These two modules help the TETDia block to capture effective diagnosis information by exploring the temporal relationships within TET ECGs. Furthermore, we establish a new TET dataset named TET4CAD for CAD diagnosis. It contains simplified TET reports for 192 CAD patients and 224 non-CAD patients, and each patient undergoes coronary angiography for labeling. Experimental results on TET4CAD underscore the superior performance of the proposed approach, highlighting the discriminative value of the temporal relationships within TET ECGs for CAD diagnosis.
Collapse
Affiliation(s)
- Jianze Wei
- Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (J.W.); (B.P.)
| | - Bocheng Pan
- Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (J.W.); (B.P.)
| | - Yu Gan
- Cardiology Department, Beijing Hospital, Beijing 100730, China; (Y.G.); (X.L.); (B.S.)
- National Center of Gerontology, National Health Commission Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing 100730, China
| | - Xuedi Li
- Cardiology Department, Beijing Hospital, Beijing 100730, China; (Y.G.); (X.L.); (B.S.)
- National Center of Gerontology, National Health Commission Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing 100730, China
| | - Deping Liu
- Cardiology Department, Beijing Hospital, Beijing 100730, China; (Y.G.); (X.L.); (B.S.)
- National Center of Gerontology, National Health Commission Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing 100730, China
| | - Botao Sang
- Cardiology Department, Beijing Hospital, Beijing 100730, China; (Y.G.); (X.L.); (B.S.)
- University of Chinese Academy of Sciences, Beijing 100006, China
| | - Xingyu Gao
- Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (J.W.); (B.P.)
| |
Collapse
|
4
|
Zhang C, Li M, Luo Z, Xiao R, Li B, Shi J, Zeng C, Sun B, Xu X, Yang H. Deep learning-driven MRI trigeminal nerve segmentation with SEVB-net. Front Neurosci 2023; 17:1265032. [PMID: 37920295 PMCID: PMC10618361 DOI: 10.3389/fnins.2023.1265032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 09/29/2023] [Indexed: 11/04/2023] Open
Abstract
Purpose Trigeminal neuralgia (TN) poses significant challenges in its diagnosis and treatment due to its extreme pain. Magnetic resonance imaging (MRI) plays a crucial role in diagnosing TN and understanding its pathogenesis. Manual delineation of the trigeminal nerve in volumetric images is time-consuming and subjective. This study introduces a Squeeze and Excitation with BottleNeck V-Net (SEVB-Net), a novel approach for the automatic segmentation of the trigeminal nerve in three-dimensional T2 MRI volumes. Methods We enrolled 88 patients with trigeminal neuralgia and 99 healthy volunteers, dividing them into training and testing groups. The SEVB-Net was designed for end-to-end training, taking three-dimensional T2 images as input and producing a segmentation volume of the same size. We assessed the performance of the basic V-Net, nnUNet, and SEVB-Net models by calculating the Dice similarity coefficient (DSC), sensitivity, precision, and network complexity. Additionally, we used the Mann-Whitney U test to compare the time required for manual segmentation and automatic segmentation with manual modification. Results In the testing group, the experimental results demonstrated that the proposed method achieved state-of-the-art performance. SEVB-Net combined with the ωDoubleLoss loss function achieved a DSC ranging from 0.6070 to 0.7923. SEVB-Net combined with the ωDoubleLoss method and nnUNet combined with the DoubleLoss method, achieved DSC, sensitivity, and precision values exceeding 0.7. However, SEVB-Net significantly reduced the number of parameters (2.20 M), memory consumption (11.41 MB), and model size (17.02 MB), resulting in improved computation and forward time compared with nnUNet. The difference in average time between manual segmentation and automatic segmentation with manual modification for both radiologists was statistically significant (p < 0.001). Conclusion The experimental results demonstrate that the proposed method can automatically segment the root and three main branches of the trigeminal nerve in three-dimensional T2 images. SEVB-Net, compared with the basic V-Net model, showed improved segmentation performance and achieved a level similar to nnUNet. The segmentation volumes of both SEVB-Net and nnUNet aligned with expert annotations but SEVB-Net displayed a more lightweight feature.
Collapse
Affiliation(s)
- Chuan Zhang
- The First Affiliated Hospital, Jinan University, Guangzhou, China
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Man Li
- Shanghai United Imaging Intelligence, Co., Ltd., Shanghai, China
| | - Zheng Luo
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Ruhui Xiao
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Bing Li
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Jing Shi
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Chen Zeng
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - BaiJinTao Sun
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Xiaoxue Xu
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Hanfeng Yang
- The First Affiliated Hospital, Jinan University, Guangzhou, China
- Department of Radiology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| |
Collapse
|
5
|
Ninno F, Tsui J, Balabani S, Díaz-Zuccarini V. A systematic review of clinical and biomechanical engineering perspectives on the prediction of restenosis in coronary and peripheral arteries. JVS Vasc Sci 2023; 4:100128. [PMID: 38023962 PMCID: PMC10663814 DOI: 10.1016/j.jvssci.2023.100128] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 09/10/2023] [Indexed: 12/01/2023] Open
Abstract
Objective Restenosis is a significant complication of revascularization treatments in coronary and peripheral arteries, sometimes necessitating repeated intervention. Establishing when restenosis will happen is extremely difficult due to the interplay of multiple variables and factors. Standard clinical and Doppler ultrasound scans surveillance follow-ups are the only tools clinicians can rely on to monitor intervention outcomes. However, implementing efficient surveillance programs is hindered by health care system limitations, patients' comorbidities, and compliance. Predictive models classifying patients according to their risk of developing restenosis over a specific period will allow the development of tailored surveillance, prevention programs, and efficient clinical workflows. This review aims to: (1) summarize the state-of-the-art in predictive models for restenosis in coronary and peripheral arteries; (2) compare their performance in terms of predictive power; and (3) provide an outlook for potentially improved predictive models. Methods We carried out a comprehensive literature review by accessing the PubMed/MEDLINE database according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The search strategy consisted of a combination of keywords and included studies focusing on predictive models of restenosis published between January 1993 and April 2023. One author independently screened titles and abstracts and checked for eligibility. The rest of the authors independently confirmed and discussed in case of any disagreement. The search of published literature identified 22 studies providing two perspectives-clinical and biomechanical engineering-on restenosis and comprising distinct methodologies, predictors, and study designs. We compared predictive models' performance on discrimination and calibration aspects. We reported the performance of models simulating reocclusion progression, evaluated by comparison with clinical images. Results Clinical perspective studies consider only routinely collected patient information as restenosis predictors. Our review reveals that clinical models adopting traditional statistics (n = 14) exhibit only modest predictive power. The latter improves when machine learning algorithms (n = 4) are employed. The logistic regression models of the biomechanical engineering perspective (n = 2) show enhanced predictive power when hemodynamic descriptors linked to restenosis are fused with a limited set of clinical risk factors. Biomechanical engineering studies simulating restenosis progression (n = 2) are able to capture its evolution but are computationally expensive and lack risk scoring for individual patients at specific follow-ups. Conclusions Restenosis predictive models, based solely on routine clinical risk factors and using classical statistics, inadequately predict the occurrence of restenosis. Risk stratification models with increased predictive power can be potentially built by adopting machine learning techniques and incorporating critical information regarding vessel hemodynamics arising from biomechanical engineering analyses.
Collapse
Affiliation(s)
- Federica Ninno
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
- Wellcome-EPSRC Centre for Interventional Surgical Sciences, London, United Kingdom
| | - Janice Tsui
- Department of Vascular Surgery, Royal Free Hospital NHS Foundation Trust, London, United Kingdom
- Division of Surgery & Interventional Science, Department of Surgical Biotechnology, Faculty of Medical Sciences, University College London, Royal Free Campus, London, United Kingdom
| | - Stavroula Balabani
- Wellcome-EPSRC Centre for Interventional Surgical Sciences, London, United Kingdom
- Department of Mechanical Engineering, University College London, London, United Kingdom
| | - Vanessa Díaz-Zuccarini
- Wellcome-EPSRC Centre for Interventional Surgical Sciences, London, United Kingdom
- Department of Mechanical Engineering, University College London, London, United Kingdom
| |
Collapse
|
6
|
Han S, Kim W, Kim Y. Feasibility study of MEMS-based stenosis detection using a prototypical catheter design with intravascular scanning probes (IVSPs). Med Eng Phys 2023; 117:104000. [PMID: 37331753 DOI: 10.1016/j.medengphy.2023.104000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 04/26/2023] [Accepted: 05/27/2023] [Indexed: 06/20/2023]
Abstract
X-ray coronary angiography (XRA) is a standard clinical method for diagnosing coronary artery disease (CAD). However, despite continuous improvements in XRA technology, it has limitations that include being visible only in color contrast, and the information it provides on coronary artery plaques is not comprehensive due to its low signal-to-noise ratio and limited resolution. In this study, we propose a novel diagnostic tool, a MEMS-based smart catheter with an intravascular scanning probe (IVSP), to complement XRA and verify its effectiveness and feasibility. The IVSP catheter uses Pt strain gauges embedded on the probe to examine the characteristics of a blood vessel, such as the degree of stenosis and morphological structures of the vessel walls, through physical contact. The feasibility test results showed that the output signals of the IVSP catheter reflected the morphological structure of the phantom glass vessel that mimicked stenosis. In particular, the IVSP catheter successfully assessed the morphology of the stenosis, which was only 17% of the cross-sectional diameter obstructed. In addition, the strain distribution on the probe surface was studied using finite element analysis (FEA), and a correlation between the experimental and FEA results was derived.
Collapse
Affiliation(s)
- Suyong Han
- Finemedix, 140-9, Yuram-ro, Dong-gu, Daegu, 41059, Republic of Korea
| | - Woojin Kim
- Advanced Mechatronics Research Group, Korea Institute of Industrial Technology, Daegu, Republic of Korea
| | - Yongdae Kim
- Kyungil University, 50 Gamasilgil, Hayangeup, Gyeongsan, Gyeongbuk, 38428, Republic of Korea.
| |
Collapse
|
7
|
Machine Learning in Cardiovascular Imaging: A Scoping Review of Published Literature. CURRENT RADIOLOGY REPORTS 2023; 11:34-45. [PMID: 36531124 PMCID: PMC9742664 DOI: 10.1007/s40134-022-00407-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/17/2022] [Indexed: 12/14/2022]
Abstract
Purpose of Review In this study, we planned and carried out a scoping review of the literature to learn how machine learning (ML) has been investigated in cardiovascular imaging (CVI). Recent Findings During our search, we found numerous studies that developed or utilized existing ML models for segmentation, classification, object detection, generation, and regression applications involving cardiovascular imaging data. We first quantitatively investigated the different aspects of study characteristics, data handling, model development, and performance evaluation in all studies that were included in our review. We then supplemented these findings with a qualitative synthesis to highlight the common themes in the studied literature and provided recommendations to pave the way for upcoming research. Summary ML is a subfield of artificial intelligence (AI) that enables computers to learn human-like decision-making from data. Due to its novel applications, ML is gaining more and more attention from researchers in the healthcare industry. Cardiovascular imaging is an active area of research in medical imaging with lots of room for incorporating new technologies, like ML. Supplementary Information The online version contains supplementary material available at 10.1007/s40134-022-00407-8.
Collapse
|