1
|
Mamalakis M, Garg P, Nelson T, Lee J, Swift AJ, Wild JM, Clayton RH. Artificial Intelligence framework with traditional computer vision and deep learning approaches for optimal automatic segmentation of left ventricle with scar. Artif Intell Med 2023; 143:102610. [PMID: 37673578 DOI: 10.1016/j.artmed.2023.102610] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 05/17/2023] [Accepted: 06/06/2023] [Indexed: 09/08/2023]
Abstract
Automatic segmentation of the cardiac left ventricle with scars remains a challenging and clinically significant task, as it is essential for patient diagnosis and treatment pathways. This study aimed to develop a novel framework and cost function to achieve optimal automatic segmentation of the left ventricle with scars using LGE-MRI images. To ensure the generalization of the framework, an unbiased validation protocol was established using out-of-distribution (OOD) internal and external validation cohorts, and intra-observation and inter-observer variability ground truths. The framework employs a combination of traditional computer vision techniques and deep learning, to achieve optimal segmentation results. The traditional approach uses multi-atlas techniques, active contours, and k-means methods, while the deep learning approach utilizes various deep learning techniques and networks. The study found that the traditional computer vision technique delivered more accurate results than deep learning, except in cases where there was breath misalignment error. The optimal solution of the framework achieved robust and generalized results with Dice scores of 82.8 ± 6.4% and 72.1 ± 4.6% in the internal and external OOD cohorts, respectively. The developed framework offers a high-performance solution for automatic segmentation of the left ventricle with scars using LGE-MRI. Unlike existing state-of-the-art approaches, it achieves unbiased results across different hospitals and vendors without the need for training or tuning in hospital cohorts. This framework offers a valuable tool for experts to accomplish the task of fully automatic segmentation of the left ventricle with scars based on a single-modality cardiac scan.
Collapse
Affiliation(s)
- Michail Mamalakis
- Insigneo Institute for in-silico, Medicine, University of Sheffield, Sheffield, S1 4DP, UK; Department of Computer Science, University of Sheffield, Regent Court, Sheffield, S1 4DP, UK.
| | - Pankaj Garg
- Department of Cardiology, Sheffield Teaching Hospitals Sheffield S5 7AU, UK
| | - Tom Nelson
- Department of Cardiology, Sheffield Teaching Hospitals Sheffield S5 7AU, UK
| | - Justin Lee
- Department of Cardiology, Sheffield Teaching Hospitals Sheffield S5 7AU, UK
| | - Andrew J Swift
- Department of Computer Science, University of Sheffield, Regent Court, Sheffield, S1 4DP, UK; Department of Infection, Immunity & Cardiovascular Disease, University of Sheffield, Sheffield, UK
| | - James M Wild
- Insigneo Institute for in-silico, Medicine, University of Sheffield, Sheffield, S1 4DP, UK; Polaris, Imaging Sciences, Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, UK
| | - Richard H Clayton
- Insigneo Institute for in-silico, Medicine, University of Sheffield, Sheffield, S1 4DP, UK; Department of Computer Science, University of Sheffield, Regent Court, Sheffield, S1 4DP, UK.
| |
Collapse
|
2
|
Artificial Intelligence as a Diagnostic Tool in Non-Invasive Imaging in the Assessment of Coronary Artery Disease. Med Sci (Basel) 2023; 11:medsci11010020. [PMID: 36976528 PMCID: PMC10053913 DOI: 10.3390/medsci11010020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 03/02/2023] Open
Abstract
Coronary artery disease (CAD) remains a leading cause of mortality and morbidity worldwide, and it is associated with considerable economic burden. In an ageing, multimorbid population, it has become increasingly important to develop reliable, consistent, low-risk, non-invasive means of diagnosing CAD. The evolution of multiple cardiac modalities in this field has addressed this dilemma to a large extent, not only in providing information regarding anatomical disease, as is the case with coronary computed tomography angiography (CCTA), but also in contributing critical details about functional assessment, for instance, using stress cardiac magnetic resonance (S-CMR). The field of artificial intelligence (AI) is developing at an astounding pace, especially in healthcare. In healthcare, key milestones have been achieved using AI and machine learning (ML) in various clinical settings, from smartwatches detecting arrhythmias to retinal image analysis and skin cancer prediction. In recent times, we have seen an emerging interest in developing AI-based technology in the field of cardiovascular imaging, as it is felt that ML methods have potential to overcome some limitations of current risk models by applying computer algorithms to large databases with multidimensional variables, thus enabling the inclusion of complex relationships to predict outcomes. In this paper, we review the current literature on the various applications of AI in the assessment of CAD, with a focus on multimodality imaging, followed by a discussion on future perspectives and critical challenges that this field is likely to encounter as it continues to evolve in cardiology.
Collapse
|
3
|
Automatic development of 3D anatomical models of border zone and core scar regions in the left ventricle. Comput Med Imaging Graph 2023; 103:102152. [PMID: 36525769 DOI: 10.1016/j.compmedimag.2022.102152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Revised: 10/17/2022] [Accepted: 11/27/2022] [Indexed: 12/03/2022]
Abstract
Patients with myocardial infarction are at elevated risk of sudden cardiac death, and scar tissue arising from infarction is known to play a role. The accurate identification of scars therefore is crucial for risk assessment, quantification and guiding interventions. Typically, core scars and grey peripheral zones are identified by radiologists and clinicians based on cardiac late gadolinium enhancement magnetic resonance images (LGE-MRI). Scar regions from LGE-MRI vary in size, shape, heterogeneity, artifacts, and image resolution. Thus, manual segmentation is time consuming, and influenced by the observer's experience (bias effect). We propose a fully automatic framework that develops 3D anatomical models of the left ventricle with border zone and core scar regions that are free from bias effect. Our myocardium (SOCRATIS), border scar and core scar (BZ-SOCRATIS) segmentation pipelines were evaluated using internal and external validation datasets. The automatic myocardium segmentation framework performed a Dice score of 81.9% and 70.0% in the internal and external validation dataset. The automatic scar segmentation pipeline achieved a Dice score of 60.9% for the core scar segmentation and 43.7% for the border zone scar segmentation in the internal dataset and in the external dataset a Dice score of 44.2% for the core scar segmentation and 54.8% for the border scar segmentation respectively. To the best of our knowledge, this is the first study outlining a fully automatic framework to develop 3D anatomical models of the left ventricle with border zone and core scar regions. Our method exhibits high performance without the need for training or tuning in an unseen cohort (unsupervised).
Collapse
|
4
|
Sharkey MJ, Taylor JC, Alabed S, Dwivedi K, Karunasaagarar K, Johns CS, Rajaram S, Garg P, Alkhanfar D, Metherall P, O'Regan DP, van der Geest RJ, Condliffe R, Kiely DG, Mamalakis M, Swift AJ. Fully automatic cardiac four chamber and great vessel segmentation on CT pulmonary angiography using deep learning. Front Cardiovasc Med 2022; 9:983859. [PMID: 36225963 PMCID: PMC9549370 DOI: 10.3389/fcvm.2022.983859] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 09/02/2022] [Indexed: 11/13/2022] Open
Abstract
Introduction Computed tomography pulmonary angiography (CTPA) is an essential test in the work-up of suspected pulmonary vascular disease including pulmonary hypertension and pulmonary embolism. Cardiac and great vessel assessments on CTPA are based on visual assessment and manual measurements which are known to have poor reproducibility. The primary aim of this study was to develop an automated whole heart segmentation (four chamber and great vessels) model for CTPA. Methods A nine structure semantic segmentation model of the heart and great vessels was developed using 200 patients (80/20/100 training/validation/internal testing) with testing in 20 external patients. Ground truth segmentations were performed by consultant cardiothoracic radiologists. Failure analysis was conducted in 1,333 patients with mixed pulmonary vascular disease. Segmentation was achieved using deep learning via a convolutional neural network. Volumetric imaging biomarkers were correlated with invasive haemodynamics in the test cohort. Results Dice similarity coefficients (DSC) for segmented structures were in the range 0.58-0.93 for both the internal and external test cohorts. The left and right ventricle myocardium segmentations had lower DSC of 0.83 and 0.58 respectively while all other structures had DSC >0.89 in the internal test cohort and >0.87 in the external test cohort. Interobserver comparison found that the left and right ventricle myocardium segmentations showed the most variation between observers: mean DSC (range) of 0.795 (0.785-0.801) and 0.520 (0.482-0.542) respectively. Right ventricle myocardial volume had strong correlation with mean pulmonary artery pressure (Spearman's correlation coefficient = 0.7). The volume of segmented cardiac structures by deep learning had higher or equivalent correlation with invasive haemodynamics than by manual segmentations. The model demonstrated good generalisability to different vendors and hospitals with similar performance in the external test cohort. The failure rates in mixed pulmonary vascular disease were low (<3.9%) indicating good generalisability of the model to different diseases. Conclusion Fully automated segmentation of the four cardiac chambers and great vessels has been achieved in CTPA with high accuracy and low rates of failure. DL volumetric biomarkers can potentially improve CTPA cardiac assessment and invasive haemodynamic prediction.
Collapse
Affiliation(s)
- Michael J. Sharkey
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- 3D Imaging Lab, Sheffield Teaching Hospitals NHSFT, Sheffield, United Kingdom
| | - Jonathan C. Taylor
- 3D Imaging Lab, Sheffield Teaching Hospitals NHSFT, Sheffield, United Kingdom
| | - Samer Alabed
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
| | - Krit Dwivedi
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield, United Kingdom
| | - Kavitasagary Karunasaagarar
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Radiology Department, Sheffield Teaching Hospitals NHSFT, Sheffield, United Kingdom
| | - Christopher S. Johns
- Radiology Department, Sheffield Teaching Hospitals NHSFT, Sheffield, United Kingdom
| | - Smitha Rajaram
- Radiology Department, Sheffield Teaching Hospitals NHSFT, Sheffield, United Kingdom
| | - Pankaj Garg
- Norwich Medical School, University of East Anglia, Norwich, United Kingdom
| | - Dheyaa Alkhanfar
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
| | - Peter Metherall
- 3D Imaging Lab, Sheffield Teaching Hospitals NHSFT, Sheffield, United Kingdom
| | - Declan P. O'Regan
- MRC London Institute of Medical Sciences, Imperial College London, London, United Kingdom
| | | | - Robin Condliffe
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Sheffield Pulmonary Vascular Disease Unit, Sheffield Teaching Hospitals NHS Trust, Sheffield, United Kingdom
| | - David G. Kiely
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield, United Kingdom
- Sheffield Pulmonary Vascular Disease Unit, Sheffield Teaching Hospitals NHS Trust, Sheffield, United Kingdom
| | - Michail Mamalakis
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield, United Kingdom
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
| | - Andrew J. Swift
- Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
- Insigneo Institute for in Silico Medicine, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
5
|
Computational Methods for Fluid-Structure Interaction Simulation of Heart Valves in Patient-Specific Left Heart Anatomies. FLUIDS 2022. [DOI: 10.3390/fluids7030094] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Given the complexity of human left heart anatomy and valvular structures, the fluid–structure interaction (FSI) simulation of native and prosthetic valves poses a significant challenge for numerical methods. In this review, recent numerical advancements for both fluid and structural solvers for heart valves in patient-specific left hearts are systematically considered, emphasizing the numerical treatments of blood flow and valve surfaces, which are the most critical aspects for accurate simulations. Numerical methods for hemodynamics are considered under both the continuum and discrete (particle) approaches. The numerical treatments for the structural dynamics of aortic/mitral valves and FSI coupling methods between the solid Ωs and fluid domain Ωf are also reviewed. Future work toward more advanced patient-specific simulations is also discussed, including the fusion of high-fidelity simulation within vivo measurements and physics-based digital twining based on data analytics and machine learning techniques.
Collapse
|