1
|
Riaz Gondal MU, Atta Mehdi H, Khenhrani RR, Kumari N, Ali MF, Kumar S, Faraz M, Malik J. Role of Machine Learning and Artificial Intelligence in Arrhythmias and Electrophysiology. Cardiol Rev 2024:00045415-990000000-00270. [PMID: 38761137 DOI: 10.1097/crd.0000000000000715] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/20/2024]
Abstract
Machine learning (ML), a subset of artificial intelligence (AI) centered on machines learning from extensive datasets, stands at the forefront of a technological revolution shaping various facets of society. Cardiovascular medicine has emerged as a key domain for ML applications, with considerable efforts to integrate these innovations into routine clinical practice. Within cardiac electrophysiology, ML applications, especially in the automated interpretation of electrocardiograms, have garnered substantial attention in existing literature. However, less recognized are the diverse applications of ML in cardiac electrophysiology and arrhythmias, spanning basic science research on arrhythmia mechanisms, both experimental and computational, as well as contributions to enhanced techniques for mapping cardiac electrical function and translational research related to arrhythmia management. This comprehensive review delves into various ML applications within the scope of this journal, organized into 3 parts. The first section provides a fundamental understanding of general ML principles and methodologies, serving as a foundational resource for readers interested in exploring ML applications in arrhythmia research. The second part offers an in-depth review of studies in arrhythmia and electrophysiology that leverage ML methodologies, showcasing the broad potential of ML approaches. Each subject is thoroughly outlined, accompanied by a review of notable ML research advancements. Finally, the review delves into the primary challenges and future perspectives surrounding ML-driven cardiac electrophysiology and arrhythmias research.
Collapse
Affiliation(s)
| | - Hassan Atta Mehdi
- Department of Medicine, Jinnah Postgraduate Medical Centre, Karachi, Pakistan
| | - Raja Ram Khenhrani
- Department of Medicine, Internal Medicine Fellow, Shaheed Mohtarma Benazir Bhutto Medical College and Lyari General Hospital, Karachi, Pakistan
| | - Neha Kumari
- Department of Medicine, Jinnah Postgraduate Medical Centre, Karachi, Pakistan
| | - Muhammad Faizan Ali
- Department of Medicine, Jinnah Postgraduate Medical Centre, Karachi, Pakistan
| | - Sooraj Kumar
- Department of Medicine, Jinnah Sindh Medical University, Karachi, Pakistan; and
| | - Maria Faraz
- Department of Cardiovascular Medicine, Cardiovascular Analytics Group, Rawalpindi, Pakistan
| | - Jahanzeb Malik
- Department of Cardiovascular Medicine, Cardiovascular Analytics Group, Rawalpindi, Pakistan
| |
Collapse
|
2
|
Rabbani A, Babaei M, Gharib M. Automated segmentation and morphological characterization of placental intervillous space based on a single labeled image. Micron 2023; 169:103448. [PMID: 36965271 DOI: 10.1016/j.micron.2023.103448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Revised: 03/19/2023] [Accepted: 03/20/2023] [Indexed: 03/27/2023]
Abstract
In this study, a novel method of data augmentation has been presented for the segmentation of placental histological images when the labeled data are scarce. This method generates new realizations of the placenta intervillous morphology while maintaining the general textures and orientations. As a result, a diversified artificial dataset of images is generated that can be used for training deep learning segmentation models. We have observed that on average the presented method of data augmentation led to a 42% decrease in the binary cross-entropy loss of the validation dataset compared to the common approach in the literature. Additionally, the morphology of the intervillous space is studied under the effect of the proposed image reconstruction technique, and the diversity of the artificially generated population is quantified. We have demonstrated that the proposed method results in a more accurate morphological characterization of the placental intervillous space with an average feature relative error of 6.5%, which is significantly lower than the 11.5% error observed with conventional augmentation techniques. Due to the high resemblance of the generated images to the real ones, applications of the proposed method may not be limited to placental histological images, and it is recommended that other types of tissue be investigated in future studies.
Collapse
Affiliation(s)
- Arash Rabbani
- School of Computing, University of Leeds, Leeds, UK.
| | - Masoud Babaei
- School of Chemical Engineering and Analytical Science, The University of Manchester, Manchester, UK
| | - Masoumeh Gharib
- Department of Pathology, Mashhad University of Medical Sciences, Mashhad, Iran
| |
Collapse
|
3
|
Abstract
Machine learning (ML), a branch of artificial intelligence, where machines learn from big data, is at the crest of a technological wave of change sweeping society. Cardiovascular medicine is at the forefront of many ML applications, and there is a significant effort to bring them into mainstream clinical practice. In the field of cardiac electrophysiology, ML applications have also seen a rapid growth and popularity, particularly the use of ML in the automatic interpretation of ECGs, which has been extensively covered in the literature. Much lesser known are the other aspects of ML application in cardiac electrophysiology and arrhythmias, such as those in basic science research on arrhythmia mechanisms, both experimental and computational; in the development of better techniques for mapping of cardiac electrical function; and in translational research related to arrhythmia management. In the current review, we examine comprehensively such ML applications as they match the scope of this journal. The current review is organized in 3 parts. The first provides an overview of general ML principles and methodologies that will afford readers of the necessary information on the subject, serving as the foundation for inviting further ML applications in arrhythmia research. The basic information we provide can serve as a guide on how one might design and conduct an ML study. The second part is a review of arrhythmia and electrophysiology studies in which ML has been utilized, highlighting the broad potential of ML approaches. For each subject, we outline comprehensively the general topics, while reviewing some of the research advances utilizing ML under the subject. Finally, we discuss the main challenges and the perspectives for ML-driven cardiac electrophysiology and arrhythmia research.
Collapse
Affiliation(s)
- Natalia A. Trayanova
- Department of Biomedical Engineering, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, USA 21218
- Alliance for Cardiovascular Diagnosis and Treatment Innovation, Whiting School of Engineering and School of Medicine, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, USA 21218
- Division of Cardiology, Department of Medicine, Johns Hopkins University School of Medicine, 733 North Broadway, Baltimore, MD, USA 21205
| | - Dan M. Popescu
- Alliance for Cardiovascular Diagnosis and Treatment Innovation, Whiting School of Engineering and School of Medicine, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, USA 21218
- Department of Applied Mathematics and Statistics, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, USA 21218
| | - Julie K. Shade
- Department of Biomedical Engineering, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, USA 21218
- Alliance for Cardiovascular Diagnosis and Treatment Innovation, Whiting School of Engineering and School of Medicine, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, USA 21218
| |
Collapse
|
4
|
Artificial Intelligence Applications to Improve Risk Prediction Tools in Electrophysiology. CURRENT CARDIOVASCULAR RISK REPORTS 2020. [DOI: 10.1007/s12170-020-00649-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
5
|
Duchateau N, Sermesant M, Delingette H, Ayache N. Model-Based Generation of Large Databases of Cardiac Images: Synthesis of Pathological Cine MR Sequences From Real Healthy Cases. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:755-766. [PMID: 28613164 DOI: 10.1109/tmi.2017.2714343] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Collecting large databases of annotated medical images is crucial for the validation and testing of feature extraction, statistical analysis, and machine learning algorithms. Recent advances in cardiac electromechanical modeling and image synthesis provided a framework to generate synthetic images based on realistic mesh simulations. Nonetheless, their potential to augment an existing database with large amounts of synthetic cases requires further investigation. We build upon these works and propose a revised scheme for synthesizing pathological cardiac sequences from real healthy sequences. Our new pipeline notably involves a much easier registration problem to reduce potential artifacts, and takes advantage of mesh correspondences to generate new data from a given case without additional registration. The output sequences are thoroughly examined in terms of quality and usability on a given application: the assessment of myocardial viability, via the generation of 465 synthetic cine MR sequences (15 healthy and 450 with pathological tissue viability [random location, extent, and grade, up to myocardial infarct]). We demonstrate that: 1) our methodology improves the state-of-the-art algorithms in terms of realism and accuracy of the simulated images and 2) our methodology is well-suited for the generation of large databases at small computational cost.
Collapse
|
6
|
Zhen X, Zhang H, Islam A, Bhaduri M, Chan I, Li S. Direct and simultaneous estimation of cardiac four chamber volumes by multioutput sparse regression. Med Image Anal 2017; 36:184-196. [DOI: 10.1016/j.media.2016.11.008] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2016] [Revised: 09/22/2016] [Accepted: 11/22/2016] [Indexed: 12/19/2022]
|
7
|
Zhou Z, Jin Q, Yu L, Wu L, He B. Noninvasive Imaging of Human Atrial Activation during Atrial Flutter and Normal Rhythm from Body Surface Potential Maps. PLoS One 2016; 11:e0163445. [PMID: 27706179 PMCID: PMC5051739 DOI: 10.1371/journal.pone.0163445] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2016] [Accepted: 09/08/2016] [Indexed: 11/19/2022] Open
Abstract
Background Knowledge of atrial electrophysiological properties is crucial for clinical intervention of atrial arrhythmias and the investigation of the underlying mechanism. This study aims to evaluate the feasibility of a novel noninvasive cardiac electrical imaging technique in imaging bi-atrial activation sequences from body surface potential maps (BSPMs). Methods The study includes 7 subjects, with 3 atrial flutter patients, and 4 healthy subjects with normal atrial activations. The subject-specific heart-torso geometries were obtained from MRI/CT images. The equivalent current densities were reconstructed from 208-channel BSPMs by solving the inverse problem using individual heart-torso geometry models. The activation times were estimated from the time instant corresponding to the highest peak in the time course of the equivalent current densities. To evaluate the performance, a total of 32 cycles of atrial flutter were analyzed. The imaged activation maps obtained from single beats were compared with the average maps and the activation maps measured from CARTO, by using correlation coefficient (CC) and relative error (RE). Results The cardiac electrical imaging technique is capable of imaging both focal and reentrant activations. The imaged activation maps for normal atrial activations are consistent with findings from isolated human hearts. Activation maps for isthmus-dependent counterclockwise reentry were reconstructed on three patients with typical atrial flutter. The method was capable of imaging macro counterclockwise reentrant loop in the right atrium and showed inter-atria electrical conduction through coronary sinus. The imaged activation sequences obtained from single beats showed good correlation with both the average activation maps (CC = 0.91±0.03, RE = 0.29±0.05) and the clinical endocardial findings using CARTO (CC = 0.70±0.04, RE = 0.42±0.05). Conclusions The noninvasive cardiac electrical imaging technique is able to reconstruct complex atrial reentrant activations and focal activation patterns in good consistency with clinical electrophysiological mapping. It offers the potential to assist in radio-frequency ablation of atrial arrhythmia and help defining the underlying arrhythmic mechanism.
Collapse
Affiliation(s)
- Zhaoye Zhou
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, Minnesota, United States of America
| | - Qi Jin
- Department of Cardiology, Ruijin Hospital Affiliated to Shanghai Jiaotong University School of Medicine, Shanghai, China
| | - Long Yu
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, Minnesota, United States of America
| | - Liqun Wu
- Department of Cardiology, Ruijin Hospital Affiliated to Shanghai Jiaotong University School of Medicine, Shanghai, China
| | - Bin He
- Department of Biomedical Engineering, University of Minnesota, Minneapolis, Minnesota, United States of America
- Institute for Engineering in Medicine, University of Minnesota, Minneapolis, Minnesota, United States of America
- * E-mail:
| |
Collapse
|
8
|
Duchateau N, De Craene M, Allain P, Saloux E, Sermesant M. Infarct Localization From Myocardial Deformation: Prediction and Uncertainty Quantification by Regression From a Low-Dimensional Space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:2340-2352. [PMID: 27164583 DOI: 10.1109/tmi.2016.2562181] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Diagnosing and localizing myocardial infarct is crucial for early patient management and therapy planning. We propose a new method for predicting the location of myocardial infarct from local wall deformation, which has value for risk stratification from routine examinations such as (3D) echocardiography. The pipeline combines non-linear dimensionality reduction of deformation patterns and two multi-scale kernel regressions. Confidence in the diagnosis is assessed by a map of local uncertainties, which integrates plausible infarct locations generated from the space of reduced dimensionality. These concepts were tested on 500 synthetic cases generated from a realistic cardiac electromechanical model, and 108 pairs of 3D echocardiographic sequences and delayed-enhancement magnetic resonance images from real cases. Infarct prediction is made at a spatial resolution around 4 mm, more than 10 times smaller than the current diagnosis, made regionally. Our method is accurate, and significantly outperforms the clinically-used thresholding of the deformation patterns (on real data: sensitivity/specificity of 0.828/0.804, area under the curve: 0.909 versus 0.742 for the most predictive strain component). Uncertainty adds value to refine the diagnosis and eventually re-examine suspicious cases.
Collapse
|
9
|
Alessandrini M, De Craene M, Bernard O, Giffard-Roisin S, Allain P, Waechter-Stehle I, Weese J, Saloux E, Delingette H, Sermesant M, D'hooge J. A Pipeline for the Generation of Realistic 3D Synthetic Echocardiographic Sequences: Methodology and Open-Access Database. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:1436-1451. [PMID: 25643402 DOI: 10.1109/tmi.2015.2396632] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Quantification of cardiac deformation and strain with 3D ultrasound takes considerable research efforts. Nevertheless, a widespread use of these techniques in clinical practice is still held back due to the lack of a solid verification process to quantify and compare performance. In this context, the use of fully synthetic sequences has become an established tool for initial in silico evaluation. Nevertheless, the realism of existing simulation techniques is still too limited to represent reliable benchmarking data. Moreover, the fact that different centers typically make use of in-house developed simulation pipelines makes a fair comparison difficult. In this context, this paper introduces a novel pipeline for the generation of synthetic 3D cardiac ultrasound image sequences. State-of-the art solutions in the fields of electromechanical modeling and ultrasound simulation are combined within an original framework that exploits a real ultrasound recording to learn and simulate realistic speckle textures. The simulated images show typical artifacts that make motion tracking in ultrasound challenging. The ground-truth displacement field is available voxelwise and is fully controlled by the electromechanical model. By progressively modifying mechanical and ultrasound parameters, the sensitivity of 3D strain algorithms to pathology and image properties can be evaluated. The proposed pipeline is used to generate an initial library of 8 sequences including healthy and pathological cases, which is made freely accessible to the research community via our project web-page.
Collapse
|
10
|
Seegerer P, Mansi T, Jolly MP, Neumann D, Georgescu B, Kamen A, Kayvanpour E, Amr A, Sedaghat-Hamedani F, Haas J, Katus H, Meder B, Comaniciu D. Estimation of Regional Electrical Properties of the Heart from 12-Lead ECG and Images. ACTA ACUST UNITED AC 2015. [DOI: 10.1007/978-3-319-14678-2_21] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/21/2023]
|
11
|
Zettinig O, Mansi T, Neumann D, Georgescu B, Rapaka S, Seegerer P, Kayvanpour E, Sedaghat-Hamedani F, Amr A, Haas J, Steen H, Katus H, Meder B, Navab N, Kamen A, Comaniciu D. Data-driven estimation of cardiac electrical diffusivity from 12-lead ECG signals. Med Image Anal 2014; 18:1361-76. [PMID: 24857832 DOI: 10.1016/j.media.2014.04.011] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2014] [Revised: 03/17/2014] [Accepted: 04/10/2014] [Indexed: 11/25/2022]
Abstract
Diagnosis and treatment of dilated cardiomyopathy (DCM) is challenging due to a large variety of causes and disease stages. Computational models of cardiac electrophysiology (EP) can be used to improve the assessment and prognosis of DCM, plan therapies and predict their outcome, but require personalization. In this work, we present a data-driven approach to estimate the electrical diffusivity parameter of an EP model from standard 12-lead electrocardiograms (ECG). An efficient forward model based on a mono-domain, phenomenological Lattice-Boltzmann model of cardiac EP, and a boundary element-based mapping of potentials to the body surface is employed. The electrical diffusivity of myocardium, left ventricle and right ventricle endocardium is then estimated using polynomial regression which takes as input the QRS duration and electrical axis. After validating the forward model, we computed 9500 EP simulations on 19 different DCM patients in just under three seconds each to learn the regression model. Using this database, we quantify the intrinsic uncertainty of electrical diffusion for given ECG features and show in a leave-one-patient-out cross-validation that the regression method is able to predict myocardium diffusion within the uncertainty range. Finally, our approach is tested on the 19 cases using their clinical ECG. 84% of them could be personalized using our method, yielding mean prediction errors of 18.7ms for the QRS duration and 6.5° for the electrical axis, both values being within clinical acceptability. By providing an estimate of diffusion parameters from readily available clinical data, our data-driven approach could therefore constitute a first calibration step toward a more complete personalization of cardiac EP.
Collapse
Affiliation(s)
- Oliver Zettinig
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA; Computer Aided Medical Procedures, Technische Universität München, Germany
| | - Tommaso Mansi
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA.
| | - Dominik Neumann
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA; Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | - Bogdan Georgescu
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA
| | - Saikiran Rapaka
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA
| | - Philipp Seegerer
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA; Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany
| | | | | | - Ali Amr
- Heidelberg University Hospital, Heidelberg, Germany
| | - Jan Haas
- Heidelberg University Hospital, Heidelberg, Germany
| | | | - Hugo Katus
- Heidelberg University Hospital, Heidelberg, Germany
| | | | - Nassir Navab
- Computer Aided Medical Procedures, Technische Universität München, Germany
| | - Ali Kamen
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA
| | - Dorin Comaniciu
- Siemens Corporate Technology, Imaging and Computer Vision, Princeton, NJ, USA
| |
Collapse
|
12
|
Erem B, Coll-Font J, Orellana RM, Stovícek P, Brooks DH. Using transmural regularization and dynamic modeling for noninvasive cardiac potential imaging of endocardial pacing with imprecise thoracic geometry. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:726-38. [PMID: 24595345 PMCID: PMC3950945 DOI: 10.1109/tmi.2013.2295220] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Cardiac electrical imaging from body surface potential measurements is increasingly being seen as a technology with the potential for use in the clinic, for example for pre-procedure planning or during-treatment guidance for ventricular arrhythmia ablation procedures. However several important impediments to widespread adoption of this technology remain to be effectively overcome. Here we address two of these impediments: the difficulty of reconstructing electric potentials on the inner (endocardial) as well as outer (epicardial) surfaces of the ventricles, and the need for full anatomical imaging of the subject's thorax to build an accurate subject-specific geometry. We introduce two new features in our reconstruction algorithm: a nonlinear low-order dynamic parameterization derived from the measured body surface signals, and a technique to jointly regularize both surfaces. With these methodological innovations in combination, it is possible to reconstruct endocardial activation from clinically acquired measurements with an imprecise thorax geometry. In particular we test the method using body surface potentials acquired from three subjects during clinical procedures where the subjects' hearts were paced on their endocardia using a catheter device. Our geometric models were constructed using a set of CT scans limited in axial extent to the immediate region near the heart. The catheter system provides a reference location to which we compare our results. We compare our estimates of pacing site localization, in terms of both accuracy and stability, to those reported in a recent clinical publication , where a full set of CT scans were available and only epicardial potentials were reconstructed.
Collapse
|