1
|
Shivashankara KK, Deepanshi, Mehri Shervedani A, Clifford GD, Reyna MA, Sameni R. ECG-Image-Kit: a synthetic image generation toolbox to facilitate deep learning-based electrocardiogram digitization. Physiol Meas 2024; 45:055019. [PMID: 39150768 DOI: 10.1088/1361-6579/ad4954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 05/09/2024] [Indexed: 08/18/2024]
Abstract
Objective.Cardiovascular diseases are a major cause of mortality globally, and electrocardiograms (ECGs) are crucial for diagnosing them. Traditionally, ECGs are stored in printed formats. However, these printouts, even when scanned, are incompatible with advanced ECG diagnosis software that require time-series data. Digitizing ECG images is vital for training machine learning models in ECG diagnosis, leveraging the extensive global archives collected over decades. Deep learning models for image processing are promising in this regard, although the lack of clinical ECG archives with reference time-series data is challenging. Data augmentation techniques using realistic generative data models provide a solution.Approach.We introduceECG-Image-Kit, an open-source toolbox for generating synthetic multi-lead ECG images with realistic artifacts from time-series data, aimed at automating the conversion of scanned ECG images to ECG data points. The tool synthesizes ECG images from real time-series data, applying distortions like text artifacts, wrinkles, and creases on a standard ECG paper background.Main results.As a case study, we used ECG-Image-Kit to create a dataset of 21 801 ECG images from the PhysioNet QT database. We developed and trained a combination of a traditional computer vision and deep neural network model on this dataset to convert synthetic images into time-series data for evaluation. We assessed digitization quality by calculating the signal-to-noise ratio and compared clinical parameters like QRS width, RR, and QT intervals recovered from this pipeline, with the ground truth extracted from ECG time-series. The results show that this deep learning pipeline accurately digitizes paper ECGs, maintaining clinical parameters, and highlights a generative approach to digitization.Significance.The toolbox has broad applications, including model development for ECG image digitization and classification. The toolbox currently supports data augmentation for the 2024 PhysioNet Challenge, focusing on digitizing and classifying paper ECG images.
Collapse
Affiliation(s)
- Kshama Kodthalu Shivashankara
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, United States of America
| | - Deepanshi
- Department of Biomedical Informatics, Emory University, Atlanta, GA 30322, United States of America
| | - Afagh Mehri Shervedani
- Electrical and Computer Engineering Department, University of Illinois Chicago, Chicago, IL 60607, United States of America
| | - Gari D Clifford
- Department of Biomedical Informatics, Emory University, Atlanta, GA 30322, United States of America
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, United States of America
| | - Matthew A Reyna
- Department of Biomedical Informatics, Emory University, Atlanta, GA 30322, United States of America
| | - Reza Sameni
- Department of Biomedical Informatics, Emory University, Atlanta, GA 30322, United States of America
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30332, United States of America
| |
Collapse
|
2
|
Bellfield RAA, Ortega-Martorell S, Lip GYH, Oxborough D, Olier I. Impact of ECG data format on the performance of machine learning models for the prediction of myocardial infarction. J Electrocardiol 2024; 84:17-26. [PMID: 38471239 DOI: 10.1016/j.jelectrocard.2024.03.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 02/08/2024] [Accepted: 03/04/2024] [Indexed: 03/14/2024]
Abstract
Background We aim to determine which electrocardiogram (ECG) data format is optimal for ML modelling, in the context of myocardial infarction prediction. We will also address the auxiliary objective of evaluating the viability of using digitised ECG signals for ML modelling. Methods Two ECG arrangements displaying 10s and 2.5 s of data for each lead were used. For each arrangement, conservative and speculative data cohorts were generated from the PTB-XL dataset. All ECGs were represented in three different data formats: Signal ECGs, Image ECGs, and Extracted Signal ECGs, with 8358 and 11,621 ECGs in the conservative and speculative cohorts, respectively. ML models were trained using the three data formats in both data cohorts. Results For ECGs that contained 10s of data, Signal and Extracted Signal ECGs were optimal and statistically similar, with AUCs [95% CI] of 0.971 [0.961, 0.981] and 0.974 [0.965, 0.984], respectively, for the conservative cohort; and 0.931 [0.918, 0.945] and 0.919 [0.903, 0.934], respectively, for the speculative cohort. For ECGs that contained 2.5 s of data, the Image ECG format was optimal, with AUCs of 0.960 [0.948, 0.973] and 0.903 [0.886, 0.920], for the conservative and speculative cohorts, respectively. Conclusion When available, the Signal ECG data should be preferred for ML modelling. If not, the optimal format depends on the data arrangement within the ECG: If the Image ECG contains 10s of data for each lead, the Extracted Signal ECG is optimal, however, if it only uses 2.5 s, then using the Image ECG data is optimal for ML performance.
Collapse
Affiliation(s)
- Ryan A A Bellfield
- Data Science Research Centre, Liverpool John Moores University, Byrom Street, Liverpool L3 3AF, UK; Liverpool Centre for Cardiovascular Science at University of Liverpool, Liverpool John Moores University and Liverpool Heart & Chest Hospital, Liverpool, UK
| | - Sandra Ortega-Martorell
- Data Science Research Centre, Liverpool John Moores University, Byrom Street, Liverpool L3 3AF, UK; Liverpool Centre for Cardiovascular Science at University of Liverpool, Liverpool John Moores University and Liverpool Heart & Chest Hospital, Liverpool, UK
| | - Gregory Y H Lip
- Liverpool Centre for Cardiovascular Science at University of Liverpool, Liverpool John Moores University and Liverpool Heart & Chest Hospital, Liverpool, UK; Department of Clinical Medicine, Aalborg University, Denmark
| | - David Oxborough
- Liverpool Centre for Cardiovascular Science at University of Liverpool, Liverpool John Moores University and Liverpool Heart & Chest Hospital, Liverpool, UK; School of Sport and Exercise Sciences, Liverpool John Moores University, Byrom Street, Liverpool L3 3AF, UK
| | - Ivan Olier
- Data Science Research Centre, Liverpool John Moores University, Byrom Street, Liverpool L3 3AF, UK; Liverpool Centre for Cardiovascular Science at University of Liverpool, Liverpool John Moores University and Liverpool Heart & Chest Hospital, Liverpool, UK.
| |
Collapse
|
3
|
Santamónica AF, Carratalá-Sáez R, Larriba Y, Pérez-Castellanos A, Rueda C. ECGMiner: A flexible software for accurately digitizing ECG. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 246:108053. [PMID: 38340566 DOI: 10.1016/j.cmpb.2024.108053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 12/13/2023] [Accepted: 01/27/2024] [Indexed: 02/12/2024]
Abstract
BACKGROUND AND OBJECTIVE The electrocardiogram (ECG) is the most important non-invasive method for elucidating information about heart and cardiovascular disease diagnosis. Typically, the ECG system manufacturing companies provide ECG images, but store the numerical data in a proprietary format that is not interpretable and is not therefore useful for automatic diagnosis. There have been many efforts to digitize paper-based ECGs. The main limitations of previous works in ECG digitization are that they require manual selection of the regions of interest, only partly provide signal digitization, and offer limited accuracy. METHODS We have developed the ECGMiner, an open-source software to digitize ECG images. It is precise, fast, and simple to use. This software digitizes ECGs in four steps: 1) recognizing the image composition; 2) removing the gridline; 3) extracting the signals; 4) post-processing and storing the data. RESULTS We have evaluated the ECGMiner digitization capabilities using the Pearson Correlation Coefficient (PCC) and the Root Mean Square Error (RMSE) measures, and we consider ECG from two large, public, and widely used databases, LUDB and PTB-XL. The actual and digitized values of signals in both databases have been compared. The software's ability to correctly identify the location of characteristic waves has also been validated. Specifically, the PCC values are between 0.971 and 0.995, and the RMSE values are between 0.011 and 0.031 mV. CONCLUSIONS The ECGMiner software presented in this paper is open access, easy to install, easy to use, and capable of precisely recovering the paper-based/digital ECG signal data, regardless of the input format and signal complexity. ECGMiner outperforms existing digitization algorithms in terms of PCC and RMSE values.
Collapse
Affiliation(s)
- Adolfo F Santamónica
- Depto. de Estadística e Investigación Operativa de la Universidad de Valladolid, Paseo de Belén 7, Valladolid, 47011, Castilla y León, Spain.
| | - Rocío Carratalá-Sáez
- Depto. Informática de la Universidad de Valladolid, Paseo de Belén 5, Valladolid, 47011, Castilla y León, Spain.
| | - Yolanda Larriba
- Depto. de Estadística e Investigación Operativa de la Universidad de Valladolid, Paseo de Belén 7, Valladolid, 47011, Castilla y León, Spain.
| | - Alberto Pérez-Castellanos
- Servicio de Cardiología, Hospital Universitario Son Espases, Instituto de Investigación Sanitaria de Baleares (IdISBa), Carretera de Valldemossa, 79, Palma, Illes Balears, Palma, 07120, Illes Balears, Spain.
| | - Cristina Rueda
- Depto. de Estadística e Investigación Operativa de la Universidad de Valladolid, Paseo de Belén 7, Valladolid, 47011, Castilla y León, Spain.
| |
Collapse
|
4
|
Raileanu G, de Jong JSSG. Electrocardiogram Interpretation Using Artificial Intelligence: Diagnosis of Cardiac and Extracardiac Pathologic Conditions. How Far Has Machine Learning Reached? Curr Probl Cardiol 2024; 49:102097. [PMID: 37739276 DOI: 10.1016/j.cpcardiol.2023.102097] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 09/18/2023] [Indexed: 09/24/2023]
Abstract
Artificial intelligence (AI) is already widely used in different fields of medicine, making possible the integration of the paraclinical exams with the clinical findings in patients, for a more accurate and rapid diagnosis and treatment decision. The electrocardiogram remains one of the most important, fastest, cheapest, and noninvasive methods of diagnosis in cardiology, despite the rapid development and progression of the technology. Even if studied a long time ago, it still has a lot of less understood features that, with a better understanding, can give more clues to a correct and prompt diagnosis in a short time. The use of AI in the interpretation of the ECG improved the accuracy and the time to diagnosis in different cardiovascular diseases, and more than this, explaining the decision to make AI diagnosis improved the human understanding of the different features of the ECG that might be considered for a more accurate diagnosis. The purpose of this article is to provide an overview of the most recently published articles about the use of AI in ECG interpretation.
Collapse
Affiliation(s)
- Gabriela Raileanu
- Department of Cardiology, Onze Lieve Vrouwe Gasthuis, Amsterdam, The Netherlands.
| | - Jonas S S G de Jong
- Department of Cardiology, Onze Lieve Vrouwe Gasthuis, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Li F, Wang P, Wang Li X. Deep learning-based regional ECG diagnosis platform. Pacing Clin Electrophysiol 2024; 47:139-148. [PMID: 38029363 DOI: 10.1111/pace.14891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Revised: 11/06/2023] [Accepted: 11/15/2023] [Indexed: 12/01/2023]
Abstract
OBJECTIVE To enable the intelligent diagnosis of a variety of common Electrocardiogram (ECG), we investigate the deep learning-based ECG diagnosis system. METHODS From January 2015 to December 2019, four consecutive years of 100,120 conventional 12-lead ECG data were collected in our hospital. Utilizing this dataset, we constructed a deep learning model designed to intelligently diagnose prevalent ECG anomalies by employing a multi-task learning framework. The system performance was evaluated using various metrics, including sensitivity, specificity, negative predictive value, positive predictive value, and so forth. Additionally, we employed an ECG intelligent diagnostic platform for clinical application to undertake real-time online analysis of 2500 conventional 12-lead ECG samples in June 2020, aiming to validate our model. At this stage, we compared the performance of our model against the traditional manual identification method. RESULTS The efficacy of the ECG intelligent diagnostic model was notably high for common and straightforward ECG patterns, such as sinus rhythm (F1 = 98.01%), sinus tachycardia (F1 = 96.26%), sinus bradycardia (F1 = 94.88%), and a normal electrocardiogram (F1 = 91.71%), as well as for Premature Ventricular Contractions (F1 = 91.62%). Nevertheless, when diagnosing rarer and more intricate ECG anomalies, the system requires an increased number of samples to refine the deep learning models. During the validation stage, our model exhibited better efficiency in terms of accuracy, labor time and labor cost when compared to the manual identification approach. CONCLUSIONS Our deep learning-driven intelligent ECG diagnostic model clearly demonstrates significant clinical utility. The integrated artificial intelligence diagnosis system not only has the potential to augment physicians in their diagnostic processes but also offers a viable avenue to reduce associated labor costs.
Collapse
Affiliation(s)
- Fang Li
- Department of Cardiology, The First Affiliated Hospital of Huzhou University, Huzhou, Zhejiang Province, China
| | - Ping Wang
- Department of Cardiology, The First Affiliated Hospital of Huzhou University, Huzhou, Zhejiang Province, China
| | - Xiao Wang Li
- Department of Cardiology, The First Affiliated Hospital of Huzhou University, Huzhou, Zhejiang Province, China
| |
Collapse
|
6
|
Lence A, Extramiana F, Fall A, Salem JE, Zucker JD, Prifti E. Automatic digitization of paper electrocardiograms - A systematic review. J Electrocardiol 2023; 80:125-132. [PMID: 37352634 DOI: 10.1016/j.jelectrocard.2023.05.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 05/16/2023] [Accepted: 05/22/2023] [Indexed: 06/25/2023]
Abstract
The digitization of electrocardiogram paper records is an essential step to preserve and analyze cardiac data. This digitization process is not flawless as it involves several challenges, such as skew correction, binarization, and signal extraction. Various approaches have been proposed to address these challenges and recent studies have introduced innovative solutions, such as deep learning models and automation processes. Although existing approaches have shown promising results, there is a lack of common databases and metrics where authors could evaluate and compare their methods. Furthermore, the limited accessibility of code or software hinders the comparison process. Overall, while digitization of paper ECG recordings is important in advancing cardiology research, additional efforts are needed to standardize the evaluation process while improving code accessibility. This article provides a systematic review of this process.
Collapse
Affiliation(s)
- Alex Lence
- IRD, Sorbonne Université, Unité de Modélisation Mathématique et Informatique des Systèmes Complexes, UMMISCO, F-93143 Bondy, France.
| | - Fabrice Extramiana
- CRMR Maladies Cardiaques Héréditaires Rares, Hôpital Bichat, Paris, France; Universtité Paris Cité, Paris, France
| | - Ahmad Fall
- IRD, Sorbonne Université, Unité de Modélisation Mathématique et Informatique des Systèmes Complexes, UMMISCO, F-93143 Bondy, France; UMMISCO, Université Cheikh Anta Diop, UCAD, Faculté Des Sciences Et Techniques, FST, ESP, IRD, BP 10700 Dakar, Sénégal
| | - Joe-Elie Salem
- Department of Medicine, Vanderbilt University Medical Center, Nashville, TN, USA; Clinical Investigation Center Paris-Est, CIC-1901, INSERM, UNICO-GRECO Cardio-Oncology Program, Department of Pharmacology, Pitié-Salpêtrière University Hospital, Sorbonne, France
| | - Jean-Daniel Zucker
- IRD, Sorbonne Université, Unité de Modélisation Mathématique et Informatique des Systèmes Complexes, UMMISCO, F-93143 Bondy, France; Sorbonne Université, INSERM, Nutrition et Obesities; systemic approaches, NutriOmique, AP-HP, Hôpital Pitié-Salpêtrière, France
| | - Edi Prifti
- IRD, Sorbonne Université, Unité de Modélisation Mathématique et Informatique des Systèmes Complexes, UMMISCO, F-93143 Bondy, France; Sorbonne Université, INSERM, Nutrition et Obesities; systemic approaches, NutriOmique, AP-HP, Hôpital Pitié-Salpêtrière, France.
| |
Collapse
|
7
|
Noise ECG generation method based on generative adversarial network. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
8
|
Wu H, Patel KHK, Li X, Zhang B, Galazis C, Bajaj N, Sau A, Shi X, Sun L, Tao Y, Al-Qaysi H, Tarusan L, Yasmin N, Grewal N, Kapoor G, Waks JW, Kramer DB, Peters NS, Ng FS. A fully-automated paper ECG digitisation algorithm using deep learning. Sci Rep 2022; 12:20963. [PMID: 36471089 PMCID: PMC9722713 DOI: 10.1038/s41598-022-25284-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Accepted: 11/28/2022] [Indexed: 12/12/2022] Open
Abstract
There is increasing focus on applying deep learning methods to electrocardiograms (ECGs), with recent studies showing that neural networks (NNs) can predict future heart failure or atrial fibrillation from the ECG alone. However, large numbers of ECGs are needed to train NNs, and many ECGs are currently only in paper format, which are not suitable for NN training. We developed a fully-automated online ECG digitisation tool to convert scanned paper ECGs into digital signals. Using automated horizontal and vertical anchor point detection, the algorithm automatically segments the ECG image into separate images for the 12 leads and a dynamical morphological algorithm is then applied to extract the signal of interest. We then validated the performance of the algorithm on 515 digital ECGs, of which 45 were printed, scanned and redigitised. The automated digitisation tool achieved 99.0% correlation between the digitised signals and the ground truth ECG (n = 515 standard 3-by-4 ECGs) after excluding ECGs with overlap of lead signals. Without exclusion, the performance of average correlation was from 90 to 97% across the leads on all 3-by-4 ECGs. There was a 97% correlation for 12-by-1 and 3-by-1 ECG formats after excluding ECGs with overlap of lead signals. Without exclusion, the average correlation of some leads in 12-by-1 ECGs was 60-70% and the average correlation of 3-by-1 ECGs achieved 80-90%. ECGs that were printed, scanned, and redigitised, our tool achieved 96% correlation with the original signals. We have developed and validated a fully-automated, user-friendly, online ECG digitisation tool. Unlike other available tools, this does not require any manual segmentation of ECG signals. Our tool can facilitate the rapid and automated digitisation of large repositories of paper ECGs to allow them to be used for deep learning projects.
Collapse
Affiliation(s)
- Huiyi Wu
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
| | | | - Xinyang Li
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
| | - Bowen Zhang
- National University of Singapore, Singapore, Singapore
| | | | - Nikesh Bajaj
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
| | - Arunashis Sau
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK
| | - Xili Shi
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
| | - Lin Sun
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
| | | | - Harith Al-Qaysi
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK
| | - Lawrence Tarusan
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK
| | - Najira Yasmin
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK
| | - Natasha Grewal
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK
| | - Gaurika Kapoor
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK
| | - Jonathan W Waks
- Harvard-Thorndike Electrophysiology Institute, Beth Israel Deaconess Medical Centre, Harvard Medical School, Boston, MA, USA
| | - Daniel B Kramer
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
- Harvard-Thorndike Electrophysiology Institute, Beth Israel Deaconess Medical Centre, Harvard Medical School, Boston, MA, USA
| | - Nicholas S Peters
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK
| | - Fu Siong Ng
- Imperial College London, National Heart & Lung Institute, London, W12 0NN, UK.
- Department of Cardiology, Imperial College Healthcare NHS Trust, London, UK.
- Cardiac Electrophysiology, National Heart and Lung Institute, Imperial College London, 4th floor, Imperial Centre for Translational and Experimental Medicine, Hammersmith Campus, Du Cane Road, London, W12 0NN, UK.
| |
Collapse
|
9
|
Fatema K, Montaha S, Rony MAH, Azam S, Hasan MZ, Jonkman M. A Robust Framework Combining Image Processing and Deep Learning Hybrid Model to Classify Cardiovascular Diseases Using a Limited Number of Paper-Based Complex ECG Images. Biomedicines 2022; 10:2835. [PMID: 36359355 PMCID: PMC9687837 DOI: 10.3390/biomedicines10112835] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 10/15/2022] [Accepted: 11/03/2022] [Indexed: 12/01/2023] Open
Abstract
Heart disease can be life-threatening if not detected and treated at an early stage. The electrocardiogram (ECG) plays a vital role in classifying cardiovascular diseases, and often physicians and medical researchers examine paper-based ECG images for cardiac diagnosis. An automated heart disease prediction system might help to classify heart diseases accurately at an early stage. This study aims to classify cardiac diseases into five classes with paper-based ECG images using a deep learning approach with the highest possible accuracy and the lowest possible time complexity. This research consists of two approaches. In the first approach, five deep learning models, InceptionV3, ResNet50, MobileNetV2, VGG19, and DenseNet201, are employed. In the second approach, an integrated deep learning model (InRes-106) is introduced, combining InceptionV3 and ResNet50. This model is developed as a deep convolutional neural network capable of extracting hidden and high-level features from images. An ablation study is conducted on the proposed model altering several components and hyperparameters, improving the performance even further. Before training the model, several image pre-processing techniques are employed to remove artifacts and enhance the image quality. Our proposed hybrid InRes-106 model performed best with a testing accuracy of 98.34%. The InceptionV3 model acquired a testing accuracy of 90.56%, the ResNet50 89.63%, the DenseNet201 88.94%, the VGG19 87.87%, and the MobileNetV2 achieved 80.56% testing accuracy. The model is trained with a k-fold cross-validation technique with different k values to evaluate the robustness further. Although the dataset contains a limited number of complex ECG images, our proposed approach, based on various image pre-processing techniques, model fine-tuning, and ablation studies, can effectively diagnose cardiac diseases.
Collapse
Affiliation(s)
- Kaniz Fatema
- Health Informatics Research Lab, Department of Computer Science and Engineering, Daffodil International University, Dhaka 1207, Bangladesh
| | - Sidratul Montaha
- Health Informatics Research Lab, Department of Computer Science and Engineering, Daffodil International University, Dhaka 1207, Bangladesh
| | - Md. Awlad Hossen Rony
- Health Informatics Research Lab, Department of Computer Science and Engineering, Daffodil International University, Dhaka 1207, Bangladesh
| | - Sami Azam
- College of Engineering, IT and Environment, Charles Darwin University, Darwin, NT 0909, Australia
| | - Md. Zahid Hasan
- Health Informatics Research Lab, Department of Computer Science and Engineering, Daffodil International University, Dhaka 1207, Bangladesh
| | - Mirjam Jonkman
- College of Engineering, IT and Environment, Charles Darwin University, Darwin, NT 0909, Australia
| |
Collapse
|
10
|
Randazzo V, Puleo E, Paviglianiti A, Vallan A, Pasero E. Development and Validation of an Algorithm for the Digitization of ECG Paper Images. SENSORS (BASEL, SWITZERLAND) 2022; 22:7138. [PMID: 36236237 PMCID: PMC9572306 DOI: 10.3390/s22197138] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 09/11/2022] [Accepted: 09/15/2022] [Indexed: 06/16/2023]
Abstract
The electrocardiogram (ECG) signal describes the heart's electrical activity, allowing it to detect several health conditions, including cardiac system abnormalities and dysfunctions. Nowadays, most patient medical records are still paper-based, especially those made in past decades. The importance of collecting digitized ECGs is twofold: firstly, all medical applications can be easily implemented with an engineering approach if the ECGs are treated as signals; secondly, paper ECGs can deteriorate over time, therefore a correct evaluation of the patient's clinical evolution is not always guaranteed. The goal of this paper is the realization of an automatic conversion algorithm from paper-based ECGs (images) to digital ECG signals. The algorithm involves a digitization process tested on an image set of 16 subjects, also with pathologies. The quantitative analysis of the digitization method is carried out by evaluating the repeatability and reproducibility of the algorithm. The digitization accuracy is evaluated both on the entire signal and on six ECG time parameters (R-R peak distance, QRS complex duration, QT interval, PQ interval, P-wave duration, and heart rate). Results demonstrate the algorithm efficiency has an average Pearson correlation coefficient of 0.94 and measurement errors of the ECG time parameters are always less than 1 mm. Due to the promising experimental results, the algorithm could be embedded into a graphical interface, becoming a measurement and collection tool for cardiologists.
Collapse
Affiliation(s)
- Vincenzo Randazzo
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Edoardo Puleo
- Dipartimento di Fisica, Università di Torino & Sezione INFN di Torino, 10125 Turin, Italy
| | | | - Alberto Vallan
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| | - Eros Pasero
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy
| |
Collapse
|
11
|
Attallah O. An Intelligent ECG-Based Tool for Diagnosing COVID-19 via Ensemble Deep Learning Techniques. BIOSENSORS 2022; 12:bios12050299. [PMID: 35624600 PMCID: PMC9138764 DOI: 10.3390/bios12050299] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 04/06/2022] [Accepted: 04/24/2022] [Indexed: 06/01/2023]
Abstract
Diagnosing COVID-19 accurately and rapidly is vital to control its quick spread, lessen lockdown restrictions, and decrease the workload on healthcare structures. The present tools to detect COVID-19 experience numerous shortcomings. Therefore, novel diagnostic tools are to be examined to enhance diagnostic accuracy and avoid the limitations of these tools. Earlier studies indicated multiple structures of cardiovascular alterations in COVID-19 cases which motivated the realization of using ECG data as a tool for diagnosing the novel coronavirus. This study introduced a novel automated diagnostic tool based on ECG data to diagnose COVID-19. The introduced tool utilizes ten deep learning (DL) models of various architectures. It obtains significant features from the last fully connected layer of each DL model and then combines them. Afterward, the tool presents a hybrid feature selection based on the chi-square test and sequential search to select significant features. Finally, it employs several machine learning classifiers to perform two classification levels. A binary level to differentiate between normal and COVID-19 cases, and a multiclass to discriminate COVID-19 cases from normal and other cardiac complications. The proposed tool reached an accuracy of 98.2% and 91.6% for binary and multiclass levels, respectively. This performance indicates that the ECG could be used as an alternative means of diagnosis of COVID-19.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt
| |
Collapse
|
12
|
Petmezas G, Stefanopoulos L, Kilintzis V, Tzavelis A, Rogers JA, Katsaggelos AK, Maglaveras N. State-of-the-art Deep Learning Methods on Electrocardiogram Data: A Systematic Review (Preprint). JMIR Med Inform 2022; 10:e38454. [PMID: 35969441 PMCID: PMC9425174 DOI: 10.2196/38454] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Revised: 06/03/2022] [Accepted: 07/03/2022] [Indexed: 11/13/2022] Open
Abstract
Background Electrocardiogram (ECG) is one of the most common noninvasive diagnostic tools that can provide useful information regarding a patient’s health status. Deep learning (DL) is an area of intense exploration that leads the way in most attempts to create powerful diagnostic models based on physiological signals. Objective This study aimed to provide a systematic review of DL methods applied to ECG data for various clinical applications. Methods The PubMed search engine was systematically searched by combining “deep learning” and keywords such as “ecg,” “ekg,” “electrocardiogram,” “electrocardiography,” and “electrocardiology.” Irrelevant articles were excluded from the study after screening titles and abstracts, and the remaining articles were further reviewed. The reasons for article exclusion were manuscripts written in any language other than English, absence of ECG data or DL methods involved in the study, and absence of a quantitative evaluation of the proposed approaches. Results We identified 230 relevant articles published between January 2020 and December 2021 and grouped them into 6 distinct medical applications, namely, blood pressure estimation, cardiovascular disease diagnosis, ECG analysis, biometric recognition, sleep analysis, and other clinical analyses. We provide a complete account of the state-of-the-art DL strategies per the field of application, as well as major ECG data sources. We also present open research problems, such as the lack of attempts to address the issue of blood pressure variability in training data sets, and point out potential gaps in the design and implementation of DL models. Conclusions We expect that this review will provide insights into state-of-the-art DL methods applied to ECG data and point to future directions for research on DL to create robust models that can assist medical experts in clinical decision-making.
Collapse
Affiliation(s)
- Georgios Petmezas
- Lab of Computing, Medical Informatics and Biomedical-Imaging Technologies, The Medical School, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Leandros Stefanopoulos
- Lab of Computing, Medical Informatics and Biomedical-Imaging Technologies, The Medical School, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Vassilis Kilintzis
- Lab of Computing, Medical Informatics and Biomedical-Imaging Technologies, The Medical School, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Andreas Tzavelis
- Department of Biomedical Engineering, Northwestern University, Evanston, IL, United States
| | - John A Rogers
- Department of Material Science, Northwestern University, Evanston, IL, United States
| | - Aggelos K Katsaggelos
- Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL, United States
| | - Nicos Maglaveras
- Lab of Computing, Medical Informatics and Biomedical-Imaging Technologies, The Medical School, Aristotle University of Thessaloniki, Thessaloniki, Greece
| |
Collapse
|
13
|
Attallah O. ECG-BiCoNet: An ECG-based pipeline for COVID-19 diagnosis using Bi-Layers of deep features integration. Comput Biol Med 2022; 142:105210. [PMID: 35026574 PMCID: PMC8730786 DOI: 10.1016/j.compbiomed.2022.105210] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 01/01/2022] [Accepted: 01/01/2022] [Indexed: 12/29/2022]
Abstract
The accurate and speedy detection of COVID-19 is essential to avert the fast propagation of the virus, alleviate lockdown constraints and diminish the burden on health organizations. Currently, the methods used to diagnose COVID-19 have several limitations, thus new techniques need to be investigated to improve the diagnosis and overcome these limitations. Taking into consideration the great benefits of electrocardiogram (ECG) applications, this paper proposes a new pipeline called ECG-BiCoNet to investigate the potential of using ECG data for diagnosing COVID-19. ECG-BiCoNet employs five deep learning models of distinct structural design. ECG-BiCoNet extracts two levels of features from two different layers of each deep learning technique. Features mined from higher layers are fused using discrete wavelet transform and then integrated with lower-layers features. Afterward, a feature selection approach is utilized. Finally, an ensemble classification system is built to merge predictions of three machine learning classifiers. ECG-BiCoNet accomplishes two classification categories, binary and multiclass. The results of ECG-BiCoNet present a promising COVID-19 performance with an accuracy of 98.8% and 91.73% for binary and multiclass classification categories. These results verify that ECG data may be used to diagnose COVID-19 which can help clinicians in the automatic diagnosis and overcome limitations of manual diagnosis.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria, 1029, Egypt.
| |
Collapse
|
14
|
The History and Challenges of SCP-ECG: The Standard Communication Protocol for Computer-Assisted Electrocardiography. HEARTS 2021. [DOI: 10.3390/hearts2030031] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Ever since the first publication of the standard communication protocol for computer-assisted electrocardiography (SCP-ECG), prENV 1064, in 1993, by the European Committee for Standardization (CEN), SCP-ECG has become a leading example in health informatics, enabling open, secure, and well-documented digital data exchange at a low cost, for quick and efficient cardiovascular disease detection and management. Based on the experiences gained, since the 1970s, in computerized electrocardiology, and on the results achieved by the pioneering, international cooperative research on common standards for quantitative electrocardiography (CSE), SCP-ECG was designed, from the beginning, to empower personalized medicine, thanks to serial ECG analysis. The fundamental concept behind SCP-ECG is to convey the necessary information for ECG re-analysis, serial comparison, and interpretation, and to structure the ECG data and metadata in sections that are mostly optional in order to fit all use cases. SCP-ECG is open to the storage of the ECG signal and ECG measurement data, whatever the ECG recording modality or computation method, and can store the over-reading trails and ECG annotations, as well as any computerized or medical interpretation reports. Only the encoding syntax and the semantics of the ECG descriptors and of the diagnosis codes are standardized. We present all of the landmarks in the development and publication of SCP-ECG, from the early 1990s to the 2009 International Organization for Standardization (ISO) SCP-ECG standards, including the latest version published by CEN in 2020, which now encompasses rest and stress ECGs, Holter recordings, and protocol-based trials.
Collapse
|