1
|
Wu YH, Li AH, Chen TC, Liu JK, Tsai KC, Ho MP. Compared with physician overread, computer is less accurate but helpful in interpretation of electrocardiography for ST-segment elevation myocardial infarction. J Electrocardiol 2023; 81:60-65. [PMID: 37572584 DOI: 10.1016/j.jelectrocard.2023.07.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Revised: 07/21/2023] [Accepted: 07/27/2023] [Indexed: 08/14/2023]
Abstract
INTRODUCTION Previous studies have demonstrated varying sensitivity and specificity of computer-interpreted electrocardiography (CIE) in identifying ST-segment elevation myocardial infarction (STEMI). This study aims to evaluate the accuracy of contemporary computer software in recognizing electrocardiography (ECG) signs characteristic of STEMI compared to emergency physician overread in clinical practice. MATERIAL AND METHODS In this retrospective observational single-center study, we reviewed the records of patients in the emergency department (ED) who underwent ECGs and troponin tests. Both the Philips DXL 16-Lead ECG. Algorithm and on-duty emergency physicians interpreted each standard 12‑lead ECG. The sensitivity and specificity of computer interpretation and physician overread ECGs for the definite diagnosis of STEMI were calculated and compared. RESULTS Among the 9340 patients included in the final analysis, 133 were definitively diagnosed with STEMI. When "computer-reported infarct or injury" was used as the indicator, the sensitivity was 87.2% (95% CI 80.3% to 92.4%) and the specificity was 86.2% (95% CI 85.5% to 86.9%). When "physician-overread STEMI" was used as the indicator, the sensitivity was 88.0% (95% CI 81.2% to 93.0%) and the specificity was 99.9% (95% CI 99.8% to 99.9%). The area under the receiver operating characteristic curve for physician-overread STEMI and computer-reported infarct or injury were 0.939 (95% CI 0.907 to 0.972) and 0.867 (95% CI 0.834 to 0.900), respectively. CONCLUSIONS This study reveals that while the sensitivity of the computer in recognizing ECG signs of STEMI is similar to that of physicians, physician overread of ECGs is more specific and, therefore, more accurate than CIE.
Collapse
Affiliation(s)
- Yuan-Hui Wu
- Department of Emergency Medicine, Far Eastern Memorial Hospital, New Taipei City, Taiwan; School of Medicine, Fu-Jen Catholic University, New Taipei City, Taiwan.
| | - Ai-Hsien Li
- Cardiovascular Medical Center, Far Eastern Memorial Hospital, New Taipei City, Taiwan
| | - Tsan-Chi Chen
- Department of Medical Research, Far Eastern Memorial Hospital, New Taipei City, Taiwan.
| | - Jen-Kuei Liu
- Department of Emergency Medicine, Far Eastern Memorial Hospital, New Taipei City, Taiwan
| | - Kuang-Chau Tsai
- Department of Emergency Medicine, Far Eastern Memorial Hospital, New Taipei City, Taiwan.
| | - Min-Po Ho
- Department of Emergency Medicine, Far Eastern Memorial Hospital, New Taipei City, Taiwan.
| |
Collapse
|
2
|
Paez Perez Y, Rimm S, Bove J, Hochman S, Liu T, Catapano A, Shroff N, Lim J, Rimm B. Does the Electrocardiogram Machine Interpretation Affect the Ability to Accurately Diagnose ST-Elevation Myocardial Infarction by Emergency Physicians? Crit Pathw Cardiol 2023; 22:8-12. [PMID: 36812338 DOI: 10.1097/hpc.0000000000000310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/16/2023]
Abstract
INTRODUCTION An ST-elevation myocardial infarction (STEMI) can portend significant morbidity and mortality to the patient and therefore must be rapidly diagnosed by an emergency medicine (EM) physician. The primary aim of this study is to determine whether EM physicians are more or less likely to accurately diagnose STEMI on an electrocardiogram (ECG) if they are blinded to the ECG machine interpretation as opposed to if they are provided the ECG machine interpretation. METHODS We performed a retrospective chart review of adult patients over 18 years of age admitted to our large, urban tertiary care center with a diagnosis of STEMI from January 1, 2016, to December 31, 2017. From these patients' charts, we selected 31 ECGs to create a quiz that was presented twice to a group of emergency physicians. The first quiz contained the 31 ECGs without the computer interpretations revealed. The second quiz, presented to the same physicians 2 weeks later, contained the same set of ECGs with the computer interpretations revealed. Physicians were asked "Based on the ECG above, is there a blocked coronary artery present causing a STEMI?" RESULTS Twenty-five EM physicians completed two 31-question ECG quizzes for a total of 1550 ECG interpretations. On the first quiz with computer interpretations blinded, the overall sensitivity in identifying a "true STEMI" was 67.2% with an overall accuracy of 65.6%. On the second quiz in which the ECG machine interpretation was revealed, the overall sensitivity was 66.4% with an accuracy of 65.8 % in correctly identifying a STEMI. The differences in sensitivity and accuracy were not statistically significant. CONCLUSION This study demonstrated no significant difference in physicians blinded versus those unblinded to computer interpretations of possible STEMI.
Collapse
Affiliation(s)
| | - Sarah Rimm
- Emergency Department, MedStar Franklin Square Medical Center, Baltimore, MD
| | - Joseph Bove
- Emergency Department, St. Joseph's University Medical Center, Paterson, NJ
| | - Steven Hochman
- Emergency Department, St. Joseph's University Medical Center, Paterson, NJ
| | - Tianci Liu
- Emergency Department, Harbor-UCLA Medical Center, Torrance, CA
| | - Anthony Catapano
- Emergency Department, St. Joseph's University Medical Center, Paterson, NJ
| | - Ninad Shroff
- Emergency Department, St. Joseph's University Medical Center, Paterson, NJ
| | - Jessica Lim
- Emergency Department, AdventHealth Apopka, Apopka, FL
| | - Brian Rimm
- Organizational Assessment, Uniformed Services University of the Health Sciences, Bethesda, MD
| |
Collapse
|
3
|
Kim S, Kim W, Kang GH, Jang YS, Choi HY, Kim JG, Lee Y, Shin DG. Analysis of the accuracy of automatic electrocardiogram interpretation in ST-segment elevation myocardial infarction. Clin Exp Emerg Med 2022; 9:18-23. [PMID: 35354230 PMCID: PMC8995511 DOI: 10.15441/ceem.21.163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 11/11/2021] [Indexed: 11/25/2022] Open
Abstract
Objective This study aimed to analyze the association between the culprit artery and the diagnostic accuracy of automatic electrocardiogram (ECG) interpretation in patients with ST-segment elevation myocardial infarction (STEMI). Methods This single-centered, retrospective cohort study included adult patients with STEMI who visited the emergency department between January 2017 and December 2020. The primary endpoint was the association between the culprit artery occlusion and the misinterpretation of ECG, evaluated by the chi-square test or Fisher exact test. Results The rate of misinterpretation of the automated ECG for patients with STEMI was 26.5% (31/117 patients). There was no significant correlation between the ST segment change in the four involved leads (anteroseptal, lateral, inferior, and aVR) and the misinterpretation of ECG (all P > 0.05). Single culprit artery occlusion significantly affected the misinterpretation of ECG compared with multiple culprit artery occlusion (single vs. multiple, 27/86 [31.3%] vs. 4/31 [12.9%], P = 0.045). There was no association between culprit artery and the misinterpretation of ECG (P = 0.132). Conclusion Single culprit artery occlusion might increase misinterpretation of ECG compared with multiple culprit artery occlusions in the automatic interpretation of STEMI.
Collapse
|
4
|
Dave N, Bui S, Morgan C, Hickey S, Paul CL. Interventions targeted at reducing diagnostic error: systematic review. BMJ Qual Saf 2021; 31:297-307. [PMID: 34408064 DOI: 10.1136/bmjqs-2020-012704] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 08/11/2021] [Indexed: 01/01/2023]
Abstract
BACKGROUND Incorrect, delayed and missed diagnoses can contribute to significant adverse health outcomes. Intervention options have proliferated in recent years necessitating an update to McDonald et al's 2013 systematic review of interventions to reduce diagnostic error. OBJECTIVES (1) To describe the types of published interventions for reducing diagnostic error that have been evaluated in terms of an objective patient outcome; (2) to assess the risk of bias in the included interventions and perform a sensitivity analysis of the findings; and (3) to determine the effectiveness of included interventions with respect to their intervention type. METHODS MEDLINE, CINAHL and the Cochrane Database of Systematic Reviews were searched from 1 January 2012 to 31 December 2019. Publications were included if they delivered patient-related outcomes relating to diagnostic accuracy, management outcomes and/or morbidity and mortality. The interventions in each included study were categorised and analysed using the six intervention types described by McDonald et al (technique, technology-based system interventions, educational interventions, personnel changes, structured process changes and additional review methods). RESULTS Twenty studies met the inclusion criteria. Eighteen of the 20 included studies (including three randomised controlled trials (RCTs)) demonstrated improvements in objective patient outcomes following the intervention. These three RCTs individually evaluated a technique-based intervention, a technology-based system intervention and a structured process change. The inclusion or exclusion of two higher risk of bias studies did not affect the results. CONCLUSION Technique-based interventions, technology-based system interventions and structured process changes have been the most studied interventions over the time period of this review and hence are seen to be effective in reducing diagnostic error. However, more high-quality RCTs are required, particularly evaluating educational interventions and personnel changes, to demonstrate the value of these interventions in diverse settings.
Collapse
Affiliation(s)
- Neha Dave
- School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia
| | - Sandy Bui
- School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia
| | - Corey Morgan
- School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia
| | - Simon Hickey
- School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia
| | - Christine L Paul
- School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia.,The University of Newcastle Hunter Medical Research Institute, New Lambton, New South Wales, Australia
| |
Collapse
|
5
|
McLaren JTT, Taher AK, Kapoor M, Yi SL, Chartier LB. Sharing and Teaching Electrocardiograms to Minimize Infarction (STEMI): reducing diagnostic time for acute coronary occlusion in the emergency department. Am J Emerg Med 2021; 48:18-32. [PMID: 33838470 DOI: 10.1016/j.ajem.2021.03.067] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 02/19/2021] [Accepted: 03/21/2021] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Limits to ST-Elevation Myocardial Infarction (STEMI) criteria may lead to prolonged diagnostic time for acute coronary occlusion. We aimed to reduce ECG-to-Activation (ETA) time through audit and feedback on STEMI-equivalents and subtle occlusions, without increasing Code STEMIs without culprit lesions. METHODS This multi-centre, quality improvement initiative reviewed all Code STEMI patients from the emergency department (ED) over a one-year baseline and one-year intervention period. We measured ETA time, from the first ED ECG to the time a Code STEMI was activated. Our intervention strategy involved a grand rounds presentation and an internal website presenting weekly local challenging cases, along with literature on STEMI-equivalents and subtle occlusions. Our outcome measure was ETA time for culprit lesions, our process measure was website views/visits, and our balancing measure was the percentage of Code STEMIs without culprit lesions. RESULTS There were 51 culprit lesions in the baseline period, and 64 in the intervention period. Median ETA declined from 28.0 min (95% confidence interval [CI] 15.0-45.0) to 8.0 min (95%CI 6.0-15.0). The website garnered 70.4 views/week and 27.7 visitors/week in a group of 80 physicians. There was no change in percentage of Code STEMIs without culprit lesions: 28.2% (95%CI 17.8-38.6) to 20.0% (95%CI 11.2-28.8%). Conclusions Our novel weekly web-based feedback to all emergency physicians was associated with a reduction in ETA time by 20 min, without increasing Code STEMIs without culprit lesions. Local ECG audit and feedback, guided by ETA as a quality metric for acute coronary occlusion, could be replicated in other settings to improve care.
Collapse
Affiliation(s)
- Jesse T T McLaren
- Emergency Department, University Health Network, Toronto, ON, Canada; Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada.
| | - Ahmed K Taher
- Emergency Department, University Health Network, Toronto, ON, Canada; Division of Emergency Medicine, Department of Medicine, University of Toronto, Toronto, ON, Canada.
| | - Monika Kapoor
- Emergency Department, University Health Network, Toronto, ON, Canada; Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada.
| | - Soojin L Yi
- Emergency Department, University Health Network, Toronto, ON, Canada; Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada
| | - Lucas B Chartier
- Emergency Department, University Health Network, Toronto, ON, Canada; Division of Emergency Medicine, Department of Medicine, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
6
|
Iftikhar A, Bond R, Mcgilligan V, Leslie SJ, Knoery C, Shand J, Ramsewak A, Sharma D, McShane A, Rjoob K, Peace A. Human-Computer Agreement of Electrocardiogram Interpretation for Patients Referred to and Declined for Primary Percutaneous Coronary Intervention: Retrospective Data Analysis Study. JMIR Med Inform 2021; 9:e24188. [PMID: 33650984 PMCID: PMC7967222 DOI: 10.2196/24188] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Revised: 10/13/2020] [Accepted: 01/17/2021] [Indexed: 12/01/2022] Open
Abstract
Background When a patient is suspected of having an acute myocardial infarction, they are accepted or declined for primary percutaneous coronary intervention partly based on clinical assessment of their 12-lead electrocardiogram (ECG) and ST-elevation myocardial infarction criteria. Objective We retrospectively determined the agreement rate between human (specialists called activator nurses) and computer interpretations of ECGs of patients who were declined for primary percutaneous coronary intervention. Methods Various features of patients who were referred for primary percutaneous coronary intervention were analyzed. Both the human and computer ECG interpretations were simplified to either “suggesting” or “not suggesting” acute myocardial infarction to avoid analysis of complex heterogeneous and synonymous diagnostic terms. Analyses, to measure agreement, and logistic regression, to determine if these ECG interpretations (and other variables such as patient age, chest pain) could predict patient mortality, were carried out. Results Of a total of 1464 patients referred to and declined for primary percutaneous coronary intervention, 722 (49.3%) computer diagnoses suggested acute myocardial infarction, whereas 634 (43.3%) of the human interpretations suggested acute myocardial infarction (P<.001). The human and computer agreed that there was a possible acute myocardial infarction for 342 out of 1464 (23.3%) patients. However, there was a higher rate of human–computer agreement for patients not having acute myocardial infarctions (450/1464, 30.7%). The overall agreement rate was 54.1% (792/1464). Cohen κ showed poor agreement (κ=0.08, P=.001). Only the age (odds ratio [OR] 1.07, 95% CI 1.05-1.09) and chest pain (OR 0.59, 95% CI 0.39-0.89) independent variables were statistically significant (P=.008) in predicting mortality after 30 days and 1 year. The odds for mortality within 1 year of referral were lower in patients with chest pain compared to those patients without chest pain. A referral being out of hours was a trending variable (OR 1.41, 95% CI 0.95-2.11, P=.09) for predicting the odds of 1-year mortality. Conclusions Mortality in patients who were declined for primary percutaneous coronary intervention was higher than the reported mortality for ST-elevation myocardial infarction patients at 1 year. Agreement between computerized and human ECG interpretation is poor, perhaps leading to a high rate of inappropriate referrals. Work is needed to improve computer and human decision making when reading ECGs to ensure that patients are referred to the correct treatment facility for time-critical therapy.
Collapse
Affiliation(s)
- Aleeha Iftikhar
- Computing Engineering and Build Environment, Ulster University, Belfast, United Kingdom
| | - Raymond Bond
- Computing Engineering and Build Environment, Ulster University, Belfast, United Kingdom
| | - Victoria Mcgilligan
- Centre for Personalised Medicine, Ulster University, Londonderry, United Kingdom
| | | | - Charles Knoery
- Cardiac Unit, Raigmore Hospital, Inverness, United Kingdom
| | - James Shand
- Department of Cardiology, Altnagelvin Hospital, Western Health and Social Care Trust, Londonderry, United Kingdom
| | - Adesh Ramsewak
- Department of Cardiology, Altnagelvin Hospital, Western Health and Social Care Trust, Londonderry, United Kingdom
| | - Divyesh Sharma
- Department of Cardiology, Altnagelvin Hospital, Western Health and Social Care Trust, Londonderry, United Kingdom
| | - Anne McShane
- Letterkenny University Hospital, Letterkenny, Ireland
| | - Khaled Rjoob
- Computing Engineering and Build Environment, Ulster University, Belfast, United Kingdom
| | - Aaron Peace
- Department of Cardiology, Altnagelvin Hospital, Western Health and Social Care Trust, Londonderry, United Kingdom
| |
Collapse
|
7
|
McLaren JT, Kapoor M, Yi SL, Chartier LB. Using ECG-To-Activation Time to Assess Emergency Physicians’ Diagnostic Time for Acute Coronary Occlusion. J Emerg Med 2021; 60:25-34. [DOI: 10.1016/j.jemermed.2020.09.028] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 07/24/2020] [Accepted: 09/12/2020] [Indexed: 12/27/2022]
|
8
|
Kashou AH, Ko WY, Attia ZI, Cohen MS, Friedman PA, Noseworthy PA. A comprehensive artificial intelligence–enabled electrocardiogram interpretation program. CARDIOVASCULAR DIGITAL HEALTH JOURNAL 2020; 1:62-70. [PMID: 35265877 PMCID: PMC8890098 DOI: 10.1016/j.cvdhj.2020.08.005] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023] Open
Abstract
Background Automated computerized electrocardiogram (ECG) interpretation algorithms are designed to enhance physician ECG interpretation, minimize medical error, and expedite clinical workflow. However, the performance of current computer algorithms is notoriously inconsistent. We aimed to develop and validate an artificial intelligence–enabled ECG (AI-ECG) algorithm capable of comprehensive 12-lead ECG interpretation with accuracy comparable to practicing cardiologists. Methods We developed an AI-ECG algorithm using a convolutional neural network as a multilabel classifier capable of assessing 66 discrete, structured diagnostic ECG codes using the cardiologist’s final annotation as the gold-standard interpretation. We included 2,499,522 ECGs from 720,978 patients ≥18 years of age with a standard 12-lead ECG obtained at the Mayo Clinic ECG laboratory between 1993 and 2017. The total sample was randomly divided into training (n = 1,749,654), validation (n = 249,951), and testing (n = 499,917) datasets with a similar distribution of codes. We compared the AI-ECG algorithm’s performance to the cardiologist’s interpretation in the testing dataset using receiver operating characteristic (ROC) and precision recall (PR) curves. Results The model performed well for various rhythm, conduction, ischemia, waveform morphology, and secondary diagnoses codes with an area under the ROC curve of ≥0.98 for 62 of the 66 codes. PR metrics were used to assess model performance accounting for category imbalance and demonstrated a sensitivity ≥95% for all codes. Conclusions An AI-ECG algorithm demonstrates high diagnostic performance in comparison to reference cardiologist interpretation of a standard 12-lead ECG. The use of AI-ECG reading tools may permit scalability as ECG acquisition becomes more ubiquitous.
Collapse
Affiliation(s)
| | - Wei-Yin Ko
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota
| | - Zachi I. Attia
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota
| | - Michal S. Cohen
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota
| | - Paul A. Friedman
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota
| | - Peter A. Noseworthy
- Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota
- Address reprint requests and correspondence: Dr Peter A. Noseworthy, Department of Cardiovascular Diseases, Electrophysiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905.
| |
Collapse
|
9
|
Hoang A, Singh A, Singh A. Comparing physicians and experienced advanced practice practitioners on the interpretation of electrocardiograms in the emergency department. Am J Emerg Med 2020; 40:145-147. [PMID: 32061403 DOI: 10.1016/j.ajem.2020.01.047] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Revised: 01/24/2020] [Accepted: 01/27/2020] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Many patients present to emergency departments (ED) in U.S. for evaluation of acute coronary syndrome, and a rapid electrocardiogram (ECG) and interpretation are imperative for initial triage. A growing number of advanced practice practitioners (APP) (e.g. physician assistants, nurse practitioners) are assisting patient care in the ED. PURPOSE This study aims to compare the interpretation of ECGs by experienced APPs, each having 10 or more years of experience, with resident physicians and attending physicians. PATIENTS AND METHODS 99 ED providers were stratified into attendings, residents at varying levels, and APPs were tested to interpret 36 ECGs from a database of ECGs initially interpreted to be ST elevation myocardial infarctions, of which 24 were determined to have a culprit lesion by coronary intervention. RESULTS Attending physicians were the most sensitive (0.86, 95% CI of 0.80 to 0.92) and specific (0.69, 95% Cl of 0.60 to 0.79) at interpreting ECGs, but APPs and physicians in their first year of practice out of residency were almost equally as sensitive [(0.82, 95% CI of 0.76 to 0.88) and (0.82, 95% CI of 0.76 to 0.88)] and specific [(0.62, 95% cl of 0.52 to 0.73) and (0.65, 95% Cl of 0.56 to 0.75)]. CONCLUSION This study suggests the possibility of changing ED workflow where experienced APPs can be responsible for initial screening of an ECG, thus allowing fewer interruptions for ED physicians.
Collapse
Affiliation(s)
- Alexander Hoang
- Emergency Department, Highland Hospital Alameda County, 1411 E 31st St, Oakland, CA 94602, United States of America.
| | - Amarinder Singh
- Emergency Department, Highland Hospital Alameda County, 1411 E 31st St, Oakland, CA 94602, United States of America.
| | - Amandeep Singh
- Emergency Department, Highland Hospital Alameda County, 1411 E 31st St, Oakland, CA 94602, United States of America.
| |
Collapse
|
10
|
Kim KS, Park YS, Moon YJ, Jung KW, Kang J, Hwang GS. Preoperative Myocardial Ischemia Detected With Electrocardiography Is Associated With Reduced 1-Year Survival Rate in Patients Undergoing Liver Transplant. Transplant Proc 2019; 51:2755-2760. [DOI: 10.1016/j.transproceed.2019.02.063] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Accepted: 02/06/2019] [Indexed: 12/27/2022]
|
11
|
Wagenvoort LME, Willemsen RTA, Konings KTS, Stoffers HEJH. Interpretations of and management actions following electrocardiograms in symptomatic patients in primary care: a retrospective dossier study. Neth Heart J 2019; 27:498-505. [PMID: 31301001 PMCID: PMC6773798 DOI: 10.1007/s12471-019-01306-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND The electrocardiogram (ECG) has become a popular tool in primary care. The clinical value of the ECG depends on the appropriateness of the indication and the interpretation skills of the general practitioner (GP). OBJECTIVES To describe the use of electrocardiography in primary care and to assess the performance of GPs in interpreting ECGs and making subsequent management decisions. METHODS Three hundred ECGs, recorded during daily practice in symptomatic patients by 14 GPs who regularly perform electrocardiography, were selected. Corresponding data of the indications, interpretations and subsequent management actions were extracted from the associated medical records. A panel consisting of an expert GP and a cardiologist reviewed the ECGs and specified their agreement with the findings and actions of the study GPs. RESULTS The most common indications were suspicion of a rhythm abnormality (43.7%), ischaemic heart disease (42.7%) and patient reassurance (14.3%). The study GPs interpreted 53.3% of the ECGs as showing no (new or acute) abnormality, whereas supraventricular rhythm disorders (12.3%), conduction disorders (7.7%) and repolarisation disorders (7.0%) were the most frequently reported pathological findings. Overall, the expert panel disagreed with the interpretations of the study GPs in 16.2% of cases, and with the GPs' management actions in 11.7%. Learning goals for GPs performing electrocardiography could be formulated for acute coronary syndrome, rhythm disorders, pulmonary embolism, reassurance, left ventricular hypertrophy and premature ventricular complexes. CONCLUSION GPs who feel competent in electrocardiography performed well in the opinion of the expert panel. We formulated various learning objectives for GPs performing electrocardiography.
Collapse
Affiliation(s)
- L M E Wagenvoort
- Care and Public Health Research Institute (CAPHRI), Department of Family Medicine, Maastricht University, Maastricht, The Netherlands
| | - R T A Willemsen
- Care and Public Health Research Institute (CAPHRI), Department of Family Medicine, Maastricht University, Maastricht, The Netherlands.
| | - K T S Konings
- Care and Public Health Research Institute (CAPHRI), Department of Family Medicine, Maastricht University, Maastricht, The Netherlands
| | - H E J H Stoffers
- Care and Public Health Research Institute (CAPHRI), Department of Family Medicine, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
12
|
Deep Learning with a Recurrent Network Structure in the Sequence Modeling of Imbalanced Data for ECG-Rhythm Classifier. ALGORITHMS 2019. [DOI: 10.3390/a12060118] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
The interpretation of Myocardial Infarction (MI) via electrocardiogram (ECG) signal is a challenging task. ECG signals’ morphological view show significant variation in different patients under different physical conditions. Several learning algorithms have been studied to interpret MI. However, the drawback of machine learning is the use of heuristic features with shallow feature learning architectures. To overcome this problem, a deep learning approach is used for learning features automatically, without conventional handcrafted features. This paper presents sequence modeling based on deep learning with recurrent network for ECG-rhythm signal classification. The recurrent network architecture such as a Recurrent Neural Network (RNN) is proposed to automatically interpret MI via ECG signal. The performance of the proposed method is compared to the other recurrent network classifiers such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). The objective is to obtain the best sequence model for ECG signal processing. This paper also aims to study a proper data partitioning ratio for the training and testing sets of imbalanced data. The large imbalanced data are obtained from MI and healthy control of PhysioNet: The PTB Diagnostic ECG Database 15-lead ECG signals. According to the comparison result, the LSTM architecture shows better performance than standard RNN and GRU architecture with identical hyper-parameters. The LSTM architecture also shows better classification compared to standard recurrent networks and GRU with sensitivity, specificity, precision, F1-score, BACC, and MCC is 98.49%, 97.97%, 95.67%, 96.32%, 97.56%, and 95.32%, respectively. Apparently, deep learning with the LSTM technique is a potential method for classifying sequential data that implements time steps in the ECG signal.
Collapse
|
13
|
Litell JM, Meyers HP, Smith SW. Emergency physicians should be shown all triage ECGs, even those with a computer interpretation of “Normal”. J Electrocardiol 2019; 54:79-81. [DOI: 10.1016/j.jelectrocard.2019.03.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2018] [Revised: 02/24/2019] [Accepted: 03/05/2019] [Indexed: 10/27/2022]
|
14
|
Smith SW, Walsh B, Grauer K, Wang K, Rapin J, Li J, Fennell W, Taboulet P. A deep neural network learning algorithm outperforms a conventional algorithm for emergency department electrocardiogram interpretation. J Electrocardiol 2018; 52:88-95. [PMID: 30476648 DOI: 10.1016/j.jelectrocard.2018.11.013] [Citation(s) in RCA: 49] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2018] [Revised: 09/26/2018] [Accepted: 11/15/2018] [Indexed: 12/18/2022]
Abstract
BACKGROUND Cardiologs® has developed the first electrocardiogram (ECG) algorithm that uses a deep neural network (DNN) for full 12‑lead ECG analysis, including rhythm, QRS and ST-T-U waves. We compared the accuracy of the first version of Cardiologs® DNN algorithm to the Mortara/Veritas® conventional algorithm in emergency department (ED) ECGs. METHODS Individual ECG diagnoses were prospectively mapped to one of 16 pre-specified groups of ECG diagnoses, which were further classified as "major" ECG abnormality or not. Automated interpretations were compared to blinded experts'. The primary outcome was the performance of the algorithms in finding at least one "major" abnormality. The secondary outcome was the proportion of all ECGs for which all groups were identified, with no false negative or false positive groups ("accurate ECG interpretation"). Additionally, we measured sensitivity and positive predictive value (PPV) for any abnormal group. RESULTS Cardiologs® vs. Veritas® accuracy for finding a major abnormality was 92.2% vs. 87.2% (p < 0.0001), with comparable sensitivity (88.7% vs. 92.0%, p = 0.086), improved specificity (94.0% vs. 84.7%, p < 0.0001) and improved positive predictive value (PPV 88.2% vs. 75.4%, p < 0.0001). Cardiologs® had accurate ECG interpretation for 72.0% (95% CI: 69.6-74.2) of ECGs vs. 59.8% (57.3-62.3) for Veritas® (P < 0.0001). Sensitivity for any abnormal group for Cardiologs® and Veritas®, respectively, was 69.6% (95CI 66.7-72.3) vs. 68.3% (95CI 65.3-71.1) (NS). Positive Predictive Value was 74.0% (71.1-76.7) for Cardiologs® vs. 56.5% (53.7-59.3) for Veritas® (P < 0.0001). CONCLUSION Cardiologs' DNN was more accurate and specific in identifying ECGs with at least one major abnormal group. It had a significantly higher rate of accurate ECG interpretation, with similar sensitivity and higher PPV.
Collapse
Affiliation(s)
- Stephen W Smith
- Department of Emergency Medicine, Hennepin County Medical Center, Minneapolis, MN, USA; University of Minnesota, Department of Emergency Medicine, USA.
| | | | - Ken Grauer
- College of Medicine, University of Florida, USA
| | - Kyuhyun Wang
- University of Minnesota, Department of Medicine, Division of Cardiology, USA
| | | | - Jia Li
- Cardiologs® Technologies, Paris, France
| | | | - Pierre Taboulet
- Cardiologs® Technologies, Paris, France; Department of Emergency Medicine, Hôpital Saint Louis, Assistance Publique-Hôpitaux de Paris, Paris, France
| |
Collapse
|
15
|
e-Transmission of ECGs for expert consultation results in improved triage and treatment of patients with acute ischaemic chest pain by ambulance paramedics. Neth Heart J 2018; 26:562-571. [PMID: 30357611 PMCID: PMC6220022 DOI: 10.1007/s12471-018-1187-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
AIMS In pre-hospital settings handled by paramedics, identification of patients with myocardial infarction (MI) remains challenging when automated electrocardiogram (ECG) interpretation is inconclusive. We aimed to identify those patients and to get them on the right track to primary percutaneous coronary intervention (PCI). METHODS AND RESULTS In the Rotterdam-Rijnmond region, automated ECG devices on all ambulances were supplemented with a modem, enabling transmission of ECGs for online expert interpretation. The diagnostic protocol for acute chest pain was modified and monitored for 1 year. Patients with an ECG that met the criteria for ST-elevation myocardial infarction (STEMI) were immediately transported to a PCI hospital. ECGs that did not meet the STEMI criteria, but showed total ST deviation ≥800 µv were transmitted for online interpretation by the ECG expert. Online supervision was offered as a service if ECGs showed conduction disorders, or had an otherwise 'suspicious' pattern according to the ambulance paramedics. We enrolled 1,076 patients with acute ischaemic chest pain who did not meet the automated STEMI criteria. Their mean age was 63 years; 64% were men. After online consultation, 735 (68%) patients were directly transported to a PCI hospital for further treatment. PCI within 90 min was performed in 115 patients. CONCLUSION During a 1-year evaluation of the modified pre-hospital triage protocol for patients with acute ischaemic chest pain, over 100 acute MI patients with an initially inconclusive ECG received primary PCI within 90 min. Because of these results, we decided to continue the operation of the modified protocol.
Collapse
|
16
|
Chartrain AG, Kellner CP, Mocco J. Pre-hospital detection of acute ischemic stroke secondary to emergent large vessel occlusion: lessons learned from electrocardiogram and acute myocardial infarction. J Neurointerv Surg 2018; 10:549-553. [PMID: 29298860 DOI: 10.1136/neurintsurg-2017-013428] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2017] [Revised: 11/10/2017] [Accepted: 11/13/2017] [Indexed: 11/03/2022]
Abstract
Currently, there is no device capable of detecting acute ischemic stroke (AIS) secondary to emergent large vessel occlusion (ELVO) in the pre-hospital setting. The inability to reliably identify patients that would benefit from primary treatment with endovascular thrombectomy remains an important limitation to optimizing emergency medical services (EMS) triage models and time-to-treatment. Several clinical grading scales that rely solely on clinical examination have been proposed and have demonstrated only moderate predictive ability for ELVO. Consequently, a technology capable of detecting ELVO in the pre-hospital setting would be of great benefit. An analogous scenario existed decades ago, in which pre-hospital detection of acute myocardial infarction (AMI) was unreliable until the emergence of the 12-lead ECG and its adoption by EMS providers. This review details the implementation of pre-hospital ECG (PHECG) for the detection of AMI and explores how early experience with PHECG may be applied to ELVO detection devices, once they become available.
Collapse
Affiliation(s)
| | | | - J Mocco
- Department of Neurosurgery, Icahn School of Medicine at Mount Sinai, New York, USA
| |
Collapse
|
17
|
Miranda DF, Lobo AS, Walsh B, Sandoval Y, Smith SW. New Insights Into the Use of the 12-Lead Electrocardiogram for Diagnosing Acute Myocardial Infarction in the Emergency Department. Can J Cardiol 2017; 34:132-145. [PMID: 29407007 DOI: 10.1016/j.cjca.2017.11.011] [Citation(s) in RCA: 59] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2017] [Revised: 11/22/2017] [Accepted: 11/22/2017] [Indexed: 01/05/2023] Open
Abstract
The 12-lead electrocardiogram (ECG) remains the most immediately accessible and widely used initial diagnostic tool for guiding management in patients with suspected myocardial infarction (MI). Although the development of high-sensitivity cardiac troponin assays has improved the rule-in and rule-out and risk stratification of acute MI without ST elevation, the immediate management of the subset of acute MI with acute coronary occlusion depends on integrating clinical presentation and ECG findings. Careful interpretation of the ECG might yield subtle features suggestive of ischemia that might facilitate more rapid triage of patients with subtle acute coronary occlusion or, conversely, in identification of ST-elevation MI mimics (pseudo ST-elevation MI patterns). Our goal in this review article is to consider recent advances in the use of the ECG to diagnose coronary occlusion MIs, including the application of rules that allow MI to be diagnosed on the basis of atypical ECG manifestations. Such rules include the modified Sgarbossa criteria allowing identification of acute MI in left bundle branch block or ventricular pacing, the 3- and 4-variable formula to differentiate normal ST elevation (formerly called early repolarization) from subtle ECG signs of left anterior descending coronary artery occlusion, the differentiation of ST elevation of left ventricular aneurysm from that of acute anterior MI, and the use of lead aVL in the recognition of inferior MI. Improved use of the ECG is essential to improving the diagnosis and appropriate early management of acute coronary occlusion MIs, which will lead to improved outcomes for patients who present with acute coronary syndrome.
Collapse
Affiliation(s)
- David F Miranda
- Division of Cardiology, Department of Medicine, Hennepin County Medical Center and Minneapolis Heart Institute, Abbott Northwestern Hospital, Minneapolis, Minnesota, USA
| | - Angie S Lobo
- Department of Medical Education, Abbott Northwestern Hospital, Minneapolis, Minnesota, USA
| | - Brooks Walsh
- Department of Emergency Medicine, Bridgeport Hospital, Bridgeport, Connecticut, USA
| | - Yader Sandoval
- Mayo Clinic, Department of Cardiovascular Medicine, Rochester, Minnesota, USA
| | - Stephen W Smith
- Department of Emergency Medicine, Hennepin County Medical Center and University of Minnesota, Minneapolis, Minnesota, USA.
| |
Collapse
|
18
|
Driver BE, Khalil A, Henry T, Kazmi F, Adil A, Smith SW. A new 4-variable formula to differentiate normal variant ST segment elevation in V2-V4 (early repolarization) from subtle left anterior descending coronary occlusion - Adding QRS amplitude of V2 improves the model. J Electrocardiol 2017; 50:561-569. [PMID: 28460689 DOI: 10.1016/j.jelectrocard.2017.04.005] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2017] [Indexed: 12/18/2022]
Abstract
INTRODUCTION Precordial normal variant ST elevation (NV-STE), previously often called "early repolarization," may be difficult to differentiate from subtle ischemic STE due to left anterior descending (LAD) occlusion. We previously derived and validated a logistic regression formula that was far superior to STE alone for differentiating the two entities on the ECG. The tool uses R-wave amplitude in lead V4 (RAV4), ST elevation at 60 ms after the J-point in lead V3 (STE60V3) and the computerized Bazett-corrected QT interval (QTc-B). The 3-variable formula is: 1.196 x STE60V3 + 0.059 × QTc-B - 0.326 × RAV4 with a value ≥23.4 likely to be acute myocardial infarction (AMI). HYPOTHESIS Adding QRS voltage in V2 (QRSV2) would improve the accuracy of the formula. METHODS 355 consecutive cases of proven LAD occlusion were reviewed, and those that were obvious ST elevation myocardial infarction were excluded. Exclusion was based on one straight or convex ST segment in V2-V6, 1 millimeter of summed inferior ST depression, any anterior ST depression, Q-waves, "terminal QRS distortion," or any ST elevation >5 mm. The NV-STE group comprised emergency department patients with chest pain who ruled out for AMI by serial troponins, had a cardiologist ECG read of "NV-STE," and had at least 1 mm of STE in V2 and V3. R-wave amplitude in lead V4 (RAV4), ST elevation at 60 ms after the J-point in lead V3 (STE60V3) and the computerized Bazett-corrected QT interval (QTc-B) had previously been measured in all ECGs; physicians blinded to outcome then measured QRSV2 in all ECGs. A 4-variable formula was derived to more accurately classify LAD occlusion vs. NV-STE and optimize area under the curve (AUC) and compared with the previous 3-variable formula. RESULTS There were 143 subtle LAD occlusions and 171 NV-STE. A low QRSV2 added diagnostic utility. The derived 4-variable formula is: 0.052*QTc-B - 0.151*QRSV2 - 0.268*RV4 + 1.062*STE60V3. The 3-variable formula had an AUC of 0.9538 vs. 0.9686 for the 4-variable formula (p = 0.0092). At the same specificity as the 3-variable formula [90.6%, at which cutpoint (≥23.4), 123 of 143 MI were correctly classified for 86% sensitivity], the sensitivity of the new formula at cutpoint ≥17.75 is 90.2%, with 129/143 correctly classified MI, identifying an additional 6 cases. The cutpoint with the highest accuracy (92.0%) was at a cutoff value ≥18.2, with 88.8% sensitivity, 94.7% specificity, and a positive and negative likelihood ratio of 16.9 (95% CI: 8.9-32) and 0.12 (95% CI: 0.07-0.19). At this cutpoint, it correctly classified an additional 11 cases (289 of 315, vs. 278 of 315): 127/143 for MI (an additional 4 cases) and 162/171 for NV-STE (an additional 7 cases). CONCLUSION On the ECG, a 4-variable formula was derived which adds QRSV2; it differentiates subtle LAD occlusion from NV-STE better than the 3-variable formula. At a value ≥18.2, the formula (0.052*QTc-B - 0.151*QRSV2 - 0.268*RV4 + 1.062*STE60V3) was very accurate, sensitive, and specific, with excellent positive and negative likelihood ratios. This formula needs to be validated.
Collapse
Affiliation(s)
- Brian E Driver
- Department of Emergency Medicine, Hennepin County Medical Center, Minneapolis, MN
| | - Ayesha Khalil
- Minneapolis Heart Institute, Abbott Northwestern Hospital, Minneapolis, MN
| | - Timothy Henry
- Minneapolis Heart Institute, Abbott Northwestern Hospital, Minneapolis, MN
| | - Faraz Kazmi
- Department of Medicine, Cardiology of Division, Advocate Lutheran General Hospital, Park Ridge, IL
| | - Amina Adil
- Department of Medicine, Cardiology Division, Aurora St. Luke's Medical Center, Milwaukee, WI
| | - Stephen W Smith
- Department of Emergency Medicine, Hennepin County Medical Center, Minneapolis, MN.
| |
Collapse
|