1
|
Jacquemyn X, Guerrier K, Harvey E, Tackett S, Kutty S, Wetzel GT. pECGreview: Assessment of a Novel Tool to Evaluate the Accuracy of Pediatric ECG Interpretation Skills. Pediatr Cardiol 2024:10.1007/s00246-024-03556-z. [PMID: 38953950 DOI: 10.1007/s00246-024-03556-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2024] [Accepted: 06/14/2024] [Indexed: 07/04/2024]
Abstract
The skill of interpretation of the electrocardiogram (ECG) remains poor despite existing educational initiatives. We sought to evaluate the validity of using a subjective scoring system to assess the accuracy of ECG interpretations submitted by pediatric cardiology fellows, trainees, and faculty to the Pediatric ECG Review (pECGreview), a web-based ECG interpretation training program. We conducted a retrospective, cross-sectional study of responses submitted to pECGreview. ECG interpretations were assessed independently by four individuals with a range of experience. Accuracy was assessed using a 3-point scale: 100% for generally correct interpretations, 50% for over- or underdiagnosis of minor ECG abnormalities, and 0% for over- or underdiagnosis of major ECG abnormalities. Inter-rater agreement was assessed using expanded Bland-Altman plots, Pearson correlation coefficients, and Intraclass Correlation Coefficients (ICC). 1460 ECG interpretations by 192 participants were analyzed. 107 participants interpreted at least five ECGs. The mean accuracy score was 76.6 ± 13.7%. Participants were correct in 66.1 ± 5.1%, had minor over- or underdiagnosis in 21.5 ± 4.6% and major over- or underdiagnosis in 12.3 ± 3.9% of interpretations. Validation of agreement between evaluators demonstrated limits of agreement of 11.3%. Inter-rater agreement exhibited consistent patterns (all correlations ≥ 0.75). Absolute agreement was 0.74 (95% CI 0.69-0.80), and average measures agreement was 0.92 (95% CI 0.89-0.94). Accuracy score analysis of as few as five ECG interpretations submitted to pECGreview yielded good inter-rater reliability for assessing and ranking ECG interpretation skills in pediatric cardiology fellows in training.
Collapse
Affiliation(s)
- Xander Jacquemyn
- Helen B. Taussig Heart Center, Department of Pediatrics, Johns Hopkins Hospital, M2315, 1800 Orleans St, Baltimore, MD, 21287, USA
- Department of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Karine Guerrier
- Division of Peds Cardiology, Department of Pediatrics, University of Tennessee Health Science Center, College of Medicine, Memphis, TN, USA
| | - Evan Harvey
- Division of Peds Cardiology, Department of Pediatrics, University of Tennessee Health Science Center, College of Medicine, Memphis, TN, USA
| | - Sean Tackett
- Biostatistics, Epidemiology, and Data Management Core, Johns Hopkins School of Medicine, Baltimore, MD, USA
| | - Shelby Kutty
- Helen B. Taussig Heart Center, Department of Pediatrics, Johns Hopkins Hospital, M2315, 1800 Orleans St, Baltimore, MD, 21287, USA
| | - Glenn T Wetzel
- Helen B. Taussig Heart Center, Department of Pediatrics, Johns Hopkins Hospital, M2315, 1800 Orleans St, Baltimore, MD, 21287, USA.
- Division of Peds Cardiology, Department of Pediatrics, University of Tennessee Health Science Center, College of Medicine, Memphis, TN, USA.
| |
Collapse
|
2
|
Kayar O, Sayıcı İU, Yoldaş T, Özgür S. Pediatric Electrocardiography Interpretation: Where We Are Now? Turk Arch Pediatr 2023; 58:612-617. [PMID: 37915270 PMCID: PMC10724843 DOI: 10.5152/turkarchpediatr.2023.23075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 08/20/2023] [Indexed: 11/03/2023]
Abstract
OBJECTIVE Electrocardiography (ECG) is an important diagnostic tool used in the early diagnosis and treatment of arrhythmias and conduction disorders. Pediatricians need to interpret the ECGs correctly and be able to decide the situations that require pediatric cardiology consultation. In this study, we aimed to determine the ECG evaluation competencies of pediatricians. The obtained data will serve as a guide for the development of a training module. MATERIALS AND METHODS Pediatric residents and specialists were included in the study. A questionnaire was sent to the participants via Google Forms. In this questionnaire, participants were asked to evaluate whether 10 ECG samples were normal or abnormal, detect the abnormality in the ECGs, define the specific diagnosis, and indicate how confident they were in their evaluation. A total of 242 participants, 160 of whom were pediatric residents and 82 were pediatricians, were included in the study. RESULTS The mean knowledge level of the participants was 17 ± 4.1 out of 30 points. Electrocardiography knowledge score increased with increasing age, increasing experience after graduation from medical school, increasing seniority during residency training, and increasing self-confidence in ECG interpretation. A significant difference was found between the ECG knowledge scores of those who attended an ECG course after graduation and those who did not. The rate of correctly defining the distinction between normal and abnormal was 93.7%. The rate of detecting pathologies in ECGs accurately and correct identification of specific diagnosis was 56.7%. CONCLUSION The accuracy level of pediatricians in ECG evaluation is low. Electrocardiography trainings are needed to develop ECG assessment skills.
Collapse
Affiliation(s)
- Oğuzhan Kayar
- Department of Pediatrics, Dr. Sami Ulus Maternity, Child Health and Diseases Training and Research Hospital, Ankara, Turkey
| | - İlker Ufuk Sayıcı
- Department of Pediatric Cardiology, Etlik City Hospital, Ankara, Turkey
| | - Tamer Yoldaş
- Department of Pediatric Cardiology, Etlik City Hospital, Ankara, Turkey
| | - Senem Özgür
- Department of Pediatric Cardiology, Etlik City Hospital, Ankara, Turkey
| |
Collapse
|
3
|
Obsekov V, Teng C, Balmer DF. EKG Acquisition Curriculum for Pediatric Trainees. JOURNAL OF MEDICAL EDUCATION AND CURRICULAR DEVELOPMENT 2023; 10:23821205231204758. [PMID: 37822779 PMCID: PMC10563494 DOI: 10.1177/23821205231204758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 09/14/2023] [Indexed: 10/13/2023]
Abstract
OBJECTIVES Pediatric residency trainees interface with electrocardiograms (EKG) as part of routine clinical care. Depending on workflow and availability of support staff, trainees may be required to obtain EKGs on patients, though training on this skill varies. Our intervention seeks to train incoming pediatric residents on obtaining EKGs from pediatric patients and identifying common problems that may result in acquisition of low-fidelity EKGs. METHODS A team of physicians, EKG technicians, and simulation educators designed a 30-min didactic and experiential learning opportunity for incoming pediatric trainees held prior to their start of clinical responsibilities. During the session, trainees were introduced to the basics of EKG acquisition and common quality issues that arise. Afterwards, they practiced placing EKG leads on a mannequin and a live model. A pre- and post-session survey was utilized to assess the session's utility and participant's learning. RESULTS The intervention was perceived as a valuable experience by participants over the course of 2 years. We found increased participant comfort with performing and troubleshooting EKGs (P<.001). There was a 33% improvement in quality assessment of EKG rhythm strips after the session (P<.001). CONCLUSION Given the importance of EKGs to the care of pediatric patients, it is essential that pediatricians receive adequate training in acquiring and assessing EKG quality. This intervention was deemed to be highly useful with a demonstrated improvement in EKG troubleshooting skills among first year pediatric residents. This session improves learner comfort with essential clinical responsibilities and identification of low-quality EKGs that often warrant repeat testing.
Collapse
Affiliation(s)
- Vladislav Obsekov
- Department of Pediatrics, Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | - Christopher Teng
- Department of Pediatrics, Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Department of Cardiology, Boston Children's Hospital, Boston, MA, USA
| | - Dorene F Balmer
- Department of Pediatrics, Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania, Children's Hospital of Philadelphia, Philadelphia, PA, USA
- Department of Cardiology, Boston Children's Hospital, Boston, MA, USA
| |
Collapse
|
4
|
Ebrahim MA, Alseid RK, Aleinati RT, Tuzcu V. Electrocardiogram interpretation among pediatricians: Assessing knowledge, attitudes, and practice. Ann Pediatr Cardiol 2020; 13:205-211. [PMID: 32863655 PMCID: PMC7437623 DOI: 10.4103/apc.apc_18_20] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2020] [Revised: 03/17/2020] [Accepted: 04/05/2020] [Indexed: 11/26/2022] Open
Abstract
Objectives: This study assesses the competency of pediatricians in interpreting electrocardiograms (ECGs). Methods: A cross-sectional study involving 125 pediatricians comprised of 71 general pediatricians, 15 pediatric cardiologists, and 39 other subspecialists recruited from all public hospitals and two specialty centers. Participants completed a questionnaire that included 10 ECGs and questions regarding backgrounds, attitudes, and practices. The ECGs were graded to obtain a knowledge score out of 30 points. Mann–Whitney U test and Kruskal-Wallis test with post hoc analysis and Bonferroni adjustment were used to compare groups. Results: The mean knowledge score ranged from 47.7% to 69.7% among various pediatric specialties (P = 0.006). Age, increasing years of experience, confidence level, number of cardiology referrals, and perceived importance of having good ECG interpretation skills were significantly related to the knowledge score (P ≤ 0.05). Accuracy was highest in identifying normal ECGs (76.8%), supraventricular tachycardia (64.8%), along with long QT interval (58.4%), and was lowest for right bundle branch block (RBBB) (10.4%), 2:1 atrioventricular conduction (10.4%), and atrial tachycardia (AT) (4.8%). Accuracy among pediatric cardiologists was highest for long QT interval (100%), normal ECG (80%), as well as Wolff-Parkinson-White syndrome (80%), and lowest for RBBB (13.3%) and AT (0%). Most pediatricians believe that ECGs are “useful” (78.4%) and that having good interpretation skill is “important” (80.6%). Conclusions: Pediatricians recognize the importance of ECGs. However, their skill and level of accuracy at interpretation is suboptimal, including cardiologists, and may affect patient care. Thus, efforts should be made to improve ECG understanding to provide better service to patients.
Collapse
Affiliation(s)
- Mohammad A Ebrahim
- Department of Pediatrics, Faculty of Medicine, Kuwait University, Jabriya, Kuwait
| | - Reem K Alseid
- Department of Pediatrics, Faculty of Medicine, Kuwait University, Jabriya, Kuwait
| | - Raghad T Aleinati
- Department of Pediatrics, Faculty of Medicine, Kuwait University, Jabriya, Kuwait
| | - Volkan Tuzcu
- Sidra Medicine, Heart Center, Doha, Qatar.,Istanbul Medipol University Hospital, Division of Pediatric Cardiology, Istanbul, Turkey
| |
Collapse
|
5
|
Alonso Moreno F, Orueta Sánchez R, Segura Fragoso A, Rabadán Velasco A, Luna del Pozo L, Villarín Castro A, Baquero Alonso M, Rodríguez Padial L. Estudio de fiabilidad en la interpretación del electrocardiograma por médicos de familia y médicos residentes. Semergen 2018; 44:153-160. [DOI: 10.1016/j.semerg.2016.12.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2016] [Accepted: 12/06/2016] [Indexed: 10/20/2022]
|