Is computer-assisted instruction more effective than other educational methods in achieving ECG competence among medical students and residents? Protocol for a systematic review and meta-analysis

Clinically contextualised ECG interpretation: the impact of prior clinical exposure and case vignettes on ECG diagnostic accuracy

BACKGROUND

ECGs are often taught without clinical context. However, in the clinical setting, ECGs are rarely interpreted without knowing the clinical presentation. We aimed to determine whether ECG diagnostic accuracy was influenced by knowledge of the clinical context and/or prior clinical exposure to the ECG diagnosis.

METHODS

Fourth- (junior) and sixth-year (senior) medical students, as well as medical residents were invited to complete two multiple-choice question (MCQ) tests and a survey. Test 1 comprised 25 ECGs without case vignettes. Test 2, completed immediately thereafter, comprised the same 25 ECGs and MCQs, but with case vignettes for each ECG. Subsequently, participants indicated in the survey when last, during prior clinical clerkships, they have seen each of the 25 conditions tested. Eligible participants completed both tests and survey. We estimated that a minimum sample size of 165 participants would provide 80% power to detect a mean difference of 7% in test scores, considering a type 1 error of 5%.

RESULTS

This study comprised 176 participants (67 [38.1%] junior students, 55 [31.3%] senior students, 54 [30.7%] residents). Prior ECG exposure depended on their level of training, i.e., junior students were exposed to 52% of the conditions tested, senior students 63.4% and residents 96.9%. Overall, there was a marginal improvement in ECG diagnostic accuracy when the clinical context was known (Cohen's d = 0.35, p < 0.001). Gains in diagnostic accuracy were more pronounced amongst residents (Cohen's d = 0.59, p < 0.001), than senior (Cohen's d = 0.38, p < 0.001) or junior students (Cohen's d = 0.29, p < 0.001). All participants were more likely to make a correct ECG diagnosis if they reported having seen the condition during prior clinical training, whether they were provided with a case vignette (odds ratio [OR] 1.46, 95% confidence interval [CI] 1.24-1.71) or not (OR 1.58, 95% CI 1.35-1.84).

CONCLUSION

ECG interpretation using clinical vignettes devoid of real patient experiences does not appear to have as great an impact on ECG diagnostic accuracy as prior clinical exposure. However, exposure to ECGs during clinical training is largely opportunistic and haphazard. ECG training should therefore not rely on experiential learning alone, but instead be supplemented by other formal methods of instruction.

Utility of mobile learning in Electrocardiography

Aims

Mobile learning is attributed to the acquisition of knowledge derived from accessing information on a mobile device. Although increasingly implemented in medical education, research on its utility in Electrocardiography remains sparse. In this study, we explored the effect of mobile learning on the accuracy of electrocardiogram (ECG) analysis and interpretation.

Methods and results

The study comprised 181 participants (77 fourth- and 69 sixth-year medical students, and 35 residents). Participants were randomized to analyse ECGs with a mobile learning strategy [either searching the Internet or using an ECG reference application (app)] or not. For each ECG, they provided their initial diagnosis, key supporting features, and final diagnosis consecutively. Two weeks later, they analysed the same ECGs, without access to any mobile device. ECG interpretation was more accurate when participants used the ECG app (56%), as compared to searching the Internet (50.3%) or neither (43.5%, P = 0.001). Importantly, mobile learning supported participants in revising their initial incorrect ECG diagnosis (ECG app 18.7%, Internet search 13.6%, no mobile device 8.4%, P < 0.001). However, whilst this was true for students, there was no significant difference amongst residents. Internet searches were only useful if participants identified the correct ECG features. The app was beneficial when participants searched by ECG features, but not by diagnosis. Using the ECG reference app required less time than searching the Internet (7:44 ± 4:13 vs. 9:14 ± 4:34, P < 0.001). Mobile learning gains were not sustained after 2 weeks.

Conclusion

Whilst mobile learning contributes to increased ECG diagnostic accuracy, the benefits were not sustained over time.

Effectiveness of blended learning versus lectures alone on ECG analysis and interpretation by medical students

BACKGROUND

Most medical students lack confidence and are unable to accurately interpret ECGs. Thus, better methods of ECG instruction are being sought. Current literature indicates that the use of e-learning for ECG analysis and interpretation skills (ECG competence) is not superior to lecture-based teaching. We aimed to assess whether blended learning (lectures supplemented with the use of a web application) resulted in better acquisition and retention of ECG competence in medical students, compared to conventional teaching (lectures alone).

METHODS

Two cohorts of fourth-year medical students were studied prospectively. The conventional teaching cohort (n = 67) attended 4 hours of interactive lectures, covering the basic principles of Electrocardiography, waveform abnormalities and arrhythmias. In addition to attending the same lectures, the blended learning cohort (n = 64) used a web application that facilitated deliberate practice of systematic ECG analysis and interpretation, with immediate feedback. All participants completed three tests: pre-intervention (assessing baseline ECG competence at start of clinical clerkship), immediate post-intervention (assessing acquisition of ECG competence at end of six-week clinical clerkship) and delayed post-intervention (assessing retention of ECG competence 6 months after clinical clerkship, without any further ECG training). Diagnostic accuracy and uncertainty were assessed in each test.

RESULTS

The pre-intervention test scores were similar for blended learning and conventional teaching cohorts (mean 31.02 ± 13.19% versus 31.23 ± 11.52% respectively, p = 0.917). While all students demonstrated meaningful improvement in ECG competence after teaching, blended learning was associated with significantly better scores, compared to conventional teaching, in immediate (75.27 ± 16.22% vs 50.27 ± 17.10%, p <  0.001; Cohen's d = 1.58), and delayed post-intervention tests (57.70 ± 18.54% vs 37.63 ± 16.35%, p <  0.001; Cohen's d = 1.25). Although diagnostic uncertainty decreased after ECG training in both cohorts, blended learning was associated with better confidence in ECG analysis and interpretation.

CONCLUSION

Blended learning achieved significantly better levels of ECG competence and confidence amongst medical students than conventional ECG teaching did. Although medical students underwent significant attrition of ECG competence without ongoing training, blended learning also resulted in better retention of ECG competence than conventional teaching. Web applications encouraging a stepwise approach to ECG analysis and enabling deliberate practice with feedback may, therefore, be a useful adjunct to lectures for teaching Electrocardiography.

Determining electrocardiography training priorities for medical students using a modified Delphi method

BACKGROUND

Although electrocardiography is considered a core learning outcome for medical students, there is currently little curricular guidance for undergraduate ECG training. Owing to the absence of expert consensus on undergraduate ECG teaching, curricular content is subject to individual opinion. The aim of this modified Delphi study was to establish expert consensus amongst content and context experts on an ECG curriculum for medical students.

METHODS

The Delphi technique, an established method of obtaining consensus, was used to develop an undergraduate ECG curriculum. Specialists involved in ECG teaching were invited to complete three rounds of online surveys. An undergraduate ECG curriculum was formulated from the topics of ECG instruction for which consensus (i.e. ≥75% agreement) was achieved.

RESULTS

The panellists (n = 131) had a wide range of expertise (42.8% Internal Medicine, 22.9% Cardiology, 16% Family Medicine, 13.7% Emergency Medicine and 4.6% Health Professions Education). Topics that reached consensus to be included in the undergraduate ECG curriculum were classified under technical aspects of performing ECGs, basic ECG analysis, recognition of the normal ECG and abnormal rhythms and waveforms and using electrocardiography as part of a clinical diagnosis. This study emphasises that ECG teaching should be framed within the clinical context. Course conveners should not overload students with complex and voluminous content, but rather focus on commonly encountered and life-threatening conditions, where accurate diagnosis impacts on patient outcome. A list of 23 "must know" ECG diagnoses is therefore proposed.

CONCLUSION

A multidisciplinary expert panel reached consensus on the ECG training priorities for medical students.

Blended Learning Compared to Traditional Learning in Medical Education: Systematic Review and Meta-Analysis

Background

Blended learning, which combines face-to-face learning and e-learning, has grown rapidly to be commonly used in education. Nevertheless, the effectiveness of this learning approach has not been completely quantitatively synthesized and evaluated using knowledge outcomes in health education.

Objective

The aim of this study was to assess the effectiveness of blended learning compared to that of traditional learning in health education.

Methods

We performed a systematic review of blended learning in health education in MEDLINE from January 1990 to July 2019. We independently selected studies, extracted data, assessed risk of bias, and compared overall blended learning versus traditional learning, offline blended learning versus traditional learning, online blended learning versus traditional learning, digital blended learning versus traditional learning, computer-aided instruction blended learning versus traditional learning, and virtual patient blended learning versus traditional learning. All pooled analyses were based on random-effect models, and the I² statistic was used to quantify heterogeneity across studies.

Results

A total of 56 studies (N=9943 participants) assessing several types of learning support in blended learning met our inclusion criteria; 3 studies investigated offline support, 7 studies investigated digital support, 34 studies investigated online support, 8 studies investigated computer-assisted instruction support, and 5 studies used virtual patient support for blended learning. The pooled analysis comparing all blended learning to traditional learning showed significantly better knowledge outcomes for blended learning (standardized mean difference 1.07, 95% CI 0.85 to 1.28, I²=94.3%). Similar results were observed for online (standardized mean difference 0.73, 95% CI 0.60 to 0.86, I²=94.9%), computer-assisted instruction (standardized mean difference 1.13, 95% CI 0.47 to 1.79, I²=78.0%), and virtual patient (standardized mean difference 0.62, 95% CI 0.18 to 1.06, I²=78.4%) learning support, but results for offline learning support (standardized mean difference 0.08, 95% CI –0.63 to 0.79, I²=87.9%) and digital learning support (standardized mean difference 0.04, 95% CI –0.45 to 0.52, I²=93.4%) were not significant.

Conclusions

From this review, blended learning demonstrated consistently better effects on knowledge outcomes when compared with traditional learning in health education. Further studies are needed to confirm these results and to explore the utility of different design variants of blended learning.

Is computer-assisted instruction more effective than other educational methods in achieving ECG competence amongst medical students and residents? A systematic review and meta-analysis

OBJECTIVES

It remains unclear whether computer-assisted instruction (CAI) is more effective than other teaching methods in acquiring and retaining ECG competence among medical students and residents.

DESIGN

This systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

DATA SOURCES

Electronic literature searches of PubMed, databases via EBSCOhost, Scopus, Web of Science, Google Scholar and grey literature were conducted on 28 November 2017. We subsequently reviewed the citation indexes for articles identified by the search.

ELIGIBILITY CRITERIA

Studies were included if a comparative research design was used to evaluate the efficacy of CAI versus other methods of ECG instruction, as determined by the acquisition and/or retention of ECG competence of medical students and/or residents.

DATA EXTRACTION AND SYNTHESIS

Two reviewers independently extracted data from all eligible studies and assessed the risk of bias. After duplicates were removed, 559 papers were screened. Thirteen studies met the eligibility criteria. Eight studies reported sufficient data to be included in the meta-analysis.

RESULTS

In all studies, CAI was compared with face-to-face ECG instruction. There was a wide range of computer-assisted and face-to-face teaching methods. Overall, the meta-analysis found no significant difference in acquired ECG competence between those who received computer-assisted or face-to-face instruction. However, subanalyses showed that CAI in a blended learning context was better than face-to-face teaching alone, especially if trainees had unlimited access to teaching materials and/or deliberate practice with feedback. There was no conclusive evidence that CAI was better than face-to-face teaching for longer-term retention of ECG competence.

CONCLUSION

CAI was not better than face-to-face ECG teaching. However, this meta-analysis was constrained by significant heterogeneity amongst studies. Nevertheless, the finding that blended learning is more effective than face-to-face ECG teaching is important in the era of increased implementation of e-learning.

PROSPERO REGISTRATION NUMBER

CRD42017067054.

Comparative study of virtual and traditional teaching methods on the interpretation of cardiac dysrhythmia in nursing students

INTRODUCTION

Due to the importance of correct interpretation of electrocardiogram (ECG) in the quality of healthcare delivery, new educational methods are increasingly being implemented and evaluated. In this regard, the purpose of this study was to compare the traditional and virtual teaching methods on the interpretation of cardiac dysrhythmia in nursing students.

METHODS

The present study is a quasi-experimental research with pretest and posttest design. Sixty nursing students in the seventh semester from schools of nursing in Urmia and Khoy cities were randomly assigned to two virtual and traditional education groups. Students' knowledge was measured by a researcher-made 30-item test.

RESULTS

The mean and standard deviation of the students' scores in the traditional education group was 11.20 ± 4.41 and 14.40 ± 4.62 and in the virtual group was 11.30 ± 2.74 and 18.43 ± 4.68, pre- and post-training, respectively. Paired t-test showed a significant difference between the mean score of pretest and posttest in both types of training (P < 0.001). According to the results of independent sample t-test, there were no significant differences between the two groups before the training (P > 0.05). However, in the posttraining period, there were significant differences between traditional and virtual education groups (P < 0.001).

CONCLUSION

Considering the results of this study, which shows the positive effects of virtual education method on nursing students' knowledge about cardiac dysrhythmia, this method can be used as an alternative or complementary method to the traditional education.

Predicting electrocardiogram interpretation performance in Advanced Cardiovascular Life Support simulation: comparing knowledge tests and simulation performance among Mexican medical students

BACKGROUND

Simulation plays a key role in assessing performance in Advanced Cardiovascular Life Support (ACLS). Traditional knowledge tests are also important for assessing the cognitive elements of ACLS performance. However, the association between the two has not been established. In this study, we focus on one important element in ACLS-interpretation of electrocardiograms (ECG)-and the potential of knowledge tests to serve as predictors of improvement in ACLS performance.

METHODS

We looked at the correlation between Mexican medical students' improvement in ECG interpretation performance in ACLS megacode simulations (from the start of the semester to the end of the semester), and their scores on ECG interpretation knowledge tests.

RESULTS

We found significant improvement in ECG interpretation in ACLS megacode simulation (from pre-semester to post-semester), but this was not predicted by the ECG interpretation knowledge test scores. The correlation was .079 (p = 0.66).

CONCLUSIONS

These results suggest that even cognitive tasks such as ECG interpretation can be expressed and assessed differently in simulation versus traditional knowledge testing.