Impact of teaching and assessment format on electrocardiogram interpretation skills

Development of peer assessment rubrics in simulation-based learning for advanced cardiac life support skills among medical students

INTRODUCTION

Peer assessment can enhance understanding of the simulation-based learning (SBL) process and promote feedback, though research on its rubrics remains limited. This study assesses the validity and reliability of a peer assessment rubric and determines the appropriate number of items and raters needed for a reliable assessment in the advanced cardiac life support (ACLS) context.

METHODS

Ninety-five third-year medical students participated in the ACLS course and were assessed by two teachers (190 ratings) and three peers (285 ratings). Students rotated roles and were assessed once as a team leader on a ten-item rubric in three domains: electrocardiogram and ACLS skills, management and mechanisms, and affective domains. Messick's validity framework guided the collection of validity evidence.

RESULTS

Five sources of validity evidence were collected: (1) content: expert reviews and alpha, beta, and pilot tests for iterative content validation; (2) response process: achieved acceptable peer interrater reliability (intraclass correlation = 0.78, p = 0.001) and a Cronbach's alpha of 0.83; (3) internal structure: demonstrated reliability through generalizability theory, where one peer rater with ten items achieved sufficient reliability (Phi-coefficient = 0.76), and two raters enhanced reliability (Phi-coefficient = 0.85); construct validity was supported by confirmatory factor analysis. (4) Relations to other variables: Peer and teacher ratings were similar. However, peers rated higher in scenario management; further generalizability theory analysis indicated comparable reliability with the same number of teachers. (5) Consequences: Over 80% of students positively perceived peer assessment on a 5-point Likert scale survey.

CONCLUSION

This study confirms the validity and reliability of ACLS SBL rubrics while utilizing peers as raters. Rubrics can exhibit clear performance criteria, ensure uniform grading, provide targeted feedback, and promote peer assessment skills.

Designing an ECG curriculum for residents: Evidence-based approaches to improving resident ECG interpretation skills

Residents enter their training with variable comfort and competency in electrocardiogram (ECG) interpretation. Accurately interpreting an ECG is a fundamental skill in medicine and resident physicians would benefit from a longitudinal, dedicated ECG curriculum as part of their training to enhance interpretation skills and improve patient outcomes. Educators currently employ a wide array of methodologies to teach their trainees proper ECG interpretation skills, with no single modality established as the gold-standard for teaching this crucial skill. We present evidence-based guidance on how educators may develop and implement an effective ECG interpretation curriculum as part of residency training.

Implementation of a longitudinal, near-peer ECG didactic curriculum in an internal medicine residency program and impact on ECG interpretation skills

BACKGROUND

To determine the impact of a longitudinal, near-peer, dedicated ECG didactic curriculum on internal medicine resident ability to accurately interpret ECGs.

METHODS

This study employs a prospective cohort design. Internal medicine residents at University at Buffalo participated in monthly ECG didactic sessions over a 7-month period. Residents were invited to complete pre- and post-curriculum questionnaires. Responses were anonymous and participation voluntary. Data collected included basic demographics, career interest, exposure to clinical cardiology, and number of sessions attended. Residents were asked to interpret sixteen unique ECGs, divided evenly among eight common rhythms into both questionnaires. Pre- and post-curriculum cohorts were compared using t-tests and chi-square analyses. Associations between attendance, comfort level in interpretation, and number of correct interpretations were analyzed using Pearson correlations. Multivariate linear regression determined the strongest predictor of the number of correct ECG interpretations.

RESULTS

The post-curriculum cohort correctly interpreted a significantly greater percentage of ECGs compared to pre-curriculum cohort (74.5% vs. 60.9%, p < .001). Didactic attendance was significantly associated with comfort level in interpreting ECGs (r = .328, p = .018) and trended towards an increased number of correct interpretations (r = .248, p = .077). Residents who attended three or more sessions demonstrated increased ECG interpretation skills compared to those who attended two or fewer sessions (80.0% vs. 71.1%, p = .048). Number of clinical cardiology rotations attended was significantly associated with correct interpretations (r = .310, p < .001) and was the strongest predictor of accurately interpreting ECGs (β = 0.29, p = .037).

CONCLUSIONS

Participation in a longitudinal, near-peer ECG didactic curriculum improved resident ability to interpret ECGs. A curriculum which contains both didactic sessions and clinical exposure may offer the greatest benefit in improving ECG interpretation skills.

Comparing the effectiveness of asynchronous e-modules and didactic lectures to teach electrocardiogram interpretation to first year US medical students

BACKGROUND

Medical students are expected to be competent in interpreting electrocardiograms (ECGs) by the time they graduate, but many are unable to master this skill. Studies suggest that e-modules are an effective way to teach ECG interpretation, however they are typically evaluated for use during clinical clerkships. We sought to determine if an e-module could replace a didactic lecture to teach ECG interpretation during a preclinical cardiology course.

METHODS

We developed an asynchronous, interactive e-module that consisted of narrated videos, pop-up questions and quizzes with feedback. Participants were first year medical students who were either taught ECG interpretation during a 2-hour didactic lecture (control group) or were given unlimited access to the e-module (e-module group). First-year internal medicine residents (PGY1 group) were included to benchmark where ECG interpretation skills should be at graduation. At three time-points (pre-course, post-course, and 1-year follow-up), participants were evaluated for ECG knowledge and confidence. A mixed-ANOVA was used to compare groups over time. Students were also asked to describe what additional resources they used to learn ECG interpretation throughout the study.

RESULTS

Data was available for 73 (54%) students in the control group, 112 (81%) in the e-module group and 47 (71%) in the PGY1 group. Pre-course scores did not differ between the control and e-module groups (39% vs. 38%, respectively). However, the e-module group performed significantly better than the control group on the post-course test (78% vs. 66%). In a subsample with 1-year follow-up data, the e-module group's performance decreased, and the control group remained the same. The PGY1 groups' knowledge scores were stable over time. Confidence in both medical student groups increased by the end of the course, however only pre-course knowledge and confidence were significantly correlated. Most students relied on textbooks and course materials for learning ECG, however online resources were also utilized.

CONCLUSIONS

An asynchronous, interactive e-module was more effective than a didactic lecture for teaching ECG interpretation, however continued practice is needed regardless of how students learn to interpret ECGs. Various ECG resources are available to students to support their self-regulated learning.

Electrocardiogram Interpretation Competency of Medical Interns in Saudi Arabia: A Cross-Sectional Study

Objective To determine the competence of medical interns in Saudi Arabia in interpreting common ECG abnormalities, explore limitations, and facilitate solutions to the development of ECG interpretation skills in Saudi Arabia. Methods This cross-sectional study was conducted from 11 June 2022 to 3 November 2022 using the convenience stratified sampling technique among 373 medical interns (54.4% male and 45.6% female) in 15 medical colleges within Saudi Arabia. Results Almost all (91.7%) of the participants recognized the basic ECG elements, as they correctly identified normal ECG patterns. The most well-understood ECG pathologies were ventricular fibrillation, atrial fibrillation, and acute myocardial infarction, which were accurately interpreted by 69.2%, 67.8%, and 61.9% of the participants, respectively. The least understood ECG result was a pathological Q wave, which only 20.9% recognized. Most (63.5%) participants attributed their challenges in ECG interpretation to their inadequate training in college, and 57.4% of them stated that practical case-based training could best facilitate the improvement of their skills in ECG interpretation. Conclusion Most of the participants showed unsatisfactory performance in ECG interpretation. Despite their completion of advanced cardiac life support courses, their overall performance did not improve significantly. Most of them believed that their colleges did not adequately train them to read ECGs. Thus, a majority think case-based training is a key strategy for improving their ECG interpretation skills.

Surfing the clinical trials of ECG teaching to medical students: A systematic review

Interpreting an electrocardiogram (ECG) is crucial for every physician. The physician's competency in ECG interpretation needs to be improved at any stage of medical education. The aim of the present study was to review the currently published clinical trials of ECG teaching to medical students and provide suggestions for future works. On May 1, 2022, PubMed, Scopus, Web of Science, Google Scholar, and ERIC were searched to retrieve relevant articles on clinical trials of ECG teaching to medical students. The quality of the included studies was assessed utilizing the Buckley et al. criteria. The screening, data extraction, and quality appraisal processes were duplicated independently. In case of disagreements, consultation with a third author was put forth. In total, 861 citations were found in the databases. After screening abstracts and full texts, 23 studies were deemed eligible. The majority of the studies were of good quality. Peer teaching (7 studies), self-directed learning (6 studies), web-based learning (10 studies), and various assessment modalities (3 studies) comprised the key themes of the studies. Various methods of ECG teaching were encountered in the reviewed studies. Future studies in ECG training should focus on novel and creative teaching methods, the extent to which self-directed learning can be effective, the utility of peer teaching, and the implications of computer-assisted ECG interpretation (e.g., artificial intelligence) for medical students. Long-term knowledge retention assessment studies based on different approaches integrated with clinical outcomes could be beneficial in determining the most efficient modalities.

Competency and confidence in ECG interpretation among medical students

Objectives

To assess competency and confidence in ECG interpretation in medical students across years of medical school and evaluate the associations of various factors, a curriculum change, and student confidence with ECG competency.

Methods

Four hundred and fourteen (414) third- to sixth-year medical students participated in this cross-sectional study conducted in 2019 in the Hebrew University of Jerusalem, Israel. A voluntary response sample of participants answered a validated, web-based questionnaire, composed of eight ECG strips. Participants were also asked about confidence and sources for ECG education and exposure. Competency and confidence across medical school years were compared using the ANOVA and chi-square tests.

Results

Competency was low overall (mean score, SD (standard deviation) 3.23±1.81 out of 8), and higher in sixth-year students compared to third-, fourth- and fifth-year students (4.37±1.69 vs. 2.90±1.82, 2.90±1.54, 2.50±1.56, respectively, F(3,337)=24.425, p<0.0001). There was no difference between students before and after the curriculum change. Work experience in medicine was associated with competency (odds ratio (OR), 7.97; 95% confidence interval (CI), 4.03-15.77, p<0.0001). The reported confidence level was low (median 2 out of 5) and was found to be correlated with the total score achieved (r(332)=0.5, p<0.0001).

Conclusions

Student competency was shown to be insufficient throughout medical school. Competency and confidence in ECG interpretation seem to be significantly improved by increased and repetitive exposure to ECG. Thus, strategies to facilitate better ECG skills should involve an extended focus on ECG in the undergraduate and graduate curricula and include competency-based educational programs.

Effectiveness of peer teaching in health professions education: A systematic review and meta-analysis

BACKGROUND

The reform in health professions education requires the focus to shift from fact memorization to exploring, analyzing, assimilating, and synthesizing information to promote active and collaborative learning. Peer teaching is one of the educational strategies.

AIMS

This review aimed to explore and synthesize quantitative evidence to determine the overall effect of peer teaching in enhancing students' theoretical knowledge and practical skills (e.g., procedural skills and resuscitation) in health professions education.

METHODS

PubMed, ScienceDirect, CINAHL, ERIC, ProQuest, reference lists of relevant studies, and reviews were searched till November 2021. Results were pooled using random-effects meta-analysis or narrative synthesis.

RESULTS

A total of 44 RCTs were included. This review showed a significant effect of peer teaching on procedural skills improvement and a comparable effect on theoretical knowledge and resuscitation skills acquisition compared to the conventional teaching method. Near-peer teaching seemed to be the most effective method for skill improvement. Subgroup analysis showed no significant differences between peer teaching and conventional teaching groups (e.g., expert/faculty teaching, self-study or lectures).

CONCLUSIONS

Peer teaching seems to be a promising teaching and learning strategy in health professions education, positively affecting theoretical knowledge and procedural skills. Future research should explore the effect of peer teaching in developing countries to provide a comprehensive picture of peer teaching.

Medical Education in Pathology: General Concepts and Strategies for Implementation

CONTEXT.—

Pathology education must evolve as medical knowledge expands and disruptive technologies emerge. The evolution in pathology teaching practices accelerated as traditional teaching modalities were suspended in March 2020 during the coronavirus disease 2019 (COVID-19) pandemic.

OBJECTIVES.—

To provide pathologists an overview of established teaching paradigms and practical examples of how these paradigms may be applied to pathology education, emphasizing differences in graduate and undergraduate medical education as well as the challenges and promises of remote learning, as revealed by the COVID-19 pandemic.

DATA SOURCES.—

Selected peer-reviewed publications representing the field of educational social science.

CONCLUSIONS.—

Evidence-based methods described in education and social sciences can be effectively deployed in pathology education and especially remote learning, as necessitated by the current COVID-19 pandemic. Understanding established principles, such as cognitive load, competency-based learning, peer-assisted learning, and flipped classrooms may prove useful in developing effective, learner-centric content for pathology education.

Mastering Electrocardiogram Interpretation Skills Through a Perceptual and Adaptive Learning Module

Although accurate interpretation of the standard 12-lead electrocardiogram (ECG) is fundamental to diagnosing heart disease, several prior studies report low accuracy rates among medical students, residents, and practicing physicians. The objective of this study was to determine if an online ECG Perceptual and Adaptive Learning Module (ECG PALM) is an efficient instrument to teach ECG interpretation. The ECG PALM consists of 415 unique ECG tracings with associated pretest, posttest, and delayed tests, each using 30 additional ECGs to gauge the effectiveness and durability of training. Between 2013 and 2015, a total of 113 third-year and 156 fourth-year medical students and 34 first-year, 41 second-year, and 37 third-year emergency medicine residents completed the PALM and associated tests. We measured two mastery criteria: accuracy, the percentage of correct interpretations, and fluency, the percentage of images interpreted accurately within 15 seconds. The ECG PALM produced statistically significant improvements (0.0001 < p < 0.0045) in student and resident performance for both accuracy (effect size = 0.9 to 3.2) and fluency (effect size = 2.5 to 3.1) following training ranging from 46 ± 24 minutes (R3s) to 88 ± 32 minutes (third-year medical students). Medical students and residents performed significantly better on a test the year following training (delayed test) than those without prior ECG PALM training (pretest). The fluency of R3 residents in classifying the 15 diagnostic categories was less than 60% for nine of the 15 diagnoses and greater than 80% for only one. Following PALM training, fluency was higher than 80% for seven of the 15 categories and less than 60% for only two categories. Accuracy in recognizing ST-elevation myocardial infarctions (STEMIs) was high both before and after PALM training for R3s, but fluency was only 64% for anterior STEMIs on the pretest, increasing to 93% following PALM training. These observations suggest that the ECG PALM is an effective and durable supplemental tool for developing mastery in interpreting common ECG abnormalities.

[Rheumatology in German MD curricula]

Transmitting a substantial amount of basic knowledge in Rheumatology to all medical students is essential for the future medical care of patients with rheumatic diseases for two reasons: on the one hand, future general practitioners will need to master the patterns of rheumatic diseases to recognize them fast enough in new-onset patients and to refer them in time and directly to rheumatologists. On the other hand, the shortage of rheumatologists can only then be relieved in the future when we are able to inspire enthusiasm for our specialty. Adequate rheumatological structures are established only in some of the German faculties of medicine. Structural improvements happen in small steps only but were achieved at several sites. The better the local structures, the higher the chances of committed university teachers in rheumatology to reach all medical students. Probably from 2026 onwards, the learning objectives relevant for examinations will be defined by the national competence-based catalogue of learning objectives in medicine (NKLM), which is currently in the final stages of completion together with the German Federal Institute for Medical and Pharmaceutical Examinations (IMPP). It now appears that systemic autoimmune diseases and inflammatory rheumatic diseases are adequately depicted in this catalogue. If this is achieved, students will know more about these diseases in the future and will diagnose them faster in patients. Work on the NKLM is therefore of highest importance. In addition to the work on the learning objectives, up to date learning materials are required, which have to be available throughout Germany. A Rheumatology script just finished by the committee for medical student education of the German Society of Rheumatology (DGRh) and now available on the DGRh homepage should close this gap.

Qualitative analysis of cognitive and social congruence in peer-assisted learning - The perspectives of medical students, student tutors and lecturers

BACKGROUND

The teaching of students by peers, so-called peer-assisted learning, is effective based on cognitive and social congruence among students and student tutors. This study aims to investigate cognitive and social congruence by analysing the perspectives of students, student tutors and lecturers in order to receive a better understanding of these concepts and to improve the teaching in tutorials as well as the relationship among students and student tutors.

METHODS

Cognitive and social congruence were assessed by conducting semi-structured interviews. An interview guide about teaching and relationship in tutorials was based on previous findings of Schmidt & Moust (1995) and Lockspeiser et al. (2008). The interviews were analysed inductively by using qualitative content analysis.

RESULTS

Twenty-nine participants were interviewed. The following categories were found for cognitive congruence: knowledge base, high expertise by student tutors, same language and effective knowledge transfer. Social congruence was represented by relaxed learning atmosphere, sharing social roles, empathic and supportive behaviour of student tutors, sharing experiences, understanding difficulties and enjoying tutorial.

CONCLUSION

Cognitive and social congruence may be displayed on the practical behavioural level. Trust in student tutor could be found in both concepts on different levels. The qualitative results provide a deeper insight by indicating that the student tutors may play a 'mediator' role for the relationship between students and lectures.

A qualitative study on negative attitude toward electrocardiogram learning among undergraduate medical students

Objective:

Negative affect state toward learning has a substantial impact on the learning process, academic performance, and practice of a particular subject, but such attitude toward electrocardiogram (ECG) learning has still received relatively little attention in medical education research. In spite of the significant emphasis in investigating ECG teaching method, the educators would not be able to address ECG incompetency without understanding the negative perception and attitude toward ECG learning. The purpose of this study was to assess the undergraduate students' difficulties in ECG learning and hence help educators design appropriate ECG learning curriculum to instill competent skill in ECG interpretation based on this outcome.

Materials and Methods:

A total of 324 undergraduate preclinical (year 2) and clinical (year 3–5) medical students participated in this study. The research design used thematic analysis of an open-ended questionnaire to analyze the qualitative data.

Results:

The thematic analysis detected five major emergent themes: lack of remembering (18.2%), lack of understanding (28.4%), difficulty in applying (3.6%), difficulty in analysis (15.1%), and difficulty in interpretation (17.8%), of which addressing these challenges could be taken as a foundation step upon which medical educators put an emphasis on in order to improve ECG teaching and learning.

Conclusion:

Negative attitude toward ECG learning poses a serious threat to acquire competency in ECG interpretation skill. The concept of student's memorizing ECG is not a correct approach; instead, understanding the concept and vector analysis is an elementary key for mastering ECG interpretation skill. The finding of this study sheds light into a better understanding of medical students' deficient points of ECG learning in parallel with taxonomy of cognitive domain and enables the medical teachers to come up with effective and innovative strategies for innovative ECG learning in an undergraduate medical curriculum.

Implementing Change in Neuroanatomy Education: Organization, Evolution, and Assessment of a Near-Peer Teaching Program in an Undergraduate Medical School in Greece

In light of the current shifts in medical education from traditional lectures to more active teaching modalities, a peer-teaching program was introduced to a compulsory, second-year neuroanatomy course. A cross-sectional survey of 527 medical students in the six-year medical program of the National and Kapodistrian University of Athens was administered. The primary aim of the survey, which was distributed to second- through sixth-year medical students, who had completed the neuroanatomy course, was to assess student perception of peer teachers (PTs). Across the five years assessed, students increasingly acknowledged the contribution of PTs to their learning (P < 0.001). Attributes of PTs (e.g., contribution to learning, motivation, effective usage of material, and team environment) were significantly related to the student's opinion of the importance of laboratory activities (P < 0.001). Students who received "average" final grades scored the importance of laboratory exercises, and by inference PTs, significantly lower than students who received "excellent" final grades (P < 0.05). The amount of training that PTs had received was also significantly related to student perceptions of a PT's contribution. Better trained PTs were associated with significantly higher scores regarding learning, motivation, and positive environment compared to less trained PTs (P < 0.05). The results of the present study show that peer-teaching was well received by students attending the neuroanatomy course. While the results express the evolution of the program across the years, the findings also show that learners believed that PTs and the laboratory program contributed significantly to their understanding of neuroanatomy.

A novel instrument of cognitive and social congruence within peer-assisted learning in medical training: construction of a questionnaire by factor analyses

BACKGROUND

Peer-assisted learning is effective due to cognitive and social congruence. Cognitive congruence is created by sharing a similar knowledge base between students and student tutors. Social congruence is defined as having similar social roles. A questionnaire of these concepts was newly constructed, and this study explored the factor analysis of the instrument.

METHODS

In a cross-sectional method design cognitive and social congruence were operationalised by exploratory and confirmatory factor analyses. Cognitive and social congruence were assessed by validated questionnaires and through self-developed items that were collected through semi-structured interviews.. The questionnaire consisted of 26 items that were rated on a five-point Likert scale, from 0 = I strongly disagree to 4 = I strongly agree.

RESULTS

676 medical students participated in the study. Exploratory factor analysis for students resulted in a two-factor solution with cognitive and social congruence as confirming factors. New findings showed that the items "non-judgmental learning atmosphere" and "informal communication" were associated to cognitive congruence, "effectiveness" and "comprehensible explanations" belonged to social congruence. Confirmatory factor analysis for student tutors confirmed the resulting two-factor solution.

CONCLUSIONS

As one of the largest investigation of cognitive and social congruence, this study investigated the underlying mechanisms of effective PAL using factor analysis. Cognitive congruence was created by sharing the same knowledge. Knowledge transfer might play a relevant role in cognitive congruence. Social congruence focused on the relationship between student tutors and students, which might impact the content level. Practical recommended actions (using the same language) could be implemented.

[Evaluation of a support for the analysis of electrocardiogram by emergency residents]

AIM

Electrocardiogram (ECG) is a routine examination in emergency medicine (EM), however the level of resident's interpretations is inhomogeneous and sometimes insufficient. We have developed a support to assist in the interpretation of ECG in emergency situations. Our main objective was to assess whether this new tool improved the rate of good interpretations by residents of EM departments (EMD). The secondary objectives were to assess whether it improved the rate of good triages, the level of certainty of residents, and to study its impact according to the seniority of the resident.

PATIENTS AND METHOD

Multi-center, before-and-after study, carried out with existing residents in the different EMD dependent of a single university hospital center. The evaluation was conducted in two stages: an initial analysis of 17 ECGs without tool and a new analysis using the tool.

RESULTS

Out of a target population of 68 residents, 41 (60 %) were included. The tool significantly improved the correct reading rate from 46 % without the tool to 68 % (P<0.001). The rate of correct triage (56 % vs. 64 %) and diagnostic certainty (54 vs. 66 on a scale of 0 to 100) were also significantly improved (P<0.001). The more experienced residents were generally more efficient in pre-testing, but the tool improved results regardless of seniority.

CONCLUSION

The development of a simple support to assist in the interpretation of ECGs improves the rate of good interpretations among residents in EMD.

Quantifying the medical student learning curve for ECG rhythm strip interpretation using deliberate practice

Objectives: Obtaining competency in medical skills such as interpretation of electrocardiograms (ECGs) requires repeated practice and feedback. Structured repeated practice and feedback for ECGs is likely not provided to most medical students, so skill development is dependent on opportunistic training during clinical rotations. Our aim was to describe: the amount of deliberate practice completed for learning ECG rhythm strip diagnoses in first year medical students, the learning curve for rhythm strip diagnosis, and student experiences with deliberate practice. Methods: First year medical students from two medical schools were provided with online rhythm strip practice cases. Diagnostic accuracy was measured throughout practice, and students were provided feedback for every case they completed. Total cases practiced and time spent practicing were correlated with their performance during practice and on an exam. Results: 314 of 384 (82%) students consented. The mean number of ECGs each student practiced was 59 (range 0-280), representing 18,466 total instances of deliberate practice. We generated mathematical models that accurately correlated both the number of cases practiced and time spent practicing, with diagnostic accuracy on an exam (p<0.001). For example, students would need to spend on average of 112 minutes and complete 34 practice cases to obtain 75% on an ECG rhythm strip exam. Student satisfaction was high using the online cases. Conclusions: We succeeded in delivering deliberate practice for ECG rhythm strip interpretation to a large cohort of students at 2 medical schools. We quantified a learning curve that estimates the number of cases and practice time required to achieve pre-determined levels of diagnostic accuracy. This data can help inform a competency-based approach to curriculum development.

Peer teaching beyond the formal medical curriculum

Peer-assisted learning (PAL) is nowadays commonly implemented in medical education. Mostly PAL is utilized to specifically support teaching within one subject or a specific curricular situation. Here, we present a large-scale peer teaching program that aims to address the individual student's learning needs. In addition, it provides a platform for students to participate in academic teaching. A retrospective data analysis was performed to reveal the program's development and acceptance. The program was implemented in 2008/09 with three tutorials conducted by 24 student tutors to support students preparing for reexaminations. Since then, the program has continuously grown. In 2015/16, 140 tutors conducted 52 tutorials, consisting of 2,750 lessons for 1,938 tutees. New tutorial categories were continuously introduced. In 2015/16, these encompassed tutorials that were held concomitantly to the formal curriculum, tutorials that exceeded the contents of the formal curriculum, tutorials for preparation for the state examination, and electives. Evaluations among the tutees revealed that 93.5% of the respondents rated the courses overall as "good" or "excellent" ( n = 13,489) in 2015/16. All elements of the peer teaching program are managed by one academic group. This encompasses the organization of tutorials, the quality management, and the qualification of tutors, including content-related supervision and didactic training. We conclude that the implementation of a large-scale peer teaching program can complement the formal curriculum. This might be beneficial for both tutors who can actively train their didactic and content-related competencies, and tutees who can autonomously consolidate and expand their knowledge.

Is computer-assisted instruction more effective than other educational methods in achieving ECG competence among medical students and residents? Protocol for a systematic review and meta-analysis

INTRODUCTION

Although ECG interpretation is an essential skill in clinical medicine, medical students and residents often lack ECG competence. Novel teaching methods are increasingly being implemented and investigated to improve ECG training. Computer-assisted instruction is one such method under investigation; however, its efficacy in achieving better ECG competence among medical students and residents remains uncertain.

METHODS AND ANALYSIS

This article describes the protocol for a systematic review and meta-analysis that will compare the effectiveness of computer-assisted instruction with other teaching methods used for the ECG training of medical students and residents. Only studies with a comparative research design will be considered. Articles will be searched for in electronic databases (PubMed, Scopus, Web of Science, Academic Search Premier, CINAHL, PsycINFO, Education Resources Information Center, Africa-Wide Information and Teacher Reference Center). In addition, we will review citation indexes and conduct a grey literature search. Data extraction will be done on articles that met the predefined eligibility criteria. A descriptive analysis of the different teaching modalities will be provided and their educational impact will be assessed in terms of effect size and the modified version of Kirkpatrick framework for the evaluation of educational interventions. This systematic review aims to provide evidence as to whether computer-assisted instruction is an effective teaching modality for ECG training. It is hoped that the information garnered from this systematic review will assist in future curricular development and improve ECG training.

ETHICS AND DISSEMINATION

As this research is a systematic review of published literature, ethical approval is not required. The results will be reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis statement and will be submitted to a peer-reviewed journal. The protocol and systematic review will be included in a PhD dissertation.

PROSPERO REGISTRATION NUMBER

CRD42017067054; Pre-results.

What We Do and Do Not Know about Teaching Medical Image Interpretation

Educators in medical image interpretation have difficulty finding scientific evidence as to how they should design their instruction. We review and comment on 81 papers that investigated instructional design in medical image interpretation. We distinguish between studies that evaluated complete offline courses and curricula, studies that evaluated e-learning modules, and studies that evaluated specific educational interventions. Twenty-three percent of all studies evaluated the implementation of complete courses or curricula, and 44% of the studies evaluated the implementation of e-learning modules. We argue that these studies have encouraging results but provide little information for educators: too many differences exist between conditions to unambiguously attribute the learning effects to specific instructional techniques. Moreover, concepts are not uniformly defined and methodological weaknesses further limit the usefulness of evidence provided by these studies. Thirty-two percent of the studies evaluated a specific interventional technique. We discuss three theoretical frameworks that informed these studies: diagnostic reasoning, cognitive schemas and study strategies. Research on diagnostic reasoning suggests teaching students to start with non-analytic reasoning and subsequently applying analytic reasoning, but little is known on how to train non-analytic reasoning. Research on cognitive schemas investigated activities that help the development of appropriate cognitive schemas. Finally, research on study strategies supports the effectiveness of practice testing, but more study strategies could be applicable to learning medical image interpretation. Our commentary highlights the value of evaluating specific instructional techniques, but further evidence is required to optimally inform educators in medical image interpretation.

How are we assessing near-peer teaching in undergraduate health professional education? A systematic review

BACKGROUND

Near Peer teaching (NPT) is reported as an effective pedagogical approach to student learning and performance. Studies in medicine, nursing and health sciences have relied mainly on self-reports to describe its benefits, focusing on psychomotor and cognitive aspects of learning. Despite increasing research reports on peer teaching internationally, little is known about the various domains of learning used in assessment of performance and objective learning outcomes of NPT.

OBJECTIVE

To determine the domains of learning and assessment outcomes used in NPT in undergraduate health professional education.

METHODS

Quantitative systematic review was conducted in accord with the PRISMA protocol and the Joanna Briggs Institute processes. A wide literature search was conducted for the period 1990-November 2015 of fourteen databases. Grey literature was undertaken from all key research articles. Studies meeting the inclusion criteria were eligible for consideration, including measured learning outcomes of near-peer teaching in undergraduate education in nursing, medicine and health sciences. Set limitations included publications after 1990 (2015 inclusive), English language and objective learning outcomes. A quality appraisal process involving two independent reviewers was used to analyse the data.

RESULTS

Of 212 selected articles, 26 were included in the review. Terminology was confusing and found to be a barrier to the review process. Although some studies demonstrated effective learning outcomes resulting from near-peer teaching, others were inconclusive. Studies focused on cognitive and psychomotor abilities of learners with none assessing metacognition, affective behaviours or learning outcomes from quality of understanding.

CONCLUSION

The studies reviewed focused on cognitive and psychomotor abilities of learners. Even though evidence clearly indicates that metacognition and affective behaviours have direct influence on learning and performance, indicating more research around this topic is warranted. Methodological quality of the studies and lack of theoretical frameworks underpinned by educational psychology may have contributed to inconsistencies in learning outcomes reported.

Near-peer education: a novel teaching program

OBJECTIVE

This study aims to: 1) Evaluate whether a near-peer program improves perceived OSCE performance; 2) Identify factors motivating students to teach; 3) Evaluate role of near-peer teaching in medical education.

METHODS

A near-peer OSCE teaching program was implemented at Monash University's Peninsula Clinical School over the 2013 academic year. Forty 3rd-year and thirty final-year medical students were recruited as near-peer learners and educators, respectively. A post-program questionnaire was completed by learners prior to summative OSCEs (n=31), followed by post-OSCE focus groups (n=10). Near-peer teachers were interviewed at the program's conclusion (n=10). Qualitative data was analysed for emerging themes to assess the perceived value of the program.

RESULTS

Learners felt peer-led teaching was more relevant to assessment, at an appropriate level of difficulty and delivered in a less threatening environment than other methods of teaching. They valued consistent practice and felt confident approaching their summative OSCEs. Educators enjoyed the opportunity to develop their teaching skills, citing mutual benefit and gratitude to past peer-educators as strong motivators to teach others.

CONCLUSIONS

Near-peer education, valued by near-peer learners and teachers alike, was a useful method to improve preparation and perceived performance in summative examinations. In particular, a novel year-long, student-run initiative was regarded as a valuable and feasible adjunct to faculty teaching.

Teaching crucial skills: An electrocardiogram teaching module for medical students

BACKGROUND

Medical student performance in electrocardiogram (ECG) interpretation at our institution could be improved. Varied resources exist to teach students this essential skill.

METHODS

We created an ECG teaching module (ECGTM) of 75 cases representing 15 diagnoses to improve medical students' performance and confidence in ECG interpretation. Students underwent pre- and post-clerkship testing to assess ECG interpretation skills and confidence and also end-of-clinical-year testing in ECG and laboratory interpretation. Performance was compared for the years before and during ECGTM availability.

RESULTS

Eighty-four percent of students (total n=101) reported using the ECGTM; 98% of those who used it reported it was useful. Students' performance and confidence were higher on the post-test. Students with access to the ECGTM (n=101) performed significantly better than students from the previous year (n=90) on the end-of-year ECG test.

CONCLUSIONS

The continuous availability of an ECGTM was associated with improved confidence and ability in ECG interpretation. The ECGTM may be another available tool to help students as they learn to read ECGs.

Retention of Baseline Electrocardiographic Knowledge After a Blended-Learning Course

BACKGROUND

Among nurses, skill retention after an electrocardiography blended-learning course is unknown.

OBJECTIVES

To compare 3- and 8-week electrocardiography test scores, compare scores by nurse and work characteristics and self-assessed electrocardiographic competence, and compare 1-year work retention with 3- and 8-week scores and change in scores from week 3 to week 8.

METHODS

Data were collected on demographics, comfort with electrocardiography expectations, electrocardiography competence levels, and 1-year work retention. Correlational and comparative statistics were used in analyses.

RESULTS

Of 69 nurses, 58% were somewhat comfortable with interventions for abnormal rhythms. Test scores were higher at 3 weeks than at 8 weeks: mean difference, 26%; P < .001. Scores at 8 weeks reflected intermediate skill retention and were not associated with nurse characteristics, electrocardiography background, comfort with rhythms and measurements, or 1-year work retention. Nurses with greater comfort for intervening when rhythm abnormalities occurred had higher median 8-week scores (P = .01) than did nurses with less comfort, and perceptions of electrocardiographic competence were associated with 8-week scores (r = 0.28; P = .02). Reduction in scores at 8 weeks was less severe in nurses with greater comfort at 3 weeks in measuring electrocardiographic intervals (P = .008) and applying therapeutic interventions (P = .009).

CONCLUSIONS

Skill retention and competence in electrocardiographic interpretation were intermediate and correlated with baseline self-assessment. Electrocardiographic interpretation, measurement, and interventions should be reinforced at the bedside.

How can we improve teaching of ECG interpretation skills? Findings from a prospective randomised trial

BACKGROUND

There is an ongoing debate on how ECG interpretation should be taught during undergraduate medical training. This study addressed the impact of teaching format, examination consequences and student motivation on skills retention.

METHODS

A total of 493 fourth-year medical students participated in a six-group, partially randomised trial. Students received three levels of teaching intensity: self-directed learning (2 groups), lectures (2 groups) or small-group peer-teaching (2 groups). On each level of teaching intensity, end-of-course written examinations (ECG exit exam) were summative in one group and formative in the other. Learning outcome was assessed in a retention test two months later.

RESULTS

Retention test scores were predicted by summative assessments (adjusted beta 4.08; 95% CI 1.39-6.78) but not by the type of teaching. Overall performance levels and motivation did not predict performance decrease or skills retention.

CONCLUSIONS

Summative assessments increase medium-term retention of ECG interpretation skills, irrespective of instructional format.

Moving Knowledge Acquisition From the Lecture Hall to the Student Home: A Prospective Intervention Study

BACKGROUND

Podcasts are popular with medical students, but the impact of podcast use on learning outcomes in undergraduate medical education has not been studied in detail.

OBJECTIVE

Our aim was to assess the impact of podcasts accompanied by quiz questions and lecture attendance on short- and medium-term knowledge retention.

METHODS

Students enrolled for a cardio-respiratory teaching module were asked to prepare for 10 specific lectures by watching podcasts and submitting answers to related quiz questions before attending live lectures. Performance on the same questions was assessed in a surprise test and a retention test.

RESULTS

Watching podcasts and submitting answers to quiz questions (versus no podcast/quiz use) was associated with significantly better test performance in all items in the surprise test and 7 items in the retention test. Lecture attendance (versus no attendance) was associated with higher test performance in 3 items and 1 item, respectively. In a linear regression analysis adjusted for age, gender, and overall performance levels, both podcast/quiz use and lecture attendance were significant predictors of student performance. However, the variance explained by podcast/quiz use was greater than the variance explained by lecture attendance in the surprise test (38.7% vs. 2.2%) and retention test (19.1% vs. 4.0%).

CONCLUSIONS

When used in conjunction with quiz questions, podcasts have the potential to foster knowledge acquisition and retention over and above the effect of live lectures.

Translating medical documents into plain language enhances communication skills in medical students--A pilot study

OBJECTIVE

To train and assess undergraduate medical students' written communication skills by exercises in translating medical reports into plain language for real patients.

METHODS

27 medical students participated in a newly developed communication course. They attended a 3-h seminar including a briefing on patient-centered communication and an introduction to working with the internet platform http://washabich.de. In the following ten weeks, participants "translated" one medical report every fortnight on this platform receiving feedback by a near-peer supervisor. A pre- and post-course assignment consisted of a self-assessment questionnaire on communication skills, analysis of a medical text with respect to medical jargon, and the translation of a medical report into plain language.

RESULTS

In the self-assessment, students rated themselves in most aspects of patient-centered communication significantly higher after attending the course. After the course they marked significantly more medical jargon terms correctly than before (p<0.001). In a written plain language translation of a medical report they scored significantly higher with respect to communicative aspects (p<0.05) and medical correctness (p<0.001).

CONCLUSION

Translating medical reports into plain language under near-peer supervision is associated with improved communication skills and medical knowledge in undergraduate medical students.

PRACTICE IMPLICATIONS

To include translation exercises in the undergraduate medical curriculum.

The acquisition and retention of ECG interpretation skills after a standardized web-based ECG tutorial-a randomised study

BACKGROUND

Electrocardiogram (ECG) interpretation is of great importance for patient management. However, medical students frequently lack proficiency in ECG interpretation and rate their ECG training as inadequate. Our aim was to examine the effect of a standalone web-based ECG tutorial and to assess the retention of skills using multiple follow-up intervals.

METHODS

203 medical students were included in the study. All participants completed a pre-test, an ECG tutorial, and a post-test. The participants were also randomised to complete a retention-test after short (2-4 weeks), medium (10-12 weeks), or long (18-20 weeks) follow-up. Intragroup comparisons of test scores were done using paired-samples t-test. Intergroup comparisons of test scores were performed using independent-samples t-test and ANOVA, whereas demographic data were compared using ANOVA and Chi-squared test.

RESULTS

The overall mean test score improved significantly from 52.7 (SD 16.8) in the pre-test to 68.4 (SD 12.3) in the post-test (p < 0.001). Junior and senior students demonstrated significantly different baseline scores (45.5 vs. 57.8 points; p < 0.001), but showed comparable score gains (16.5 and 15.1 points, respectively; p = 0.48). All three follow-up groups experienced a decrease in test score between post-test and retention-test: from 67.4 (SD 12.3) to 60.2 (SD 8.3) in the short follow-up group, from 71.4 (SD 12.0) to 60.8 (SD 8.9) in the medium follow-up group, and from 66.1 (SD 12.1) to 58.6 (SD 8.6) in the long follow-up group (p < 0.001 for all). However, there were no significant differences in mean retention-test score between the groups (p = 0.33). Both junior and senior students showed a decline in test score at follow-up (from 62.0 (SD 10.6) to 56.2 (SD 9.8) and from 72.9 (SD 11.4) to 62.5 (SD 6.6), respectively). When comparing the pre-test to retention-test delta scores, junior students had learned significantly more than senior students (junior students improved 10.7 points and senior students improved 4.7 points, p = 0.003).

CONCLUSION

A standalone web-based ECG tutorial can be an effective means of teaching ECG interpretation skills to medical students. The newly acquired skills are, however, rapidly lost when the intervention is not repeated.

The effectiveness of self-directed learning (SDL) for teaching physiology to first-year medical students

BACKGROUND

Self-directed learning (SDL) has become popular in medical curricula and has been advocated as an effective learning strategy for medical students to develop competence in knowledge acquisition.

AIMS

The primary aim was to find out if there was any benefit of supplementing self-directed learning activity with a traditional lecture on two different topics in physiology for first-year medical students.

METHOD

Two batches of first-year Bachelor of Medicine and Bachelor of Surgery (MBBS) (Batch A and Batch B) comprising 125 students each, received an SDL session on Morphological classification of anaemia. The students belonging to Batch A received a one-hour lecture on the same topic three days prior to the SDL session. The students were given a 10 multiple choice questions (MCQ) test for a maximum of 10 marks immediately following the SDL session. The next topic, Conducting system of the heart, disorders and conduction blocks was taught to both batches in traditional lecture format. This was followed by an SDL session on the same topic for Batch A only. The students were evaluated with a MCQ test for a maximum of 10 marks.

RESULTS

The mean test scores on the first topic were 4.38±2.06 (n=119) and 4.17±1.71 (n=118) for Batch A and Batch B, respectively. The mean test scores on the second topic were 5.4± 1.54 (n=112) and 5.15±1.37 (n=107) for Batch A and Batch B, respectively. There was no significant difference between the groups.

CONCLUSION

For first-year medical students, SDL is an effective teaching strategy for learning physiology. However, no additional benefit is gained by supplementing SDL with a lecture to facilitate learning physiology.

Medical students as peer tutors: a systematic review

BACKGROUND

While Peer Assisted Learning (PAL) has long occurred informally in medical education, in the past ten years, there has been increasing international interest in formally organised PAL, with many benefits for both the students and institutions. We conducted a systematic review of the literature to establish why and how PAL has been implemented, focussing on the recruitment and training process for peer tutors, the benefits for peer tutors, and the competency of peer tutors.

METHOD

A literature search was conducted in three electronic databases. Selection of titles and abstracts were made based on pre-determined eligibility criteria. We utilized the 'AMEE Peer assisted learning: a planning and implementation framework: AMEE Guide no. 30' to assist us in establishing the review aims in a systematic review of the literature between 2002 and 2012. Six key questions were developed and used in our analysis of particular aspects of PAL programs within medical degree programs.

RESULTS

We found nineteen articles that satisfied our inclusion criteria. The PAL activities fell into three broad categories of teacher training, peer teaching and peer assessment. Variability was found in the reporting of tutor recruitment and training processes, tutor outcomes, and tutor competencies.

CONCLUSION

Results from this review suggest that there are many perceived learning benefits for student tutors. However, there were mixed results regarding the accuracy of peer assessment and feedback, and no substantial evidence to conclude that participation as a peer tutor improves one's own examination performance. Further research into PAL in medicine is required if we are to better understand the relative impact and benefits for student tutors.

Improving ECG Competence in Medical Trainees in a UK District General Hospital

Background

Competency in electrocardiogram (ECG) interpretation is central to undergraduate and postgraduate clinical training. Studies have demonstrated ECGs are interpreted sub-optimally. Our study compares the effectiveness of two learning strategies to improve competence and confidence.

Method

A 1-month prospective randomized study compared the strategies in two cohorts: undergraduate third year medical students and postgraduate foundation year one (FY1) doctors. Both had blinded randomization to one of these learning strategies: focused teaching program (FTP) and self-directed learning (SDL). All volunteers completed a confidence questionnaire before and after allocation learning strategy and an ECG recognition multiple choice question (MCQ) paper at the end of the learning period.

Results

The FTP group of undergraduates demonstrated a significant difference in successfully interpreting “ventricular tachycardia” (P = 0.046) and “narrow complex tachycardia” (P = 0.009) than the SDL group. Participant confidence increased in both learning strategies. FTP confidence demonstrated a greater improvement than SDL for both cohorts.

Conclusion

A dedicated teaching program can improve trainee confidence and competence in ECG interpretation. A larger benefit is observed in undergraduates and those undertaking a FTP.

Electrocardiogram interpretation by Canadian general paediatricians: Examining practice, accuracy and confidence

BACKGROUND

Paediatric electrocardiograms (ECGs) are ordered and interpreted by general paediatricians; however, no previous studies have evaluated the accuracy of their ECG interpretations.

OBJECTIVE

To determine general paediatricians' practice and opinions regarding ECG use, accuracy of their interpretation of paediatric ECGs, and the relationship between accuracy and self-perceived confidence.

METHODS

In the present cross-sectional study, Canadian general paediatricians were asked to complete a questionnaire and interpret 18 paediatric ECGs. The questionnaire assessed characteristics of ECG use, self-perceived confidence and opinions regarding ECG use in general paediatric practice. For the ECGs provided, respondents were asked whether the ECG was normal or abnormal, what abnormality the ECG demonstrated and how confident they were in this interpretation.

RESULTS

ECG interpretation was performed by 124 general paediatricians. General paediatricians frequently use ECGs in their practice and regard this investigation as useful in patient assessment. The mean (± SD) accuracy of identifying ECGs as normal or abnormal, and identifying the specific abnormality was 80±12% and 56±20%, respectively. The sensitivity and specificity of identifying abnormal ECGs were 80% (95% CI 78% to 82%) and 79% (95% CI 75% to 83%), respectively. Correct ECG interpretation for isolated rhythm disturbances (73%) was significantly better than for abnormalities in axis (25%), chamber hypertrophy (41%) and ECG intervals (49%) (P<0.001). Overall confidence in ECG interpretation correlated with and was the only significant predictor of interpretation accuracy (r=0.396, P<0.001).

CONCLUSION

General paediatricians were adept at detecting abnormal ECGs, but were less able to identify the abnormalities. Further education in ECG interpretation may be important for this population.

Competency in electrocardiogram interpretation among graduating medical students

BACKGROUND

The ability to accurately interpret electrocardiogram (ECG) abnormalities is a core competency for graduating medical students (GMS). Incorrect interpretation of ECG findings can result in adverse patient outcomes. To our knowledge, there has been no published study evaluating the level of competency in ECG interpretation in GMS.

PURPOSES

To evaluate the ability of graduating medical students to interpret abnormal and critical ECGs and to correlate student performance with self-reported confidence and adequacy of ECG training.

METHODS

A list of 22 ECGs which GMS are expected to identify was developed. Classic examples of each ECG were identified and verified by two board-certified cardiologists. The 22 ECGs along with 11 questions related to confidence and degree of ECG training were administered to (a) 168 4th-year George Washington University School of Medicine (GWUSOM) students, (b) 63 incoming housestaff to GWUSOM, and (c) 22 graduating internal medicine housestaff.

RESULTS

Given the lack of statistical differences, GW medical students and incoming housestaff were combined into a single group (GMS, n=231). Mean number of correct answers on the 22 ECG examination for GMS was 8.2 (SE=0.529) and 13.9 (SE=1.312) for graduating residents (p<.0001). On the 6 life-threatening ECGs, GMS scored lower than graduating residents (3.4 SE=0.191 vs. 4.6 SE=0.541; p<.0002). Mean score in the GMS group was associated with increasing levels of reported confidence and degree of ECG experience.

CONCLUSIONS

A 22-item ECG examination was developed, piloted, and demonstrated to have construct validity. GMS had a limited level of competency in ECG interpretation which was correlated with reported self-confidence and degree of ECG exposure in Years 3-4.

Should we pay the student? A randomised trial of financial incentives in medical education

BACKGROUND

Financial incentives are effective in moderating physician and patient behaviour, but they have not been studied in the context of medical education.

AIM

This study assessed whether financial incentives can motivate students to acquire electrocardiogram (ECG) interpretation skills.

METHODS

Students enrolled for a cardio-respiratory teaching module (n = 121) were randomised to an intervention (financial incentive) or a control (book voucher raffle) condition. All students took three validated exams of ECG interpretation skills (at module entry, module exit and seven weeks later). Only the exit exam was financially incentivised in the intervention group. The primary outcome was the proportion of students who correctly identified ≥60% of clinically important diagnoses in the exit exam.

RESULTS

Financial incentives more than doubled the odds of correctly identifying ≥60% of diagnoses in the exit exam (adjusted odds ratio 2.44, 95% confidence interval 1.05-5.67) and significantly increased student learning time. However, there was no significant effect on performance levels in the retention exam.

CONCLUSIONS

Financial incentives increase reported learning time and examination results in the short-term. The lack of a sustained effect on performance suggests that financial incentives may foster a superficial or strategic rather than a deep approach to learning.

Increase in medical knowledge during the final year of undergraduate medical education in Germany

AIMS

In Germany, the final year of undergraduate medical education ('practice year') consists of three 16-week clinical attachments, two of which are internal medicine and surgery. Students can choose a specific specialty for their third 16-week attachment. Practice year students do not receive specific teaching to prepare them for the National Licensing Examination. It is unknown whether knowledge levels increase during this year. This study aimed at assessing knowledge at the beginning and the end of the final year of medical school.

METHODS

Three hundred pre-selected United States Medical Licensing Examination type items from ten medical disciplines were reviewed by ten recent medical graduates from the Netherlands and Germany. The resulting test included 150 items and was taken by 77 and 79 final year medical students from Göttingen and Hamburg at the beginning and the end of their practice year, respectively.

RESULTS

Cronbach's α of the pre- and post-test was 0.75 and 0.68, respectively. Mean percent scores in the pre- and post-test were 63.9±6.9 and 69.4±5.7, respectively (p<0.001; effect size calculated as Cohen's d: 0.87). In individual students, post-test scores were particularly high for items related to their specific chosen specialty.

CONCLUSION

The knowledge test used in this study provides a suitable external tool to assess progress of undergraduate medical students in their knowledge during the practice year. The pre-test may be used to guide individual learning behaviour during this final year of undergraduate education.

Summative assessments are more powerful drivers of student learning than resource intensive teaching formats

BACKGROUND

Electrocardiogram (ECG) interpretation is a core clinical skill that needs to be acquired during undergraduate medical education. Intensive teaching is generally assumed to produce more favorable learning outcomes, but recent research suggests that examinations are more powerful drivers of student learning than instructional format. This study assessed the differential contribution of teaching format and examination consequences to learning outcome regarding ECG interpretation skills in undergraduate medical students.

METHODS

A total of 534 fourth-year medical students participated in a six-group (two sets of three), partially randomized trial. Students received three levels of teaching intensity: self-directed learning (two groups), lectures (two groups) or small-group peer teaching facilitated by more advanced students (two groups). One of the two groups on each level of teaching intensity was assessed in a formative, the other in a summative written ECG examination, which provided a maximum of 1% credit points of the total curriculum. The formative examination provided individual feedback without credit points. Main outcome was the correct identification of ≥3 out of 5 diagnoses in original ECG tracings. Secondary outcome measures were time spent on independent study and use of additional study material.

RESULTS

Compared with formative assessments, summative assessments increased the odds of correctly identifying at least three out of five ECG diagnoses (OR 5.14; 95% CI 3.26 to 8.09), of spending at least 2 h/week extra on ECG self-study (OR 4.02; 95% CI 2.65 to 6.12) and of using additional learning material (OR 2.86; 95% CI 1.92 to 4.24). Lectures and peer teaching were associated with increased learning effort only, but did not augment examination performance.

CONCLUSIONS

Medical educators need to be aware of the paramount role of summative assessments in promoting student learning. Consequently, examinations within medical schools need to be closely matched to the desired learning outcomes. Shifting resources from implementing innovative and costly teaching formats to designing more high-quality summative examinations warrants further investigation.

Estimating learning outcomes from pre- and posttest student self-assessments: a longitudinal study

PURPOSE

Learning outcome is an important measure for overall teaching quality and should be addressed by comprehensive evaluation tools. The authors evaluated the validity of a novel evaluation tool based on student self-assessments, which may help identify specific strengths and weaknesses of a particular course.

METHOD

In 2011, the authors asked 145 fourth-year students at Göttingen Medical School to self-assess their knowledge on 33 specific learning objectives in a pretest and posttest as part of a cardiorespiratory module. The authors compared performance gain calculated from self-assessments with performance gain derived from formative examinations that were closely matched to these 33 learning objectives.

RESULTS

Eighty-three students (57.2%) completed the assessment. There was good agreement between performance gain derived from subjective data and performance gain derived from objective examinations (Pearson r=0.78; P<.0001) on the group level. The association between the two measures was much weaker when data were analyzed on the individual level. Further analysis determined a quality cutoff for performance gain derived from aggregated student self-assessments. When using this cutoff, the evaluation tool was highly sensitive in identifying specific learning objectives with favorable or suboptimal objective performance gains.

CONCLUSIONS

The tool is easy to implement, takes initial performance levels into account, and does not require extensive pre-post testing. By providing valid estimates of actual performance gain obtained during a teaching module, it may assist medical teachers in identifying strengths and weaknesses of a particular course on the level of specific learning objectives.

German medical students lack knowledge of how to treat smoking and problem drinking

AIM

To assess the extent of undergraduate medical training on alcohol use disorders (AUD) and smoking, and medical students' perceived knowledge regarding consequences of, and treatment options for, these disorders compared with other chronic conditions.

DESIGN

Cross-sectional survey assessing teaching and perceived knowledge of health consequences and treatment options for AUD and smoking compared with diabetes and hypertension.

SETTING

Medical schools in Germany.

PARTICIPANTS

Twenty-five of 36 medical school offices (response rate 69.4%) and 19 526 of 39 358 students from 27 medical schools (response rate 49.6%).

MEASUREMENT

Medical schools were asked to provide information on curricular coverage of the four conditions. Students reported their year of study and perceived knowledge about the consequences of all four disorders and perceived knowledge of treatment options.

FINDINGS

Courses time-tabled approximately half as many teaching hours on AUD and tobacco as on diabetes or hypertension. Final-year students reported high levels of knowledge of consequences of all four conditions and how to treat diabetes and hypertension, but only 20% believed they knew how to treat alcohol use disorders or smoking.

CONCLUSIONS

Curriculum coverage in German medical schools of alcohol use disorders and smoking is half that of diabetes and hypertension, and in the final year of their undergraduate training most students reported inadequate knowledge of how to intervene to address them.

Cigarette smoking knowledge and perceptions among students in four Italian medical schools

INTRODUCTION

Tobacco smoking is the leading cause of premature death in the developed world. Advice and assistance by physicians help smokers quit, but little attention has been paid to the topic of tobacco dependence in the curricula of Italian medical schools. Consequently, few physicians follow the clinical practice guidelines for treating dependence.

METHODS

This study was conducted on 439 students at 4 Italian medical schools in 2010. Students were asked to complete a 60-item questionnaire. Two scores were computed: Score 1 assessed knowledge of the epidemiology of smoking, risks associated with smoking, and benefits of cessation. Score 2 assessed knowledge of tobacco dependence treatment guidelines and the effectiveness of treatments. A score of less than 60% indicated insufficient knowledge.

RESULTS

Medical students had limited knowledge of the epidemiology of smoking, attributable morbidity and mortality, and the benefits of cessation. This limited knowledge was reflected by the finding that 70% of students had a total Score 1 less than 60% of available points. Knowledge of clinical guidelines, perceived competence in counseling smokers, and treatment of addiction was also insufficient, as 76% of students achieved a total Score 2 of less than 60%.

CONCLUSIONS

Our data demonstrate that Italian medical students have limited knowledge about tobacco dependence, how to treat it, and the critical role of the physician in promoting cessation. Taken together with research from other countries, these findings suggest that medical schools do not offer adequate training in tobacco dependence and provide a rationale for modifying the core curriculum to include more information on tobacco dependence treatment.

Towards outcome-based programme evaluation: using student comparative self-assessments to determine teaching effectiveness

BACKGROUND

Programme evaluation of medical education should be multi-dimensional. While structural and organisational aspects of teaching are frequently assessed, programme evaluation tools are rarely matched to specific learning objectives.

AIMS

This study used one medical school's catalogue of specific learning objectives to implement and critically appraise a novel programme evaluation tool based on comparative student self-assessments.

METHOD

Medical students enrolled in the clinical phase of the undergraduate curriculum in Göttingen were invited to self-rate their knowledge, skills and attitudes before and after each course. A newly developed formula controlling for student performance levels when entering a course was used to compute a percentage gain in knowledge, skills and attitudes. Data derived from a prospective, longitudinal intervention study on the development of electrocardiogram interpretation skills including 636 students from four consecutive cohorts were used to provide validity evidence of the new approach.

RESULTS

The novel tool appeared superior to plain mean differences and effect sizes in detecting outstanding teaching as well as shortcomings of the curriculum. In addition, it adequately reflected objectively measured performance levels and was responsive to curriculum change.

CONCLUSIONS

Comparative student self-assessment is a valid tool to appraise undergraduate medical curricula at the level of specific learning objectives.