Promoting medical competencies through a didactic tutor qualification programme - a qualitative study based on the CanMEDS Physician Competency Framework

Perceptions of the CanMEDS Competencies of Faculty and Students in Different Curriculum Systems of a Medical School in China

INTRODUCTION

The Ottawa-Shanghai Joint School of Medicine (OSJSM) has adopted the uOttawa's undergraduate medical education (UGME) program vertically integrated (VI) curriculum.However, limited information is available regarding whether the VI and non-VI curricula foster different perspectives on necessary competencies.

METHODS

This study included 167 undergraduate medical students and 142 faculty members from different curricula at the Shanghai Jiao Tong University School of Medicine. Participants completed a questionnaire, rating the importance of competencies relating to the seven CanMEDS roles.

RESULTS

The cognitive level regarding the competencies required to be a successful clinician was significantly higher among participants from VI versus non-VI curricula. All participants gave the highest ratings to the Medical Expert and Professional roles, and rated the Health Advocate role as least important. Competency ratings did not significantly differ between students from VI versus non-VI curricula. Ratings between VI and non-VI faculty showed only one significant difference, namely the competence of"Constantly update clinical knowledge and professional skills" was ranked significantly higher by faculty of non-VI curricula. In the top rated 10 competencies, the Communicator role was considered more important by participants from VI versus non-VI curricula.

CONCLUSION

The cognitive level regarding the competencies was related to the curriculum system. The Communicator role seemed to be paid more attention in VI curricula, however, other competencies was not demonstrated to be related to the curriculum system.

Does peer teaching improve academic results and competencies during medical school? A mixed methods study

BACKGROUND

This study investigates the impact of Peer-Assisted Learning (PAL) in clinical skills on peer teachers' academic scores and competencies; however, controversy remains on this topic, and concrete evidence on its impact lacking.

METHODS

We performed a mixed methods study combining a retrospective cohort study with a modified Delphi survey. Peer teachers and Skills Lab faculty members participated in this study. A validated questionnaire, the CanMEDS Competency Based Inventory (CCBI), and group interviews were used to assess the outcomes of PAL. Our results were also triangulated with literature data.

RESULTS

In 3 consecutive cohorts of medical students (n = 311), 78 participated in PAL. Peer teachers obtained higher scores from the start of the study, at different timepoints in medical school, and on their final scores compared to all other students. Interestingly their progress followed the same path and magnitude as other well-performing students. However, based on our findings from a modified Delphi survey (CCBI interviews) and a literature review, we found further supporting evidence for a positive impact of PAL on the competencies of physical skills (medical expert), teamwork and leadership (collaborator), lifelong learning (scholar), and for admitting uncertainty/limits (professional) within the CanMEDS roles.

CONCLUSIONS

We conclude that higher achieving students are more likely to volunteer for a peer tutoring program; however this does not significantly augment their academic scores as compared to above well-performing non-teaching fellow students. Importantly, our modified Delphi survey indicated which CanMEDS roles were positively impacted by PAL: medical expert, collaborator, scholar and professional.

Opening up a tailored tutor qualification program for medical students to other healthcare students - a mixed-method study

BACKGROUND

Peer-led tutorials are widely used in medical education to promote practical skills acquisition and support faculty staff. Typically, student tutors are custom trained for this specific task. We investigated whether opening up an existing medical tutor qualification program to other degree programs is successful in terms of acceptance among students, acquisition of tutor-specific and interprofessional competencies, and which factors contribute to success or failure.

METHODS

We developed a two-day tutor qualification program and conducted it annually from 2016 to 2020 with medical and other healthcare students. At the end of each course, we administered a written survey in which the participants rated the following items: their attitudes towards interprofessional learning (using the UWE-IP-D Interprofessional Learning Scale), the interprofessional learning setting, the teaching approach, and their competency acquisition (each on a five-point Likert scale; 1 = strongly agree, 5 = strongly disagree). Furthermore, we assessed participants' qualitative feedback in free-text fields and performed inductive content analyses.

RESULTS

The study participation rate was high (response rate 97%; medical students: n = 75; healthcare students: n = 22). Participants stated high levels of competency acquisition (total M = 1.59, individual items' M's ranging from 1.20 to 2.05) and even higher satisfaction with the teaching approach (total M = 1.28, individual items' M's ranging from 1.43 to 1.05). Overall satisfaction with the training was M = 1.22; SD = 0.58. No significant differences in ratings were found between the student groups. The qualitative results showed that students appreciated the interprofessional setting and experienced it as enriching. The most positive feedback was found in didactics/teaching methods on role-plays and group work; most suggestions for improvement were found in the area of structure and organisation on breaks and time management.

CONCLUSIONS

Opening up an existing medical tutor qualification program to other student groups can be seen as fruitful to teach not only tutor-related aspects but also interprofessional competencies. The results demonstrate the importance of detailed planning that considers group composition and contextual conditions and provides interactive teaching methods to promote interprofessional experiences. This study offers important information about prerequisites and methodological implementation that could be important for the interprofessional redesign of existing training programs.

Formative peer assessment in higher healthcare education programmes: a scoping review

OBJECTIVES

Formative peer assessment focuses on learning and development of the student learning process. This implies that students are taking responsibility for assessing the work of their peers by giving and receiving feedback to each other. The aim was to compile research about formative peer assessment presented in higher healthcare education, focusing on the rationale, the interventions, the experiences of students and teachers and the outcomes of formative assessment interventions.

DESIGN

A scoping review.

DATA SOURCES

Searches were conducted until May 2019 in PubMed, Cumulative Index to Nursing and Allied Health Literature, Education Research Complete and Education Research Centre. Grey literature was searched in Library Search, Google Scholar and Science Direct.

ELIGIBILITY CRITERIA

Studies addressing formative peer assessment in higher education, focusing on medicine, nursing, midwifery, dentistry, physical or occupational therapy and radiology published in peer-reviewed articles or in grey literature.

DATA EXTRACTIONS AND SYNTHESIS

Out of 1452 studies, 37 met the inclusion criteria and were critically appraised using relevant Critical Appraisal Skills Programme, Joanna Briggs Institute and Mixed Methods Appraisal Tool tools. The pertinent data were analysed using thematic analysis.

RESULT

The critical appraisal resulted in 18 included studies with high and moderate quality. The rationale for using formative peer assessment relates to giving and receiving constructive feedback as a means to promote learning. The experience and outcome of formative peer assessment interventions from the perspective of students and teachers are presented within three themes: (1) organisation and structure of the formative peer assessment activities, (2) personal attributes and consequences for oneself and relationships and (3) experience and outcome of feedback and learning.

CONCLUSION

Healthcare education must consider preparing and introducing students to collaborative learning, and thus develop well-designed learning activities aligned with the learning outcomes. Since peer collaboration seems to affect students' and teachers' experiences of formative peer assessment, empirical investigations exploring collaboration between students are of utmost importance.

The AaLplus near-peer teaching program in Family Medicine strengthens basic medical skills-A five-year retrospective study

Background

Basic medical skills such as history taking and physical examination are essential components of clinical work profiles, but nevertheless have been neglected by conventional preclinical curricula. The near-peer-teaching program AaL^plus [living anatomy plus] teaches basic medical skills, especially history taking, physical examination, and venepuncture, to preclinical students. It is a highly popular compulsory course in the first four semesters (320 students/year, 9h/semester) at Heidelberg University and ends with a formative Objective Structured Clinical Examination (OSCE) during which students receive structured in-depth feedback on their performance. AaL^plus is part of the Department of General Practice’s longitudinal curriculum for Family Medicine.

Objectives

This study aims to assess whether the AaL^plus program has positive effects on students’ clinical skill development and subjective confidence in history taking, physical examination and venepuncture.

Methods

From 2015 to 2019, we asked all AaL^plus participants to rate the program and self-assess their medical skills on 5-point Likert scales (min 1, max 5). In 4-station OSCEs, trained tutors rated the students’ performance in all taught skills using standardized checklists.

Results

From 2015 to 2019 n = 1534 questionnaires returned (response rate = 98.6%, 52.7% females). After course completion, students felt able to take a patient’s history (mean 3.97, SD = 0.75) and perform physical examinations (means range 3.82–4.36, SDs range 0.74–0.89) as well as venepuncture (mean 4.12, SD = 0.88). A large majority of students claimed they acquired these skills in the AaL^plus program. During OSCE, 81.9% passed anamnesis, 93.1% passed physical examination, and 95.4% passed venepuncture (of n = 1556). Students mostly rated the feedback they received during the OSCE as “helpful” or “very helpful” (means for different stations 4.69–4.76, SDs 0.50–0.70).

Conclusions

AaL^plus is a positive example of a peer teaching program in the preclinical stage of medical studies. It successfully trains junior students in essential medical abilities and increases their confidence in their skills. A high percentage of students pass the formative OSCE and evaluate it positively. Consistently high ratings indicate the program’s routine viability. Further studies are needed to analyze if programs like AaL^plus could have an impact on the number of graduates choosing career in Family Medicine.

Peers as OSCE assessors for junior medical students - a review of routine use: a mixed methods study

BACKGROUND

Peer-assisted learning is well established in medical education; however, peer tutors rarely act as assessors for the OSCE. In the compulsory, near-peer teaching programme covering basic medical skills at the University of Heidelberg, peer tutors serve as assessors on a formative OSCE. This study aimed to investigate the feasibility and acceptance of peer assessors and to survey the perceived advantages and disadvantages of their use.

METHODS

In 2016 and 2017 all OSCE peer assessors (third to sixth-year medical students) and all of the peer-assessed students in 2017 (second-year-medical students) were invited to participate in a survey. Both groups were asked to complete a tablet-based questionnaire immediately after the OSCE. Peer assessors were asked to rate eight statements and the peer-assessed students to rate seven statements on a five-point Likert scale. Both were asked to comment on the advantages and disadvantages of peer-assessors.

RESULTS

Overall, 74 of 76 peer assessors and 307 of 308 peer-assessed students participated in the study. 94% (67/74) of peer assessors and 90% (276/307) of the peer-assessed group thought that it is important to have peer tutors as assessors. Of the peer assessors, 92% (68/74) felt confident in giving structured feedback during the OSCE and 66% (49/74) felt they had improved their teaching skills. Of the peer-assessed students, 99% (306/307) were satisfied with their peers as OSCE assessors and 96% (292/307) considered the peer feedback during the OSCE as helpful. The participants mentioned structural benefits, such as lower costs, and suggested the quality of the OSCE was higher due to the use of peer assessors. The use of peer assessors was found to be beneficial for the learners in the form of high-quality feedback and an overall reduction in stress. Furthermore, the use of peer assessors was found to be beneficial for the peer assessors (improved teaching and clinical skills).

CONCLUSION

From a learner's perspective, the use of peer assessors for a formative OSCE that is part of a near-peer teaching program aimed at junior medical students is favourable for all. A broad implementation of peer assessment in the formative OSCE should be encouraged to investigate effects on quality and stress-reduction.