Reflect to interact - fostering medical students' communication through reflection-focused e-learning

BACKGROUND

Previous research indicates that reflection can foster medical communication competence. However, best practices for embedding reflection in online medical education are missing. This study examined how reflection processes can be promoted and embedded in an e-learning course on physician-patient communication to foster learning.

METHODS

We investigated three differently designed e-learning conditions featuring different proportions of reflection triggers and compared their effects on students' reflections. We had 114 medical students in their first clinical year complete one of the variants: video modelling (VM, n = 39), video reflection (VR, n = 39), or a variant merging both approaches (VMR, n = 36). Each student wrote a total of nine reflections based on the same guiding questions at three time points embedded in the course. The students' levels of reflection were measured using an adapted version of the REFLECT rubric (scale 0-18).

RESULTS

Students of all course variants achieved good levels of reflection beyond the descriptive level at all three time points, with no significant differences between the variants. The mean reflection scores at the end of the course were M = 14.22 for VM (SD = 2.23), M = 13.56 for VR (SD = 2.48), and M = 13.24 for VMR (SD = 2.21). Students who completed VM showed significantly improved levels of reflection over the course, whereas we found no statistically significant development for those in VR or VMR. The reflection scores correlated significantly positively with each other, as did the text lengths of the written reflections. Reflection scores also correlated significantly positively with text length.

CONCLUSIONS

Our study offers a teaching strategy that can foster good levels of reflection, as demonstrated in the three e-learning variants. The developed reflection prompts can be easily embedded in various e-learning environments and enable reflections of good quality, even in settings with limited available teaching time.

Seeing with Different Eyes. The Module Life & Science of the Elite-Master Program Biomedical Neuroscience

From its beginnings in 2018, the international elite-master program Biomedical Neuroscience of TUM School of Medicine and Health at Technical University of Munich was guided by two convictions: First, excellent research depends not only on the mediation of scientific knowledge and skills, but also on a multifaceted understanding of science itself. Second, teaching must recognize and support not only student's growing expertise but also their personal and professional development. To this end, the module Life & Science was designed. It gives students the opportunity to explore neuroscience from different angles to deepen the epistemological, sociological, and cultural understanding of their chosen profession.

Training in medical communication competence through video-based e-learning: How effective are video modeling and video reflection?

OBJECTIVE

The present study investigated the efficacy of the didactic approaches of video modeling (VM, best-practice examples), video reflection (VR, problem-based approach), and the combination of both (VMR) in fostering medical communication competence in a video-based digital learning environment.

METHODS

N = 126 third-year medical students who participated in the pre-post study were assigned to either the intervention groups (VM, VR, and VMR) or the wait-list control group. The efficacy of the three approaches was assessed by means of a situational judgment test (SJT) of medical communication competence. To investigate the differences between the wait-list control and the intervention groups (H1), between the single-mode and combined conditions (H2), and between VM and VR (H3), we applied planned contrast analyses.

RESULTS

The planned contrasts showed that the VR condition significantly improved learning outcomes in comparison to the VM condition (H3). The decreased mean scores of the VM condition offset the increased mean scores of VR, and thus no significant differences could be found in H1 and H2.

CONCLUSIONS

Our study provides promising evidence that VR fosters medical communication competence more effectively than VM.

PRACTICAL IMPLICATIONS

Medical students' learning in video-based digital environments can be facilitated by the use of interactive VR.

Structure and quality of bedside teaching: A videographic analysis

Bedside teaching (BST) is a core element of medical education. In light of a reported decrease in BST, evidence on how to use BST time most efficiently should be developed. Given that little research into the tangible quality characteristics of good BST has been reported, we investigated the influence of various teacher and structural characteristics on the perceived quality of BST. We filmed and coded 36 BSTs involving 24 lecturers and 259 students. Structural characteristics of interest were: number of students and patients, overall duration, and the proportion of clinical examination. Lecturer questionnaires provided insight into teaching experience and intrinsic motivation, and student evaluations assessed the quality of BSTs in three dimensions. Correlations are reported using the Pearson r and a linear mixed model (LMM). The intrinsic motivation of lecturers was significantly positively correlated with perceived quality, but their experience was only weakly so correlated. In the LMM, a significant association was observed for the quality dimension of clinical teaching with the number of patients and the proportion of time spent on clinical examination. Based on our findings, we recommend including multiple patients in BSTs, and providing substantial opportunities for clinical examination. Regarding lecturers, motivation matters more than experience.

Development and internal validation of an instrument to measure the motivation of residents for family medicine

BACKGROUND

For several decades, medical school graduates' motivation to specialise in family medicine is decreasing. Therefore, residents in family medicine must be motivated for the profession and finish their residency.

OBJECTIVES

Goal of the current study is the development and internal validation of an instrument to measure the residents' motivation for family medicine, which is based on the self-determination theory: STRength mOtivatioN General practitioner (STRONG).

METHODS

We used an existing instrument, the 'Strength of Motivation for Medical School,' adapted the 15 items and added a 16th item to make it suitable for residency in family medicine. After a review by experts, the questionnaire was sent to 943 residents of family medicine in Bavaria, Germany, in December 2020. An exploratory factor analysis for the STRONG item scores was carried out. The items were analysed for grouping into subscales by using principal component analysis. Cronbach's alpha for internal consistency was determined for calculating the reliability of the subscales.

RESULTS

After analysis, the questionnaire appeared to consist of two subscales: 'Willingness to sacrifice' (eight items, Cronbach's alpha is 0.82) and 'Persuasion' (five items, Cronbach's alpha is 0.61). The factor analysis with Promax rotation resulted in two factors explaining 39.6% of the variance. The Cronbach's alpha of the full scale is 0.73.

CONCLUSION

Based on the internal validation, the STRONG Instrument appears to have good reliability and internal validity, assuming a two-factor structure. This may therefore be a helpful instrument for measuring the strength of the motivation of (future) family medicine residents.

Student mistakes and teacher reactions in bedside teaching

We analyse interactions between teachers and students during video-recorded bedside teaching sessions in internal medicine, orthopaedics and neurology. Multiple raters used a high-inference categorical scheme on 36 sessions. Our research questions concern the types of student mistakes, clinical teachers' reactions to them and if they use different strategies to address different types of mistakes. We used a Poisson model and generalized mixed models to analyse these research questions. Most frequently, students made reproduction mistakes. Relatively high rates of rejection and a similar prevalence of low and high levels of elaboration and correction time for students were observed. Reproduction mistakes were associated with the highest level of rejection and the lowest level of elaboration. High levels of elaboration were observed when students were applying skills in new situations. Students were most often allowed time to correct when mistakes in the areas of analysis or application of skills and knowledge had occurred. There is a decrease in the rate of making mistakes for neurology and orthopaedics compared to internal medicine. Reproduction mistakes influence significantly the outcome feedback compared to application mistakes. Analytic and reproduction mistakes influence elaboration significantly compared to application mistakes. We found a significant effect whether the lecturer allows time for correction of reproduction mistakes compared to application mistakes. These results contribute to the understanding of interactive, patient-centred clinical teaching as well as student mistakes and how teachers are reacting to them. Our descriptive findings provide an empirical basis for clinical teachers to react to student mistakes in didactically fruitful ways.

Experiences of medical students and nursing trainees from unexpected death through simulation training

BACKGROUND

Dying in simulation training is controversially discussed. On the one hand, the danger of an emotional overload of the learners is pointed out. On the other hand, dying in simulation settings is addressed as an opportunity to prepare future health professionals to deal with patient death. The present study investigates how medical students and nursing trainees experience the sudden death of a simulated patient and how and under which conditions it can be valuable to simulate the patient's death.

METHODS

At the TUM School of Medicine in Munich, Germany, we developed an interprofessional, simulation-based course in which participants were unexpectedly confronted with a cardiac arrest scenario within which resuscitation had to be discontinued due to an advanced directive. After the course, focus groups were conducted with nine medical students and six nursing trainees. Data were analysed using Grounded Theory techniques.

RESULTS

The participants reported low to high emotional involvement. The active renunciation of life-sustaining measures was felt to be particularly formative and caused a strange feeling and helplessness. Questions of what could have been done differently determined interviewees' thoughts. The participants appreciated the opportunity to experience what it feels like to lose a patient. The course experience encouraged interviewees to reflect on dying and the interviewees explained that they feel better prepared to face death after the course. The unexpected character of the confrontation, presence of the advanced directive and debriefing positively affected the impact of the simulation.

CONCLUSIONS

The study recognises simulation training as a promising approach for preparing future health care professionals to encounter a patient's death.

Structured interviews on self-regulated learning strategies of medical students in the final year of medical school

BACKGROUND

In the final year of medical school, the educational focus is on experiences in the clinical environment. This is where students acquire most of their practical knowledge for their future career and need to optimise their Self-Regulated Learning (SRL) strategies. Hence, the current study aims to explore which SRL strategies medical students use during their clerkships in different learning settings.

METHODS

Structured interviews were conducted between May 2019 and December 2020 with 43 medical students during their final year in Munich, Germany. The students were surveyed about their SRL strategies. The transcribed data were thematically analysed using the measurements Strategy Use (SU) and Strategy Frequency (SF).

RESULTS

Interview data were organized into 11 SRL strategy categories. The most used SRL strategy in general was "seeking information in the internet in form of a text" (SU: 1; SF: 2.605), with an e-learning tool; followed by "seeking social assistance from doctors" (SU: 0.977; SF: 1.884), and "seeking information in books" (SU: 0.884; SF: 1.419). There were differences in the usage of SRL in different learning contexts between female and male students. For example, 95.3% of students are "seeking social assistance from doctors" when having difficulties on the ward, but only 55.8% when they need help with written tasks (e.g. medical letter). The results show a difference in SRL usage when preparing for oral-practical (79.1% books) and written (97.7% e-learning tool) exam. However, it also appears that some students do not have SRL strategies for certain situations, mostly due to a lack of time.

CONCLUSION

Medical students in the clinical phase are adapting their SRL strategy to the learning situation. To better support students´ SRL, it is necessary to ensure availability for their preferred resources: e-learning tool and experienced physicians as supervisors. Future research should focus on strategies to handle the limited time during clerkships.

Measuring informal workplace learning outcomes in residency training: a validation study

BACKGROUND

Informal workplace learning (WPL) has no concrete learning objective and takes place without a responsible supervisor, which makes it difficult to assess its learning outcomes. Formal learning situations, as they are known from universities or schools, do not exist in this context and make a conventional assessment of learning goals and achievements impossible. Informal learning in the workplace is of central importance, and the assessment of informal learning outcomes in medical education is an under-researched area. The aim of our study was to adapt and validate an informal WPL questionnaire (originally developed for social workers) to assess learning outcomes due to informal WPL in residency training.

METHODS

A total of 528 residents (n = 339 female; age: M = 29.79; SD = 3.37 years) completed an adapted questionnaire on informal WPL outcomes and the Freiburg Questionnaire to Assess Competencies in Medicine (i.e. medical knowledge, communication, and scholarship). Exploratory factor analysis was used to determine the underlying factor structure. The reliability of the factors was tested using McDonald's omega, and the correlation between the factors and the three subscales of the Freiburg questionnaire was tested using Spearman's rho correlation coefficient. To investigate construct validity, a structural equation model was calculated to examine the relationships between medical competencies and informal learning outcomes.

RESULTS

The exploratory factor analysis yielded a four-factor solution that best fit the data. The scores of all four factors (GLO-CD: generic learning outcomes-competence development, GLO-R: generic learning outcomes-reflection, JSLO: job-specific learning outcomes, and OLLO: organisational learning outcomes) showed good internal consistency (Ω ≥ .69). The structural equation model showed that "medical expertise" had an impact on all four factors of informal learning at work. "Scholarship" seemed to predict GLO-CD and GLO-R.

CONCLUSIONS

Our four-factor model reveals meaningful determinants of informal WPL in relation to residency training. The instrument is therefore the first promising attempt to assess informal WPL in the broader context of medical education during residency, thus supporting its construct validity.

OPEN Hackathon at the TUM School of Medicine, Germany

The OPEN Hackathon of the Technical University of Munich (TUM) 2020 set out to address challenges and potential solutions for medical education at the School of Medicine to kick off the 2020/21 winter semester. The event lasted 36 hours, during which medical students, teachers and staff members had the opportunity to tackle current problems in education and to develop co-created, customized solutions through creative teamwork for the School of Medicine at the TUM. The resulting solutions are now being realized and implemented in teaching. This paper describes the process and organization of the hackathon. Furthermore, the result of the evaluation of the event are described. In this paper, we aim to present the project as a valuable pioneer in the field of developing medical-educational topics within the framework of innovative methodological formats.

Professional Identity and Motivation for Medical School in First-Year Medical Students: A Cross-sectional Study

Background

Professional identity formation (PIF) is a life-long process, starting even before professional education. High levels of motivation for medical school are essential for effective learning and academic success. Both are key factors in future physicians' professional and personal development, and according to self-determination theory, professional identity (PI) and students' levels of motivation could be closely linked. Therefore, we sought to investigate whether PI and strength of motivation for medical school are associated in new medical students.

Methods

In a cross-sectional survey, all new medical students in Munich, Germany, were asked to complete the Macleod Clark Professional Identity Scale (MCPIS-9) and the Strength of Motivation for Medical School-Revised questionnaire (SMMS-R) as well as to provide information about age, gender, and waiting time before starting medical school.

Results

Eight hundred eleven out of 918 new medical students participated in the survey. A positive correlation between the MCPIS-9 and the SMMS-R (p < 0.001) was found. Female students showed higher scores in the SMMS-R (p < 0.05) and the SMMS-R-subscale Readiness to Start (p < 0.001). The amount of waiting semesters showed a positive correlation with the total SMMS-R score (p < 0.01) as well as with the subscales Readiness to Start and Persistence (both p < 0.001).

Discussion

We found an association between PI and strength of motivation for medical school in a large cohort of new medical students. Female gender and more waiting semesters were associated with higher levels of self-perceived motivation and higher scores on the SMMS-R-subscale Readiness to Start. More research is needed to better understand this topic to further improve medical education.

Implicit expression of uncertainty in medical students during different sequences of clinical reasoning in simulated patient handovers

BACKGROUND

Dealing with medical uncertainty is an essential competence of physicians. During handovers, communication of uncertainty is important for patient safety, but is often not explicitly expressed and can hamper medical decisions. This study examines medical students' implicit expression of uncertainty in different sequences of clinical reasoning during simulated patient handovers.

METHODS

In 2018, eighty-seven final-year medical students participated in handovers of three simulated patient cases, which were videotaped and transcribed verbatim. Sequences of clinical reasoning and language references to implicit uncertainty that attenuate and strengthen information based on a framework were identified, categorized, and analyzed with chi-square goodness-of-fit tests.

RESULTS

A total of 6358 sequences of clinical reasoning were associated with the four main categories "statement", "assessment", "consideration", and "implication", with statements occurring significantly (p<0.001) most frequently. Attenuated sequences of clinical reasoning occurred significantly (p<0.003) more frequently than strengthened sequences. Implications were significantly more often attenuated than strengthened (p<0.003). Statements regarding results occurred significantly more often plain or strengthened than statements regarding actions (p<0.0025).

CONCLUSION

Implicit expressions of uncertainty in simulated medical students' handovers occur in different degrees during clinical reasoning. These findings could contribute to courses on clinical case presentations by including linguistic terms and implicit expressions of uncertainty and making them explicit.

How is modern bedside teaching structured? A video analysis of learning content, social and spatial structures

BACKGROUND

Bedside teaching (BST) is an essential and traditional clinical teaching format. It has been subject to various impediments and has transformed over time. Besides a decrease in bedside time, there has also been a didactic diversification. In order to use time at the bedside effectively and understand the current design of BST, we here offer an evidence-based insight into how BST is practiced. This may serve as a basis for a refinement of its didactic design.

METHODS

In the current study, we investigate the interrelationships between learning content and the social as well as spatial structures of BST. To this end, we have empirically analysed almost 80 hours of video material from a total of 36 BST sessions with good interrater reliability.

RESULTS

BST lasted on average 125 min, most of which was spent in plenary and less than a third of the time at the patient's bedside. History taking was primarily practiced at the bedside while case presentations, clinical reasoning and theoretical knowledge were largely taught away from the patient. Clinical examination took place to a similar extent in the patient's room and in the theory room.

CONCLUSIONS

Even though the filmed BSTs are not purely "bedside", the teaching format investigated here is a typical example of undergraduate medical education. In order to maximize the teaching time available, a suitable learning space should be provided in addition to the bedside. Moreover, the clinical examination should be revised in its general sequence prior to the BST, and conscious decisions should be made regarding the social structure so as to optimize the potential of small groups and plenary sessions.

Medical Students and Their Perceptions of Digital Medicine: a Question of Gender?

Digital technologies play an essential role in the medical sector of today and the future. In a cross-sectional online survey at a German medical university, male students more frequently reported keeping themselves informed about digital medicine outside of their studies across all clinical years of study. While female students self-assessed their knowledge in different fields of digital medicine as worse than their male peers in the first clinical years of study, no more gender differences could be found towards the final year. However, students of both genders showed a strong desire for further education on the topic of digital medicine.

The WFME global standards for quality improvement of postgraduate medical education: Which standards are also applicable in Germany? Recommendations for physicians with a license for postgraduate training and training agents

Background: In Germany, the (model) regulation for postgraduate medical education 2018, the professional codes of conduct of the regional medical councils and the health professions chamber laws of the federal states are the formal basis of postgraduate medical education, but say little about its structure, processes and results. The World Federation for Medical Education (WFME) has developed global standards for improving the quality of postgraduate medical education and published them in a revised edition in 2015. A German version which takes the specifics of medical training in Germany into account has not been published to date. Objective: The Committee for Postgraduate Medical Education (PGME) of the Society for Medical Education (GMA) has set itself the goal of firstly translating the WFME standards into German and secondly making recommendations for physicians with a license for post-graduate training (PLT) and training agents (TA) in clinics and practices which have been adapted to the German context. Methods: The WFME standards were translated into German by a working group of the GMA Committee for PGME, the terminology adapted to PGME in Germany and checked by an interdisciplinary panel of experts made up of 9 members of the committee. In a second step, the WFME basic standards and quality standards for PGME relevant to PLTs and TAs in Germany were iteratively determined by this panel of experts using the Nominal Group Technique (NGT) and compiled in the form of recommendations. Results: The translation of the WFME guidelines was approved by the expert group without any changes to the content, taking into account the terminological system of PGME in Germany. In a second step, 90 standards were identified which were considered helpful for PGME in Germany, especially for PLTs and TAs (such as development of a professional identity, a more patient-centered approach or support of self-directed learning). Care was taken to only give recommendations which can be influenced by PLTs and TAs. These standards have been summarized as recommendations to PLTs and TAs and take into account all chapters of the WFME standards. Conclusion: The WFME standards selected here are recommended to PLTs and TAs in clinics and practices to achieve high-quality PGME. Empirical longitudinal studies will be required to examine both the implementation and the results of applying the modified WFME criteria in Germany.

Programs to encourage working as a general practitioner in rural areas: why do medical students not want to participate? A cross-sectional study

BACKGROUND

In many countries, not enough students are interested to work as general practitioners in rural areas. To solve this problem, several, sometimes partly extracurricular, programs have been developed. Most of these programs are based on continuity, which means that students stay in a rural region for an extended period of time, by completing clerkships. Although the effects of these programs are positive, it is often difficult to motivate students to participate. The purpose of the present study is to get insight into the reasons why students choose not to participate in these programs.

METHODS

We carried out a questionnaire study among medical students in the clinical phase of the Technical University of Munich in Germany. First, we asked the students whether they actively informed themselves about the program which aims to reduce the shortage of general practitioners in rural areas in Bavaria. Furthermore, the questionnaire focused on the reasons for not participating in this program.

RESULTS

Based on the answers of 442 students from study years 3-6, the most frequently chosen reason for not participating in the program is "identification with another discipline" with 61.0%, directly followed by "not willing to commit long-term" (56.1%). In third place is "personal connections to another region" with 30.5%. In the open comments, we find the same reasons: many students do not want to commit to a certain direction too early. In addition, students indicate that the number of regions where this program is offered is too limited for them.

CONCLUSIONS

Offering programs to prepare and motivate students for work as general practitioners in rural areas can contribute to increasing the pool of future general practitioners. To encourage students to participate in such a program, it is important to consider the motives of students. Many students who might be interested in general practice do not choose to take part in such a program because they do not want to commit to a particular specialty or region at an early stage. It is important to take these insights into account when designing and implementing these programs.

A video-based situational judgement test of medical students' communication competence in patient encounters: Development and first evaluation

OBJECTIVE

We developed and evaluated the Video-Based Assessment of Medical Communication Competence (VA-MeCo), a construct-driven situational judgement test measuring medical students' communication competence in patient encounters.

METHODS

In the construction phase, we conducted two expert studies (n_panel1 = 6, n_panel2 = 13) to ensure curricular and content validity and sufficient expert agreement on the answer key. In the evaluation phase, we conducted a cognitive pre-test (n = 12) and a pilot study (n = 117) with medical students to evaluate test usability and acceptance, item statistics and test reliability depending on the applied scoring method (raw consensus vs. pairwise comparison scoring).

RESULTS

The results of the expert interviews indicated good curricular and content validity. Expert agreement on the answer key was high (ICCs> .86). The pilot study showed favourable usability and acceptance by students. Irrespective of the scoring method, reliability for the complete test (Cronbach's α >.93) and its subscales (α >.83) was high.

CONCLUSION

There is promising evidence that medical communication competence can be validly and reliably measured using a construct-driven and video-based situational judgement test.

PRACTICE IMPLICATIONS

Video-based SJTs allow efficient online assessment of medical communication competence and are well accepted by students and educators.

Changes in medical students´ and anesthesia technician trainees´ attitudes towards interprofessionality - experience from an interprofessional simulation-based course

BACKGROUND

Interprofessional simulation based education (IPSBE) programs positively impact participants' attitudes towards interprofessional collaboration and learning. However, the extent to which students in different health professions benefit and the underlying reasons for this are subject of ongoing debate.

METHODS

We developed a 14-h IPSBE course with scenarios of critical incidents or emergency cases. Participants were final year medical students (FYMS) and final year anesthesia technician trainees (FYATT). To assess attitudes towards interprofessionalism, the University of the West of England Interprofessional Questionnaire was administrated before and after the course. Using focus group illustration maps, qualitative data were obtained from a subcohort of the participants (n = 15).

RESULTS

After the course, self-assessment of communication and teamwork skills, attitudes towards interprofessional interactions and relationships showed comparative improvement in both professions. Attitudes towards interprofessional learning improved only in FYMS. Qualitative data revealed teamwork, communication, hierarchy and the perception of one's own and other health profession as main topics that might underlie the changes in participants' attitudes. An important factor was that participants got to know each other during the course and understood each other's tasks.

CONCLUSIONS

Since adequate communication and teamwork skills and positive attitudes towards interprofessionality account to effective interprofessional collaboration, our data support intensifying IPSBE in undergraduate health care education.

Validation of the ComCare index for rater-based assessment of medical communication and interpersonal skills

OBJECTIVES

To develop and validate a short instrument to assess undergraduate medical students' communication and interpersonal skills in videographed history taking situations with simulated patients.

METHODS

Sixty-seven undergraduate medical students participating in an assessment including videographed physician-patient encounters for history taking with five simulated patients were included in this study. The last video of each participant's consultation hour was rated by two independent assessors with the eight-item ComCare index for assessment of communication and interpersonal skills newly designed for the external rater perspective (ComCareR). We compared the sum scores of the ComCareR with ratings of the same videos with the Kalamazoo Communication Skills Assessment Form from an observational perspective (KCSAFd-video) and the Global Rating scale (GR), which also measure communication and interpersonal skills.

RESULTS

The ComCareR showed an excellent interrater reliability (ICC = .85). We found a small but significant correlation with the KCSAFd-video Interpersonal Competence (ρ = .34, 95% CI [.10,.54]) and a high positive correlation with the GR (ρ = .59, 95% CI [.40,.73]).

CONCLUSIONS

The ComCareR is a valid and brief index for holistic assessment of communication and interpersonal skills in physician-patient encounters.

PRACTICE IMPLICATIONS

The ComCareR can be used for quick rater-based assessment of physicians' communication and interpersonal skills.

Evaluating the Global Rating scale's psychometric properties to assess communication skills of undergraduate medical students in video-recorded simulated patient encounters

OBJECTIVES

To evaluate the psychometric properties of the Global Rating scale (GR) as an observer-based tool to assess communication skills of undergraduate medical students in video-recorded patient encounters.

METHODS

Seventy advanced undergraduate medical students participated in a simulation-based assessment including patient consultations. Simulated patients rated these encounters with the Consultation and Relational Empathy (CARE) scale. Two independent, blinded raters assessed the videos of the encounters with the GR and another blinded rater with the Clinical Reasoning Indicators Scale (CRI-HT-S). To assess the GR's psychometric properties, we analysed reliability by means of a G-study, interrater reliability by ICC, convergent validity (correlation of GR and CARE), and divergent validity (correlation of GR and CRI-HT-S).

RESULTS

We analysed 325 videos of 65 students (56.9% female, mean age 26.1 ± 2.2 years). The G-coefficient was.90. Interrater reliability of the GR was ICC = .95, 95% CI [.91,.97]. CARE and GR correlated moderately (ρ = .47, 95% CI [.25,.65]). GR and CRI-HT-S did not correlate (ρ = .09, 95% CI [-.16,.34]).

CONCLUSIONS

With excellent reliability and adequate validity, the quality of the GR as assessment instrument for communication skills could be demonstrated.

PRACTICE IMPLICATIONS

The GR is a suitable instrument for video-based rating of communication skills.

Frequency of medical students' language expressing implicit uncertainty in simulated handovers

OBJECTIVES

The aim of this study was to investigate the number and type of implicit expressions of uncertainty by medical students during simulated patient handovers.

METHODS

Eighty-seven volunteer medical students, a convenience sample collected on a first-come, first-served basis, participated in simulated handovers. They each worked with three simulated patients who presented with different chief complaints and personal conditions. The handovers were video recorded and transcribed. A framework of implicit expressions of uncertainty was used to identify and count modifiers that attenuate or strengthen medical information using MAXQDA lexical search. We analysed the findings with respect to the patients' contexts.

RESULTS

Implicit uncertainty expressions which attenuate or strengthen information occurred in almost equal frequency, 1879 (55%) versus 1505 (45%). Attenuators were found most frequently in the category 'Questionable', 1041 (55.4%), strengtheners in the category 'Focused', 1031 (68.5%). Most attenuators and strengtheners were found in the handover of two patients with challenging personal conditions ('angry man', 434 (23.1%) versus 323 (21.5%); 'unfocused woman', 354 (19.4%) versus 322 (21.4%)) and one patient with abnormal laboratory findings ('elevated creatinine', 379 (20.2%) versus 285 (18.9%)).

CONCLUSIONS

Medical students use a variety of implicit expressions of uncertainty in simulated handovers. These findings provide an opportunity for medical educators to design communication courses that raise students' awareness for content-dependent implicit expressions of uncertainty and provide strategies to communicate uncertainty explicitly.

How to... train your skills goes digital! A project report on the development and implementation of practice-oriented digital student tutorials

Objective: This project report outlines the development and implementation of digital tutorials ("How to... train your skills goes digital!") by peer tutors (TUTs) based on previously established in-person tutorials, as well as the subsequent combination of both approaches. The TUTs' objective, in spite of corona-related restrictions and strict hygiene requirements during the pandemic, was to provide fellow students with the opportunity to learn, practice and reflect on clinical-practical skills. Methodology: In a collaborative undertaking, the TUTs first analyzed the learning objectives of the in-person tutorials in order to be able to design content-matched digital tutorials without entirely abandoning the practical aspect. The Moodle learning management platform was selected as the appropriate tool for delivery of the relevant theoretical knowledge. Practical exercises are embedded in the digital tutorials during online meetings. The participants (PTs) create their own models in the sense of a home skills station based on instructions provided via Moodle. Acceptance was systematically documented via questionnaires. Results: The digital tutorials were well accepted by the PTs (n=64). Evaluation (response rate: 37.5%) outcomes were consistently positive. Both course implementation and the PTs' own progress were rated "good" to "very good". Nevertheless, the PTs do not yet feel well-prepared to carry out the various activities practiced independently. In the winter semester of 2020/21, the in-person tutorials were also reintroduced in a combined format. The marked demand for the tutorials may indicate the PT preference for practice on the simulation center models. Conclusion: The systematic combination of digital and in-person tutorials using the flipped classroom approach would appear to make sense in the long run. The effectiveness and sustainability of this approach in comparison with in-person tutorials only should be further investigated.

[The importance of the learning environment and reduction of burnout in clinical training: an analysis of the Competence Centre for Residency Training in Family Medicine Bavaria (CCRTB)]

BACKGROUND

The Competence Centre for Residency Training in Family Medicine Bavaria (CCRTB) was established to improve the quality of postgraduate medical training by offering additional seminars and mentoring programmes as well as regular 'train-the-trainer' courses for educating physicians. In addition, residents have the opportunity to participate in a regional training network.

OBJECTIVE

The aim was to assess the burden of burnout and the importance of the learning environment in the clinical training phase.

METHODS

We conducted a cross-sectional study. Burnout was assessed using the Maslach Burnout Inventory (MBI), which comprises the scales "Emotional Exhaustion", "Depersonalisation" and "Personal Accomplishment". The quality of the learning environment was recorded using the German version of the Dutch Residency Educational Climate Test (D-RECT German). In addition, multivariable linear regressions were performed to estimate the impact of learning environment, year of training and participation in a regional network on the level of burnout.

RESULTS

129 clinical residents enrolled in the CCRTB were invited to participate in the study, 78 (61%) of whom submitted a response. 76 (59%) of these residents were included in the analyses. The present study discloses an increased burden of burnout among residents in the clinical training phase, with approx. 40% reaching a critical burnout score. A higher quality of the learning environment was associated with significantly milder burnout symptoms on the majority of the D-RECT scales.

CONCLUSION

Family medicine residents in the clinical training phase show a high burden of burnout. Therefore, increasing the quality of the learning environment appears to be an effective key element in achieving a reduction of burnout in clinical training. This might contribute to an increase in professional satisfaction, which finally may also prevent migration from the medical profession.

Increased professionalization and lower burnout scores were associated with structured residency training program: results of a cross sectional survey

The competence centre for Residency Training in Family Medicine Bavaria (CCRTB) was established to improve the quality of postgraduate medical education by offering training and mentoring programmes for residents, and by providing train-the-trainer and mentoring courses for supervisors. Beyond that, regional Residency Training Networks (RTN) on avoluntary basis were developed to facilitate structured and efficient clinical rotation programs. Primary aim was to investigate the burden of burnout and the development of professionalism among CCRTB-residencies within a cross-sectional study. Secondary aim was to evaluate differences between CCRTB-residents with and without participation in aregional RTN. Burnout was determined with the Maslach Burnout Inventory (MBI), comprising the scales emotional exhaustion, depersonalization, and personal accomplishment. Ambulatory professionalization was evaluated using the German Professional Scale (Pro-D), comprising the scales professionalism towards the patient, towards other professionals, towards society, and towards oneself. Statistical significance of group differences was calculated by nonparametric tests. Multivariable linear regression modelling was performed to estimate the independent impact of professionalization and RTN participation on burnout scores. 347 CRRTB residents in ambulatory postgraduate training were invited, 212 (61.1%) participated, and 197 (92.9%) were included in our analyses. Lower emotional exhaustion and depersonalization, and increased personal accomplishment was associated with increased professionalisation, which was significant for nearly all Pro-D scales (p ≤ 0.05). RTN residents showed higher professionalism towards the patient (p = 0.031), other professionals (p = 0.012), and towards the society (p = 0.007) than residents of unstructured programs, and higher levels of personal accomplishment (p < 0.05). Early and efficient professionalization might be akey to reduce burnout and to establish asatisfying career in family medicine. Train-the-trainer and mentoring concepts should be implemented regularly for the training of residents. Thus, increased engagement in medical didactics should be aprerequisite for accreditation as atraining practice for residents.

Medical students' engagement in the context of the SARS-CoV-2 pandemic: The influence of psychological factors on readiness to volunteer

Objective: To avert staff shortages during the first wave of the SARS-CoV-2 pandemic in spring 2020, the medical faculties of the Technical University of Munich (TUM) and the Ludwig Maximilian University of Munich (LMU) appealed to their students to volunteer for relief work. In this study, we examine the influence of psychological factors on the students' decisions to respond to this call or not. Methodology: We report on a cross-sectional study based on an online survey among medical students at the TUM and LMU. The survey consisted of a questionnaire containing items on motivation and other factors related to the decision for or against volunteering. Questions were also asked about anxieties regarding COVID-19 and the occurrence of depressive symptoms, as well as about resilience. Results: Responses from 244 participants were analysed. Students' decisions to volunteer revealed both altruistic and introjected motivations. For those students who did not volunteer, time overlaps and workload related to other activities played an important role. Between the two groups, no significant difference was detected in terms of their resilience and COVID-19-related anxieties. However, the non-volunteering students reported a significantly higher prevalence of depressive symptoms. Conclusion: Sense of duty and the desire to help were, according to the students, the most important reasons for volunteering. Depressive symptoms and lack of time made volunteering less likely. Resilience and COVID-19-related anxieties do not seem to have had any influence on the decision to volunteer or not.

Measuring hygiene competence: the picture-based situational judgement test HygiKo

BACKGROUND

With the onset of the COVID-19 pandemic at the beginning of 2020, the crucial role of hygiene in healthcare settings has once again become very clear. For diagnostic and for didactic purposes, standardized and reliable tests suitable to assess the competencies involved in "working hygienically" are required. However, existing tests usually use self-report questionnaires, which are suboptimal for this purpose. In the present study, we introduce the newly developed, competence-oriented HygiKo test instrument focusing health-care professionals' hygiene competence and report empirical evidence regarding its psychometric properties.

METHODS

HygiKo is a Situational Judgement Test (SJT) to assess hygiene competence. The HygiKo-test consists of twenty pictures (items), each item presents only one unambiguous hygiene lapse. For each item, test respondents are asked (1) whether they recognize a problem in the picture with respect to hygiene guidelines and, (2) if yes, to describe the problem in a short verbal response. Our sample comprised n = 149 health care professionals (79.1 % female; age: M = 26.7 years, SD = 7.3 years) working as clinicians or nurses. The written responses were rated by two independent raters with high agreement (α > 0.80), indicating high reliability of the measurement. We used Item Response Theory (IRT) for further data analysis.

RESULTS

We report IRT analyses that show that the HygiKo-test is suitable to assess hygiene competence and that it allows to distinguish between persons demonstrating different levels of ability for seventeen of the twenty items), especially for the range of low to medium person abilities. Hence, the HygiKo-SJT is suitable to get a reliable and competence-oriented measure for hygiene-competence.

CONCLUSIONS

In its present form, the HygiKo-test can be used to assess the hygiene competence of medical students, medical doctors, nurses and trainee nurses in cross-sectional measurements. In order to broaden the difficulty spectrum of the current test, additional test items with higher difficulty should be developed. The Situational Judgement Test designed to assess hygiene competence can be helpful in testing and teaching the ability of working hygienically. Further research for validity is needed.

Educational Intervention Reduced Family Medicine Residents' Intention to Request Diagnostic Tests: Results of a Controlled Trial

OBJECTIVE

Dealing with uncertainty is a core competence for physicians. To evaluate the impact of an educational intervention on family medicine residents' (FMRs') intention to request diagnostic tests and their attitudes toward uncertainty.

METHODS

Nonrandomized controlled trial. Intervention group (IG) FMRs participated in interactive "dealing with uncertainty" seminars comprising statistical lessons and diagnostic reasoning. Control group (CG) FMRs participated in seminars without in-depth diagnostic lessons. FMRs completed the Dealing with Uncertainty Questionnaire (DUQ), comprising the Diagnostic Action and Diagnostic Reasoning scales. The Physicians' Reaction to Uncertainty (PRU) questionnaire, comprising 4 scales (Anxiety Due to Uncertainty, Concern about Bad Outcomes, Reluctance to Disclose Uncertainty to Patients, and Reluctance to Disclose Mistakes to Physicians) was also completed. Follow-up was performed 3 months later. Differences were calculated with repeated-measures analysis of variance.

RESULTS

In total, 107 FMRs of the IG and 102 FMRs of the CG participated at baseline and follow-up. The mean (SD) Diagnostic Action scale score decreased from 24.0 (4.8) to 22.9 (5.1) in the IG and increased in the CG from 23.7 (5.4) to 24.1 (5.4), showing significant group difference (P = 0.006). The Diagnostic Reasoning scale increased significantly (P = 0.025) without a significant group difference (P = 0.616), from 19.2 (2.6) to 19.7 (2.4) in the IG and from 18.1 (3.3) to 18.8 (3.2) in the CG. The PRU scale Anxiety Due to Uncertainty decreased significantly (P = 0.029) without a significant group difference (P = 0.116), from 20.5 (4.8) to 18.5 (5.5) in the IG and from 19.9 (5.5) to 19.0 (6.0) in the CG.

CONCLUSION

The structured seminar reduced self-rated diagnostic test requisition. The change in Anxiety Due to Uncertainty and Diagnostic Reasoning might be due to an unspecific accompanying effect of the extra-occupational seminars for residents.

[Virtual skills-training in urology : Teaching at the Technical University of Munich during the COVID-19-pandemic]

Hintergrund und Einleitung

Die COVID-19-Pandemie stellte die Universitätskliniken vor eine große Herausforderung: Wie kann eine praktische Ausbildung angehender Mediziner ohne deren Präsenz in der Klinik erfolgen? Als Alternative zum regulären Praktikumstag haben wir innerhalb kurzer Zeit ein virtuelles Ersatzangebot mittels Lehrvideos zu unterschiedlichen urologischen Themen auf einer universitären Online-Plattform geschaffen. Ziel der Videos war die Vermittlung des Fachs Urologie in Theorie und Praxis.

Material und Methoden

Die Videos wurden durch Mitarbeiter der Klinik anhand eines ausgearbeiteten Konzepts gefilmt und bearbeitet. Anschließend wurden diese Videos auf der universitären Online-Lehrplattform Moodle zur Verfügung gestellt. Zur Erfolgskontrolle mussten die Studierenden zu jedem Themenkomplex eine Frage beantworten. Eine Teilnahmebescheinigung wurde generiert, sobald die Studierenden mindestens 60 % aller Fragen richtig beantwortet hatten und an einer abschließenden Evaluation teilgenommen haben.

Ergebnisse

Der virtuelle Praktikumstag wurde von 164 Teilnehmern absolviert. Die Evaluationen sind mit einem sehr positiven Gesamturteil ausgefallen – mit einer Schulnote von 1,2. Insgesamt war die Akzeptanz des Ersatzangebotes hoch.

Diskussion

Das virtuelle Format als Alternative zum Präsenzunterricht wurde von den Studierenden sehr gut angenommen. Mit dem virtuellen Praktikumstag wurde eine schnelle und kontaktlose Alternative zum Präsenzunterricht geschaffen.

Isn't here just there without a "t" - to what extent can digital Clinical Case Discussions compensate for the absence of face-to-face teaching?

Objective: COVID-19 challenges curriculum managers worldwide to create digital substitutes for classroom teaching. Case-based teaching formats under expert supervision can be used as a substitute for practical bedside teaching, where the focus is on teaching clinical reasoning skills. Methods: For medical students of LMU and TU Munich, the interactive, case-based, and supervised teaching format of Clinical Case Discussion (CCD) was digitised and implemented as dCCD in their respective curricula. Case discussions were realised as videoconferences, led by a student moderator, and took place under the supervision of a board-certified clinician. To prevent passive participation, additional cognitive activations were implemented. Acceptance, usability, and subjective learning outcomes were assessed in dCCDs by means of a special evaluation concept. Results: With regard to acceptance, students were of the opinion that they had learned effectively by participating in dCCDs (M=4.31; SD=1.37). The majority of students also stated that they would recommend the course to others (M=4.23; SD=1.62). The technical implementation of the teaching format was judged positively overall, but findings for usability were heterogeneous. Students rated their clinical reasoning skills at the end of the dCCDs (M=4.43; SD=0.66) as being significantly higher than at the beginning (M=4.33; SD=0.69), with low effect size, t(181)=-2.352, p=.020, d=0.15. Conclusion: Our evaluation data shows that the dCCD format is well-accepted by students as a substitute for face-to-face teaching. In the next step, we plan to examine the extent to which participation in dCCDs leads to an increase in objectively measured clinical reasoning skills, analogous to a face-to-face CCD with on-site attendance.

Radiation oncology as part of medical education-current status and possible digital future prospects

Purpose

Education as part of medical education is currently changing rapidly. Not least because of the corona crisis, more and more digital teaching formats and innovative teaching concepts such as the flipped classroom model are finding their way into teaching. We analyzed the acceptance and effectiveness of traditional teaching methods as well as the interest in innovative e‑learning methods among medical students in the field of radiation oncology at the medical school of the Technical University of Munich.

Methods

We carried out an online-based survey as well as a knowledge test on all students from two terms who had completed the seminar series of radiation oncology. The survey comprised seven questions on the frequency of participation, acceptance, and judgment of the effectiveness in terms of learning and on a potential use of e‑learning methods using a six-point Likert scale. The test consisted of 10 multiple-choice questions.

Results

Traditional teaching methods are largely accepted by students and most students consider the current learning format to be effective in terms of the teaching effect in the field of radiation oncology. However, only about 50% of all knowledge questions were answered correctly. The possible use of e‑learning methods was judged critically or desired in roughly equal parts among the students.

Conclusion

Traditional seminars enjoy a high level of acceptance among students. Effectiveness with regard to the internalization of content taught, however, should be increased. After all, the future seems to lie in the integration of e‑learning in the form of educational videos and practical seminars.

Assessing clinical reasoning in undergraduate medical students during history taking with an empirically derived scale for clinical reasoning indicators

BACKGROUND

The clinical reasoning process, which requires biomedical knowledge, knowledge about problem-solving strategies, and knowledge about reasons for diagnostic procedures, is a key element of physicians' daily practice but difficult to assess. The aim of this study was to empirically develop a Clinical Reasoning Indicators-History Taking-Scale (CRI-HT-S) and to assess the clinical reasoning ability of advanced medical students during a simulation involving history taking.

METHODS

The Clinical Reasoning Indictors-History Taking-Scale (CRI-HT-S) including a 5-point Likert scale for assessment was designed from clinical reasoning indicators identified in a qualitative study in 2017. To assess indicators of clinical reasoning ability, 65 advanced medical students (semester 10, n = 25 versus final year, n = 40) from three medical schools participated in a 360-degree competence assessment in the role of beginning residents during a simulated first workday in hospital. This assessment included a consultation hour with five simulated patients which was videotaped. Videos of 325 patient consultations were assessed using the CRI-HT-S. A factor analysis was conducted and the students' results were compared according to their advancement in undergraduate medical training.

RESULTS

The clinical reasoning indicators of the CRI-HT-S loaded on three factors relevant for clinical reasoning: 1) focusing questions, 2) creating context, and 3) securing information. Students reached significantly different scores (p < .001) for the three factors (factor 1: 4.07 ± .47, factor 2: 3.72 ± .43, factor 3: 2.79 ± .83). Students in semester 10 reached significantly lower scores for factor 3 than students in their final year (p < .05).

CONCLUSIONS

The newly developed CRI-HT-S worked well for quantitative assessment of clinical reasoning indicators during history taking. Its three-factored structure helped to explore different aspects of clinical reasoning. Whether the CRI-HT-S has the potential to be used as a scale in objective structured clinical examinations (OCSEs) or in workplace-based assessments of clinical reasoning has to be investigated in further studies with larger student cohorts.

(Self-)Reflexion and training of professional skills in the context of "being a doctor" in the future - a qualitative analysis of medical students' experience in LET ME ... keep you real!

Objective: This paper seeks to assess how medical students can be trained in medical studies seminars to examine their own professional role as doctors. The LET ME ... keep you real! university seminar was developed and conducted at the Technical University of Munich. In this context, the following questions will be addressed: How can we assess the contribution of a university seminar to a medical student's own examination of being a doctor? And: What skills are developed in LET ME ... keep you real! that foster medical students' (self-)reflexion? Methods: The source data is statements made by medical students who took part in the LET ME….keep you real! seminar from 2016-2018. Student perspectives were analyzed after five focus group discussions with a total of 26 medical student participants and two individual interviews. Based on the interpretative paradigm and following the credo of a methodological exploration of medical students' lifeworld, their specific learning experience as well as their ability for (self-)reflexion were mapped out. Results: The research questions guiding the assessment of the seminar can be answered as follows: From the students' perspective, the (self-)reflexion triggered and organized by LET ME ... keep you real! can be seen as rehearsing a meta-view. From the students' standpoint, five skills can be identified that make this behavior possible: questioning and doubting,recognizing relevant perspectives, classifying viewpoints, maintaining communal exchanges and deciding on a (different) position. Situatively, these skills are often used in combination and challenge students on an intellectual, communicative and emotional level. Conclusion: The ability to (self-)reflect should be more strongly integrated in university medical training by providing appropriate support, especially since it presents students with specific challenges to (self-)reflexively approach their own future as doctors. The skills mapped out here can be used as orientation to develop seminars on professional (self-)reflexive identity development for medical students.

Entrustable professional activities and facets of competence in a simulated workplace-based assessment for advanced medical students

Background: Competence-based assessment formats in medical education usually focus on individual facets of competence (FOCs). The concept of 'Entrustable Professional Activities' (EPAs) encompasses supervisors' decisions on which level of supervision a trainee requires to perform a professional activity including several FOCs. How the different FOCs as perceived by clinician raters contribute to entrustment decisions is yet unclear.Objective: How do FOC perceptions relate to entrustment-decisions?Methods: Sixty-seven advanced medical students participated in an assessment simulating the first day of a resident physician. Participants were rated by supervisors for seven FOCs and twelve EPAs.Results: There was a positive correlation between FOC and EPA scores. Each EPA displayed a different correlation pattern with FOC ratings.Discussion: For most EPAs high levels of entrustment were associated with high ratings for selected FOCs. The results are in alignment with the assumption that each EPA encompasses a different set of FOCs.Conclusions: In our simulated workplace-based assessment, entrustment decisions for EPAs reflect the FOCs observed in a trainee. Thus, assessment of FOCs alongside with EPA ratings could add to the understanding of factors contributing to entrustment decisions.

[Overview on research in the field of medical education]

Medical education is a relatively young field of research that has been characterized by many innovations over the last 20 years. The main topics were the preparation of students for their medical work and imparting of profound knowledge about scientific contexts in medicine. For a long time, the main focus was on learning the necessary knowledge and skills; however, this is no longer considered sufficient. In order to carry out the work as a physician well, other qualities are also necessary, such as communication, collaboration, professionalism, science and reflectivity. Worldwide these aspects are being increasingly integrated into the learning objectives of medical schools and residency programs. The structure of medical studies at many universities has also changed. So-called vertical integration strengthens the integration of theoretical preclinical training and the clinical phase. This means that in the preclinical phase training is more practice-oriented and in the clinical phase a more structured form of training takes place. In the first years of study, students are prepared for the clinical phase by discussing patient cases and practicing skills in simulation centers. In addition, the clinical working environment is increasingly used as a learning environment. Developments have also been made regarding examinations: in addition to knowledge and skills, students and residents are now also assessed regarding performance in practice. Using more realistic assessments, e.g., Objective Structured Clinical Examinations and Workplace-based Assessments, students are evaluated more on their actual performance in practice. By means of the Entrustable Professional Activities method, students are gradually given more responsibility in order to prepare them for their future tasks.

Improving physicians' surgical ward round competence through simulation-based training

OBJECTIVE

Ward rounds are an essential part of physicians' daily routine. Existing studies suggest that their practical implementation is inconsistent. Therefore, developing interventions to train ward round competence and assessing if they are effective educational tools are crucial goals for research.

METHODS

We analysed a simulation-based tutorial dedicated to fourth-year medical students, including casework and ward round simulation. We investigated the effectiveness of this intervention regarding ward round competence through a randomized controlled trial. Performance was assessed with the modified/validated surgical ward round assessment tool by two blinded and trained raters. Supplementary, motivation during the ward round tutorial was assessed for all students at different time points.

RESULTS

Analysis of the ratings show that, in contrast to the control group (pre: 66.1 vs. post: 64.8 points, p =  0.72), the ward round competence of the intervention group (pre: 62.6 vs. post: 69.6 points, p =  0.0169) improved significantly after participating in the ward round tutorial.

CONCLUSION

The results show that our simulation-based training is an effective way to improve competence of medical students in conducting surgical ward rounds.

PRACTICE IMPLICATIONS

Participation in ward round trainings is a valuable tool to prepare students for their future professional practise.

International mobility of students in the medical disciplines from a comparative perspective

Objective: We analyze the extent to which students of human, veterinary and dental medicine complete study-related stays abroad (frequency, type and duration of stays abroad and countries visited). Furthermore, we investigate the possible correlations between completed stays abroad and the duration of studies, the completion of a doctorate and entering professional life. Methods: The data come from a written cross-sectional survey of 742 graduates of their respective study programs at Bavarian universities. The evaluation was carried out using descriptive and inferential statistical methods. Results: Slightly more than half of the surveyed students completed study-associated stays abroad, with notable differences between the three study programs. The students most frequently completed internships abroad lasting an average of nine weeks. Switzerland was the most common country of destination for the stays abroad. Furthermore, there were no or only weak correlations between stays abroad, the duration of studies and progress towards a doctorate or the commencement of professional employment abroad. There were no correlations with the stress experienced as part of initial employment after graduation. Conclusion: The results clearly indicate that stays abroad are quite usual for students in the medical disciplines and are almost standard in the study of human medicine. The selection of the countries visited indicates that the primary goal of the students' stays abroad is to deepen their competence with a view to later employment in their home country.

Implicit expression of uncertainty - suggestion of an empirically derived framework

BACKGROUND

Uncertainty occurs in physicians' daily work in almost every clinical context and is also present in the clinical reasoning process. The way physicians communicate uncertainty in their thinking process during handoffs is crucial for patient safety because uncertainty has diverse effects on individuals involved in patient care. Dealing with uncertainty and expressing uncertainty are important processes in the development of professional identity of undergraduate medical students. Many studies focused on how to deal with uncertainty and whether uncertainty is explicitly expressed. Hardly any research has been done regarding implicit expression of uncertainty. Therefore, we studied the ways in which medical students in the role of beginning residents implicitly express uncertainty during simulated handoffs.

METHODS

Sixty-seven advanced undergraduate medical students participated in a simulated first day of residency including a consultation hour, a patient management phase with interprofessional interaction, and a patient handoff. We transcribed the videographed handoffs verbatim and extracted language with respect to expression of uncertainty using a grounded theory approach. Text sequences expressing patient related information were analyzed and coded with respect to language aspects which implicitly modified plain information with respect to increasing or decreasing uncertainty. Concepts and categories were developed and discussed until saturation of all aspects was reached.

RESULTS

We discovered a framework of implicit expressions of uncertainty regarding diagnostic and treatment-related decisions within four categories: "Statement", "Assessment", "Consideration", and "Implication". Each category was related to either the subcategory "Actions" or "Results" within the diagnostic or therapeutic decisions. Within each category and subcategory, we found a subset of expressions, which implicitly attenuated or strengthened plain information thereby increasing uncertainty or certainty, respectively. Language that implicitly attenuated plain information belonged to the categories questionable, incomplete, alterable, and unreliable while we could ascribe implicit strengtheners to the categories assertive, adequate, focused, and reliable.

CONCLUSIONS

Our suggested framework of implicit expression of uncertainty may help to raise the awareness for expression of uncertainty in the clinical reasoning process and provide support for making uncertainty explicit in the teaching process. This may lead to more transparent communication processes among health care professionals and eventually to improved patient safety.

Validation of a competence-based assessment of medical students' performance in the physician's role

BACKGROUND

Assessing competence of advanced undergraduate medical students based on performance in the clinical context is the ultimate, yet challenging goal for medical educators to provide constructive alignment between undergraduate medical training and professional work of physicians. Therefore, we designed and validated a performance-based 360-degree assessment for competences of advanced undergraduate medical students.

METHODS

This study was conducted in three steps: 1) Ten facets of competence considered to be most important for beginning residents were determined by a ranking study with 102 internists and 100 surgeons. 2) Based on these facets of competence we developed a 360-degree assessment simulating a first day of residency. Advanced undergraduate medical students (year 5 and 6) participated in the physician's role. Additionally knowledge was assessed by a multiple-choice test. The assessment was performed twice (t1 and t2) and included three phases: a consultation hour, a patient management phase, and a patient handover. Sixty-seven (t1) and eighty-nine (t2) undergraduate medical students participated. 3) The participants completed the Group Assessment of Performance (GAP)-test for flight school applicants to assess medical students' facets of competence in a non-medical context for validation purposes. We aimed to provide a validity argument for our newly designed assessment based on Messick's six aspects of validation: (1) content validity, (2) substantive/cognitive validity, (3) structural validity, (4) generalizability, (5) external validity, and (6) consequential validity.

RESULTS

Our assessment proved to be well operationalised to enable undergraduate medical students to show their competences in performance on the higher levels of Bloom's taxonomy. Its generalisability was underscored by its authenticity in respect of workplace reality and its underlying facets of competence relevant for beginning residents. The moderate concordance with facets of competence of the validated GAP-test provides arguments of convergent validity for our assessment. Since five aspects of Messick's validation approach could be defended, our competence-based 360-degree assessment format shows good arguments for its validity.

CONCLUSION

According to these validation arguments, our assessment instrument seems to be a good option to assess competence in advanced undergraduate medical students in a summative or formative way. Developments towards assessment of postgraduate medical trainees should be explored.

How can communicative competence instruction in medical studies be improved through digitalization?

The teaching of communicative competence plays an increasingly important role in medical education. In addition to traditional teaching formats, such as role-plays with simulated patients, technology-based approaches become more important in medical education. Teaching materials are increasingly augmented by videos of simulated doctor-patient conversations. This combination allows the content of teaching materials to be demonstrated with video or for videos to create a basis for reflection activities. In addition, conversation videos can illustrate different qualities of clinical communication and serve as illustrative material for describing particular issues in more detail. In addition to teaching clinical communicative competence, the assessment of this competence also plays an important role in medical educational research. So far, this has mainly been conducted through direct observation using checklists or rating scales. Relatively little is known about the assessment of communicative competence using standardized online-based tests. Situational Judgement Tests (SJTs) offer a promising approach in this respect. The BMBF-funded (BMBF = Bundesministerium für Bildung und Forschung - Federal Ministry of Education and Research) joint project voLeA (Entwicklung videobasierter Lehr- und Assessmentmodule zur Gesprächskompetenz im Medizinstudium = Development of video-based teaching and assessment modules for communicative competence in medical studies) addresses these two issues. Specifically, the project is engaged in developing e-learning modules to promote communicative competence and an assessment of this competence using an SJT. The present paper focuses on the benefits of technology-based learning and assessment units for clinical communicative competence in medical studies, using the voLeA project as an example.

Teacher questions and student responses in case-based learning: outcomes of a video study in medical education

BACKGROUND

Case-based learning (CBL) is a highly interactive instructional format widely used in medical education. One goal of CBL is to integrate basic biomedical knowledge and its application to concrete patient cases and their clinical management. In this context, we focus the role of teacher questions as triggers for reproductive vs. elaborative student responses. Specifically, our research questions concern the kinds of questions posed by clinical teachers, the kinds of responses given by students, the prediction of student responses based upon teacher questions, and the differences between the two medical disciplines in focus of our study, internal medicine and surgery.

METHODS

We analyse 19 videotaped seminars (nine internal medicine, ten surgery) taught by clinicians and attended by advanced medical students. Multiple raters performed a low-inference rating process using a theory-based categorical scheme with satisfactory interrater-reliability.

RESULTS

We found that medical teachers mostly posed initial (instead of follow-up) questions and that their questions were more often closed (instead of open). Also, more reasoning (than reproductive) questions were posed. A high rate of student non-response was observed while elaborative and reproductive student responses had a similar prevalence. In the prediction context, follow-up reasoning questions were associated with low non-response and many elaborative answers. In contrast, the highest student non-response rate followed open reproduction questions and initial reasoning questions. Most reproductive statements by students were made following closed reproduction questions.

CONCLUSIONS

These results deepen our understanding of interactive, questions-driven medical teaching and provide an empirical basis for clinical teachers to use questions in didactically fruitful ways.

Implementing a logbook on entrustable professional activities in the final year of undergraduate medical education in Germany - a multicentric pilot study

Objectives: The final year of undergraduate medical education (practical year) should foster the transition from undergraduate medical education to graduate medical education. Medical students in the practical year should be able to assume professional tasks, and supervisors should assign these tasks to them. In this pilot study, a curriculum based on the concept of entrustable professional activities (EPAs) was implemented and evaluated in the disciplines of internal medicine, surgery and general practice at four university hospitals. Methods:n=37 medical students and n=17 supervising physicians at four German university hospitals participated in the implementation study for one trimester. For evaluation purposes, we conducted focus group discussions and telephone interviews and analyzed them following qualitative content analysis. Results: We identified five different aspects as important for implementing the EPA curriculum in undergraduate medical education in the German context: Implementation process of the EPA curriculum and required resources, Entrustment process, Feedback sessions with supervisors, Students' and supervisors' role perceptionOverall impact of EPAs on training conditions in the practical year. Conclusion: The study presents a practical implementation of the EPA curriculum in Germany's undergraduate medical education. Besides the need for time and resources, the concept shows good feasibility and fosters a competence-oriented undergraduate medical education in the practical year.

Correlation of online assessment parameters with summative exam performance in undergraduate medical education of pharmacology: a prospective cohort study

BACKGROUND

Learning analytics aims to improve learning outcomes through the systematic measurement and analysis of learning-related data. However, which parameters have the highest predictive power for academic performance remains to be elucidated. The aim of this study was to investigate the correlation of different online assessment parameters with summative exam performance in undergraduate medical education of pharmacology.

METHODS

A prospective study was conducted with a cohort of undergraduate medical students enrolled in a pharmacology course at Technical University of Munich, Germany. After a four-week teaching and learning period, students were given access to an online assessment platform consisting of 440 multiple choice (MC) questions. After 12 days, a final written summative exam was performed. Bivariate correlation and multiple regression analyses were performed for different online assessment parameters as predictors and summative exam performance as dependent variable. Self-perceived pharmacology competence was measured by questionnaires pre- and postintervention.

RESULTS

A total of 224 out of 393 (57%) students participated in the study and were included in the analysis. There was no significant correlation for the parameters "number of logins" (r = 0.01, p = 0.893), "number of MC-questions answered" (r = 0.02, p = 0.813) and "time spent on the assessment platform" (r = - 0.05, p = 0.459) with exam performance. The variable "time per question" was statistically significant (p = 0.006), but correlated negatively (r = - 0.18) with academic performance of study participants. Only "total score" (r = 0.71, p < 0.001) and the "score of first attempt" (r = 0.72, p < 0.001) were significantly correlated with final grades. In a multiple regression analysis, "score first attempt" accounted for 52% of the variation of "score final exam", and "time per question" and "total score" for additional 5 and 1.4%, respectively. No gender-specific differences were observed. Finally, online assessments resulted in improved self-perceived pharmacology competence of students.

CONCLUSION

In this prospective cohort study, we systematically assessed the correlation of different online assessments parameters with exam performance and their gender-neutrality. Our findings may help to improve predictive models of academic performance in undergraduate medical education of pharmacology.

Why hand hygiene is not sufficient: modeling hygiene competence of clinical staff as a basis for its development and assessment

Adhering to hygiene standards in daily clinical work is an important characteristic of qualitatively high-value medical care. In this regards, hand hygiene is often focused on in the literature. From the viewpoint of medical education research, we argue that this focus is too narrow to explain how staff who are working clinically with patients implement and adhere to standards of hygiene across a wide variety of tasks of their daily clinical routine. We present basic features of a differentiated concept of hygiene competence, which includes specialized knowledge, corresponding inner attitudes, and action routines that are customized to the needs of specific situations. Building on that, we present a current simulation-based course concept aimed at developing hygiene competence in medical education. Furthermore, we describe a test instrument that is designed according to the principle of a situational judgment test and that appears promising for the assessment of hygiene competence. The course and the measurement instrument are discussed in regards to their fit to the competence model and the related perspectives for research and teaching.

German Language Adaptation of the Kalamazoo Communication Skills Assessment Form (KCSAF): A Multi-Method Study of Two Cohorts of Medical Students

Abstract. This work investigates the German version of the Kalamazoo Communication Skills Assessment Form (KCSAFd) for three assessment methods: students' self-assessment (KCSAFd-self), assessment by standardised patients (KCSAFd-sPat) and video-assessment by trained raters (KCSAFd-video). Videotaped simulated patient consultations of N = 163 medical students from the first ( n = 97) and the final clinical years ( n = 66) were rated using the KCSAFd. Investigating the psychometric properties of the instrument, we found a two factor-construct with interpersonal and conversational competence. All methods showed good internal consistency and acceptable model fit values. Additionally, we found plausible relationships between the three methods and meaningful differences between the two groups of students.

Medical Trainees' Experiences With Dying and Death

This study investigates medical trainees' experiences with dying and death, by means of semistructured interviews. Nine medical students and nine residents reported a total of 114 experiences. The great majority of these experiences took place during the final year of medical school. The authors identified the latent characteristics, which illustrate an in-depth understanding of the significance of the described experiences. Three main themes emerged: circumstances of death, personal relationship, and one's own role. The age of the dying person, the extent of suffering, time frame and setting, and the patients' behaviors were factors that influence the perceptions of the experiences. The interviewees reported powerful emotional consternation by the patients' deaths with whom they had developed a close relationship. Failure, helplessness, and guilt were negatively associated perceptions of one's own role. This study illustrates the tension between emotional concern and professional detachment. It highlights the continuing existence of a physician image, in which control represents the key issue.

"Imagine Neuro-Oncology"- a one week course with medical and technical students: students' reflections about multidisciplinarity and its practical relevance

Modern medicine requires tight multidisciplinary collaboration and communication among several technical disciplines. Nevertheless, multidisciplinary medical courses are rare and even less often scientifically evaluated. The aim was to evaluate an innovative neuro-oncology course for medical students (MED) and students of science, technology, engineering, and mathematics (STEM) so that they learn and practice mutual understanding, communication and cooperation. 10 MED and 9 STEM were trained together during a one-week-course on the topic of "brain tumor" in imaging, surgical planning, surgery, pathological diagnosis, and adjuvant therapy. Evaluation was undertaken via focus groups and accompanying questionnaires about motivation, course acceptance, and multidisciplinary attitude. Students evaluated course structure, content, and multidisciplinary setting positively and showed high intrinsic motivation. However, the students sensed an "artificial dividing line" between both groups, which was conceptually encouraged by the deliberate temporary subdivision into "monodisciplinary" seminars and during the preparation of presentations. Students' opinion of the concept was generally positive as they learned about the challenges in finding a "common scientific language". Nevertheless, some criticisms were raised concerning the dividing line between the disciplines, which in part led to organizational changes. Even though the current reality may be reflected here, the goal of future interprofessional courses should definitely be to dissolve this dividing line.

Specific feedback makes medical students better communicators

BACKGROUND

Feedback is regarded a key element in teaching communication skills. However, specific aspects of feedback have not been systematically investigated in this context. Therefore, the aim of this study was to investigate the effectiveness of communication skills training (CST) integrating specific, structured and behavioral feedback.

METHODS

We condensed best practice recommendations for feedback in a CST for undergraduate medical students and compared the effect of specific, structured and behavior-orientated feedback (intervention group CST-behav) to general, experience-orientated feedback (CST- exp. as our control group) in a randomized controlled trial (RCT). We investigated changes on communication skills evaluated by independent raters, and evaluated by standardized patients (SP). To do that, every student was video-recorded in a pre and post assessment.

RESULTS

Sixty-six undergraduate medical students participated voluntarily in our study. Randomization did not result in equally skilled groups at baseline, so valid inter-group comparisons were not possible. Therefore, we analyzed the results of 34 students of our intervention group (CST-behav). Five out of seven domains in communication skills as evaluated by independent raters improved significantly, and there was a significant change in the global evaluation by SP.

CONCLUSIONS

Although we were unable to make between-group comparisons, the results of the within group pre-post evaluation suggest that specific feedback helps improve communication skills.

Interprofessional assessment of medical students' competences with an instrument suitable for physicians and nurses

BACKGROUND

Physicians need a set of specific competences to perform well in interprofessional teams in their first year of residency. These competences should be achieved with graduation from medical school. Assessments during undergraduate medical studies are mostly rated by supervisors only. The aim of our study was to compare the rating of core facets of competence of medical students late in their undergraduate training as well as the rating confidence between three different groups of assessors (supervisors, residents, and nurses) in an assessment simulating the first day of residency.

METHODS

Sixty-seven advanced medical students from three different medical schools (Hamburg, Oldenburg and Munich) participated in a 360-degree assessment simulating the first working day of a resident. Each participant was rated by three assessors - a supervisor, a resident and a nurse - in seven facets of competence relevant for the first year of residency: (1) responsibility, (2) teamwork and collegiality, (3) knowing and maintaining own personal bounds and possibilities, (4) structure, work planning and priorities, (5) coping with mistakes, (6) scientifically and empirically grounded method of working, and (7) verbal communication with colleagues and supervisors. Means of all assessed competences and confidences of judgement of the three rating groups were compared. Additionally, correlations between assessed competences and confidence of judgement within each group of raters were computed.

RESULTS

All rating groups showed consistent assessment decisions (Cronbach's α: supervisors = .90, residents = .80, nurses = .78). Nurses assessed the participants significantly higher in all competences compared to supervisors and residents (all p ≤ .05) with moderate and high effect sizes (d = .667-1.068). While supervisors' and residents' ratings were highest for "teamwork and collegiality", participants received the highest rating by nurses for "responsibility". Competences assessed by nurses were strongly positively correlated with their confidence of judgment while supervisors' assessments correlated only moderately with their confidence of judgment in two competences.

CONCLUSIONS

Different professional perspectives provide differentiated competence ratings for medical students in the role of a beginning resident. Rating confidence should be enhanced by empirically derived behavior checklists with anchors, which need to be included in rater training to decrease raters' subjectivity.