Designing the learning of intraprofessional collaboration among medical residents

BACKGROUND

To preserve quality and continuity of care, collaboration between primary-care and secondary-care physicians is becoming increasingly important. Therefore, learning intraprofessional collaboration (intraPC) requires explicit attention during postgraduate training. Hospital placements provide opportunities for intraPC learning, but these opportunities require interventions to support and enhance such learning. Design-Principles guide the design and development of educational activities when theory-driven Design-Principles are tailored into context-sensitive Design-Principles. The aim of this study was to develop and substantiate a set of theory-driven and context-sensitive Design-Principles for intraPC learning during hospital placements.

METHODS

Based on our earlier research, we formulated nine theory-driven Design-Principles. To enrich, refine and consolidate these principles, three focus group sessions with stakeholders were conducted using a Modified Nominal Group Technique. Next, two work conferences were conducted to test the feasibility and applicability of the Design-Principles for developing intraPC educational activities and to sharpen the principles into a final set of Design-Principles.

RESULTS

The theoretical Design-Principles were discussed and modified iteratively. Two new Design-Principles were added during focus group 1, and one more Design-Principle was added during focus group 2. The Design-Principles were categorised into three clusters: (i) Culture: building collaborative relations in a psychologically safe context where patterns or feelings of power dynamics between primary and secondary care physicians can be discussed; (ii) Connecting Contexts: making residents and supervisors mutually understand each other's work contexts and activities; and (iii) Making the Implicit Explicit: having supervising teams act as role models demonstrating intraPC and continuously pursuing improvement in intraPC to make intraPC explicit. Participants were unanimous in their view that the Design-Principles in the Culture cluster were prerequisites to facilitate intraPC learning.

CONCLUSION

This study led to the development of 12 theory-driven and context-sensitive Design-Principles that may guide the design of educational activities to support intraPC learning during hospital placements.

Exploring power dynamics and their impact on intraprofessional learning

BACKGROUND

During postgraduate training, considerable efforts for intraprofessional education are in place to prepare primary care residents (PC residents) and medical specialty residents (MS residents) for intraprofessional collaboration (intraPC). Power dynamics are inherently present in such hierarchical medical contexts. This affects intraPC (learning). Yet little attention has been paid to factors that impact power dynamics. This study aims to explore power dynamics and their impact on intraPC learning between PC residents and MS residents during hospital placements.

METHODS

This study expands on previously published ethnographic research investigating opportunities and barriers for intraPC learning among residents in five Dutch hospitals. We analysed transcripts of observations and in-depth interviews using template analysis. A critical theory paradigm was employed. Discourse analysis additionally informed the data.

RESULTS

We defined five interrelated themes that describe characteristics of power dynamics in intraPC learning during hospital placements: beliefs; power distribution; interaction style; subjection; and fearless learning. Power dynamics operate both within and between the themes: power distribution between PC residents, MS residents and MS supervisors seemed to be an attribution affected by underlying beliefs about professional norms or about other professions; beliefs influenced the way PC residents, MS residents and MS supervisors interacted; power distribution based on inequity could lead to subjection of PC residents; power distribution based on equity could lead to fearless learning; and open interactions enabled fearless intraPC learning.

CONCLUSIONS

Power dynamics have an impact on intraPC learning among residents in hospitals. Constructive power dynamics occur when power distribution is based on equity, combined with sincere open interactions, actively inviting each other into discussions and enlisting the support of MS supervisors to foster fearless learning. This can be achieved by creating awareness of implicit beliefs and making them explicit, recognising interaction that encourages intraPC learning and creating policies that support fearless intraPC learning.

Chances for learning intraprofessional collaboration between residents in hospitals

CONTEXT

Intraprofessional collaboration (intraPC) between primary care (PC) doctors and medical specialists (MSs) is becoming increasingly important. Patient safety issues are often related to intraPC. In order to equip doctors well for their task of providing good quality and continuity of care, intraPC needs explicit attention, starting in postgraduate training. Worldwide, PC residents undertake a hospital placement during their postgraduate training, where they work in proximity with MS residents. This placement offers the opportunity to learn intraPC. It is yet unknown whether and how residents learn intraPC and what barriers to and opportunities for exist in learning intraPC during hospital placements.

METHODS

We performed an ethnographic non-participatory observational study in three emergency departments and three geriatric departments of five hospitals in the Netherlands. This was followed by 42 in-depth interviews with the observed residents and supervisors. The observations were used to feed the questions for the in-depth interviews. We analysed the interviews iteratively following the data collection using template analysis.

RESULTS

Hospital wards are rich in opportunities for learning intraPC. These opportunities, however, are seldom exploited for various reasons: intraPC receives limited attention when formulating placement goals, so purposeful learning of intraPC hardly takes place; residents lack awareness of the learning of intraPC; MS residents are not accustomed to searching for expertise from PC residents; PC residents adapt to the MS role and they contribute very little of their PC knowledge, and power dynamics in the hospital department negatively influence the learning of intraPC. Therefore, improvements in mindset, professional identity and power dynamics are crucial to facilitate and promote intraPC.

CONCLUSIONS

Intraprofessional collaboration is not learned spontaneously during hospital placements. To benefit from the abundant opportunities to learn intraPC, adjustments to the set-up of these placements are necessary. Learning intraPC is promoted when there is a collaborative culture, hierarchy is limited, and there is dedicated time for intraPC and support from the supervisor.

The use of SBAR as a structured communication tool in the pediatric non-acute care setting: bridge or barrier for interprofessional collaboration?

SBAR (Situation, Background, Assessment and Recommendation) is a structured method developed for communicating critical information that requires immediate action. In 2016 the SBAR tool was introduced at the Amalia Children's Hospital in the Netherlands to improve communication between healthcare workers. Despite formal training and the introduction of aids to facilitate implementation, observed adherence to the tool was low. A qualitative study was undertaken to study the use of SBAR by pediatric residents and nurses in the non-acute clinical care setting of an academic children's hospital. Semi-structured focus group sessions were conducted and qualitatively analyzed using a constructed coding template to search for facilitators and barriers in the use of SBAR by different professionals. We found professionals' use of SBAR was influenced by departmental, cultural, and individual factors. Important themes for effective implementation and use of SBAR in an interprofessional setting, like situation dependency, learning climate and professional identity had not been addressed during the initial implementation. To facilitate SBAR's use it is important to identify professionals' needs to use the tool effectively, to take into account how tasks and responsibilities are perceived by different professions, and to stimulate interprofessional feedback and role modeling.

Do different curriculum aligned selection procedures admit students with different personality profiles to medical school?

BACKGROUND

Medical schools aim to contribute to a pool of doctors who are ready for a future practice that will be ever-changing requiring collaboration skills and lifelong learning. They adapt their curricula and selection procedures to fulfil this responsibility. This study aims to determine whether two different selection procedures in one medical school, both matching the key characteristics of the subsequent curricula (one traditional, knowledge-based, and one recently designed for self directed learning and focusing on practice), select students with different personality traits as a side-effect. This perspective was chosen as personality has been related to the CanMeds competencies, innovation capacities, medical school performance and medical professional success.

METHODS

A total of 621 students admitted through the new or the traditional selection procedure were invited to complete a Big Five Inventory questionnaire at the start of their Bachelor's programme. Using ANCOVA, we compared Big Five traits of students admitted through the new selection procedure (n = 196) and the traditional selection procedure (n = 425).

RESULTS

The group of students admitted through the procedure matching the newly designed curriculum had a lower mean score on neuroticism (p < .01) and higher mean scores on conscientiousness, extraversion, agreeableness and openness (p < .001) than the other group.

CONCLUSIONS

The findings of the current study indicate that the medical school population is influenced in terms of personality traits as a side-effect of a changing selection procedure. We recommend studying this mechanism and its implications further and using it more consciously in selection procedure design.

Selection as a learning experience: an exploratory study

INTRODUCTION

Research on selection for medical school does not explore selection as a learning experience, despite growing attention for the learning effects of assessment in general. Insight in the learning effects allows us to take advantage of selection as an inclusive part of medical students' learning process to become competent professionals. The aims of this study at Radboud University Medical Center, the Netherlands, were 1) to determine whether students have learning experiences in the selection process, and, if so, what experiences; and 2) to understand what students need in order to utilize the learning effects of the selection process at the start of the formal curriculum.

MATERIALS AND METHODS

We used focus groups to interview 30 students admitted in 2016 about their learning experiences in the selection process. Thematic analysis was used to explore the outcomes of the interviews and to define relevant themes.

RESULTS

In the selection process, students learned about the curriculum, themselves, their relation to others, and the profession they had been selected to enter, although this was not explicitly perceived as learning. Students needed a connection between selection and the curriculum as well as feedback to be able to really use their learning experiences for their further development.

DISCUSSION

Medical school selection qualifies as a learning experience, and students as well as medical schools can take advantage of this. We recommend a careful design of the selection procedure, integrating relevant selection learning experiences into the formal curriculum, providing feedback and explicitly approaching the selection and the formal curriculum as interconnected contributors to students' development.

The effects of a non-cognitive versus cognitive admission procedure within cohorts in one medical school

In medical school selection, non-cognitive performance in particular correlates with performance in clinical practice. It is arguable, therefore, that selection should focus on non-cognitive aspects despite the predictive value of prior cognitive performance for early medical school performance. The aim of this study at Radboud University Medical Center, the Netherlands, is to determine the effects of admitting students through an autonomous non-cognitive procedure on early medical school performance. We compared their performance to the performance of students selected through an autonomous cognitive selection procedure, enrolling in the Bachelor's curriculum simultaneously. 574 students (2013 and 2014 cohorts), admitted through non-cognitive selection (based on portfolio, CASPer and MMI, n = 135) or cognitive selection (curriculum sample selection, n = 439) were included in the study. We compared dropout rates, course credits and grades, using logistic and linear regression. The dropout rate was the highest in the non-cognitive selection group (p < 0.001). Students admitted through non-cognitive selection more often obtained the highest grade for the nursing attachment (p = 0.02) and had a higher mean grade for the practical clinical course in year 3 (p = .04). No differences in course grades were found. The results indicate that students perform best on the elements of the curriculum that are represented most strongly in the selection procedure they had participated in. We recommend the use of curriculum sample procedures, resembling the early medical school curriculum,-whether it has a more cognitive or a more non-cognitive focus-, to select the students who are likely to be successful in the subsequent curriculum.

Successfully sustaining sex and gender issues in undergraduate medical education: a case study

Although several projects have addressed the importance of gender health issues in medical education, the sustainability of change efforts in medical education has rarely been addressed. Understanding the possible facilitators or barriers to sustainability may help to develop future interventions that are effective in maintaining gender health issues as a topic in medical curricula. The aim of this study is to provide a longitudinal evaluation of changes regarding gender health issues that occurred in the past decade and the factors that influenced this process. The coursebooks of eight theoretical courses of the Nijmegen medical curriculum were screened on the basis of criteria for an integrated gender perspective in medical education. To assess the sustainability of gender health issues, the screening results from 2014 were compared with those of a similar project in 2005. In addition, open interviews were conducted with eight coordinators to identify facilitators and barriers influencing the sustainability of gender health issues. Analysis showed that, over the past decade, the implementation of gender health issues was mainly sustained and additional changes were made, resulting in an ongoing gender perspective in the Nijmegen medical curriculum. The coordinators mentioned several factors that influenced the sustainability of implementation in medical education: coordinators' and teachers' gender-sensitive attitude, competing demands, the presence of sex and gender in learning objectives, examinations and evaluation, organizational support and curriculum revisions. Our findings suggest that, in implementing sex and gender in medical education, medical faculties need to focus on top-down support in incorporating sex and gender into core objectives and time spent on incorporating sex and gender into medicine, and on the continuous training of teaching staff.

Evaluation of clinical teaching quality in competency-based residency training in Lithuania

BACKGROUND AND AIM

In 2013, all residency programs at the Lithuanian University of Health Sciences were renewed into the competency-based medical education curriculum (CBME). In 2015, we implemented the validated EFFECT questionnaire together with the EFFECT-System for quality assessment of clinical teaching in residency training. The aim of this study was to investigate the influence of characteristics of the resident (year of training) and clinical teacher (gender, age, and type of academic position) on teaching quality, as well as to assess areas for teaching quality improvement.

MATERIALS AND METHODS

Residents from 7 different residency study programs filled out 333 EFFECT questionnaires evaluating 146 clinical teachers. We received 143 self-evaluations of clinical teachers using the same questionnaire. Items were scored on a 6-point Likert scale. Main outcome measures were residents' mean overall (MOS), mean subdomain (MSS) and clinical teachers' self-evaluation scores. The overall comparisons of MOS and MSS across study groups and subgroups were done using Student's t test and ANOVA for trend. The intraclass correlation coefficient (ICC) was calculated in order to see how residents' evaluations match with self-evaluations for every particular teacher. To indicate areas for quality improvement items were analyzed subtracting their mean score from the respective (sub)domain score.

RESULTS

MOS for domains of "role modeling", "task allocation", "feedback", "teaching methodology" and "assessment" valued by residents were significantly higher than those valued by teachers (P<0.01). Teachers who filled out self-evaluation questionnaires were rated significantly higher by residents in role modeling subdomains (P<0.05). Male teachers in (sub)domains "role modeling: CanMEDS roles and reflection", "task allocation", "planning" and "personal support" were rated significantly higher than the female teachers (P<0.05). Teachers aged 40 years or younger were rated higher (P<0.01). Residents ratings by type of teachers' academic position almost in all (sub)domains differed significantly (P<0.05). No correlation observed between MOS of a particular teacher and MOS as rated by residents (ICC=0.055, P=0.399). The main areas for improvement were "feedback" and "assessment".

CONCLUSIONS

Resident evaluations of clinical teachers are influenced by teachers' age, gender, year of residency training, type of teachers' academic position and whether or not a clinical teacher performed self-evaluation. Development of CBME should be focused on the continuous evaluation of quality, clinical teachers educational support and the implementation of e-portfolio.

Integrating technical and non-technical skills coaching in an acute trauma surgery team training: Is it too much?

OBJECTIVE

Research on effective integration of technical and non-technical skills in surgery team training is sparse. In a previous study we found that surgical teachers predominantly coached on technical and hardly on non-technical skills during the Definitive Surgical and Anesthetic Trauma Care (DSATC) integrated acute trauma surgery team training. This study aims to investigate whether the priming of teachers could increase the amount of non-technical skills coaching during such a training.

DESIGN

Coaching activities of 12 surgical teachers were recorded on audio and video. Six teachers were primed on non-technical skills coaching prior to the training. Six others received no priming and served as controls. Blind observers reviewed the recordings of 2 training scenario's and scored whether the observed behaviors were directed on technical or non-technical skills. We compared the frequency of the non-technical skills coaching between the primed and the non-primed teachers and analyzed for differences according to the trainees' level of experience.

SETTING

Surgical teachers coached trainees during the highly realistic DSATC integrated acute trauma surgery team training. Trainees performed damage control surgery in operating teams on anesthetized porcine models during 6 training scenario's.

PARTICIPANTS

Twelve experienced surgical teachers participated in this study.

RESULTS

Coaching on non-technical skills was limited to about 5%. The primed teachers did not coach more often on non-technical skills than the non-primed teachers. We found no differences in the frequency of non-technical skills coaching based on the trainees' level of experience.

CONCLUSION

Priming experienced surgical teachers does not increase the coaching on non-technical skills. The current DSATC acute trauma surgery team training seems too complex for integrating training on technical and non-technical skills.

COMPETENCIES

Patient care, Practice based learning and improvement.

Validation of the EFFECT questionnaire for competence-based clinical teaching in residency training in Lithuania

BACKGROUND AND AIM

In 2013, all residency programs at the Lithuanian University of Health Sciences were renewed into a competency-based medical education curriculum. To assess the quality of clinical teaching in residency training, we chose the EFFECT (evaluation and feedback for effective clinical teaching) questionnaire designed and validated at the Radboud University Medical Centre in the Netherlands. The aim of this study was to validate the EFFECT questionnaire for quality assessment of clinical teaching in residency training.

MATERIALS AND METHODS

The research was conducted as an online survey using the questionnaire containing 58 items in 7 domains. The questionnaire was double-translated into Lithuanian. It was sent to 182 residents of 7 residency programs (anesthesiology reanimathology, cardiology, dermatovenerology, emergency medicine, neurology, obstetrics and gynecology, physical medicine and rehabilitation). Overall, 333 questionnaires about 146 clinical teachers were filled in. To determine the item characteristics and internal consistency (Cronbach's α), the item and reliability analyses were performed. Furthermore, confirmatory factor analysis (CFI) was performed using a model for maximum-likelihood estimation.

RESULTS

Cronbach's α within different domains ranged between 0.91 and 0.97 and was comparable with the original version of the questionnaire. Confirmatory factor analysis demonstrated satisfactory model-fit with CFI of 0.841 and absolute model-fit RMSEA of 0.098.

CONCLUSIONS

The results suggest that the Lithuanian version of the EFFECT maintains its original validity and may serve as a valid instrument for quality assessment of clinical teaching in competency-based residency training in Lithuania.

The effect of curriculum sample selection for medical school

In the Netherlands, students are admitted to medical school through (1) selection, (2) direct access by high pre-university Grade Point Average (pu-GPA), (3) lottery after being rejected in the selection procedure, or (4) lottery. At Radboud University Medical Center, 2010 was the first year we selected applicants. We designed a procedure based on tasks mimicking the reality of early medical school. Applicants took an online course followed by an on-site exam, resembling courses and exams in early medical school. Based on the exam scores, applicants were selected or rejected. The aim of our study is to determine whether curriculum sample selection explains performance in medical school and is preferable compared to selection based on performance in secondary school. We gathered data on the performance of students of three consecutive cohorts (2010-2012, N = 954). We compared medical school performance (course credits and grade points) of selected students to the three groups admitted in other ways, especially lottery admissions. In regression analyses, we controlled for out of context cognitive performance by adjusting for pu-GPA. Selection-admitted students outperformed lottery-admitted students on most outcome measures, unadjusted as well as adjusted for pu-GPA (p ≤ 0.05). They had higher grade points than non-selected lottery students, both unadjusted and adjusted for pu-GPA (p ≤ 0.025). Adjusted for pu-GPA, selection-admitted students and high-pu-GPA students performed equally. We recommend this selection procedure as it adds to secondary school cognitive performance for the general population of students, is efficient for large numbers of applicants and not labour-intensive.

Teaching adjuvant endocrine breast cancer treatment to medical students

BACKGROUND

In undergraduate medical education, students are supposed to acquire knowledge and understanding about the basic principles of adjuvant breast cancer treatment. The best education method in this context is unknown. In this randomised study we assessed the effect of designing a patient education poster on knowledge, perceived participation and students' satisfaction compared with case-oriented education concerning endocrine therapy for breast cancer patients.

METHODS

This study was conducted in the Bachelor Oncology Course for undergraduate students in Medical Science of the Radboud University Nijmegen Medical Centre. In the experimental group, students designed and created a patient education poster in small groups. In the control group, students answered case-based questions in small groups. Knowledge was tested at different moments using multiple-choice questions. To assess perceived participation and satisfaction, students filled out questionnaires.

RESULTS

329 students participated in the study. No difference in knowledge was observed between the experimental and control group. However, students in the control group reported a higher perceived participation and satisfaction compared with the students in the experimental group (p<0.05).

CONCLUSION

In this study, working on case-based questions was preferred compared with designing a patient education poster in terms of students' perceived participation and satisfaction. Working on case-based questions may be appreciated by medical students as most relevant for their future profession. We advocate more attention to the importance of patient education in the medical curriculum, to help students realise the relevance of this aspect of medical profession.

Evaluation and feedback for effective clinical teaching in postgraduate medical education: validation of an assessment instrument incorporating the CanMEDS roles

BACKGROUND

Providing clinical teachers in postgraduate medical education with feedback about their teaching skills is a powerful tool to improve clinical teaching. A systematic review showed that available instruments do not comprehensively cover all domains of clinical teaching. We developed and empirically test a comprehensive instrument for assessing clinical teachers in the setting of workplace learning and linked to the CanMEDS roles.

METHODS

In a Delphi study, the content validity of a preliminary instrument with 88 items was studied, leading to the construction of the EFFECT (evaluation and feedback for effective clinical teaching) instrument. The response process was explored in a pilot test and focus group research with 18 residents of 6 different disciplines. A confirmatory factor analyses (CFA) and reliability analyses were performed on 407 evaluations of 117 supervisors, collected in 3 medical disciplines (paediatrics, pulmonary diseases and surgery) of 6 departments in 4 different hospitals.

RESULTS

CFA yielded an 11 factor model with a good to excellent fit and internal consistencies ranged from 0.740 to 0.940 per domain; 7 items could be deleted.

CONCLUSION

The model of workplace learning showed to be a useful framework for developing EFFECT, which incorporates the CanMEDS competencies and proved to be valid and reliable.