Exploring the Construct of Psychological Safety in Medical Education

Proactive personality and critical thinking in Chinese medical students: The moderating effects of psychological safety and academic self-efficacy

Objectives

This study aimed to identify the relationship among proactive personality, psychological safety, academic self-efficacy and critical thinking, and to further explore whether psychological safety and academic self-efficacy could be a moderator in the association between proactive personality and critical thinking among Chinese medical students.

Materials and methods

The cross-sectional study was carried out from October to December 2020 in China. Totally, 5,920 valid responses were collected at four Chinese medical universities. Critical thinking, proactive personality, psychological safety, academic self-efficacy and demographic factors were assessed through questionnaires. Hierarchical multiple regression was used to identify interrelationship clusters among variables. Simple slope analyses were performed to explore the moderating effects of psychological safety and academic self-efficacy.

Results

The mean score of critical thinking among medical students was 3.85 ± 0.61. Proactive personality, psychological safety, and academic self-efficacy were shown to be important factors for critical thinking. Psychological safety and academic self-efficacy moderated the association between proactive personality and critical thinking. A simple slope analysis showed that high psychological safety and academic self-efficacy weakened the impact of proactive personality on critical thinking.

Conclusion

Most medical students surveyed in China might have relatively high levels of critical thinking. Psychological safety and academic self-efficacy moderated the association between proactive personality and critical thinking. More interventions related to psychological safety and academic self-efficacy will be helpful to improve critical thinking among Chinese medical students.

Gender Differences in Psychological Safety, Academic Safety, Cognitive Load, and Debriefing Satisfaction in Simulation-Based Learning

BACKGROUND

As there is an increasing trend in the number of male-identifying learners in undergraduate nursing education, a need exists to identify the gender differences in learners' perceptions regarding simulation-based learning.

PURPOSE

This study aimed to identify the gender differences in psychological safety, academic safety, cognitive load, and debriefing satisfaction in simulation-based nursing education.

METHODS

A cross-sectional descriptive survey was implemented with 97 female and 95 male nursing students. Data were analyzed using Mann-Whitney U tests or independent-samples t tests.

RESULTS

Female nursing students reported a lower academic safety and higher intrinsic load than male nursing students. Male nursing students perceived a higher germane load than female nursing students.

CONCLUSIONS

The significance of the present study was the identification of gender differences in participant perception of the simulation learning experience for effective simulation design.

Educational Safety for the Surgical Learner

Psychological safety is known to improve team performance and organizational learning. The related concept of "educational safety" has recently emerged to describe an environment in which learners can unreservedly focus on learning and professional growth, without worrying about the potential repercussions of interpersonal risk-taking. Educational safety is crucial for optimal learning in clinical environments, and yet is difficult to establish due to constant performance assessment, fear of failure, and pervasive hierarchies. In this perspective, we propose a framework for conceptualizing educational safety in surgical learning environments, and explore current threats to educational safety. We also discuss strategies for combating these threats, as well as the importance of further research to evaluate the impact of educational safety on surgical learning outcomes.

Ten-year mixed-method evaluation of prelicensure health professional student self-reported learning in an interfaculty pain curriculum

Introduction:

Student perspectives on interprofessional pain education are lacking.

Objectives:

The purpose of this study was to evaluate ratings of knowledge acquisition and effective presentation methods for prelicensure health professional students attending the University of Toronto Centre for the Study of Pain Interfaculty Pain Curriculum (Canada).

Methods:

A 10-year (2009–2019) retrospective longitudinal mixed-methods approach comprising analysis and integration of quantitative and qualitative data sets was used to evaluate 5 core University of Toronto Centre for the Study of Pain Interfaculty Pain Curriculum learning sessions.

Results:

A total of 10, 693 students were enrolled (2009–2019) with a mean annual attendance of 972 students (±SD:102). The mean proportion of students rating “agree/strongly agree” for knowledge acquisition and effective presentation methods across sessions was 79.3% (±SD:3.4) and 76.7% (±SD:6.0), respectively. Knowledge acquisition or presentation effectiveness scores increased, respectively, over time for 4 core sessions: online self-study pain mechanisms module (P = 0.03/P < 0.001), online self-study opioids module (P = 0.04/P = 0.019), individually selected in-person topical pain sessions (P = 0.03/P < 0.001), and in-person patient or interprofessional panel session (P = 0.03). Qualitative data corroborated rating scores and expanded insight into student expectations for knowledge acquisition to inform real-world clinical practice and interprofessional collaboration; presentation effectiveness corresponded with smaller session size, individually selected sessions, case-based scenarios, embedded knowledge appraisal, and opportunities to meaningfully interact with presenters and peers.

Conclusion:

This study demonstrated positive and increasing prelicensure student ratings of knowledge acquisition and effective presentation methods across multifaceted learning sessions in an interfaculty pain curriculum. This study has implications for pain curriculum design aimed at promoting students' collaborative, patient-centered working skills.

See commentary: Trouvin A-P. “Ten-year mixed method evaluation of prelicensure health professional student self-reported learning in an interfaculty pain curriculum”: a view on pain education. PAIN Rep 2022;7:e1031.

Students attending learning sessions at the University of Toronto Interfaculty Pain Curriculum (2009–2019) in Toronto, Canada, self-report high ratings of knowledge acquisition and effective presentation methods.

Practice what you teach: An approach to integrate airway education for experienced anesthesia clinicians

BACKGROUND

The COVID-19 pandemic has disrupted clinician education. To address this challenge, our divisional difficult airway program (AirEquip) designed and implemented small-group educational workshops for experienced clinicians. Our primary aim was to test the feasibility and acceptability of a small-group, flexible-curriculum skills workshop conducted during the clinical workday. Secondary objectives were to evaluate whether our workshop increased confidence in performing relevant skills and to assess the work-effort required for the new program.

METHODS

We implemented a 1:1 and 2:1 (participant to facilitator ratio) airway skills workshop for experienced clinicians during the workday. A member of the AirEquip team temporarily relieved the attendee of clinical duties to facilitate participation. Attendance was encouraged but not required. Feasibility was assessed by clinician attendance, and acceptability was assessed using three Likert scale questions and derived from free-response feedback. Participants completed pre and postworkshop surveys to assess familiarity and comfort with various aspects of airway management. A work-effort analysis was conducted and compared to the effort to run a previously held larger-format difficult airway conference.

RESULTS

Fifteen workshops were conducted over 7 weeks; members of AirEquip were able to temporarily assume participants' clinical duties. Forty-seven attending anesthesiologists and 17 CRNAs attended the workshops, compared with six attending anesthesiologists and five CRNAs who attended the most recent larger-format conference. There was no change in confidence after workshop participation, but participants overwhelmingly expressed enthusiasm and satisfaction with the workshops. The number of facilitator person-hours required to operate the workshops (105 h) was similar to that required to run a single all-day larger-format conference (104.5 h).

CONCLUSION

It is feasible and acceptable to incorporate expert-led skills training into the clinical workday. Alongside conferences and large-format instruction, this modality enhances the way we are able to share knowledge with our colleagues. This concept can likely be applied to other skills in various clinical settings.

Effectiveness of the use of concept maps and simulated cases as a teaching-learning strategy in enhancing the learning confidence of baccalaureate nursing students: A qualitative approach

BACKGROUND

Didactic lectures and exam-oriented learning can lead to students becoming passive learners who rely on rote memory. This learning style negatively impacts their ability to cultivate the core nursing values and critical thinking.

OBJECTIVES

This study aimed to investigate the impact of a concept mapping teaching-learning strategy on undergraduate nursing students' ability to integrate theoretical biosciences knowledge into care practice and on their skills in critical thinking and teamwork.

METHODS

A qualitative research design was adopted. A course entitled Evaluation and Analysis of Adult Nursing Cases was developed based on a concept mapping strategy involving 24 simulated cases relevant to medical and surgical nursing. The participants were students from the two-year undergraduate nursing programme at a university in Taiwan. Data were collected from September 2020 to February 2021. Qualitative data were collected from semi-structured face-to-face interviews with 20 students and from 100 reflective reports on students' learning journeys. The data were analysed using qualitative content analysis.

RESULTS

Two major themes were identified: (1) changes in learning style and thinking and (2) rewards from learning. The participants reported that their learning style had changed from reliance on rote learning to image memory, and their thinking process from linear (cause-effect) to multifaceted thinking at different levels. The teaching and learning strategies contributed to feelings of ability advancement and psychological safety, which led to learning achievement and confidence.

CONCLUSION

The use of a concept mapping strategy and simulated cases enhanced students' learning by enabling them to integrate theoretical knowledge and improve their thinking abilities. The teaching and learning strategies helped participants in learning about psychological safety and increased their learning confidence.

Growth, Engagement, and Belonging in the Clinical Learning Environment: the Role of Psychological Safety and the Work Ahead

Psychological safety is the perception that an environment is safe for interpersonal risk taking, exposing vulnerability, and contributing perspectives without fear of being shamed, blamed, or ignored. The presence of psychological safety has been associated with improved team learning and innovation, leader inclusivity, and team members' sense of belonging. In medical education, psychological safety has additional benefits: it allows learners to be present in the moment and to focus on the tasks at hand, and reduces trainee focus on image. Several key features of psychologically safe environments have already been described, including the presence of high-quality relationships, the absence of social positioning, a learner-driven and flexible learning agenda, the lack of formal assessment, and time for debriefing. However, many of the structures and cultural traditions in medical education are in clear opposition to these features. This paper describes the current barriers to psychological safety in medical education, and sets out an agenda for change. In accordance with benefits seen in other sectors, we anticipate that an emphasis on relationships and psychological safety will support the learning, inclusion, and success of medical trainees.

Learning team-based quality improvement in a virtual setting: a qualitative study

OBJECTIVE

The objective was to explore students' perceptions of learning quality improvement (QI) in a virtual setting and identify factors that promote or inhibit virtual learning.

DESIGN

We used an exploratory case study design with focus group interviews. The data were analysed using a thematic analysis approach, with an analytical framework derived from activity theory and Bloom's revised taxonomy of six categories of cognitive processes of learning.

SETTING

Postgraduate students participating in a virtual 1-day simulation module to learn QI at two universities in Norway.

PARTICIPANTS

Four focus groups with a total of 12 participants.

RESULTS

The students' descriptions of learning outcomes indicate that the learning activity involved a variety of cognitive activities, including higher-order cognitive processes. We identified three themes pertaining to the students' experiences of the virtual learning activity: learning through active participation, constructing a virtual learning opportunity and creating a virtual learning environment. The students described that participation and active engagement led to a greater understanding and an integration of theory and practical improvement skills. They reported that to engage in the virtual learning opportunity, it was necessary to create a learning environment where they felt psychologically safe.

CONCLUSION

Our findings indicate that it is possible to facilitate collaborative learning integrating theoretical knowledge and practical skills in a virtual setting. Students experienced that engaging in the virtual learning activity contributed to the integration of theoretical knowledge and practical skills. Psychological safety seems to be important for students' engagement in the virtual learning activity. A virtual learning environment alters prior common norms for interaction based on physical presence, which in turn affect students feeling of psychological safety. Educators need to be aware of this and facilitate a virtual learning environment where students feel comfortable to engage.

Medical residents and attending physicians’ perceptions of feedback and teaching in the United States: a qualitative study

PURPOSE

Residents and attendings agree on the importance of feedback to resident education. However, while faculty report providing frequent feedback, residents often do not perceive receiving it, particularly in the context of teaching. Given the nuanced differences between feedback and teaching, we aimed to explore resident and attending perceptions of feedback and teaching in the clinical setting.

METHODS

We conducted a qualitative study of internal medicine residents and attendings from December 2018 through March 2019 at the Massachusetts General Hospital to investigate perceptions of feedback in the inpatient clinical setting. Residents and faculty were recruited to participate in focus groups. Data were analyzed using thematic analysis to explore perspectives and barriers to feedback provision and identification.

RESULTS

Five focus groups included 33 total participants in 3 attending (n=20) and 2 resident (n=13) groups. Thematic analysis of focus group transcripts identified 7 themes which organized into 3 thematic categories: (1) disentangling feedback and teaching, (2) delivering high-quality feedback, and (3) experiencing feedback in the group setting. Residents and attendings highlighted important themes in discriminating feedback from teaching. They indicated that while feedback is reactive in response to an action or behavior, teaching is proactive and oriented toward future endeavors.

CONCLUSION

Confusion between the critical concepts of teaching and feedback may be minimized by allowing them to each have their intended impact, either in response to prior events or aimed toward those yet to take place.

Impostor Phenomenon and Its Relationship to Self-Esteem Among Students at an International Medical College in the Middle East: A Cross Sectional Study

The atmosphere of constant scrutiny of academic ability that prevails in medical colleges may leave some students at risk of expressing feelings of intellectual fraudulence and phoniness. Impostor phenomenon (IP) traits have been associated with anxiety, depression, job dissatisfaction, and poor professional performance. Internationally trained junior doctors exhibit stronger IP feelings than colleagues trained within their own country of citizenship. These feelings may develop during student life. International universities are diverse and complex environments where students may be emersed in a cultural milieu alien to their societies of origin, leading to feelings of isolation. Individuals with IP traits often perceive themselves as the “only one” experiencing this phenomenon, resulting in further isolation and negative self-evaluation, especially among women and underrepresented minorities. IP has also been linked to low self-esteem among students. This study assessed the prevalence of IP and its relationship to self-esteem among students at a campus of a European medical college with a large international student body situated in the Middle East. The self-administered questionnaires: Clance's Impostor Phenomenon Scale (CIPS) and Rosenberg's Self-Esteem Scale (RSES) were completed by 290 medical students (58.3% females). Participants' median (range) age was 19 years (16–35). Students were of 28 different nationalities; the largest proportions were from Gulf Corporation Council (GCC) countries. The prevalence of low self-esteem was 18.6%, while 45.2% of the students demonstrated traits suggestive of IP. There was a strongly negative correlation between CIPS and RSES (r = −0.71). No significant gender differences were found in IP. Similarly, no differences in IP were found when comparing between age groups, previous experience in higher education or year of study. Multivariate analysis showed that students from GCC countries had higher levels of self-esteem relative to students from other regions. Low self-esteem was a strong predictor of IP. Country of origin may influence students' self-esteem studying in international university settings.

The affective component of learning in simulation-based education - facilitators' strategies to establish psychological safety and accommodate nursing students' emotions

Background

Active learning situations such as simulation-based education (SBE) are found to trigger a wide range of emotions among students. Facilitators have an important educational role in SBE which include being attentive and adaptive to students’cognitive and affective responses. Although the importance of emotions in SBE is recognized in facilitator guidelines, little is known about how facilitators accommodate student affect. Hence, this study explores facilitators’ strategies for addressing students’ emotions in SBE.

Method

Individual interviews with nine facilitators were performed and transcripts were subjected to qualitative analyses in accordance with interpretive description approach.

Results

Findings show that facilitators are attentive to and continuously assess students’ emotional responses in SBE. Both positive emotions, such as interest and surprise, and negative emotions such as anxiety are cultivated, yet adapted to the perceived needs of the individual student. Psychological safety was seen as a prerequisite for optimal learning, regardless of the students’ previous level of knowledge. Furthermore, significant learning was seen as something that might also arise from uncomfortable experiences, such as students realizing their own mistakes or uncertainty. Hence facilitators were found to balance levels of difficulty, emotional arousal and psychological safety during the various phases of SBE.

Conclusion

Facilitators recognize the emotional dimension of learning in SBE and have numerous strategies for accommodating students’ emotions. This study highlights the complexity of the facilitator’s role in adapting training to individual cognitive and emotional needs. These findings have implications for facilitator training which should include awareness of the role of emotions in learning and strategies for observing and accommodating training to meet emotional needs.

Residents as Research Subjects: Balancing Resident Education and Contribution to Advancing Educational Innovations

BACKGROUND

Research in education advances knowledge and improves learning, but the literature does not define how to protect residents' rights as subjects in studies or how to limit the impact of their participation on their clinical training.

OBJECTIVE

We aimed to develop a consensual framework on how to include residents as participants in education research, with the dual goal of protecting their rights and promoting their contributions to research.

METHODS

A nominal group technique approach was used to structure 3 iterative meetings held with the pre-existing residency training program committee and 7 invited experts between September 2018 and April 2019. Thematic text analysis was conducted to prepare a final report, including recommendations.

RESULTS

Five themes, each with recommendations, were identified: (1) Freedom of participation: participation, non-participation, or withdrawal from a study should not interfere with teacher-learner relationship (recommendation: improve recruitment and consent forms); (2) Avoidance of over-solicitation (recommendation: limit the number of ongoing studies); (3) Management of time dedicated to participation in research (recommendations: schedule and proportion of time for study participation); (4) Emotional safety (recommendation: requirement for debriefing and confidential counseling); and (5) Educational safety: data collected during a study should not influence clinical assessment of the resident (recommendation: principal investigator should not be involved in the evaluation process of learners in clinical rotation).

CONCLUSIONS

Our nominal group technique approach resulted in raising 5 specific issues about freedom of participation of residents in research in medical education, over-solicitation, time dedicated to research, emotional safety, and educational safety.

A qualitative study of the incentives and barriers that influence preferences for rural placements during surgical training in Australia

BACKGROUND

Rural exposure of long durations during clinical training is positively associated with rural career uptake and is a central strategy to addressing the geographical maldistribution of Australia's surgical workforce. However, the incentives and barriers to trainees undergoing surgical training preferencing repeated rural placements in Australia are not well understood. This qualitative study explores the incentives and barriers that influence preference for rural placements during surgical training in Australia.

METHODS

This qualitative study employed online semi-structured in-depth interviews. Participants were recruited using an online survey, and interviews were conducted between October 2020 and November 2020. Transcripts were transcribed and de-identified, and thematically analysed.

RESULTS

Twenty-nine semi-structured interviews were conducted with trainees and 12 Fellows. Twenty-five participants identified as male, and four identified as female. Four main incentives identified were: (1) broad scope of learning opportunities, (2) quality of supervision, (3) positive work environment and (4) lifestyle. Seven barriers identified were: (1) inadequate preparation for placement, (2) limited case mix to support learning outcomes, (3) lack of formally structured learning opportunities, (4) workload and safe hours concerns, (5) lack of peer support, (6) childcare and educational needs and (7) partner career development.

CONCLUSION

The strategy of encouraging trainees to undertake rural placements to address the maldistribution of the surgical workforce should include initiatives that support learning outcomes across their training levels. In addition, improving trainees' ability to prepare adequately for placements may also improve the number and duration of rural placements trainees undertake during their training.

Let's embed peer-support groups into the medical curriculum for all

Even before the COVID-19 pandemic, attending to the mental wellbeing of all doctors was high on the political agenda. The quality of patient care is also known to be related to doctors' wellbeing. Now, in the midst of a global pandemic, doctors are having to cope with ever more trauma and moral injury. Group-based peer support and regular reflective practice are interventions known to reduce clinician burnout and optimise wellbeing. Junior doctors are the most likely of all medical groups to be at a high risk of burnout. The NHS Staff and Learners' Mental Wellbeing Commission report advocates establishing explicit peer support mechanisms and the use of peer support as part of the first line of psychological first aid. Peer support is not addressed in the curriculum for the majority of medical specialties. We recommend that regular peer-support reflective groups are provided during protected time for all trainees.

Understanding and Optimizing Group Dynamics in Case-Based Collaborative Learning

Teamwork skills are recognized as a core competency of physicians. To more effectively prepare trainees for the demands of their future work, medical educators are increasingly turning to group-based instructional formats. We employ case-based collaborative learning (CBCL) - a format which requires daily in-class discussion and collaboration in assigned small groups. While students overwhelmingly embraced CBCL as stimulating and thought-provoking, some students reported that social dynamics among group members adversely impacted their experience. Using mixed methods, we demonstrate that a short intervention that asked students to discuss how they can best learn together improved small group dynamics, and promoted psychological safety among peers. Importantly, no specific instruction in team work was required, students overall had a clear understanding how they could improve, but they did not know how to start this conversation with each other. To promote team learning, we propose that educators emphasize students' accountability to their peers' learning in addition to their own, and devote some time in class for teams to reflect and discuss how to improve learning with each other. Our observations are of interest to anyone frequently relying on group work without peer assessment or formal feedback on group performance.

Assessment of Entrustable Professional Activities Using a Web-Based Simulation Platform During Transition to Emergency Medicine Residency: Mixed Methods Pilot Study

BACKGROUND

The 13 core entrustable professional activities (EPAs) are key competency-based learning outcomes in the transition from undergraduate to graduate medical education in the United States. Five of these EPAs (EPA2: prioritizing differentials, EPA3: recommending and interpreting tests, EPA4: entering orders and prescriptions, EPA5: documenting clinical encounters, and EPA10: recognizing urgent and emergent conditions) are uniquely suited for web-based assessment.

OBJECTIVE

In this pilot study, we created cases on a web-based simulation platform for the diagnostic assessment of these EPAs and examined the feasibility and acceptability of the platform.

METHODS

Four simulation cases underwent 3 rounds of consensus panels and pilot testing. Incoming emergency medicine interns (N=15) completed all cases. A maximum of 4 "look for" statements, which encompassed specific EPAs, were generated for each participant: (1) performing harmful or missing actions, (2) narrowing differential or wrong final diagnosis, (3) errors in documentation, and (4) lack of recognition and stabilization of urgent diagnoses. Finally, we interviewed a sample of interns (n=5) and residency leadership (n=5) and analyzed the responses using thematic analysis.

RESULTS

All participants had at least one missing critical action, and 40% (6/15) of the participants performed at least one harmful action across all 4 cases. The final diagnosis was not included in the differential diagnosis in more than half of the assessments (8/15, 54%). Other errors included selecting incorrect documentation passages (6/15, 40%) and indiscriminately applying oxygen (9/15, 60%). The interview themes included psychological safety of the interface, ability to assess learning, and fidelity of cases. The most valuable feature cited was the ability to place orders in a realistic electronic medical record interface.

CONCLUSIONS

This study demonstrates the feasibility and acceptability of a web-based platform for diagnostic assessment of specific EPAs. The approach rapidly identifies potential areas of concern for incoming interns using an asynchronous format, provides feedback in a manner appreciated by residency leadership, and informs individualized learning plans.

No One Size Fits All: A Qualitative Study of Clerkship Medical Students' Perceptions of Ideal Supervisor Responses to Microaggressions

PURPOSE

This study explores medical students' perspectives on the key features of ideal supervisor responses to microaggressions targeting clerkship medical students.

METHOD

This single-institution, qualitative focus group study, based in an interpretivist paradigm, explored clerkship medical students' perceptions in the United States, 2020. During semistructured focus groups, participants discussed 4 microaggression scenarios. The authors employed the framework method of thematic analysis to identify considerations and characteristics of ideal supervisor responses and explored differences in ideal response across microaggression types.

RESULTS

Thirty-nine students participated in 7 focus groups, lasting 80 to 92 minutes per group. Overall, students felt that supervisors' responsibility began before a microaggression occurred, through anticipatory discussions ("pre-brief") with all students to identify preferences. Students felt that effective bystander responses should acknowledge student preferences, patient context, interpersonal dynamics in the room, and the microaggression itself. Microassaults necessitated an immediate response. After a microaggression, students preferred a brief one-on-one check-in with the supervisor to discuss the most supportive next steps including whether further group discussion would be helpful.

CONCLUSIONS

Students described that an ideal supervisor bystander response incorporates both student preferences and the microaggression context, which are best revealed through advanced discussion. The authors created the Bystander Microaggression Intervention Guide as a visual representation of the preferred bystander microaggression response based on students' discussions. Effective interventions promote educational safety and shift power dynamics to empower the student target.

Shame in medical clerkship: "You just feel like dirt under someone's shoe"

INTRODUCTION

This study explores how senior medical students' experience and react to shame during clinical placements by asking them to reflect on (1) manifestations of shame experiences, (2) situations and social interactions that give rise to shame, and (3) perceived effects of shame on learning and professional identity development.

METHODS

In this interpretive study, the authors recruited 16 senior medical students from two classes at a Norwegian medical school. In three focus group interviews, participants were invited to reflect on their experiences of shame. The data were analyzed using systematic text condensation, producing rich descriptions about students' shame experiences.

RESULTS

All participants had a range of shame experiences, with strong emotional, physical, and cognitive reactions. Shame was triggered by a range of clinician behaviours interpreted as disinterest, disrespect, humiliation, or breaches of professionalism. Shame during clinical training caused loss of confidence and motivation, worries about professional competence, lack of engagement in learning, and distancing from shame-associated specialties. No positive effects of shame were reported.

DISCUSSION

Shame reactions in medical students were triggered by clinician behaviour that left students feeling unwanted, rejected, or burdensome, and by humiliating teaching situations. Shame had deleterious effects on motivation, learning, and professional identity development. This study has implications for learners, educators, and clinicians, and it may contribute to increased understanding of the importance of supportive learning environments and supervisors' social skills within the context of medical education.

Ottawa 2020 consensus statement for programmatic assessment - 1. Agreement on the principles

INTRODUCTION

In the Ottawa 2018 Consensus framework for good assessment, a set of criteria was presented for systems of assessment. Currently, programmatic assessment is being established in an increasing number of programmes. In this Ottawa 2020 consensus statement for programmatic assessment insights from practice and research are used to define the principles of programmatic assessment.

METHODS

For fifteen programmes in health professions education affiliated with members of an expert group (n = 20), an inventory was completed for the perceived components, rationale, and importance of a programmatic assessment design. Input from attendees of a programmatic assessment workshop and symposium at the 2020 Ottawa conference was included. The outcome is discussed in concurrence with current theory and research.

RESULTS AND DISCUSSION

Twelve principles are presented that are considered as important and recognisable facets of programmatic assessment. Overall these principles were used in the curriculum and assessment design, albeit with a range of approaches and rigor, suggesting that programmatic assessment is an achievable education and assessment model, embedded both in practice and research. Knowledge on and sharing how programmatic assessment is being operationalized may help support educators charting their own implementation journey of programmatic assessment in their respective programmes.

Morning report for all: a qualitative study of disseminating case conferences via podcasting

BACKGROUND

Despite its long-established importance, diagnostic reasoning (DR) education has suffered uneven implementation in medical education. The Clinical Problem Solvers (CPSolvers) podcast has emerged as a novel strategy to help teach DR through case conferences with expert diagnosticians and trainees. CPSolvers has 25,000 listeners in 147 countries. The aim of this study was to evaluate the podcast by eliciting the developers' goals of the podcast, then determining to what extent they aligned with the listeners' actual usage habits, features they valued, and perceptions of the podcast.

METHODS

We conducted semi-structured interviews with 3 developers and 8 listeners from April-May 2020, followed by qualitative thematic analysis.

RESULTS

Three major developer goals with sub-goals resulted: 1. To teach diagnostic reasoning in a case-based format by (1a) teaching schemas, (1b) modeling expert diagnostic reasoning, (1c) teaching clinical knowledge, and (1d) teaching diagnostic reasoning terminology. 2. To change the culture of medicine by (2a) promoting diversity, (2b) modeling humility and promoting psychological safety, and (2c) creating a fun, casual way to learn. 3. To democratize the teaching of diagnostic reasoning by leveraging technology. Listeners' usage habits, valued features, and perceptions overall strongly aligned with all these aspects, except for (1c) clinical knowledge, and (1d) diagnostic reasoning terminology. Listeners identified (1a) schemas, and (2c) promotion of psychological safety as the most valuable features of the podcast.

CONCLUSION

CPSolvers has been perceived as a highly effective and novel way to disseminate DR education in the form of case conferences, serving as an alternative to traditional in-person case conferences suspended during COVID-19. CPSolvers combines many known benefits of in-person case conferences with a compassionate and entertaining teaching style, plus advantages of the podcasting medium - democratizing morning report for listeners around the world.

The critical role of infrastructure and organizational culture in implementing competency-based education and individualized pathways in undergraduate medical education

In 2010, several key works in medical education predicted the changes necessary to train modern physicians to meet current and future challenges in health care, including the standardization of learning outcomes paired with individualized learning processes. The reframing of a medical expert as a flexible, adaptive team member and change agent, effective within a larger system and responsive to the community's needs, requires a new approach to education: competency-based medical education (CBME). CBME is an outcomes-based developmental approach to ensuring each trainee's readiness to advance through stages of training and continue to grow in unsupervised practice. Implementation of CBME with fidelity is a complex and challenging endeavor, demanding a fundamental shift in organizational culture and investment in appropriate infrastructure. This paper outlines how member schools of the American Medical Association Accelerating Change in Medical Education Consortium developed and implemented CBME, including common challenges and successes. Critical supporting factors include adoption of the master adaptive learner construct, longitudinal views of learner development, coaching, and a supportive learning environment.

An Internal Perspective: the Psychological Impact of Mistreatment

OBJECTIVES

Student mistreatment remains a prominent issue in medical education. Mistreatment has been linked to negative mental health outcomes, including depression, anxiety, and burnout. Continued challenges in this arena include difficulties in identifying mistreatment and underreporting. The objective of this study was to better understand the nuances of individual students' reactions to mistreatment.

METHODS

Medical students, who had experienced mistreatment, were invited to participate in this study. Individual, semi-structured, peer-to-peer interviews were conducted with 21 students. Interview transcriptions were coded using grounded theory and inductive analysis, and themes were extracted.

RESULTS

The interviews generated 34 unique mistreatment incidents. Four major themes arose in students' reactions to mistreatment. (1) Descriptions-the student described the incident as inappropriate, unusual, or unnecessary. (2) Recognition-most students did not immediately recognize the incident as mistreatment. (3) Emotions-the student described negative emotions (negative self-views, anger, powerlessness, shock, discomfort) associated with the mistreatment incident. (4) Coping mechanisms-the student utilized avoidance and rationalization to process their mistreatment.

CONCLUSIONS

Mistreatment generates complex emotions and coping mechanisms that impair the learning process. These complex emotions and coping mechanisms also make it difficult for trainees to identify mistreatment and to feel safe to report. Increasing understanding of the psychological impact of mistreatment can help peers and educators better screen for mistreatment in trainees and guide them in reporting decisions.

Experiential learning, collaboration and reflection: key ingredients in longitudinal faculty development

BACKGROUND

Longitudinal faculty development (LFD) may allow for increased uptake of teaching skills, especially in a forum where teachers can reflect individually and collectively on the new skills. However, the exact processes by which such interventions are effective need further exploration.

METHODS

This qualitative study examined an LFD initiative teaching a novel feedback approach attended by five family practice physicians. The initiative began with two 1.5-hour workshops: Goal-Oriented Feedback (as the teaching skill to be developed) and Narrative Reflection (as the tool to support personal reflection on the skill being learned). Over the subsequent six-months, the five participants iteratively applied the feedback approach in their teaching and engaged in narrative reflection at four 1-hour group sessions. Transcripts from the group discussions and exit interviews were analyzed using thematic analysis.

RESULTS

Iteratively trialing, individually reflecting on, and collectively exploring efforts to implement the new feedback approach resulted in the development of a learning community among the group. This sense of community created a safe space for reflection, while motivating ongoing efforts to learn the skill. Individual pre-reflection prepared individuals for group co-reflection; however, written narratives were not essential.

CONCLUSION

LFD initiatives should include an emphasis on ensuring opportunities for iterative attempts of teaching skills, guided self-reflection, and collaborative group reflection and learning to ensure sustainable change to teaching practices.

Virtual Interactive Case-Based Education (VICE): A Conference for Deliberate Practice of Diagnostic Reasoning

INTRODUCTION

Current approaches to teaching diagnostic reasoning minimally address the need for deliberate practice. We developed an educational conference for internal medicine residents to practice diagnostic reasoning and examine how biases affect their differential diagnoses through cognitive autopsies.

METHODS

We formatted the Virtual Interactive Case-Based Education (VICE) conference as a clinical problem-solving exercise, in which a facilitator presents a case to a single discussant selected from the audience. We delivered VICE on an internet-based conferencing platform with screen-sharing capability over approximately 30 minutes. To maximize learners' psychological safety, we employed an active facilitation model that normalized uncertainty and prioritized the diagnostic process over arriving at the correct diagnosis.

RESULTS

Resident attitudes toward VICE were assessed by utilizing a postconference survey and gathering descriptive data for 11 sessions. Ninety-seven percent of respondents (n = 35) felt that VICE was a novel and valuable addition to their curriculum. Qualitative data suggested that positive features of the conference included the opportunity to practice diagnostic reasoning, the single-discussant format, and the supportive learning environment. Discussants reported that holding the conference in person would have negatively impacted their experience.

DISCUSSION

Internal medicine residents universally valued the opportunity to engage in deliberate practice of case-based reasoning in a psychologically safe environment during the VICE conference. The virtual nature of the conference contributed significantly to discussants' positive experience. This resource includes all materials necessary to implement VICE, as well as an instructional video on facilitation.

Addressing the gate blocking of minority faculty

There have been ongoing efforts to increase the presence of underrepresented minorities in medicine (URMM), including faculty development initiatives, mentoring programs and outreach efforts. However, URMM faculty face unique challenges that are crucial for academic institutions and leaders to recognize in order to improve retention of this group and allow for meaningful advancement in the field. This paper introduces the concept of gate blocking, defined as what happens to minority faculty as a result of the consequences of the minority tax and systems designed to advantage some and disadvantage others. In addition to defining gate blocking, the authors make recommendations to address this concern in academic medicine and promote the advancement and retention of URMM faculty.

Perfectionism, Power, and Process: What We Must Address to Dismantle Mental Health Stigma in Medical Education

In this commentary, the authors draw on 2 personal accounts of mental illness published by Kirk J. Brower, MD, and Darrell G. Kirch, MD, in this issue to consider how and why mental health stigma is maintained in medical education. In particular, they explore how perfectionism, power differentials, and structural forces drive mental illness stigma in medical education. They argue that mental health stigma in medical education, while deeply embedded in the physician archetype and medical culture, is not inevitable and that dismantling it will require individual courage, interpersonal acceptance, and institutional action.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

Students' social networks are diverse, dynamic and deliberate when transitioning to clinical training

CONTEXT

Transitions in medical education are dynamic, emotional and complex yet, unavoidable. Relationships matter, especially in times of transition. Using qualitative, social network research methods, we explored social relationships and social support as medical students transitioned from pre-clinical to clinical training.

METHODS

Eight medical students completed a social network map during a semi-structured interview within two weeks of beginning their clinical clerkships (T0 ) and then again four months later (T1 ). They indicated meaningful interactions that influenced their transition from pre-clinical to clinical training and discussed how these relationshipsimpacted their transition. We conducted mixed-methods analysis on this data.

RESULTS

At T0 , eight participants described the influence of 128 people in their social support networks; this marginally increased to 134 at T1 . People from within and beyond the clinical space made up participants' social networks. As new relationships were created (eg with peers and doctors), old relationships were kept (eg with doctors and family) or dissolved over time (eg with near-peers and nurses). Participants deliberately created, kept or dissolved relationships over time dependent on whether they provided emotional support (eg they could trust them) or instrumental support (eg they provided academic guidance).

CONCLUSIONS

This is the first social networks analysis paper to explore social networks in transitioning students in medicine. We found that undergraduate medical students' social support networks were diverse, dynamic and deliberate as they transitioned to clerkships. Participants created and kept relationships with those they trusted and who provided emotional or instrumental support and dissolved relationships that did not provide these functions.

'I'm unworthy of being in this space': The origins of shame in medical students

OBJECTIVES

Shame results from a negative global self-evaluation and can have devastating effects. Shame research has focused primarily on graduate medical education, yet medical students are also susceptible to its occurrence and negative effects. This study explores the development of shame in medical students by asking: how does shame originate in medical students? and what events trigger and factors influence the development of shame in medical students?

METHODS

The study was conducted using hermeneutic phenomenology, which seeks to describe a phenomenon, convey its meaning and examine the contextual factors that influence it. Data were collected via a written reflection, semi-structured interview and debriefing session. It was analysed in accordance with Ajjawi and Higgs' six steps of hermeneutic analysis: immersion, understanding, abstraction, synthesis, illumination and integration.

RESULTS

Data analysis yielded structural elements of students' shame experiences that were conceptualised through the metaphor of fire. Shame triggers were the specific events that sparked shame reactions, including interpersonal interactions (eg, receiving mistreatment) and learning (eg, low test scores). Shame promoters were the factors and characteristics that fuelled shame reactions, including those related to the individual (eg, underrepresentation), environment (eg, institutional expectations) and person-environment interaction (eg, comparisons to others). The authors present three illustrative narratives to depict how these elements can interact to lead to shame in medical students.

CONCLUSIONS

This qualitative examination of shame in medical students reveals complex, deep-seated aspects of medical students' emotional reactions as they navigate the learning environment. The authors posit that medical training environments may be combustible, or possessing inherent risk, for shame. Educators, leaders and institutions can mitigate this risk and contain damaging shame reactions by (a) instilling a true sense of belonging and inclusivity in medical learning environments, (b) facilitating growth mindsets in medical trainees and (c) eliminating intentional shaming in medical education.

Virtual adaptation of traditional healthcare quality improvement training in response to COVID-19: a rapid narrative review

BACKGROUND

Information and communication technology are playing a major role in ensuring continuity of healthcare services during the COVID-19 pandemic. The pandemic has also disrupted healthcare quality improvement (QI) training and education for healthcare professionals and there is a need to rethink the way QI training and education is delivered. The purpose of this rapid evidence review is to quickly, but comprehensively collate studies to identify what works and what does not in delivering QI training and education using distance learning modalities.

METHODS

Three healthcare databases were searched along with grey literature sources for studies published between 2015 and 2020. Studies with QI training programmes or courses targeting healthcare professionals and students with at least one component of the programme being delivered online were included.

RESULTS

A total of 19 studies were included in the review. Most studies had a mixed methods design and used blended learning methods, combining online and in-person delivery modes. Most of the included studies reported achieving desired outcomes, including improved QI knowledge, skills and attitudes of participants and improved clinical outcomes for patients. Some benefits of online QI training delivery include fewer required resources, reduced need for on-site instructors, increased programme reach, and more control and flexibility over learning time for participants. Some limitations of online delivery modes include limited learning and networking opportunities, functional and technical problems and long lead time for content adaptation and customisation.

DISCUSSION

The review highlights that distance learning approaches to QI help in overcoming barriers to traditional QI training. Some important considerations for those looking to adapt traditional programmes to virtual environments include balancing virtual and non-virtual methods, using suitable technological solutions, customising coaching support, and using multiple criteria for programme evaluation.

CONCLUSION

Virtual QI and training of healthcare professionals and students is a viable, efficient, and effective alternative to traditional QI education that will play a vital role in building their competence and confidence to improve the healthcare system in post-COVID environment.

The impact of entrustment assessments on feedback and learning: Trainee perspectives

CONTEXT

Assessment for and of learning in workplace settings is at the heart of competency-based medical education. In postgraduate medical education (PGME), entrustable professional activities (EPAs) and entrustment scales are increasingly used to assess competence. However, the educational impacts of these assessment approaches remain unknown. Therefore, this study aimed to explore trainee perceptions regarding the impacts of EPAs and entrustment scales on feedback and learning processes in the clinical setting.

METHODS

Four focus groups were conducted with postgraduate trainees in anaesthesia, emergency medicine, general internal medicine and nephrology at McMaster University in Hamilton, Ontario, Canada. Data collection and analysis were informed by principles of constructivist grounded theory.

RESULTS

Entrustable professional activities representing well-defined tasks are perceived as potentially effective drivers for feedback and learning. Use of EPAs and entrustment scales, however, may augment existing tensions between developmental (for learning) and decision-making (of learning) assessment functions. Three key dilemmas seem to influence the impact of EPA-based assessment approaches on residents' learning: (a) standardisation of outcomes versus flexibility in assessment to align with individual learning experiences; (b) assessment tasks focusing on performance standards versus opportunities for learning, and (c) feedback focusing on numeric entrustment scores versus narrative and dialogue. Use of entrustment as an assessment outcome may impact trainees' motivation and feelings of self-efficacy, further enhancing tensions between learning and performance.

CONCLUSIONS

Entrustable professional activities and entrustment scales may support assessment for learning in PGME. However, their successful implementation requires the careful management of dilemmas that arise in EPA-based assessment in order to support competence development.

Releasing the Net to Promote Minority Faculty Success in Academic Medicine

Underrepresented minority faculty in academic medicine continue to be underrepresented in academic health centers across the country. Their underrepresentation impacts advancements in clinical care, education, and discovery and slows our forward progress in the field. Underrepresented in medicine faculty includes people who are black or African American, Hispanic or Latinx, or Native American. Barriers to underrepresented faculty recruitment, retention, and advancement include minority and gratitude taxes, imposter syndrome, and a lack of an appreciation of power distance and distance traveled. This article reviews five barriers to progress in achieving appropriate diversity among faculty and leadership of academic health centers, focusing on the multiplying effects of these barriers and potential steps forward.

COVID-19 pandemic: Early effects on pediatric rehabilitation medicine training

PURPOSE

The COVID-19 pandemic hastened the need for graduate medical education (GME) innovation, resulting in the creation of multiple pediatric rehabilitation medicine (PRM) e-learning initiatives. There has been a paucity of data regarding trainee perceptions regarding quickly developed new methods of learning during the pandemic. This study explored PRM trainee perceptions of e-learning and effects of the pandemic on education.

METHODS

Questionnaire study with data collected via REDCap.

RESULTS

Greater than half of PRM trainees (56.6%, 30/53) responded. Most respondents reported that the virtual lectures series (79.3%), journal club (78.9%), and virtual arts initiatives (75.0%) were valuable to their education. Common benefits noted included access to subject experts, networking, lecture recording, and location flexibility. Common concerns included lack of protected time, virtual platform fatigue, and decreased engagement. Most respondents were not redeployed. Relative to before the pandemic, less satisfaction with clinical education (70.0%) and greater satisfaction with non-clinical education (60.0%) was reported. The majority of graduating trainees felt positively (83.3%) and 16.7% were neutral regarding confidence to graduate.

CONCLUSION

Trainees perceived national e-learning as valuable to their education, especially due to the access to expert leaders around the nation. Future work should explore ways to overcome barriers and optimize benefits of GME and PRM e-learning.

Focal Length Fluidity: Research Questions in Medical Education Research and Scholarship

Research and scholarship in health professions education has been shaped by intended audience (i.e., producers vs users) and the purpose of research questions (i.e., curiosity driven or service oriented), but these archetypal dichotomies do not represent the breadth of scholarship in the field. Akin to an array of lenses required by scientists to capture images of a black hole, the authors propose the analogy of lenses with different focal lengths to consider how different kinds of research questions can offer insight into health professions research-a microscope, a magnifying glass, binoculars, and telescopes allow us to ask and answer different kinds of research questions. They argue for the relevance of all of the different kinds of research questions (or focal lengths); each provides important insight into a particular phenomenon and contributes to understanding that phenomenon in a different way. The authors propose that research questions can move fluidly across focal lengths. For example, a theoretical question can be made more pragmatic through asking "how" questions ("How can we observe and measure a phenomenon?"), whereas a pragmatic question can be made more theoretic by asking a series of "why" questions ("Why are these findings relevant to larger issues?"). In summary, only through the combination of lenses with different focal lengths, brought to bear through interdisciplinary work, can we fully comprehend important phenomena in health professions education and scholarship-the same way scientists managed to image a black hole.

Spinning the lens on physician power: narratives of humanism and healing

Divisive, disabling and dangerous power has featured heavily in health professions literature, social media and medical education. Negative accounts of the wielding of power have discoloured the lens through which the public sees medicine and distorted the view of a profession long associated with healing, humanism and heart. What has been buried in the midst of this discourse are positive accounts of power where the yielding of power is encouraging, empathetic and empowering. This article offers three personal vignettes illustrating the ability of power to positively affect lives in the practice of medicine, for patients and doctors alike. More of these stories are needed to uplift and rebalance the conversation on physician power and how it can be used for good. It is necessary to provide a narrative framework of what it looks like to be a healer and a humanistic doctor to satisfy the general public through a commitment to cultivate multidimensional future healthcare providers.

Perspectives from the other side of the screen: how clinicians and radiologists communicate about diagnostic errors

Background

Miscommunication amongst providers is a major factor contributing to diagnostic errors. There is a need to explore the current state of communications between clinicians and diagnostic radiologists. We compare and contrast the perceptions, experiences, and other factors that influence communication behaviors about diagnostic errors between clinicians and radiologists.

Methods

A survey with questions addressing (1) communication around diagnostic error, (2) types of feedback observed, (3) the manner by which the feedback is reported, and (4) length of time between the discovery of the diagnostic error and disclosing it was created and distributed through two large academic health centers and through listservs of professional societies of radiologists and clinicians.

Results

A total of 240 individuals responded, of whom 58% were clinicians and 42% diagnostic radiologists. Both groups of providers frequently discover diagnostic errors, although radiologists encounter them more frequently. From the qualitative analysis, feedback around diagnostic error included (1) timeliness of error, (2) specificity in description or terminology, (3) collegial in delivery, and (4) of educational value through means such as quality improvement.

Conclusions

Clinicians and radiologists discover diagnostic errors surrounding the interpretation of radiology images, although radiologists discover them more frequently. There is significant opportunity for improvement in education and practice regarding how radiologists and clinicians communicate as a team and, importantly, how feedback is given when an error is discovered. Educators and clinical leaders should consider designing, implementing, and evaluating strategies for improvement.