Development of a Simulation-Based Mastery Learning Curriculum for Breaking Bad News

Stop Asking How Much Information Your Patient Wants Before Discussing Serious News

Discussing serious news is a fundamental communication skill, and many clinicians have been taught to ask their patients how much detail they want to hear before sharing difficult information. Over the past decade, we have taught hundreds of medical students how to discuss serious news and reviewed hundreds of their recorded conversations. We've found that asking how much detail a patient wants to hear often results in confusion and is not an effective way to understand their communication preferences. Instead of asking how much detail your patient wants to hear, we propose an alternative way to tailor information to their needs when discussing serious news. By asking permission to share, presenting the news in a succinct, jargon-free headline, and providing emotional support and expert guidance at the right times, you can give the correct amount of detail while avoiding unnecessary confusion resulting in high-quality, patient centered communication every time you discuss serious news.

Teaching Pediatrics Residents a Communication Framework for Delivering Difficult News: A Randomized Controlled Trial of Practice Methods

OBJECTIVES

1) Improve resident skills in delivering difficult news (DDN) by educating pediatric residents using a communication framework with validity evidence, the m-SPIKES (an acronym for modified setting, perception, involvement, knowledge, empathy, and summarize/strategize) framework. 2) Determine whether small-group practice with peer role-play or Rapid cycle deliberate practice (RCDP) simulation is a more effective practice modality for improving DDN.

METHODS

Institutional review board-exempt single-institution pilot randomized controlled trial involving 28 pediatric residents. Residents attended an educational intervention that consisted of a large-group didactic session to learn the m-SPIKES framework followed by randomization into either peer role-play or RCDP groups for small-group practice. The residents completed pre- and postsurveys regarding self-efficacy in DDN using a Likert scale and were evaluated for fundamental communication skills and mastery of m-SPIKES by trained faculty during a simulation with a standardized patient before and after the educational intervention. Data were analyzed using bivariate inferential statistical analysis with t tests.

RESULTS

After the educational intervention, residents in both cohorts were found to have significantly increased self-efficacy in DDN, fundamental communication skills, and overall mastery of the use of m-SPIKES (P ≤ .001). The 2 cohorts had similar improvements in self-efficacy (P = .223) and fundamental communication skills (P = .306); however, the peer role-play showed a significant improvement in mastery of m-SPIKES when compared to the RCDP group (P = .046).

CONCLUSIONS

While this educational intervention demonstrated a significant improvement in DDN skills for all residents in both the peer role-play and RCDP groups, more studies are needed to determine whether the use of RCDP is advantageous in communication education.

Current situation and effectiveness of palliative care training for staff in an emergency care medical consortium hospital: a cross-sectional study

Background

The emergency department (ED), usually deemed not the most frequent setting for palliative care (PC), has increasingly been mentioned for its potential critical role in end-of-life patient care. However, how the training affects PC performance remains to be investigated. This study aims to investigate the current PC standard of care and effectiveness of PC training in a Chinese emergency care medical consortium hospital.

Methods

We conducted an anonymous online census targeting the emergency care providers in the consortium hospital. The questionnaire included respondents' demographics, PC knowledge, PC practice, and whether they have received any PC training. Outcome variables included: confidence in clinical implementation, perceptions about death, and attitudes toward PC implementation with Likert five score rating. Factors associated with better PC knowledge and performance were identified by analysis of the association between rating scores and participant characteristics.

Results

923 staff participated in the study, while 429 (46.5%) received PC training. Training participation was significantly associated with age, education, occupation, rank, working years, and experience of family members' death (p < 0.05). Training improved the total score of knowledge and practice of PC (median 90 vs. 100, p < 0.001), the confidence in clinical PC management (confidence score: 36 vs. 40, p < 0.001), and attitudes toward PC implementation (attitude score: 37 vs. 40, p = 0.048). Offline lecture-based learning was the primary training form in this hospital. The ORs of case-based learning, online lecture video, and community training project to higher total scores were 1.94 (95% CI 1.18-3.17, p = 0.009), 2.09 (1.23-3.56, p = 0.006) and 0.17 (0.04-0.63, p = 0.008), respectively. Meanwhile, cased-based learning, online lecture video, and community training project contributed significantly to the confidence score. So did the lecture offline to the score of perception about death (perception score). The OR of meeting online to attitude score was 1.69 (1.05-2.73, p = 0.030).

Conclusion

Palliative care training is associated with better self-rating of PC among ED care providers. However, there is a significant gap for improvement, particularly for the community training programs.

Using Simulation-Based Mastery Learning to Achieve Excellent Learning Outcomes in Physical Therapist Education

INTRODUCTION

The 2 aims of this observational study are (a) to describe the implementation and feasibility of a bed mobility skills simulation-based mastery learning (SBML) curricular module for physical therapist students and (b) to measure learning outcomes and student perceptions of this module.

REVIEW OF LITERATURE

Simulation-based mastery learning is an outcome-based educational approach that has been successful in other health professions but has not been explored in physical therapy education.

SUBJECTS

Eighty-seven students in a single cohort of a Doctor of Physical Therapy program.

METHODS

The SBML module in this pretest-posttest study included a pretest, instruction, initial posttest, and additional rounds of instruction and assessment as needed for all learners to achieve the minimum passing standard (MPS) set using the Mastery Angoff and Patient Safety methods. Outcome measures were bed mobility assessment pass rates and scores, additional student and faculty time compared with a traditional approach, and student perceptions of their self-confidence and the module.

RESULTS

All students achieved the MPS after 3 rounds of training and assessment beyond the initial posttest. Mean Total Scores improved from 67.6% (12.9%) at pretest to 91.4% (4.8%) at mastery posttest ( P < .001, Cohen's d = 1.8, 95% CI [1.4-2.1]); mean Safety Scores improved from 75.2% (16.0%) at pretest to 100.0% (0.0%) at mastery posttest ( P < .001, Cohen's d = 1.5, 95% CI [1.2-1.9]). Students who did not achieve the MPS at the initial posttest ( n = 30) required a mean of 1.2 hours for additional instruction and assessment. Survey results revealed an increase in student confidence ( P < .001) and positive student perceptions of the module.

DISCUSSION AND CONCLUSION

Implementation of this SBML module was feasible and resulted in uniformly high levels of bed mobility skill acquisition. Based on rigorous learning outcomes, feasible requirements for implementation, and increased student confidence, SBML offers a promising approach for wider implementation in physical therapy education.

Bringing competency-based communication training to scale: A multi-institutional virtual simulation-based mastery learning curriculum for Emergency Medicine residents

PURPOSE

Serious illness communication skills are essential for physicians, yet competency-based training is lacking. We address scalability barriers to competency-based communication skills training by assessing the feasibility of a multi-center, virtual simulation-based mastery learning (vSBML) curriculum on breaking bad news (BBN).

METHODS

First-year emergency medicine residents at three academic medical centers participated in the virtual curriculum. Participants completed a pretest with a standardized patient (SP), a workshop with didactics and small group roleplay with SPs, a posttest with an SP, and additional deliberate practice sessions if needed to achieve the minimum passing standard (MPS). Participants were assessed using a previously published BBN assessment tool that included a checklist and scaled items. Authors compared pre- and posttests to evaluate the impact of the curriculum.

RESULTS

Twenty-eight (90%) of 31 eligible residents completed the curriculum. Eighty-nine percent of participants did not meet the MPS at pretest. Post-intervention, there was a statistically significant improvement in checklist performance (Median= 93% vs. 53%, p < 0.001) and on all scaled items assessing quality of communication. All participants ultimately achieved the MPS.

CONCLUSIONS

A multi-site vSBML curriculum brought all participants to mastery in the core communication skill of BBN and represents a feasible, scalable model to incorporate competency-based communication skills education in a widespread manner.

Twelve tips for developing simulation-based mastery learning clinical skills checklists

Simulation-based mastery learning is a powerful educational paradigm that leads to high levels of performance through a combination of strict standards, deliberate practice, formative feedback, and rigorous assessment. Successful mastery learning curricula often require well-designed checklists that produce reliable data that contribute to valid decisions. The following twelve tips are intended to help educators create defensible and effective clinical skills checklists for use in mastery learning curricula. These tips focus on defining the scope of a checklist using established principles of curriculum development, crafting the checklist based on a literature review and expert input, revising and testing the checklist, and recruiting judges to set a minimum passing standard. While this article has a particular focus on mastery learning, with the exception of the tips related to standard setting, the general principles discussed apply to the development of any clinical skills checklist.

Development and Initial Validity Evidence for a Pregnancy Disclosure and Options Counseling Checklist in Emergency Medicine

Background

Many patients first learn of a pregnancy in the emergency department (ED). However, limited ED physician knowledge in pregnancy disclosure and options counseling may contribute to challenges in patient care and potential missed opportunities for timely access to reproductive care. No standardized instruments exist to teach or assess this important communication skill for the ED physicians. This study aimed to develop and collect validity evidence for a checklist for effective pregnancy disclosure and options counseling by ED physicians in an environment with unrestricted access to comprehensive reproductive care.

Methods

A prospective checklist creation and validity evidence collection study was conducted, involving literature review, expert input through a modified Delphi process, and pilot testing with ED faculty and residents at an urban academic medical center. We structured the validity evidence collection process using Messick's criteria for construct validity, addressing content, response process, internal structure, and relations to other variables. Data analysis focused on collecting validity evidence, including inter-rater reliability and participant performance assessment based on faculty or resident status.

Results

The study resulted in a final 17-item checklist for pregnancy disclosure and options counseling in the ED. Pilot testing with 20 participants (eight faculty members and 12 residents) revealed high overall inter-rater reliability with almost perfect agreement (kappa = 0.81) and acceptable internal consistency (Cronbach's alpha = 0.88). Checklist scores showed no significant difference across standardized patients, indicating consistency. Faculty members outperformed residents, suggesting concurrent validity based on levels of clinical experience.

Conclusions

Preliminary validity evidence supports the use of this novel checklist to assess physician competency in pregnancy disclosure and options counseling in the ED. Given the frequency of new pregnancy encounters in the ED and the dynamic changes to pregnant patients' reproductive rights, enhancing physician education in these areas is critical for optimizing patient care and autonomy.

Embedding an Education Intervention about Shared Decision Making into an RCT: Ensuring competency and fidelity

Objective

To describe the outcomes of training nephrology clinicians and clinical research participants, to use the Best Case/Worst Case Communication intervention, for discussions about dialysis initiation for patients with life-limiting illness, during a randomized clinical trial to ensure competency, fidelity to the intervention, and adherence to study protocols and the intervention throughout the trial.

Methods

We enrolled 68 nephrologists at ten study sites and randomized them to receive training or wait-list control. We collected copies of completed graphic aids (component of the intervention), used with study-enrolled patients, to measure fidelity and adherence.

Results

We trained 34 of 36 nephrologists to competence and 27 completed the entire program. We received 60 graphic aids for study-enrolled patients for a 73% return rate in the intervention arm. The intervention fidelity score for the graphic aid reflected completion of all elements throughout the study.

Conclusion

We successfully taught the Best Case/Worst Case Communication intervention to clinicians as research participants within a randomized clinical trial.

Innovation

Decisions about dialysis are an opportunity to discuss prognosis and uncertainty in relation to consideration of prolonged life supporting therapy. Our study reveals a strategy to evaluate adherence to a communication intervention in real time during a clinical study.

Development of a Simulation-Based Mastery Learning Curriculum for Late Goals of Care Discussions

INTRODUCTION

Fellows in critical care medicine (CCM) routinely help patients and families navigate complex decisions near the end of life. These "late goals of care" (LGOC) discussions require rigorous skills training and impact patient care. Innovation is needed to ensure that fellow training in leading these discussions is centered on reproducible competency-based standards. The aims of this study were to (1) describe the development of a simulation-based mastery learning (SBML) curriculum for LGOC discussions and (2) set a defensible minimum passing standard (MPS) to ensure uniform skill acquisition among learners.

INNOVATION

We developed an SBML curriculum for CCM fellows structured around REMAP, a mnemonic outlining foundational components of effective communication around serious illness. A multidisciplinary expert panel iteratively created an LGOC discussion assessment tool. Pilot testing was completed to refine the checklist, set the MPS, and assess skill acquisition.

OUTCOMES

The LGOC discussion assessment tool included an 18-item checklist and 6 scaled items. The tool produced reliable data (k ≥ 0.7 and ICC of ≥ 0.7). Using the Mastery Angoff method, the panel set the MPS at 87%. Ten CCM fellows participated in the pilot study. Performance on the checklist significantly improved from a median score of 52% (IQR 44%-72%) at pretest to 96% (IQR 82%-97%) at post-test (P = 0.005). The number of learners who met the MPS similarly improved from 10% during pre-testing to 70% during post-testing (P = 0.02).

COMMENT

We describe the development of a LGOC SBML curriculum for CCM fellows which includes a robust communication skills assessment and the delineation of a defensible MPS.

Situational simulation teaching effectively improves dental students' non-operational clinical competency and objective structured clinical examination performance

BACKGROUND

Appropriate communication with dental patients enhances treatment outcomes and patient satisfaction. Implementing simulated patient interviews courses can improve patient-centered care and reduce conflict during clerkship training. Therefore, this study explored the relationship among student participation in a situational simulation course (SSC), academic performance, clerkship performance, and objective structured clinical examination (OSCE) performance.

METHODS

This study was conducted with a sample of fifth-year dental students undergoing clerkship training. After implementing a situational simulation course to investigate the relationship among participation in SSC, academic performance, clerkship performance, and OSCE performance, a path analysis model was developed and tested.

RESULTS

Eighty-seven fifth-year dental students were eligible for the SSC, and most (n = 70, 80.46%) volunteered to participate. The path analysis model revealed that academic performance had a direct effect on OSCE performance (β = 0.281, P = 0.003) and clerkship performance (β = 0.441, P < 0.001). In addition, SSC teaching had a direct effect on OSCE performance (β = 0.356, P < 0.001).

CONCLUSIONS

SSCs can enhance dental students' non-operational clinical competency and OSCE performance effectively. Simulated patient encounters with feedback, incorporated into the dental curricula, have led to improved communication. Based on our findings, we suggest implementing SSC teaching before the OSCE to improve communication and cognitive skills.

Delivering bad or difficult news. An innovative simulation-based education approach to prepare interdisciplinary fellowships

BACKGROUND

There is limited data on the effectiveness of training interventions to improve the delivery of bad news.

METHODS

This preliminary research included pre-post assessments and an open-ended survey to evaluate the effectiveness and perceived value of training on delivering bad news for 26 first- and second-year fellows from five adult and pediatric fellowship programs.

RESULTS

There was a significant increase in faculty assessment scores (34.5 vs. 41.0, respectively, Z = -3.661, p < 0.001) and Standardized Patient (SP) assessment scores (37.5 vs .44.5, respectively, Z = -2.244, p = 0.025). Fellows valued having a standard framework to aid in the delivery of bad news; receiving targeted feedback and having the opportunity to apply their skills in a subsequent case.

CONCLUSIONS

A one-hour, four-phase lesson plan that includes an individualized training approach and simulation do-overs can be effective and valuable for preparing fellows to deliver bad news.

Necessity of Pretests in Central Venous Catheter Insertion Simulation-Based Mastery Learning: A Randomized Controlled Trial

PURPOSE

Simulation-based mastery learning (SBML) is a rigorous form of competency-based learning. Components of SBML include a pretest, deliberate practice, and a posttest; all learners must meet or exceed a minimum passing standard (MPS) on the posttest before completing training. The authors aimed to explore whether a modified SBML curriculum (without a pretest assessment) was as effective as the standard SBML curriculum (with a pretest assessment).

METHOD

The authors performed a randomized controlled trial of internal medicine residents who participated in an internal jugular central venous catheter insertion SBML curriculum at a tertiary care academic medical center in Chicago, Illinois, from December 2018 through December 2021. Residents were randomly assigned to complete the usual SBML intervention (pretest group) or to complete a modified SBML intervention without a pretest (no pretest group). The authors compared initial posttest performance and training time between groups.

RESULTS

Eighty-nine of 120 eligible residents (74.1%) completed the study: 43 in the pretest group and 46 in the no pretest group. Median (IQR) initial posttest scores were not statistically different between the pretest group (96.6 [93.1-100]) and the no pretest group (96.6 [92.4-100]). However, all 43 residents (100%) in the pretest group reached the MPS at the initial posttest compared with 41 of the 46 (89%) in the no pretest group ( P = .06). Residents in the pretest group required 16.5 hours more faculty and learning time than the no pretest group.

CONCLUSIONS

More residents who completed a pretest reached the MPS at initial posttest. However, incorporating a pretest during the internal jugular central venous catheter SBML curriculum required substantially more learner and faculty time without clear performance benefits.

Clinical Experience Is Not a Proxy for Competence: Comparing Fellow and Medical Student Performance in a Breaking Bad News Simulation-Based Mastery Learning Curriculum

BACKGROUND

It is unknown whether traditional medical education ensures competence among fellows in the key skill of breaking bad news (BBN). While simulation-based mastery learning (SBML) has been used to train fourth-year medical students (M4s) in BBN, it is unclear if it adds similar value for fellows.

OBJECTIVE

We examined the effect of traditional medical training on BBN skills by comparing baseline fellow and M4 skills and confidence and assessed the impact of a BBN SBML curriculum for fellows.

METHODS

Fellows training in six programs at Northwestern University from November 2018 to May 2019 were eligible for inclusion. Fellows completed a BBN SBML curriculum including a pretest, individualized feedback using a previously published assessment tool, and ongoing deliberate practice until all achieved a minimum passing standard (MPS). The primary outcomes were checklist and scaled item scores on the assessment tool. Fellow performance was compared to a historical M4 cohort.

RESULTS

Twenty-eight of 38 eligible fellows completed the curriculum and were included for analysis. Fellows reported significantly more experience and confidence in BBN compared to M4s, yet their pre-training performance was significantly worse on checklist (57.1% vs 65.0%, P = .02) and scaled items; only 4% reached the MPS. After training, fellow performance significantly improved on checklist (57.1% to 92.6%, SD = 5.2%, P < .001) and scaled items; all reached the MPS.

CONCLUSIONS

Despite higher confidence and BBN clinical experience, fellows performed worse than untrained M4s, confirming that experience is not a proxy for skill. Programs must develop competency-based assessments to ensure entrustment of communication skills.

Hospice Transitions From the Perspective of the Caregiver: A Qualitative Study and Development of a Preliminary Hospice Transition Checklist

Background: Relative to curative and traditional care delivery, hospice care has been associated with superior end of life (EOL) outcomes for both patient and caregiver. Still, comprehensive orientation and caregiver preparation for the transition to hospice is variable and often inadequate. From the perspective of the caregiver, it is unclear what information would better prepare them to support the transition of their loved one to hospice. Objectives: Our two sequential objectives were: 1) Explore caregivers' experiences and perceptions on the transition of their loved one to hospice; and 2) Develop a preliminary checklist of considerations for a successful transition. Design: We conducted semi-structured interviews and used a descriptive inductive/deductive thematic analysis to identify themes. Subjects: 19 adult caregivers of patients across the United States who had enrolled in hospice and died in the year prior (January - December 2019). Measurements: An interview guide was iteratively developed based on prior literature and expanded through collaborative coding and group discussion. Results: Four key themes for inclusion in our framework emerged: hospice intake, preparedness, burden of care and hospice resources. Conclusions: Focusing on elements of our preliminary checklist, such as educating families on goals of hospice or offering opportunities for respite care, into the orientation procedures may be opportunities to improve satisfaction with the transition and the entirety of the hospice experience. Future directions include testing the effectiveness of the checklist and adapting for expanded poputlations.

Serious Illness Communication Training Among Radiation Oncology Residents

PURPOSE

Education and specific training on serious illness communication skills for radiation oncology residents is lacking. The Accreditation Council for Graduate Medical Education requires radiation oncology residents to demonstrate interpersonal and communication skills; however, implementing specific training to address this poses an ongoing challenge. This study assesses the feasibility and effectiveness of a radiation oncology specific serious illness communication curriculum at a single radiation oncology residency program.

METHODS AND MATERIALS

The primary objectives were to assess observable communication skills among radiation oncology residents and their perceived level of preparedness and comfort with patient encounters surrounding serious illness. Each resident participated in a baseline simulated patient encounter. Two virtual half-day experience-based learning sessions led by faculty experts trained in teaching serious illness communication were held. The training consisted of brief didactic teaching, with the emphasis on small group guided practice with simulated patients in scenarios specific to radiation oncology. Each resident participated in a postcourse simulated patient encounter. Three blinded faculty trained in serious illness communication completed objective assessments of observable communication skills to compare pre- and postcourse performance.

RESULTS

A t test based on validated assessments reviewed by blinded faculty demonstrated significant improvement in overall observable communication skills among radiation oncology residents in the postcourse encounter compared with the precourse encounter (P = .0067). Overall, 8 of 9 (89%) residents felt more comfortable and prepared with radiation oncology-specific serious illness communication after the course compared with prior. The simulated patients rated the overall average resident performance higher on the postcourse assessment (Likert 4.89/5) compared with the precourse assessment (Likert 4.09/5), which trended toward a significant improvement (P = .0515).

CONCLUSIONS

Radiation oncology residents had a significant improvement in observable communication skills after participating in an experience-based training curriculum. This course can serve as an adaptable model that may be implemented by other radiation oncology residency programs.

Teaching Communication as a Procedure by Utilizing a Mixed-Methods Curriculum: A Pilot Study

Objective

In this study, we aimed to develop and pilot a mixed-methods curriculum among pediatric subspecialty fellows that combined didactics, role-play, and bedside coaching with a procedure card. We hypothesized that this curriculum would improve fellows’ ability to navigate difficult conversations and would be feasible to implement across training programs.

Methods

This study was conducted from 2019 to 2020. Phase 1 focused on establishing baseline performance. Phase 2 involved the education of participants and faculty. During phase 3, participants communicated difficult news to patients and families using the procedure card as a prompt with the aid of faculty coaching. Six months later, participants' performance was re-evaluated and compared with baseline performance.

Results

A total of 10 out of 17 (60%) participants completed the pilot study. Likert self-efficacy results revealed an improvement in the skill of delivering difficult news (3.0 pre-intervention, 4.1 post-intervention, p=0.0001), conducting a family conference (2.5 pre-intervention, 3.6 post-intervention, p=0.0001), and responding to emotions (3.4 pre-intervention, 4.2 post-intervention, p=0.0003). Investigator assessments showed improvement in fellows’ ability to communicate information clearly (2.5 pre-intervention, 3.9 post-intervention, p=0.0001) and demonstrate empathy (2.7 pre-intervention, 3.3 post-intervention, p=0.005).

Conclusions

In this pilot study, coaching at the bedside with a procedure-card prompt was effective at improving specific self-perceived and observed communication skills. Future research is needed to evaluate modifications to this curriculum to enhance its feasibility.

Brain Death Determination and Communication: An Innovative Approach Using Simulation and Standardized Patients

CONTEXT

Palliative medicine clinicians in hospital settings are often involved in the care of patients dying in critical care settings, with a subset from brain death. Brain death is a complex concept, not only for families, but also for clinicians. There is wide variability in adhering to formalized guidelines for brain death determination. In addition, communication techniques regarding brain death determination are distinct from those used in shared decision-making. There is a need to obtain knowledge and practical skills in brain death determination, including examination and communication. Simulation can provide a low-stakes setting to practice the process of brain death determination and communication.

OBJECTIVES

Describe a novel approach using high-fidelity simulation to teach hospice and palliative medicine fellows the practical and nuanced aspects of brain death determination and communication. Discuss the impact on fellows' confidence and knowledge for this learning activity.

INNOVATION/METHODS

This three-hour workshop includes a didactic session followed by a single case conducted in three parts using standardized patient encounters and high-fidelity simulation with manikin. It is delivered annually, as part of the monthly core didactic conference for all hospice and palliative medicine fellows in the four fellowship programs in our region.

OUTCOMES/RESULTS

Pre- and post-intervention surveys were performed assessing perceived confidence and content-related knowledge, which showed significant improvement in both areas.

COMMENTS/CONCLUSION

Simulation is a practical and constructive method for teaching the challenging concepts and unique communication skills involved in brain death determination.

A Novel Application of the Modified Angoff Method to Rate Case Difficulty in Simulation-Based Research

INTRODUCTION

Simulation use in research is often limited by controlling for scenario difficulty when using repeated measures. Our study assesses the feasibility of the Modified Angoff Method to reach expert consensus regarding difficulty of medical simulations. We compared scores with participant physiologic stress.

METHODS

Emergency medicine physicians with expertise in simulation education were asked to review 8 scenarios and estimate the percentage of resident physicians who would perform all critical actions using the modified Angoff method. A standard deviation (SD) of less than 10% of estimated percentage correct signified consensus. Twenty-five residents then performed the 6 scenarios that met consensus and heart rate variability (HRV) was measured.

RESULTS

During round 1, experts rated 4/8 scenarios within a 10% SD for postgraduate year 3 (PGY3) and 3/8 for PGY4 residents. In round 2, 6/8 simulation scenarios were within an SD of 10% points for both years. Intraclass correlation coefficient was 0.84 for PGY3 ratings and 0.89 for PGY4 ratings. A mixed effects analysis of variance showed no significant difference in HRV change from rest to simulation between teams or scenarios. Modified Angoff Score was not a predictor of HRV (multiple R2 = 0.0176).

CONCLUSIONS

Modified Angoff ratings demonstrated consensus in quantifying the estimated percentage of participants who would complete all critical actions for most scenarios. Although participant HRV did decrease during the scenarios, we were unable to significantly correlate this with ratings. This modified Angoff method is a feasible approach to evaluate simulation difficulty for educational and research purposes and may decrease the time and resources necessary for scenario piloting.

The use of simulation in medical student education on the topic of breaking bad news: A systematic review

BACKGROUND

Simulated patients (SPs) are widely used, but the most effective way of utilising them in undergraduate breaking bad news (BBN) medical education is unknown.

OBJECTIVES

To conduct a systematic review into SP's use in developing BBN skills in medical students.

METHODS

14 databases searched with the terms "Medical education", "Patient simulation", "Bad news". Data was systematically extracted, and thematic analysis undertaken.

RESULTS

Of 2117 articles screened, 29 publications met the inclusion criteria. These demonstrated a variety of SP models, including actors as patients (65.5%), peers (7.0%), and cancer survivors (3.5%). with delivery at varying times in the curricula. SPs are uniformly reported as having positive impact, but there is a lack of high-quality evidence comparing the use of differing forms of training. There was some evidence that virtual SPs were as useful as in-person SPs.

CONCLUSIONS

SPs allow students to practise vital BBN communication skills without risking detriment to patient care. Despite the heterogeneity of ways in which SPs have been used, the benefits of different approaches and when and how these should be delivered remains unclear.

PRACTICE IMPLICATIONS

Further educational development and research is needed about the use of SPs to support undergraduate BBN communication skills development.

Standardized vs peer-played patients for learning how to break bad news in lung cancer: A prospective crossover study

CONTEXT

Residents in respiratory medicine are often confronted with breaking bad news to patients. In communication skill training, a recurring question is whether to use standardized or peer-played patients for simulation METHODS: In this prospective single-center crossover study in pulmonology residents, a range of scenarios were performed during training sessions using standardized or peer-played patients. The aim was to assess whether patient type did alter the quality of the role-play. The residents completed post-scenario questionnaires about the role-play of each scenario, but also pre- and post-session questionnaires about their perception of the effectiveness of both modalities, and pre- and post-testing questionnaires about the psychological impact of the training.

RESULTS

Collectively, 4 scenarios were performed 52 times and evaluated 208 times by 52 residents. The use of standardized patients appeared to improve the quality of the patient role (8.8 ± 1.0 vs. 8.3 ± 1.1; p = 0.001) and the general quality of role-play (8.8 ± 1.0 vs. 8.2 ± 0.9; p = 0.008), without affecting the quality of the physician role played by the resident. There were no significant differences between standardized and peer-played patients regarding learning interest or psychological impact. Regardless of the modality, the training sessions did appear to significantly affect the residents' evaluations of their ability to break bad news to patients (5.7 ± 1.1 vs. 7.4 ± 1.1; p < 10-4).

CONCLUSION

Our results did not point to a superiority of either of these modalities for learning how to break bad news. Both may be used, depending on the local resources.

Developing standardized patient-based cases for communication training: lessons learned from training residents to communicate diagnostic uncertainty

Health professions education has benefitted from standardized patient (SP) programs to develop and refine communication and interpersonal skills in trainees. Effective case design is essential to ensure an SP encounter successfully meets learning objectives that are focused on communication skills. Creative, well-designed case scenarios offer learners the opportunity to engage in complex patient encounters, while challenging them to address the personal and emotional contexts in which their patients are situated. Therefore, prior to considering the practical execution of the patient encounter, educators will first need a clear and structured strategy for writing, organizing, and developing cases. The authors reflect on lessons learned in developing standardized patient-based cases to train learners to communicate to patients during times of diagnostic uncertainty, and provide suggestions to develop a set of simulation cases that are both standardized and diverse. Key steps and workflow processes that can assist educators with case design are introduced. The authors review the need to increase awareness of and mitigate existing norms and implicit biases, while maximizing variation in patient diversity. Opportunities to leverage the breadth of emotional dispositions of the SP and the affective domain of a clinical encounter are also discussed as a means to guide future case development and maximize the value of a case for its respective learning outcomes.

Teaching residents how to break bad news: piloting a resident-led curriculum and feedback task force as a proof-of-concept study

Background

Breaking bad news (BBN) is a critically important skill set for residents. Limited formal supervision and unpredictable timing of bad news delivery serve as barriers to the exchange of meaningful feedback.

Purpose of study

The goal of this educational innovation was to improve internal medicine residents’ communication skills during challenging BBN encounters. A formal BBN training programme and innovative on-demand task force were part of this two-phase project.

Study design

Internal medicine residents at a large academic medical centre participated in an interactive workshop focused on BBN. Workshop survey results served as a needs assessment for the development of a novel resident-led BBN task force. The task force was created to provide observations at the bedside and feedback after BBN encounters. Training of task force members incorporated video triggers and a feedback checklist. Inter-rater reliability was analysed prior to field testing, which provided data on real-world implementation challenges.

Results

148 residents were trained during the 2-hour communications skills workshop. Based on survey results, 73% (108 of 148) of the residents indicated enhanced confidence in BBN after participation. Field testing of the task force on a hospital ward revealed potential workflow barriers for residents requesting observations and prompted troubleshooting. Solutions were implemented based on field testing results.

Conclusions

A trainee-led BBN task force and communication skills workshop is offered as an innovative model for improving residents’ interpersonal and communication skills in BBN. We believe the model is both sustainable and reproducible. Lessons learnt are offered to aid in implementation in other settings.

Development and validation of The Breaking Bad News Attitudes Scale

BACKGROUND

Communication of bad news plays a critical role in the physician-patient relationship, and a variety of consensus guidelines have been developed to this purpose, including the SPIKES protocol. However, little is known about physicians' attitudes towards breaking bad news and to be trained to deliver it. This study aimed to develop and validate a self-report questionnaire to assess physicians' attitudes towards principles of the SPIKES protocol and training on them.

METHODS

The Breaking Bad News Attitudes Scale (BBNAS) was administered to 484 pediatricians and 79 medical students, recruited at two scientific conferences and two medical schools in Brazil. The questionnaire structural validity, reliability, and associations with other variables were tested.

RESULTS

The BBNAS showed adequate validity and good reliability, with two factors measuring attitudes towards the SPIKES strategy for braking bad news (α = 0.81) and the possibility to be trained on it (α = 0.77), respectively.

CONCLUSION

The novel questionnaire is a psychometrically sound measure that provides information on physicians' agreement with the SPIKES protocol. The BBNAS can provide useful information for planning training and continuing education programs for clinicians on communication of bad news using the SPIKES as a framework.

Assessing Nephrology Fellows' Skills in Communicating About Kidney Replacement Therapy and Kidney Biopsy: A Multicenter Clinical Simulation Study on Breaking Bad News

RATIONALE & OBJECTIVE

Interpersonal communication skills and professionalism competencies are difficult to assess among nephrology trainees. We developed a formative "Breaking Bad News" simulation and implemented a study in which nephrology fellows were assessed with regard to their skills in providing counseling to simulated patients confronting the need for kidney replacement therapy (KRT) or kidney biopsy.

STUDY DESIGN

Observational study of communication competency in the setting of preparing for KRT for kidney failure, for KRT for acute kidney injury (AKI), or for kidney biopsy.

SETTING & PARTICIPANTS

58 first- and second-year nephrology fellows assessed during 71 clinical evaluation sessions at 8 training programs who participated in an objective structured clinical examination of simulated patients in 2017 and 2018.

PREDICTORS

Fellowship training year and clinical scenario.

OUTCOME

Primary outcome was the composite score for the "overall rating" item on the Essential Elements of Communication-Global Rating Scale 2005 (EEC-GRS), as assessed by simulated patients. Secondary outcomes were the score for EEC-GRS "overall rating" item for each scenario, score < 3 for any EEC-GRS item, Mini-Clinical Examination Exercise (Mini-CEX) score < 3 on at least 1 item (as assessed by faculty), and faculty and fellow satisfaction with simulation exercise (via a survey they completed).

ANALYTICAL APPROACH

Nonparametric tests of hypothesis comparing performance by fellowship year (primary goal) and scenario.

RESULTS

Composite scores for EEC-GRS overall rating item were not significantly different between fellowship years (P = 0.2). Only 4 of 71 fellow evaluations had an unsatisfactory score for the EEC-GRS overall rating item on any scenario. On Mini-CEX, 17% scored < 3 on at least 1 item in the kidney failure scenario; 37% and 53% scored < 3 on at least 1 item in the AKI and kidney biopsy scenarios, respectively. In the survey, 96% of fellows and 100% of faculty reported the learning objectives were met and rated the experience good or better in 3 survey rating questions.

LIMITATIONS

Relatively brief time for interactions; limited familiarity with and training of simulated patients in use of EEC-GRS.

CONCLUSIONS

The fellows scored highly on the EEC-GRS regardless of their training year, suggesting interpersonal communication competency is achieved early in training. The fellows did better with the kidney failure scenario than with the AKI and kidney biopsy scenarios. Structured simulated clinical examinations may be useful to inform curricular choices and may be a valuable assessment tool for communication and professionalism.

Non-technical skills progression during anesthesiology residency in Portugal: the impact of a National Pedagogical Plan

Background Simulation is known as an important tool for the learning of technical and non-technical skills without endangering patient safety. In Portugal, a National Pedagogical Plan for Anesthesiology Residents was created based on simulation training. This plan was designed according to the objectives set forth by the Portuguese Board of Anesthesiology. This study aimed to evaluate the impact of simulation training courses on the non-technical skills of medical residents in Anesthesiology. Methods Confidential questionnaires, pre- and post-course, were answered by all the residents that attended the different modules of the simulation training program at Centro Hospitalar e Universitário de Coimbra Biomedical Simulation Centre, Portugal, from February 2011 to March 2018. Results A total of 344 questionnaires were answered. In the group of questions regarding the need for help, mistakes, and self-efficacy over time, students recognized an increase over time in the need for support and the self-assessment of the number of mistakes (p < 0.001). Regarding the self-evaluation of safety culture and communication skills, at the end of the residency, almost all the students recognized that they did not feel bad when asking for help or expressing their opinion, even when they disagreed with the consultant anesthesiologist. This was significantly different from the values of the self-assessment at the beginning of residency (p < 0.001). The evolution of preparation, knowledge, and training also showed a positive evolution over the simulation modules (p < 0.001). Finally, the evaluation of the behavioral component in the clinical setting showed a significant positive evolution over time (p < 0.001): in the end, all the students strongly agreed that behavioral competencies are crucial. Conclusions The impact of simulation on anesthesiology non-technical skills during residency is positive and recognized by the students. Moreover, simulation also helps in the recognition of error, enriching the value of self-confidence and the crucial role of behavioral skills. ABBREVIATIONS BSC-CHUC: Biomedical Simulation Centre from Centro Hospitalar e Universitário de Coimbra.

Use of a simulation-based mastery learning curriculum to improve ultrasound-guided vascular access skills of pediatric anesthesiologists

BACKGROUND

Pediatric vascular access is inherently challenging due to the small caliber of children's vessels. Ultrasound-guided intravenous catheter insertion has been shown to increase success rates and decrease time to cannulation in patients with difficult intravenous access. Although proficiency in ultrasound-guided intravenous catheter insertion is a critical skill in pediatric anesthesia, there are no published competency-based training curricula.

AIMS

The objective of this study was to evaluate the performance of pediatric anesthesiologists who participated in a novel ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum.

METHODS

Pediatric anesthesia attendings, fellows, and rotating residents participated in the ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum from August 2019 to February 2020. The 2-hour curriculum consisted of participants first undergoing a simulated skills pretest followed by watching a video on ultrasound-guided intravenous catheter insertion and deliberate practice on a simulator. Subsequently, all participants took a post-test and were required to meet or exceed a minimum passing standard. Those who were unable to meet the minimum passing standard participated in further practice until they could be retested and met this standard. We compared pre to post-test ultrasound-guided intravenous catheter insertion skills and self-confidence before and after participation in the curriculum.

RESULTS

Twenty-six pediatric anesthesia attendings, 12 fellows, and 38 residents participated in the curriculum. At pretest, 16/76 (21%) participants were able to meet or exceed the minimum passing standard. The median score on the pretest was 21/25 skills checklist items correct and improved to 24/25 at post-test (95% CI 3.0-4.0, P < .01). Self-confidence significantly improved after the course from an average of 3.2 before the course to a postcourse score of 3.9 (95% CI 0.5-0.9, P < .01; 1 = Not all confident, 5 = Very confident).

CONCLUSIONS

Simulation-based mastery learning significantly improved anesthesiologists' ultrasound-guided intravenous catheter insertion performance in a simulated setting.

A Narrative Review of Interventions to Teach Medical Students How to Break Bad News

Breaking bad news (BBN) is a key advanced communication skill that physicians must learn. Despite the breadth of literature describing patients' preferences and data citing poor physician competency in this arena, there remains significant dissatisfaction with how doctors deliver bad news. One way to solve this dilemma is to ensure that we are using the best evidence-based educational approaches to train the cadre of medical students who graduate from medical school each year. This article provides a 15-year review of articles on BBN in the undergraduate medical education curriculum that have been validated using the Medical Education Research Quality Instrument (MERSQI) (Acad Med 90:1067-76, 2015). This narrative review aims to identify articles which describe undergraduate medical education curriculum that evaluate how to best teach students to communicate bad news to patients. In the process, the authors reviewed 179 abstracts in 118 academic journals. Articles that met the inclusion criteria were evaluated using the MERSQI and those that scored higher than 11.3 were chosen for analysis. This paper summarizes the 15 articles that met the criteria. The review reveals (1) standard components which should be included in an undergraduate BBN curriculum, (2) a pressing need for utilizing a teaching and evaluation tool that incorporates nonverbal communication, and (3) a further need to test long-term curriculum retention.

Promoting Readiness for Residency: Embedding Simulation-Based Mastery Learning for Breaking Bad News Into the Medicine Subinternship

PURPOSE

It is challenging to add rigorous, competency-based communication skills training to existing clerkship structures. The authors embedded a simulation-based mastery learning (SBML) curriculum into a medicine subinternship to demonstrate feasibility and determine the impact on the foundational skill of breaking bad news (BBN).

METHOD

All fourth-year students enrolled in a medicine subinternship at Northwestern University Feinberg School of Medicine from September 2017 through August 2018 were expected to complete a BBN SBML curriculum. First, students completed a pretest with a standardized patient using a previously developed BBN assessment tool. Learners then participated in a 4-hour BBN skills workshop with didactic instruction, focused feedback, and deliberate practice with simulated patients. Students were required to meet or exceed a predetermined minimum passing standard (MPS) at posttest. The authors compared pretest and posttest scores to evaluate the effect of the intervention. Participant demographic characteristics and course evaluations were also collected.

RESULTS

Eighty-five students were eligible for the study, and 79 (93%) completed all components. Although 55/79 (70%) reported having personally delivered serious news to actual patients, baseline performance was poor. Students' overall checklist performance significantly improved from a mean of 65.0% (SD = 16.2%) items correct to 94.2% (SD = 5.9%; P < .001) correct. There was also statistically significant improvement in scaled items assessing quality of communication, and all students achieved the MPS at mastery posttest. All students stated they would recommend the workshop to colleagues.

CONCLUSIONS

It is feasible to embed SBML into a required clerkship. In the context of this study, rigorous SBML resulted in uniformly high levels of skill acquisition, documented competency, and was positively received by learners.

Development of the Uncertainty Communication Checklist: A Patient-Centered Approach to Patient Discharge From the Emergency Department

Clear communication with patients upon emergency department (ED) discharge is important for patient safety during the transition to outpatient care. Over one-third of patients are discharged from the ED with diagnostic uncertainty, yet there is no established approach for effective discharge communication in this scenario. From 2017 to 2019, the authors developed the Uncertainty Communication Checklist for use in simulation-based training and assessment of emergency physician communication skills when discharging patients with diagnostic uncertainty. This development process followed the established 12-step Checklist Development Checklist framework and integrated patient feedback into 6 of the 12 steps. Patient input was included as it has potential to improve patient-centeredness of checklists related to assessment of clinical performance. Focus group patient participants from 2 clinical sites were included: Thomas Jefferson University Hospital, Philadelphia, PA, and Northwestern University Hospital, Chicago, Illinois.The authors developed a preliminary instrument based on existing checklists, clinical experience, literature review, and input from an expert panel comprising health care professionals and patient advocates. They then refined the instrument based on feedback from 2 waves of patient focus groups, resulting in a final 21-item checklist. The checklist items assess if uncertainty was addressed in each step of the discharge communication, including the following major categories: introduction, test results/ED summary, no/uncertain diagnosis, next steps/follow-up, home care, reasons to return, and general communication skills. Patient input influenced both what items were included and the wording of items in the final checklist. This patient-centered, systematic approach to checklist development is built upon the rigor of the Checklist Development Checklist and provides an illustration of how to integrate patient feedback into the design of assessment tools when appropriate.

A long-term evaluation of a training program on breaking bad news in pediatric neurosurgery: a pilot study

OBJECTIVE

Breaking bad news is a difficult task in medical practice. Several breaking-bad-news training programs have been proposed. However, long-term results of such training have rarely been investigated. The aim of this study was to compare the short- and long-term evaluations by young neurosurgeons of a training program for breaking bad news to patients and their parents.

METHODS

Between 2012 and 2015, pediatric neurosurgery residents participated in a training day on breaking bad news in pediatric neurosurgery with professional actors. A personal debriefing, followed by a theoretical session, completed the training. Immediate feedback was evaluated through a survey administered at the end of the day. Long-term results were explored via an online form sent at least 3 years after the training completion.

RESULTS

Seventeen participants from 9 different countries were interviewed. Their immediate feedback confirmed their interest. For 71% of them, the program was very interesting, and 77% were extremely satisfied or very satisfied. All trainees wanted more training sessions. At a mean of 4.5 years of follow-up (range 3-6 years), 71% of the trainees fully remembered the session. Most of them (86%) reported a positive impact of the training on their career. Only 21% had another training session on breaking bad news during their residency. At long-term analysis, fewer trainees considered the duration of the training to have been sufficient (p = 0.044).

CONCLUSIONS

Breaking-bad-news training has a positive long-term educational impact even several years later. Such a training program should be implemented into pediatric neurosurgery residency.

Simulation-based mastery learning compared to standard education for discussing diagnostic uncertainty with patients in the emergency department: a randomized controlled trial

BACKGROUND

Diagnostic uncertainty occurs frequently in emergency medical care, with more than one-third of patients leaving the emergency department (ED) without a clear diagnosis. Despite this frequency, ED providers are not adequately trained on how to discuss diagnostic uncertainty with these patients, who often leave the ED confused and concerned. To address this training need, we developed the Uncertainty Communication Education Module (UCEM) to teach physicians how to discuss diagnostic uncertainty. The purpose of the study is to evaluate the effectiveness of the UCEM in improving physician communications.

METHODS

The trial is a multicenter, two-arm randomized controlled trial designed to teach communication skills using simulation-based mastery learning (SBML). Resident emergency physicians from two training programs will be randomly assigned to immediate or delayed receipt of the two-part UCEM intervention after completing a baseline standardized patient encounter. The two UCEM components are: 1) a web-based interactive module, and 2) a smart-phone-based game. Both formats teach and reinforce communication skills for patient cases involving diagnostic uncertainty. Following baseline testing, participants in the immediate intervention arm will complete a remote deliberate practice session via a video platform and subsequently return for a second study visit to assess if they have achieved mastery. Participants in the delayed intervention arm will receive access to UCEM and remote deliberate practice after the second study visit. The primary outcome of interest is the proportion of residents in the immediate intervention arm who achieve mastery at the second study visit.

DISCUSSION

Patients' understanding of the care they received has implications for care quality, safety, and patient satisfaction, especially when they are discharged without a definitive diagnosis. Developing a patient-centered diagnostic uncertainty communication strategy will improve safety of acute care discharges. Although use of SBML is a resource intensive educational approach, this trial has been deliberately designed to have a low-resource, scalable intervention that would allow for widespread dissemination and uptake.

TRIAL REGISTRATION

The trial was registered at clinicaltrials.gov (NCT04021771). Registration date: July 16, 2019.

"I'd Want to Know, Because a Year's Not a Long Time to Prepare for a Death": Role of Prognostic Information in Shared Decision Making among Women with Metastatic Breast Cancer

Context: Increasing emphasis on patient-centered care has led to highlighted importance of shared decision making, which better aligns medical decisions with patient care preferences. Effective shared decision making in metastatic breast cancer (MBC) treatment requires prognostic understanding, without which patients may receive treatment inconsistent with personal preferences. Objectives: To assess MBC patient and provider perspectives on the role of prognostic information in treatment decision making. Methods: We conducted semi-structured interviews with MBC patients and community oncologists and separate focus groups involving lay navigators, nurses, and academic oncologists. Qualitative analysis utilized a content analysis approach that included a constant comparative method to generate themes. Results: Of 20 interviewed patients with MBC, 30% were African American. Academic oncologists were mostly women (60%), community oncologists were all Caucasian, and nurses were all women and 28% African American. Lay navigators were all African American and predominately women (86%). Five emergent themes were identified. (1) Most patients wanted prognostic information but differed in when they wanted to have this conversation, (2) Emotional distress and discomfort was a critical reason for not discussing prognosis, (3) Religious beliefs shaped preferences for prognostic information, (4) Health care professionals differed on prognostic information delivery timing, and (5) Providers acknowledged that an individualized approach taking into account patient values and preferences would be beneficial. Conclusion: Most MBC patients wanted prognostic information, yet varied in when they wanted this information. Understanding why patients want limited or unrestricted prognostic information can inform oncologists' efforts toward shared decision making.

Setting a Minimum Passing Standard for the Uncertainty Communication Checklist Through Patient and Physician Engagement

BACKGROUND

Historically, medically trained experts have served as judges to establish a minimum passing standard (MPS) for mastery learning. As mastery learning expands from procedure-based skills to patient-centered domains, such as communication, there is an opportunity to incorporate patients as judges in setting the MPS.

OBJECTIVE

We described our process of incorporating patients as judges to set the MPS and compared the MPS set by patients and emergency medicine residency program directors (PDs).

METHODS

Patient and physician panels were convened to determine an MPS for a 21-item Uncertainty Communication Checklist. The MPS for both panels were independently calculated using the Mastery Angoff method. Mean scores on individual checklist items with corresponding 95% confidence intervals were also calculated for both panels and differences analyzed using a t test.

RESULTS

Of 240 eligible patients and 42 eligible PDs, 25 patients and 13 PDs (26% and 65% cooperation rates, respectively) completed MPS-setting procedures. The patient-generated MPS was 84.0% (range 45.2-96.2, SD 10.2) and the physician-generated MPS was 88.2% (range 79.7-98.1, SD 5.5). The overall MPS, calculated as an average of these 2 results, was 86.1% (range 45.2-98.1, SD 9.0), or 19 of 21 checklist items.

CONCLUSIONS

Patients are able to serve as judges to establish an MPS using the Mastery Angoff method for a task performed by resident physicians. The patient-established MPS was nearly identical to that generated by a panel of residency PDs, indicating similar expectations of proficiency for residents to achieve skill "mastery."