I like what you are saying, but only if i feel safe: Psychological safety moderates the relationship between voice and perceived contribution to healthcare team effectiveness

Introduction

Are nurses who voice work-related concerns viewed as positive contributors to a team? We propose that the extent to which healthcare professionals consider voice by nurses as helpful for the team depends on how psychologically safe they feel. Specifically, we hypothesized that psychological safety moderates the relationship between voice of a lower ranking team member (i.e., a nurse) and perceived contribution by others, such that voice is more likely to be seen as valuable for team decision-making when psychological safety is high but not when it is low.

Methods

We tested our hypotheses with a randomized between-subjects experiment using a sample of emergency medicine nurses and physicians. Participants evaluated a nurse who either did or did not speak up with alternative suggestions during emergency patient treatment.

Results

Results confirmed our hypotheses: At higher levels of psychological safety the nurse's voice was considered as more helpful than withholding of voice for team decision-making. This was not the case at lower levels of psychological safety. This effect was stable when including important control variables (i.e., hierarchical position, work experience, gender).

Discussion

Our results shed light on how evaluations of voice are contingent on perceptions of a psychologically safe team context.

Teaching, coaching, or debriefing With Good Judgment: a roadmap for implementing “With Good Judgment” across the SimZones

Simulation-based learning occurs in multiple contexts, and one teaching style cannot adequately cover the needs at each learning level. For example, reflective debriefing, often used following a complex simulation case, is not what is needed when learning new skills. When to use which facilitation style is a question that educators often overlook or struggle to determine. SimZones is a framework used to clarify the multiple contexts in simulation. This framework, combined with elements of Debriefing With Good Judgment, can help educators match the appropriate facilitation style with learner needs and learning context. We have distilled the core elements of the “with good judgment” approach to debriefing and applied them to the SimZones framework to guide educators with (1) what type of learning can be expected with each learning context, (2) what behaviors and activities can be expected of the learners in each learning context, (3) what instructional strategies are most effectively used at each stage, and (4) what are the implications for the teacher-learner relationship.

Accreditation of Simulation Fellowships and Training Programs: More Checkboxes or Elevating the Field?

SUMMARY STATEMENT

As the field of healthcare simulation matures, formal accreditation for simulation fellowships and training programs has become increasingly available and touted as a solution to standardize the education of those specializing in healthcare simulation. Some simulation experts hold opposing views regarding the potential value of simulation fellowship program accreditation. We report on the proceedings of a spirited debate at the 20th International Meeting on Simulation in Healthcare in January 2020. Pro arguments view accreditation as the logical evolution of a maturing profession: improving training quality through standard setting, providing external validation for individual programs, and enhancing the program's return on investment. Con arguments view accreditation as an incompletely formulated construct; burdensome to the "financially strapped" fellowship director, misaligned with simulation fellows' needs and expectations, and confusing to administrators mistakenly equating accreditation with credentialing. In addition, opponents of accreditation postulate that incorporating curricular standards, practice guidelines, and strategies derived and implemented without rigor, supporting evidence and universal consensus is premature. This narrative review of our debate compares and contrasts contemporary perspectives on simulation fellowship program accreditation, concluding with formal recommendations for learners, administrators, sponsors, and accrediting bodies.

Critical event debriefing: a checklist for the aftermath

PURPOSE OF REVIEW

Millions of perioperative crises (e.g. anaphylaxis, cardiac arrest) may occur annually. Critical event debriefing can offer benefits to the individual, team, and system, yet only a fraction of perioperative critical events are debriefed in real-time. This publication aims to review evidence-based best practices for proximal critical event debriefing.

RECENT FINDINGS

Evidence-based key processes to consider for proximal critical event debriefing can be summarized by the WATER mnemonic: Welfare check (assessing team members' emotional and physical wellbeing to continue providing care); Acute/short-term corrections (matters to be addressed before the next case); Team reactions and reflections (summarizing case; listening to team member reactions; plus/delta conversation); Education (lessons learned from the event and debriefing); Resource awareness and longer term needs [follow-up (e.g. safety/quality improvement report), local peer-support and employee assistance resources]. A cognitive aid to accompany this mnemonic is provided with the publication.

SUMMARY

There is growing literature on how to conduct proximal perioperative critical event debriefing. Evidence-based best practices, as well as a cognitive aid to apply them, may help bridge the gap between theory and clinical practice. In this era of increased attention to burnout and wellness, the consideration of interventions to improve the quality and frequency of critical event debriefing is paramount.

Clinical debriefing during the COVID-19 pandemic: hurdles and opportunities for healthcare teams

The COVID-19 pandemic and the subsequent pressures on healthcare staff and resources have exacerbated the need for clinical teams to reflect and learn from workplace experiences. Surges in critically ill patients, the impact of the disease on the workforce and long term adjustments in work and life have upturned our normality. Whilst this situation has generated a new 'connectedness' within healthcare workers, it also continues to test our resilience.An international multi-professional collaboration has guided the identification of ongoing difficulties to effective communication and debriefing, as well as emerging opportunities to promote a culture of dialogue. This article outlines pandemic related barriers and new possibilities categorising them according to task management, teamwork, situational awareness and decision making. It describes their direct and indirect impact on clinical debriefing and signposts towards solutions to overcome challenges and, building on new bridges, advance team conversations that allow us to learn, improve and support each other.This pandemic has brought clinical professionals together; nevertheless, it is essential to invest in further developing and supporting cohesive teams. Debriefing enables healthcare teams and educators to mitigate stress, build resilience and promote a culture of continuous learning and patient care improvement.

Self-directed video versus instructor-based neonatal resuscitation training: a randomized controlled blinded non-inferiority multicenter international study

OBJECTIVE

To compare the efficacy of video-assisted self-directed neonatal resuscitation skills course with video-assisted facilitator-led course.

METHODS

This multicenter, randomized, blinded, non-inferiority-controlled trial compared two methods of teaching basic neonatal resuscitation skills using mask ventilation. Groups of novice providers watched an instructional video. One group received instructor facilitation (Ins-Video). The other group did not (Self-Video). An Objective Structured Clinical Exam (OSCE) measured skills performance, and a written test gauged knowledge.

RESULTS

One hundred and thirty-four students completed the study. Sixty-three of 68 in the Self-Video Group (92.6%) and 59 of 66 in the Ins-Video Group (89.4%) achieved post-training competency in positive pressure ventilation (primary outcome). OSCE passing rates were low in both groups. Knowledge survey scores were comparable between groups and non-inferior.

CONCLUSIONS

Video self-instruction taught novice providers positive pressure ventilation skills and theoretical knowledge, but it was insufficient for mastery of basic neonatal resuscitation in simulation environment.

Development and implementation of an end-of-shift clinical debriefing method for emergency departments during COVID-19

BACKGROUND

Multiple guidelines recommend debriefing after clinical events in the emergency department (ED) to improve performance, but their implementation has been limited. We aimed to start a clinical debriefing program to identify opportunities to address teamwork and patient safety during the COVID-19 pandemic.

METHODS

We reviewed existing literature on best-practice guidelines to answer key clinical debriefing program design questions. An end-of-shift huddle format for the debriefs allowed multiple cases of suspected or confirmed COVID-19 illness to be discussed in the same session, promoting situational awareness and team learning. A novel ED-based clinical debriefing tool was implemented and titled Debriefing In Situ COVID-19 to Encourage Reflection and Plus-Delta in Healthcare After Shifts End (DISCOVER-PHASE). A facilitator experienced in simulation debriefings would facilitate a short (10-25 min) discussion of the relevant cases by following a scripted series of stages for debriefing. Data on the number of debriefing opportunities, frequency of utilization of debriefing, debriefing location, and professional background of the facilitator were analyzed.

RESULTS

During the study period, the ED treated 3386 suspected or confirmed COVID-19 cases, with 11 deaths and 77 ICU admissions. Of the 187 debriefing opportunities in the first 8-week period, 163 (87.2%) were performed. Of the 24 debriefings not performed, 21 (87.5%) of these were during the four first weeks (21/24; 87.5%). Clinical debriefings had a median duration of 10 min (IQR 7-13). They were mostly facilitated by a nurse (85.9%) and mainly performed remotely (89.8%).

CONCLUSION

Debriefing with DISCOVER-PHASE during the COVID-19 pandemic were performed often, were relatively brief, and were most often led remotely by a nurse facilitator. Future research should describe the clinical and organizational impact of this DISCOVER-PHASE.

Bolstering clinician resilience through an interprofessional, web-based nightly debriefing program for emergency departments during the COVID-19 pandemic

The COVID-19 pandemic has instigated significant changes for health care systems. With clinician burnout rising, efforts to promote clinician resilience are essential. Within this quality improvement project, an interprofessional debriefing program (Brigham Resilience in COVID-19-pandemic Emergency Forum-BRIEF) was developed within two emergency departments (EDs). An interprofessional group of ED providers led optional, nightly debriefings using a web-based portal to connect with ED clinicians for six weeks. In total, 81 interprofessional staff participated in nightly debriefings with a 47% attendance rate. On average, three participants attended the BRIEF nightly (range = 2-8) to discuss the challenges of social distancing, scarce resources, high acuity, clinician burnout and mental health. Participation increased as rates of COVID-19 positive patients rose. Debriefing leaders provided ED leadership with summaries of clinician experiences and suggestions for improvements. Feedback supported quality improvement initiatives within the ED and greater mental health support for staff. Clinicians and administrators provided positive feedback regarding the program's impact on clinician morale, and clinical processes that promoted the safety and quality of patient care. Optional debriefing with receptive departmental leadership may be a successful tool to support clinicians and hospitals during critical events.

COVID-19 crisis, safe reopening of simulation centres and the new normal: food for thought

Background

The world is facing a massive burden from the coronavirus disease 2019 (COVID-19) pandemic. Governments took the extraordinary step of locking down their own countries to curb the spread of the coronavirus. After weeks of severe restrictions, countries have begun to relax their strict lockdown measures. However, reopening will not be back to normal.

Simulation facilities (SF) are training spaces that enable health professionals and students to learn skills and procedures in a safe and protected environment. Today’s clinicians and students have an expectation that simulation laboratories are part of lifelong healthcare education. There is great uncertainty about how COVID-19 will impact future training in SF. In particular, the delivery of training activities will benefit of adequate safety measures implemented for all individuals involved.

This paper discusses how to safely reopen SF in the post-lockdown phase.

Main body

The paper outlines 10 focus points and provides operational tips and recommendations consistent with current international guidelines to reopen SF safely in the post-lockdown phase. Considering a variety of national advices and regulations which describe initial measures for the reopening of workplaces as well as international public health recommendations, we provide points of reflection that can guide decision-makers and SF leaders on how to develop local approaches to specific challenges. The tips have been laid out taking also into account two main factors: (a) the SF audience, mainly consisting of undergraduate and postgraduate healthcare professionals, who might face exposure to COVID-19 infection, and (b) for many simulation-based activities, such as teamwork training, adequate physical distancing cannot be maintained.

Conclusions

The planning of future activities will have to be based not only on safety but also on flexibility principles.

Sharing common methods consistent with national and international health guidelines, while taking into account the specific characteristics of the different contexts and centres, will ultimately foster dissemination of good practices.

This article seeks to further the conversation. It is our hope that this manuscript will prompt research about the impact of such mitigation procedures and measures in different countries.

Efficacy of a Short Role-Play Training on Breaking Bad News in the Emergency Department

Introduction

Breaking bad news (BBN) in the emergency department (ED) represents a challenging and stressful situation for physicians. Many medical students and residents feel stressed and uncomfortable with such situations because of insufficient training. Our randomized controlled study aimed to assess the efficacy of a four-hour BBN simulation-based training on perceived self-efficacy, the BBN process, and communication skills.

Methods

Medical students and residents were randomized into a 160-hour ED clinical rotation without a formal BBN curriculum (control group [CG], n = 31) or a 156-hour ED clinical rotation and a four-hour BBN simulation-based training (training group [TG], n = 37). Both groups were assessed twice: once at the beginning of the rotation (pre-test) and again four weeks later. Assessments included a BBN evaluation via a simulation with two actors playing family members and the completion of a questionnaire on self-efficacy. Two blinded raters assessed the BBN process with the SPIKES (a delivery protocol for delivering bad news) competence form and communication skills with the modified BBN Assessment Schedule.

Results

Group-by-time effects adjusted by study year revealed a significant improvement in TG as compared with CG on self-efficacy (P < 0.001), the BBN process (P < 0.001), and communication skills (P < 0.001). TG showed a significant gain regarding the BBN process (+33.3%, P < 0.001). After the training, students with limited clinical experience prior to the rotation showed BBN performance skills equal to that of students in the CG who had greater clinical experience.

Conclusion

A short BBN simulation-based training can be added to standard clinical rotations. It has the potential to significantly improve self-efficacy, the BBN process, and communication skills.

Neonatal resuscitation experience curves: simulation based mastery learning booster sessions and skill decay patterns among pediatric residents

Background Following neonatal resuscitation program (NRP) training, decay in clinical skills can occur. Simulation-based deliberate practice (SBDP) has been shown to maintain NRP skills to a variable extent. Our study objectives were (a) to determine whether a single 30 min simulation-based intervention that incorporates SBDP and mastery learning (ML) can effectively restore skills and prevent skill decay and (b) to compare different timing options. Methods Following NRP certification, pediatric residents were randomly assigned to receive a video-recorded baseline assessment plus SBDP-ML refresher education at between 6 and 9 months (early) or between 9 and 12 months (late). One year following initial certification, participants had repeat skill retention videotaped evaluations. Participants were scored by blinded NRP instructors using validated criteria scoring tools and assigned a global performance rating score (GRS). Results Twenty-seven participants were included. Residents in both early and late groups showed significant skill decay 7 and 10 months after initial NRP. SBDP-ML booster sessions significantly improved participants' immediate NRP performance scores (p<0.001), which persisted for 2 months, but were again lower 4 months later. Conclusions NRP skills may be boosted to mastery levels after a short SBDP-ML intervention and do not appear to significantly decline after 2 months. Brief booster training could potentially serve as a useful supplement to traditional NRP training for pediatric residents.

Improving the Clinical Skills Performance of Graduating Medical Students Using "WISE OnCall," a Multimedia Educational Module

INTRODUCTION

"Transitions to residency" programs are designed to maximize quality and safety of patient care, as medical students become residents. However, best instructional or readiness assessment practices are not yet established. We sought to study the impact of a screen-based interactive curriculum designed to prepare interns to address common clinical coverage issues (WISE OnCall) on the clinical skills demonstrated in simulation and hypothesize that performance would improve after completing the module.

METHODS

Senior medical students were recruited to participate in this single group prestudy/poststudy. Students responded to a call from a standardized nurse (SN) and assessed a standardized patient (SP) with low urine output, interacted with a 45-minute WISE OnCall module on the assessment and management of oliguria, and then evaluated a different SP with low urine output of a different underlying cause. Standardized patients assessed clinical skills with a 37-item, behaviorally anchored checklist measuring clinical skills (intraclass correlation coefficient [ICC], 0.55-0.81). Standardized nurses rated care quality and safety and collaboration and interprofessional communication using a 33-item literature-based, anchored checklist (ICC, 0.47-0.52). Standardized patient and SN ratings of the same student performance were correlated (r, 0.37-0.62; P < 0.01). Physicians assessed clinical reasoning quality based on the students' patient encounter note (ICC, 0.55-0.68), ratings that did not correlate with SP and SN ratings. We compared pre-post clinical skills performance and clinical reasoning. Fifty-two medical students (31%) completed this institutional review board -approved study.

RESULTS

Performance as measured by the SPs, SNs, and the postencounter note all showed improvement with mostly moderate to large effect sizes (range of Cohen's d, 0.30-1.88; P < 0.05) after completion of the online module. Unexpectedly, professionalism as rated by the SP was poorer after the module (Cohen's d, -0.93; P = 0.000).

DISCUSSION

A brief computer-based educational intervention significantly improved graduating medical students' clinical skills needed to be ready for residency.

A simulated "Night-onCall" to assess and address the readiness-for-internship of transitioning medical students

Transitioning medical students are anxious about their readiness-for-internship, as are their residency program directors and teaching hospital leadership responsible for care quality and patient safety. A readiness-for-internship assessment program could contribute to ensuring optimal quality and safety and be a key element in implementing competency-based, time-variable medical education. In this paper, we describe the development of the Night-onCall program (NOC), a 4-h readiness-for-internship multi-instructional method simulation event. NOC was designed and implemented over the course of 3 years to provide an authentic "night on call" experience for near graduating students and build measurements of students' readiness for this transition framed by the Association of American Medical College's Core Entrustable Professional Activities for Entering Residency. The NOC is a product of a program of research focused on questions related to enabling individualized pathways through medical training. The lessons learned and modifications made to create a feasible, acceptable, flexible, and educationally rich NOC are shared to inform the discussion about transition to residency curriculum and best practices regarding educational handoffs from undergraduate to graduate education.

Simulation Fellowship Programs: An International Survey of Program Directors

PURPOSE

To report on the evolution of simulation-based training (SBT) by identifying the composition and infrastructure of existing simulation fellowship programs, describing the current training practices, disclosing existing program barriers, and highlighting opportunities for standardization.

METHOD

Investigators conducted a cross-sectional survey study among English-speaking simulation fellowship program directors (September 2014-September 2015). They identified fellowships through academic/institutional Web sites, peer-reviewed literature, Web-based search engines, and snowball sampling. They invited programs to participate in the Web-based questionnaire via e-mail and follow-up telephone calls.

RESULTS

Forty-nine programs met the inclusion criteria. Of these, 32 (65%) responded to the survey. Most programs were based in the United States, but others were from Canada, England, and Australia. Over half of the programs started in or after 2010. Across all 32 programs, 186 fellows had graduated since 1998. Fellows and directors were primarily departmentally funded; programs were primarily affiliated with hospitals and/or medical schools, many of which had sponsoring centers accredited by governing bodies. Fellows were typically medical trainees; directors were typically physicians. The majority of programs (over 90%) covered four core objectives, and all endorsed similar educational outcomes. Respondents identified no significant universal barriers to program success. Most directors (18/28 [64%]) advocated standardized fellowship guidelines on a national level.

CONCLUSIONS

Paralleling the fast growth and integration of SBT, fellowship training opportunities have grown rapidly in the United States, Canada, and beyond. This study highlights potential areas for standardization and accreditation of simulation fellowships which would allow measurable competencies in graduates.

A collaborative clinical simulation model for the development of competencies by medical students

Herein, we present a new collaborative clinical simulation (CCS) model for the development of medical competencies by medical students. The model is a comprehensive compendium of published considerations and recommendations on clinical simulation (CS) and computer-supported collaborative learning (CSCL). Currently, there are no educational models combining CS and CSCL. The CCS model was designed for the acquisition and assessment of clinical competencies; working collaboratively and supported by technology, small groups of medical students independently design and perform simulated cases. The model includes four phases in which the learning objectives, short case scenarios, materials, indices, and the clinical simulation are designed, monitored, rated and debriefed.

Assessment of Developmental Progress Using an Objective Structured Clinical Examination-Simulation Hybrid Examination for Obstetrics and Gynecology Residents

OBJECTIVE

The Test of Integrated Professional Skills (TIPS) is an objective structured clinical examination-simulation hybrid examination that assesses resident integration of technical, cognitive, and affective skills in Obstetrics and Gynecology (OBGYN) residents. The aim of this study was to analyze performance patterns and reactions of residents to the test to understand how it may fit within a comprehensive assessment program.

DESIGN

A retrospective, mixed methods review of the design and implementation of the examination, patterns of performance of trainees at different levels of training, focus group data, and description of use of TIPS results for resident remediation and curriculum development.

SETTING

OBGYN residents at New York University Langone Medical Center, a tertiary-care, urban academic health center.

PARTICIPANTS

OBGYN residents in all years of training, postgraduate year-1 through postgraduate year, all residents completing the TIPS examination and consenting to participate in focus groups were included.

RESULTS

In all, 24 residents completed the TIPS examination. Performance on the examination varied widely among individuals at each stage of training, and did not follow developmental trends, except for technical skills. Cronbach α for both standardized patient and faculty ratings ranged from 0.69 to 0.84, suggesting internal consistency. Focus group results indicated that residents respond to the TIPS examination in complex ways, ranging from anxiety about performance to mixed feelings about how to use the data for their learning.

CONCLUSION

TIPS assesses a range of attributes, and can support both formative and summative evaluation. Lack of clear developmental differences and wide variation in performance by learners at the same level of training support the argument for individualized learning plans and competency-based education.

Development and Validation of an Assessment Tool for Competency in Critical Care Ultrasound

BACKGROUND

Point-of-care ultrasound is an emerging technology in critical care medicine. Despite requirements for critical care medicine fellowship programs to demonstrate knowledge and competency in point-of-care ultrasound, tools to guide competency-based training are lacking.

OBJECTIVE

We describe the development and validity arguments of a competency assessment tool for critical care ultrasound.

METHODS

A modified Delphi method was used to develop behaviorally anchored checklists for 2 ultrasound applications: "Perform deep venous thrombosis study (DVT)" and "Qualify left ventricular function using parasternal long axis and parasternal short axis views (Echo)." One live rater and 1 video rater evaluated performance of 28 fellows. A second video rater evaluated a subset of 10 fellows. Validity evidence for content, response process, and internal consistency was assessed.

RESULTS

An expert panel finalized checklists after 2 rounds of a modified Delphi method. The DVT checklist consisted of 13 items, including 1.00 global rating step (GRS). The Echo checklist consisted of 14 items, and included 1.00 GRS for each of 2 views. Interrater reliability evaluated with a Cohen kappa between the live and video rater was 1.00 for the DVT GRS, 0.44 for the PSLA GRS, and 0.58 for the PSSA GRS. Cronbach α was 0.85 for DVT and 0.92 for Echo.

CONCLUSIONS

The findings offer preliminary evidence for the validity of competency assessment tools for 2 applications of critical care ultrasound and data on live versus video raters.

Beyond the simulation laboratory: a realist synthesis review of clinical outcomes of simulation-based mastery learning

PURPOSE

Translational educational outcomes have been defined as starting in simulation laboratories (T1) and moving downstream to improved patient care practices (T2), patient outcomes (T3), and cost/other value outcomes (T4). The authors conducted a realist synthesis review of the literature to evaluate the translational effect of simulation-based mastery learning (SBML) principles beyond the laboratory. They also sought to address future directions in SBML to improve patient care processes and outcomes and, thus, the quality of health care delivery.

METHOD

The authors searched multiple databases for simulation-based medical education (SBME) studies published through April 2013. They screened articles using the PICO method-population (P), intervention (I), control (C), outcome (O)-to answer the research question: For (P) any health care providers, does the (I) implementation of SBML training, compared with (C) other training methodologies or no extra training, result in (O) a change in patient care practices or T2-T4 outcomes? Studies implementing SBME interventions with training methodologies that met all SBML principles and reporting T2-T4 outcomes were identified.

RESULTS

The 14 included studies used pre/post or cohort study designs; the majority were limited to individual performance and procedural competency. They reported improvement after SBML training in procedure performance, task success, patient discomfort, procedure time, complication rates, or T4 impacts (e.g., cost reduction).

CONCLUSIONS

Findings suggest health professions education conducted using SBML methodology can improve patient care processes and outcomes. Further research is needed to understand the translational impact of SBML for nontechnical skills, including teamwork, and skill retention.

Bedside ultrasound curriculum for medical students: report of a blended learning curriculum implementation and validation

BACKGROUND

Medical students on clinical rotations rarely receive formal bedside ultrasound (BUS) training. We designed, implemented, and evaluated a standardized BUS curriculum for medical students on their Emergency Medicine (EM) rotation. Teaching was aimed toward influencing four cognitive and psychomotor learning domains: BUS instrumentation knowledge, image interpretation, image acquisition, and procedural guidance.

METHODS

Participants viewed three instructional Web-based tutorials on BUS instrumentation, the Focused Assessment for Sonography in Trauma (FAST) examination and ultrasound-guided central venous catheter (CVC) placement. Subsequently, participants attended a 3-hour hands-on training session to discuss the same content area and practice with faculty coaches. A Web-based, multiple-choice questionnaire was administered before and after the session. During the final week of the rotation, students returned for skills assessments on FAST image acquisition and CVC placement.

RESULTS

Forty-five medical students on an EM rotation were enrolled. Sonographic knowledge overall mean score improved significantly from 66.6% (SD ±11.2) to 85.7% (SD ±10.0), corresponding to a mean difference of 19.1% (95% CI 15.5-22.7; p < 0.001). There were high pass rates for FAST (89.0%, 40/45) and CVC (96.0%, 43/45) skills assessments. There was no significant difference between medical student posttest and EM resident test scores 85.7% (SD ±10.0) and 88.1% (SD ± 7.6) (p = 0.40), respectively.

CONCLUSIONS

A formal BUS curriculum for medical students on EM rotation positively influenced performance in several key learning domains. As BUS competency is required for residency in EM and other specialties, medical schools could consider routinely incorporating BUS teaching into their clinical rotation curricula.

Notes from the Field: Residents' Perceptions of Simulation-Based Skills Assessment in Obstetrics and Gynecology

Simulation in obstetrics and gynecology (OBGYN) training captures a range of interpersonal, cognitive, and technical skills. However, trainee perspectives on simulation-based assessment remain unexplored. After an observed structured clinical examination (OSCE) simulation hybrid exam, two focus groups of residents were conducted. Analysis grounded in a thematic coding guided the qualitative research process. Responses suggest a valuation of cognitive and technical skills over interpersonal skills. Realism was seen as critical and residents perceived the assessment as more valuable for the educator than the learner. Feedback was highly valued. Resident perspectives on this exam give insight into their perceptions of simulation-based assessment as well as their conceptions of their own learning through simulations.

What's your best time? Chronometry in the learning of medical procedures

OBJECTIVES

Most medical procedures have a time element. It is uncommon, however, to explicitly use chronometry, the measurement of time, in the learning of these procedures. This study considered whether instructional designs that include chronometry could improve deliberate practice and be used in meaningful formative assessments.

METHODS

A selective review of the medical education literature was undertaken to identify how chronometry was used in a broad sampling of medical education research in the learning of medical procedures. We identified prior publications in which time measurement was used either directly as a pedagogic intervention or as an assessment method in a medical school programme.

RESULTS

Our review suggests a number of desirable features of chronometry. For the individual learner, procedural time measurements can demonstrate both improving ability and increasing consistency. Chronometry can enhance instructional designs involving deliberate practice by facilitating overlearning (i.e. learning that goes beyond minimum competence), increasing the challenge level and enhancing self-regulation of learning (e.g. self-competition). Breaking down chronometric data into meaningful interval or split times might further inform instructional designs.

CONCLUSIONS

Chronometry has the potential to contribute to instructional designs and assessment methods in medical procedures training. However, more research is needed to elucidate its full potential and describe possible negative consequences of this widely available but underutilised educational tool.

Test of integrated professional skills: objective structured clinical examination/simulation hybrid assessment of obstetrics-gynecology residents' skill integration

BACKGROUND

Assessment of obstetrics-gynecology residents' ability to integrate clinical judgment, interpersonal skills, and technical ability in a uniform fashion is required to document achievement of benchmarks of competency. An observed structured clinical examination that incorporates simulation and bench models uses direct observation of performance to generate formative feedback and standardized evaluation.

METHODS

The Test of Integrated Professional Skills (TIPS) is a 5-station performance-based assessment that uses standardized patients and complex scenarios involving ultrasonography, procedural skills, and evidence-based medicine. Standardized patients and faculty rated residents by using behaviorally anchored checklists. Mean scores reflecting performance in TIPS were compared across competency domains and by developmental level (using analysis of variance) and then compared to standard faculty clinical evaluations (using Spearman ρ). Participating faculty and residents were also asked to evaluate the usefulness of the TIPS.

RESULTS

Twenty-four residents participated in the TIPS. Checklist items used to assess competency were sufficiently reliable, with Cronbach α estimates from 0.69 to 0.82. Performance improved with level of training, with wide variation in performance. Standard faculty evaluations did not correlate with TIPS performance. Several residents who were rated as average or above average by faculty performed poorly on the TIPS (> 1 SD below the mean). Both faculty and residents found the TIPS format useful, providing meaningful evaluation and opportunity for feedback.

CONCLUSIONS

A simulation-based observed structured clinical examination facilitates observation of a range of skills, including competencies that are difficult to observe and measure in a standardized way. Debriefing with faculty provides an important interface for identification of performance gaps and individualization of learning plans.

The making of expert clinicians: reflective practice

Debriefing is a rigorous reflection process which helps trainees recognize and resolve clinical and behavioral dilemmas raised by a clinical case. This approach emphasizes eliciting trainees'assumptions about the situation and their reasons for performing as they did (mental models). It analyses their impact on actions, to understand if it is necessary to maintain them or construct new ones that may lead to better performance in the future. It blends evidence and theory from education research, the social and cognitive sciences, and experience drawn from conducting and teaching debriefing to clinicians worldwide, on how to improve professional effectiveness through "reflective practice".

A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair

OBJECTIVES

Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency.

METHODS

Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station.

RESULTS

Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging.

CONCLUSIONS

Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.

Experience curves as an organizing framework for deliberate practice in emergency medicine learning

Deliberate practice is an important skill-training strategy in emergency medicine (EM) education. Learning curves display the relationship between practice and proficiency. Forgetting curves show the opposite, and demonstrate how skill decays over time when it is not reinforced. Using examples of published studies of deliberate practice in EM we list the properties of learning and forgetting curves and suggest how they can be combined to create experience curves: a longitudinal representation of the relationship between practice, skill acquisition, and decay over time. This framework makes explicit the need to avoid a piecemeal, episodic approach to skill practice and assessment in favor of more emphasis on what can be done to improve durability of competence over time. The authors highlight the implications for both educators and education researchers.

The emerging role of simulation education to achieve patient safety: translating deliberate practice and debriefing to save lives

Simulation-based educational processes are emerging as key tools for assessing and improving patient safety. Multidisciplinary or interprofessional simulation training can be used to optimize crew resource management and safe communication principles. There is good evidence that simulation training improves self-confidence, knowledge, and individual and team performance on manikins. Emerging evidence supports that procedural simulation, deliberate practice, and debriefing can also improve operational performance in clinical settings and can result in safer patient and population/system outcomes in selected settings. This article highlights emerging evidence that shows how simulation-based interventions and education contribute to safer, more efficient systems of care that save lives.

Developing and assessing initiatives designed to improve clinical teaching performance

To improve the teaching performance of emergency physicians, it is necessary to understand the attributes of expert teachers and the optimal methods to deliver faculty development. A working group of medical educators was formed to review the literature, summarize what is known on the topic, and provide recommendations for future research. This occurred as a track of the 2012 Academic Emergency Medicine (AEM) consensus conference "Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success." The group concluded that the current state of research on these topics is limited. Improvement in understanding will come through research focusing on Kirkpatrick's higher levels of evaluation (behavior and results).

What you see (sonographically) is what you get: vein and patient characteristics associated with successful ultrasound-guided peripheral intravenous placement in patients with difficult access

OBJECTIVES

Ultrasound (US) has been shown to facilitate peripheral intravenous (IV) placement in emergency department (ED) patients with difficult IV access (DIVA). This study sought to define patient and vein characteristics that affect successful US-guided peripheral IV placement.

METHODS

This was a prospective observational study of US-guided IV placement in a convenience sample of DIVA patients in an urban, tertiary care ED. DIVA patients were defined as having any of the following: at least two failed IV attempts or a history of difficult access plus the inability to visualize or palpate any veins on physical exam. Patient characteristics (demographic information, vital signs, and medical history) were collected on enrolled patients. The relationships between patient characteristics, vein depth and diameter, US probe orientation, and successful IV placement were analyzed.

RESULTS

A total of 169 patients were enrolled, with 236 attempts at access. Increasing vessel diameter was associated with a higher likelihood of success (odds ratio [OR] = 1.79 per 0.1-cm increase in vessel diameter, 95% confidence interval [CI] = 1.37 to 2.34). Increasing vessel depth did not affect success rates (OR = 0.96 per 0.1-cm increase of depth, 95% CI = 0.89 to 1.04) until a threshold depth of 1.6 cm, beyond which no vessels were successfully cannulated. Probe orientation and patient characteristics were unrelated to success.

CONCLUSIONS

Success was solely related to vessel characteristics detected with US and not influenced by patient characteristics or probe orientation. Successful DIVA was primarily associated with larger vessel, while vessel depth up to >1.6 cm and patient characteristics were unrelated to success. Clinically, if two vessels are identified at a depth of <1.6 cm, the larger diameter vessel, even if comparatively deeper, should yield the greatest likelihood of success.

Untreated hypertension and the emergency department: a chance to intervene?

OBJECTIVES

Untreated hypertension (HTN) is a major public health problem. Screening for untreated HTN in the emergency department (ED) may lead to appropriate treatment of more patients. The authors investigated the accuracy of identifying HTN in the ED, the proportion of ED patients with untreated HTN, patient characteristics predicting untreated HTN, and provider documentation of untreated HTN.

METHODS

The authors performed a retrospective cross-sectional study on a random sample of 2,061 adults treated at an urban academic ED. The validity of six candidate definitions of HTN in the ED was assessed in a subsample using outpatient clinic records as the reference standard. "Untreated HTN" was HTN without a HTN medication listed in the ED history. "Documentation of untreated HTN was documentation of HTN as a visit problem, specific referral for HTN, or ED discharge with a HTN" information sheet or a HTN medication. Multivariable logistic regression was used to determine associations.

RESULTS

The preferred definition of HTN in the ED had sensitivity of 86% (95% confidence interval [CI] = 80% to 90%), specificity of 78% (95% CI = 69% to 85%), and accuracy of 83% (95% CI = 78% to 87%). Of the 42% (95% CI = 40% to 44%) of ED patients with HTN, 43% (95% CI = 39% to 46%) had untreated HTN. Patients who were younger and male, without primary care physicians, with fewer prior ED visits, and without cardiovascular comorbidities, had higher odds of untreated HTN. Of those with untreated HTN, 8% (95% CI = 5% to 11%) had their untreated HTN documented.

CONCLUSIONS

Untreated HTN was common in the ED but rarely documented. Providers can use ED blood pressures along with patient characteristics to identify those with untreated HTN for referral to primary care.

Risk tolerance for the exclusion of potentially life-threatening diseases in the ED

OBJECTIVE

Given the same pretest probability (10%) for subarachnoid hemorrhage (SAH), pulmonary embolism (PE), and acute coronary syndrome (ACS), we determined if differences exist in the risk tolerance for disease exclusion according to published guidelines given a negative test result.

METHODS

Published guidelines that make practice recommendations on the evaluation of ACS, PE, and SAH were sought using the National Guideline Clearinghouse in low-risk settings. Second-order Monte Carlo simulation was performed to determine point estimates and confidence intervals (CIs) for posttest probabilities assuming a pretest probability of 10%.

RESULTS

Guidelines recommend that patients with low-risk suspected ACS should undergo stress testing. For SAH, computed tomography (CT) followed by lumbar puncture (LP) is recommended without mention of pretest probability; and D-dimer testing is recommended to exclude PE in low-risk patients. Test sensitivity for thallium-201 single photon emission computed tomography (SPECT) was 89%, exercise echocardiogram was 85%, D-dimer testing was 95%, and CT/LP for SAH was 100% (as a gold standard) and CT only was 97.5%. Given a negative test result, for PE, posttest probability was 0.5% (95% CI 0.1%-0.9%); for SPECT, 1.1% (SD 0.5%-1.6%); and for exercise echocardiogram, 1.5% (95% CI 0.5%-2.5%) compared with a posttest probability of 0% for CT followed by LP for SAH. Using a CT-only approach gives a posttest probability of 0.2% (95% CI 0.2%-0.4%).

CONCLUSIONS

Guidelines for suspected PE and ACS allow small but nonzero calculated risk end points in low-risk settings, whereas SAH guidelines afford no misses. Because many gold standard tests are more invasive and can have adverse effects, guideline authors should consider adopting a standard acceptable miss rate as an end point for workups with low clinical suspicion to avoid the overuse of invasive testing.