Twelve tips for developing simulation-based mastery learning clinical skills checklists

Simulation-based mastery learning is a powerful educational paradigm that leads to high levels of performance through a combination of strict standards, deliberate practice, formative feedback, and rigorous assessment. Successful mastery learning curricula often require well-designed checklists that produce reliable data that contribute to valid decisions. The following twelve tips are intended to help educators create defensible and effective clinical skills checklists for use in mastery learning curricula. These tips focus on defining the scope of a checklist using established principles of curriculum development, crafting the checklist based on a literature review and expert input, revising and testing the checklist, and recruiting judges to set a minimum passing standard. While this article has a particular focus on mastery learning, with the exception of the tips related to standard setting, the general principles discussed apply to the development of any clinical skills checklist.

Effect of Polypectomy Simulation-Based Mastery Learning on Skill Retention Among Practicing Endoscopists

PURPOSE

Practicing endoscopists frequently perform and teach screening colonoscopies and polypectomies, but there is no standardized method to train and assess physicians who perform polypectomy procedures. The authors created a polypectomy simulation-based mastery learning (SBML) curriculum and hypothesized that completion of the curriculum would lead to immediate improvement in polypectomy skills and skill retention at 6 and 12 months after training.

METHOD

The authors performed a pretest-posttest cohort study with endoscopists who completed SBML and were randomized to follow-up at 6 or 12 months from May 2021 to August 2022. Participants underwent SBML training, including a pretest, a video lecture, deliberate practice, and a posttest. All learners were required to meet or exceed a minimum passing standard on a 17-item skills checklist before completing training and were randomized to follow-up at 6 or 12 months. The authors compared simulated polypectomy skills performance on the checklist from pretest to posttest and posttest to 6- or 12-month follow-up test.

RESULTS

Twenty-four of 30 eligible participants (80.0%) completed the SBML intervention, and 20 of 24 (83.3%) completed follow-up testing. The minimum passing standard was set at 93% of checklist items correct. The pretest passing rate was 4 of 24 participants (16.7%) compared with 24 of 24 participants (100%) at posttest ( P < .001). There were no significant differences in passing rates from posttest to combined 6- and 12-month posttest in which 18 of 20 participants (90.0%) passed.

CONCLUSIONS

Before training and despite years of clinical experience, practicing endoscopists demonstrated poor performance of polypectomy skills. SBML was an effective method for practicing endoscopists to acquire and maintain polypectomy skills during a 6- to 12-month period.

Powerful medical education improves health care quality and return on investment

INTRODUCTION

Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness.

METHODS

This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations.

RESULTS

PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment.

CONCLUSIONS

The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care.

Performance of peripheral catheters inserted with ultrasound guidance versus landmark technique after a simulation-based mastery learning intervention

PROBLEM

Ultrasound-guided peripheral intravenous catheter (USGPIV) insertion is an effective method to gain vascular access in patients with difficult intravenous access (DIVA). While USGPIV success rates are reported to be high, some studies have reported a concerning incidence of USGPIV premature failures.

AIMS

The purpose of this study was to compare differences in USGPIV and landmark peripheral intravenous catheter (PIV) utilization and failure following a hospital-wide USGPIV training program for nurses.

METHODS

The authors performed a retrospective, electronic medical record review of all USGPIVs and PIVs inserted at a tertiary, urban, academic medical center from September 1, 2018, through September 30, 2019. The primary outcome was differences between USGPIV and PIV time to failure.

RESULTS

A total of 43,470 short peripheral intravenous catheters (PIVCs) were inserted in 23,713 patients. Of these, 7972 (16.8%) were USGPIV. At 30 days of follow-up, for PIVCs with an indication for removal documented, USGPIVs had higher Kaplan-Meier survival probabilities than PIVs (p < 0.001).

CONCLUSIONS

The use of simulation-based mastery associated with USGPIVs, demonstrated lower failure rates than standard PIVs after 2 days and USGPIVs exhibited improved survival rates in patients with DIVA. These findings suggest that rigorous simulation-based insertion training demonstrates improved USGPIV survival when compared to traditional PIVCs. SBML is an extremely useful tool to ensure appropriately trained clinicians acquire the necessary knowledge and skillset to improve USGPIV outcomes.

Use of Simulation-Based Mastery Learning Curriculum to Improve Difficult Conversation Skills Among Anesthesiologists: A Pilot Study

Background

Breaking bad news (BBN) is an important clinical task for physicians. Unfortunately, there is no standard method to teach and assess these skills of anesthesiologists. Although anesthesiology has become a relatively safe medical specialty, complications still occur that require disclosure to patients and their families. Disclosure of bad news can be a significant source of stress for clinicians, especially for those who have low confidence in their BBN skills. Anesthesiologists' skills in BBN can be improved with simulation-based mastery learning (SBML), an intense form of competency-based learning.

Methods

An SBML curriculum was developed using the SPIKES (Situation, Perception, Invitation, Knowledge, Emotion, Summarize) framework for BBN and the NURSE (Naming, Understanding, Respecting, Supporting, Exploring) statements for expressing empathy. A pretest-posttest study was conducted from March 2020 to June 2022 to evaluate anesthesiologists' performance in BBN. Participants completed a 2-hour curriculum consisting of a pretest, didactic session, deliberate practice with feedback, and a posttest. Anesthesiologists were assessed using a 16-item skills checklist.

Results

Six anesthesiology attendings and 14 anesthesiology fellows were enrolled in the study. Three of 20 participants met the minimum passing score (MPS) at the time of their pretest. All study participants met the MPS on their first posttest (P < .001). The median participant confidence in BBN significantly increased (3 to 4, P < .001). Overall course satisfaction in the curriculum was high, with a median score of 5.

Conclusions

Our study demonstrates that a BBN SBML curriculum for anesthesiologists significantly improved communication skills and confidence in a simulated environment. Because only 3 participants met the MPS before training, our results suggest that anesthesiologists could benefit from further education to gain effective communication skills and that SBML training may be effective to achieve this result.

Necessity of Pretests in Central Venous Catheter Insertion Simulation-Based Mastery Learning: A Randomized Controlled Trial

PURPOSE

Simulation-based mastery learning (SBML) is a rigorous form of competency-based learning. Components of SBML include a pretest, deliberate practice, and a posttest; all learners must meet or exceed a minimum passing standard (MPS) on the posttest before completing training. The authors aimed to explore whether a modified SBML curriculum (without a pretest assessment) was as effective as the standard SBML curriculum (with a pretest assessment).

METHOD

The authors performed a randomized controlled trial of internal medicine residents who participated in an internal jugular central venous catheter insertion SBML curriculum at a tertiary care academic medical center in Chicago, Illinois, from December 2018 through December 2021. Residents were randomly assigned to complete the usual SBML intervention (pretest group) or to complete a modified SBML intervention without a pretest (no pretest group). The authors compared initial posttest performance and training time between groups.

RESULTS

Eighty-nine of 120 eligible residents (74.1%) completed the study: 43 in the pretest group and 46 in the no pretest group. Median (IQR) initial posttest scores were not statistically different between the pretest group (96.6 [93.1-100]) and the no pretest group (96.6 [92.4-100]). However, all 43 residents (100%) in the pretest group reached the MPS at the initial posttest compared with 41 of the 46 (89%) in the no pretest group ( P = .06). Residents in the pretest group required 16.5 hours more faculty and learning time than the no pretest group.

CONCLUSIONS

More residents who completed a pretest reached the MPS at initial posttest. However, incorporating a pretest during the internal jugular central venous catheter SBML curriculum required substantially more learner and faculty time without clear performance benefits.

Use of an ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum to improve paediatric anaesthesia care

Background

We previously showed that an ultrasound-guided i.v. catheter insertion (USGIV) simulation-based mastery learning (SBML) curriculum improves the simulated USGIV skills of paediatric anaesthesiologists. It remains unclear if improvements in simulated USGIV skills translate to improved patient care.

Methods

A cohort study was conducted from August 2018 to August 2020 to evaluate paediatric anaesthesiologists' USGIV performance in the operating theatre before and after they participated in the USGIV SBML curriculum. Paediatric anaesthesiologists' use of ultrasound for successful i.v. insertion and first-attempt i.v. insertion success rate with ultrasound were compared before and after training.

Results

Twenty-nine paediatric anaesthesiologists completed training. Unadjusted analysis showed a significant increase in the percentage of i.v. catheters inserted with ultrasound for successful i.v. catheter insertion (9.5-14.5%; P<0.001) and first i.v. catheter insertion attempt success with ultrasound (5.5-8.9%; P<0.001) from before to after training. Multivariable regression analysis showed higher odds of ultrasound use for a successful i.v. catheter attempt (1.79; 95% confidence interval [CI]: 1.11-2.90; P=0.018) and first-attempt success with ultrasound (4.11; 95% CI: 2.02-8.37; P<0.001) after training.

Conclusions

After completing the USGIV SBML curriculum, paediatric anaesthesiologists increased their ultrasound use for successful i.v. catheter insertion and first-attempt success rate with ultrasound for patients in the operating theatre.

Clinical and demographic factors associated with pediatric difficult intravenous access in the operating room

BACKGROUND

Pediatric intravenous catheter insertion can be difficult in the operating room due to the technical challenges of small diameter vessels and the need to rapidly gain intravenous access in anesthetized children. Few studies have examined factors associated with difficult vascular access in the operating room, especially accounting for the increased possibility to use ultrasound guidance.

AIMS

The primary aim of the study was to identify factors associated with pediatric difficult vascular access in the operating room. Our primary hypothesis was that Black race, Hispanic ethnicity, and ultrasound use would be associated with pediatric difficult vascular access.

METHODS

We performed a retrospective analysis of prospectively collected data from a cohort of pediatric patients who had intravenous catheters inserted in the operating room at an academic tertiary care children's hospital from March 2020 to February 2021. We measured associations among patients who were labeled as having difficult vascular access (>2 attempts at access) with demographic, clinical, and hospital factors.

RESULTS

12 728 intravenous catheter insertions were analyzed. Multivariable analysis showed significantly higher odds of difficult vascular access with Black non-Hispanic race (1.43, 95% CI: 1.06-1.93, p = .018), younger age (0.93, 95% CI: 0.89-0.98, p = .005), overweight (1.41, 95% CI: 1.04-1.90, p = .025) and obese body mass index (1.56, 95% 95% CI: 1.12-2.17, p = .008), and American Society of Anesthesiologists physical status III (1.54, 95% CI:1.11-2.13, p = .01). The attending anesthesiologist compared to all other practitioners (certified registered nurse anesthetist: (0.41, 95% CI: 0.31-0.56, p < .001, registered nurse: 0.25, 95% CI: 0.13-0.48, p < .001, trainee: 0.21, 95% CI: 0.17-0.28, p-value <.001 with attending as reference variable) and ultrasound use (2.61, 95% CI: 1.85-3.69, p < .001) were associated with successful intravenous catheter placement.

CONCLUSIONS

Black non-Hispanic race/ethnicity, younger age, obese/overweight body mass index, American Society of Anesthesiologists physical status III, and ultrasound were all associated with pediatric difficult vascular access in the operating room.

Development and evaluation of a simulation-based mastery learning maintenance of certification course

BACKGROUND/OBJECTIVES

To develop and evaluate a post-acute care simulation-based mastery learning (SBML) continuing medical education (CME)/maintenance of certification (MOC) procedure course.

DESIGN

Pretest-posttest study of the SBML intervention.

SETTING

A 2-day post-acute care procedures course.

PARTICIPANTS

Sixteen practicing clinicians (5 physicians,11 advanced practice providers). Participants engaged in a skills pretest on knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing using a checklist created for each procedure. Participants received a didactic on each procedure followed by deliberate practice with feedback. Using the same checklists, participants completed a skills posttest and were required to meet a minimum passing standard (MPS) to obtain CME/MOC credit.

MEASUREMENTS

The MPS for each skills checklist was determined by a multidisciplinary panel of 11 experts. Participants completed surveys on procedure self-confidence and a course evaluation.

RESULTS

There was statistically significant improvement between pre- and posttests for all four procedures (p < .001). All participants were able to meet or exceed the MPS for each skill during the 2-day course. Participants' self-confidence regarding each procedure improved significantly (p < .001).

CONCLUSION

An SBML training course granting CME/MOC credit for post-acute care providers significantly improves performance of knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing.

Ultrasound-Guided Peripheral Intravenous Catheter Insertion Training Reduces Use of Midline Catheters in Hospitalized Patients With Difficult Intravenous Access

OBJECTIVES

Difficult intravenous (IV) access (DIVA) is a prevalent condition in the hospital setting and increases utilization of midline catheters (MCs) and peripherally inserted central catheters (PICCs). Ultrasound-guided peripheral intravenous (USGPIV) insertion is effective at establishing intravenous access in DIVA but remains understudied in the inpatient setting. We evaluated the effect of an USGPIV simulation-based mastery learning (SBML) curriculum for nurses on MC and PICC utilization for hospitalized patients.

METHODS

We performed a quasi-experimental observational study. We trained nurses across all inpatient units at a large tertiary care hospital. We queried the electronic medical record to compare PICC and MC utilization for patients with DIVA during 3 periods: before USGPIV SBML training (control), during pilot testing of the intervention, and during the SBML intervention. To account for variations in insertion practices over time, we performed an interrupted time series (ITS) analysis between 2 periods, the combined control and pilot periods and the intervention period.

RESULTS

One hundred forty-eight nurses completed USGPIV SBML training. Midline catheters inserted monthly per 1000 patient-days for DIVA decreased significantly from 1.86 ± 0.51 (control) to 2.31 ± 0.28 (pilot) to 1.33 ± 0.51 (intervention; P = 0.001). The ITS analysis indicated a significant intervention effect (P < 0.001). Peripherally inserted central catheters inserted monthly per 1000 patient-days for DIVA also significantly decreased over the study periods; however, the ITS failed to show an intervention effect as PICC insertions were already decreasing during the control period.

CONCLUSIONS

A hospital-wide USGPIV SBML curriculum for inpatient nurses was associated with a significant reduction in MCs inserted for DIVA.

Simulation-Based Mastery Learning Improves Ultrasound-Guided Peripheral Intravenous Catheter Insertion Skills of Practicing Nurses

INTRODUCTION

Difficult intravenous (IV) access (DIVA) is frequently encountered in the hospital setting. Ultrasound-guided peripheral IV catheter (USGPIV) insertion has emerged as an effective procedure to establish access in patients with DIVA. Despite the increased use of USGPIV, little is known about the optimal training paradigms for bedside nurses. Therefore, we developed and evaluated a novel, sustainable, USGPIV simulation-based mastery learning (SBML) curriculum for nurses.

METHODS

This is a prospective cohort study of an USGPIV SBML training program for bedside nurses over a 12-month period. We evaluated skills and self-confidence before and after training and measured the proportion of the nurses achieving independent, proctor, and instructor status. Procedure logs and surveys were used to explore the nurse experience and utilization of USGPIV on real patients with DIVA 3 months after the intervention.

RESULTS

Two hundred thirty-eight nurses enrolled in the study. The USGPIV skill checklist scores increased from median of 6.0 [interquartile range = 4.0-9.0 (pretest) to 29.0, interquartile range = 28-30 (posttest), P < 0.001]. The USGPIV confidence improved from before (mean = 2.32, SD = 1.17) to after (mean = 3.85, SD = 0.73, P < 0.001) training (5-point Likert scale). Sixty-two percent of the nurses enrolled achieved independent status, 47.5% became proctors, and 11.3% course trainers. At 3-month posttraining, the nurses had attempted a mean of 35.6 USGPIV insertions with an 89.5% success rate.

CONCLUSIONS

This novel USGPIV SBML curriculum improves nurses' insertion skills, self-confidence, and progresses patient care through USGPIV insertions on hospitalized patients with DIVA.

Psychometric Validation of Central Venous Catheter Insertion Mastery Learning Checklist Data and Decisions

INTRODUCTION

Resident physicians are expected to acquire competence at central venous catheter (CVC) insertion to a mastery standard. Valid competence decisions about resident physicians' CVC performance rely on reliable data and rigorous achievement standards. This study used data from 3 CVC simulation-based mastery learning studies involving internal medicine (IM) and emergency medicine (EM) residents to address 2 questions: What is the effectiveness of a CVC mastery learning education intervention? Are minimum passing standards (MPSs) set by faculty supported by item response theory (IRT) analyses?

METHODS

Pretraining and posttraining skills checklist data were drawn from 3 simulation-based mastery learning research reports about CVC internal jugular (IJ) and subclavian (SC) insertion skill acquisition. Residents were required to meet or exceed a posttest skills MPS. Generalized linear mixed effect models compared checklist performance from pre to postintervention. Minimum passing standards were determined by Angoff and Hofstee standard setting methods. Item response theory models were used for cut-score evaluation.

RESULTS

Internal medicine and EM residents improved significantly on every IJ and SC checklist item after mastery learning. Item response theory analyses support the IJ and SC MPSs.

CONCLUSIONS

Mastery learning is an effective education intervention to achieve clinical skill acquisition among IM and EM residents. Item response theory analyses reveal desirable measurement properties for the MPSs previously set by expert faculty panels. Item response theory analysis is useful for evaluating standards for mastery learning interventions. The CVC mastery learning curriculum, reliable outcome data, and high achievement standards together contribute to reaching valid decisions about the competence of resident physicians to perform the clinical procedure.

Barriers and Facilitators to Central Venous Catheter Insertion: A Qualitative Study

OBJECTIVES

The aims of the study were to identify perceived barriers and facilitators to central venous catheter (CVC) insertion among healthcare providers and to understand the extent to which an existing Simulation-Based Mastery Learning (SBML) program may address barriers and leverage facilitators.

METHODS

Providers participating in a CVC insertion SBML train-the-trainer program, in addition to intensive care unit nurse managers, were purposively sampled from Veterans Administration Medical Centers located in geographically diverse areas. We conducted semistructured interviews to assess perceptions of barriers and facilitators to CVC insertion. Deidentified transcripts were analyzed using a grounded theory approach and the constant comparative method. We subsequently mapped identified barriers and facilitators to our SBML curriculum to determine whether or not the curriculum addresses these factors.

RESULTS

We interviewed 28 providers at six Veterans Administration Medical Centers, identifying the following five overarching factors of perceived barriers to CVC insertion: (1) equipment, (2) personnel/staff, (3) setting or organizational context, (4) patient or provider, and (5) time-related barriers. Three overarching factors of facilitators emerged: (1) equipment, (2) personnel, and (3) setting or organizational context facilitators. The SBML curriculum seems to address most identified barriers, while leveraging many facilitators; building on the commonly identified facilitator of nursing staff contribution by expanding the curriculum to explicitly include nurse involvement could improve team efficiency and organizational culture of safety.

CONCLUSIONS

Many identified facilitators (e.g., ability to use ultrasound, personnel confidence/competence) were also identified as barriers. Evidence-based SBML programs have the potential to amplify these facilitators while addressing the barriers by providing an opportunity to practice and master CVC insertion skills.

Effectiveness of a simulation-based mastery learning to train clinicians on a novel cricothyrotomy procedure at an academic medical centre during a pandemic: a quasi-experimental cohort study

OBJECTIVES

To develop and evaluate a simulation-based mastery learning (SBML) curriculum for cricothyrotomy using wet towels to suppress aerosolisation during a pandemic.

DESIGN

Quasi-experimental, pre-post study.

SETTING

Tertiary care, academic medical centre in Chicago.

PARTICIPANTS

Ear, nose and throat and general surgery residents, fellows and attendings.

INTERVENTION

Cricothyroidotomy simulation-based mastery learning curriculum.

OUTCOMES MEASURE

Pretest to posttest simulated cricothyrotomy skills checklist performance.

RESULTS

37 of 41 eligible surgeons participated in the curriculum. Median pretest score was 72.5 (IQR 55.0-80.0) and 100.0 (IQR 98.8-100.0) for the posttest p<0.001. All participants scored at or above a minimum passing standard (93% checklist items correct) at posttest.

CONCLUSIONS

Using SBML is effective to quickly train clinicians to competently perform simulated cricothyrotomy during a pandemic.

Simulation-based training improves polypectomy skills among practicing endoscopists

Background and study aims  Practicing endoscopists have variable polypectomy skills during colonoscopy and limited training opportunities for improvement. Simulation-based training enhances procedural skill, but its impact on polypectomy is unclear. We developed a simulation-based polypectomy intervention to improve polypectomy competency. Methods  All faculty endoscopists at our tertiary care center who perform colonoscopy with polypectomy were recruited for a simulation-based intervention assessing sessile and stalked polypectomy. Endoscopists removed five polyps in a simulation environment at pretest followed by a training intervention including a video, practice, and one-on-one feedback. Within 1-4 weeks, endoscopists removed five new simulated polyps at post-test. We used the Direct Observation of Polypectomy Skills (DOPyS) checklist for assessment, evaluating individual polypectomy skills, and global competency (scale: 1-4). Competency was defined as an average global competency score of ≥ 3. Results  83 % (29/35) of eligible endoscopists participated and 95 % (276/290) of planned polypectomies were completed. Only 17 % (5/29) of endoscopists had average global competency scores that were competent at pretest compared with 52 % (15/29) at post-test ( P  = 0.01). Of all completed polypectomies, the competent polypectomy rate significantly improved from pretest to post-test (55 % vs. 71 %; P  < 0.01). This improvement was significant for sessile polypectomy (37 % vs. 65 %; P  < 0.01) but not for stalked polypectomy (82 % vs. 80 %; P  = 0.70). Conclusions  Simulation-based training improved polypectomy skills among practicing endoscopists. Further studies are needed to assess the translation of simulation-based education to clinical practice.

Simulation-Based Assessments and Graduating Neurology Residents' Milestones: Status Epilepticus Milestones

BACKGROUND

The American Board of Psychiatry and Neurology and the Accreditation Council for Graduate Medical Education (ACGME) developed Milestones that provide a framework for residents' assessment. However, Milestones do not provide a description for how programs should perform assessments.

OBJECTIVES

We evaluated graduating residents' status epilepticus (SE) identification and management skills and how they correlate with ACGME Milestones reported for epilepsy and management/treatment by their program's clinical competency committee (CCC).

METHODS

We performed a cohort study of graduating neurology residents from 3 academic medical centers in Chicago in 2018. We evaluated residents' skills identifying and managing SE using a simulation-based assessment (26-item checklist). Simulation-based assessment scores were compared to experience (number of SE cases each resident reported identifying and managing during residency), self-confidence in identifying and managing these cases, and their end of residency Milestones assigned by a CCC based on end-of-rotation evaluations.

RESULTS

Sixteen of 21 (76%) eligible residents participated in the study. Average SE checklist score was 15.6 of 26 checklist items correct (60%, SD 12.2%). There were no significant correlations between resident checklist performance and experience or self-confidence. The average participant's level of Milestone for epilepsy and management/treatment was high at 4.3 of 5 (SD 0.4) and 4.4 of 5 (SD 0.4), respectively. There were no significant associations between checklist skills performance and level of Milestone assigned.

CONCLUSIONS

Simulated SE skills performance of graduating neurology residents was poor. Our study suggests that end-of-rotation evaluations alone are inadequate for assigning Milestones for high-stakes clinical skills such as identification and management of SE.

Mortality, critical illness, and mechanical ventilation among hospitalized patients with COVID-19 on therapeutic anticoagulants

Background

COVID-19 is associated with hypercoagulability and increased incidence of thrombosis. We compared the clinical outcomes of adults hospitalized with COVID-19 who were on therapeutic anticoagulants to those on prophylactic anticoagulation.

Materials and methods

We performed an observational study of adult inpatients' with COVID-19 from March 9 to June 26, 2020. We compared patients who were continued on their outpatient prescribed therapeutic anticoagulation and those who were newly started on therapeutic anticoagulation for COVID-19 (without other indication) to those who were on prophylactic doses. The primary outcome was overall death while secondary outcomes were critical illness (World Health Organization Ordinal Scale for Clinical Improvement score ≥5), mechanical ventilation, and death among patients who first had critical illness. We adjusted for age, sex, race, body mass index (BMI), Charlson score, glucose on admission, and use of antiplatelet agents.

Results

Of 1716 inpatients with COVID-19, 171 patients were continued on their therapeutic anticoagulation and 78 were started on new therapeutic anticoagulation for COVID-19. In patients continued on home therapeutic anticoagulation, there were no differences in overall death, critical illness, mechanical ventilation, or death among patients with critical illness compared to patients on prophylactic anticoagulation. In patients receiving new therapeutic anticoagulation for COVID-19, there was increased death (OR 5.93; 95% CI 3.71-9.47), critical illness (OR 14.51; 95% CI 7.43-28.31), need mechanical ventilation (OR 11.22; 95% CI 6.67-18.86), and death after first having critical illness (OR 5.51; 95% CI 2.80-10.87).

Conclusions

Therapeutic anticoagulation for inpatients with COVID-19 was not associated with improved outcomes.

Ethical imperative of psychological safety in healthcare: in response to the Manifesto for healthcare simulation practice

Psychological safety is valued in other high-risk industries as an essential element to ensure safety. Yet, in healthcare, psychological safety is not mandatorily measured, quantified, or reported as an independent measure of safety. All members of the healthcare team's voice and safety are important. Calls for personal, physical or patient safety should never be disregarded or met with retaliation.

Impact of Simulation-based Mastery Learning on Resident Skill Managing Mechanical Ventilators

Background: Caring for patients requiring mechanical ventilation is complex, and residents may lack adequate skill for managing these patients. Simulation-based mastery learning (SBML) is an educational model that trains clinicians to a high standard and can reduce complications. The mastery learning model has not been applied to ventilator management. Objective: The purpose of this study was to determine whether SBML, as compared with traditional training, is an effective strategy for teaching residents the skills necessary to manage patients requiring mechanical ventilation. Methods: We developed an SBML curriculum and a 47-item skills checklist to test ventilator management for patients with normal, restricted, and obstructed lung physiology. A minimum passing standard (MPS) on the checklist was set using the Mastery Angoff method. Residents rotating through the medical intensive care unit in Academic Year 2017-2018 were assigned to SBML or traditional training based on their medical intensive care unit team. The SBML group was pretested on a ventilator simulator using the skills checklist. They then received a 1.5-hour session (45 min didactic and 45 min deliberate practice on the simulator with feedback). At rotation completion, they were posttested on the simulator using the checklist until the MPS was met. Both SBML-trained and traditionally trained groups received teaching during daily bedside rounds and twice weekly didactic lectures. At rotation completion, traditionally trained residents were tested using the same skills checklist on the simulator. We compared pretest and posttest performance among SBML-trained residents and end of the rotation test performances between the SBML-trained and traditionally trained residents. Results: The MPS was set at 87% on the checklist. Fifty-seven residents were assigned to the SBML-trained group and 49 were assigned to the traditionally trained group. Mean checklist scores for SBML-trained residents improved from 51.4% (standard deviation [SD] = 17.5%) at pretest to 86.1% (SD = 7.6%) at initial posttest and 92.5% (SD = 3.7%) at final (mastery) posttest (both P < 0.001). Forty-two percent of residents required more than one attempt at the posttest to meet or exceed the MPS. At rotation completion, the traditionally trained residents had a mean test score of 60.9% (SD = 13.3%). Conclusion: SBML is an effective strategy to train residents on mechanical ventilator management. An SBML curriculum may augment traditional training methods to further equip residents to safely manage ventilated patients.

Difficult intravenous access in the emergency department: Performance and impact of ultrasound-guided IV insertion performed by nurses

BACKGROUND

Difficult intravenous access (DIVA) is a common problem in Emergency Departments (EDs), yet the prevalence and clinical impact of this condition is poorly understood. Ultrasound-guided peripheral intravenous catheter (USGPIV) insertion is a successful modality for obtaining intravenous (IV) access in patients with DIVA.

OBJECTIVES

We aimed to describe the prevalence of DIVA, explore how DIVA affects delivery of care, and determine if nurse insertion of USGPIV improves care delays among patients with DIVA.

METHODS

We retrospectively queried the electronic medical record for all ED patients who had a peripheral IV (PIV) inserted at a tertiary academic medical center from 2015 to 2017. We categorized patients as having DIVA if they required ≥3 PIV attempts or an USGPIV. We compared metrics for care delivery including time-to-IV-access, time-to-laboratory-results, time-to-IV-analgesia, and ED length of stay (LOS) between patients with and without DIVA. We also compared these metrics in patients with DIVA with a physician-inserted USGPIV versus those with a nurse-inserted USGPIV.

RESULTS

A total of 147,260 patients were evaluated during the study period. Of these, 13,192 (8.9%) met criteria for DIVA. Patients with DIVA encountered statistically significant delays in time-to-IV-access, time-to-laboratory-results, time-to-IV-analgesia, and ED LOS compared to patients without DIVA (all p < 0.001). Patients with nurse-inserted USGPIVs also had statistically significant improvements in time-to-IV-access, time-to-laboratory-results, time-to-IV-analgesia, and ED LOS compared to patients with physician-inserted USGPIVs (all p < 0.001).

CONCLUSION

DIVA affects many ED patients and leads to delays in PIV access-related care. Nurse insertion of USGPIVs improves care in patients with DIVA.

Use of a simulation-based mastery learning curriculum to improve ultrasound-guided vascular access skills of pediatric anesthesiologists

BACKGROUND

Pediatric vascular access is inherently challenging due to the small caliber of children's vessels. Ultrasound-guided intravenous catheter insertion has been shown to increase success rates and decrease time to cannulation in patients with difficult intravenous access. Although proficiency in ultrasound-guided intravenous catheter insertion is a critical skill in pediatric anesthesia, there are no published competency-based training curricula.

AIMS

The objective of this study was to evaluate the performance of pediatric anesthesiologists who participated in a novel ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum.

METHODS

Pediatric anesthesia attendings, fellows, and rotating residents participated in the ultrasound-guided intravenous catheter insertion simulation-based mastery learning curriculum from August 2019 to February 2020. The 2-hour curriculum consisted of participants first undergoing a simulated skills pretest followed by watching a video on ultrasound-guided intravenous catheter insertion and deliberate practice on a simulator. Subsequently, all participants took a post-test and were required to meet or exceed a minimum passing standard. Those who were unable to meet the minimum passing standard participated in further practice until they could be retested and met this standard. We compared pre to post-test ultrasound-guided intravenous catheter insertion skills and self-confidence before and after participation in the curriculum.

RESULTS

Twenty-six pediatric anesthesia attendings, 12 fellows, and 38 residents participated in the curriculum. At pretest, 16/76 (21%) participants were able to meet or exceed the minimum passing standard. The median score on the pretest was 21/25 skills checklist items correct and improved to 24/25 at post-test (95% CI 3.0-4.0, P < .01). Self-confidence significantly improved after the course from an average of 3.2 before the course to a postcourse score of 3.9 (95% CI 0.5-0.9, P < .01; 1 = Not all confident, 5 = Very confident).

CONCLUSIONS

Simulation-based mastery learning significantly improved anesthesiologists' ultrasound-guided intravenous catheter insertion performance in a simulated setting.

Use of a simulation-based mastery learning curriculum for neurology residents to improve the identification and management of status epilepticus

BACKGROUND

Appropriate and timely treatment of status epilepticus (SE) decreases morbidity and mortality. Therefore, skill-based training in the identification and management of SE is crucial for clinicians.

OBJECTIVE

The objective of the study was to develop and evaluate the impact of a simulation-based mastery learning (SBML) curriculum to train neurology residents on the identification and management of SE.

METHODS

We used pretest-posttest design with a retention test on SE skills for this study. Neurology residents in the second postgraduate year (PGY-2) were eligible to participate in the SE SBML curriculum. Learners completed a baseline-simulated SE skills assessment (pretest) using a 26-item dichotomous skills checklist. Next, they participated in a didactic session about the identification and management of SE, followed by deliberate skills practice. Subsequently, participants completed another skills assessment (posttest) using the same 26-item checklist. All participants were required to meet or exceed a minimum passing standard (MPS) determined by a panel of 14 SE experts using the Mastery Angoff standard setting method. After meeting the MPS at posttest, participants were reassessed during an unannounced in situ simulation session on the medical wards. We compared pretest with posttest simulated SE skills performance and posttest with reassessment in situ performance.

RESULTS

The MPS was set at 88% (23/26) checklist items correct. Sixteen neurology residents participated in the intervention. Participant performance improved from a median of 44.23% (Interquartile range (IQR): 34.62-55.77) at pretest to 94.23% (IQR: 92.13-100) at the posttest after SBML (p < .001). There was no significant difference in scores between the posttest and in situ test up to 8 months later (94.23%; IQR: 92.31-100 vs. 92.31%; IQR: 88.46-96.15; p = .13).

CONCLUSIONS

Our SBML curriculum significantly improved residents' SE identification and management skills that were largely retained during an unannounced simulated encounter in the hospital setting.

Emergency cricothyrotomy during the COVID-19 pandemic: how to suppress aerosolization

Background

Cricothyrotomy is associated with significant aerosolization that increases the potential risk of infection among healthcare providers. It is important to identify simple yet effective methods to suppress aerosolization and improve the safety of healthcare providers.

Methods

5 ear, nose and throat and general surgeons used a locally developed hybrid cricothyrotomy simulator with a porcine trachea to test three draping methods to suppress aerosolization during the procedure: an X-ray cassette drape, dry operating room (OR) towels and wet OR towels. The three methods were judged based on three categories: effectiveness of suppression, availability in all healthcare systems and ease of handling.

Results

All five surgeons performed the procedure independently using each of the three suppression methods. The wet OR towel drape was found to be an effective method to suppress aerosolization, and it did not hinder the surgeons from performing the procedure accurately. This finding was confirmed by using an atomized fluorescein dye injection into the porcine trachea, representing aerosolized material while performing the procedure.

Conclusions

We present a novel intervention using wet towels to suppress aerosolization during cricothyrotomy. Wet towels are cheap and readily available within any healthcare setting regardless of the financial resources available.

Improving cardiology fellow education of right heart catheterization using a simulation based curriculum

BACKGROUND

Medical procedures are traditionally taught informally at patients' bedside through observation and practice using the adage "see one, do one, teach one." This lack of formalized training can cause trainees to be unprepared to perform procedures independently. Simulation based education (SBE) increases competence, reduces complications, and decreases costs. We developed, implemented, and evaluated the efficacy of a right heart catheterization (RHC) SBE curriculum.

METHODS

The RHC curriculum consisted of a pretest, video didactics, deliberate practice, and a posttest. Pre-and posttest skills examinations consisted of a dichotomous 43-item checklist on RHC skills and a 14-item hemodynamic waveform quiz. We enrolled two groups of fellows: 6 first-year, novice cardiology fellows at Northwestern University in their first month of training, and 11 second- and third-year fellows who had completed traditional required, level I training in RHC. We trained the first-year fellows at the beginning of the 2018-2019 year using the SBE curriculum and compared them to the traditionally-trained cardiology fellows who did not complete SBE.

RESULTS

The SBE-trained fellows significantly improved RHC skills, hemodynamic knowledge, and confidence from pre- to posttesting. SBE-trained fellows performed similarly to traditionally-trained fellows on simulated RHC skills checklists (88.4% correct vs. 89.2%, p = .84), hemodynamic quizzes (94.0% correct vs. 86.4%, p = .12), and confidence (79.4 vs. 85.9 out of 100, p = .15) despite less clinical experience.

CONCLUSIONS

A SBE curriculum for RHC allowed novice cardiology fellows to achieve level I skills and knowledge at the beginning of fellowship and can train cardiology fellows before patient contact.

Patient, Caregiver, and Clinician Perceptions of Ventricular Assist Device Self-care Education Inform the Development of a Simulation-based Mastery Learning Curriculum

BACKGROUND

Patients who undergo ventricular assist device (VAD) implantation and their caregivers must rapidly learn a significant amount of self-care skills and knowledge.

OBJECTIVE

The aim of this study was to explore patient, caregiver, VAD coordinator, and physician perspectives and perceptions of existing VAD self-care training to inform development of a simulation-based mastery learning (SBML) curriculum to teach patients and caregivers VAD self-care skills and knowledge.

METHODS

We conducted semistructured, in-person interviews with patients with a VAD, their caregivers, VAD coordinators, and physicians (cardiac surgeons, an infectious disease physician, and advanced heart failure cardiologists). We used a 2-cycle team-based iterative inductive approach to coding and analysis.

RESULTS

We interviewed 16 patients, 12 caregivers, 7 VAD coordinators, and 11 physicians. Seven major themes were derived from the interviews including (1) identification of critical curricular content, (2) need for standardization and assessment, (3) training modalities, (4) benefits of repetition, (5) piercing it all together, (6) need for refresher training, and (7) provision of training before implant.

CONCLUSIONS

Findings from this study suggest that SBML is a natural fit for the high-risk tasks needed to save VAD self-care. The 7 unique training-related themes derived from the qualitative data informed the design and development of a VAD SBML self-care curriculum.

Simulation-Based Mastery Learning Improves Patient and Caregiver Ventricular Assist Device Self-Care Skills: A Randomized Pilot Trial

BACKGROUND

No recognized standards exist for teaching patients and their caregivers ventricular assist device (VAD) self-care skills. We compared the effectiveness of a VAD simulation-based mastery learning (SBML) self-care training curriculum with usual VAD self-care training.

METHODS AND RESULTS

VAD patients and their caregivers were randomized to SBML or usual training during their implant hospitalization. The SBML group completed a pretest on 3 VAD self-care skills (controller, power source, and dressing change), then viewed videos and participated in deliberate practice on a simulator. SBML participants took a posttest and were required to meet or exceed a minimum passing standard for each of the skills. The usual training group completed the existing institutional VAD self-care teaching protocol. Before hospital discharge, the SBML and usual training groups took the same 3 VAD self-care skills tests. We compared demographic and clinical information, self-confidence, total participant training time, and skills performance between groups. Forty participants completed the study in each group. There were no differences in demographic and clinical information, self-confidence, or training time between groups. More participants in the SBML group met the minimum passing standard compared with the usual training group for controller (37/40 [93%] versus 25/40 [63%]; P=0.001), power source (36/40 [90%] versus 9/40 [23%]; P<0.001), and dressing change skills (19/20 [95%] versus 0/20; P<0.001).

CONCLUSIONS

SBML provided superior VAD self-care skills learning outcomes compared with usual training. This study has important implications for patients due to the morbidity and mortality associated with improper VAD self-care.

CLINICAL TRIAL REGISTRATION

URL: http://www.clinicaltrials.gov. Unique identifier: NCT03073005.

Development of a Simulation-Based Mastery Learning Curriculum for Breaking Bad News

INTRODUCTION

Physician communication impacts patient outcomes. However, communication skills, especially around difficult conversations, remain suboptimal, and there is no clear way to determine the validity of entrustment decisions. The aims of this study were to 1) describe the development of a simulation-based mastery learning (SBML) curriculum for breaking bad news (BBN) conversation skills and 2) set a defensible minimum passing standard (MPS) to ensure uniform skill acquisition among learners.

INNOVATION

An SBML BBN curriculum was developed for fourth-year medical students. An assessment tool was created to evaluate the acquisition of skills involved in a BBN conversation. Pilot testing was completed to confirm improvement in skill acquisition and set the MPS.

OUTCOMES

A BBN assessment tool containing a 15-item checklist and six scaled items was developed. Students' checklist performance improved significantly at post-test compared to baseline (mean 65.33%, SD = 12.09% vs mean 88.67%, SD = 9.45%, P < 0.001). Students were also significantly more likely to have at least a score of 4 (on a five-point scale) for the six scaled questions at post-test. The MPS was set at 80%, requiring a score of 12 items on the checklist and at least 4 of 5 for each scaled item. Using the MPS, 30% of students would require additional training after post-testing.

COMMENTS

We developed a SBML curriculum with a comprehensive assessment of BBN skills and a defensible competency standard. Future efforts will expand the mastery model to larger cohorts and assess the impact of rigorous education on patient care outcomes.

The Effect of Judge Selection on Standard Setting Using the Mastery Angoff Method during Development of a Ventricular Assist Device Self-Care Curriculum

Background

Patients and caregivers need to perform ventricular assist device (VAD) self-care safely to help prevent complications (e.g., infection). We developed a VAD self-care simulation-based mastery learning (SBML) curriculum. We determined optimal minimum passing scores (MPSs) and evaluated effects of judge selection.

Methods

A multidisciplinary team created a VAD self-care SBML curriculum including simulated skills and knowledge examinations. Patients, caregivers, VAD coordinators, and physicians were expert judges who determined MPSs using the Mastery Angoff method.

Results

MPSs for the skills and knowledge examinations were high (range = 94-99% and 97% correct), respectively. Judges closely agreed on MPSs.

Conclusions

Stakeholders set stringent MPSs for high-stakes VAD self-care.

A Comparison of Approaches for Mastery Learning Standard Setting

PURPOSE

Defensible minimum passing standards (MPSs) must be used to evaluate learner performance outcomes in health professions education. In this study, the authors compared the results of traditional Angoff and Hofstee standard-setting exercises with the Mastery Angoff and Patient-Safety approaches for central venous catheter (CVC) insertion skills examinations. The authors also evaluated how these standards affected the historical performance of residents who participated in a simulation-based mastery learning (SBML) curriculum for CVC insertion skills.

METHOD

In April and May 2015, 12 physicians with expertise in CVC insertion set MPSs for previously published internal jugular (IJ) and subclavian (SC) CVC insertion checklists using Angoff, Hofstee, Mastery Angoff, and Patient-Safety approaches. The resulting MPSs were compared using historical performance of internal medicine and emergency medicine residents who participated in CVC insertion SBML.

RESULTS

The MPSs were set as follows: Angoff: IJ 91% checklist items correct, SC 90%. Hofstee: IJ 88%, SC 90%. Mastery Angoff: IJ 98%, SC 98%. Patient-Safety: IJ 98%, SC 98%. Based on the historical performance of 143 residents assessed on IJ and SC insertion, applying the 98% MPS would result in additional practice and retesting of 55/123 residents (45%) who had previously passed the IJ examination and 36/130 residents (28%) who had passed the SC examination using the Angoff and Hofstee MPSs.

CONCLUSIONS

The Mastery Angoff and Patient-Safety standard-setting approaches resulted in higher CVC insertion SBML MPSs compared with traditional standard-setting methods. Further study should assess the impact of these more rigorous standards on patient outcomes.

Simulation-Based Mastery Learning for Thoracentesis Skills Improves Patient Outcomes: A Randomized Trial

PURPOSE

Physicians-in-training often perform bedside thoracenteses in academic medical centers, and complications are more common among less experienced clinicians. Simulation-based mastery learning (SBML) is one potential solution to this problem. This study evaluated the effects of a randomized trial of thoracentesis SBML on patient complications: iatrogenic pneumothorax (IP), hemothorax, and reexpansion pulmonary edema (REPE).

METHOD

The authors randomized internal medicine residents to undergo thoracentesis SBML at a tertiary care academic center from December 2012 to May 2016. They subsequently compared thoracentesis complications from procedures performed by SBML-trained residents, traditionally trained residents (no simulation training), and those referred to pulmonary medicine or interventional radiology (IR).

RESULTS

During the study period, 917 thoracenteses were performed on 709 patients. IP occurred in 60 (6.5%) procedures, of which 7 (11.6%) were clinically meaningful. SBML-trained residents performed procedures with a trend toward lower combined clinically meaningful complications (IP, hemothorax, REPE) compared with traditionally trained residents (7.9% vs. 0%; P = .06). SBML-trained residents caused fewer clinically meaningful IPs compared with traditionally trained residents, pulmonary, and IR referrals (P = .02). Hemothorax occurred after 4 (0.4%) thoracenteses, and SBML-trained residents had a trend toward lower hemothorax (0) compared with other groups (P = .07). REPE occurred after 3 (0.3%) procedures, with no differences between groups. SBML-trained residents performed procedures with lower combined clinically meaningful complications compared with other groups (P = .008).

CONCLUSIONS

Residents randomized to an SBML intervention performed thoracenteses with low rates of clinically meaningful complications. Rigorous education represents a successful quality improvement strategy.

Healthcare Providers' Awareness and Perceptions of Competency Requirements in Central Venous Catheter Insertion

This article was migrated. The article was marked as recommended. Background Studies show that medical residents do not feel comfortable and lack the skills and confidence to perform common bedside procedures. Regulatory bodies often require a set number of procedures to determine resident competence, yet medical providers' knowledge of competency guidelines are less well known. This study aimed to qualitatively assess existing practices relevant to documentation of competency in central venous catheter (CVC) insertion and explore healthcare providers' awareness and perceptions of those practices at their institutions. Methods The authors performed a qualitative study at Veterans Affairs Medical Centers (VAMCs) from February to December 2014 as part of a larger project related to the dissemination of a simulation-based CVC insertion curriculum. Two authors conducted interviews with hospital staff (including attending physicians, nurses, and residents) at selected VAMCs. Recordings of interviews were transcribed, coded, and analyzed using a grounded theory approach and constant comparative techniques. Results Twenty-six participants were interviewed at six VAMCs. Participants reported varying perspectives regarding their institutions' policies about CVC insertion. Four major themes emerged: (1) knowledge of institutional policy; (2) competency by numbers; (3) documentation of competency; and (4) perceptions of competency measures. Participants reported concern about the reliability of these policies and measures of competence. Conclusions This study demonstrates that healthcare providers' knowledge and perceptions about institutional requirements for procedural competency vary widely. Our findings suggest the need for establishment of consistent competency policies based on evidence-based practices, and highlight the need for increased communication regarding individual institutional policies. Integration of rigorous simulation-based education, implemented consistently across institutions, can provide a reliable mechanism to train and assess procedural competence and ensure patient safety.

Vascular Ultrasonography: A Novel Method to Reduce Paracentesis Related Major Bleeding

Paracentesis is a core competency for hospitalists. Using ultrasound for fluid localization is standard practice and involves a low-frequency probe. Experts recommend a "2-probe technique, " which incorporates a high-frequency ultrasound probe in addition to the low-frequency probe to identify blood vessels within the intended needle path. Evidence is currently lacking to support this 2-probe technique, so we performed a pre- to postintervention study to evaluate its effect on paracentesis-related bleeding complications. From February 2010 to August 2011, procedures were performed using only low-frequency probes (preintervention group), while the 2-probe technique was used from September 2011 to February 2016 (postintervention group). A total of 5777 procedures were performed. Paracentesis-related minor bleeding was similar between groups. Major bleeding was lower in the postintervention group (3 [0.3%], n = 1000 vs 4 [0.08%], n = 4777; P = 0.07). This clinically meaningful trend suggests that using the 2-probe technique might prevent paracentesis-related major bleeding.

An institution-wide approach to submission, review, and funding of simulation-based curricula

This article describes the development, implementation, and modification of an institutional process to evaluate and fund graduate medical education simulation curricula. The goals of this activity were to (a) establish a standardized mechanism for proposal submission and evaluation, (b) identify simulation-based medical education (SBME) curricula that would benefit from mentored improvement before implementation, and (c) ensure that funding decisions were fair and defensible. Our intent was to develop a process that was grounded in sound educational principles, allowed for efficient administrative oversight, ensured approved courses were high quality, encouraged simulation education research and scholarship, and provided opportunities for medical specialties that had not previously used SBME to receive mentoring and faculty development.

Residents' Procedural Experience Does Not Ensure Competence: A Research Synthesis

BACKGROUND

Many medical certifying bodies require that a minimum number of clinical procedures be completed during residency training to obtain board eligibility. However, little is known about the relationship between the number of procedures residents perform and their clinical competence.

OBJECTIVE

This study evaluated associations between residents' medical procedure skills measured in a simulation laboratory and self-reported procedure experience and year of training.

METHODS

This research synthesis extracted and summarized data from multiple cohorts of internal medicine, emergency medicine, anesthesiology, and neurology resident physicians who performed simulated clinical procedures. The procedures were central venous catheter insertion, lumbar puncture, paracentesis, and thoracentesis. We compared residents' baseline simulated performance to their self-reported procedure experience using data from 7 research reports written by Northwestern University investigators between 2006 and 2016. We also evaluated how performance differed by postgraduate year (PGY).

RESULTS

A total of 588 simulated procedures were performed during the study period. We found significant associations between passing the skills examinations and higher number of self-reported procedures performed (P = .011) and higher PGY (P < .001). However, performance for all procedures was poor, as only 10% of residents passed the assessments with a mean of 48% of checklist items correct (SD = 24.2). The association between passing the skills examination and year of training was mostly due to differences between PGY-1 and subsequent years of training.

CONCLUSIONS

Despite positive associations between self-reported experience and simulated procedure performance, overall performance was poor. Residents' clinical experience is not a proxy for skill.

Safe and Effective Bedside Thoracentesis: A Review of the Evidence for Practicing Clinicians

BACKGROUND

Physicians often care for patients with pleural effusion, a condition that requires thoracentesis for evaluation and treatment. We aim to identify the most recent advances related to safe and effective performance of thoracentesis.

METHODS

We performed a narrative review with a systematic search of the literature. Two authors independently reviewed search results and selected studies based on relevance to thoracentesis; disagreements were resolved by consensus. Articles were categorized as those related to the pre-, intra- and postprocedural aspects of thoracentesis.

RESULTS

Sixty relevant studies were identified and included. Pre-procedural topics included methods for physician training and maintenance of skills, such as simulation with direct observation. Additionally, pre-procedural topics included the finding that moderate coagulopathies (international normalized ratio less than 3 or a platelet count greater than 25,000/μL) and mechanical ventilation did not increase risk of postprocedural complications. Intraprocedurally, ultrasound use was associated with lower risk of pneumothorax, while pleural manometry can identify a nonexpanding lung and may help reduce risk of re-expansion pulmonary edema. Postprocedurally, studies indicate that routine chest X-ray is unwarranted, because bedside ultrasound can identify pneumothorax.

CONCLUSIONS

While the performance of thoracentesis is not without risk, clinicians can incorporate recent advances into practice to mitigate patient harm and improve effectiveness. Journal of Hospital Medicine 2017;12:266-276.

Achieving Procedural Competence during Nephrology Fellowship Training: Current Requirements and Educational Research

Concerns have previously been raised as to whether training programs are ensuring that nephrology fellows achieve competence in the procedural skills required for independent practice. We sought to review the current requirements for procedural training as well as educational research pertaining to achieving competence in the core nephrology procedures of nontunneled (temporary) hemodialysis catheter insertion and percutaneous kidney biopsy. At this time, there is no universal approach to procedural training and assessment during nephrology fellowship. Nonetheless, simulation-based mastery learning programs have been shown to be effective in improving fellows' skills in nontunneled (temporary) hemodialysis catheter insertion and should be provided by all nephrology training programs. For percutaneous kidney biopsy, the development and evaluation of inexpensive simulators are a promising starting point for future study. Current practice with respect to procedural training during nephrology fellowship remains imperfect; however, the ongoing shift toward competency-based evaluation provides opportunities to refocus on improvement.

The effect of simulation-based mastery learning on thoracentesis referral patterns

Internal medicine (IM) residents and hospitalist physicians commonly perform thoracenteses. National data show that thoracenteses are also frequently referred to other services such as interventional radiology (IR), increasing healthcare costs. Simulation-based mastery learning (SBML) is an effective method to boost physicians' procedural skills and self-confidence. This study aimed to (1) assess the effect of SBML on IM residents' simulated thoracentesis skills and (2) compare thoracentesis referral patterns, self-confidence, and reasons for referral between traditionally trained residents (non-SBML-trained), SBML-trained residents, and hospitalist physicians. A random sample of 112 IM residents at an academic medical center completed thoracentesis SBML from December 2012 to May 2015. We surveyed physicians caring for hospitalized patients with thoracenteses during the same time period and compared referral patterns, self-confidence, and reasons for referral. SBML-trained resident thoracentesis skills improved from a median of 57.6% (interquartile range [IQR] 43.3-76.9) at pretest to 96.2% (IQR 96.2-100.0) at post-test (P < 0.001). Surveys demonstrated that traditionally trained residents were more likely to refer to IR and cited lower confidence as reasons. SBML-trained residents were more likely to perform bedside thoracenteses. Hospitalist physicians were most likely to refer to pulmonary medicine and cited lack of time to perform the procedure as the main reason. SBML-trained residents were most confident about their thoracentesis skills, despite hospitalist physicians having more experience. This study identifies confidence and time as reasons physicians refer thoracenteses rather than perform them at the bedside. Thoracentesis SBML boosts skills and promotes bedside procedures that are safe and less expensive than referrals. Journal of Hospital Medicine 2016;11:792-795. © 2016 Society of Hospital Medicine.