Effect of Polypectomy Simulation-Based Mastery Learning on Skill Retention Among Practicing Endoscopists

PURPOSE

Practicing endoscopists frequently perform and teach screening colonoscopies and polypectomies, but there is no standardized method to train and assess physicians who perform polypectomy procedures. The authors created a polypectomy simulation-based mastery learning (SBML) curriculum and hypothesized that completion of the curriculum would lead to immediate improvement in polypectomy skills and skill retention at 6 and 12 months after training.

METHOD

The authors performed a pretest-posttest cohort study with endoscopists who completed SBML and were randomized to follow-up at 6 or 12 months from May 2021 to August 2022. Participants underwent SBML training, including a pretest, a video lecture, deliberate practice, and a posttest. All learners were required to meet or exceed a minimum passing standard on a 17-item skills checklist before completing training and were randomized to follow-up at 6 or 12 months. The authors compared simulated polypectomy skills performance on the checklist from pretest to posttest and posttest to 6- or 12-month follow-up test.

RESULTS

Twenty-four of 30 eligible participants (80.0%) completed the SBML intervention, and 20 of 24 (83.3%) completed follow-up testing. The minimum passing standard was set at 93% of checklist items correct. The pretest passing rate was 4 of 24 participants (16.7%) compared with 24 of 24 participants (100%) at posttest ( P < .001). There were no significant differences in passing rates from posttest to combined 6- and 12-month posttest in which 18 of 20 participants (90.0%) passed.

CONCLUSIONS

Before training and despite years of clinical experience, practicing endoscopists demonstrated poor performance of polypectomy skills. SBML was an effective method for practicing endoscopists to acquire and maintain polypectomy skills during a 6- to 12-month period.

Powerful medical education improves health care quality and return on investment

INTRODUCTION

Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness.

METHODS

This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations.

RESULTS

PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment.

CONCLUSIONS

The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care.

Performance of peripheral catheters inserted with ultrasound guidance versus landmark technique after a simulation-based mastery learning intervention

PROBLEM

Ultrasound-guided peripheral intravenous catheter (USGPIV) insertion is an effective method to gain vascular access in patients with difficult intravenous access (DIVA). While USGPIV success rates are reported to be high, some studies have reported a concerning incidence of USGPIV premature failures.

AIMS

The purpose of this study was to compare differences in USGPIV and landmark peripheral intravenous catheter (PIV) utilization and failure following a hospital-wide USGPIV training program for nurses.

METHODS

The authors performed a retrospective, electronic medical record review of all USGPIVs and PIVs inserted at a tertiary, urban, academic medical center from September 1, 2018, through September 30, 2019. The primary outcome was differences between USGPIV and PIV time to failure.

RESULTS

A total of 43,470 short peripheral intravenous catheters (PIVCs) were inserted in 23,713 patients. Of these, 7972 (16.8%) were USGPIV. At 30 days of follow-up, for PIVCs with an indication for removal documented, USGPIVs had higher Kaplan-Meier survival probabilities than PIVs (p < 0.001).

CONCLUSIONS

The use of simulation-based mastery associated with USGPIVs, demonstrated lower failure rates than standard PIVs after 2 days and USGPIVs exhibited improved survival rates in patients with DIVA. These findings suggest that rigorous simulation-based insertion training demonstrates improved USGPIV survival when compared to traditional PIVCs. SBML is an extremely useful tool to ensure appropriately trained clinicians acquire the necessary knowledge and skillset to improve USGPIV outcomes.

Necessity of Pretests in Central Venous Catheter Insertion Simulation-Based Mastery Learning: A Randomized Controlled Trial

PURPOSE

Simulation-based mastery learning (SBML) is a rigorous form of competency-based learning. Components of SBML include a pretest, deliberate practice, and a posttest; all learners must meet or exceed a minimum passing standard (MPS) on the posttest before completing training. The authors aimed to explore whether a modified SBML curriculum (without a pretest assessment) was as effective as the standard SBML curriculum (with a pretest assessment).

METHOD

The authors performed a randomized controlled trial of internal medicine residents who participated in an internal jugular central venous catheter insertion SBML curriculum at a tertiary care academic medical center in Chicago, Illinois, from December 2018 through December 2021. Residents were randomly assigned to complete the usual SBML intervention (pretest group) or to complete a modified SBML intervention without a pretest (no pretest group). The authors compared initial posttest performance and training time between groups.

RESULTS

Eighty-nine of 120 eligible residents (74.1%) completed the study: 43 in the pretest group and 46 in the no pretest group. Median (IQR) initial posttest scores were not statistically different between the pretest group (96.6 [93.1-100]) and the no pretest group (96.6 [92.4-100]). However, all 43 residents (100%) in the pretest group reached the MPS at the initial posttest compared with 41 of the 46 (89%) in the no pretest group ( P = .06). Residents in the pretest group required 16.5 hours more faculty and learning time than the no pretest group.

CONCLUSIONS

More residents who completed a pretest reached the MPS at initial posttest. However, incorporating a pretest during the internal jugular central venous catheter SBML curriculum required substantially more learner and faculty time without clear performance benefits.

Clinical Experience Is Not a Proxy for Competence: Comparing Fellow and Medical Student Performance in a Breaking Bad News Simulation-Based Mastery Learning Curriculum

BACKGROUND

It is unknown whether traditional medical education ensures competence among fellows in the key skill of breaking bad news (BBN). While simulation-based mastery learning (SBML) has been used to train fourth-year medical students (M4s) in BBN, it is unclear if it adds similar value for fellows.

OBJECTIVE

We examined the effect of traditional medical training on BBN skills by comparing baseline fellow and M4 skills and confidence and assessed the impact of a BBN SBML curriculum for fellows.

METHODS

Fellows training in six programs at Northwestern University from November 2018 to May 2019 were eligible for inclusion. Fellows completed a BBN SBML curriculum including a pretest, individualized feedback using a previously published assessment tool, and ongoing deliberate practice until all achieved a minimum passing standard (MPS). The primary outcomes were checklist and scaled item scores on the assessment tool. Fellow performance was compared to a historical M4 cohort.

RESULTS

Twenty-eight of 38 eligible fellows completed the curriculum and were included for analysis. Fellows reported significantly more experience and confidence in BBN compared to M4s, yet their pre-training performance was significantly worse on checklist (57.1% vs 65.0%, P = .02) and scaled items; only 4% reached the MPS. After training, fellow performance significantly improved on checklist (57.1% to 92.6%, SD = 5.2%, P < .001) and scaled items; all reached the MPS.

CONCLUSIONS

Despite higher confidence and BBN clinical experience, fellows performed worse than untrained M4s, confirming that experience is not a proxy for skill. Programs must develop competency-based assessments to ensure entrustment of communication skills.

Development and evaluation of a simulation-based mastery learning maintenance of certification course

BACKGROUND/OBJECTIVES

To develop and evaluate a post-acute care simulation-based mastery learning (SBML) continuing medical education (CME)/maintenance of certification (MOC) procedure course.

DESIGN

Pretest-posttest study of the SBML intervention.

SETTING

A 2-day post-acute care procedures course.

PARTICIPANTS

Sixteen practicing clinicians (5 physicians,11 advanced practice providers). Participants engaged in a skills pretest on knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing using a checklist created for each procedure. Participants received a didactic on each procedure followed by deliberate practice with feedback. Using the same checklists, participants completed a skills posttest and were required to meet a minimum passing standard (MPS) to obtain CME/MOC credit.

MEASUREMENTS

The MPS for each skills checklist was determined by a multidisciplinary panel of 11 experts. Participants completed surveys on procedure self-confidence and a course evaluation.

RESULTS

There was statistically significant improvement between pre- and posttests for all four procedures (p < .001). All participants were able to meet or exceed the MPS for each skill during the 2-day course. Participants' self-confidence regarding each procedure improved significantly (p < .001).

CONCLUSION

An SBML training course granting CME/MOC credit for post-acute care providers significantly improves performance of knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing.

Ultrasound-Guided Peripheral Intravenous Catheter Insertion Training Reduces Use of Midline Catheters in Hospitalized Patients With Difficult Intravenous Access

OBJECTIVES

Difficult intravenous (IV) access (DIVA) is a prevalent condition in the hospital setting and increases utilization of midline catheters (MCs) and peripherally inserted central catheters (PICCs). Ultrasound-guided peripheral intravenous (USGPIV) insertion is effective at establishing intravenous access in DIVA but remains understudied in the inpatient setting. We evaluated the effect of an USGPIV simulation-based mastery learning (SBML) curriculum for nurses on MC and PICC utilization for hospitalized patients.

METHODS

We performed a quasi-experimental observational study. We trained nurses across all inpatient units at a large tertiary care hospital. We queried the electronic medical record to compare PICC and MC utilization for patients with DIVA during 3 periods: before USGPIV SBML training (control), during pilot testing of the intervention, and during the SBML intervention. To account for variations in insertion practices over time, we performed an interrupted time series (ITS) analysis between 2 periods, the combined control and pilot periods and the intervention period.

RESULTS

One hundred forty-eight nurses completed USGPIV SBML training. Midline catheters inserted monthly per 1000 patient-days for DIVA decreased significantly from 1.86 ± 0.51 (control) to 2.31 ± 0.28 (pilot) to 1.33 ± 0.51 (intervention; P = 0.001). The ITS analysis indicated a significant intervention effect (P < 0.001). Peripherally inserted central catheters inserted monthly per 1000 patient-days for DIVA also significantly decreased over the study periods; however, the ITS failed to show an intervention effect as PICC insertions were already decreasing during the control period.

CONCLUSIONS

A hospital-wide USGPIV SBML curriculum for inpatient nurses was associated with a significant reduction in MCs inserted for DIVA.

A mastery learning approach to education about fall risk and gait assessment

Mastery learning is a form of competency-based education in which learning time varies but outcomes are uniform. Trainees must meet a minimum passing standard (MPS) before completing a mastery learning curriculum. The objective of this study was to establish a curriculum for fall risk and gait assessment for medical students, determine an MPS for a fall risk and gait assessment clinical skills examination (CSE), and apply the MPS to a sample of medical students completing a fall risk and gait assessment CSE. Medical students completed an interactive session about fall risk and gait assessment including the Timed Up and Go (TUG) test and completed deliberate practice with 3 patients. Skills were evaluated using an 18-item skills checklist. A panel of clinical experts set the MPS at 82%. Eighty-seven medical students participated. The average score on the checklist was 14.7 of 18 (81.4%.) Although almost all performed the TUG correctly, only 61% met the MPS for the checklist. Our results suggest that a mastery learning approach may better prepare the 39% of students that did not meet MPS to complete a fall risk and gait assessment.

Psychometric Validation of Central Venous Catheter Insertion Mastery Learning Checklist Data and Decisions

INTRODUCTION

Resident physicians are expected to acquire competence at central venous catheter (CVC) insertion to a mastery standard. Valid competence decisions about resident physicians' CVC performance rely on reliable data and rigorous achievement standards. This study used data from 3 CVC simulation-based mastery learning studies involving internal medicine (IM) and emergency medicine (EM) residents to address 2 questions: What is the effectiveness of a CVC mastery learning education intervention? Are minimum passing standards (MPSs) set by faculty supported by item response theory (IRT) analyses?

METHODS

Pretraining and posttraining skills checklist data were drawn from 3 simulation-based mastery learning research reports about CVC internal jugular (IJ) and subclavian (SC) insertion skill acquisition. Residents were required to meet or exceed a posttest skills MPS. Generalized linear mixed effect models compared checklist performance from pre to postintervention. Minimum passing standards were determined by Angoff and Hofstee standard setting methods. Item response theory models were used for cut-score evaluation.

RESULTS

Internal medicine and EM residents improved significantly on every IJ and SC checklist item after mastery learning. Item response theory analyses support the IJ and SC MPSs.

CONCLUSIONS

Mastery learning is an effective education intervention to achieve clinical skill acquisition among IM and EM residents. Item response theory analyses reveal desirable measurement properties for the MPSs previously set by expert faculty panels. Item response theory analysis is useful for evaluating standards for mastery learning interventions. The CVC mastery learning curriculum, reliable outcome data, and high achievement standards together contribute to reaching valid decisions about the competence of resident physicians to perform the clinical procedure.

Barriers and Facilitators to Central Venous Catheter Insertion: A Qualitative Study

OBJECTIVES

The aims of the study were to identify perceived barriers and facilitators to central venous catheter (CVC) insertion among healthcare providers and to understand the extent to which an existing Simulation-Based Mastery Learning (SBML) program may address barriers and leverage facilitators.

METHODS

Providers participating in a CVC insertion SBML train-the-trainer program, in addition to intensive care unit nurse managers, were purposively sampled from Veterans Administration Medical Centers located in geographically diverse areas. We conducted semistructured interviews to assess perceptions of barriers and facilitators to CVC insertion. Deidentified transcripts were analyzed using a grounded theory approach and the constant comparative method. We subsequently mapped identified barriers and facilitators to our SBML curriculum to determine whether or not the curriculum addresses these factors.

RESULTS

We interviewed 28 providers at six Veterans Administration Medical Centers, identifying the following five overarching factors of perceived barriers to CVC insertion: (1) equipment, (2) personnel/staff, (3) setting or organizational context, (4) patient or provider, and (5) time-related barriers. Three overarching factors of facilitators emerged: (1) equipment, (2) personnel, and (3) setting or organizational context facilitators. The SBML curriculum seems to address most identified barriers, while leveraging many facilitators; building on the commonly identified facilitator of nursing staff contribution by expanding the curriculum to explicitly include nurse involvement could improve team efficiency and organizational culture of safety.

CONCLUSIONS

Many identified facilitators (e.g., ability to use ultrasound, personnel confidence/competence) were also identified as barriers. Evidence-based SBML programs have the potential to amplify these facilitators while addressing the barriers by providing an opportunity to practice and master CVC insertion skills.

Simulation-based training improves polypectomy skills among practicing endoscopists

Background and study aims  Practicing endoscopists have variable polypectomy skills during colonoscopy and limited training opportunities for improvement. Simulation-based training enhances procedural skill, but its impact on polypectomy is unclear. We developed a simulation-based polypectomy intervention to improve polypectomy competency. Methods  All faculty endoscopists at our tertiary care center who perform colonoscopy with polypectomy were recruited for a simulation-based intervention assessing sessile and stalked polypectomy. Endoscopists removed five polyps in a simulation environment at pretest followed by a training intervention including a video, practice, and one-on-one feedback. Within 1-4 weeks, endoscopists removed five new simulated polyps at post-test. We used the Direct Observation of Polypectomy Skills (DOPyS) checklist for assessment, evaluating individual polypectomy skills, and global competency (scale: 1-4). Competency was defined as an average global competency score of ≥ 3. Results  83 % (29/35) of eligible endoscopists participated and 95 % (276/290) of planned polypectomies were completed. Only 17 % (5/29) of endoscopists had average global competency scores that were competent at pretest compared with 52 % (15/29) at post-test ( P  = 0.01). Of all completed polypectomies, the competent polypectomy rate significantly improved from pretest to post-test (55 % vs. 71 %; P  < 0.01). This improvement was significant for sessile polypectomy (37 % vs. 65 %; P  < 0.01) but not for stalked polypectomy (82 % vs. 80 %; P  = 0.70). Conclusions  Simulation-based training improved polypectomy skills among practicing endoscopists. Further studies are needed to assess the translation of simulation-based education to clinical practice.

Simulation-Based Assessments and Graduating Neurology Residents' Milestones: Status Epilepticus Milestones

BACKGROUND

The American Board of Psychiatry and Neurology and the Accreditation Council for Graduate Medical Education (ACGME) developed Milestones that provide a framework for residents' assessment. However, Milestones do not provide a description for how programs should perform assessments.

OBJECTIVES

We evaluated graduating residents' status epilepticus (SE) identification and management skills and how they correlate with ACGME Milestones reported for epilepsy and management/treatment by their program's clinical competency committee (CCC).

METHODS

We performed a cohort study of graduating neurology residents from 3 academic medical centers in Chicago in 2018. We evaluated residents' skills identifying and managing SE using a simulation-based assessment (26-item checklist). Simulation-based assessment scores were compared to experience (number of SE cases each resident reported identifying and managing during residency), self-confidence in identifying and managing these cases, and their end of residency Milestones assigned by a CCC based on end-of-rotation evaluations.

RESULTS

Sixteen of 21 (76%) eligible residents participated in the study. Average SE checklist score was 15.6 of 26 checklist items correct (60%, SD 12.2%). There were no significant correlations between resident checklist performance and experience or self-confidence. The average participant's level of Milestone for epilepsy and management/treatment was high at 4.3 of 5 (SD 0.4) and 4.4 of 5 (SD 0.4), respectively. There were no significant associations between checklist skills performance and level of Milestone assigned.

CONCLUSIONS

Simulated SE skills performance of graduating neurology residents was poor. Our study suggests that end-of-rotation evaluations alone are inadequate for assigning Milestones for high-stakes clinical skills such as identification and management of SE.

Impact of Simulation-based Mastery Learning on Resident Skill Managing Mechanical Ventilators

Background: Caring for patients requiring mechanical ventilation is complex, and residents may lack adequate skill for managing these patients. Simulation-based mastery learning (SBML) is an educational model that trains clinicians to a high standard and can reduce complications. The mastery learning model has not been applied to ventilator management. Objective: The purpose of this study was to determine whether SBML, as compared with traditional training, is an effective strategy for teaching residents the skills necessary to manage patients requiring mechanical ventilation. Methods: We developed an SBML curriculum and a 47-item skills checklist to test ventilator management for patients with normal, restricted, and obstructed lung physiology. A minimum passing standard (MPS) on the checklist was set using the Mastery Angoff method. Residents rotating through the medical intensive care unit in Academic Year 2017-2018 were assigned to SBML or traditional training based on their medical intensive care unit team. The SBML group was pretested on a ventilator simulator using the skills checklist. They then received a 1.5-hour session (45 min didactic and 45 min deliberate practice on the simulator with feedback). At rotation completion, they were posttested on the simulator using the checklist until the MPS was met. Both SBML-trained and traditionally trained groups received teaching during daily bedside rounds and twice weekly didactic lectures. At rotation completion, traditionally trained residents were tested using the same skills checklist on the simulator. We compared pretest and posttest performance among SBML-trained residents and end of the rotation test performances between the SBML-trained and traditionally trained residents. Results: The MPS was set at 87% on the checklist. Fifty-seven residents were assigned to the SBML-trained group and 49 were assigned to the traditionally trained group. Mean checklist scores for SBML-trained residents improved from 51.4% (standard deviation [SD] = 17.5%) at pretest to 86.1% (SD = 7.6%) at initial posttest and 92.5% (SD = 3.7%) at final (mastery) posttest (both P < 0.001). Forty-two percent of residents required more than one attempt at the posttest to meet or exceed the MPS. At rotation completion, the traditionally trained residents had a mean test score of 60.9% (SD = 13.3%). Conclusion: SBML is an effective strategy to train residents on mechanical ventilator management. An SBML curriculum may augment traditional training methods to further equip residents to safely manage ventilated patients.

Promoting Readiness for Residency: Embedding Simulation-Based Mastery Learning for Breaking Bad News Into the Medicine Subinternship

PURPOSE

It is challenging to add rigorous, competency-based communication skills training to existing clerkship structures. The authors embedded a simulation-based mastery learning (SBML) curriculum into a medicine subinternship to demonstrate feasibility and determine the impact on the foundational skill of breaking bad news (BBN).

METHOD

All fourth-year students enrolled in a medicine subinternship at Northwestern University Feinberg School of Medicine from September 2017 through August 2018 were expected to complete a BBN SBML curriculum. First, students completed a pretest with a standardized patient using a previously developed BBN assessment tool. Learners then participated in a 4-hour BBN skills workshop with didactic instruction, focused feedback, and deliberate practice with simulated patients. Students were required to meet or exceed a predetermined minimum passing standard (MPS) at posttest. The authors compared pretest and posttest scores to evaluate the effect of the intervention. Participant demographic characteristics and course evaluations were also collected.

RESULTS

Eighty-five students were eligible for the study, and 79 (93%) completed all components. Although 55/79 (70%) reported having personally delivered serious news to actual patients, baseline performance was poor. Students' overall checklist performance significantly improved from a mean of 65.0% (SD = 16.2%) items correct to 94.2% (SD = 5.9%; P < .001) correct. There was also statistically significant improvement in scaled items assessing quality of communication, and all students achieved the MPS at mastery posttest. All students stated they would recommend the workshop to colleagues.

CONCLUSIONS

It is feasible to embed SBML into a required clerkship. In the context of this study, rigorous SBML resulted in uniformly high levels of skill acquisition, documented competency, and was positively received by learners.

Improving cardiology fellow education of right heart catheterization using a simulation based curriculum

BACKGROUND

Medical procedures are traditionally taught informally at patients' bedside through observation and practice using the adage "see one, do one, teach one." This lack of formalized training can cause trainees to be unprepared to perform procedures independently. Simulation based education (SBE) increases competence, reduces complications, and decreases costs. We developed, implemented, and evaluated the efficacy of a right heart catheterization (RHC) SBE curriculum.

METHODS

The RHC curriculum consisted of a pretest, video didactics, deliberate practice, and a posttest. Pre-and posttest skills examinations consisted of a dichotomous 43-item checklist on RHC skills and a 14-item hemodynamic waveform quiz. We enrolled two groups of fellows: 6 first-year, novice cardiology fellows at Northwestern University in their first month of training, and 11 second- and third-year fellows who had completed traditional required, level I training in RHC. We trained the first-year fellows at the beginning of the 2018-2019 year using the SBE curriculum and compared them to the traditionally-trained cardiology fellows who did not complete SBE.

RESULTS

The SBE-trained fellows significantly improved RHC skills, hemodynamic knowledge, and confidence from pre- to posttesting. SBE-trained fellows performed similarly to traditionally-trained fellows on simulated RHC skills checklists (88.4% correct vs. 89.2%, p = .84), hemodynamic quizzes (94.0% correct vs. 86.4%, p = .12), and confidence (79.4 vs. 85.9 out of 100, p = .15) despite less clinical experience.

CONCLUSIONS

A SBE curriculum for RHC allowed novice cardiology fellows to achieve level I skills and knowledge at the beginning of fellowship and can train cardiology fellows before patient contact.

Continuity With Patients, Preceptors, and Peers Improves Primary Care Training: A Randomized Medical Education Trial

PURPOSE

Infusing continuity of care into medical student clerkships may accelerate professional development, preserve patient-centered attitudes, and improve primary care training. However, prospective, randomized studies of longitudinal curricula are lacking.

METHOD

All entering Northwestern University Feinberg School of Medicine students in 2015 and 2016 were randomized to the Education Centered Medical Home (ECMH), a 4-year, team-based primary care clerkship; or a mentored individual preceptorship (IP) for 2 years followed by a traditional 4-week primary care clerkship. Students were surveyed 4 times (baseline, M1, M2, and M3 year [through 2018]); surveys included the Maslach Burnout Inventory (MBI); the Communication, Curriculum, and Culture (C3) survey assessing the hidden curriculum; and the Attitudes Toward Health Care Teams (ATHCT) scale. The authors analyzed results using an intent-to-treat approach.

RESULTS

Three hundred twenty-nine students were randomized; 316 (96%) participated in surveys. Seventy percent of all respondents would recommend the ECMH to incoming first-year students. ECMH students reported a more positive learning environment (overall quality, 4.4 ECMH vs 4.0 IP, P < .001), greater team-centered attitudes (ATHCT scale, 3.2 vs 3.0, P = .007), less exposure to negative aspects of the hidden curriculum (C3 scale, 4.6 vs 4.3, P < .001), and comparable medical knowledge acquisition. ECMH students established more continuity relationships with patients (2.2 vs 0.3, P < .001) and reported significantly higher professional efficacy (MBI-PE, 4.1 vs 3.9, P = .02).

CONCLUSIONS

In this randomized medical education trial, the ECMH provided superior primary care training across multiple outcomes compared with a traditional clerkship-based model, including improved professional efficacy.

Patient, Caregiver, and Clinician Perceptions of Ventricular Assist Device Self-care Education Inform the Development of a Simulation-based Mastery Learning Curriculum

BACKGROUND

Patients who undergo ventricular assist device (VAD) implantation and their caregivers must rapidly learn a significant amount of self-care skills and knowledge.

OBJECTIVE

The aim of this study was to explore patient, caregiver, VAD coordinator, and physician perspectives and perceptions of existing VAD self-care training to inform development of a simulation-based mastery learning (SBML) curriculum to teach patients and caregivers VAD self-care skills and knowledge.

METHODS

We conducted semistructured, in-person interviews with patients with a VAD, their caregivers, VAD coordinators, and physicians (cardiac surgeons, an infectious disease physician, and advanced heart failure cardiologists). We used a 2-cycle team-based iterative inductive approach to coding and analysis.

RESULTS

We interviewed 16 patients, 12 caregivers, 7 VAD coordinators, and 11 physicians. Seven major themes were derived from the interviews including (1) identification of critical curricular content, (2) need for standardization and assessment, (3) training modalities, (4) benefits of repetition, (5) piercing it all together, (6) need for refresher training, and (7) provision of training before implant.

CONCLUSIONS

Findings from this study suggest that SBML is a natural fit for the high-risk tasks needed to save VAD self-care. The 7 unique training-related themes derived from the qualitative data informed the design and development of a VAD SBML self-care curriculum.

Simulation-Based Mastery Learning Improves Patient and Caregiver Ventricular Assist Device Self-Care Skills: A Randomized Pilot Trial

BACKGROUND

No recognized standards exist for teaching patients and their caregivers ventricular assist device (VAD) self-care skills. We compared the effectiveness of a VAD simulation-based mastery learning (SBML) self-care training curriculum with usual VAD self-care training.

METHODS AND RESULTS

VAD patients and their caregivers were randomized to SBML or usual training during their implant hospitalization. The SBML group completed a pretest on 3 VAD self-care skills (controller, power source, and dressing change), then viewed videos and participated in deliberate practice on a simulator. SBML participants took a posttest and were required to meet or exceed a minimum passing standard for each of the skills. The usual training group completed the existing institutional VAD self-care teaching protocol. Before hospital discharge, the SBML and usual training groups took the same 3 VAD self-care skills tests. We compared demographic and clinical information, self-confidence, total participant training time, and skills performance between groups. Forty participants completed the study in each group. There were no differences in demographic and clinical information, self-confidence, or training time between groups. More participants in the SBML group met the minimum passing standard compared with the usual training group for controller (37/40 [93%] versus 25/40 [63%]; P=0.001), power source (36/40 [90%] versus 9/40 [23%]; P<0.001), and dressing change skills (19/20 [95%] versus 0/20; P<0.001).

CONCLUSIONS

SBML provided superior VAD self-care skills learning outcomes compared with usual training. This study has important implications for patients due to the morbidity and mortality associated with improper VAD self-care.

CLINICAL TRIAL REGISTRATION

URL: http://www.clinicaltrials.gov. Unique identifier: NCT03073005.

A Mastery Learning Capstone Course to Teach and Assess Components of Three Entrustable Professional Activities to Graduating Medical Students

PROBLEM

Thirteen measurable Entrustable Professional Activities (EPAs) have been proposed by the Association of American Medical Colleges as a means to operationalize medical school graduates' patient care qualifications. Mastery learning is an effective method for boosting clinical skills, but its applicability to the EPAs remains to be studied. The authors designed this study to evaluate a mastery learning intervention to teach and assess components of 3 of the 13 EPAs in a 4th-year capstone course.

INTERVENTION

The course featured mastery learning principles and addressed three EPA-based skills: (a) obtain informed consent, (b) develop a differential diagnosis and write admission orders, and (c) write discharge prescriptions. All students underwent a baseline skills assessment, received feedback, engaged in deliberate practice with actionable feedback, and completed a similar skills-based posttest assessment. Students continued with practice and testing until the minimum passing standards (MPSs) were reached for each posttest.

CONTEXT

All medical students at a single medical school (Northwestern University, Feinberg School of Medicine) who matriculated in 2012 and graduated with the class of 2016 participated in a required transition to residency course immediately prior to graduation.

OUTCOME

There were 134 students eligible to participate, and 130 (97.0%) completed all curricular requirements and assessments. All 130 medical students who completed the course met or exceeded the MPS for each of the three EPA-based clinical skills. Reliability coefficients for outcome data were uniformly high. Measures for each of the three clinical skills showed statistically significant improvement.

LESSONS LEARNED

The capstone course was an effective approach to teach and assess components of three EPA-based clinical skills to mastery learning standards in a 4th-year capstone course. We learned that this approach for implementation is feasible and results in significant improvement in components of EPA skill performance. Next steps will include developing assessments incorporating the mastery model into components of additional EPAs, identifying the best location within the curriculum to insert this content, and expanding the number of assessments as part of a larger assessment system.

Development of a Simulation-Based Mastery Learning Curriculum for Breaking Bad News

INTRODUCTION

Physician communication impacts patient outcomes. However, communication skills, especially around difficult conversations, remain suboptimal, and there is no clear way to determine the validity of entrustment decisions. The aims of this study were to 1) describe the development of a simulation-based mastery learning (SBML) curriculum for breaking bad news (BBN) conversation skills and 2) set a defensible minimum passing standard (MPS) to ensure uniform skill acquisition among learners.

INNOVATION

An SBML BBN curriculum was developed for fourth-year medical students. An assessment tool was created to evaluate the acquisition of skills involved in a BBN conversation. Pilot testing was completed to confirm improvement in skill acquisition and set the MPS.

OUTCOMES

A BBN assessment tool containing a 15-item checklist and six scaled items was developed. Students' checklist performance improved significantly at post-test compared to baseline (mean 65.33%, SD = 12.09% vs mean 88.67%, SD = 9.45%, P < 0.001). Students were also significantly more likely to have at least a score of 4 (on a five-point scale) for the six scaled questions at post-test. The MPS was set at 80%, requiring a score of 12 items on the checklist and at least 4 of 5 for each scaled item. Using the MPS, 30% of students would require additional training after post-testing.

COMMENTS

We developed a SBML curriculum with a comprehensive assessment of BBN skills and a defensible competency standard. Future efforts will expand the mastery model to larger cohorts and assess the impact of rigorous education on patient care outcomes.

Perceptions of Patient-Centered Care among First-Year Medical Students

Phenomenon: Teaching patient-centered care (PCC) is a key component of undergraduate medical curricula. Prior frameworks of PCC describe multiple domains of patient-centeredness, ranging from interpersonal encounters to systems-level issues. Medical students' perceptions of PCC are thought to erode as they progress through school, but little is known about how students view PCC toward the beginning of training. This study explores the perceptions of PCC among 1st-year medical students to inform curricular development and evaluation. Approach: Medical students participated in semistructured, in-person interviews within 4 months of starting medical school as part of a longitudinal study. Transcripts were analyzed using a grounded theory approach and the constant comparative method to describe responses and characterize emergent themes. Transcripts were reviewed to compare codes and compile a final codebook. Findings: Thirty-eight students completed interviews. Students provided heterogeneous definitions of PCC, including perceptions that PCC is implicit and obvious. Many students were unable to provide a concrete definition of PCC, juxtaposing PCC with other priorities such as profit- or physician-centered care, whereas others thought the term was jargon. Some participants defined PCC as upholding patient values using hypothetical examples centered around physician behavior. Insights: Although students appeared to enter medical school with a range of perceptions about PCC, many of their descriptions were limited and only scratch the surface of existing frameworks. Rather than their perceptions of PCC eroding during medical school, students may never fully develop a foundational understanding of PCC. Our findings reinforce the need for authentic, clinically experiential learning opportunities that promote PCC from the earliest stages of medical education.

The Effect of Judge Selection on Standard Setting Using the Mastery Angoff Method during Development of a Ventricular Assist Device Self-Care Curriculum

Background

Patients and caregivers need to perform ventricular assist device (VAD) self-care safely to help prevent complications (e.g., infection). We developed a VAD self-care simulation-based mastery learning (SBML) curriculum. We determined optimal minimum passing scores (MPSs) and evaluated effects of judge selection.

Methods

A multidisciplinary team created a VAD self-care SBML curriculum including simulated skills and knowledge examinations. Patients, caregivers, VAD coordinators, and physicians were expert judges who determined MPSs using the Mastery Angoff method.

Results

MPSs for the skills and knowledge examinations were high (range = 94-99% and 97% correct), respectively. Judges closely agreed on MPSs.

Conclusions

Stakeholders set stringent MPSs for high-stakes VAD self-care.

A Comparison of Approaches for Mastery Learning Standard Setting

PURPOSE

Defensible minimum passing standards (MPSs) must be used to evaluate learner performance outcomes in health professions education. In this study, the authors compared the results of traditional Angoff and Hofstee standard-setting exercises with the Mastery Angoff and Patient-Safety approaches for central venous catheter (CVC) insertion skills examinations. The authors also evaluated how these standards affected the historical performance of residents who participated in a simulation-based mastery learning (SBML) curriculum for CVC insertion skills.

METHOD

In April and May 2015, 12 physicians with expertise in CVC insertion set MPSs for previously published internal jugular (IJ) and subclavian (SC) CVC insertion checklists using Angoff, Hofstee, Mastery Angoff, and Patient-Safety approaches. The resulting MPSs were compared using historical performance of internal medicine and emergency medicine residents who participated in CVC insertion SBML.

RESULTS

The MPSs were set as follows: Angoff: IJ 91% checklist items correct, SC 90%. Hofstee: IJ 88%, SC 90%. Mastery Angoff: IJ 98%, SC 98%. Patient-Safety: IJ 98%, SC 98%. Based on the historical performance of 143 residents assessed on IJ and SC insertion, applying the 98% MPS would result in additional practice and retesting of 55/123 residents (45%) who had previously passed the IJ examination and 36/130 residents (28%) who had passed the SC examination using the Angoff and Hofstee MPSs.

CONCLUSIONS

The Mastery Angoff and Patient-Safety standard-setting approaches resulted in higher CVC insertion SBML MPSs compared with traditional standard-setting methods. Further study should assess the impact of these more rigorous standards on patient outcomes.

Simulation-Based Mastery Learning for Thoracentesis Skills Improves Patient Outcomes: A Randomized Trial

PURPOSE

Physicians-in-training often perform bedside thoracenteses in academic medical centers, and complications are more common among less experienced clinicians. Simulation-based mastery learning (SBML) is one potential solution to this problem. This study evaluated the effects of a randomized trial of thoracentesis SBML on patient complications: iatrogenic pneumothorax (IP), hemothorax, and reexpansion pulmonary edema (REPE).

METHOD

The authors randomized internal medicine residents to undergo thoracentesis SBML at a tertiary care academic center from December 2012 to May 2016. They subsequently compared thoracentesis complications from procedures performed by SBML-trained residents, traditionally trained residents (no simulation training), and those referred to pulmonary medicine or interventional radiology (IR).

RESULTS

During the study period, 917 thoracenteses were performed on 709 patients. IP occurred in 60 (6.5%) procedures, of which 7 (11.6%) were clinically meaningful. SBML-trained residents performed procedures with a trend toward lower combined clinically meaningful complications (IP, hemothorax, REPE) compared with traditionally trained residents (7.9% vs. 0%; P = .06). SBML-trained residents caused fewer clinically meaningful IPs compared with traditionally trained residents, pulmonary, and IR referrals (P = .02). Hemothorax occurred after 4 (0.4%) thoracenteses, and SBML-trained residents had a trend toward lower hemothorax (0) compared with other groups (P = .07). REPE occurred after 3 (0.3%) procedures, with no differences between groups. SBML-trained residents performed procedures with lower combined clinically meaningful complications compared with other groups (P = .008).

CONCLUSIONS

Residents randomized to an SBML intervention performed thoracenteses with low rates of clinically meaningful complications. Rigorous education represents a successful quality improvement strategy.

Healthcare Providers' Awareness and Perceptions of Competency Requirements in Central Venous Catheter Insertion

This article was migrated. The article was marked as recommended. Background Studies show that medical residents do not feel comfortable and lack the skills and confidence to perform common bedside procedures. Regulatory bodies often require a set number of procedures to determine resident competence, yet medical providers' knowledge of competency guidelines are less well known. This study aimed to qualitatively assess existing practices relevant to documentation of competency in central venous catheter (CVC) insertion and explore healthcare providers' awareness and perceptions of those practices at their institutions. Methods The authors performed a qualitative study at Veterans Affairs Medical Centers (VAMCs) from February to December 2014 as part of a larger project related to the dissemination of a simulation-based CVC insertion curriculum. Two authors conducted interviews with hospital staff (including attending physicians, nurses, and residents) at selected VAMCs. Recordings of interviews were transcribed, coded, and analyzed using a grounded theory approach and constant comparative techniques. Results Twenty-six participants were interviewed at six VAMCs. Participants reported varying perspectives regarding their institutions' policies about CVC insertion. Four major themes emerged: (1) knowledge of institutional policy; (2) competency by numbers; (3) documentation of competency; and (4) perceptions of competency measures. Participants reported concern about the reliability of these policies and measures of competence. Conclusions This study demonstrates that healthcare providers' knowledge and perceptions about institutional requirements for procedural competency vary widely. Our findings suggest the need for establishment of consistent competency policies based on evidence-based practices, and highlight the need for increased communication regarding individual institutional policies. Integration of rigorous simulation-based education, implemented consistently across institutions, can provide a reliable mechanism to train and assess procedural competence and ensure patient safety.

Introduction to Safe Space Training: Interactive Module for Promoting a Safe Space Learning Environment for LGBT Medical Students

INTRODUCTION

Lesbian, gay, bisexual, and transgender (LGBT) students face challenges in achieving their educational goals. By understanding concepts surrounding sexual orientation and gender identity, faculty, staff, and students can support LGBT community members and provide a safe educational space. In order to address this we created a condensed training resource that focused on skill building and is easily implemented institution-wide for students, residents, fellows, faculty, and staff.

METHODS

This module serves as an introduction to concepts integral to the LGBT community. It is structured into two sections and takes approximately 30 minutes to complete, including pre-/postevaluations. The first section of the module focuses on presenting basic information about the LGBT world experience and basic terminology. The second section contains two real-world scenarios aimed at demonstrating skills used to create a safe educational learning space. Each scenario contains interactive questions that allow participants to practice applying their new skills.

RESULTS

To date, 89 institutional community members at the Northwestern University Feinberg School of Medicine have completed the module. Survey results demonstrate that the module was well-received and effective at improving attitudes towards creating a safe space.

DISCUSSION

While this module provides a foundation in terminology and phenomena relevant to the LGBT experience, it is just one part of creating a positive institutional climate for LGBT community members. Additional in-person skills-based training should also be considered to complement and enhance this module's contents.

An institution-wide approach to submission, review, and funding of simulation-based curricula

This article describes the development, implementation, and modification of an institutional process to evaluate and fund graduate medical education simulation curricula. The goals of this activity were to (a) establish a standardized mechanism for proposal submission and evaluation, (b) identify simulation-based medical education (SBME) curricula that would benefit from mentored improvement before implementation, and (c) ensure that funding decisions were fair and defensible. Our intent was to develop a process that was grounded in sound educational principles, allowed for efficient administrative oversight, ensured approved courses were high quality, encouraged simulation education research and scholarship, and provided opportunities for medical specialties that had not previously used SBME to receive mentoring and faculty development.

Evaluation of a Mastery Learning Intervention on Hospitalists' Code Status Discussion Skills

CONTEXT

Although code status discussions (CSD) occur frequently in the hospital setting, discussions often lack content necessary for informed decision making. Simulation-based mastery learning (SBML) has been used to improve clinical skills among resident physicians and may provide a novel way to improve hospitalists' CSD skills.

OBJECTIVES

The objective of this pilot randomized controlled trial was to develop and evaluate a CSD SBML intervention for hospitalists.

METHODS

Twenty hospitalists were randomized to control vs. a CSD SBML intervention. Hospitalists conducted a baseline standardized patient encounter (pretest) that was scored using a 19-item CSD checklist and controls completed a repeat standardized patient encounter six months later (post-test). Intervention group hospitalists received at least one two-hour training session featuring deliberate practice and feedback and were expected to meet a minimum passing score (MPS) on the post-test of 84% set by an expert panel.

RESULTS

Only two of the 20 hospitalists met the MPS at pretest. Seventy percentage of intervention hospitalists achieved the MPS after a single training session. Post-test median checklist scores were higher for intervention hospitalists compared with controls (16.5 vs. 12.0, P = 0.0001). Intervention hospitalists were significantly more likely to ask about previous experiences with end-of-life decision making (70% vs. 20%, P = 0.03), explore values/goals (100% vs. 50%, P = 0.01), ask permission to make a recommendation regarding code status (60% vs. 0%, P = 0.003), and align recommendations with patient values/goals (90% vs. 40%, P = 0.02) than controls.

CONCLUSION

Few hospitalists demonstrated mastery of CSD skills at baseline; SBML was an effective way to improve these skills.

Residents' Procedural Experience Does Not Ensure Competence: A Research Synthesis

BACKGROUND

Many medical certifying bodies require that a minimum number of clinical procedures be completed during residency training to obtain board eligibility. However, little is known about the relationship between the number of procedures residents perform and their clinical competence.

OBJECTIVE

This study evaluated associations between residents' medical procedure skills measured in a simulation laboratory and self-reported procedure experience and year of training.

METHODS

This research synthesis extracted and summarized data from multiple cohorts of internal medicine, emergency medicine, anesthesiology, and neurology resident physicians who performed simulated clinical procedures. The procedures were central venous catheter insertion, lumbar puncture, paracentesis, and thoracentesis. We compared residents' baseline simulated performance to their self-reported procedure experience using data from 7 research reports written by Northwestern University investigators between 2006 and 2016. We also evaluated how performance differed by postgraduate year (PGY).

RESULTS

A total of 588 simulated procedures were performed during the study period. We found significant associations between passing the skills examinations and higher number of self-reported procedures performed (P = .011) and higher PGY (P < .001). However, performance for all procedures was poor, as only 10% of residents passed the assessments with a mean of 48% of checklist items correct (SD = 24.2). The association between passing the skills examination and year of training was mostly due to differences between PGY-1 and subsequent years of training.

CONCLUSIONS

Despite positive associations between self-reported experience and simulated procedure performance, overall performance was poor. Residents' clinical experience is not a proxy for skill.

Impact of a Video-Based Interactive Workshop on Unprofessional Behaviors Among Internal Medicine Residents

BACKGROUND

Unprofessional behaviors undermine the hospital learning environment and the quality of patient care.

OBJECTIVE

To assess the impact of an interactive workshop on the perceptions of and self-reported participation in unprofessional behaviors.

METHODS

We conducted a pre-post survey study at 3 internal medicine residency programs. For the workshop we identified unprofessional behaviors related to on-call etiquette: "blocking" an admission, disparaging a colleague, and misrepresenting a test as urgent. Formal debriefing tools were utilized to guide the discussion. We fielded an internally developed 20-item survey on perception and participation in unprofessional behaviors prior to the workshop. An online "booster" quiz was delivered at 4 months postworkshop, and the 20-item survey was repeated at 9 months postworkshop. Results were compared to a previously published control from the same institutions, which showed that perceptions of unprofessional behavior did not change and participation in the behaviors worsened over the internship.

RESULTS

Of 237 eligible residents, 181 (76%) completed both pre- and postsurvey. Residents perceived blocking an admission and the misrepresentation of a test as urgent to be more unprofessional at a 9-month follow-up (2.0 versus 1.74 and 2.63 versus 2.28, respectively; P < .05), with no change in perception for disparaging a colleague. Participation in unprofessional behaviors did not decrease after the workshop, with the exception of misrepresenting a test as urgent (61% versus 50%, P = .019).

CONCLUSIONS

The results of this multi-site study indicate that an interactive workshop can change perception and may lower participation in some unprofessional behaviors.

The effect of simulation-based mastery learning on thoracentesis referral patterns

Internal medicine (IM) residents and hospitalist physicians commonly perform thoracenteses. National data show that thoracenteses are also frequently referred to other services such as interventional radiology (IR), increasing healthcare costs. Simulation-based mastery learning (SBML) is an effective method to boost physicians' procedural skills and self-confidence. This study aimed to (1) assess the effect of SBML on IM residents' simulated thoracentesis skills and (2) compare thoracentesis referral patterns, self-confidence, and reasons for referral between traditionally trained residents (non-SBML-trained), SBML-trained residents, and hospitalist physicians. A random sample of 112 IM residents at an academic medical center completed thoracentesis SBML from December 2012 to May 2015. We surveyed physicians caring for hospitalized patients with thoracenteses during the same time period and compared referral patterns, self-confidence, and reasons for referral. SBML-trained resident thoracentesis skills improved from a median of 57.6% (interquartile range [IQR] 43.3-76.9) at pretest to 96.2% (IQR 96.2-100.0) at post-test (P < 0.001). Surveys demonstrated that traditionally trained residents were more likely to refer to IR and cited lower confidence as reasons. SBML-trained residents were more likely to perform bedside thoracenteses. Hospitalist physicians were most likely to refer to pulmonary medicine and cited lack of time to perform the procedure as the main reason. SBML-trained residents were most confident about their thoracentesis skills, despite hospitalist physicians having more experience. This study identifies confidence and time as reasons physicians refer thoracenteses rather than perform them at the bedside. Thoracentesis SBML boosts skills and promotes bedside procedures that are safe and less expensive than referrals. Journal of Hospital Medicine 2016;11:792-795. © 2016 Society of Hospital Medicine.

Factors Associated with Inpatient Thoracentesis Procedure Quality at University Hospitals

BACKGROUND

Physicians increasingly refer thoracentesis procedures to interventional radiology (IR) rather than performing them at the bedside. Factors associated with thoracentesis procedures at university hospitals were studied to determine clinical outcomes by provider specialty.

METHODS

An administrative database review was performed of patients who underwent an inpatient thoracentesis procedure in hospitals participating in the University HealthSystem Consortium (UHC) Database from January 2010 through September 2013. The incidence of iatrogenic pneumothorax, mean total hospital costs, and mean length of stay (LOS) were compared by clinical specialty.

RESULTS

There were 113,860 admissions with 132,472 thoracentesis procedures performed on 99,509 patients at 234 UHC hospitals. IR performed 43,783 (33%) thoracentesis procedures; medicine, 22,243 (17%); and pulmonary, 26,887 (20%). The incidence of iatrogenic pneumothorax was 2.8% for IR, 2.9% for medicine, and 3.1% for pulmonary. Medicine and pulmonary had equivalent risk of iatrogenic pneumothorax compared to IR after controlling for clinical covariates. Admissions with medicine and pulmonary procedures were associated with significantly lower costs compared to IR admissions (p < 0.001) after controlling for clinical covariates. Admissions with IR procedures had a mean LOS of 14.1 days; medicine, 13.2 days; and pulmonary, 15.9 days. Admissions with medicine and pulmonary procedures were associated with fewer hospital days when compared to IR in the controlled model (p < 0.001).

CONCLUSION

Admissions with medicine and pulmonary bedside thoracentesis procedures are as safe and less costly than IR procedures. Shifting IR thoracentesis procedures to the bedside might be a potential way to reduce hospital costs while still ensuring high-quality patient care, provided that portable ultrasound is used.

Dissemination of an innovative mastery learning curriculum grounded in implementation science principles: a case study

Dissemination of a medical education innovation, such as mastery learning, from a setting where it has been used successfully to a new and different medical education environment is not easy. This article describes the uneven yet successful dissemination of a simulation-based mastery learning (SBML) curriculum on central venous catheter (CVC) insertion for internal medicine and emergency medicine residents across medical education settings. The dissemination program was grounded in implementation science principles. The article begins by describing implementation science which addresses the mechanisms of medical education and health care delivery. The authors then present a mastery learning case study in two phases: (1) the development, implementation, and evaluation of the SBML CVC curriculum at a tertiary care academic medical center; and (2) the dissemination of the SBML CVC curriculum to an academic community hospital setting. Contextual information about the drivers and barriers that affected the SBML CVC curriculum dissemination is presented. This work demonstrates that dissemination of mastery learning curricula, like all other medical education innovations, will fail without active educational leadership, personal contacts, dedication, hard work, rigorous measurement, and attention to implementation science principles. The article concludes by presenting a set of lessons learned about disseminating an SBML CVC curriculum across different medical education settings.