Interventions Used to Improve Communication Competencies in Surgical Residencies: A Systematic Review

OBJECTIVE

To explore which educational interventions have been used to address communication skill in surgical residents.

DESIGN

Systematic review.

RESULTS

Several interventions have been used to improve communication skill in residency, including simulation, standardized patients, and didactic teaching. These interventions vary widely, yet the majority of interventions tend to result in improvement in resident communication skill.

CONCLUSIONS

Communication is an essential skill for surgical trainees to learn. Integration of communication-focused educational interventions can lead to improved skill development in surgical residents.

Peer review for handoff education in a transition to residency course: A prospective cohort study

Background and Aims

Association of American Medical Colleges (AAMC) and Accreditation Council for Graduate Medical Education (ACGME) mandate training in handoff delivery for students and residents. Communication errors, including errors during handoffs of patient care, account for over 2/3 of sentinel events. This study aims to assess the effectiveness of peer-assisted learning (PAL) in handoff education within a longitudinal framework.

Methods

This study involved the analysis of fourth-year medical students (n = 67) enrolled in a transition to residency program designed to reinforce skills essential for success in internal medicine residencies. We modified the I-PASS handoff rubric for a single-encounter evaluation. Before attending the transitions of care workshop, students submitted one written handoff report. During high-fidelity simulation sessions, peers evaluated the written document as well as verbal handoffs, while faculty evaluated a recorded verbal version. The primary outcome measured was improvement in handoff quality and accuracy over time and secondary outcomes compared peer- and self-evaluations to faculty assessments.

Results

Overall, students demonstrated a statistically significant improvement in handoff quality and accuracy across all scoring criteria after completing the peer evaluation process. Peer evaluations did not demonstrate statistically significant differences in scores for quality or accuracy questions as compared to faculty.

Conclusion

Peer evaluators effectively assessed handoff reports using the modified I-PASS checklist yielding outcomes similar to faculty while providing feedback. These findings provide exciting evidence that should prompt training programs to consider incorporating standardized peer review into handoff education for medical students and, potentially, residents. The detailed evaluation of individual handoff events fosters feedback skills essential for ongoing professional growth and clinical excellence.

An internal medicine residency preparatory curriculum for fourth-year medical students

BACKGROUND

Intern preparation courses are often broad in scope; there are few published specialty-specific programs outside of General Surgery and Obstetrics. We designed an internal medicine (IM) residency preparatory course at the University of Maryland School of Medicine, which aimed to prepare graduating medical students for the rigours of IM residency training, mapped to Entrustable Professional Activities (EPAs).

METHODS

Fourteen fourth-year medical students who were matriculating into IM residency programs enrolled in a 4-week long residency preparation course. The course was designed to teach skills using case-based learning modules, specialty topic seminars, simulation laboratories, procedure laboratories and clinical practice. Participants were surveyed before and after the course on their perceived knowledge and ability with the skills tested.

RESULTS

With the exception of 'giving signout to a colleague', there was a significant difference in the participant's perceived ability for each skill taught within the course (P < 0.03 for each), with mean pre-course scores of 1.4-3.7 (SD = 0.5-1.2) and mean post-course scores of 3.2-4.2 (SD = 0.5-1.3). A second survey on course evaluation and perceived impact, completed 3 months after starting intern year, resulted in all respondents reporting that the information learned during the course had directly affected their care of patients on a daily or weekly basis. The modified Ottawa scale was the primary assessment means for the EPAs, with participants approaching entrustment at the conclusion of the course.

CONCLUSIONS

Implementation of an IM-specific residency preparation course is a useful adjunct in the fourth year of medical school.

A Capstone Course for Senior Medical Students: from Innovative Elective to Required Core Curriculum

We describe our institution's development and implementation of our Capstone course from a small elective course to the only required fourth-year course. The course's structure evolved from mostly didactic to one including various workshops and simulation sessions. Course content has become increasingly specialty-specific. Implementation requires high faculty and resident involvement. Evaluations indicate a positive impact of the course on participants' self-reported confidence and residency preparedness. Assessment remains pass/fail with more specialty-specific questions. As steadily increasing numbers of medical schools are developing transition to residency courses, we share our Capstone course's evolution and lessons learned over the past nine years.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-023-01880-2.

The American College of Surgeons Entering Resident Readiness Assessment (ACS ERRA): Validity Evidence From a Three-Year National Study

OBJECTIVE

To gather validity evidence supporting the use and interpretation of scores from the American College of Surgeons Entering Resident Readiness Assessment (ACS ERRA) Program.

SUMMARY AND BACKGROUND DATA

ACS ERRA is an online formative assessment program developed to assess entering surgery residents' ability to make critical clinical decisions, and includes 12 clinical areas and 20 topics identified by a national panel of surgeon educators and residency program directors.

METHODS

Data from 3 national testing administrations of ACS ERRA (2018-2020) were used to gather validity evidence regarding content, response process, internal structure (reliability), relations to other variables, and consequences.

RESULTS

Over the 3 administrations, 1975 surgery residents participated from 125 distinct residency programs. Overall scores [Mean = 64% (SD = 7%)] remained consistent across the 3 years ( P = 0.670). There were no significant differences among resident characteristics (gender, age, international medical graduate status). The mean case discrimination index was 0.54 [SD = 0.15]. Kappa inter-rater reliability for scoring was 0.87; the overall test score reliability (G-coefficient) was 0.86 (Ф-coefficient = 0.83). Residents who completed residency readiness programs had higher ACS ERRA scores (66% versus 63%, Cohen's d = 0.23, P < 0.001). On average, 15% of decisions made (21/140 per test) involved potentially harmful actions. Variability in scores from graduating medical schools (7%) carried over twice as much weight than from matched residency programs (3%).

CONCLUSIONS

ACS ERRA scores provide valuable information to entering surgery residents and surgery program directors to aid in development of individual and group learning plans.

International Learner Perceptions, Educational Value, and Cost Associated With the Use of Start-to-Finish Surgical Simulation Compared With Cadaveric Models

BACKGROUND

Graduate surgical education is highly variable across regions and institutions regarding case volume and degree of trainee participation in each case. Dedicated educational curriculum using cadaveric tissue has been shown to enhance graduate surgical training, however with associated financial and utility burden to the institution.

OBJECTIVE

To investigate the utility of educational and cost applications of a novel method of combining mixed organic hydrogel polymers and 3-dimensional printed anatomic structures to create a complete "start-to-finish" simulation for resident education in spinal anatomy, instrumentation, and surgical techniques.

METHODS

This qualitative pilot study investigated 14 international participants on achievement of objective and personal learning goals in a standardized curriculum using biomimetic simulation compared with cadaveric tissue. A questionnaire was developed to examine trainee evaluation of individual anatomic components of the biomimetic simulators compared with previous experience with cadaveric tissue.

RESULTS

A total of 210 responses were acquired from 14 participants. Six participants originated from US residency education programs and 8 from transcontinental residency programs. Survey results for the simulation session revealed high user satisfaction. Score averages for each portion of the simulation session indicated learner validation of anatomic features for the simulation compared with previous cadaveric experience. Cost analysis resulted in an estimated savings of $10 833.00 for this single simulation session compared with previous cadaveric tissue sessions.

CONCLUSION

The results of this study indicate a strong potential of establishing biomimetic simulation as a cost-effective and high-quality alternative to cadaveric tissue for the instruction of fundamental spine surgical techniques.

Implementing Oncology Pharmacy Boot Camp for Advanced Pharmacy Practice Experience Students at a Regional Conference in Saudi Arabia

Background Upon graduation, pharmacy students are expected to possess a diverse array of knowledge, skills, and attitudes. A subject-specific boot camp may support bridging the gap between the information and skills gained during clerkships, courses required for pharmacy school after graduation, and skills needed for the job market, as well as the gap between pharmacy school and residency. This research aimed to determine whether an integrated boot camp increased Advanced Pharmacy Practice Experience (APPE) student self-confidence and enhanced students' knowledge in oncology pharmacy. Method APPE students who attended the annual meeting of the Saudi Oncology Pharmacy Assembly (SOPA)/International Society of Oncology Pharmacy Practitioners (ISOPP) Regional Conference 2021 were voluntarily enrolled in a three-hour oncology-focused boot camp consisting of interactive lectures. Pre- and post-intervention examinations were used to evaluate student learning outcomes and their experience feedback. Result Of 118 students who attended the boot camp, 80 students who met the criteria were included in the study. The pre- and post-intervention examinations were completed by the 80 APPE students. The pre-intervention test results (mean: 66%, standard deviation (SD): 16%) increased by 21.5% after the boot camp (mean: 87.5%, SD: 12%, p = 0.001). Students scored better on each of the 10 test questions, with nine questions demonstrating a statistically significant result. Conclusion The results of this research showed that interns who participated in an oncology boot camp had a higher level of knowledge and confidence in applying key oncology concepts. Interns were satisfied with the chance to engage in the activity, and they agreed to adding boot camps to future conferences would be valuable. This research shows that it is possible to hold a transitional boot camp during conferences to better prepare students for their fields of study and increase their participation in oncology conferences.

The First Two Years of the Association of Pediatric Surgery Training Program Directors (APSTPD) Transition to Fellowship Course: Lessons Learned and Future Directions

OBJECTIVE

The first transition to fellowship course for incoming pediatric surgery fellows was held in the US in 2018 and the second in 2019. The course aimed to facilitate a successful transition in to fellowship by introduction of the professional, patient care, and technical aspects unique to pediatric surgery training. The purpose of this study was to evaluate the feasibility and effectiveness of the first two years of this course in the US and discuss subsequent evolution of this endeavor.

DESIGN

This is a descriptive and qualitative analysis of two years' experience with the Association of Pediatric Surgery Training Program Directors' (APSTPD) Transition to Fellowship course. Course development and curriculum, including clinical knowledge, soft skills, and hands-on skills labs, are presented. Participating incoming fellows completed multiple choice, boards-style pre- and post-tests. Scores were compared to determine if knowledge was effectively transferred. Participants also completed post-course evaluations and subsequent 3- or 12-month surveys inquiring on the lasting impact of the course on their transition into fellowship. Standard univariate statistics were used to present results.

SETTING

The first APSTPD Transition to Fellowship course was held at the Johns Hopkins Hospital in Baltimore, Maryland in 2018, and the second course was held at the Oregon Health and Science University in Portland, Oregon in 2019.

PARTICIPANTS

All fellows entering ACGME-certified Pediatric Surgery fellowships in the United States were invited to participate. Twenty fellows accepted and attended in 2018, and fourteen fellows participated in 2019.

RESULTS

There were 34 incoming pediatric surgery fellow participants over 2 years. Faculty represented more than 10 institutions each year. Pre- and post-test scores were similar between years, with a significant improvement of scores after completion of the course (67±10% vs 79±8%, p < 0.001). Feedback from participants was overwhelmingly positive, with skills labs being attendees' favorite component. When asked about usefulness of individual course sessions, more attendees found clinical sessions more useful than soft skills (93% vs 73%, p = 0.011). Almost all (90%) of participants reported the course met its stated purpose and would recommend the course to future fellows. This was further reflected on 3 and 12 month follow up surveys wherein 85% stated they found the course helpful during the first few months of fellowship and 90% would still recommend it.

CONCLUSIONS

A transition to fellowship course in the US for incoming pediatric surgery fellows is logistically feasible, effective in transfer of knowledge, and highly regarded among attendees. Feedback from each course has been used to improve the subsequent courses, ensuring that it remains a valuable addition to pediatric surgical training in the US.

The Otolaryngology boot camp: a scoping review evaluating commonalities and appraisal for curriculum design and delivery

OBJECTIVE

Surgical boot camps are becoming increasingly popular in Otolaryngology-Head and Neck Surgery (OHNS) residency programs. Despite pioneering virtual reality and simulation-based surgical education, these boot camps have lacked critical appraisal. The objective of this article was to examine the adoption and utility of surgical boot camps in OHNS residency training programs around the world.

DATA SOURCES

Ovid Medline and PubMed databases were systematically searched in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for scoping reviews. Additionally, a grey literature search was performed.

REVIEW METHODS

Inclusion criteria were peer-reviewed publications and grey literature sources that reported on OHNS boot camps for the novice learner. The search was restricted to human studies published in English. Studies were excluded if they were not examining junior trainees.

RESULTS

A total of 551 articles were identified. Following removal of duplicates, screening, and full text review, 16 articles were included for analysis. Seven major boot camps were identified across various academic sites in the world. Most boot camps were one-day intensive camps incorporating a mixture of didactic, skill specific, and simulation sessions using an array of task trainers and high-fidelity simulators focusing on OHNS emergencies. Studies measuring trainee outcomes demonstrated improvement in trainee confidence, immediate knowledge, and skill acquisition.

CONCLUSION

Surgical boot camps appear to be an effective tool for short term knowledge and skill acquisition. Further studies should examine retention of skill and maintenance of confidence over longer intervals, as little is known about these lasting effects.

Competency-based medical education across the continuum: How well aligned are medical school EPAs to residency milestones?

INTRODUCTION

Competency-based medical education (CBME) provides a framework for describing learner progression throughout training. However, specific approaches to CBME implementation vary widely across educational settings. Alignment between various methods used across the continuum is critical to support transitions and assess learner performance. The purpose of this study was to investigate alignment between CBME frameworks used in undergraduate medical education (UME) and graduate medical education (GME) settings using the US context as a model.

METHOD

The authors analyzed content from the core entrustable professional activities for entering residency (Core EPAs; UME model) and residency milestones (GME model). From that analysis, they performed a series of cross-walk activities to investigate alignment between frameworks. After independent review, authors discussed findings until consensus was reached.

RESULTS

Some alignment was found for activities associated with history taking, physical examination, differential diagnosis, patient safety, and interprofessional care; however, there were far more examples of misalignment.

CONCLUSIONS

These findings highlight challenges creating alignment of assessment frameworks across the continuum of training. The importance of these findings includes implications for assessment and persistence of the educational gap across UME and GME. The authors provide four next steps to improve upon the continuum of education.

Education curriculum for surgical interns that improves stress management and grit levels

INTRODUCTION

Overwhelming stress or burnout has been observed in medical students, including 69% of surgical interns. This study aimed to assess the stress levels of fifth-year medical students during surgical training. An education curriculum with both clinical and research sessions was evaluated for its effect on the interns' stress and grit levels.

METHOD

A blinded, prospective study was conducted to evaluate the efficacy of an educational program on the recognition and management of stress. The State-Trait Anxiety Inventory (STAI) was used to assess anxiety. The Grit Scale was used to quantify the interns' grit, conscientiousness, and self-control.

RESULTS

The STAI survey results showed that the STAI state scores but not the trait scores were significantly lower in the intervention group than in the control group (p < 0.05). Additionally, the postintervention STAI score and the change in the STAI score were both lower in the intervention group (p < 0.05). There was a significant increase in grit among the medical students in the intervention group from baseline to post-intervention (p < 0.001). The scores of the consistency and perseverance subscales of the Grit Scale also increased significantly from baseline to post-intervention (both p < 0.001).

CONCLUSION

The education curriculum can improve interns' stress management and grit levels. We believe this curriculum needs to be implemented in medical education, and we plan to continue the program.

Sticking It Straight: Pediatric Procedure Curriculum Initiative

OBJECTIVES

Literature demonstrates that pediatric residents are not graduating with procedural confidence and competency. This was confirmed with our own institution's Accreditation Council for Graduate Medical Education and internal surveys. Our primary objective was to improve procedural confidence among pediatric residents with the introduction of a mandatory longitudinal pediatric procedural curriculum, including simulation in combination with online modules.

METHODS

We performed a quality improvement intervention to increase resident comfort level performing Accreditation Council for Graduate Medical Education-required procedures. This study involved pediatric residents, postgraduation year (PGY) 1-3, at an academic, tertiary care hospital. Between April 2015 and June 2017, the combination of online self-directed learning modules and hands-on simulation curriculum was implemented for pediatric residents. Surveys were administered at 1-year intervals to assess self-reported comfort level on 12 procedures using a Likert scale (1 for "strongly disagree" to 5 for "strongly agree, maximum score of 60 for all procedures).

RESULTS

Forty (63%) of 63 participant presurveys and 45 (71%) of 63 postsurveys were available for analysis. The mean comfort level for all procedures demonstrated a statistically significant increase from 32.4 to 37.1, or 12.7% (P = 0.005). By PGY level, the score increased from 24.4 to 30.9 (21%) for PGY1, 34.4 to 37.5 (8.3%) for PGY2, and 38.6 to 42.8 (9.8%) for PGY3 (P < 0.005). Overall, pediatric residents rated the simulation experience very favorably.

CONCLUSIONS

A mandatory longitudinal procedure curriculum improved procedural comfort level among pediatric residents. Iterative curriculum designs found the most productive combination to be deliberate practice within mastery learning simulation sessions with required precourse online modules.

A systematic review of methodological principles and delivery of surgical simulation bootcamps

BACKGROUND

The growth of "bootcamp style" simulation training in surgical practice has been exponential over the last decade. Developing and delivering a surgical bootcamp requires a significant investment. This systematic review aims to identify the key components that allow for a successful and rewarding surgical bootcamp course to be implemented that can be applied to all surgical specialities.

METHODS

To understand the surgical bootcamp principles and delivery mechanisms, we searched peer-reviewed, English language studies published between 2000 and 21.

RESULTS

From 137 articles, 14 studies with a Medical Education Research Quality Instrument Score of >11.5 were included. Most studies followed the core components; delivery at transition (12), mapping syllabus (13), multimodality delivery (14), and deliberate practice with formative feedback (12) apart from 1:1 training by only 2 studies.

CONCLUSIONS

Our review suggests that Surgical bootcamp can be an extremely useful education tool for trainees if 5 pillars of a boot camp are respected.

What Is the State of Compassion Education? A Systematic Review of Compassion Training in Health Care

PURPOSE

To investigate the current state and quality of compassion education interventions offered to health care providers during training or practice, determine how the components of each education intervention map onto the domains of an empirically based clinical model of compassion, and identify the most common approaches to compassion education.

METHOD

The MEDLINE, Embase, CINAHL Plus with Full Text, Sociological Abstracts, Web of Science, ERIC, and Education Research Complete databases were searched from inception to March 2020 in this systematic review. Studies that evaluated a compassion education intervention for health care providers or those in training to enhance compassion toward patients and/or families were included. A narrative synthesis of the included studies was performed. The components of each intervention were mapped onto the domains of compassion described in the Patient Compassion Model.

RESULTS

One hundred eight peer-reviewed publications describing 103 interventions were included. Modalities ranged from establishing curricula and interventions in clinical settings to programs that used humanities-based reflective practices, clinical simulation, role modeling, and contemplative practices, with many education interventions adopting a multimodal approach. Most interventions mapped to the virtuous response domain of the Patient Compassion Model; very few mapped to the other domains of this model.

CONCLUSIONS

Most interventions were limited as they focused on a single domain of compassion; did not adequately define compassion; were assessed exclusively by self-report; were devoid of a comparator/control group; and did not evaluate retention, sustainability, and translation to clinical practice over time. The authors suggest that compassion education interventions be grounded in an empirically based definition of compassion; use a competency-based approach; employ multimodal teaching methods that address the requisite attitudes, skills, behaviors, and knowledge within the multiple domains of compassion; evaluate learning over time; and incorporate patient, preceptor, and peer evaluations.

Otolaryngology Curriculum During Residency Preparation Course Improves Preparedness for Internship

OBJECTIVES/HYPOTHESIS

Residency preparation courses (RPCs) have become a widely adopted practice to ease the transition of medical students into residency, but these courses often lack training in skills expected of subspecialty interns. To fill this gap, a simulation-based curriculum in otolaryngology (ORL) was implemented at the University of Michigan Medical School. The curriculum aimed to improve confidence and perceived ability to perform common ORL skills for graduating students prior to internship.

STUDY DESIGN

Cross-sectional study.

METHODS

Six basic simulations (tracheostomy, flexible laryngoscopy, otomicroscopy, myringotomy and tube insertion, epistaxis and peritonsillar abscess management) were included in the first course in 2019. The course was expanded in 2020 with the addition of three advanced simulations (ear foreign body extraction, tracheostomy complications, and "cannot intubate, cannot ventilate" situations). Pre- and postsession surveys were collected to assess individual simulations and the course overall.

RESULTS

A total of 32 students participated in the ORL simulation curriculum in Spring 2019 and 2020. Paired t-tests showed significant improvement in self-perception of ability on every simulation. Qualitative feedback revealed that students particularly valued the opportunity for hands-on learning. Non-ORL students rated their baseline abilities significantly lower than ORL students on five stations, but they achieved statistically equivalent postsession ratings on all but the otomicroscopy station.

CONCLUSIONS

An ORL-specific curriculum is a valuable addition to procedural RPCs. The curriculum resulted in increased confidence and perceived ability in skill performance for both students pursuing ORL residencies, as well as those pursuing other procedural specialties.

LEVEL OF EVIDENCE

4 Laryngoscope, 131:E2143-E2148, 2021.

Self-directed learning by video as a means to improve technical skills in surgery residents: a randomized controlled trial

BACKGROUND

With their demanding schedules, surgical residents have limited time to practice techniques. The aim is to evaluate the pedagogic model of self-directed learning using video in surgery residents.

METHODS

Informed consent was obtained from all the participants. A randomized controlled trial was conducted in 2018 at Hôpital Maisonneuve-Rosemont (University of Montreal). Participants were general surgery residents. There were 27 eligible residents; 22 completed the study. They were filmed performing an intestinal anastomosis on cadaveric pig bowel. The self-directed learning by video (SDL-V) group was given an expert video, which demonstrated the technique performed by an experienced surgeon. The control group continued with their regular duties. Three weeks later, participants performed a second filmed anastomosis. Two attending surgeons evaluated the residents' filmed anastomosis using the Objective Structured Assessment of Technical Skills scale. After their second anastomosis, all participants had access to the expert video and completed a survey.

RESULTS

Score did not differ significantly between groups during the first (control: 23.6 (4.5) vs. SDL-V: 23.9 (4.5), p = 0.99, presented as mean (SD)) or second filmed anastomosis procedure (control: 27.1 (3.9) vs. SDL-V: 29.6 (3.4) p = 0.28). Both groups improved significantly from pre- to post-intervention (mean difference between the two anastomosis procedure with 95% CI for control: 3.5, [1.1; 5.9] and for SDL-V: 5.8, [3.4: 8.2]). Correlation between the evaluators for score was moderate (r = 0.6, 95% CI: [0.3: 0.8]). The pass/fail global evaluation exhibited poor inter-rater reliability (Kappa: 0.105, 95% CI: [- 0.2:0.4]). On the survey, all participants wanted more expert-made videos of specific surgical techniques.

CONCLUSIONS

Despite a higher final OSATS score for the intervention group, self-directed learning by video failed to produce a statistically significant difference on the overall OSATS scores between the two groups in this small cohort.

Surgical Residents' Perspective on Informed Consent-How Does It Compare With Attending Surgeons?

BACKGROUND

The informed consent discussion (ICD) is a compulsory element of clinical practice. Surgical residents are often tasked with obtaining informed consent, but formal instruction is not included in standard curricula. This study aims to examine attitudes of surgeons and residents concerning ICD.

MATERIALS AND METHODS

A survey regarding ICD was administered to residents and attending surgeons at an academic medical center with an Accreditation Council for Graduate Medical Education-accredited general surgery residency.

RESULTS

In total, 44 of 64 (68.75%) residents and 37 of 50 (72%) attending surgeons participated. Most residents felt comfortable consenting for elective (93%) and emergent (82%) cases, but attending surgeons were less comfortable with resident-led ICD (51% elective, 73% emergent). Resident comfort increased with postgraduate year (PGY) (PGY1 = 39%, PGY5 = 85%). A majority of participants (80% attending surgeons, 73% residents) believed resident ICD skills should be formally evaluated, and most residents in PGY1 (61%) requested formal instruction. High percentages of residents (86%) and attendings (100%) believed that ICD skills were best learned from direct observation of attending surgeons.

CONCLUSIONS

Resident comfort with ICD increases as residents advance through training. Residents acknowledge the importance of their participation in this process, and in particular, junior residents believe formal instruction is important. Attending surgeons are not universally comfortable with resident-led ICDs, particularly for elective surgeries. Efforts for improving ICD education including direct observation between attending surgeons and residents and formal evaluation may benefit the residency curriculum.

Results From an Evidenced-Based Curriculum Design With Innovative Simulators to Prepare Providers in Caring for Those With Burn Injuries

Burn care and medical education have undergone dramatic changes. Trauma has over seven courses covering fundamentals, whereas burns has one. Our goal was to develop a course to meet the needs of healthcare professionals requiring more advanced burn management training. A survey was distributed to burn physicians, nurses, therapists, administrators, and survivors, to assess the perceived proficiency of those managing adult and pediatric patients. Procedure simulators were developed, and a course was designed and delivered. An after-course survey of participants captured how this course filled identified knowledge gaps. A total of 188 initial surveys were sent to individuals involved in burn care. A diverse pool of 109 individuals participated (58% response rate). Survey results by providers demonstrated the lowest self-rated proficiency scores at managing large pediatric burns and frostbite. Nonphysicians reported low proficiency in developing wound treatment algorithms, performing escharotomies, and aftercare/reintegration. Following rigorous curriculum development, the course was conducted, and after-course surveys noted students' improved understanding of managing burn injuries, ability to troubleshoot, confidence to manage patients, and their recommending the course to a peer. Providing quality care beyond the initial assessment and stabilization of a burn-injured patient requires additional skills and knowledge. Providers that are uncomfortable or challenged in providing this care may benefit from additional training. Initial data show that a course, such as this one, provides the education necessary to fill the most commonly reported gaps in knowledge and skills. Further work is being invested to develop disaster management skills, assessment components, and further determine course validity.

Professionalism and inter-communication skills (ICS): a multi-site validity study assessing proficiency in core competencies and milestones in medical learners

BACKGROUND

Interpersonal and Communication Skills (ICS) and Professionalism milestones are challenging to evaluate during medical training. Paucity in proficiency, direction and validity evidence of assessment tools of these milestones warrants further research. We validated the reliability of the previously-piloted Instrument for Communication skills and Professionalism Assessment (InCoPrA) in medical learners.

METHODS

This validity approach was guided by the rigorous Kane's Framework. Faculty-raters and standardized patients (SPs) used their respective InCoPrA sub-component to assess distinctive domains pertinent to ICS and Professionalism through multiple expert-built simulated-scenarios comparable to usual care. Evaluations included; inter-rater reliability of the faculty total score; the correlation between the total score by the SPs; and the average of the total score by two-faculty members. Participants were surveyed regarding acceptability, realism, and applicability of this experience.

RESULTS

Eighty trainees and 25 faculty-raters from five medical residency training sites participated. ICC of the total score between faculty-raters was generally moderate (ICC range 0.44-0.58). There was on average a moderate linear relationship between the SPs and faculty total scores (Pearson correlations range 0.23-0.44). Majority of participants ascertained receiving a meaningful, immediate, and comprehensive patient-faculty feedback.

CONCLUSIONS

This work substantiated that InCoPrA was a reliable, standardized, evidence-based, and user-friendly assessment tool for ICS and Professionalism milestones. Validating InCoPrA showed generally-moderate agreeability and high acceptability. Using InCoPrA also promoted engaging all stakeholders in medical education and training-faculty, learners, and SPs-using simulation-media as pathway for comprehensive feedback of milestones growth.

Surgical simulation supplements reproductive endocrinology and infertility fellowship training

Objective

To assess if a surgical boot camp improves laparoscopic skill among reproduction endocrinology and infertility (REI) fellows and increases fellow desire to incorporate surgical skills into practice and to examine whether fellowship in vitro fertilization (IVF) volume correlates with surgical efficiency.

Design

Prospective evaluation.

Setting

Simulation Center.

Patients

Forty REI fellows.

Interventions

Fellows were timed before and after training in laparoscopic suturing and knot tying and while using virtual simulators. Fellows were surveyed before boot camp on prior experience with IVF and reproductive surgery, and immediately and 1 month after boot camp on their desire to incorporate surgical skills into practice.

Main Outcome Measures

Efficiency of laparoscopic suturing and knot tying before and after boot camp; likelihood and persistence of incorporating surgical skills into practice immediately and 1 month after boot camp; and correlation between fellowship IVF volume and fellow surgical efficiency.

Results

Fellows experienced significant improvement in laparoscopic suturing (44 sec), intracorporeal knot tying (82 sec), and extracorporeal knot tying (71 sec). Fellows reported being more likely to incorporate operative hysteroscopy (89%), operative laparoscopy (87%), and laparoscopic suturing (84%) into practice immediately following boot camp with no difference 1 month later. Fifty-four percent of fellows reported being more likely to perform robotic surgery after the boot camp, increasing to 70% 1 month later. There were weak correlations between IVF case volume and efficiency in laparoscopic suturing or hysteroscopic polypectomy (Spearman correlation coefficients, -0.14 and -0.03).

Conclusions

An intensive surgical boot camp enhances surgical skill among REI fellows.

Veterinary Intern Program for Entrustable Professional Activities Skills, a.k.a. Intern Boot Camp

The University of Tennessee College of Veterinary Medicine (UTCVM) Department of Large Animal Clinical Sciences has developed an intensive training program that all large animal veterinary interns are required to complete at the onset of their internship year. This program was designed to establish a uniform approach to entrustable professional activity (EPA) skills deemed essential by the large animal faculty. These EPA skills emphasize the clinical approaches and skills that interns should understand and demonstrate competency in early in their internship year. The EPA program, completed over 4 consecutive days, was coined the "Intern Boot Camp" and structured to fuse case-based lecture discussions and hands-on wet labs designed to develop or improve skills and techniques. At the conclusion of the boot camp, participants were given an evaluation survey to provide feedback on the program. The results were overwhelmingly positive, with 90% of the participants giving the program a rating of 5 on a scale ranging from 1 (poor opinion or experience) to 5 (excellent opinion or experience). Nearly 95% of participants stated that they felt more prepared for their internship year after attending the boot camp, and 100% of the participants indicated that they would recommend this program to future candidates. Given the positive outcomes over the past 4 years, the implementation of the Veterinary Intern Entrustable Professional Activities program (Intern Boot Camp) is considered a valuable component of the veterinary intern training program and could readily be adapted to other programs.

Evaluating the educational effectiveness of an 8-week patient management course for surgical interns: A nine-year analysis

INTRODUCTION

Our general surgery program mandates an 8-week "intern school" (IS) for matriculating surgery interns. The course consists of a pre-test, didactics, and a post-test. We hypothesized IS exam performance would correlate with American Board of Surgery In Training Examination (ABSITE) scores.∖ METHODS: This was a retrospective analysis of IS pre- and post-tests and ABSITE scores for all OHSU surgery interns from 2010 to 2018. McNemar's, chi-square, and Pearson tests were calculated.

RESULTS

The pre and post-test pass rate for 293 interns was 26% vs. 86% (p < 0.001). Categorical interns were more likely to pass the pre-test (33% vs 11% p = 0.004), and the post-test (96% vs 83% p = 0.007) than non-designated interns and more likely to pass the post-test than designated preliminary intern (96% vs 80%, p = 0.0014). There was no correlation between IS exams and ABSITE performance.

DISCUSSION

IS improves exam performance, but IS test scores do not correlate with ABSITE scores, and the program is not a means to identify interns at risk of poor ABSITE performance.

Multi-Specialty Boot Camp: Enhancing Student Confidence in Residency Preparation

BACKGROUND

A "boot camp" or senior preparatory course can help to bridge the gap between knowledge and skills attained in required clerkships and residency expectations. An under-researched area is in interventions across specialties and with student confidence as the outcome.

OBJECTIVE

A multi-specialty school-wide boot camp for 4th year medical students was evaluated with a curriculum that focused on specialty milestones and entrustable professional activities and the importance of student confidence as an outcome.

METHODS

A school-wide "boot camp" was developed to help 4th year students become ready for their matched specialty. Faculty resources were pooled to teach students from multiple specialties' common milestone topics. Surveys were collected from 3 academic years (2014-2015 to 2016-2017): pre-boot camp (Pre), immediately post-boot camp (Post 1), and 3 months after starting residency (Post 2). Dependent t-tests were employed to determine pre-post differences.

RESULTS

Over the 3-year study period, 185 students participated in boot camp, 162 (87.6%) completed the first 2 surveys, and 75 (40.5%) students provided data at all 3 points in time. With more robust findings between Pre and Post 1, students improved their confidence level in communicating with families and most specialty skills, and students felt more prepared to be an intern as a result of the boot camp.

CONCLUSIONS

The robust increase in student confidence suggested that a multi-specialty, school-wide approach to a capstone curriculum should be considered by medical schools, which will not only benefit students but faculty as well. Future research should examine student competence in achieving specialty skills.

Tool to improve qualitative assessment of left ventricular systolic function

Interactive online learning tools have revolutionized graduate medical education and can impart echocardiographic image interpretive skills. We created self-paced, interactive online training modules using a repository of echocardiography videos of normal and various degrees of abnormal left ventricles. In this study, we tested the feasibility of this learning tool. Thirteen anesthesia interns took a pre-test and then had 3 weeks to complete the training modules on their own time before taking a post-test. The average score on the post-test (74.6% ± 11.08%) was higher than the average score on the pre-test (57.7% ± 9.27%) (P < 0.001). Scores did not differ between extreme function (severe dysfunction or hyperdynamic function) and non-extreme function (normal function or mild or moderate dysfunction) questions on both the pre-test (P = 0.278) and post-test (P = 0.093). The interns scored higher on the post-test than the pre-test on both extreme (P = 0.0062) and non-extreme (P = 0.0083) questions. After using an online educational tool that allowed learning on their own time and pace, trainees improved their ability to correctly categorize left ventricular systolic function. Left ventricular systolic function is often a key echocardiographic question that can be difficult to master. The promising performance of this educational resource may lead to more time- and cost-effective methods for improving diagnostic accuracy among learners.

Does being in the hot seat matter? Effect of passive vs active learning in surgical simulation

BACKGROUND

Participation in simulation can improve future performance, but it is unclear if observation of simulation scenarios can produce an equivalent benefit.

METHODS

First-year surgical residents were exposed to various simulation scenarios in groups of 4 or 5, either through active participation or passive observation. Residents were individually assessed on 3 of the scenarios. Scores were categorized based on resident level of exposure to the scenario and analyzed using a multivariate analysis.

RESULTS

32 residents were enrolled and 28 underwent testing. Previous exposure to the scenario as a participant or observer led to improved performance on medical management and overall performance compared to those who had not been exposed (p < 0.02). However, active participation did not improve performance relative to passive observation (p > 0.1). Previous exposure did not improve communication aspects of the scenarios.

CONCLUSION

Analyses confirmed the advantage of simulation-based training, but additionally suggest that the benefits for similar in both active participants and passive observers. This supports the idea of group based simulation training which can be more cost and time efficient.

The Impact of an Introductory Radiation Oncology Curriculum (IROC) for Radiation Oncology Trainees Across the United States and Canada

PURPOSE

Despite interest from both radiation oncology residents and program directors, many residency training programs lack a formalized introductory curriculum to orient incoming radiation oncology residents to the specialty.

METHODS AND MATERIALS

Using the 6-step model for medical education curriculum development, a structured introductory radiation oncology curriculum (IROC) was created for incoming post-graduate year 2 (PGY-2) radiation oncology residents to address foundational concepts including patient simulation, contouring, and plan evaluation. The curriculum was distributed to 55 training programs across the United States and Canada at the start of the 2018 to 2019 and 2019 to 2020 academic years. Feasibility of curriculum dissemination was assessed via a survey of participating program directors. Curriculum effectiveness was assessed using an anonymous survey of participating residents administered pre- and postcurriculum and consisting of both subjective and objective knowledge-based questions.

RESULTS

A total of 236 residents participated in IROC at the start of the 2018 to 2019 and 2019 to 2020 academic years. Of those, 228 of 236 (97%) completed both the pre- and postcurriculum surveys. Of participating residents, the median residency program size was 10 (range, 2-28), and the median number of residents in each program per year was 3 (range, 1-7). At baseline, most PGY-2s (142 of 228, 62%) reported being "not at all" or "slightly" prepared to function in the radiation oncology clinic, and after IROC most (188 of 228, 82%) felt "moderately," "quite," or "extremely" prepared. Objective knowledge improved pre- to postcurriculum on a multiple-choice test from 70% to 81% (P < .0001) correct, with improvements observed across all question items. Program directors also reported that the curriculum was easier to use and more effective than prior orientation materials.

CONCLUSIONS

The implementation of an international introductory curriculum for PGY-2 radiation oncology residents is both feasible and effective. Similar strategies should be employed to enhance and standardize radiation oncology educational initiatives across training programs.

Boot Camp in a Box: Initial Experience with Pretraining Skills Preparation for New Interns

PURPOSE

In order to increase selected skills at onset of training, we provided newly matched PGY-1 trainees with materials and instructions to practice these skills, as well as the opportunity to share video-recorded performance and receive feedback based on these videos.

METHODS

Knot tying and suturing kits, instruments and supplies, and video instructions for task performance were sent to newly matched trainees to our program (n = 10), with instructions to practice 4 tasks (1- and 2-handed knot tying, interrupted and running suturing) until self-assessed comfort with each task was achieved or the 8-week time point before start of training was reached. Each trainee returned a video of each task, which was graded by blinded reviewers for time and errors using an itemized evaluation instrument (12 items for suturing and five items for knot-tying). Feedback (annotations of submitted videos) was provided after grading was completed. Task performance was repeated and reassessed at the time of new intern "Boot Camp" and again 8 weeks after start of training. Performance scores were compared for the 3 time points and with scores of PGY 2-4 residents using ANOVA with posthoc tests.

RESULTS

Compliance with instruction for practice and return of video recorded tasks in the months before start of PGY-1 training was high, with only 1 of 10 failing to return knot-tying videos. A significant pattern of performance change (p < 0.05) was observed for all tasks with an initial decrease between the pre-employment practice period and the Boot Camp test followed by an increase to the highest level of performance 2 months after start of training. At that point, scores were not significantly different than those of more senior residents.

CONCLUSIONS

A high level of compliance was achieved with requested skills practice and video documentation of performance. We attribute the consistently lower scores on the tasks during Boot Camp tests to higher stress test environment which was apt to be less favorable than having the trainee choose to submit their best possible preresidency video recording of performance in a low-stress situation. Subsequent achievement of significantly higher performance even compared to more senior residents may have been helped by incentivized pretraining practice.

Simulation Training to Improve the Ability of First-Year Doctors to Assess and Manage Deteriorating Patients: a Systematic Review and Meta-analysis

Many simulation courses now exist which aim to prepare first-year doctors for the task of assessing and managing potentially deteriorating patients. Despite the substantial resources required, the degree to which participants benefit from such courses, and which aspects of the simulation training are optimal for learning, remains unclear. A systematic literature search was undertaken across seven electronic databases. Inclusion criteria were that the intervention must be a simulation of a deteriorating patient scenario that would likely be experienced by first-year doctors, and that participants being first-year doctors or in their final year of medical school. Studies reporting quantitative benefits of simulation on participants' knowledge and simulator performance underwent meta-analyses. The search returned 1444 articles, of which 48 met inclusion criteria. All studies showed a benefit of simulation training, but outcomes were largely limited to self-rated or objective tests of knowledge, or simulator performance. The meta-analysis demonstrated that simulation improved participant performance by 16% as assessed by structured observation of a simulated scenario, and participant knowledge by 7% as assessed by written assessments. A mixed-methods analysis found conflicting evidence about which aspects of simulation were optimal for learning. The results of the review indicate that simulation is an important tool to improve first-year doctors' confidence, knowledge and simulator performance with regard to assessment and management of a potentially deteriorating patient. Future research should now seek to clarify the extent to which these improvements translate into clinical practice, and which aspects of simulation are best suited to achieve this.

Advanced communication: A critical component of high quality gynecologic cancer care: A Society of Gynecologic Oncology evidence based review and guide

Effective communication between gynecologic oncology providers and patients is vital to patient-centered care. Skilled communication improves the patient's knowledge retention, builds trust in providers, enhances shared decision-making, and alleviates anxiety of both patients and caregivers. Effective communication is also associated with reduced provider burnout due to improved comfort from possessing the skills to handle emotionally charged situations. Therefore, training in serious illness communication skills is critically important to gynecologic oncology practice and benefits patients, providers, and the healthcare system. Like surgical skills, communication skills can be learned and improved upon, particularly by making use of communication skills courses and other resources. While the purpose of each conversation will vary based on the medical setting, most communication roadmaps incorporate four basic components: 1) Assess patient knowledge and understanding, 2) inform patient in accordance with her communication preferences, 3) recognize and respond to emotion 4) elicit patient values, and create a plan that aligns with those values. Improved patient outcomes associated with addressing patient emotions underscore a critical need to recognize and address emotional cues during difficult conversations. We present strategies for delivering serious news, and for discussing prognosis and goals of care. In each strategy, we highlight skills for recognizing and responding to patient and family emotional cues.

Competence and training in interventional pulmonology

Interventional pulmonology (IP) is experiencing a rapid evolution of new technologies. There is a need to develop structured training programs, organized in high volume expert centers in order to improve trainee education, and including the development of validated metrics for their competency assessment. Concerning teaching methods, a gradual progression from theory to practice, using new teaching techniques, including live sessions and low and high-fidelity simulation, flipped classroom models and problem-based learning (PBL) exercises would provide a training setting more suitable for our current need to improve skills and update professionals. Training programs should be learner-centered and competence-oriented, as well as being based on a spiral-shaped approach in which the same subject is addressed many times, from new and different perspectives of knowledge, ability, behavior and attitude, until the trainee has demonstrated a high degree of skill and professionalism. Furthermore there is a need to standardize the training programs as guide for physicians wishing to undertake a gradual and voluntary improvement of their own competencies, and assist those planning and organizing training programs in IP. The article includes a general part on core curriculum contents, innovative training methods and simulation, and introduces the following articles on the skills that the Interventional Pulmonologist must master in order to perform the different procedures. This monography should be considered a starting point that will evolve over time and results in better training for practitioners and better care for our patients. The task of establishing a trainee's competence to practice independently as an Interventional Pulmonologist remains the responsibility of the IP fellowship program director and faculty, who validate logbooks and assess competence for each procedure. These standards need to be reviewed and approved by national and International Scientific Societies and Healthcare Institutions with the aim to improve, disseminate and incorporate them in healthcare programs.

Impact of urology simulation boot camp in improving endoscopic instrument knowledge

Objective

Education and training of surgeons has traditionally focused on the development of individual knowledge, technical skills and decision making. Knowledge about endoscopic instruments is one of the core elements of urological training. We assessed the precourse knowledge of newly appointed urology trainees and the impact of boot camp in improving their knowledge.

Methods

Newly appointed specialty trainees in urology took part in a pilot 5-day urology simulation boot camp (USBC). The aim of the USBC was to improve their confidence, procedural performance and non-technical skills, with one of the modules looking at the trainees' knowledge about common endoscopic instruments in urology. Delegates were first asked to identify and assemble the instruments, followed by one-to-one teaching about the instruments. An Objective Structured Assessment Tool was used to assess their knowledge in the identification and assembly of the cystoscope, resectoscope and optical urethrotome, before and at the end of the course.

Results

Data of two successive boot camps were collected to assess knowledge of instruments of newly appointed urology trainees. Majority of the trainees had good precourse knowledge of the cystoscopy kit, with 84% able to correctly identify the parts. Seventy-six per cent of candidates were able to identify the resectoscope equipment, but only approximately a third of trainees were able to correctly identify the urethrotome kit. The assembly of cystoscope, resectoscope and urethrotome was performed correctly in 74%, 42% and 32% at baseline and 94%, 90% and 77% postcourse, respectively. Overall performance improved significantly in the postcourse assessment (<0.001).

Conclusion

This urology boot camp has addressed gaps in trainees' core equipment knowledge and guided them to improve their knowledge with respect to identification and assembly of cystoscope, resectoscope and urethrotome.

Neonatal Intensive Care Unit Boot Camp: A Preparatory Curriculum for Pediatric Residents

Introduction

Resident training has changed significantly in recent years, resulting in reduced experiences and practice. Because pediatric residents have fewer required intensive care unit (ICU) rotations, we introduced a neonatal ICU (NICU) boot camp (2014-2015) that continues today to prepare residents immediately prior to beginning an NICU rotation.

Methods

The NICU boot camp consists of three 1-hour sessions: two interactive lectures with case-based application and one hands-on, integrative learning using simulation. The sessions are designed to cover basic information to assist in daily rounding and decision making while in the NICU. After their NICU rotation, residents complete a 12-item questionnaire. Program evaluation includes direct observation during sessions, faculty debriefing, and a postprogram resident survey.

Results

Fifty-seven residents participated; questionnaire responses were available from 46 (80.70%). Combined percentages of very useful and extremely useful responses for the three sessions were 82.61%, 78.26%, and 82.60%, with 86.95% for the overall program; 80.40% agreed that repeating boot camp prior to each NICU rotation would be useful. Analysis of narrative responses revealed that participation in boot camp enhanced residents' readiness and confidence for patient care in the NICU and as stated for each educational objective.

Discussion

Program evaluation results support highly effective and sustainable implementation and achievement of educational objectives. Minor refinements continue for enhancing active learning and content materials and for increasing rigor of program evaluation. Results also suggest that our boot camp may benefit other pediatric programs and serve as a model for use in other resident specialty programs.

Surgical Practical Skills Learning Curriculum: Implementation and Interns' Confidence Perceptions

OBJECTIVE

To provide an overview of the practical skills learning curriculum and assess its effects over time on the surgical interns' perceptions of their technical skills, patient management, administrative tasks, and knowledge.

DESIGN

An 84-hour practical skills curriculum composed of didactic, simulation, and practical sessions was implemented during the 2015 to 2016 academic year for general surgery interns. Totally, 40% of the sessions were held during orientation, whereas the remainder sessions were held throughout the academic year. Interns' perceptions of their technical skills, administrative tasks, patient management, and knowledge were assessed by the practical skills curriculum residents' perception survey at various time points during their intern year (baseline, midpoint, and final). Interns were also asked to fill out an evaluation survey at the completion of each session to obtain feedback on the curriculum.

SETTING

General Surgery Residency program at a tertiary care academic institution.

PARTICIPANTS

20 General Surgery categorical and preliminary interns.

RESULTS

Significant differences were found over time in interns' perceptions on their technical skills, patient management, administrative tasks, and knowledge (p < 0.001 for all). The results were also statistically significant when accounting for a prior boot camp course in medical school, intern status (categorical or preliminary), and gender (p < 0.05 for all). Differences in interns' perceptions occurred both from baseline to midpoint, and from midpoint to final time point evaluations (p < 0.001 for all). Prior surgical boot camp in medical school status, intern status (categorical vs. preliminary), and gender did not differ in the interns' baseline perceptions of their technical skills, patient management, administrative tasks, and knowledge (p > 0.05 for all).

CONCLUSIONS

Implementation of a Practical Skills Curriculum in surgical internships can improve interns' confidence perception on their technical skills, patient management skills, administrative tasks, and knowledge.

Learning outcomes evaluation of a simulation-based introductory course to anaesthesia

OBJECTIVE

An increased number of errors and reduced patient safety have been reported during the incorporation of residents, as this period involves learning new skills. The objectives were to evaluate the learning outcomes of an immersive simulation boot-camp for incoming residents before starting the clinical rotations. Airway assessment, airway control with direct laryngoscopy, and epidural catheterization competencies were evaluated.

MATERIAL AND METHOD

Twelve first-year anaesthesiology residents participated. A prospective study to evaluate transfer of endotracheal intubation skills learned at the simulation centre to clinical practice (primary outcome) was conducted. A checklist of 28 skills and behaviours was used to assess the first supervised intubation performed during anaesthesia induction in ASA I/II patients. Secondary outcome was self-efficacy to perform epidural catheterization. A satisfaction survey was also performed.

RESULTS

Seventy-five percent of residents completed more than 21 out of 28 skills and behaviours to assess and control the airway during their first intubation in patients. Twelve items were performed by all residents and 5 by half of them. More than 83% of participants reported a high level of self-efficacy in placing an epidural catheter. All participants would recommend the course to their colleagues.

CONCLUSIONS

A focused intensive simulation-based boot-camp addressing key competencies required to begin anaesthesia residency was well received, and led to transfer of airway management skills learned to clinical settings when performing for first time on patients, and to increased self-reported efficacy in performing epidural catheterization.

Barriers to the implementation and uptake of simulation-based training programs in general surgery: a multinational qualitative study

BACKGROUND

Despite evidence demonstrating the advantages of simulation training in general surgery, it is not widely integrated into surgical training programs worldwide. The aim of this study was to identify barriers and facilitators to the implementation and uptake of surgical simulation training programs.

METHODS

A multinational qualitative study was conducted using semi-structured interviews of general surgical residents and experts. Each interview was audio recorded, transcribed verbatim, and underwent emergent theme analysis. All data were anonymized and results pooled.

RESULTS

A total of 37 individuals participated in the study. Seventeen experts (Program Directors and Surgical Attendings with an interest in surgical education) and 20 residents drawn from the United States, Canada, United Kingdom, France, and Japan were interviewed. Barriers to simulation-based training were identified based on key themes including financial cost, access, and translational benefit. Participants described cost (89%) and access (76%) as principal barriers to uptake. Common facilitators included a mandatory requirement to complete simulation training (78%) and on-going assessment of skills (78%). Participants felt that simulation training could improve patient outcomes (76%) but identified a lack of evidence to demonstrate benefit (38%). There was a consensus that simulation training has not been widely implemented (70%).

CONCLUSIONS

There are multiple barriers to the implementation of surgical simulation training programs, however, there is agreement that these programs could potentially improve patient outcomes. Identifying these barriers enable the targeted use of facilitators to deliver simulation training programs.

A Simulation-based Quality Improvement Approach to Improve Pediatric Resident Competency with Required Procedures

INTRODUCTION

Pediatric residents report a lack of confidence and competence with procedural skills at graduation. Training programs could benefit from improved approaches to target these needs. Using the Institute for Healthcare Improvement (IHI) Model for Improvement and three Plan-Do-Study-Act (PDSA) cycles, we examined the impact of a procedure simulation boot camp on self-reported procedural confidence and competence as well as the longitudinal impacts of these sequential interventions on Accreditation Council for Graduate Medical Education (ACGME) Graduating Resident Survey (GRS) results.

METHODS

Three rapid cycle interventions were performed in successive academic years. The interventions included 1) increased awareness of available procedural experiences, 2) institution of procedural educational conferences, and 3) implementation of a senior resident procedure boot camp. Senior resident self-reported procedural confidence was measured before and after the boot camp. Procedural competence was measured using the ACGME GRS.  Results: Thirty-two of 34 senior residents (94%) completed the 2016 ACGME GRS, similar to the response rates of 2014 (92%) and 2015 (94%), and 30 of 34 third-year residents participated in the procedure boot camp (88%). Resident confidence and competence with procedural skills improved after the institution of the quality improvement intervention. ACGME GRS-reported competency increased in bag and mask ventilation (77% to 94%), neonatal endotracheal intubation (39% to 69%), peripheral IV placement (10% to 50%), and umbilical catheter placement (35% to 53%).

CONCLUSION

A quality improvement intervention with three rapid PDSA cycles was successful in improving senior pediatric resident confidence and competence with ACGME required procedural skills.

Computer Simulation and Digital Resources for Plastic Surgery Psychomotor Education

Contemporary plastic surgery residents are increasingly challenged to learn a greater number of complex surgical techniques within a limited period. Surgical simulation and digital education resources have the potential to address some limitations of the traditional training model, and have been shown to accelerate knowledge and skills acquisition. Although animal, cadaver, and bench models are widely used for skills and procedure-specific training, digital simulation has not been fully embraced within plastic surgery. Digital educational resources may play a future role in a multistage strategy for skills and procedures training. The authors present two virtual surgical simulators addressing procedural cognition for cleft repair and craniofacial surgery. Furthermore, the authors describe how partnerships among surgical educators, industry, and philanthropy can be a successful strategy for the development and maintenance of digital simulators and educational resources relevant to plastic surgery training. It is our responsibility as surgical educators not only to create these resources, but to demonstrate their utility for enhanced trainee knowledge and technical skills development. Currently available digital resources should be evaluated in partnership with plastic surgery educational societies to guide trainees and practitioners toward effective digital content.

Advances in Pediatric Cardiology Boot Camp: Boot Camp Training Promotes Fellowship Readiness and Enables Retention of Knowledge

We previously demonstrated that a pediatric cardiology boot camp can improve knowledge acquisition and decrease anxiety for trainees. We sought to determine if boot camp participants entered fellowship with a knowledge advantage over fellows who did not attend and if there was moderate-term retention of that knowledge. A 2-day training program was provided for incoming pediatric cardiology fellows from eight fellowship programs in April 2016. Hands-on, immersive experiences and simulations were provided in all major areas of pediatric cardiology. Knowledge-based examinations were completed by each participant prior to boot camp (PRE), immediately post-training (POST), and prior to the start of fellowship in June 2016 (F/U). A control group of fellows who did not attend boot camp also completed an examination prior to fellowship (CTRL). Comparisons of scores were made for individual participants and between participants and controls. A total of 16 participants and 16 control subjects were included. Baseline exam scores were similar between participants and controls (PRE 47 ± 11% vs. CTRL 52 ± 10%; p = 0.22). Participants' knowledge improved with boot camp training (PRE 47 ± 11% vs. POST 70 ± 8%; p < 0.001) and there was excellent moderate-term retention of the information taught at boot camp (PRE 47 ± 11% vs. F/U 71 ± 8%; p < 0.001). Testing done at the beginning of fellowship demonstrated significantly better scores in participants versus controls (F/U 71 ± 8% vs. CTRL 52 ± 10%; p < 0.001). Boot camp participants demonstrated a significant improvement in basic cardiology knowledge after the training program and had excellent moderate-term retention of that knowledge. Participants began fellowship with a larger fund of knowledge than those fellows who did not attend.

Comparison of Canadian and Swiss Surgical Training Curricula: Moving on Toward Competency-Based Surgical Education

OBJECTIVE

Quality of surgical training in the era of resident duty-hour restrictions (RDHR) is part of an ongoing debate. Most training elements are provided during surgical service. As exposure to surgical procedures is important but time-consuming, RDHR may affect quality of surgical training. Providing structured training elements may help to compensate for this shortcoming.

DESIGN

This binational anonymous questionnaire-based study evaluates frequency, time, and structure of surgical training programs at 2 typical academic teaching hospitals with different RDHR.

SETTING

Departments of Surgery of University of Basel (Basel, Switzerland) and the Queen's University (Kingston, Ontario, Canada).

PARTICIPANTS

Surgical consultants and residents of the Queen's University Hospital (Kingston, Ontario, Canada) and the University Hospital Basel (Basel, Switzerland) were eligible for this study.

RESULTS

Questionnaire response rate was 37% (105/284). Queen's residents work 80 hours per week, receiving 7 hours of formal training (8.8% of workweek). Basel residents work 60 hours per week, including 1 hour of formal training (1.7% of working time). Queen's faculty and residents rated their program as "structured" or "rather structured" in contrast to Basel faculty and residents who rated their programs as "neutral" in structure or "unstructured." Respondents identified specific structured training elements more frequently at Queen's than in Basel. Two-thirds of residents responded that they seek out additional surgical experiences through voluntary extra work. Basel participants articulated a stronger need for improvement of current surgical training. Although Basel residents and consultants in both institutions fear negative influence of RDHR on the training program, this was not the case in Queen's residents.

CONCLUSIONS

Providing more structured surgical training elements may be advantageous in providing optimal-quality surgical education in an era of work-hour restrictions.

A Pediatric Cardiology Fellowship Boot Camp improves trainee confidence

Introduction New paediatric cardiology trainees are required to rapidly assimilate knowledge and gain clinical skills to which they have limited or no exposure during residency. The Pediatric Cardiology Fellowship Boot Camp (PCBC) at Boston Children's Hospital was designed to provide incoming fellows with an intensive exposure to congenital cardiac pathology and a broad overview of major areas of paediatric cardiology practice.

METHODS

The PCBC curriculum was designed by core faculty in cardiac pathology, echocardiography, electrophysiology, interventional cardiology, exercise physiology, and cardiac intensive care. Individual faculty contributed learning objectives, which were refined by fellowship directors and used to build a programme of didactics, hands-on/simulation-based activities, and self-guided learning opportunities.

RESULTS

A total of 16 incoming fellows participated in the 4-week boot camp, with no concurrent clinical responsibilities, over 2 years. On the basis of pre- and post-PCBC surveys, 80% of trainees strongly agreed that they felt more prepared for clinical responsibilities, and a similar percentage felt that PCBC should be offered to future incoming fellows. Fellows showed significant increase in their confidence in all specific knowledge and skills related to the learning objectives. Fellows rated hands-on learning experiences and simulation-based exercises most highly.

CONCLUSIONS

We describe a novel 4-week-long boot camp designed to expose incoming paediatric cardiology fellows to the broad spectrum of knowledge and skills required for the practice of paediatric cardiology. The experience increased trainee confidence and sense of preparedness to begin fellowship-related responsibilities. Given that highly interactive activities were rated most highly, boot camps in paediatric cardiology should strongly emphasise these elements.

Improving the medical school-residency transition

BACKGROUND

In response to calls to improve the continuum between undergraduate and graduate medical education, many medical schools are creating electives designed to prepare students for residency training. There is a need for data that link improvements from these residency preparation courses to residency itself. Data is needed that links improvements from these residency preparation courses to residency OBJECTIVE: To examine senior medical student performance on the Association of Professors of Gynecology and Obstetrics (APGO) Preparation for Residency Knowledge Assessment before and after an obstetrics and gynaecology residency preparation elective, and to determine whether the knowledge improvements persisted to the start of the residency.

METHODS

All 13 students enrolled in the course completed the APGO knowledge assessment on the first and last day of the elective. Three months later, the students were asked to re-take the assessment immediately prior to the start of their residency.

RESULTS

There was improvement in mean scores from the pre-test score of 66.4 per cent to the post-test score of 77.4 per cent. At the time of the pre-test, three of the 13 students (23%) had passing scores (70% or greater), and at the time of the post-test, 11 of the 13 (85%) had passing scores. Nine of the 13 students (69%) completed the APGO knowledge assessment immediately prior to the start of their residency. Those nine students had a mean pre-residency score of 76.4 per cent. Eight of the nine students (89%) passed the pre-residency test.

CONCLUSIONS

Our data support the value of residency preparation electives for improving knowledge, and suggest that senior medical school electives can help to bridge the continuum between undergraduate and graduate medical education.

A pilot study examining experiential learning vs didactic education of abdominal compartment syndrome

BACKGROUND

Current surgical education relies on simulated educational experiences or didactic sessions to teach low-frequency clinical events such as abdominal compartment syndrome (ACS). The purpose of this pilot study was to evaluate if simulation would improve performance and knowledge retention of ACS better than a didactic lecture.

METHODS

Nineteen general surgery residents were block randomized by postgraduate year level to a didactic or a simulation session. After 3 months, all residents completed a knowledge assessment before participating in an additional simulation. Two independent reviewers assessed resident performance via audio-video recordings.

RESULTS

No baseline differences in ACS experience were noted between groups. The observational evaluation demonstrated a significant difference in performance between the didactic and simulation groups: 9.9 vs 12.5, P = .037 (effect size = 1.15). Knowledge retention was equivalent between groups.

CONCLUSIONS

This pilot study suggests that simulation-based education may be more effective for teaching the basic concepts of ACS.