Use of High Fidelity Operating Room Simulation to Assess and Teach Communication, Teamwork and Laparoscopic Skills: Initial Experience

The State of Urotrauma Education Among Residency Programs in the United States: A Systematic Review and Meta-Analysis

PURPOSE OF REVIEW

Management of urotrauma is a crucial part of a urologist's knowledge and training. We therefore sought to understand the state of urotrauma education in the United States.

RECENT FINDINGS

Using themes of "Urotrauma" and "Education," we performed a systematic review and meta-analysis by searching for studies in MEDLINE, all Cochrane libraries, EMBASE, BIOSIS, Scopus, and Web of Science through May 2023. The primary outcome was the pooled rate of urology trainee and program director attitudes toward urotrauma education. Secondary outcomes involved a descriptive summary of existing urotrauma curricula and an assessment of factors affecting urotrauma exposure. Of 12,230 unique records, 11 studies met the final eligibility criteria, and we included 2 in the meta-analysis. The majority of trainees and program directors reported having level 1 trauma center rotations (range 88-89%) and considered urotrauma exposure as an important aspect of residency education (83%, 95% CI 76-88%). Despite possible increases in trainee exposure to Society of Genitourinary Reconstructive Surgeons (GURS) faculty over the preceding decade, nearly a third of trainees and program directors currently felt there remained inadequate exposure to urotrauma during training (32%, 95% CI 19-46%). Factors affecting urotrauma education include the limited exposure to GURS-trained faculty and clinical factors such as case infrequency and non-operative trauma management. Urology resident exposure to urotrauma is inadequate in many training programs, underscoring the potential value of developing a standardized curriculum to improve urotrauma education for trainees. Further investigation is needed to characterize this issue and to understand how it impacts trainee practice readiness.

Use of High-Fidelity Simulation to Enhance Interdisciplinary Collaboration and Reduce Patient Falls

OBJECTIVES

This pilot study aimed to determine the effect of nurse/physician interdisciplinary team training on patient falls. Specifically, we evaluated team training in a simulation center as a method for targeting and minimizing breakdowns in perceptions of respect, collaboration, communication, and role misunderstanding behaviors between care disciplines.

METHODS

Registered nurses (RNs) were randomly assigned to participate. Residents were divided into groups and assigned based on their availability and clinical responsibility. All participants completed a demographic form, the Professional Practice Environment Assessment Scale (PPEAS), and the Mayo High Performance Teamwork Scale (MHPTS) after consenting and before participation in simulation training. The PPEAS and the MHPTS were readministered at 2 and 6 months after the simulation experience. Differences in MHPTS and PPEAS scores between the baseline and 2- and 6-month assessments were analyzed; fall rates over time were evaluated using Cochran-Armitage trend tests.

RESULTS

After the team training exercises, teamwork as measured by the MHPTS improved significantly at both 2 and 6 months (P = 0.01; P < 0.001) compared with baseline measurement. Practice environment subscores, with the exception of positive organizational characteristics, also increased when measured 6 months after training. The primary outcome, reduction in anticipated patient falls, improved significantly (P = 0.02) over the course of the study.

CONCLUSIONS

Results of this pilot study show that team training exercises result in improvement in both patient safety (anticipated patient falls) and team member perception of their work environment. If validated by other studies, improvement in this patient safety metric would represent an important benefit of simulation and team training.

Current Status of Simulation Training in Urology: A Non-Systematic Review

Simulation has emerged as an effective solution to increasing modern constraints in surgical training. It is recognized that a larger proportion of surgical complications occur during the surgeon's initial learning curve. The simulation takes the learning curve out of the operating theatre and facilitates training in a safe and pressure-free environment whilst focusing on patient safety. The cost of simulation is not insignificant and requires commitment in funding, human resources and logistics. It is therefore important for trainers to have evidence when selecting various simulators or devices. Our non-systematic review aims to provide a comprehensive up-to-date picture on urology simulators and the evidence for their validity. It also discusses emerging technologies and future directions. Urologists should embed evidence-based simulation in training programs to shorten learning curves while maintaining patient safety and work should be directed toward a validated and agreed curriculum.

Interventions to improve team effectiveness within health care: a systematic review of the past decade

BACKGROUND

A high variety of team interventions aims to improve team performance outcomes. In 2008, we conducted a systematic review to provide an overview of the scientific studies focused on these interventions. However, over the past decade, the literature on team interventions has rapidly evolved. An updated overview is therefore required, and it will focus on all possible team interventions without restrictions to a type of intervention, setting, or research design.

OBJECTIVES

To review the literature from the past decade on interventions with the goal of improving team effectiveness within healthcare organizations and identify the "evidence base" levels of the research.

METHODS

Seven major databases were systematically searched for relevant articles published between 2008 and July 2018. Of the original search yield of 6025 studies, 297 studies met the inclusion criteria according to three independent authors and were subsequently included for analysis. The Grading of Recommendations, Assessment, Development, and Evaluation Scale was used to assess the level of empirical evidence.

RESULTS

Three types of interventions were distinguished: (1) Training, which is sub-divided into training that is based on predefined principles (i.e. CRM: crew resource management and TeamSTEPPS: Team Strategies and Tools to Enhance Performance and Patient Safety), on a specific method (i.e. simulation), or on general team training. (2) Tools covers tools that structure (i.e. SBAR: Situation, Background, Assessment, and Recommendation, (de)briefing checklists, and rounds), facilitate (through communication technology), or trigger (through monitoring and feedback) teamwork. (3) Organizational (re)design is about (re)designing structures to stimulate team processes and team functioning. (4) A programme is a combination of the previous types. The majority of studies evaluated a training focused on the (acute) hospital care setting. Most of the evaluated interventions focused on improving non-technical skills and provided evidence of improvements.

CONCLUSION

Over the last decade, the number of studies on team interventions has increased exponentially. At the same time, research tends to focus on certain interventions, settings, and/or outcomes. Principle-based training (i.e. CRM and TeamSTEPPS) and simulation-based training seem to provide the greatest opportunities for reaching the improvement goals in team functioning.

Non-technical skills training to enhance performance of obstetrics and gynaecology residents in the operating room

The importance of incorporating non-technical skills in surgical training cannot be understated, however, these remain non-core components of training. The aim of our study was to evaluate the effectiveness of a training course in improving residents' non-technical skills performance in the operating room. Twenty-eight eligible Obstetrics and Gynaecology residents were divided into conventional and experimental groups by using blocked randomisation. The experimental group received a training course comprising of 20 h over 5 weeks as an educational intervention. A blinded assessor assessed non-technical skill performance by using non-technical skill for surgeons rating system while performing two procedures evacuation and curettage and elective caesarean section in pretest and post-test phase. The post-test results of experimental training group improved significantly in all four categories: situational awareness, decision-making, communication and leadership than the conventional training group demonstrating the effectiveness of a training course. Participants found the course useful and relevant to their practices and strongly recommended the incorporation of similar courses in early years of training. Impact Statement What is already known on this subject? Operating room is the mainstay of surgeons and the majority of the studies done in the operating room relate to structured courses to teach residents about non-technical skills, with training and evaluation done on the same day. These either explores the perception of trainees, expansion of the cognitive component and/or feasibility of training for non-technical skills. To date, there is a lack of evidence in the literature to address questions regarding the appropriate time to incorporate non-technical skills in the curriculum, due to study designs. This highlights the need for more randomised control trials with different curricular designs to evaluate effectiveness. What do the results of this study add? The results of our study enable a comparative analysis between learning curves of conventional training, with the experimental group demonstrating the effectiveness of a training course. This strongly supports implementation of non-technical training in postgraduate competency-based curricula. What are the implications of these findings for clinical practice and/or further research? This study shall be used as an evidence-based source to design curricula for teaching non-technical skills to residents.

Use of simulation-based learning among perioperative nurses and students: A scoping review

OBJECTIVES

Simulation-based learning has been extensively explored, especially in baccalaureate nursing programmes. Recently, simulation-based learning has been introduced in perioperative nursing. The aim of this scoping review is to investigate work published on the use of simulation-based learning in the field of perioperative nursing.

DESIGN AND DATA SOURCES

A scoping review was conducted using the methodological framework of Arksey and O'Malley to identify a broad range of relevant literature, regardless of study design. A comprehensive and systematic search was performed using Medline, CINAHL, Eric, Svemed+, PsychINFO and Embase in May 2016 and then was updated in February 2018. Each database was searched for literature published between 1st January 2005 and 8th February 2018.

REVIEW METHOD

Two authors independently assessed literature eligibility and extracted data to answer our research question 'What is known about the use of simulation-based learning in the field of perioperative nursing?'

RESULTS

Nine articles and one doctoral thesis were included in the review. There appears to be a paucity of research or results-oriented evidence regarding the use of simulation-based learning in the field of perioperative nursing. Different goals of simulation-based learning were reported. It was difficult to confirm whether these goals had been reached as none of the articles included control groups, and no evaluations had been undertaken against Kirkpatrick's level 3 to see changes in participants' behaviours, and level 4, to determine whether the training had a positive impact on, for example, patient outcomes.

CONCLUSION

Owing to the lack of research and the inadequate descriptions of design and method in simulation-based learning in most of the articles included, there is little evidence in the existing literature to guide practitioners of this learning in the field of perioperative nursing. This indicates a need for further research in this area.

Nontechnical Skills in Surgery: A Systematic Review of Current Training Modalities

BACKGROUND

The complexity of the operating room requires a surgeon to have both technical ability and an array of nontechnical skills. The emphasis on technical skills during surgical training is well established, however it is deficiencies in nontechnical skills that have been identified as the main cause of errors in the operating room.

OBJECTIVE

This systematic review aims to identify current methods used to teach nontechnical skills and how these methods are assessed to determine their validity, evidence, and role in training.

METHODS

MEDLINE and Embase databases were searched for English language articles between 2000 and 2017 for nontechnical surgical skills training. Original research articles were included if they described non-technical surgical skills training modalities and their assessment. Results were assessed for the level of evidence and each modality was awarded a level of recommendation, using a modified educational Oxford Centre for Evidence-Based Medicine classification, as adapted by the European Association of Endoscopic Surgery.

RESULTS

A total of 19 studies were identified pertaining to high fidelity simulation (n = 8), low fidelity simulation (n = 6), didactic teaching (n = 2) and crisis resource management (n = 3). Of the included studies 1 was classified Level 1b, 1 level 2b, 7 level 2b, 2 level 2c, and 8 level 3.

CONCLUSION

With the importance of nontechnical skills being increasingly recognized, it is essential for surgeons to receive adequate training in nontechnical skills. Therefore the most valuable teaching modalities such as high and low fidelity simulation needs to be implemented into surgical training curricula.

Simulation-Based Team Training Improves Team Performance among Pediatric Intensive Care Unit Staff

Simulation training fosters collaborative learning and improves communication among interdisciplinary teams. In this prospective observational cohort study, we evaluated the impact of interdisciplinary simulation-based team training (SBTT) on immediate learning of team performance behaviors. In a 3-month period, 30 simulation sessions were conducted and 165 staff members, including physicians, nurses, and respiratory therapists, were trained. Regression analysis showed a statistically significant improvement in team performance ( p  < 0.0001). Study results demonstrate that SBTT is effective in immediate acquisition of optimal team performance behaviors by multidisciplinary pediatric intensive care unit staff, including physicians with higher level subspecialty training in the simulation environment.

Postgraduate course in minimally invasive urological surgery

Background

Minimally invasive surgeries are increasingly common as the first option for most urological diseases. However, laparoscopic techniques are difficult to master, especially for surgeons who were not trained during their residency programs. Therefore, postgraduate courses are important for such matters. This study aims to evaluate the results of postgraduate courses in minimally invasive urological surgery.

Methods

A specific questionnaire was used to evaluate the impact of the course on urologists' professional activities. The questionnaire also evaluated demographic data and previous surgical experience. The postgraduate course was divided into 10 monthly modules, each one with 36 hours of activities, from March to December. All students of the laparoscopic postgraduate course from the last five years were enrolled in the study.

Results

Forty-one students were included in the study. Thirty-nine students were male (95.1%), and the mean age was 39.5 years (range, 30-60 years). Students from all regions of the country were enrolled. Thirty (73.2%) students had minor laparoscopic experience. All students improved their laparoscopic skills and were able to include new procedures in their daily surgical practice. Eleven students (26.8%) had no laparoscopic experience, and all of them started to perform laparoscopic procedures. The median level of impact on professional life was 75 points (range, 0-100 points).

Conclusions

The postgraduate course is an appropriate way to acquire urological laparoscopic skills. The annual course allowed improvement and initiation of laparoscopic procedures, which significantly impacted urologists' daily activities.

Systematic review of methods for quantifying teamwork in the operating theatre

Background

Teamwork in the operating theatre is becoming increasingly recognized as a major factor in clinical outcomes. Many tools have been developed to measure teamwork. Most fall into two categories: self‐assessment by theatre staff and assessment by observers. A critical and comparative analysis of the validity and reliability of these tools is lacking.

Methods

MEDLINE and Embase databases were searched following PRISMA guidelines. Content validity was assessed using measurements of inter‐rater agreement, predictive validity and multisite reliability, and interobserver reliability using statistical measures of inter‐rater agreement and reliability. Quantitative meta‐analysis was deemed unsuitable.

Results

Forty‐eight articles were selected for final inclusion; self‐assessment tools were used in 18 and observational tools in 28, and there were two qualitative studies. Self‐assessment of teamwork by profession varied with the profession of the assessor. The most robust self‐assessment tool was the Safety Attitudes Questionnaire (SAQ), although this failed to demonstrate multisite reliability. The most robust observational tool was the Non‐Technical Skills (NOTECHS) system, which demonstrated both test–retest reliability (P > 0·09) and interobserver reliability (Rwg = 0·96).

Conclusion

Self‐assessment of teamwork by the theatre team was influenced by professional differences. Observational tools, when used by trained observers, circumvented this.

Simulation in urological training: Where are we in 2017?

Traditional Halstedian principles are no longer compatible with modern day urological training. Changing patterns of healthcare provision and the advanced nature of minimally invasive urological surgery have resulted in trainees receiving reduced exposure to independent operative experience. The drive towards consultant-delivered care, coupled with the introduction of the European working time directive, necessitate the urology trainee to meet end-of-training competencies with fewer learning opportunities compared with previous generations. Simulation provides an opportunity to compensate for reduced operative experience by augmenting both technical and non-technical skills development. A variety of simulation models can be used from cadaveric, synthetic and animal models to advanced virtual reality to aid surgical training. Whilst simulation is not without limitations, it has the potential to significantly enhance procedural competency and non-technical skills in a risk-free environment. Clear benefits, including equipment familiarity and trainee confidence have been demonstrated. However, direct transferability of these benefits to an operating-theatre is not clearly evident. Whilst not a substitute for clinical practice, simulation is likely to prove itself as a valuable adjunct to urological training. In this narrative review, we examine the current literature on simulation training in relation to urological surgery.

Preoperative surgical rehearsal using cadaveric fresh tissue surgical simulation increases resident operative confidence

BACKGROUND

Rehearsal is an essential part of mastering any technical skill. The efficacy of surgical rehearsal is currently limited by low fidelity simulation models. Fresh cadaver models, however, offer maximal surgical simulation. We hypothesize that preoperative surgical rehearsal using fresh tissue surgical simulation will improve resident confidence and serve as an important adjunct to current training methods.

METHODS

Preoperative rehearsal of surgical procedures was performed by plastic surgery residents using fresh cadavers in a simulated operative environment. Rehearsal was designed to mimic the clinical operation, complete with a surgical technician to assist. A retrospective, web-based survey was used to assess resident perception of pre- and post-procedure confidence, preparation, technique, speed, safety, and anatomical knowledge on a 5-point scale (1= not confident, 5= very confident).

RESULTS

Twenty-six rehearsals were performed by 9 residents (PGY 1-7) an average of 4.7±2.1 days prior to performance of the scheduled operation. Surveys demonstrated a median pre-simulation confidence score of 2 and a post-rehearsal score of 4 (P<0.01). The perceived improvement in confidence and performance was greatest when simulation was performed within 3 days of the scheduled case. All residents felt that cadaveric simulation was better than standard preparation methods of self-directed reading or discussion with other surgeons. All residents believed that their technique, speed, safety, and anatomical knowledge improved as a result of simulation.

CONCLUSIONS

Fresh tissue-based preoperative surgical rehearsal was effectively implemented in the residency program. Resident confidence and perception of technique improved. Survey results suggest that cadaveric simulation is beneficial for all levels of residents. We believe that implementation of preoperative surgical rehearsal is an effective adjunct to surgical training at all skill levels in the current environment of decreased work hours.

Training Tools for Nontechnical Skills for Surgeons-A Systematic Review

OBJECTIVE

Development of nontechnical skills for surgeons has been recognized as an important factor in surgical care. Training tools for this specific domain are being created and validated to maximize the surgeon's nontechnical ability. This systematic review aims to outline, address, and recommend these training tools.

DESIGN

A full and comprehensive literature search, using a systematic format, was performed on ScienceDirect and PubMed, with data extraction occurring in line with specified inclusion criteria.

SETTING

Systematic review was performed fully at King's College London.

RESULTS

A total of 84 heterogeneous articles were used in this review. Further, 23 training tools including scoring systems, training programs, and mixtures of the two for a range of specialities were identified in the literature. Most can be applied to surgery overall, although some tools target specific specialities (such as neurosurgery). Interrater reliability, construct, content, and face validation statuses were variable according to the specific tool in question.

CONCLUSIONS

Study results pertaining to nontechnical skill training tools have thus far been universally positive, but further studies are required for those more recently developed and less extensively used tools. Recommendations can be made for individual training tools based on their level of validation and for their target audience. Based on the number of studies performed and their status of validity, NOTSS and Oxford NOTECHS II can be considered the gold standard for individual- and team-based nontechnical skills training, respectively, especially when used in conjunction with a training program.

Comprehensive simulation-enhanced training curriculum for an advanced minimally invasive procedure: a randomized controlled trial

BACKGROUND

There is no comprehensive simulation-enhanced training curriculum to address cognitive, psychomotor, and nontechnical skills for an advanced minimally invasive procedure.

OBJECTIVES

1) To develop and provide evidence of validity for a comprehensive simulation-enhanced training (SET) curriculum for an advanced minimally invasive procedure; (2) to demonstrate transfer of acquired psychomotor skills from a simulation laboratory to live porcine model; and (3) to compare training outcomes of SET curriculum group and chief resident group.

SETTING

University.

METHODS

This prospective single-blinded, randomized, controlled trial allocated 20 intermediate-level surgery residents to receive either conventional training (control) or SET curriculum training (intervention). The SET curriculum consisted of cognitive, psychomotor, and nontechnical training modules. Psychomotor skills in a live anesthetized porcine model in the OR was the primary outcome. Knowledge of advanced minimally invasive and bariatric surgery and nontechnical skills in a simulated OR crisis scenario were the secondary outcomes. Residents in the SET curriculum group went on to perform a laparoscopic jejunojejunostomy in the OR. Cognitive, psychomotor, and nontechnical skills of SET curriculum group were also compared to a group of 12 chief surgery residents.

RESULTS

SET curriculum group demonstrated superior psychomotor skills in a live porcine model (56 [47-62] versus 44 [38-53], P<.05) and superior nontechnical skills (41 [38-45] versus 31 [24-40], P<.01) compared with conventional training group. SET curriculum group and conventional training group demonstrated equivalent knowledge (14 [12-15] versus 13 [11-15], P = 0.47). SET curriculum group demonstrated equivalent psychomotor skills in the live porcine model and in the OR in a human patient (56 [47-62] versus 63 [61-68]; P = .21). SET curriculum group demonstrated inferior knowledge (13 [11-15] versus 16 [14-16]; P<.05), equivalent psychomotor skill (63 [61-68] versus 68 [62-74]; P = .50), and superior nontechnical skills (41 [38-45] versus 34 [27-35], P<.01) compared with chief resident group.

CONCLUSION

Completion of the SET curriculum resulted in superior training outcomes, compared with conventional surgery training. Implementation of the SET curriculum can standardize training for an advanced minimally invasive procedure and can ensure that comprehensive proficiency milestones are met before exposure to patient care.

Development of a Comprehensive Communication Skills Curriculum for Pediatrics Residents

BACKGROUND

Effective communication is an essential element of medical care and a priority of medical education. Specific interventions to teach communication skills are at the discretion of individual residency programs.

OBJECTIVE

We developed the Resident Communication Skills Curriculum (RCSC), a formal curriculum designed to teach trainees the communication skills essential for high-quality practice.

METHODS

A multidisciplinary working group contributed to the development of the RCSC, guided by an institutional needs assessment, literature review, and the Accreditation Council for Graduate Medical Education core competencies. The result was a cohesive curriculum that incorporates didactic, role play, and real-life experiences over the course of the entire training period. Methods to assess curricular outcomes included self-reporting, surveys, and periodic faculty evaluations of the residents.

RESULTS

Curricular components have been highly rated by residents (3.95-3.97 based on a 4-point Likert scale), and residents' self-reported communication skills demonstrated an improvement over the course of residency in the domains of requesting a consultation, providing effective handoffs, handling conflict, and having difficult conversations (intern median 3.0, graduate median 4.0 based on a 5-point Likert scale, P ≤ .002). Faculty evaluations of residents have also demonstrated improvement over time (intern median 3.0, graduate median 4.5 based on a 5-point Likert scale, P < .001).

CONCLUSIONS

A comprehensive, integrated communication skills curriculum for pediatrics residents was implemented, with a multistep evaluative process showing improvement in skills over the course of the residency program. Positive resident evaluations and informal comments from faculty support its general acceptance. The use of existing resources makes this curriculum feasible.

High fidelity, low cost moulage as a valid simulation tool to improve burns education

Simulation allows the opportunity for repeated practice in controlled, safe conditions. Moulage uses materials such as makeup to simulate clinical presentations. Moulage fidelity can be assessed by face validity (realism) and content validity (appropriateness). The aim of this project is to compare the fidelity of professional moulage to non-professional moulage in the context of a burns management course. Four actors were randomly assigned to a professional make-up artist or a course faculty member for moulage preparation such that two actors were in each group. Participants completed the actor-based burn management scenarios and answered a ten-question Likert-scale questionnaire on face and content validity. Mean scores and a linear mixed effects model were used to compare professional and non-professional moulage. Cronbach's alpha assessed internal consistency. Twenty participants experienced three out of four scenarios and at the end of the course completed a total of 60 questionnaires. Professional moulage had higher average ratings for face (4.30 v 3.80; p=0.11) and content (4.30 v 4.00; p=0.06) validity. Internal consistency of face (α=0.91) and content (α=0.85) validity questions was very good. The fidelity of professionally prepared moulage, as assessed by content validity, was higher than non-professionally prepared moulage. We have shown that using professional techniques and low cost materials we can prepare quality high fidelity moulage simulations.

Interprofessional collaboration milestones: advocating for common assessment criteria in graduate medical education

BACKGROUND

Milestone-based assessments of resident physicians inform critical decisions regarding resident competence and advancement. Thus, it is essential that milestone evaluations are based upon strong validity evidence and that consistent evaluation criteria are used across residency programs. A common approach to assessment of interprofessional collaboration milestones is particularly important since standardized measures of individual resident competence in interprofessional collaboration have not been established.

DISCUSSION

We propose that assessments of interprofessional collaboration in graduate medical education meet common criteria, namely, these assessments should: 1) measure competency of an individual resident, 2) occur in the context of an interprofessional team, 3) be ascertained via direct observation of the resident, 4) be performed in a real-world clinical practice setting (such as a hospital ward, outpatient clinic, or operating room). We present the evidence-based rationale for these criteria and cite examples of published assessment instruments that fulfill one or more of the criteria, however further research is needed to ensure fidelity of assessments. The proposed criteria may assist residency educators as they endeavor to provide robust and consistent assessments of interprofessional collaboration milestones.

Stratification of Expert vs Novice Laparoscopists Using the Basic Laparoscopic Urologic Surgery (BLUS) Curriculum at a Single Institution

PURPOSE

To assess determinants of performance applying the tasks of the Basic Laparoscopic Urologic Surgery (BLUS) skills curriculum administered at a single institution.

METHODS

After obtaining institutional review board approval, fourth-year medical students, urology residents (postgraduate year 1-5), and staff attending surgeons from an academic institution were recruited. Participants were grouped by level of experience and evaluated on 4 different BLUS modules testing fundamental laparoscopic techniques from September 2012 to September 2013. Task completion time (TCT) and missed objectives were compared with previous laparoscopic experience, amount of endourological training, and scores obtained through the EDGE simulator.

RESULTS

TCTs among the participants were slower and accrued greater errors in the novice group (n = 10) than in the intermediate-level (n = 9) and expert-level (n = 9) groups. Completion times on the peg transfer were 213.4, 128.1, and 108.7 seconds (p < 0.05); on the circle cutting were 182.4, 128.3, and 97.2 seconds (p < 0.05); on the clip application were 44.4, 43.2, and 38.1 seconds (p = 0.08); and on the suturing were 286.1, 177.3, and 123.6 seconds (p < 0.05) for novice, intermediate, and expert groups, respectively. When past laparoscopic numbers of participants were compared with TCTs, a positive correlation of R(2) = 0.39 was seen, signifying a relationship between number of laparoscopic cases and TCT outcomes.

CONCLUSION

Performance on the EDGE simulator device during the BLUS modules significantly correlated with the amount of laparoscopic experience. Increase in the years of experience and number of laparoscopic cases led to faster and more accurate TCTs.

The current role of simulation in urological training

Introduction

Simulation is becoming an increasingly popular educational tool in numerous surgical specialities, including urology. This article reviews the current role of urological simulators; discussing their need, availability, incorporation and current limitations.

Material and methods

A literature review of the electronic databases Medline, Embase and Google Scholar was performed.

Results

For increasingly limited urological training programs, simulation can act as a valuable adjunct to clinical training. Evidence suggests that simulation enables the trainee to bypass the early, error-prone part of the surgical learning curve. It should be incorporated into proficiency-based curricula, with junior trainees initially beginning with low fidelity simulators to grasp basic surgical skills before moving onto full-procedural simulation as they progress through their training. A wide variety of simulators of differing fidelity are currently available, teaching both technical (eg. cystoscopy) and non-technical (eg. communication) urological surgical skills. Whist numerous studies have assessed the face, content and construct validity of various urological simulators, further work needs to be undertaken to determine whether the skills learnt actually improve trainee performance in the operating room. Then, educators will be able to make informed decisions about whether these resource demanding (financially and in terms of demands on faculty) simulators are a worthwhile educational tool.

Conclusions

Although further investigation is required, urological simulators appear to have a considerable role for developing both technical and non-technical urological skills in an increasingly restricted educational environment in modern urogynecology.

Development and incorporation of hybrid simulation OSCE into in-training examinations to assess multiple CanMEDS competencies in urologic trainees

INTRODUCTION

As residency training requirements increasingly emphasize a competency-based approach, novel tools to directly evaluate Canadian Medical Education Directives for Specialists (CanMEDS) competencies must be developed. Incorporating simulation allows residents to demonstrate knowledge and skills in a safe, standardized environment. We describe a novel hybrid simulation station for use in a urology resident in-training Objective Structured Clinical Exam (OSCE) to assess multiple CanMEDS competencies.

METHODS

An OSCE station was developed to assess Communicator, Health Advocate, Manager, and Medical Expert (including technical skills) CanMEDS roles. Residents interviewed a standardized patient, interacted with a nurse, performed flexible cystoscopy and attempted stent removal using a novel bladder/stent model. Communication was assessed using the Calgary-Cambridge Observational Guide, knowledge was assessed using a checklist, and technical skills were assessed using a previously validated global rating scale. Video debriefing allowed residents to review their performance. Face and discriminative validity were assessed, and feasibility was determined through qualitative post-examination interviews and cost analysis.

RESULTS

All 9 residents (postgraduate years [PGY] 3, 4, 5) completed the OSCE in 15 minutes. Communicator and knowledge scores were similar among all PGYs. Scores in technical skills were higher in PGY-5 compared with PGY-3/4 reside nts (mean score 79% vs. 73%). Residents and exam personnel felt the OSCE station allowed for realistic demonstration of competencies. Equipment cost was $218 for the exam station.

CONCLUSIONS

We developed and implemented a hybrid simulation-based OSCE station to assess multiple CanMEDS roles. This approach was feasible and cost-effective; it also provided a framework for future development of similar OSCE stations to assess resident competencies across multiple domains.

Training situational awareness to reduce surgical errors in the operating room

Background

Surgical errors result from faulty decision-making, misperceptions and the application of suboptimal problem-solving strategies, just as often as they result from technical failure. To date, surgical training curricula have focused mainly on the acquisition of technical skills. The aim of this review was to assess the validity of methods for improving situational awareness in the surgical theatre.

Methods

A search was conducted in PubMed, Embase, the Cochrane Library and PsycINFO® using predefined inclusion criteria, up to June 2014. All study types were considered eligible. The primary endpoint was validity for improving situational awareness in the surgical theatre at individual or team level.

Results

Nine articles were considered eligible. These evaluated surgical team crisis training in simulated environments for minimally invasive surgery (4) and open surgery (3), and training courses focused at training non-technical skills (2). Two studies showed that simulation-based surgical team crisis training has construct validity for assessing situational awareness in surgical trainees in minimally invasive surgery. None of the studies showed effectiveness of surgical crisis training on situational awareness in open surgery, whereas one showed face validity of a 2-day non-technical skills training course.

Conclusion

To improve safety in the operating theatre, more attention to situational awareness is needed in surgical training. Few structured curricula have been developed and validation research remains limited. Strategies to improve situational awareness can be adopted from other industries.

Examining patient safety attitudes among urology trainees

OBJECTIVES

To identify current attitudes to patient safety among urology trainees. To examine whether these have changed with the recent increase in emphasis on patient safety and the introduction of new working procedures in operating theatres.

SUBJECTS AND METHODS

Subjects included 28 urology trainees, based in the West of Scotland, UK. Trainee attitudes were examined using the Operating Room Management Attitudes Questionnaire, a validated tool for examining attitudes towards patient safety.

RESULTS

Attitudes to teamwork were highly positive, with 89-100% of trainees acknowledging the need to share information and conduct pre- and postoperative briefs, and 82-96% being accepting of multidisciplinary feedback on performance. Attitudes to preoperative briefing and multidisciplinary feedback were improved compared with a similar historical cohort. Trainees were reluctant to acknowledge the effect of stress and fatigue on personal performance; 50% felt they worked effectively in critical phases of operations even when tired, only 50% would tell team members their workload was becoming excessive and only 36% of trainees recognized that personal problems could affect their performance. There was no significant change in these attitudes from 2006 data. Regarding leadership and confidence assertion, 68% of trainees felt that leadership in the operating theatre should rest with the medical staff, 18% stated senior decisions or actions should not be questioned unless they threaten safety and 7% that they should not be questioned at all. This was similar to previous data.

CONCLUSIONS

Attitudes to briefing and multidisciplinary feedback appear to have improved since the introduction of the World Health Organization surgical checklist and wider use of feedback tools; other safety attitudes remain largely unchanged. Urology trainees may benefit from further training to better understand the mechanisms of error development, to raise awareness of human performance limitation, particularly the effects of stress and fatigue, and to develop techniques to challenge decisions/respond to challenges.

High-fidelity simulation-based team training in urology: evaluation of technical and nontechnical skills of urology residents during laparoscopic partial nephrectomy

INTRODUCTION

The use of low-risk simulation training for resident education is rapidly expanding as teaching centers integrate simulation-based team training (SBTT) sessions into their education curriculum. SBTT is a valuable tool in technical and communication skills training and assessment for residents. We created a unique SBTT scenario for urology residents involving a laparoscopic partial nephrectomy procedure.

MATERIALS AND METHODS

Urology residents were randomly paired with a certified registered nurse anesthetists or an anesthesia resident. The scenario incorporated a laparoscopic right partial nephrectomy utilizing a unique polyvinyl alcohol kidney model with an embedded 3cm lower pole exophytic tumor and the high-fidelity SimMan3G mannequin. The Urology residents were instructed to pay particular attention to the patient's identifying information provided at the beginning of the case. Two scripted events occurred, the patient had an anaphylactic reaction to a drug and, after tumor specimen was sent for a frozen section, the confederate pathologist called into the operating room (OR) twice, first with the wrong patient name and subsequently with the wrong specimen. After the scenario was complete, technical performance and nontechnical performance were evaluated and assessed. A debriefing session followed the scenario to discuss and assess technical performance and interdisciplinary nontechnical communication between the team.

RESULTS

All Urology residents (n = 9) rated the SBTT scenario as a useful tool in developing communication skills among the OR team and 88% rated the model as useful for technical skills training. Despite cuing to note patient identification, only 3 of 9 (33%) participants identified that the wrong patient information was presented when the confederate "pathologist" called in to report pathology results.

CONCLUSION

All urology residents rated SBTT sessions as useful for the development of communication skills between different team members and making residents aware of unlikely but potential critical errors in the OR. We will continue to use SBTT as a useful method to develop resident technical and nontechnical skills outside of the high-risk operating environment.

Current concepts of team training in surgical residency: a survey of North American program directors

OBJECTIVES

The purpose of the present survey was to (1) establish the prevalence of Crew Resource Management (CRM)- and team-training interventions among general surgery residency programs of the United States and Canada; (2) to characterize current approaches to training and assessment of nontechnical skills; and (3) to inquire about program directors' (PDs') recommendations for future curricula in graduate medical education.

DESIGN

An online questionnaire was developed by the authors and distributed via email to the directors of all accredited general surgery residency programs across the United States and Canada. After 3 email reminders, paper versions were sent to all nonresponders.

PARTICIPANTS AND SETTING

PDs of accredited general surgery residency programs in the United States and Canada.

RESULTS

One hundred twenty (47%) PDs from the United States and 9 (53%) from Canada responded to the survey. Of all respondents, 32% (n = 40) indicated conducting designated team-training interventions for residents. Three main instructional strategies were identified: combined approaches using simulation and didactic methods (42%, n = 16); predominantly simulation-based approaches (37%, n = 14); and didactic approaches (21%, n = 8). Correspondingly, 83% (n = 93) of respondents recommended a combination of didactic methods and opportunities for practice for future curricula. A high agreement between responding PDs was shown regarding learning objectives for a proposed team-based training curriculum (α = 0.95).

CONCLUSIONS

The self-reported prevalence of designated CRM- and team-training interventions among responding surgical residency programs was low. For the design of future curricula, the vast majority of responding PDs advocated for the combination of interactive didactic methods and opportunities for practice.

Remote monitoring and supervision of urology residents utilizing integrated endourology suites-a prospective study of patients' opinions

PURPOSE

To report on integrated endourology suites (IES), remote monitoring and supervision (RMS) of urology residents and to evaluate patients' opinions, acceptance, and satisfaction level with IES and RMS.

PATIENTS AND METHODS

Patients undergoing flexible cystoscopy in the IES with RMS were surveyed using a questionnaire. All procedures were performed by junior urology residents (UR-1 level) using RMS. Patients were studied using a nine-question survey to evaluate their comfort level, acceptance, and level of satisfaction with RMS. Six questions used a scale of 1 to 10 (1=strongly disagree; 10=strongly agree), and the remaining three questions solicited a "yes" or "no" response.

RESULTS

100 patients were studied (59% Caucasians, 40% African Americans, and 1% Hispanic). Median age was 63 years. The highest level of education was middle school in 2% of patients, high school in 55%, undergraduate in 33%, and postgraduate in 10%. Patients scored a mean of 9.50/10 (highly satisfactory) regarding their comfort with RMS; 96% scored ≥ 7, 4% scored 5 to 6, and none scored <5. Patients were satisfied having a urology resident perform the procedure (9.48/10), other residents and medical students watch the procedure (9.41/10), a video camera in the room (9.40/10), and two-way sound communication (9.40/10). None perceived compromise to their privacy or quality of care.

CONCLUSIONS

RMS in IES is highly acceptable to patients undergoing endoscopic procedures. RMS has the potential to positively impact residency training, efficiency, regulatory compliance, safety, and productivity.

Integrated in-situ simulation using redirected faculty educational time to minimize costs: a feasibility study

INTRODUCTION

Simulation is an effective teaching tool, but many hospitals do not possess the space or finances to support traditional simulation centers. Our objective is to describe the feasibility of an in situ simulation program model that uses minimal permanent space and "redirected" cost-neutral faculty educational time to address these issues.

METHODS

Two pediatric simulators and audiovisual equipment were purchased. Course faculty were derived from a group of physicians and nurses with a percentage work assignment apportioned to education. A portion of this was subsequently redirected toward simulation. After 2 years of operation, faculty were surveyed regarding time devoted to the program. Program growth and quality statistics were examined descriptively.

RESULTS

The program supported 786 learner encounters in 166 sessions over 2 years. Simulation hours per month increased over sixfold during that period (P < 0.001). Program initiation cost was $128920.89, with subsequent yearly costs of $11,695. Mean program ratings ranged between 4.5/5 for Crisis Resource Management and 4.4/5 for communication skills training. Resident (2.6 h/y increase, P value <0.001) and nursing (2.2 h/y increase, P < 0.001) simulation hours increased significantly. Faculty involvement averaged between 3% and 32% of total work hours.

CONCLUSION

This report demonstrates the feasibility of implementing an in situ simulation program using minimal permanent institutional space and cost-neutral redirected faculty time. This type of programmatic structure is conducive to short- and medium-term growth, is well received by participants, and allows for substantial cost savings. Future work will be needed to determine what growth limitations are inherent in this staffing and structural model.

High fidelity simulation based team training in urology: a preliminary interdisciplinary study of technical and nontechnical skills in laparoscopic complications management

PURPOSE

Simulation based team training provides an opportunity to develop interdisciplinary communication skills and address potential medical errors in a high fidelity, low stakes environment. We evaluated the implementation of a novel simulation based team training scenario and assessed the technical and nontechnical performance of urology and anesthesiology residents.

MATERIALS AND METHODS

Urology residents were randomly paired with anesthesiology residents to participate in a simulation based team training scenario involving the management of 2 scripted critical events during laparoscopic radical nephrectomy, including the vasovagal response to pneumoperitoneum and renal vein injury during hilar dissection. A novel kidney surgical model and a high fidelity mannequin simulator were used for the simulation. A debriefing session followed each simulation based team training scenario. Assessments of technical and nontechnical performance were made using task specific checklists and global rating scales.

RESULTS

A total of 16 residents participated, of whom 94% rated the simulation based team training scenario as useful for communication skill training. Also, 88% of urology residents believed that the kidney surgical model was useful for technical skill training. Urology resident training level correlated with technical performance (p=0.004) and blood loss during renal vein injury management (p=0.022) but not with nontechnical performance. Anesthesia resident training level correlated with nontechnical performance (p=0.036). Urology residents consistently rated themselves higher on nontechnical performance than did faculty (p=0.033). Anesthesia residents did not differ in the self-assessment of nontechnical performance compared to faculty assessments.

CONCLUSIONS

Residents rated the simulation based team training scenario as useful for interdisciplinary communication skill training. Urology resident training level correlated with technical performance but not with nontechnical performance. Urology residents consistently overestimated their nontechnical performance.

Total laparoscopic hysterectomy: evaluation of an evidence-based educational strategy using a novel simulated suture and knot-tying challenge, the "holiotomy"

Objective. The purpose of this study was to evaluate perceptions of skills and practice patterns of gynecologists attending a course on total laparoscopic hysterectomy (TLH). This course employed extensive use of pelvic trainer boxes to accomplish the Holiotomy Challenge. The "Holiotomy Challenge" entailed suturing two plastic pieces with six figure-of-N sutures tied with four square knots each. Methods. A survey was administered before the course and 3 months later. Data were analyzed by paired t-tests, McNemar's Chi Squares, and ANCOVAs with significance set P < .05. Results. At baseline, 216 surgeons and at 3 months 102 surgeons returned the survey. Surgeons' self-perceptions of their skills significantly increased from 6.24 to 7.28. Their reports of their surgical practice at home revealed significantly increased rates of minimally invasive procedures, from 42% to 54%. Significantly more surgeons reported having the ability to close the vagina, or a small cystotomy or enterotomy. Participation in the cadaver lab and presence of their practice partner did not impact these rates. Conclusions. A comprehensive course employing laparoscopic surgical simulation focused on basic surgical skills essential to TLH has a positive impact on attendees' self-rated skill level and rate of laparoscopic approaches. Many had begun performing TLH after the course.

What do surgical nurses know about surgical residents?

OBJECTIVE

A fundamental premise of establishing collaborative relationships between residents and nurses is a basic understanding of the attributes of each group. The intent of this study was to determine what surgical nurses know about surgical residents.

DESIGN

A piloted survey tool was administered to a cross-section of nurses working in 3 surgical intensive care units, a surgical intermediate unit, and 2 general surgical floors. Surgical residents completed the same survey tool. The percentage of residents giving the most frequent response was compared with the percentage of nurses giving the same response.

SETTING

A university, teaching hospital.

PARTICIPANTS

One hundred twenty-four of 129 surgical nurses and 24 of 25 surgical residents who completed the survey tool.

RESULTS

The response rate for nurses on the 2 survey days was 94%, or 54% of all surgical nurses employed by the hospital, and 96% for residents. The nurses surveyed were equally distributed between the units. Ninety-nine percent of nurses did not have a surgical resident as a significant other, 55% of nurses had greater than 5 years experience, and 95% were licensed registered nurses. Seventy-eight percent of nurses correctly indicated that a medical doctorate is the highest degree required to start residency (p = 0.01), but only 57% accurately identified the length of surgical residency (p = 0.02). Nurses perceived residents devoted less time to patient care (p < 0.01) and more time to studying (p < 0.01). Forty percent of nurses do not think interns are legally physicians (p < 0.01) or hold a medical license (p < 0.01). Forty percent of nurses are aware of the 80-hour work week restriction (p < 0.01). Eighteen percent of nurses have the perception that residents are not allowed to perform bedside procedures without an attending physician present (p = 0.03), while 56% have the perception that residents are not allowed to perform any part of an operation without an attending physician (p < 0.01). There is a misperception among 32% of nurses that residents pay tuition for residency (p < 0.01), while only 52% accurately identified the range of a resident's salary (p = 0.01) and 11% the amount of resident debt (p < 0.01).

CONCLUSIONS

Despite the importance of the collaborative relationship in surgical patient care, surgical nurses have a limited understanding of surgical residents. Educating nurses about the education, roles, and responsibilities of surgical residents might improve collaborative relationships and ultimately patient care.