Preliminary evaluation of the SimPORTAL major vessel injury (MVI) repair model

The State of Urotrauma Education Among Residency Programs in the United States: A Systematic Review and Meta-Analysis

PURPOSE OF REVIEW

Management of urotrauma is a crucial part of a urologist's knowledge and training. We therefore sought to understand the state of urotrauma education in the United States.

RECENT FINDINGS

Using themes of "Urotrauma" and "Education," we performed a systematic review and meta-analysis by searching for studies in MEDLINE, all Cochrane libraries, EMBASE, BIOSIS, Scopus, and Web of Science through May 2023. The primary outcome was the pooled rate of urology trainee and program director attitudes toward urotrauma education. Secondary outcomes involved a descriptive summary of existing urotrauma curricula and an assessment of factors affecting urotrauma exposure. Of 12,230 unique records, 11 studies met the final eligibility criteria, and we included 2 in the meta-analysis. The majority of trainees and program directors reported having level 1 trauma center rotations (range 88-89%) and considered urotrauma exposure as an important aspect of residency education (83%, 95% CI 76-88%). Despite possible increases in trainee exposure to Society of Genitourinary Reconstructive Surgeons (GURS) faculty over the preceding decade, nearly a third of trainees and program directors currently felt there remained inadequate exposure to urotrauma during training (32%, 95% CI 19-46%). Factors affecting urotrauma education include the limited exposure to GURS-trained faculty and clinical factors such as case infrequency and non-operative trauma management. Urology resident exposure to urotrauma is inadequate in many training programs, underscoring the potential value of developing a standardized curriculum to improve urotrauma education for trainees. Further investigation is needed to characterize this issue and to understand how it impacts trainee practice readiness.

Perspectives on simulation-based assessment of operative skill in surgical training

INTRODUCTION

The perspectives of the wider surgical community toward simulation-based assessment (SBA) in training is a gap in the literature. This study aims to explore the factors associated with the acceptable use of SBA in surgical training, through the perceptions and experiences of a broad range of stakeholder representatives, building on findings from a review of the published literature.

MATERIALS AND METHODS

Ten semi-structured interviews were conducted, using a sequential transformative qualitative methods approach, with representatives from identified key stakeholder groups; executive management, risk management, a practicing surgeon, an anaesthesiologist, a theatre-nursing representative, a representative from simulation industry, a patient, a medical student, a junior surgical trainee, and a senior surgical trainee. Interview transcripts underwent reflexive thematic analysis using an inductive and constructivist framework (NVIVO software, NVIVO 12, QSR International).

RESULTS

Four themes emerged: the 'need' for SBA, the concept of a 'minimum standard', the 'optimum design' of an SBA framework, and 'fairness'. SBA is a potential solution to challenges in the current training environment. It emerged that it should not replace trainer judgement, but could ensure that trainees meet a minimum operative competency standard. SBA should be used to identify underperforming trainees early in training to provide targeted remediation. The application of SBA in high-stakes settings such as trainee selection, autonomy granting, and end-of training certification has perceived benefits over current assessment methods.

CONCLUSIONS

This study builds on findings from prior research to explore factors regarding the acceptable use of simulation as an assessment method in surgical training, including perspectives from a broad range of stakeholder representatives. Findings can inform the development of simulation-based assessment curricula in surgical training.

Perceptions and experiences of simulation-based assessment of technical skill in surgery: A scoping review

INTRODUCTION

The introduction of simulation-based assessment raises questions as to its role in trainee selection, progression, certification and credentialing. This study sought to review and critique the available research regarding the perceptions and experiences of residents and their trainers towards simulation-based assessment of technical skills in surgery.

METHODS

A comprehensive literature review of the Medline (PubMed), Embase, Cochrane and Web of Science databases was performed in accordance with the Joanna Briggs Institute 2020 protocol for scoping reviews in July 2020, for all original research articles, abstracts and conference proceedings assessing the attitudes, perceptions, opinions and experiences of residents and surgical trainers toward simulation-based assessment of technical or operative skill.

RESULTS

A total of 1869 studies were identified on database searching. Quantitative, qualitative and mixed-methodology publications reporting the attitudes and experiences of surgical trainers and residents were identified, with 21 articles ultimately meeting the inclusion criteria for (qualitative) thematic analysis. Results were charted and categorized into broad themes: 1) Perceptions of simulation-based assessment in principle, 2) Entrustment, 3) Credentialing and certification, and 4) Resident selection and recruitment, identifying both positive perceptions and key areas of concern from residents and trainers alike regarding the current and future application of simulation-based assessment.

CONCLUSION

There is broadly positive agreement amongst residents and surgical trainers in the published literature regarding the validity of simulation-based assessment. Perceptions of the broader application and implications of simulation-based skill assessment has been identified as a gap in the literature. Future studies should aim to record comprehensive data from key stakeholders prior to implementation of a simulation-based assessment curriculum to ensure acceptability.

Evaluation of the "Teaching Guide for Basic Laparoscopic Skills" as a stand-alone educational tool for hands-on training sessions: a pilot study

INTRODUCTION AND OBJECTIVES

Standardization of hands-on training (HoT) has profoundly impacted the educational field in the last decade. To provide quality training sessions on a global scale, the European School of Urology Training group developed a teaching guide for tutors in 2015. Our study aims to understand whether this guide alone can provide information enough to match the performance improvement guaranteed by an expert tutor.

MATERIAL AND METHODS

4 randomized groups of participants underwent HoT sessions with different teaching modalities: an expert surgeon (group 1), an expert E-BLUS tutor (group 2), E-BLUS guide alone (group 3), no tutor (group 4). Groups 1 and 2 were respectively provided with two different tutors to avoid biases related to personal tutor ability. Along the training session, each participant could perform five trials on two E-BLUS tasks: Peg transfer and Knot tying. During trials 1 and 5, completion time and number of errors were recorded for analysis with Pi-score algorithm. The average per-group Pi-scores were then compared to measure different performance improvement results.

RESULTS

60 participants from Italy were enrolled and randomized into four groups of 15. Pi-scores recorded on Peg transfer task were 24,6 (group 1), 26,4 (group 2), 42,2 (group 3), 11,7 (group 4). Pi-scores recorded on Knot tying task were 33,2 (group 1), 31,3 (group 2), 37,5 (group 3), 18,6 (group 4).

CONCLUSION

Compared to a human tutor, standardized teaching with the EBLUS guide may produce similar performance improvement. This evidence opens doors to automated teaching and to several novelties in hands-on training.

Simulation platforms to assess laparoscopic suturing skills: a scoping review

BACKGROUND

Laparoscopic suturing (LS) has become a common technique used in a variety of advanced laparoscopic procedures. However, LS is a challenging skill to master, and many trainees may not be competent in performing LS at the end of their training. The purpose of this review is to identify simulation platforms available for assessment of LS skills, and determine the characteristics of the platforms and the LS skills that are targeted.

METHODS

A scoping review was conducted between January 1997 and October 2018 for full-text articles. The search was done in various databases. Only articles written in English or French were included. Additional studies were identified through reference lists. The search terms included "laparoscopic suturing" and "clinical competence."

RESULTS

Sixty-two studies were selected. The majority of the simulation platforms were box trainers with inanimate tissue, and targeted basic suturing and intracorporeal knot-tying techniques. Most of the validation came from internal structure (rater reliability) and relationship to other variables (compare training levels/case experience, and various metrics). Consequences were not addressed in any of the studies.

CONCLUSION

We identified many types of simulation platforms that were used for assessing LS skills, with most being for assessment of basic skills. Platforms assessing the competence of trainees for advanced LS skills were limited. Therefore, future research should focus on development of LS tasks that better reflect the needs of the trainees.

Laparoscopic Major Vascular Injury Simulation Using a Synthetic Compared With Porcine Model

BACKGROUND

Major vascular injury training may improve clinical skills and reduce patient morbidity during gynecologic laparoscopy; thus, reliable models for simulation should be identified.

METHOD

Two laparoscopic major vascular injury simulations using synthetic or live porcine models were constructed. The primary surgeon was given the opportunity to complete both simulations. After obtaining peritoneal access, the surgeon quickly encountered a major vascular injury. Degrading vital signs and estimated blood loss coupled with the replay of a human heartbeat that increased in volume and intensity were provided to heighten tension during the synthetic simulation.

EXPERIENCE

Twenty-two gynecologic surgery educators evaluated the simulations. Educators considered the porcine model superior to the synthetic model with regard to tissue handling. The synthetic model simulation was found to be equivalent to the porcine model on how likely the simulation would be able to improve performance in a clinical setting. Educators were more likely to implement the synthetic simulation over the porcine simulation.

CONCLUSION

The synthetic model was found to be more feasible and as effective as the porcine model to simulate and teach the initial management steps of major vascular injury at laparoscopy by gynecologic educators.

The CREST Simulation Development Process: Training the Next Generation

BACKGROUND

The challenges of training and assessing endourologic skill have driven the development of new training systems. The Center for Research in Education and Simulation Technologies (CREST) has developed a team and a methodology to facilitate this development process.

METHODS

Backwards design principles were applied. A panel of experts first defined desired clinical and educational outcomes. Outcomes were subsequently linked to learning objectives. Gross task deconstruction was performed, and the primary domain was classified as primarily involving decision-making, psychomotor skill, or communication. A more detailed cognitive task analysis was performed to elicit and prioritize relevant anatomy/tissues, metrics, and errors. Reference anatomy was created using a digital anatomist and clinician working off of a clinical data set. Three dimensional printing can facilitate this process. When possible, synthetic or virtual tissue behavior and textures were recreated using data derived from human tissue. Embedded sensors/markers and/or computer-based systems were used to facilitate the collection of objective metrics. A learning Verification and validation occurred throughout the engineering development process.

RESULTS

Nine endourology-relevant training systems were created by CREST with this approach. Systems include basic laparoscopic skills (BLUS), vesicourethral anastomosis, pyeloplasty, cystoscopic procedures, stent placement, rigid and flexible ureteroscopy, GreenLight PVP (GL Sim), Percutaneous access with C-arm (CAT), Nephrolithotomy (NLM), and a vascular injury model. Mixed modalities have been used, including "smart" physical models, virtual reality, augmented reality, and video. Substantial validity evidence for training and assessment has been collected on systems. An open source manikin-based modular platform is under development by CREST with the Department of Defense that will unify these and other commercial task trainers through the common physiology engine, learning management system, standard data connectors, and standards.

CONCLUSION

Using the CREST process has and will ensure that the systems we create meet the needs of training and assessing endourologic skills.