A Systematic Review of Simulation-Based Training in Neurosurgery, Part 2: Spinal and Pediatric Surgery, Neurointerventional Radiology, and Nontechnical Skills

Neurosurgical simulation models developed in Latin America and the Caribbean: a scoping review

Simulation training is an educational tool that provides technical and cognitive proficiency in a risk-free environment. Several models have recently been presented in Latin America and the Caribbean (LAC). However, many of them were presented in non-indexed literature and not included in international reviews. This scoping review aims to describe the simulation models developed in LAC for neurosurgery training. Specifically, it focuses on assessing the models developed in LAC, the simulated neurosurgical procedures, the model's manufacturing costs, and the translational outcomes. Simulation models developed in LAC were considered, with no language or time restriction. Cadaveric, ex vivo, animal, synthetic, and virtual/augmented reality models were included for cranial and spinal procedures. We conducted a review according to the PRISMA-ScR, including international and regional reports from indexed and non-indexed literature. Two independent reviewers screened articles. Conflicts were resolved by a third reviewer using Covidence software. We collected data regarding the country of origin, recreated procedure, type of model, model validity, and manufacturing costs. Upon screening 917 studies, 69 models were developed in LAC. Most of them were developed in Brazil (49.28%). The most common procedures were related to general neurosurgery (20.29%), spine (17.39%), and ventricular neuroendoscopy and cerebrovascular (15.94% both). Synthetic models were the most frequent ones (38.98%). The manufacturing cost ranged from 4.00 to 2005.00 US Dollars. To our knowledge, this is the first scoping review about simulation models in LAC, setting the basis for future research studies. It depicts an increasing number of simulation models in the region, allowing a wide range of neurosurgical training in a resource-limited setting.

A Systematic Review of Simulation-Based Training in Vascular Surgery

Introduction

Recent advancements in surgical technology, reduced working hours, and training opportunities exacerbated by the COVID-19 pandemic have led to an increase in simulation-based training. Furthermore, a rise in endovascular procedures has led to a requirement for high-fidelity simulators that offer comprehensive feedback. This review aims to identify vascular surgery simulation models and assess their validity and levels of effectiveness (LoE) for each model in order to successfully implement them into current training curricula.

Methods

PubMed and EMBASE were searched on January 1, 2021, for full-text English studies on vascular surgery simulators. Eligible articles were given validity ratings based on Messick’s modern concept of validity alongside an LoE score according to McGaghie’s translational outcomes.

Results

Overall 76 eligible articles validated 34 vascular surgery simulators and training courses for open and endovascular procedures. High validity ratings were achieved across studies for: content (35), response processes (12), the internal structure (5), relations to other variables (57), and consequences (2). Only seven studies achieved an LoE greater than 3/5. Overall, ANGIO Mentor was the most highly validated and effective simulator and was the only simulator to achieve an LoE of 5/5.

Conclusions

Simulation-based training in vascular surgery is a continuously developing field with exciting future prospects, demonstrated by the vast number of models and training courses. To effectively integrate simulation models into current vascular surgery curricula and assessments, there is a need for studies to look at trainee skill retention over a longer period of time. A more detailed discussion on cost-effectiveness is also needed.

Data-Driven Residency Training: A Scoping Review of Educational Interventions for Neurosurgery Residency Programs

BACKGROUND

Neurosurgery residency programs are tasked with imparting large volumes of both clinical knowledge and technical skill to trainees in limited time. Many investigators have described local practices, which may offer evidence-based interventions in neurosurgical residency education, but this literature has not been systematically reviewed.

OBJECTIVE

To perform a scoping review of educational practices in neurosurgery, which are supported by quantitative, peer-reviewed research.

METHODS

A scoping review of the literature was performed. PubMed, Embase, and Web of Science databases were queried for articles describing educational interventions for neurosurgery residents, which included a quantitative assessment of the effect on resident performance.

RESULTS

From an initial set of 1785 unique articles, 29 studies were ultimately screened and included. Studies were into the following 6 topics: (1) didactics and curricula (n = 13), (2) nontechnical skills (n = 6), (3) wellness and burnout (n = 4), (4) assessment and feedback (n = 2), (5) mentorship and career development (n = 2), and (6) research (n = 2). Individual study results were described.

CONCLUSION

Several educational interventions in neurosurgical training are supported by quantitative evidence. Methodological shortcomings are prevalent among studies of education, particularly in the selection of meaningful outcome measures. A summary of evidence-based considerations is provided for current and future program directors.

Investigation of Objectivity in Scoring and Evaluating Microvascular Anastomosis Simulation Training

The increase in minimally invasive surgery has led to a decrease in surgical experience. To date, there is only limited research examining whether skills are evaluated objectively and equally in simulation training, especially in microsurgery. The purpose of this study was to analyze the objectivity and equality of simulation evaluation results conducted in a contest format. A nationwide recruitment process was conducted to select study participants. Participants were recruited from a pool of qualified physicians with less than 10 years of experience. In this study, the simulation procedure consisted of incising a 1 mm thick blood vessel and suturing it with a 10-0 thread using a microscope. Initially, we planned to have the neurosurgical supervisors score the simulation procedure by direct observation. However, due to COVID-19, some study participants were unable to attend. Thus requiring some simulation procedures to be scored by video review. A total of 14 trainees participated in the study. The Cronbach’s alpha coefficient among the scorers was 0.99, indicating a strong correlation. There was no statistically significant difference between the scores from the video review and direct observation judgments. There was a statistically significant difference (p <0.001) between the scores for some criteria. For the eight criteria, individual scorers assigned scores in a consistent pattern. However, this pattern differed between scorers indicating that some scorers were more lenient than others. The results indicate that both video review and direct observation methods are highly objective techniques evaluate simulation procedures.

Validation of a Virtual Reality Simulator for Percutaneous Pedicle Screw Insertion

INTRODUCTION

Working-hour restrictions, rota gaps and an increasing drive for theatre efficiency have resulted in challenges to surgical training. As a result, Virtual Reality (VR) has emerged as a popular tool to augment this training. Our aim was to evaluate the validity of a VR simulator for performing percutaneous pedicle screw guidewire insertion.

MATERIALS AND METHODS

Twenty-four participants were divided into three equal groups depending on prior surgical experience: a novice group (<10 procedures), an intermediate group (10-50 procedures) and an expert group (>50 procedures). All subjects performed four guidewire insertions on a TraumaVision® simulator (Swemac Innovation AB, Linköping, Sweden) in a set order. Six outcome measures were recorded; total score, time, fluoroscopy exposure, wire depth, zone of placement and wall violations.

RESULTS

There were statistically significant differences between the groups for time taken (p<0.001) and fluoroscopy exposure (p<0.001). The novice group performed the worst, and the expert group outperformed both intermediates and novices in both categories. Other outcome results were good and less variable. There was an observed learning effect in the novice and intermediate groups between each of the attempts for both time taken and fluoroscopy exposure.

CONCLUSIONS

The study contributes constructive evidence to support the validity of the TraumaVision® simulator as a training tool for pedicle screw guidewire insertion. The simulator is less suitable as an assessment tool. The learning effect was evident in the less experienced groups, suggesting that VR may offer a greater benefit in the early stages of training. Further work is required to assess transferability to the clinical setting.

Use of Endovascular Simulator in Training of Neurosurgery Residents - A Review and Single Institution Experience

Simulators for surgical procedures and interventions have undergone significant technological advancement in the past decade and are becoming more commonplace in medical training. Neurosurgery residents across multiple training levels underwent performance evaluation using a neuro-interventional simulator, employing a variety of metrics for assessment. We identified seven core metrics used in the evaluation of neurosurgery residents performing simulated mechanical thrombectomies. Additionally, a systematic PubMed search for studies related to Neurointerventional Radiology training via simulation was performed. The purpose of this study is to examine the validity and benefits of training with these simulation devices and compare our institution's experience. Additionally, an exploration of their applicability to neurosurgery resident training is discussed.

Current and future usefulness and potential of virtual simulation in improving outcomes and reducing complications in endovascular treatment of unruptured intracranial aneurysms

BACKGROUND

Simulation training has been used in the aviation industry and surgical specialties for many years, but integration into neurointerventional practice is lagging behind.

OBJECTIVE

To investigate how neurointerventionalists perceive the usefulness and limitations of simulation tools for the treatment of unruptured intracranial aneurysms (UIAs), and to identify simulation applications that were perceived to be most valuable for endovascular UIA treatment.

METHODS

A web-based international multidisciplinary survey was conducted among neurointerventionalists. Participants were asked for their perceptions on the usefulness of current simulation tools and the potential impact of future simulation tools in endovascular UIA treatment. They identified simulation applications that could add most value to endovascular UIA treatment and help to specifically reduce endovascular UIA treatment complications.

RESULTS

233 neurointerventionalists from 38 countries completed the survey, most of whom (157/233 (67.4%)) had access to a simulator as a trainee, but only 15.3% used it frequently. Most participants (117/233 (50.2%)) considered currently available simulation tools relatively useful for endovascular UIA treatment, with greater value for trainees than for staff. Simulation of new devices (147/233 (63.1%)) and virtual practice runs in individual patient anatomy (119/233 (51.1%)) were considered most valuable for reducing endovascular UIA treatment complications.

CONCLUSION

Although neurointerventionalists perceived currently available simulation tools relatively useful, they did not use them regularly during their training. A priori testing of new devices and practice runs in individual patient anatomy in a virtual environment were thought to have the greatest potential for reducing endovascular UIA treatment complications.

Simulation in Urological Training and Education (SIMULATE): Protocol and curriculum development of the first multicentre international randomized controlled trial assessing the transferability of simulation-based surgical training

OBJECTIVES

To report the study protocol for the first international multicentre randomized controlled trial investigating the effectiveness of simulation-based surgical training and the development process for an evidence-based training curriculum, to be delivered as an educational intervention.

PARTICIPANTS AND METHODS

This prospective, international, multicentre randomized controlled clinical and educational trial will recruit urology surgical trainees who must not have performed ≥10 of the selected index procedure, ureterorenoscopy (URS). Participants will be randomized to simulation-based training (SBT) or non-simulation-based training (NSBT), the latter of which is the current sole standard of training globally. The primary outcome is the number of procedures required to achieve proficiency, where proficiency is defined as achieving a learning curve plateau of 28 or more on an Objective Structured Assessment of Technical Skills (OSATS) assessment scale, for three consecutive operations, without any complications. All participants will be followed up either until they complete 25 procedures or for 18 months. Development of the URS SBT curriculum took place through a two-round Delphi process.

RESULTS

A total of 47 respondents, consisting of trainees (n = 24) with URS experience and urolithiasis specialists (n = 23), participated in round 1 of the Delphi process. Specialists (n = 10) finalized the content of the curriculum in round 2. The developed interventional curriculum consists of initial theoretic knowledge through didactic lectures followed by select tasks and cases on the URO-Mentor (Simbionix, Lod, Israel) VR Simulator, Uro-Scopic Trainer (Limbs & Things, Bristol, UK) and Scope Trainer (Mediskills, Manchester, UK) models for both semi-rigid and flexible URS. Respondents also selected relevant non-technical skills scenarios and cadaveric simulation tasks as additional components, with delivery subject to local availability.

CONCLUSIONS

SIMULATE is the first multicentre trial investigating the effect and transferability of supplementary SBT on operating performance and patient outcomes. An evidence-based training curriculum is presented, developed with expert and trainee input. Participants will be followed and the primary outcome, number of procedures required to proficiency, will be reported alongside key clinical secondary outcomes, (ISCRTN 12260261).