Development and validation of the Skills Assessment in Microsurgery for Brain Aneurysms (SAMBA) instrument for predicting proficiency in aneurysm surgery

Training Performance Assessment for Intracranial Aneurysm Clipping Surgery Using a Patient-Specific Mixed-Reality Simulator: A Learning Curve Study

BACKGROUND AND OBJECTIVES

The value of simulation-based training in medicine and surgery has been widely demonstrated. This study investigates the introduction and use of a new mixed-reality neurosurgical simulator in aneurysm clipping surgery, focusing on the learning curve and performance improvement.

METHODS

Five true-scale craniotomy head models replicating patient-specific neuroanatomy, along with a mixed-reality simulator, a neurosurgical microscope, and a set of microsurgical instruments and clips, were used in the operation theater to simulate aneurysm microsurgery. Six neurosurgical residents participated in five video-recorded simulation sessions over 4 months. Complementary learning modalities were implemented between sessions. Thereafter, three blinded analysts reported on residents' use of the microscope, quality of manipulation, aneurysm occlusion, clipping techniques, and aneurysm rupture. Data were also captured regarding training time and clipping attempts.

RESULTS

Over the course of training, clipping time and number of clipping attempts decreased significantly (P = .018, P = .032) and the microscopic skills improved (P = .027). Quality of manipulation and aneurysm occlusion scoring improved initially although the trend was interrupted because the spacing between sessions increased. Significant differences in clipping time and attempts were observed between the most and least challenging patient models (P = .005, P = .0125). The least challenging models presented higher rates of occlusion based on indocyanine green angiography evaluation from the simulator.

CONCLUSION

The intracranial aneurysm clipping learning curve can be improved by implementing a new mixed-reality simulator in dedicated training programs. The simulator and the models enable comprehensive training under the guidance of a mentor.

Benchtop simulation of the retrosigmoid approach: Validation of a surgical simulator and development of a task-specific outcome measure score

Background

Neurosurgical training is changing globally. Reduced working hours and training opportunities, increased patient safety expectations, and the impact of COVID-19 have reduced operative exposure. Benchtop simulators enable trainees to develop surgical skills in a controlled environment. We aim to validate a high-fidelity simulator model (RetrosigmoidBox, UpSurgeOn) for the retrosigmoid approach to the cerebellopontine angle (CPA).

Methods

Novice and expert Neurosurgeons and Ear, Nose, and Throat surgeons performed a surgical task using the model - identification of the trigeminal nerve. Experts completed a post-task questionnaire examining face and content validity. Construct validity was assessed through scoring of operative videos employing Objective Structured Assessment of Technical Skills (OSATS) and a novel Task-Specific Outcome Measure score.

Results

Fifteen novice and five expert participants were recruited. Forty percent of experts agreed or strongly agreed that the brain tissue looked real. Experts unanimously agreed that the RetrosigmoidBox was appropriate for teaching. Statistically significant differences were noted in task performance between novices and experts, demonstrating construct validity. Median total OSATS score was 14/25 (IQR 10-19) for novices and 22/25 (IQR 20-22) for experts (p < 0.05). Median Task-Specific Outcome Measure score was 10/20 (IQR 7-17) for novices compared to 19/20 (IQR 18.5-19.5) for experts (p < 0.05).

Conclusion

The RetrosigmoidBox benchtop simulator has a high degree of content and construct validity and moderate face validity. The changing landscape of neurosurgical training mean that simulators are likely to become increasingly important in the delivery of high-quality education. We demonstrate the validity of a Task-Specific Outcome Measure score for performance assessment of a simulated approach to the CPA.

Superiority of living animal models in microsurgical training: beyond technical expertise

Background

Many studies are investigating the role of living and nonliving models to train microsurgeons. There is controversy around which modalities account for the best microsurgical training. In this study, we aim to provide a systematic literature review of the practical modalities in microsurgery training and compare the living and nonliving models, emphasizing the superiority of the former. We introduce the concept of non-technical skill acquisition in microsurgical training with the use of living laboratory animals in the context of a novel proposed curriculum.

Methods

A literature search was conducted on PubMed/Medline and Scopus within the past 11 years based on a combination of the following keywords: “microsurgery,” “training,” “skills,” and “models.” The online screening process was performed by two independent reviewers with the Covidence tool. A total of 101 papers was identified as relevant to our study. The protocol was reported in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.

Results

Living models offer the chance to develop both technical and non-technical competencies (i.e., leadership, situation awareness, decision-making, communication, and teamwork). Prior experience with ex vivo tissues helps residents consolidate basic skills prior to performing more advanced techniques in the living tissues. Trainees reported a higher satisfaction rate with the living models.

Conclusions

The combination of living and nonliving training microsurgical models leads to superior results; however, the gold standard remains the living model. The validity of the hypothesis that living models enhance non-technical skills remains to be confirmed.

Level of evidence: Not ratable.