LapSim virtual reality laparoscopic simulator reflects clinical experience in German surgeons

Training and assessment using the LapSim laparoscopic simulator: a scoping review of validity evidence

INTRODUCTION

The LapSim (Surgical Science, Sweden) laparoscopic simulator is a high-fidelity virtual reality simulator for use in endoscopic surgical training. This review critiques the current validity evidence for the LapSim laparoscopic simulator, specifically with respect to its potential use as a tool and method of training and assessment in surgery.

METHODS

A scoping review of the MEDLINE (PubMed), EMBASE, Cochrane and Web of Science databases was conducted in accordance with PRISMA guidelines (2020)-scoping review extension. Articles were included if they presented validity evidence for the use of the LapSim in operative skill training or assessment, in accordance with Messick's validity framework. European Association of Endoscopic Surgeons (EAES) guidelines (2005) were used to provide recommendations for the use of the LapSim in operative performance training and assessments.

RESULTS

Forty-nine articles were included. An EAES level 2 recommendation was provided with regard to the internal consistency reliability of automated performance metrics in assessing performance. An EAES recommendation of 2 was awarded with respect to the ability of the LapSim to discriminate based on case volume and overall laparoscopic experience (relationships with other variables). Performance assessment metrics on the LapSim correlate with improved performance in the operating room (EAES level of recommendation 1-consequential validity).

CONCLUSION

The LapSim has accumulated substantial evidence supporting the validity of its use in surgical training and assessment. Future studies should explore the relationship between the achievement of performance benchmarks on the LapSim and subsequent patient outcomes, and interrogate the benefits of implementing virtual reality simulation training and assessment curricula in post-graduate surgical training programmes.

Coffee break has no impact on laparoscopic skills: a randomized double-blinded placebo-controlled parallel-group trial

Background

Coffee is a widely consumed beverage. Surgeons often drink coffee before performing surgery. Caffeine intake leads to tremor which might have a negative effect on surgeons’ fine motor skills.

Methods

A double-blinded parallel-group trial was conducted in order to investigate if caffeinated coffee intake has a negative effect on laparoscopic skills and increases tremor, regardless of previous coffee consumption. 118 participants were selected during a congress of the German Society of Surgery. Exclusion criteria were immaturity and no given consent. Participants and investigators were blinded. Participants were randomized with a 1:1 allocation into interventional group receiving caffeinated coffee or placebo group receiving decaffeinated coffee. The motor skills were tested with two validated laparoscopic exercises at a laparoscopy simulator (LapSim®) before and 30 min after coffee intake. Data on influencing factors were recorded in a standardized questionnaire and tested for equal distribution in both groups. In both exercises four parameters were recorded: left and right hand path length and angular path. Their differences and the resulting effect scores were calculated for both groups as primary outcome to test which group showed greater improvement on the second round of exercises. Registration number DRKS00023608, registered retrospectively.

Results

Fifty nine subjects were assigned to each the interventional (54 analyzed) and placebo group (53 analyzed) with 11 drop outs. There was no significant difference between the placebo and interventional group in the two exercises in effect score 30 min after coffee intake [mean (SD); 38.58 (10.66) vs. 41.73 (7.40) and 113.09 (28.94) vs. 116.59 (25.63)]. A significant improvement from first to second measurement in the first exercise could be observed for both groups, demonstrating the training effect.

Conclusion

In our study, we verified that additional caffeinated coffee intake, e.g., during a coffee break, does not lead to deterioration of laparoscopic fine motor skills.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00464-021-08675-9.

Skill Acquisition, Assessment, and Simulation in Minimal Access Surgery: An Evolution of Technical Training in Surgery

Diminishing resources and expanding technologies, such as minimal access surgery, have complicated the acquisition and assessment of technical skills in surgical training programs. However, these challenges have been met with both innovation and an evolution in our understanding of how learners develop technical competence and how to better measure it. As these skills continue to grow in breadth and complexity, so too must the surgical education systems’ ability. This literature review examines and describes the pressures placed on surgical education programs and the development of methods to ameliorate them with a focus on surgical simulation.

Microsurgery Simulator of Cerebral Aneurysm Clipping with Interactive Cerebral Deformation Featuring a Virtual Arachnoid

BACKGROUND

A virtual reality simulator for aneurysmal clipping surgery is an attractive research target for neurosurgeons. Brain deformation is one of the most important functionalities necessary for an accurate clipping simulator and is vastly affected by the status of the supporting tissue, such as the arachnoid membrane. However, no virtual reality simulator implementing the supporting tissue of the brain has yet been developed.

OBJECTIVE

To develop a virtual reality clipping simulator possessing interactive brain deforming capability closely dependent on arachnoid dissection and apply it to clinical cases.

METHODS

Three-dimensional computer graphics models of cerebral tissue and surrounding structures were extracted from medical images. We developed a new method for modifiable cerebral tissue complex deformation by incorporating a nonmedical image-derived virtual arachnoid/trabecula in a process called multitissue integrated interactive deformation (MTIID). MTIID made it possible for cerebral tissue complexes to selectively deform at the site of dissection. Simulations for 8 cases of actual clipping surgery were performed before surgery and evaluated for their usefulness in surgical approach planning.

RESULTS

Preoperatively, each operative field was precisely reproduced and visualized with the virtual brain retraction defined by users. The clear visualization of the optimal approach to treating the aneurysm via an appropriate arachnoid incision was possible with MTIID.

CONCLUSION

A virtual clipping simulator mainly focusing on supporting tissues and less on physical properties seemed to be useful in the surgical simulation of cerebral aneurysm clipping. To our knowledge, this article is the first to report brain deformation based on supporting tissues.

When experts are oceans apart: comparing expert performance values for proficiency-based laparoscopic simulator training

BACKGROUND

Surgical training is moving away from the operating room toward simulation-based skills training facilities. This has led to the development of proficiency-based training courses in which expert performance data are used for feedback and assessment. However, few expert value data sets have been published, and no standard method for generating expert values has been adopted by the field.

METHODS

To investigate the effect of different proficiency value data sets on simulator training courses, we (1) compared 2 published expert performance data sets for the LapSim laparoscopic virtual-reality simulator (by van Dongen et al. and Heinrichs et al.) and (2) assessed the effect of using either set on LapSim training data obtained from 16 local residents in surgery and gynecology.

RESULTS

Across all simulator tasks, the experts consulted by van Dongen et al. performed better on motion efficiency, but not on duration or damage control. Applying both proficiency sets to training data collected during a basic skills laparoscopic simulator course, residents would have graduated on an average in 1.5 fewer sessions using the Heinrichs expert values compared with the van Dongen expert values.

CONCLUSIONS

The selection of proficiency values for proficiency-based simulator training courses affects training length, skills level assessment, and training costs. Standardized, well-controlled methods are necessary to create valid and reliable expert values for use in training and research.

Evaluation of surgical training in the era of simulation

AIM

To assess where we currently stand in relation to simulator-based training within modern surgical training curricula.

METHODS

A systematic literature search was performed in PubMed database using keywords "simulation", "skills assessment" and "surgery". The studies retrieved were examined according to the inclusion and exclusion criteria. Time period reviewed was 2000 to 2013. The methodology of skills assessment was examined.

RESULTS

Five hundred and fifteen articles focussed upon simulator based skills assessment. Fifty-two articles were identified that dealt with technical skills assessment in general surgery. Five articles assessed open skills, 37 assessed laparoscopic skills, 4 articles assessed both open and laparoscopic skills and 6 assessed endoscopic skills. Only 12 articles were found to be integrating simulators in the surgical training curricula. Observational assessment tools, in the form of Objective Structured Assessment of Technical Skills (OSATS) dominated the literature.

CONCLUSION

Observational tools such as OSATS remain the top assessment instrument in surgical training especially in open technical skills. Unlike the aviation industry, simulation based assessment has only now begun to cross the threshold of incorporation into mainstream skills training. Over the next decade we expect the promise of simulator-based training to finally take flight and begin an exciting voyage of discovery for surgical trainees.

Simulation in surgical education

The pedagogical approach to surgical training has changed significantly over the past few decades. No longer are surgical skills solely acquired through a traditional apprenticeship model of training. The acquisition of many technical and nontechnical skills is moving from the operating room to the surgical skills laboratory through the use of simulation. Many platforms exist for the learning and assessment of surgical skills. In this article, the authors provide a broad overview of some of the currently available surgical simulation modalities including bench-top models, laparoscopic simulators, simulation for new surgical technologies, and simulation for nontechnical surgical skills.

Assessing trainee impact on operative time for common general surgical procedures in ACS-NSQIP

OBJECTIVE

To examine the effect of surgical trainee involvement on operative time for common surgical procedures. Laparoscopic appendectomy, laparoscopic cholecystectomy, and open inguinal hernia repair comprise 17.7% of the total cases sampled in the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) database. These cases are commonly performed by residents at varying levels of surgical training.

STUDY DESIGN

A cross-sectional study was performed using American College of Surgeons National Surgical Quality Improvement Program data from 2005 through 2008 selecting patients undergoing laparoscopic appendectomy, laparoscopic cholecystectomy, and open inguinal hernia repair. The primary outcome was operative time and predictive variables were resident involvement and training level. Linear regression analysis was used to compare operative times between cases performed by an attending alone and those assisted by junior (postgraduate year 1-2) or senior (postgraduate year 3-5) trainees, adjusting for patient and operative factors.

RESULTS

A total of 115,535 surgical cases were included, with 65,364 (59%) performed with junior or senior surgical residents. Resident participation was associated with higher operative times with no significant differences between the junior and senior cohorts; this effect persisted after controlling for potential confounding factors. Operative time increased by 16.6 minutes (95% confidence interval, 16.2-17.0) for junior residents and also by 16.6 minutes (95% confidence interval, 16.2-16.9) for senior residents.

CONCLUSIONS

Surgical trainees' participation in common surgical procedures is associated with an increase in total operative time, with no difference between trainee seniority levels. This finding may be significant in assessing the impact of residency training programs on hospital efficiency.

Objective assessment of technical surgical skills

Background

Surgeons are increasingly being scrutinized for their performance and there is growing interest in objective assessment of technical skills. The purpose of this study was to review all evidence for these methods, in order to provide a guideline for use in clinical practice.

Methods

A systematic search was performed using PubMed and Web of Science for studies addressing the validity and reliability of methods for objective skills assessment within surgery and gynaecology only. The studies were assessed according to the Oxford Centre for Evidence-based Medicine levels of evidence.

Results

In total 104 studies were included, of which 20 (19·2 per cent) had a level of evidence 1b or 2b. In 28 studies (26·9 per cent), the assessment method was used in the operating room. Virtual reality simulators and Objective Structured Assessment of Technical Skills (OSATS) have been studied most. Although OSATS is seen as the standard for skills assessment, only seven studies, with a low level of evidence, addressed its use in the operating room.

Conclusion

Based on currently available evidence, most methods of skills assessment are valid for feedback or measuring progress of training, but few can be used for examination or credentialing. The purpose of the assessment determines the choice of method.

Contemporary virtual reality laparoscopy simulators: quicksand or solid grounds for assessing surgical trainees?

BACKGROUND

A demand for safe, efficient laparoscopic training tools has prompted the introduction of virtual reality (VR) laparoscopic simulators, which might be used for performance assessment. The purpose of this review is to determine the value of VR metrics in laparoscopic skills assessment.

DATA SOURCES

An exhaustive search of the MEDLINE and EMBASE databases was performed to identify publications concerning construct, concurrent and predictive validation of VR simulators. Of 643 publications found, 42 were included in this review. Studies into all 3 types of validation showed a large heterogeneity in study design. Although concurrence of VR metrics with box trainer metrics, mental aptitude tests, and in vivo surgical performance was generally weak, several metrics demonstrated construct validity in selected simulators.

CONCLUSIONS

Using the right simulator, tasks, and metrics, trainees' and experts' laparoscopic skills can reliably be compared. However, VR simulators cannot yet predict levels of real life surgical skills.

Proficiency-based laparoscopic and endoscopic training with virtual reality simulators: a comparison of proctored and independent approaches

BACKGROUND

Virtual reality (VR) simulators for laparoscopy and endoscopy may be valuable tools for resident education. However, the cost of such training in terms of trainee and instructor time may vary depending upon whether an independent or proctored approach is employed.

METHODS

We performed a randomized controlled trial to compare independent and proctored methods of proficiency-based VR simulator training. Medical students were randomized to independent or proctored training groups. Groups were compared with respect to the number of training hours and task repetitions required to achieve expert level proficiency on laparoscopic and endoscopic simulators. Cox regression modeling was used to compare time to proficiency between groups, with adjustment for appropriate covariates.

RESULTS

Thirty-six medical students (18 independent, 18 proctored) were enrolled. Achievement of overall simulator proficiency required a median of 11 hours of training (range, 6-21 hours). Laparoscopic and endoscopic proficiency were achieved after a median of 11 (range, 6-32) and 10 (range, 5-27) task repetitions, respectively. The number of repetitions required to achieve proficiency was similar between groups. After adjustment for covariates, trainees in the independent group achieved simulator proficiency with significantly fewer hours of training (hazard ratio, 2.62; 95% confidence interval, 1.01-6.85; p = 0.048).

CONCLUSIONS

Our study quantifies the cost, in instructor and trainee hours, of proficiency-based laparoscopic and endoscopic VR simulator training, and suggests that proctored instruction does not offer any advantages to trainees. The independent approach may be preferable for surgical residency programs desiring to implement VR simulator training.

Face and construct validity of virtual reality simulation of laparoscopic gynecologic surgery

OBJECTIVE

The objective of the study was to validate virtual reality simulation in assessing laparoscopic skills in gynecology by establishing the extent of realism of the simulation to the actual task (face validity) and the degree to which the results of the test one uses reflects the subject tested (construct validity).

STUDY DESIGN

Subjects (n = 56) were divided into 3 groups: novices (n = 15), intermediates (n = 20), and experts (n = 21). Participants completed 3 repetitions of a training program consisting of 4 basic skills and 3 gynecologic procedural simulations. The performance was compared between groups using a post hoc Student t test with the Bonferroni technique. Face validity was determined by using a questionnaire of 27 statements.

RESULTS

Resulting from the questionnaire, the opinion about the realism and training capacities of the tasks was favorable among all groups. The degree of prior laparoscopic experience was reflected in the outcome performance parameters of the tasks. Experts achieved significant better scores on specific parameters.

CONCLUSION

The results of this study indicate acceptance and thus face validity of the system among both reference (novice, intermediate) and expert group. There is a significant difference between subjects with different laparoscopic experience and thereby construct validity for the laparoscopic simulator could be established.

[Surgical training with simulators in training centers]

The development of new endoscopic procedures and minimally-invasive surgical interventions has led the methodology used to date to be questioned. Greater demand for safety by patients, the growth of the health budget and the reduced time available for training have led to the proliferation of centers with accredited personnel in which the knowledge and surgical skills necessary for the controlled incorporation of these techniques can be acquired. Simulators are available for the learning of both digestive endoscopy and laparoscopic techniques. These simulators are more or less dynamic, virtual, with viscera or mixed; even live animals can be used. Thus, the various techniques can be incorporated into clinical practice safely and effectively and at a reasonable cost. Simulators also allow evaluation and follow-up of the skills acquired.

Evolution of surgical skills training

Surgical training is changing: one hundred years of tradition is being challenged by legal and ethical concerns for patient safety, work hours restrictions, the cost of operating room time, and complications. Surgical simulation and skills training offers an opportunity to teach and practice advanced skills outside of the operating room environment before attempting them on living patients.

Simulation training can be as straight forward as using real instruments and video equipment to manipulate simulated “tissue” in a box trainer. More advanced, virtual reality simulators are now available and ready for widespread use. Early systems have demonstrated their effectiveness and discriminative ability. Newer systems enable the development of comprehensive curricula and full procedural simulations.

The Accreditation Council of Graduate Medical Education’s (ACGME) has mandated the development of novel methods of training and evaluation. Surgical organizations are calling for methods to ensure the maintenance of skills, advance surgical training, and to credential surgeons as technically competent.

Simulators in their current form have been demonstrated to improve the operating room performance of surgical residents. Development of standardized training curricula remains an urgent and important agenda, particularly for minimal invasive surgery. An innovative and progressive approach, borrowing experiences from the field of aviation, can provide the foundation for the next century of surgical training, ensuring the quality of the product. As the technology develops, the way we practice will continue to evolve, to the benefit of physicians and patients.

Simulation: a new frontier in surgical education

Simulation offers a new frontier in surgical education that promises to enhance the current approaches to training. It addresses the operational and fiscal realities of current healthcare deliveries while adhering to principles of educational psychology. Challenges for educators include systematic validation of simulation methods, attracting research funding agencies to support this cause, and development of appropriate funding mechanisms for the sometimes high facility and hardware costs. The greatest challenge, however, is instituting simulation into the minds of a surgical community that is already steeped in a long and entrenched tradition of Halstedian surgical training.