The Eindhoven laparoscopic cholecystectomy training course--improving operating room performance using virtual reality training: results from the first E.A.E.S. accredited virtual reality trainings curriculum

Completion of a novel, virtual-reality-based, advanced laparoscopic curriculum improves advanced laparoscopic skills in senior residents

INTRODUCTION

Virtual reality simulators contribute to basic laparoscopic skill acquisition. These trainers have not yet been shown to contribute to the acquisition of more advanced laparoscopic skills as measured by the Fundamentals of Laparoscopic Surgery (FLS). We have customized novel basic and advanced curricula for the LapSim trainer (Surgical Science, Göteborg, Sweden). Successful completion of these programs is required of our residents. We hypothesize that the successful completion of our advanced curriculum will result in the significant improvement of our residents' advanced laparoscopic skills as measured by the FLS skills scores.

METHODS

In all, 23 surgical residents (PGY 1-4), who had already passed our basic skills curriculum, completed our advanced LapSim curriculum. All individuals underwent FLS skills testing before and after completing the training. Laparoscopic case experience during the training period was documented for all trainees. FLS scores were analyzed by t test and controlled for case experience.

RESULTS

Posttraining FLS scores demonstrate a significant increase for all residents from a mean of 57-66 (p < 0.02), especially for seniors (PGY 3-4): 56-68 (p < 0.01). The operative laparoscopic case volume ranged from 1-90 (mean, 30) for juniors (PGY 1-2) and 12-76 (mean 50) for seniors during the training period. Junior resident FLS improvement was dependent on case volume during the period of training; residents with less than 30 cases had a mean improvement of 0, whereas those with at least 30 cases had a 15 point improvement (p < 0.01). Senior resident FLS score improvement was independent of case numbers during the training period.

CONCLUSIONS

Completion of our advanced LapSim curriculum results in improved advanced laparoscopic skills in senior residents as measured by FLS scores. This skill improvement is independent of laparoscopic case experience. Continuing to mandate the use of this skills curriculum should improve our residents' performance in advanced laparoscopic surgical procedures.

European consensus on a competency-based virtual reality training program for basic endoscopic surgical psychomotor skills

BACKGROUND

Virtual reality (VR) simulators have been demonstrated to improve basic psychomotor skills in endoscopic surgery. The exercise configuration settings used for validation in studies published so far are default settings or are based on the personal choice of the tutors. The purpose of this study was to establish consensus on exercise configurations and on a validated training program for a virtual reality simulator, based on the experience of international experts to set criterion levels to construct a proficiency-based training program.

METHODS

A consensus meeting was held with eight European teams, all extensively experienced in using the VR simulator. Construct validity of the training program was tested by 20 experts and 60 novices. The data were analyzed by using the t test for equality of means.

RESULTS

Consensus was achieved on training designs, exercise configuration, and examination. Almost all exercises (7/8) showed construct validity. In total, 50 of 94 parameters (53%) showed significant difference.

CONCLUSIONS

A European, multicenter, validated, training program was constructed according to the general consensus of a large international team with extended experience in virtual reality simulation. Therefore, a proficiency-based training program can be offered to training centers that use this simulator for training in basic psychomotor skills in endoscopic surgery.

Warm-up in a virtual reality environment improves performance in the operating room

OBJECTIVE

To assess the impact of warm-up on laparoscopic performance in the operating room (OR).

BACKGROUND

Implementation of simulation-based training into clinical practice remains limited despite evidence to show that the improvement in skills is transferred to the OR. The aim of this study was to evaluate the impact of a short virtual reality warm-up training program on laparoscopic performance in the OP.

METHODS

Sixteen Laparoscopic Cholecystectomies were performed by 8 surgeons in the OR. Participants were randomized to a group which received a preprocedure warm-up using a virtual reality simulator and no warm-up group. After the initial laparoscopic cholecystectomy all surgeons served as their own controls by performing another procedure with or without preoperative warm-up. All OR procedures were videotaped and assessed by 2 independent observers using the generic OSATS global rating scale (from 7 to 35).

RESULTS

There was significantly better surgical performance on the laparoscopic Cholecystectomy following preoperative warm-up, median 28.5 (range = 18.5-32.0) versus median 19.25 (range = 15-31.5), P = 0.042. The results demonstrated excellent reliability of the assessment tool used (Cronbach's alpha = 0.92).

CONCLUSION

This study showed a significant beneficial impact of warm-up on laparoscopic performance in the OP. The suggested program is short, easy to perform, and therefore realistic to implement in the daily life in a busy surgical department. This will potentially improve the procedural outcome and contribute to improved patient safety and better utilization of OR resources.

Skills assessment using a virtual reality simulator, LapSim, after training to develop fundamental skills for endoscopic surgery

Education and training to maintain medical safety are very important within clinical settings. We have established a training center for endoscopic surgery and we regularly hold a unique training course, which focuses on the development of fundamental skills. One hundred and ninety-four surgeons who participated in our training course were divided into four groups according to their experience in performing laparoscopic procedures. Group 1: 0-19 laparoscopic procedures (n=44). Group 2: 20-49 laparoscopic procedures (n=53). Group 3: 50-99 laparoscopic procedures (n=46). Group 4: more than 100 laparoscopic procedures (n=55). All subjects underwent evaluation for "Lifting & Grasping" using a virtual reality (VR) simulator, LapSim, before and after the training course. The mean efficiency score, time to completion and tissue damage after training were significantly improved after the training as compared with before training. Before training, subjects with greater experience had better scores. However, the only significant difference in the score was between the low experience group and greatest experience group. After training, the score increased in all groups compared with that before training, and there was no significant difference between groups. This study demonstrates the feasibility of using a VR simulator to assess fundamental skills for endoscopic surgery after training. We found that the scores for the task were associated with the level of experience of the surgeons.

Laparoscopic simulation training with proficiency targets improves practice and performance of novice surgeons

BACKGROUND

This study compares a laparoscopic skill training protocol without proficiency targets to the same protocol with explicit targets and notification of progress.

METHODS

Fourteen surgery interns were randomized into 2 groups. The intervention group received task-specific proficiency criteria to guide practice. The control group did not. After training, participants were evaluated by blinded faculty during laparoscopic cholecystectomy.

RESULTS

The control group met significantly fewer of the 7 LapSim (Surgical Science Sweden AB, Gotëborg) targets (mean = 1.14) than the intervention group (mean = 7.00; P = .001) and significantly fewer of the 5 video trainer targets (mean = .86) than the intervention group (mean = 5.00; P = .001). Ratings of depth perception, bimanual dexterity, efficiency, tissue handling, autonomy, and overall competence were higher for the intervention group. Effect sizes ranged from medium to large (.394-.981), indicating an impact of the proficiency-based training protocol.

CONCLUSIONS

Delineation of proficiency targets with reporting of progress improves interns' practice results, and appears to have a positive effect on their early operating room (OR) performance of laparoscopic cholecystectomy.

Contemporary virtual reality laparoscopy simulators: quicksand or solid grounds for assessing surgical trainees?

BACKGROUND

A demand for safe, efficient laparoscopic training tools has prompted the introduction of virtual reality (VR) laparoscopic simulators, which might be used for performance assessment. The purpose of this review is to determine the value of VR metrics in laparoscopic skills assessment.

DATA SOURCES

An exhaustive search of the MEDLINE and EMBASE databases was performed to identify publications concerning construct, concurrent and predictive validation of VR simulators. Of 643 publications found, 42 were included in this review. Studies into all 3 types of validation showed a large heterogeneity in study design. Although concurrence of VR metrics with box trainer metrics, mental aptitude tests, and in vivo surgical performance was generally weak, several metrics demonstrated construct validity in selected simulators.

CONCLUSIONS

Using the right simulator, tasks, and metrics, trainees' and experts' laparoscopic skills can reliably be compared. However, VR simulators cannot yet predict levels of real life surgical skills.

Expertise and Skill in Minimally Invasive Surgery

New attitudes to medical ethics and demands for efficiency have brought increased attention to surgical skills and training. It is important to characterize the expertise and skill involved in the multidimensional surgical profession. At a time of change, there is a need to discuss the nature of surgical expertise, and also the prospects for resident training, with special reference to new minimally invasive techniques (MIS).

In this paper, we selectively review knowledge on surgical expertise and the specific demands placed on a skilled MIS surgeon. In addition, the review contains a selection of studies from those areas that have been seen as important for the future of training in surgery.

[Assessment of resident training in laparoscopic surgery based on a digestive system anastomosis model in the laboratory]

BACKGROUND

The complexity of laparoscopic surgery makes specific training out of the operating rooms necessary to shorten learning curves and to minimise morbidity rates. Our aim was to analyse the increase in laparoscopic skills after completion of a laboratory training program.

MATERIAL AND METHODS

Prospective study of surgical resident training based on anastomosis performance on an "endotrainer". The program consisted of 4 weeks per year (20h per week) between 2004 and 2007. The outcome measures were the time and number of anastomosis necessary to perform a proper anastomosis. Upon completion, the anastomosis was checked by both trainee and evaluator and quality was assessed. Time and technical failures (loose suture, edge eversion, leakage) were recorded.

RESULTS

Twelve surgical residents were trained. They performed 189 jejuno-jejunal anastomoses (JJA), mean 15.8 per resident and 197 gastro-jejunal anastomoses (GJA), mean 16.4 per resident. The performance mean time was 72.7 min for JJA and 87.2 for GJA. There was a marked reduction in time from the beginning to completion of training. The percentage of flawed anastomosis decreased with training: 26.6%, 21.8%, 17.1%, 17%, 16.1% and 10.5% after 20, 40, 60, 80, 100 and 120 h, respectively. Bearing in mind reduction in both performance time and flawed anastomosis rate, it appears that after 70 h of training the learning curve reaches a plateau zone.

CONCLUSIONS

Intestinal anastomosis (either JJA or GJA) performed in "endotrainer" is a suitable model for laparoscopic training, without the need of live animals. After a training period of 70 hours, the improvement seems of little benefit.

Stereoscopic virtual reality simulation for microsurgical excision of cerebral arteriovenous malformation: case illustrations

BACKGROUND

Use of virtual reality planning and rehearsal for planning and training of cerebral aneurysm clipping was recently reported. We aimed to illustrate its applications in preoperative planning and training for cerebral AVM excision.

CASE DESCRIPTION

We illustrated the application of preoperative rehearsal for excision of cerebral AVM for 2 patients in a stereoscopic virtual reality environment. One patient was a 44-year-old lady with a right posterior temporal AVM, and 1 patient was a 23-year-old lady with a left frontal AVM. Through Dextroscope, an anatomical understanding of arterial feeders, nidus, and draining veins in relationship to surrounding cerebral cortex was obtained. It allowed one to see the exposure with the different angles of visualization, similar to what happened under the operative microscope.

CONCLUSION

Dextroscopic virtual reality stimulation provided an illustrated preoperative planning and training for excision of cerebral AVM.

Validation and implementation of surgical simulators: a critical review of present, past, and future

BACKGROUND

In the past 20 years the surgical simulator market has seen substantial growth. Simulators are useful for teaching surgical skills effectively and with minimal harm and discomfort to patients. Before a simulator can be integrated into an educational program, it is recommended that its validity be determined. This study aims to provide a critical review of the literature and the main experiences and efforts relating to the validation of simulators during the last two decades.

METHODS

Subjective and objective validity studies between 1980 and 2008 were identified by searches in Pubmed, Cochrane, and Web of Science.

RESULTS

Although several papers have described definitions of various subjective types of validity, the literature does not offer any general guidelines concerning methods, settings, and data interpretation. Objective validation studies on endourological simulators were mainly characterized by a large variety of methods and parameters used to assess validity and in the definition and identification of expert and novice levels of performance.

CONCLUSION

Validity research is hampered by a paucity of widely accepted definitions and measurement methods of validity. It would be helpful to those considering the use of simulators in training programs if there were consensus on guidelines for validating surgical simulators and the development of training programs. Before undertaking a study to validate a simulator, researchers would be well advised to conduct a training needs analysis (TNA) to evaluate the existing need for training and to determine program requirements in a training program design (TPD), methods that are also used by designers of military simulation programs. Development and validation of training models should be based on a multidisciplinary approach involving specialists (teachers), residents (learners), educationalists (teaching the teachers), and industrial designers (providers of teaching facilities). In addition to technical skills, attention should be paid to contextual, interpersonal, and task-related factors.

Personalized oral debriefing versus standardized multimedia instruction after patient crisis simulation

BACKGROUND

Simulation experience alone without debriefing is insufficient for learning. Standardized multimedia instruction has been shown to be useful in teaching surgical skills but has not been evaluated for use as an adjunct in crisis management training. Our primary purpose in this study was to determine whether standardized computer-based multimedia instruction is effective for learning, and whether the learning is retained 5 wk later. Our secondary purpose was to compare multimedia instruction to personalized video-assisted oral debriefing with an expert.

METHODS

Thirty anesthesia residents were recruited to manage three different simulated resuscitation scenarios using a high-fidelity patient simulator. After the first scenario, subjects were randomized to either a computer-based multimedia tutorial or a personal debriefing of their performance with an expert and videotape review. After their respective teaching, subjects managed a similar posttest resuscitation scenario and a third retention test scenario 5 wk later. Performances were independently rated by two blinded expert assessors using a previously validated assessment system.

RESULTS

Posttest (12.22 +/- 2.19, P = 0.009) and retention (12.80 +/- 1.77, P < 0.001) performances of nontechnical skills were significantly improved in the standardized multimedia instruction group compared with pretest (10.27 +/- 2.10). There were no significant differences in improvement between the two methods of instruction.

CONCLUSION

Computer-based multimedia instruction is an effective method of teaching nontechnical skills in simulated crisis scenarios and may be as effective as personalized oral debriefing. Multimedia may be a valuable adjunct to centers when debriefing expertise is not available.

The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review

BACKGROUND

Virtual reality (VR) as surgical training tool has become a state-of-the-art technique in training and teaching skills for minimally invasive surgery (MIS). Although intuitively appealing, the true benefits of haptic (VR training) platforms are unknown. Many questions about haptic feedback in the different areas of surgical skills (training) need to be answered before adding costly haptic feedback in VR simulation for MIS training. This study was designed to review the current status and value of haptic feedback in conventional and robot-assisted MIS and training by using virtual reality simulation.

METHODS

A systematic review of the literature was undertaken using PubMed and MEDLINE. The following search terms were used: Haptic feedback OR Haptics OR Force feedback AND/OR Minimal Invasive Surgery AND/OR Minimal Access Surgery AND/OR Robotics AND/OR Robotic Surgery AND/OR Endoscopic Surgery AND/OR Virtual Reality AND/OR Simulation OR Surgical Training/Education.

RESULTS

The results were assessed according to level of evidence as reflected by the Oxford Centre of Evidence-based Medicine Levels of Evidence.

CONCLUSIONS

In the current literature, no firm consensus exists on the importance of haptic feedback in performing minimally invasive surgery. Although the majority of the results show positive assessment of the benefits of force feedback, results are ambivalent and not unanimous on the subject. Benefits are least disputed when related to surgery using robotics, because there is no haptic feedback in currently used robotics. The addition of haptics is believed to reduce surgical errors resulting from a lack of it, especially in knot tying. Little research has been performed in the area of robot-assisted endoscopic surgical training, but results seem promising. Concerning VR training, results indicate that haptic feedback is important during the early phase of psychomotor skill acquisition.

Simulation in surgery

Now essential for training

Retention of basic laparoscopic skills after a structured training program

The purpose of this study was to test the retention of basic laparoscopic skills on a box trainer 1 year after a short training program. For a prior study, eight medical students without prior experience (novices) underwent baseline testing, followed by five weekly training sessions and a final test. During each of seven sessions, they performed five tasks on an inanimate box trainer. Scores were calculated by adding up the time to completion of the task with penalty points, consequently rewarding speed and precision. The sum score was the sum of the five scores. One year later, seven of them underwent retention testing for the current study. The final test results were compared with retention test results as a measure of durability of acquired skills. Novices’ scores did not worsen significantly for four out of five tasks (i.e., placing a pipe cleaner p = 0.46, placing beads p = 0.24, cutting a circle p = 0.31, and knot tying p = 0.13). However, deterioration was observed in the performance on stretching a rubber band (p < 0.05), as well as in the sum score (p < 0.05). Nevertheless, all retention scores remained better than the baseline results. In conclusion, basic laparoscopic skills acquired during a short training program merely sustain over time. However, ongoing practice is advisable, especially to preserve tissue-handling skills, since these may be the first to deteriorate.

Virtual reality training for surgical trainees in laparoscopic surgery

BACKGROUND

Surgical training has traditionally been one of apprenticeship, where the surgical trainee learns to perform surgery under the supervision of a trained surgeon. This is time consuming, costly, and of variable effectiveness. Training using a virtual reality simulator is an option to supplement standard training.

OBJECTIVES

To determine whether virtual reality training can supplement or replace conventional laparoscopic surgical training (apprenticeship) in surgical trainees with limited or no prior laparoscopic experience.

SEARCH STRATEGY

We searched The Cochrane Hepato-Biliary Group Controlled Trials Register, the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library, MEDLINE, EMBASE, Science Citation Index Expanded, and grey literature until March 2008.

SELECTION CRITERIA

We included all randomised clinical trials comparing virtual reality training versus other forms of training including video trainer training, no training, or standard laparoscopic training in surgical trainees with little or no prior laparoscopic experience. We also included trials comparing different methods of virtual reality training.

DATA COLLECTION AND ANALYSIS

We collected the data on the characteristics of the trial, methodological quality of the trials, mortality, morbidity, conversion rate, operating time, and hospital stay. We analysed the data with both the fixed-effect and the random-effects models using RevMan Analysis. For each outcome we calculated the standardised mean difference with 95% confidence intervals based on intention-to-treat analysis.

MAIN RESULTS

We included 23 trials with 612 participants. Four trials compared virtual reality versus video trainer training. Twelve trials compared virtual reality versus no training or standard laparoscopic training. Four trials compared virtual reality, video trainer training and no training, or standard laparoscopic training. Three trials compared different methods of virtual reality training. Most of the trials were of high risk of bias. In trainees without prior surgical experience, virtual reality training decreased the time taken to complete a task, increased accuracy, and decreased errors compared with no training; virtual reality group was more accurate than video trainer training group. In the participants with limited laparoscopic experience, virtual reality training reduces operating time and error better than standard in the laparoscopic training group; composite operative performance score was better in the virtual reality group than in the video trainer group.

AUTHORS' CONCLUSIONS

Virtual reality training can supplement standard laparoscopic surgical training of apprenticeship and is at least as effective as video trainer training in supplementing standard laparoscopic training. Further research of better methodological quality and more patient-relevant outcomes are needed.

A systematic review of skills transfer after surgical simulation training

OBJECTIVE

To determine whether skills acquired by simulation-based training transfer to the operative setting.

SUMMARY BACKGROUND DATA

The fundamental assumption of simulation-based training is that skills acquired in simulated settings are directly transferable to the operating room, yet little evidence has focused on correlating simulated performance with actual surgical performance.

METHODS

A systematic search strategy was used to retrieve relevant studies. Inclusion of articles was determined using a predetermined protocol, independent assessment by 2 reviewers, and a final consensus decision. Only studies that reported on the use of simulation-based training for surgical skills training, and the transferability of these skills to the operative setting, were included.

RESULTS

Ten randomized controlled trials and 1 nonrandomized comparative study were included in this review. In most cases, simulation-based training was in addition to normal training programs. Only 1 study compared simulation-based training with patient-based training. For laparoscopic cholecystectomy and colonoscopy/sigmoidoscopy, participants who received simulation-based training before undergoing patient-based assessment performed better than their counterparts who did not receive previous simulation training, but improvement was not demonstrated for all measured parameters.

CONCLUSIONS

Skills acquired by simulation-based training seem to be transferable to the operative setting. The studies included in this review were of variable quality and did not use comparable simulation-based training methodologies, which limited the strength of the conclusions. More studies are required to strengthen the evidence base and to provide the evidence needed to determine the extent to which simulation should become a part of surgical training programs.

The future of patient safety: Surgical trainees accept virtual reality as a new training tool

Background

The use of virtual reality (VR) has gained increasing interest to acquire laparoscopic skills outside the operating theatre and thus increasing patients' safety. The aim of this study was to evaluate trainees' acceptance of VR for assessment and training during a skills course and at their institution.

Methods

All 735 surgical trainees of the International Gastrointestinal Surgery Workshop 2006–2008, held in Davos, Switzerland, were given a minimum of 45 minutes for VR training during the course. Participants' opinion on VR was analyzed with a standardized questionnaire.

Results

Fivehundred-twenty-seven participants (72%) from 28 countries attended the VR sessions and answered the questionnaires. The possibility of using VR at the course was estimated as excellent or good in 68%, useful in 21%, reasonable in 9% and unsuitable or useless in 2%. If such VR simulators were available at their institution, most course participants would train at least one hour per week (46%), two or more hours (42%) and only 12% wouldn't use VR. Similarly, 63% of the participants would accept to operate on patients only after VR training and 55% to have VR as part of their assessment.

Conclusion

Residents accept and appreciate VR simulation for surgical assessment and training. The majority of the trainees are motivated to regularly spend time for VR training if accessible.

Virtual reality training for endoscopic surgery: voluntary or obligatory?

Introduction

Virtual reality (VR) simulators have been developed to train basic endoscopic surgical skills outside of the operating room. An important issue is how to create optimal conditions for integration of these types of simulators into the surgical training curriculum. The willingness of surgical residents to train these skills on a voluntary basis was surveyed.

Methods

Twenty-one surgical residents were given unrestricted access to a VR simulator for a period of four months. After this period, a competitive element was introduced to enhance individual training time spent on the simulator. The overall end-scores for individual residents were announced periodically to the full surgical department, and the winner was awarded a prize.

Results

In the first four months of study, only two of the 21 residents (10%) trained on the simulator, for a total time span of 163 minutes. After introducing the competitive element the number of trainees increased to seven residents (33%). The amount of training time spent on the simulator increased to 738 minutes.

Conclusions

Free unlimited access to a VR simulator for training basic endoscopic skills, without any form of obligation or assessment, did not motivate surgical residents to use the simulator. Introducing a competitive element for enhancing training time had only a marginal effect. The acquisition of expensive devices to train basic psychomotor skills for endoscopic surgery is probably only effective when it is an integrated and mandatory part of the surgical curriculum.

Hysteroscopic morcellator for removal of intrauterine polyps and myomas: a randomized controlled pilot study among residents in training

The purpose of this randomized controlled study was to compare conventional resectoscopy and hysteroscopic morcellation among residents in training (Canadian Task Force classification I). Sixty women with an intrauterine polyp or myoma were randomized to either hysteroscopic removal by conventional resectoscopy or hysteroscopic morcellation performed by 6 residents in training for obstetrics and gynecology (10 procedures per resident). The mean operating time for resectosocpy and morcellation was 17.0 (95% confidence interval [95% CI] 14.1-17.9, standard deviation [SD] 8.4) and 10.6 (95% CI 7.3-14.0, SD 9.5) min, respectively (p = .008). Multiple linear regression analysis showed that operating time increased significantly, for both resectoscopy and morcellator, when volume of intrauterine disorder increased. The use of the hysteroscopic morcellator reduced operating time more than 8 min in comparison to conventional resectoscopy (p < .001) when correction for volume was applied. Subjective surgeon and trainer scores for convenience of technique on a visual analog scale were in favor of the morcellator. No learning curve was observed. In conclusion, the hysteroscopic morcellator for removal of intrauterine polyps and myomas offers a good alternative to conventional resectoscopy for residents in training.

Validation of two instruments to assess technical bronchoscopic skill using virtual reality simulation

BACKGROUND

In an era of increased emphasis on patient safety and competency-based education, demonstration of significant variability in the teaching of flexible bronchoscopy has led to initiatives for new standardized curricula and assessment tools.

OBJECTIVES

To evaluate the efficacy of such curricula and to assess bronchoscopic skill, 2 measuring instruments have been developed: the Bronchoscopy Skills and Tasks Assessment Tool (BSTAT) and the Bronchoscopy Step-by-Step Evaluation Tool (BSET). We studied the validity and reliability of these 2 instruments.

METHODS

Two independent testers simultaneously scored 22 volunteer participants at 3 levels [novice (n = 7), fellow (n = 8) and attending (n = 7)] on a virtual reality bronchoscopy simulator using the 2 instruments; each participant was tested twice, in 2 separate sessions. Intertester and test-retest reliability were analyzed with intraclass correlations (ICC); ANOVA was used to assess concurrent validity based on the subjects' expected skill level.

RESULTS

The ICCs between the testers were 0.98 for both the BSTAT and BSET. Comparison of the scores between the sessions showed high test-retest reliability by ICC (0.86 and 0.85 for BSTAT and BSET respectively), with a small yet statistically significant learning effect. The novice group's scores were lower than the fellows' and attendings' (p < 0.001) for both the BSTAT and BSET; the fellows' scores were consistently lower than the attendings' on both tests, yet the differences were not statistically significant.

CONCLUSION

This validation study of 2 objective tests of bronchoscopic skill demonstrated high reliability and concurrent validity. These instruments can now be used to evaluate the effectiveness of new competency-based bronchoscopy curricula.

CRANIOTOMY AND CLIPPING OF INTRACRANIAL ANEURYSM IN A STEREOSCOPIC VIRTUAL REALITY ENVIRONMENT

OBJECTIVE

The release of results of International Subarachnoid Aneurysm Trial in 2003 caused a shift in the paradigm of management of ruptured intracranial aneurysms. The cases selected for microsurgical clipping nowadays are usually those patients with aneurysms that are not suitable for embolization, and are often complex and difficult. We devised an innovative application of operative planning and training for craniotomy and microsurgical clipping of intracranial aneurysms in a stereoscopic virtual reality environment.

METHODS

Patient-specific Digital Imaging and Communications in Medicine data from computed tomographic angiography of the intracranial circulation and cranium were transferred to the workstation (Dextroscope; Volume Interactions Pte. Ltd., Singapore, Singapore). An aneurysm clip database was loaded into the patient data set. Three-dimensional volume rendering was followed by data coregistration and fusion.

RESULTS

Virtual head positioning and craniotomy were carried out to simulate the microscopic visualization. Clip selection could be carried out with reference to the angle of application. This allows one to see the exposure and degree of obliteration of an aneurysm with the various angles of approach.

CONCLUSION

The virtual craniotomy and microsurgical clipping application simulated the operative environment. Its role in neurosurgical training is encouraging and should be further developed.

Perceptions of surgical specialists in general surgery, orthopaedic surgery, urology and gynaecology on teaching endoscopic surgery in The Netherlands

BACKGROUND

Specific training in endoscopic skills and procedures has become a necessity for profession with embedded endoscopic techniques in their surgical palette. Previous research indicates endoscopic skills training to be inadequate, both from subjective (resident interviews) and objective (skills measurement) viewpoint. Surprisingly, possible shortcomings in endoscopic resident education have never been measured from the perspective of those individuals responsible for resident training, e.g. the program directors. Therefore, a nation-wide survey was conducted to inventory current endoscopic training initiatives and its possible shortcomings among all program directors of the surgical specialties in the Netherlands.

METHODS

Program directors for general surgery, orthopaedic surgery, gynaecology and urology were surveyed using a validated 25-item questionnaire.

RESULTS

A total of 113 program directors responded (79%). The respective response percentages were 73.6% for general surgeons, 75% for orthopaedic surgeon, 90.9% for urologists and 68.2% for gynaecologists. According to the findings, 35% of general surgeons were concerned about whether residents are properly skilled endoscopically upon completion of training. Among the respondents, 34.6% were unaware of endoscopic training initiatives. The general and orthopaedic surgeons who were aware of these initiatives estimated the number of training hours to be satisfactory, whereas the urologists and gynaecologists estimated training time to be unsatisfactory. Type and duration of endoscopic skill training appears to be heterogeneous, both within and between the specialties. Program directors all perceive virtual reality simulation to be a highly effective training method, and a multimodality training approach to be key. Respondents agree that endoscopic skills education should ideally be coordinated according to national consensus and guidelines.

CONCLUSIONS

A delicate balance exists between training hours and clinical working hours during residency. Primarily, a re-allocation of available training hours, aimed at core-endoscopic basic and advanced procedures, tailored to the needs of the resident and his or her phase of training is in place. The professions need to define which basic and advanced endoscopic procedures are to be trained, by whom, and by what outcome standards. According to the majority of program directors, virtual reality (VR) training needs to be integrated in procedural endoscopic training courses.

Routine early laparoscopic cholecystectomy for acute cholecystitis after conclusion of a randomized controlled trial

Background

The aim of this retrospective review was to assess the clinical outcomes of laparoscopic cholecystectomy for acute cholecystitis since the conclusion of a randomized controlled trial in 1997.

Methods

Records of all patients admitted for acute cholecystitis in whom early laparoscopic cholecystectomy was attempted between July 1997 and December 2004 were reviewed.

Results

A total of 209 patients were recruited to this study. Forty-three surgeons performed the procedures. The conversion rate increased significantly in the early period after the trial from 21 per cent to 42 per cent (39 of 92 patients) and decreased significantly to 24 per cent (13 of 54 patients) in the later period. The proportion of operations performed by higher surgical trainees increased significantly from 17 per cent in the early period to 56 per cent in the later period. This increase was associated with a fall in conversion rate without any significant increase in duration of operation or complication rate.

Conclusion

This study has demonstrated that the results achieved in a randomized trial can be translated into clinical practice by the entire surgical unit. A structured training programme with the inclusion of an experienced surgeon assisting both trainees and specialists should minimize this learning curve.

Construct validity of the LapSim: Can the LapSim virtual reality simulator distinguish between novices and experts?

BACKGROUND

Virtual reality simulators may be invaluable in training and assessing future endoscopic surgeons. The purpose of this study was to investigate if the results of a training session reflect the actual skill of the trainee who is being assessed and thereby establish construct validity for the LapSim virtual reality simulator (Surgical Science Ltd., Gothenburg, Sweden).

METHODS

Forty-eight subjects were assigned to one of three groups: 16 novices (0 endoscopic procedures), 16 surgical residents in training (>10 but <100 endoscopic procedures), and 16 experienced endoscopic surgeons (>100 endoscopic procedures). Performance was measured by a relative scoring system that combines single parameters measured by the computer.

RESULTS

The higher the level of endoscopic experience of a participant, the higher the score. Experienced surgeons and surgical residents in training showed statistically significant higher scores than novices for both overall score and efficiency, speed, and precision parameters.

CONCLUSIONS

Our results show that performance of the various tasks on the simulator corresponds to the respective level of endoscopic experience in our research population. This study demonstrates construct validity for the LapSim virtual reality simulator. It thus measures relevant skills and can be integrated in an endoscopic training and assessment program.

Porcine Transfer Study: Virtual Reality Simulator Training Compared with Porcine Training in Endovascular Novices

PURPOSE

To compare the learning of endovascular interventional skills by training on pig models versus virtual reality simulators.

METHODS

Twelve endovascular novices participated in a study consisting of a pig laboratory (P-Lab) and a virtual reality laboratory (VR-Lab). Subjects were stratified by experience and randomized into four training groups. Following 1 hr of didactic instruction, all attempted an iliac artery stenosis (IAS) revascularization in both laboratories. Onsite proctors evaluated performances using task-specific checklists and global rating scales, yielding a Total Score. Participants completed two training sessions of 3 hr each, using their group's assigned method (P-Lab x 2, P-Lab + VR-Lab, VR-Lab + P-Lab, or VR-Lab x 2) and were re-evaluated in both laboratories. A panel of two highly experienced interventional radiologists performed assessments from video recordings. ANCOVA analysis of Total Score against years of surgical, interventional radiology (IR) experience and cumulative number of P-Lab or VR-Lab sessions was conducted. Inter-rater reliability (IRR) was determined by comparing proctored scores with the video assessors in only the VR-Lab.

RESULTS

VR-Lab sessions improved the VR-Lab Total Score (beta = 3.029, p = 0.0015) and P-Lab Total Score (beta = 1.814, p = 0.0452). P-Lab sessions increased the P-Lab Total Score (beta = 4.074, p < 0.0001) but had no effect on the VR-Lab Total Score. In the general statistical model, both P-Lab sessions (beta = 2.552, p = 0.0010) and VR-Lab sessions (beta = 2.435, p = 0.0032) significantly improved Total Score. Neither previous surgical experience nor IR experience predicted Total Score. VR-Lab scores were consistently higher than the P-Lab scores (Delta = 6.659, p < 0.0001). VR-Lab IRR was substantial (r = 0.649, p < 0.0008).

CONCLUSIONS

Endovascular skills learned in the virtual environment may be transferable to the real catheterization laboratory as modeled in the P-Lab.

Implementation of the laparoscopic simulator in a gynecological residency curriculum

BACKGROUND

In view of the current emphasis on increasing patient safety and quality control in laparoscopic surgery, there is a growing need to improve laparoscopic training. This study was conducted to investigate if and when residents reached performance standards for basic laparoscopic skills on a boxtrainer and to analyze the current state of implementation of laparoscopic simulators in a gynecological residency curriculum.

METHODS

Residents across all 6 years of residency (postgraduate year [PGY] 1-6) were tested once on our boxtrainer by performing five inanimate tasks (pipe cleaner, rubber band, beads, cutting circle, intracorporeal knot tying). A sumscore for the five tasks was calculated for each participant (sum of all scores). Scores were calculated by adding completion time and penalty points, thus rewarding both speed and precision. These data were compared with scores of laparoscopic experts, which were set as performance standards.

RESULTS

Of the participants, 111 were residents (7 PGY1, 27 PGY2, 29 PGY3, 28 PGY4, 14 PGY5, 6 PGY6) and 8 were experts. At the end of residency, PGY6 residents reached the performance standard for all tasks except intracorporeal knot tying. It was not until PGY5 that residents reached the performance standard for the pipe cleaner task; PGY1, for rubber band; PGY5, for beads; PGY4, for circle cutting; and PGY6, for sumscore. Throughout residency PGY6 had a mean total of only 3.6 h of simulator training experience. No correlation was found between this previous voluntary simulator training experience and performance on our boxtrainer during this study (sumscore), and between previous voluntary simulator training and total laparoscopic procedures performed. In a combined multivariate analysis, sumscore performance remained significantly associated with the number of laparoscopic procedures performed by residents when they were working as as a primary surgeon (p = 0.002), and not with the cumulative hours of simulator training during residency prior to participating in this study (p = 0.15).

CONCLUSIONS

In a current Dutch gynecological residency curriculum, residents do not reach all performance standards for basic laparoscopic skills on the boxtrainer. We conclude that the voluntary simulator training program has a substantial risk to fail and that the implementation of the laparoscopic skills simulator in the current residency curriculum is in its infancy.

Nature of human error: implications for surgical practice

BACKGROUND

As the attitude to adverse events has changed from the defensive "blame and shame culture" to an open and transparent healthcare delivery system, it is timely to examine the nature of human errors and their impact on the quality of surgical health care.

METHODS

The approach of the review is generic rather than specific, and the account is based on the published psychologic and medical literature on the subject.

CONCLUSIONS

Rather than detailing the various "surgical errors," the concept of error categories within the surgical setting committed by surgeons as front-line operators is discussed. The important components of safe surgical practice identified include organizational structure with strategic control of healthcare delivery, teamwork and leadership, evidence-based practice, proficiency, continued professional development of all staff, availability of wireless health information technology, and well-embedded incident reporting and adverse events disclosure systems. In our quest for the safest possible surgical health care, there is a need for prospective observational multidisciplinary (surgeons and human factors specialists) studies as distinct for retrospective reports of adverse events. There is also need for research to establish the ideal system architecture for anonymous reporting of near miss and no harm events in surgical practice.

Simulators and Virtual Reality in Surgical Education

This article explores the pros and cons of virtual reality simulators, their abilities to train and assess surgical skills, and their potential future applications. Computer-based virtual reality simulators and more conventional box trainers are compared and contrasted. The virtual reality simulator provides objective assessment of surgical skills and immediate feedback further to enhance training. With this ability to provide standardized, unbiased assessment of surgical skills, the virtual reality trainer has the potential to be a tool for selecting, instructing, certifying, and recertifying gynecologists.

Laparoscopic skills are improved with LapMentor training: results of a randomized, double-blinded study

OBJECTIVE

To determine if prior training on the LapMentor laparoscopic simulator leads to improved performance of basic laparoscopic skills in the animate operating room environment.

SUMMARY BACKGROUND DATA

Numerous influences have led to the development of computer-aided laparoscopic simulators: a need for greater efficiency in training, the unique and complex nature of laparoscopic surgery, and the increasing demand that surgeons demonstrate competence before proceeding to the operating room. The LapMentor simulator is expensive, however, and its use must be validated and justified prior to implementation into surgical training programs.

METHODS

Nineteen surgical interns were randomized to training on the LapMentor laparoscopic simulator (n = 10) or to a control group (no simulator training, n = 9). Subjects randomized to the LapMentor trained to expert criterion levels 2 consecutive times on 6 designated basic skills modules. All subjects then completed a series of laparoscopic exercises in a live porcine model, and performance was assessed independently by 2 blinded reviewers. Time, accuracy rates, and global assessments of performance were recorded with an interrater reliability between reviewers of 0.99.

RESULTS

LapMentor trained interns completed the 30 degrees camera navigation exercise in significantly less time than control interns (166 +/- 52 vs. 220 +/- 39 seconds, P < 0.05); they also achieved higher accuracy rates in identifying the required objects with the laparoscope (96% +/- 8% vs. 82% +/- 15%, P < 0.05). Similarly, on the two-handed object transfer exercise, task completion time for LapMentor trained versus control interns was 130 +/- 23 versus 184 +/- 43 seconds (P < 0.01) with an accuracy rate of 98% +/- 5% versus 80% +/- 13% (P < 0.001). Additionally, LapMentor trained interns outperformed control subjects with regard to camera navigation skills, efficiency of motion, optimal instrument handling, perceptual ability, and performance of safe electrocautery.

CONCLUSIONS

This study demonstrates that prior training on the LapMentor laparoscopic simulator leads to improved resident performance of basic skills in the animate operating room environment. This work marks the first prospective, randomized evaluation of the LapMentor simulator, and provides evidence that LapMentor training may lead to improved operating room performance.

Novices in surgery are the target group of a virtual reality training laboratory

BACKGROUND

This study aims to establish which physicians represent the suitable target group of a virtual training laboratory.

METHODS

Novices (48 physicians with fewer than 10 laparoscopic operations) and intermediate trainees (19 physicians who performed 30-50 laparoscopic operations) participated in this study. Each participant performed the basic module 'clip application' at the beginning and after a 1-hour short training course on the LapSim. The course consisted of the tasks coordination, lift and grasp, clip application, cutting with diathermy and fine dissection at increasing difficulty levels. The time taken to complete the tasks, number of errors, and economy of motion parameters (path length and angular path) were analyzed.

RESULTS

Following training with the simulator, novices completed the task significantly faster (p = 0.001), demonstrated a greater economy of motion [path length (p = 0.04) and angular path (p = 0.01)]. In contrast, the intermediate trainees showed a reduction of their errors, but without reaching statistical significance. They showed no improvement in economy of motion and completed the task significantly slower (p = 0.03).

CONCLUSION

Novices, in comparison to intermediate trainees, tend to benefit most during their first exposure to a laparoscopy simulator.