Evaluation of surgical training in the era of simulation

The Sheep Head Versus the Pig Head as a Training Model for Sialendoscopy

OBJECTIVE

Sialendoscopy is a minimally invasive technique for treating inflammatory salivary gland diseases, requiring hands-on training due to its steep learning curve. While pig heads have been the standard training model for over two decades, sheep heads have recently emerged as an alternative. This study evaluates the efficiency of sheep heads for sialendoscopy training in newcomers.

METHODS

Participants of the 32nd International Sialendoscopy Hands-on Course (Geneva, 2023) performed sialendoscopies on fresh pig and sheep heads. Self-assessment questionnaires were completed pre- and post-training, with procedures rated on a Likert scale. Tutors evaluated participants using standardized assessments and recorded procedural times.

RESULTS

Among 52 participants from 27 countries, significant improvement in diagnostic sialendoscopy comfort was reported for both models post-training. Female participants demonstrated higher success rates than male participants in diagnostic (2.8 vs. 2.5, p = 0.03) and therapeutic (2.9 vs. 2.4, p = 0.03) procedures. More participants successfully cannulated the parotid duct on sheep heads, while submandibular gland performance was comparable across models. Self-assessments favored sheep for parotid (63%) and pigs for submandibular (79%). Overall, 53% preferred the pig model, while 47% preferred the sheep.

CONCLUSION

Both models are effective for training, with sheep heads offering advantages for parotid duct procedures. Despite the pig model's broader applications, logistical, cultural, and ethical constraints make sheep heads a viable alternative for sialendoscopy training.

LEVEL OF EVIDENCE

N/A.

Novel multimodal sensing and machine learning strategies to classify cognitive workload in laparoscopic surgery

BACKGROUND

Surgeons can experience elevated cognitive workload (CWL) during surgery due to various factors including operative technicalities and the environmental demands of the operating theatre. This can result in poorer outcomes and have a detrimental effect on surgeon well-being. The objective measurement of CWL provides a potential solution to facilitate classification of workload levels, however results are variable when physiological measures are used in isolation. The aim of this study is to develop and propose a multimodal machine learning (ML) approach to classify CWL levels using a bespoke sensor platform and to develop a ML approach to impute missing pupil diameter measures due to the effect of blinking or noise.

MATERIALS AND METHODS

Ten surgical trainees performed a simulated laparoscopic cholecystectomy under cognitive conditions of increasing difficulty, namely a modified auditory N-back task with increasing difficulty and a verbal clinical scenario. Physiological measures were recorded using a novel platform (MAESTRO). Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) were used as direct measures of CWL. Indirect measures included electromyography (EMG), electrocardiography (ECG) and pupil diameter (PD). A reference point for validation was provided by subjective assessment of perceived CWL using the SURG-TLX. A multimodal machine learning approach that systematically implements a CNN-BiLSTM, a binary version of the metaheuristic Manta Ray Foraging Optimisation (BMRFO) and a version of Fuzzy C-Means (FCM) called Optimal Completion Strategy (OCS) was used to classify the associated perceived CWL state.

RESULTS

Compared to other state of the art classification techniques, cross-validation results for the classification of CWL levels suggest that the CNN-BLSTM and BMRFO approach provides an average accuracy of 97 % based on the confusion matrix. Additionally, OCS demonstrated a superior average performance of 9.15 % in terms of Root-Mean-Square-Error (RMSE) when compared to other PD imputation methods.

CONCLUSION

Perceived CWL levels were correctly classified using a multimodal ML approach. This approach provides a potential route to accurately classify CWL levels, which may have application in future surgical training and assessment programs as well as the development of cognitive support systems in the operating room.

Nontechnical Skills Assessment in Acute Care Trauma Simulations: A Mixed Methods Approach Using Eye Tracking and Behavioral Marker Systems

INTRODUCTION

The condition of trauma patients and the urgent need for timely resuscitation present unique challenges to trauma teams. These difficulties are exacerbated for military trauma teams in combat environments. Consequently, there is a need for continued improvement of nontechnical skills (NTS) training for trauma teams. However, current approaches to NTS assessment rely on subjective ratings, which can introduce bias. Accordingly, objective methods of NTS evaluation are needed. Eye-tracking (ET) methods have been applied to studying communication, situation awareness, and leadership in many health care settings, and could be applied to studying physicians' NTS during trauma situations. In this study, we aimed to assess the relationship between trauma team leaders' objective gaze patterns and subjective expert NTS ratings during patient care simulations.

MATERIALS AND METHODS

After Institutional Review Board approval, 9 trauma teams from first-year post-graduate general surgery and emergency medicine residents were recruited to participate in 1 of 2 trauma simulations (a difficult airway case and a multi-patient trauma). Each scenario lasted approximately 15 minutes. All team leaders wore a mobile ET system to evaluate gaze metrics-time to first fixation (TTFF), average fixation duration (AFD), and total percentage of the scenario (TPS) focused on Areas of Interest (AOI), which included patient, care team, diagnostic equipment, and patient care equipment. Trained faculty raters completed the Non-Technical Skills for Surgeons (NOTSS) assessment tool and the Trauma Non-Technical Skills (T-NOTECHS) scale. One-way analysis of variance, Kruskal-Wallis, and appropriate post-hoc pairwise comparison tests were run to assess differences between ET metrics across AOI groups. Spearman's Rho tests were used to assess correlations between ET and subjective NTS ratings.

RESULTS

Compared to other NTS domains, trauma teams scored relatively poorly on communication across both T-NOTECHS (3.29$ \pm $0.61, maximum = 5) and NOTSS (2.87$ \pm $0.66, maximum = 4). We found significant differences in trauma team leaders' TTFF between teammates and the patient (Team: 1.56 vs Patient: 29.82 seconds, P < .001). TTFF on the diagnostic equipment was negatively correlated (P < .05) to multiple measures of subjective NTS assessments. There were no significant differences in AFD between AOIs, and AFD on teammates was positively correlated (P < .05) to communication and teamwork. There were significant differences in TPS across most AOI pairs (P < .05), and the average TPS fixated was highest on the patient (32%). Finally, there were several significant correlations between additional ET and NTS metrics.

CONCLUSIONS

This study utilized a mixed methods approach to assess trauma team leaders' NTS in simulated acute care trauma simulations. Our results provide several objective insights into trauma team leaders' NTS behaviors during patient care simulations. Such objective insights provide a more comprehensive understanding of NTS behaviors and can be leveraged to guide NTS training of trauma physicians in the future. More studies are needed to apply these methods to capture NTS from a larger sample of teams in both simulated and real trauma environments.

Light environment affects the efficiency of surgical suture training

BACKGROUND

Suture knotting is the basis of surgical skills. In the process of surgical skills learning, the surrounding environment, especially the light, will affect the efficiency of learning. This study investigated the effect of optical environment on the learning of stitching and knotting skills.

METHODS

A total of 44 medical students were randomly divided into four groups and participated in the study of suture knotting in four different optical environments. During the process, we assess objective pressure level by testing salivary amylase activity Likert scale and objective structured clinical examination (OSCE) was used to estimate the subjective psychological state and overall skill mastery in surgical suturing respectively.

RESULTS

Under high illumination conditions (700 lx), the salivary amylase activity of the high color temperature group (6000 K) was significantly higher than that of the low color temperature group (4000 K) (p < 0.0001). Similarly, under low illumination (300 lx), the salivary amylase activity of the high color temperature group was also significantly higher than that of the low color temperature group (p < 0.05). The student under high illumination conditions (700 lx) and the low color temperature (6000 K) have an autonomy score between 37-45, which is significantly higher compared to the other three groups (p < 0.0001). Group 2 has an average OSCE score of 95.09, which were significantly higher than those of the other three groups (p < 0.05).

CONCLUSION

High illumination combined with low color temperature is considered as the optimal training conditions, promoting trainees' optimism, reducing stress levels, and enhancing learning efficiency. These results highlight the pivotal role of light environment in improving the quality and efficiency of surgical skills training.

Effectiveness of immersive virtual reality in orthognathic surgical education: A randomized controlled trial

PURPOSE

To evaluate the efficacy of an iVR surgical training system for orthognathic surgery training in medical students.

METHODS

This study comprised 20 fifth year medical students who were randomly assigned to the VR or traditional group for orthognathic surgical education. All participants were initially provided a lecture on orthognathic surgery. The VR group then received 10 educational sessions using the self-developed iVR training system, whereas the traditional group received 10 sessions using technical manuals and annotated operation videos. These sessions were 40-min long in both the groups. Before the evaluation, the traditional group completed one session using the training and assessment modes to become familiar with the iVR training system. The score in the assessment mode, time to complete the procedure, number of instrument selection errors, number of prompts given by the system, number of positional and angular errors, and number of timeouts during each step were recorded to evaluate the learning effect.

RESULTS

The VR group achieved higher scores than the traditional group (94.67 vs. 87.65). Compared with the control group, the VR group completed the procedure more quickly, with fewer instrument selection and angular errors. No difference in the number of prompts given by the system was observed between the two groups.

CONCLUSIONS

The iVR surgical training system showed a better learning effect than the traditional learning method for orthognathic surgery. The iVR surgical training system may have utility as a supplement and potential substitute for the traditional surgical training method.

A Systematic Review of Immersive Virtual Reality for Nontechnical Skills Training in Surgery

OBJECTIVE

Immersive virtual reality (IVR) can be utilized to provide low cost and easily accessible simulation on all aspects of surgical education. In addition to technical skills training in surgery, IVR simulation has been utilized for nontechnical skills training in domains such as clinical decision-making and pre-operative planning. This systematic review examines the current literature on the effectiveness of IVR for nontechnical skill acquisition in surgical education.

DESIGN

A literature search was performed using MEDLINE, EMBASE, and Web of Science for primary studies published between January 1, 1995 and February 9, 2022. Four reviewers screened titles, abstracts, full texts, extracted data, and analyzed included studies to answer 5 key questions: How is IVR being utilized in nontechnical skills surgical education? What is the methodological quality of studies? What technologies are being utilized? What metrics are reported? What are the findings of these studies?

RESULTS

The literature search yielded 2340 citations, with 12 articles included for qualitative synthesis. Of included articles, 33% focused on clinical decision-making and 67% on anatomy/pre-operative planning. Motion sickness was a recorded metric in 25% of studies, with an aggregate incidence of 13% (11/87). An application score was reported in 33% and time to completion in 16.7%. A commercially developed application was utilized in 25%, while 75% employed a noncommercial application. The Oculus Rift was used in 41.7% of studies, HTC Vive in 25%, Samsung Gear in 16.7% of studies, Google Daydream in 8%, and 1 study did not report. The mean Medical Education Research Quality Instrument (MERSQI) score was 10.3 ± 2.3 (out of 18). In all studies researching clinical decision-making, participants preferred IVR to conventional teaching methods and in a nonrandomized control study it was found to be more effective. Averaged across all studies, mean scores were 4.33 for enjoyment, 4.16 for utility, 4.11 for usability, and 3.73 for immersion on a 5-point Likert scale.

CONCLUSIONS

The IVR nontechnical skills applications for surgical education are designed for clinical decision-making or anatomy/pre-operative planning. These applications are primarily noncommercially produced and rely upon a diverse array of HMDs for content delivery, suggesting that development is primarily coming from within academia and still without clarity on optimal utilization of the technology. Excitingly, users find these applications to be immersive, enjoyable, usable, and of utility in learning. Although a few studies suggest that IVR is additive or superior to conventional teaching or imaging methods, the data is mixed and derived from studies with weak design. Motion sickness with IVR remains a complication of IVR use needing further study to determine the cause and means of mitigation.

Eye-tracking in surgery: a systematic review

BACKGROUND

Surgery is constantly evolving with the assistance of rapidly developing novel technology. Eye-tracking devices provide opportunities to monitor the acquisition of surgical skills, gain insight into performance, and enhance surgical practice. The aim of this review was to consolidate the available evidence for the use of eye-tracking in the surgical disciplines.

METHODS

A systematic literature review was conducted in accordance with PRISMA guidelines. A search of OVID Medline, EMBASE, Cochrane library, Scopus, and Science Direct was conducted January 2000 until December 2022. Studies involving eye-tracking in surgical training, assessment and technical innovation were included in the review. Non-surgical procedures, animal studies, and studies not involving surgical participants were excluded from the review.

RESULTS

The search returned a total of 12 054 articles, 80 of which were included in the final analysis and review. Seventeen studies involved eye-tracking in surgical training, 48 surgical assessment, and 20 were focussing on technical aspects of this technology. Twenty-six different eye-tracking devices were used in the included studies. Metrics such as the number of fixations, duration of fixations, dwell time, and cognitive workload were able to differentiate between novice and expert performance. Eight studies demonstrated the effectiveness of gaze-training for improving surgical skill.

CONCLUSION

The current literature shows a broad range of utility for a variety of eye-tracking devices in surgery. There remains a lack of standardization for metric parameters and gaze analysis techniques. Further research is required to validate its use to establish reliability and create uniform practices.

Current Status of Simulation in Thoracic Surgical Training

BACKGROUND

Simulation is playing an increasingly important role in surgical training but is not yet a mandatory part of most surgical curricula. A simulator must undergo rigorous validation to verify it as a reliable tool. The aim of this study was to review the literature to identify simulators that are currently available to augment thoracic surgical training and to analyze any evidence supporting or validating them.

METHODS

A literature search of the MEDLINE (1946 to November 2022) and Embase (1947 to November 2022) databases was performed to identify simulators for basic skills and procedures in thoracic surgery. A selection of keywords were used to perform the literature search. After identification of appropriate articles, data were extracted and analyzed.

RESULTS

Thirty-three simulators were found in 31 articles. Simulators for basic skills (n = 13) and thoracic lobectomy (n = 13) were most commonly described, followed by miscellaneous (n = 7). Most models were of a hybrid modality (n = 18). Evidence of validity was established in 48.5% (n = 16) of simulators. In total, 15.2% (n = 5) of simulators had 3 or more elements of validity demonstrated, and only 3.0% (n = 1) accomplished full validation.

CONCLUSIONS

Numerous simulators of varying modality and fidelity exist for a variety of thoracic surgical skills and procedures, although validation evidence is frequently inadequate. Simulation models may be able to provide training in basic surgical and procedural skills; however, further assessment of validity needs to be undertaken before consideration of their integration into training programs.

Learning surgical knot tying and suturing technique - effects of different forms of training in a controlled randomized trial with dental students

Objective

The acquisition of surgical skills requires motor learning. A special form of this is intermanual transfer by transferring motor skills from the nondominant hand (NDH) to the dominant hand (DH). The purpose of this study was to determine the learning gains that can be achieved for the DH by training with the DH, the NDH, and by non-surgical alternative training (AT).

Methods

124 preclinical (n=62) and clinical (n=62) dental students completed surgical knot tying and suturing technique training with the DH, with the NDH, and an AT in a controlled randomized trial.

Results

A statistically significant learning gain in knot tying and suture technique with the DH was evident only after training with the DH when compared to training with the NDH (p<0.001 and p=0.004, respectively) and an AT (p=0.001 and p=0.010, respectively). Of those students who achieved a learning gain ≥4 OSATS points, 46.4% (n=32) benefited in their knot tying technique with the DH from training with the DH, 29.0% (n=20) from training with the NDH, and 24.6% (n=17) from an AT while 45.7% (n=32) benefited in their suturing technique with the DH from training with the DH, 31.4% (n=22) from training with the NDH, and 22, 9% (n=16) from an AT.

Conclusions

Training with the DH enabled significantly better learning gains in the surgical knot tying and suturing techniques with the DH.

Design and validation of a hemispherectomy simulator for neurosurgical education

OBJECTIVE

Early adaptors of surgical simulation have documented a translation to improved intraoperative surgical performance. Similar progress would boost neurosurgical education, especially in highly nuanced epilepsy surgeries. This study introduces a hands-on cerebral hemispheric surgery simulator and evaluates its usefulness in teaching epilepsy surgeries.

METHODS

Initially, the anatomical realism of the simulator and its perceived effectiveness as a training tool were evaluated by two epilepsy neurosurgeons. The surgeons independently simulated hemispherotomy procedures and provided questionnaire feedback. Both surgeons agreed on the anatomical realism and effectiveness of this training tool. Next, construct validity was evaluated by modeling the proficiency (task-completion time) of 13 participants, who spanned the experience range from novice to expert.

RESULTS

Poisson regression yielded a significant whole-model fit (χ2 = 30.11, p < 0.0001). The association between proficiency when using the training tool and the combined effect of prior exposure to hemispherotomy surgery and career span was statistically significant (χ2 = 7.30, p = 0.007); in isolation, pre-simulation exposure to hemispherotomy surgery (χ2 = 6.71, p = 0.009) and career length (χ2 = 14.21, p < 0.001) were also significant. The mean (± SD) task-completion time was 25.59 ± 9.75 minutes. Plotting career length against task-completion time provided insights on learning curves of epilepsy surgery. Prediction formulae estimated that 10 real-life hemispherotomy cases would be needed to approach the proficiency seen in experts.

CONCLUSIONS

The cerebral hemispheric surgery simulator is a reasonable epilepsy surgery training tool in the quest to increase preoperative practice opportunities for neurosurgical education.

The Third Dimension: 3D Printed Replicas and Other Alternatives to Cadaver-Based Learning

Capturing the 'third dimension' of complex human form or anatomy has been an objective of artists and anatomists from the renaissance in the fifteenth and sixteenth centuries onwards. Many of these drawings, paintings, and sculptures have had a profound influence on medical teaching and the learning resources we took for granted until around 40 years ago. Since then, the teaching of human anatomy has undergone significant change, especially in respect of the technologies available to augment or replace traditional cadaver-based dissection instruction. Whilst resources such as atlases, wall charts, plastic models, and images from the Internet have been around for many decades, institutions looking to reduce the reliance on dissection-based teaching in medical or health professional training programmes have in more recent times increasingly had access to a range of other options for classroom-based instruction. These include digital resources and software programmes and plastinated specimens, although the latter come with a range of ethical and cost considerations. However, the urge to recapitulate the 'third dimension' of anatomy has seen the recent advent of novel resources in the form of 3D printed replicas. These 3D printed replicas of normal human anatomy dissections are based on a combination of radiographic imaging and surface scanning that captures critical 3D anatomical information. The final 3D files can either be augmented with false colour or made to closely resemble traditional prosections prior to printing. This chapter details the journey we and others have taken in the search for the 'third dimension'. The future of a haptically identical, anatomically accurate replica of human cadaver specimens for surgical and medical training is nearly upon us. Indeed, the need for hard copy replicas may eventually be superseded by the opportunities afforded by virtual reality (VR) and augmented reality (AR).

Development of A Multi-Modality Navigational Based Training System for Fetoscopic Surgical Therapy

Fetal surgery is regarded as a technically difficult and new field of research, requiring the use of fetoscopic and ultrasound (US) navigation to perform minimally invasive procedures within the amniotic cavity. The Surgical Apprenticeship Training model (SAT) centres around the subjective assessment of a surgical resident's cognitive competency and technical skills under proctorship using opportunity-based environments. The restrictiveness and rarity of fetal procedures limit the effectiveness of the SAT model, resulting in a slow learning curve (LC) and higher procedural complication rates. This paper aimed to investigate the use of optical tracking technology to construct a novel simulated training system and accompanying scoring assessment under the Proficiency-Based Training model (PBT), providing real-time positional feedback of surgical tools and a quantitative feedback assessment of a surgical resident's technical skills. Clinical Relevance- Clinical feedback deemed the system as valid and confirmed that this novel approach to surgical training will significantly benefit smaller clinics that lack opportunity-based environments. Clinical feedback also suggested that the training system could be adapted to provide access to complex surgical training across the world.

VolumetricOR: A New Approach to Simulate Surgical Interventions in Virtual Reality for Training and Education

BACKGROUND

Surgical training is primarily carried out through observation during assistance or on-site classes, by watching videos as well as by different formats of simulation. The simulation of physical presence in the operating theatre in virtual reality might complement these necessary experiences. A prerequisite is a new education concept for virtual classes that communicates the unique workflows and decision-making paths of surgical health professions (i.e. surgeons, anesthesiologists and surgical assistants) in an authentic and immersive way. For this project, media scientists, designers and surgeons worked together to develop the foundations for new ways of conveying knowledge using virtual reality in surgery.

MATERIALS AND METHOD

A technical workflow to record and present volumetric videos of surgical interventions in a photorealistic virtual operating room was developed. Situated in the virtual reality demonstrator called VolumetricOR, users can experience and navigate through surgical workflows as if they are physically present. The concept is compared with traditional video-based formats of digital simulation in surgical training.

RESULTS

VolumetricOR let trainees experience surgical action and workflows (a) three-dimensionally, (b) from any perspective and (c) in real scale. This improves the linking of theoretical expertise and practical application of knowledge and shifts the learning experience from observation to participation.

DISCUSSION

Volumetric training environments allow trainees to acquire procedural knowledge before going to the operating room and could improve the efficiency and quality of the learning and training process for professional staff by communicating techniques and workflows when the possibilities of training on-site are limited.

Designing a synthetic simulator to teach open surgical skills for limb exploration in trauma: a qualitative study exploring the experiences and perspectives of educators and surgical trainees

Background

Simulation is an important adjunct to aid in the acquisition of surgical skills of surgical trainees. The simulators used to adequately enable trainees to learn, practice and be assessed in surgical skills need to be of the highest standards. This study investigates the perceived requirements of simulation and simulators used to acquire skills in limb exploratory procedures in trauma.

Methods

Semi-structured interviews were conducted with an international group of 11 surgical educators and 11 surgical trainees who had experience with surgical simulation. The interviews focused on the perceptions of simulation, the integration of simulators within a curriculum and the features of a simulator itself. Interviews were recorded, transcribed and underwent thematic analysis.

Results

Analysis of the perspectives of surgical educators and surgical trainees on simulated training in limb trauma surgery yielded three main themes: (1) Attitudes to simulation. (2) Implementing simulation. (3) Features of an open skills simulator. The majority felt simulation was relevant, intuitive and a good way for procedure warmup and the supplementation of surgical logbooks. They felt simulation could be improved with increased accessibility and variety of simulator options tailored to the learner. Suggested simulator features included greater fidelity, haptic feedback and more complex inbuilt scenarios. On a practical level, there was a desire for cost effectiveness, easy set up and storage. The responses of the educators and the trainees were similar and reflected similar concerns and suggestions for improvement.

Conclusion

There is a clear positive appetite for the incorporation of simulation into limb trauma training. The findings of this will inform the optimal requirements for high quality implementation of simulation into a surgical trauma curriculum and a reference to optimal features desired in simulator or task trainer design.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12893-021-01417-7.

A systematic review of methodological principles and delivery of surgical simulation bootcamps

BACKGROUND

The growth of "bootcamp style" simulation training in surgical practice has been exponential over the last decade. Developing and delivering a surgical bootcamp requires a significant investment. This systematic review aims to identify the key components that allow for a successful and rewarding surgical bootcamp course to be implemented that can be applied to all surgical specialities.

METHODS

To understand the surgical bootcamp principles and delivery mechanisms, we searched peer-reviewed, English language studies published between 2000 and 21.

RESULTS

From 137 articles, 14 studies with a Medical Education Research Quality Instrument Score of >11.5 were included. Most studies followed the core components; delivery at transition (12), mapping syllabus (13), multimodality delivery (14), and deliberate practice with formative feedback (12) apart from 1:1 training by only 2 studies.

CONCLUSIONS

Our review suggests that Surgical bootcamp can be an extremely useful education tool for trainees if 5 pillars of a boot camp are respected.

Recommendations for the use of coronary and valve simulators in cardiac surgical training: a systematic review

OBJECTIVES

The aim of this study was to systematically review the simulators that are currently available for coronary artery bypass graft and valve surgery and, in addition, to review the validation evidence supporting them and to recommend several simulators for training based on the analysis of results.

METHODS

A systematic literature search of the MEDLINE® (1946 to May 2021) and EMBASE® (1947 to May 2021) databases was performed to identify simulators for coronary artery and valvular procedures in cardiothoracic surgery. A selection of keywords and MeSH terms was used to execute the literature search. After identification of relevant articles, data were extracted and analysed.

RESULTS

Thirty-seven simulators were found in 31 articles. Simulators were found for coronary artery bypass graft (n = 24) and valve surgery (n = 13). The majority of models were either benchtop (n = 28) or hybrid (n = 8) modalities. Evidence of validity was demonstrated in 15 (40.5%) simulators. Twenty-two (59.5%) simulators had no validation evidence, and 1 (2.7%) simulator had 3 or more elements of validity established.

CONCLUSIONS

Two simulators were recommended for supplemental training in cardiothoracic surgery. Low-fidelity models can provide a broad foundation for surgical skills' development whereas high-fidelity simulators can be used for immersive training scenarios and appraisals. These should be utilized in early training, at which point the learning curve of trainees is steepest.

Immersive Virtual Reality for Surgical Training: A Systematic Review

BACKGROUND

Immersive virtual reality (iVR) simulators provide accessible, low cost, realistic training adjuncts in time and financially constrained systems. With increasing evidence and utilization of this technology by training programs, clarity on the effect of global skill training should be provided. This systematic review examines the current literature on the effectiveness of iVR for surgical skills acquisition in medical students, residents, and staff surgeons.

METHODS

A literature search was performed on MEDLINE, EMBASE, CENTRAL, Web of Science and PsycInfo for primary studies published between January 1, 2000 and January 26, 2021. Two reviewers independently screened titles, abstracts, and full texts, extracted data, and assessed quality and strength of evidence using the Medical Education Research Quality Instrument (MERSQI) and Cochrane methodology. Results were qualitatively synthesized, and descriptive statistics were calculated.

RESULTS

The literature search yielded 9650 citations, with 17 articles included for qualitative synthesis. The mean (SD) MERSQI score was 11.7 (1.9) out of 18. In total, 307 participants completed training in four disciplines. Immersive VR-trained groups performed 18% to 43% faster on procedural time to completion compared to control (pooled standardized mean difference = -0.90 [95% CI=-1.33 to -047, I²=1%, P < 0.0001]). Immersive VR trainees also demonstrated greater post-intervention scores on procedural checklists and greater implant placement accuracy compared to control.

CONCLUSIONS

Immersive VR incorporation into surgical training programs is supported by high-quality, albeit heterogeneous, studies demonstrating improved procedural times, task completion, and accuracy, positive user ratings, and cost-effectiveness.

A pilot study to evaluate the face & construct validity of an orthopaedic virtual reality simulator

AIMS

This study aimed to identify the face and construct validity of the Precision OS trauma module proximal femoral nail procedure. Secondary outcomes included perceived use of simulation in surgical training, with structured feedback from participants.

METHODS

A comparative interventional study was carried out in a regional orthopaedics trauma unit hospital. Volunteers were stratified into novice, intermediate and expert groups based on self-reported levels of experience. Each participant carried out a simulated proximal femoral nail on an immersive virtual platform following instruction on its use, with objective metrics such as time and x-rays, and novel metrics calculated by the simulation module recorded. Face validity was also assessed.

RESULTS

The proximal femoral nail module demonstrated construct validity. Kruskal Wallis test demonstrated a statistically significant difference across all group's novel performance (p=.018). Intermediate surgeons performed significantly better than novices (P=.022), with shorter procedural times (P=.018) Three of the intermediate group achieved the proficiency level set by the expert group, with no significant difference noted between these two groups (=.06). Time taken to completion for expert surgeons was less than intermediate group, although this did not reach significance (P=.19).

CONCLUSION

The proximal femoral nail module on the Precision OS platform demonstrated good face, and construct validity. Further research evaluating use of virtual platform simulation in surgical trauma training is needed.

Suturing Skills for Medical Students: A Systematic Review

AIM

This systematic review aimed to identify all published evidence on teaching suturing skills for medical students. We aimed to outline significant positive teaching outcomes and devise a comprehensive framework for the optimal teaching of suturing skills for medical students.

MATERIALS AND METHODS

We searched MEDLINE^® (via Ovid), EMBASE and SCOPUS databases until July 2019 with no language restriction using predefined 'Population, Intervention, Comparison, Outcome (PICO)' criteria. Data were summarised in discrete thematic axes using a qualitative synthesis approach.

RESULTS

Our search yielded a total of 2,562 articles, out of which 25 were included in the final data synthesis. We provide a structured breakdown of educational interventions including participants, instructors and nature of teaching intervention. We also describe discrete means for assessment of performance and retention of suturing skills. Based on those we propose a standardised framework on teaching suturing skills for novices.

CONCLUSION

To our knowledge this is the first systematic review investigating teaching interventions used to teach suturing skills in medical students. After extraction of individual positive teaching outcomes and utilising widely known learning theories and principles, we devised a comprehensive framework for more efficient and cost-effective teaching of suturing skills to medical students in the future.

A Training Simulator for Fractional Dilation and Curettage With Visualized Force-Position Feedback and Quantitative Evaluation

BACKGROUND

Dilation and curettage (D&C) is a basic, but important procedure with many applications in obstetrics and gynecology. Fractional D&C provides comprehensive sampling of the endocervix and subsequently the uterus. This study designs and validates a novel fractional D&C training simulator visualizing the intrauterine operation in real time and quantitatively assessing technical skills.

METHOD

The fractional D&C training simulator, consisting of measurement hardware and visual software, can display the curette tip's trajectory and force in the uterus in real time. The simulator also presents assessment indices (the cervical coverage index, cervical overlap index, uterine coverage index, uterine overlap index) to indicate the completion degree and quality of surgical performance.

EXPERIENCE

Seventy-five participants with three levels of D&C experience, including 26 novices, 24 intermediates, and 25 experts, were recruited to perform fractional D&C using the training simulator and asked to fill in a postprocedure questionnaire. All assessment indices of the novices were significantly lower than those of experienced surgeons (experts and intermediates) (P<.05). The simulator was highly regarded as a teaching tool and identified frequent areas of incomplete curettage even by experienced surgeons.

CONCLUSION

The fractional D&C training simulator provides valuable visualized force-position feedback and quantitative evaluation and may be beneficial for surgical training.

Factors relating to working hours restriction that have impacted the professional identity of trainees in the last decade

Ever-developing changes to the working hours of junior doctors by the European Working Time Directive, the junior doctor contract of 2019 and most recently the COVID-19 pandemic have impacted the professional identity of doctors. There has been little investigation into its influence on the multifaceted aspects of postgraduate medical training, which feeds into how trainees consider themselves professionally and the concept of professional identity or 'being a doctor'. A review of the medical, socio-political and educational literature reveals that the impact on the professional identity development of trainees is influenced by several perspectives from the trainee, trainer and the public. Gross reduction in working hours has no doubt decreased the raw volume of clinical experiences. However, to counteract this, smarter learning processes have evolved, including narrative reflection, supervised learning events, and a greater awareness of coaching and training among trainers.

Detection of adverse events leading to inadvertent injury during laparoscopic cholecystectomy using convolutional neural networks

Uncontrolled movements of laparoscopic instruments can lead to inadvertent injury of adjacent structures. The risk becomes evident when the dissecting instrument is located outside the field of view of the laparoscopic camera. Technical solutions to ensure patient safety are appreciated. The present work evaluated the feasibility of an automated binary classification of laparoscopic image data using Convolutional Neural Networks (CNN) to determine whether the dissecting instrument is located within the laparoscopic image section. A unique record of images was generated from six laparoscopic cholecystectomies in a surgical training environment to configure and train the CNN. By using a temporary version of the neural network, the annotation of the training image files could be automated and accelerated. A combination of oversampling and selective data augmentation was used to enlarge the fully labeled image data set and prevent loss of accuracy due to imbalanced class volumes. Subsequently the same approach was applied to the comprehensive, fully annotated Cholec80 database. The described process led to the generation of extensive and balanced training image data sets. The performance of the CNN-based binary classifiers was evaluated on separate test records from both databases. On our recorded data, an accuracy of 0.88 with regard to the safety-relevant classification was achieved. The subsequent evaluation on the Cholec80 data set yielded an accuracy of 0.84. The presented results demonstrate the feasibility of a binary classification of laparoscopic image data for the detection of adverse events in a surgical training environment using a specifically configured CNN architecture.

Feasibility of a telementoring approach as a practical training for transurethral enucleation of the benign prostatic hyperplasia using bipolar energy: a pilot study

Introduction

Telementoring is one of the applications of telemedicine capable of bringing highly experienced surgeons to areas lacking expertise. In the current study, we aimed to assess a novel telementoring application during the learning curve of transurethral enucleation of the prostate using bipolar energy (TUEB).

Material and methods

A telementoring system was developed by our engineering department. This application was used to mentor ten prospective cases of TUEB performed by an expert endourologist (novice to the TUEB). A questionnaire was filled by the operating surgeon and the mentor to provide subjective evaluation of the telementoring system. Finally, the outcomes of these patients were compared to a control group consisting of ten consecutive patients performed by the mentor.

Results

Ten consecutive TUEB were performed using this telementoring application. Delayed and interrupted connection were experienced in two and one patients, respectively; however, their effect was minor, and they did not compromise the safety of the procedure. None of the patients required conversion to conventional transurethral resection of the prostate. Only one patient in our series experienced grade IIIb complication.

Conclusion

The telementoring application for TUEB is promising. It is a simple and low-cost tool that could be a feasible option to ensure patients’ safety during the initial phase of the learning curve without time and locations constraints for both the mentor and the trainee; However, it should be mentioned that telementoring cannot yet replace the traditional surgical training with the mentor and trainee being in the operative room. Further studies are required to confirm the current results

Supplementary Information

The online version contains supplementary material available at 10.1007/s00345-021-03594-9.

Development and validation a task-specific checklist for a microsurgical varicocelectomy simulation model

PURPOSE

To develop and validate a new test of specific technical skills required for microsurgical varicocelectomy.

MATERIALS AND METHODS

An electronic questionnaire was sent to 558 members of the Brazilian Society of Urology for the validation of the task-specific checklist (TSC) for assessment of microsurgical varicocelectomy. Participants who had experience in this procedure were selected as judges. For construct validation, 12 participants including attending urologists and urological residents in training were recruited for voluntary participation. We formed a group of three experts and a group of nine novices, who had to perform the steps of microsurgical varicocelectomy on a simulation model using human placenta. Each participant was filmed and two blinded raters would then evaluate their performance using the TSC of microsurgical varicocelectomy.

RESULTS

14 judges were recruited. The assessment tool was reformulated, according to the judges suggestions and had the content validity achieved. The final version of the TSC was comprised of the task-specific score, a series of 4 items scored in a binary fashion designed for microscopic sub-inguinal varicocelectomy. The differences between the performance of participants with different levels of experience reflected the construct validity. The reliability between the raters was high. The mean time required to complete the training of microsurgical varicocelectomy in simulation model was significantly shorter for experts compared to novices (201 vs. 496 seconds, p=0.01).

CONCLUSIONS

This preliminary study suggests that the task-specific checklist of microsurgical varicocelectomy is reliable and valid in assessing microsurgical skills.

Validation of the Objective Structured Assessment of Technical Skill in Brasil

BACKGROUND

The aim of this study was to perform a cross-cultural adaptation of the Objective Structured Assessment of Technical Skill (OSATS) tool into Brazilian Portuguese and to determine its reproducibility and validity in Brasil.

METHODS

A Brazilian Portuguese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing, and then its validation. For the construct and the concurrent validities, twelve participants were divided into a group of six experts and six novices, who had to perform tasks on a simulation model using human placentas. Each participant was filmed, and two blinded raters would then evaluate their performance using the traditional subjective method and then the Brazilian Portuguese version of OSATS.

RESULTS

The Brazilian Portuguese version of OSATS had the face, content, construct, and concurrent validities achieved. The average experts' score and standard deviations were 34 and 0.894, respectively, for Judge 1 and 34.33 and 0.816 for Judge 2. In the case of novices, it was 13.33 and 2.388 for Judge 1 and 13.33 and 3.204 for Judge 2. The concordance between the judges was evident, with the Correlation Coefficient (Pearson) of 0.9944 with CI 95% between 0.9797 and 0.9985, with p < 10-10, evidencing the excellent reproducibility of the instrument.

CONCLUSION

This preliminary study suggests that the Brazilian Portuguese version of OSATS can reliably and validly assess surgical skills in Brasil.

Trauma Teams That Train as One Work as One: Invasive Procedure Training in Residency Education

BACKGROUND

Invasive surgical procedures occur infrequently in an emergency department setting; however, procedural competence is expected from trauma residents. Emergent procedures are challenging to train in a formal manner because of the urgent nature when they present. To supplement education, new and creative teaching tools such as simulation and multidisciplinary training are being used. Our study organized a multidisciplinary simulated learning workshop with surgery and emergency medicine residents for invasive, emergent procedures.

MATERIALS AND METHODS

In total, 14 surgical and 36 emergency medicine residents at our institution participated in a simulated learning experience. Ten workshops were organized, with six to seven residents participating in each session. Using a human cadaveric model, all residents were taught by senior-level residents and attendings from both specialties on how to perform uncommonly or anatomically challenging emergent invasive procedures. A pre- and post-laboratory survey was completed by all the residents to assess confidence in performing each of the 13 procedures.

RESULTS

All residents (N = 50), who participated in the study, completed pre- and post-laboratory surveys. Comparison of the pre- and post-laboratory confidence levels indicated significant increases in confidence in performing all procedures. Residents stated that this multidisciplinary approach to education in a controlled setting was helpful and fostered a collaborative relationship between both specialties.

CONCLUSIONS

Although some surgical procedures remain uncommon in the emergency department, competency is nevertheless expected for appropriate patient care. Using a collaborative simulation-based cadaver laboratory to teach emergent procedures significantly improved residents' confidence while concurrently fostering professional relationships.

Towards near real-time assessment of surgical skills: A comparison of feature extraction techniques

BACKGROUND AND OBJECTIVE

Surgical skill assessment aims to objectively evaluate and provide constructive feedback for trainee surgeons. Conventional methods require direct observation with assessment from surgical experts which are both unscalable and subjective. The recent involvement of surgical robotic systems in the operating room has facilitated the ability of automated evaluation of the expertise level of trainees for certain representative maneuvers by using machine learning for motion analysis. The features extraction technique plays a critical role in such an automated surgical skill assessment system.

METHODS

We present a direct comparison of nine well-known feature extraction techniques which are statistical features, principal component analysis, discrete Fourier/Cosine transform, codebook, deep learning models and auto-encoder for automated surgical skills evaluation. Towards near real-time evaluation, we also investigate the effect of time interval on the classification accuracy and efficiency.

RESULTS

We validate the study on the benchmark robotic surgical training JIGSAWS dataset. An accuracy of 95.63, 90.17 and 90.26% by the Principal Component Analysis and 96.84, 92.75 and 95.36% by the deep Convolutional Neural Network for suturing, knot tying and needle passing, respectively, highlighted the effectiveness of these two techniques in extracting the most discriminative features among different surgical skill levels.

CONCLUSIONS

This study contributes toward the development of an online automated and efficient surgical skills assessment technique.

Three-dimensional printing as a tool in otolaryngology training: a systematic review

OBJECTIVE

Three-dimensional printing is a revolutionary technology that is disrupting the status quo in surgery. It has been rapidly adopted by otolaryngology as a tool in surgical simulation for high-risk, low-frequency procedures. This systematic review comprehensively evaluates the contemporary usage of three-dimensional printed otolaryngology simulators.

METHOD

A systematic review of the literature was performed with narrative synthesis.

RESULTS

Twenty-two articles were identified for inclusion, describing models that span a range of surgical tasks (temporal bone dissection, airway procedures, functional endoscopic sinus surgery and endoscopic ear surgery). Thirty-six per cent of articles assessed construct validity (objective measures); the other 64 per cent only assessed face and content validity (subjective measures). Most studies demonstrated positive feedback and high confidence in the models' value as additions to the curriculum.

CONCLUSION

Whilst further studies supported with objective metrics are merited, the role of three-dimensional printed otolaryngology simulators is poised to expand in surgical training given the enthusiastic reception from trainees and experts alike.

Evidence in surgical training - a review

The first residency programs for surgical training were introduced in Germany in the late 1880s and adopted in 1889 by William Halsted in the United States [Cameron JL. William Stewart Halsted. Our surgical heritage. Ann Surg 1997;225:445-58.]. Since then, surgical education has evolved from a sheer volume of exposure to structured curricula, and at the moment, due to work time restrictions, surgical education is discussed on an international level. The reported effect of limited working hours on operative case volume has been variable [McKendy KM, Watanabe Y, Lee L, Bilgic E, Enani G, Feldman LS, et al. Perioperative feedback in surgical training: a systematic review. Am J Surg 2017;214:117-26.]. Experienced surgeons fear that residents do not have sufficient exposure to standard procedures. This may reduce the residents' responsibility for the treatment of the patient and even lead to a reduced autonomy at the end of the residency. Surgical education does not only require learning the technical skills but also human factors as well as interdisciplinary and interprofessional handling. When analyzing international surgical curricula, major differences even between countries of the European Union with more or less strict curricula can be found. Thus far, there is no study that analyzes the educational program of different countries, so there is no evidence which educational system is superior. There is also little evidence to distinguish the good from the average surgeon or the junior surgeons' progress during his residency training. Although some evaluation tools are already available, the lack of resources of most teaching hospitals often results in not using these tools as long it is not mandatory by a governmental program. Because of decreased working hours, increasing hospital costs, and increasing jurisdictional restrictions, teaching hospitals and teachers will have to change their sentiments and focus on their way of surgical education before governmental regulations will emerge leading to more regulation in surgical education. Some learning tools such as simulation, electronic learning, augmented reality, or virtual reality for a timely, sufficient and up to date surgical education. However, research and evidence for existing and novel learning tools will have to increase in the next years to allow surgical education for the future generation of surgeons around the world.

Trends in Retention and Decay of Basic Surgical Skills: Evidence from Addis Ababa University, Ethiopia: A Prospective Case-Control Cohort Study

INTRODUCTION

While prior studies have evaluated surgical skills simulation and retention in highly resourced environments, there is paucity of data on the retention of surgical skills taught in simulation laboratory to undergraduate students, and virtually none from low-resource settings. We aimed to evaluate the trends in retention/decay of surgical skills among medical students in Ethiopia and determine whether regular intervention in the form of intermittent skills testing can aid retention.

METHODS

Forty-four final year medical students were randomly divided into two cohorts of 22 students each. All 44 were trained in surgical instrument identification, simple interrupted suturing and one-handed knot tying. A previously validated, standardized assessment was performed before training, immediately after training, and then at 6 weeks, 3 months, 6 months and 1 year for cohort 1, and before training, immediately after training, and at 6 months and 1 year for cohort 2. All areas learned were tested for general decay.

RESULTS

The baseline mean scores of surgical skills were 3.8/30 for instrument identification, 3.3/15 for one-handed knot tying, and 1.35/15 for suturing. At the end of the training, mean scores improved to 26.6/30, 11.2/15 and 11.1/15 (instrument identification +599% and +772%, knot tying +447% and +417%, suturing +237% and +260%, respectively, for Cohort I and II). At 6 months and 1 year, there was a significant drop in all the three areas tested, especially in knot tying and suturing. There was no statistically significant difference between the two cohorts.

CONCLUSIONS

While our surgical skills course is an effective means to teach surgical skills to medical students, there is significant decay in abilities after 6 months. Conducting regular assessments does not appear to have any effect in helping students retain these skills. We recommend such surgical skills training be conducted at appropriate intervals, such as just before internship, to prepare student for active surgical practice.

An automatic skill evaluation framework for robotic surgery training

BACKGROUND

To provide feedback to surgeons in robotic surgery training, many surgical skill evaluation methods have been developed. However, they hardly focus on the performance of the surgical motion segments. This paper proposes a method of specifying a trainee's skill weakness in the surgical training.

METHODS

This paper proposed an automatic skill evaluation framework by comparing the trainees' operations with the template operation in each surgical motion segment, which is mainly based on dynamic time warping (DTW) and continuous hidden Markov model (CHMM).

RESULTS

The feasibility of this proposed framework has been preliminarily verified. For specifying the skill weakness in instrument handling and efficiency, the result of this proposed framework was significantly correlated with that of manual scoring.

CONCLUSION

The automatic skill evaluation framework has shown its superiority in efficiency, objectivity, and being targeted, which can be used in robotic surgery training.

What Is the Influence of Simulation-Based Training Courses, the Learning Curve, Supervision, and Surgeon Volume on the Outcome in Hernia Repair?-A Systematic Review

Introduction: In hernia surgery, too, the influence of the surgeon on the outcome can be demonstrated. Therefore the role of the learning curve, supervised procedures by surgeons in training, simulation-based training courses and surgeon volume on patient outcome must be identified. Materials and Methods: A systematic search of the available literature was carried out in June 2018 using Medline, PubMed, and the Cochrane Library. For the present analysis 81 publications were identified as relevant. Results: Well-structured simulation-based training courses was found to be associated with a reduced perioperative complication rate for patients operated on by trainees. Open as well as, in particular, laparo-endoscopic hernia surgery procedures have a long learning curve. Its negative impact on the patient can be virtually eliminated through consistent supervision by experienced hernia surgeons. However, this presupposes availability of an adequate trainee caseload and of well-trained hernia surgeons and calls for a certain degree of centralization in hernia surgery. Conclusion: Training courses, learning curve, supervision, and surgeon volume are important aspects in training and outcomes in hernia surgery.

A Vascular Anastomosis Simulation Can Provide a Safe and Effective Environment for Resident Skills Development

OBJECTIVE

Vascular anastomoses are complex surgical procedures, performed in time-sensitive circumstances, making intraoperative teaching more challenging. We sought to evaluate whether a vascular anastomosis simulation was effective in developing resident skills.

DESIGN, SETTING, PARTICIPANTS

General surgery residents participated in a vascular anastomosis simulation for 1 to 2hours during their transplant rotation. An attending transplant surgeon at the University of Colorado guided the resident through end-to-end and end-to-side anastomoses using bovine carotid artery (Artegraft). The residents completed a presimulation and postsimulation survey which quantitated their confidence. They also completed the MiSSES scale, which assessed the validity of the simulation.

RESULTS

Twenty residents participated in the simulation and completed the surveys. The residents reported increased understanding in how to set up an end-to-end anastomosis and an end-to-side anastomosis (p = 0.001 and p = 0.009, respectively). They reported increased ability to suture, forehand and backhand with a Castro-Viejo needle driver (both p < 0.001). The residents reported increased ability to manipulate the needle (p = 0.006), and increased ability to manipulate tissue without causing trauma (p = 0.021). They reported increased confidence in tying a surgical knot with 6-0 Prolene and in operating while wearing loupes (p = 0.002, and p < 0.001, respectively). Overall, the residents reported increased confidence when asked to perform part of a vascular anastomosis in the operating room (p < 0.001). Seventeen residents completed the MiSSES scale with median scores of "somewhat agree" to "strongly agree" on all domains of the scale.

CONCLUSIONS

The use of a simple, inexpensive vascular anastomosis simulation is an effective and safe environment to improve residents' surgical skills and the residents felt that the simulation was valid.

Methodological shortcomings in the literature evaluating the role and applications of 3D training for surgical trainees

AIM

There has been an increased interest in the use of three-dimensional (3D) technology in surgical training. We wish to appraise the methodological rigor applied to evaluating the role and applications of 3D technology in surgical training, in particular, on the validity of these models and assessment methods in simulated surgical training.

METHODS

Literature search was performed using MEDLINE with the following terms: "3D"; "surgery"; and "training". Only studies evaluating the role of 3D technology in surgical training were eligible for inclusion and assessed for the level of evidence, validity of the simulation model, and assessment method used.

RESULTS

A total of 93 studies were analyzed, and majority of reviewed articles focused on 3D displays (36) and 3D printing (35). Most of these studies were case series, the most common assessment was subjective (69), with objective assessment used by 57 studies. Very few studies provided evidence for validity of the model or the assessment methods used.

CONCLUSIONS

3D technology has a great potential in simulated surgical training. However, the validity of this technology and strong evidence for its beneficial effects in surgical training is lacking. Further work on validation of 3D technology and assessment tools is needed.

Construct Validity, Assessment of the Learning Curve, and Experience of Using a Low-Cost Arthroscopic Surgical Simulator

OBJECTIVE

We have developed a low-cost, portable shoulder simulator designed to train basic arthroscopic skills. This study aimed to establish the construct validity of the simulator by determining which parameters discriminated between experience levels and to assess the experience of using the simulator.

DESIGN

Participants were given an introductory presentation and an untimed practice run of a 6-step triangulation task using hooks and rubber bands. A total of 6 consecutive attempts at the task were timed, and the number of times the participant looked at their hands during the task was recorded. Participants then completed a questionnaire on their experience of using the simulator.

SETTING

St George's Hospital, London and the South West London Elective Orthopaedic Centre, Surrey.

PARTICIPANTS

Medical students, trainee doctors and surgeons, and consultant surgeons were approached to use the simulator. Participation was voluntary and nonincentivized. In total, 7 orthopedic consultants, 12 trainee doctors (ranging from foundation year 1 to clinical fellow post-Certificate of Completion of Training), and 9 medical students were recruited.

RESULTS

The average time for medical students to complete the task was 161 seconds, compared to 118 seconds for trainees, and 84 seconds for consultants. The average fastest time for medical students was 105 seconds, 73 seconds for trainees, and 52 seconds for consultants. Students were significantly slower than trainees (p = 0.026) and consultants (p = 0.001). However, times did not differ significantly between trainees and consultants. Consultants looked at their hands 0.7 times on average during the task compared with 2.8 and 3.4 times for trainees and students, respectively. More than 95% of participants found the exercise interesting and agreed or strongly agreed that the simulator was easy to use, easily portable, and well designed and constructed.

DISCUSSION

This study has established construct validity of the simulator by demonstrating the ability to distinguish between surgical experience levels. The learning curve shows improvement in individuals with or without arthroscopic or surgical experience. Simulation is becoming increasingly important in the training of medical students and surgical trainees; this study has established that low-cost portable arthroscopic box trainers may play a significant role.

Achieving Interface and Environment Fidelity in the Virtual Basic Laparoscopic Surgical Trainer

Virtual reality trainers are educational tools with great potential for laparoscopic surgery. They can provide basic skills training in a controlled environment and free of risks for patients. They can also offer objective performance assessment without the need for proctors. However, designing effective user interfaces that allow the acquisition of the appropriate technical skills on these systems remains a challenge. This paper aims to examine a process for achieving interface and environment fidelity during the development of the Virtual Basic Laparoscopic Surgical Trainer (VBLaST). Two iterations of the design process were conducted and evaluated. For that purpose, a total of 42 subjects participated in two experimental studies in which two versions of the VBLaST were compared to the accepted standard in the surgical community for training and assessing basic laparoscopic skills in North America, the FLS box-trainer. Participants performed 10 trials of the peg transfer task on each trainer. The assessment of task performance was based on the validated FLS scoring method. Moreover, a subjective evaluation questionnaire was used to assess the fidelity aspects of the VBLaST relative to the FLS trainer. Finally, a focus group session with expert surgeons was conducted as a comparative situated evaluation after the first design iteration. This session aimed to assess the fidelity aspects of the early VBLaST prototype as compared to the FLS trainer. The results indicate that user performance on the earlier version of the VBLaST resulting from the first design iteration was significantly lower than the performance on the standard FLS box-trainer. The comparative situated evaluation with domain experts permitted us to identify some issues related to the visual, haptic and interface fidelity on this early prototype. Results of the second experiment indicate that the performance on the second generation VBLaST was significantly improved as compared to the first generation and not significantly different from that of the standard FLS box-trainer. Furthermore, the subjects rated the fidelity features of the modified VBLaST version higher than the early version. These findings demonstrate the value of the comparative situated evaluation sessions entailing hands on reflection by domain experts to achieve the environment and interface fidelity and training objectives when designing a virtual reality laparoscopic trainer. This suggests that this method could be used successfully in the future to enhance the value of VR systems as an alternative to physical trainers for laparoscopic surgery skills. Some recommendations on how to use this method to achieve the environment and interface fidelity of a VR laparoscopic surgical trainer are identified.

Simulation for Percutaneous Renal Access: Where Are We?

OBJECTIVES

Percutaneous renal access (PCA) is a challenging step during percutaneous nephrolithotomy. The aim of this study is to review the literature for different types of simulators described for PCA.

METHODS

Databases of Medline, Embase, Cochrane Library, OvidSP, and Google Scholar were systematically searched until May 2016. The studies were analyzed regarding the type of simulator (nonbiologic, biologic, live animal, and virtual reality [VR]), type of validity (face, content, construct, and predictive), cost-effectiveness, and whether these simulators have been used for training and/or assessment of PCA. In addition, the study looked at the educational impact of these simulators in terms of the transfer of PCA skills to the operating room.

RESULTS

Several bench, animal, and VR simulators for training in PCA were identified. Only few studies were found on assessment of PCA skills. Biological bench models used porcine or bovine kidneys wrapped within foam, silicone, chicken carcass, or full-thickness skin flap alone. Other biological models used additional subcutaneous fascia, muscle, or ribs. Nonbiological models used prototypes, including 3D printing. Only one study reported the use of anesthetized live pig for training. The PERC Mentor™ was the only VR simulator, which has been validated for training and assessment of PCA skills. However, none of these studies assessed the educational impact of PCA simulators. Furthermore, most of the studies did not address the validity and the cost of the simulator.

CONCLUSIONS

While several biological and nonbiological PCA models exist, there is paucity of literature regarding the validity and educational impact of these simulators. The PERC Mentor simulator is the sole validated simulator for training and assessment of PCA skills. However, it is expensive and there is little evidence of its educational impact. Therefore, more research is needed to validate the available simulators and assess their educational impact for urology trainees.

Simulation for endocrine surgery training: a call to action

The approach to surgical education has undergone metamorphosis in the last two decades. The mantra, ‘see one, do one, teach one’ has been replaced colloquially with ‘see one, simulate many deliberately, do one’. Simulation has become an integral part of surgical training across many specialties. A large amount of resources, time and expertise have been devoted to the development and study of simulation's role for surgical mastery and improved patient outcomes. Despite significant advances, there is still much to be learned. Many specialties, such as endocrine surgery, are yet to contribute to this effort. Herein, we assess the state of simulation in endocrine surgery and call for experts in the field to unite and join the simulation movement.

The role of multimedia in surgical skills training and assessment

INTRODUCTION

Multimedia is an educational resource that can be used to supplement surgical skills training. The aim of this review was to determine the role of multimedia in surgical training and assessment by performing a systematic review of the literature.

METHODS

A systematic review for published articles was conducted on the following databases: PubMed/MEDLINE (1992 to November 2014), SCOPUS (1992 to November 2014) and EMBASE (1992 to November 2014). For each study the educational content, study design, surgical skill assessed and outcomes were recorded. A standard data extraction form was created to ensure systematic retrieval of relevant information.

RESULTS

21 studies were included; 14 randomized controlled trials (RCTs) and 7 non-randomized controlled trials (Non-RCTs). Technical skills were assessed in 7 RCTs and 3 non-RCTs; cognitive skills were assessed in 9 RCTs and 4 non-RCTs. In controlled studies, multimedia was associated with significant improvement in technical skills (4 studies; 4 RCTs) and cognitive skills (7 studies; 6 RCTs). In two studies multimedia was inferior in comparison to conventional teaching. Evaluation of multimedia (9 studies) demonstrated strongly favourable results.

CONCLUSIONS

This review suggests that multimedia effectively facilitates both technical and cognitive skills acquisition and is well accepted as an educational resource.