Hysteroscopic Sterilization Using a Virtual Reality Simulator: Assessment of Learning Curve

Characteristics of hysteroscopic training models: A review of the literature

Objectives

The purpose of this review is to summarize the characteristics and applications of current hysteroscopic training models.

Methods

We conducted a systematic search of PubMed, Embase, and Cochrane Library for eligible studies published before March 2024. Manual screening of references and citation tracking were also performed.

Results

Reported hysteroscopic training models included virtual reality simulators, non-biological material models, plant tissue models, animal tissue models, and human tissue models. No training model was distinctly superior in terms of realism, haptic feedback, availability of standardized scoring of operations, preparation difficulty, reusability of surgical procedure, and prices. Utilizing any type of models for hysteroscopy simulation training could assist trainees in enhancing relevant knowledge, skills, self-confidence, and comfort, but virtual reality models had an advantage in training capacity.

Conclusions

Each hysteroscopic training model has its advantages and disadvantages. An appropriate training curriculum is needed to efficiently leverage the merits of different models. The realism and training effectiveness of various training models need to be compared using rigorously designed studies and standard evaluation tools.

Learning and Short-Term Retention of Simulation-Based Arthroscopic Skills

OBJECTIVE

The study aimed to examine the learning curve and short-term retention of arthroscopic skills acquired on a simulator.

DESIGN

Cohort study.

SETTING

Clinical Skills Training Center of Zhujiang Hospital of Southern Medical University PARTICIPANT AND METHODS: Orthopaedic residents (n = 14) without previous arthroscopy experience were included. After basic information was collected and an initial arthroscopy knowledge level test was administered, the subjects received standardised training on the simulator (day 1); then, they completed tasks on the simulator, including guided diagnostics (4 times), triangulation (5 times) and loose body removal (7 times). A learning curve for each skill was generated based on the total scores. The score of the last repetition of each task was the training level.

RESULTS

A total of 14 orthopedic residents were enrolled. All participants completed the training and testing. There was a learning curve over the course of training for all 3 arthroscopic skills (p < 0.001). On day 8 after the training, the mean score for guided diagnostics decreased from 49.9 to 48.9 (p = 0.001), and the retention rate was 97.8%. For triangulation, the mean total score decreased from 58.9 to 53.6 (p < 0.001), and the retention rate was 90.8%. For loose body removal, the mean total score decreased from 87.1 to 80.7 (p < 0.001), and the retention rate was 92.7%.

CONCLUSIONS

Orthopaedic residents' arthroscopic skills learned through simulator training declined significantly in 1 week after the training, especially more difficult skills.

Assessment of learning curves on a simulated neurosurgical task using metrics selected by artificial intelligence

OBJECTIVE

Understanding the variation of learning curves of experts and trainees for a given surgical procedure is important in implementing formative learning paradigms to accelerate mastery. The study objectives were to use artificial intelligence (AI)-derived metrics to determine the learning curves of participants in 4 groups with different expertise levels who performed a series of identical virtual reality (VR) subpial resection tasks and to identify learning curve differences among the 4 groups.

METHODS

A total of 50 individuals participated, 14 neurosurgeons, 4 neurosurgical fellows and 10 senior residents (seniors), 10 junior residents (juniors), and 12 medical students. All participants performed 5 repetitions of a subpial tumor resection on the NeuroVR (CAE Healthcare) platform, and 6 a priori-derived metrics selected using the K-nearest neighbors machine learning algorithm were used to assess participant learning curves. Group learning curves were plotted over the 5 trials for each metric. A mixed, repeated-measures ANOVA was performed between the first and fifth trial. For significant interactions (p < 0.05), post hoc Tukey's HSD analysis was conducted to determine the location of the significance.

RESULTS

Overall, 5 of the 6 metrics assessed had a significant interaction (p < 0.05). The 4 groups, neurosurgeons, seniors, juniors, and medical students, showed an improvement between the first and fifth trial on at least one of the 6 metrics evaluated.

CONCLUSIONS

Learning curves generated using AI-derived metrics provided novel insights into technical skill acquisition, based on expertise level, during repeated VR-simulated subpial tumor resections, which will allow educators to develop more focused formative educational paradigms for neurosurgical trainees.

To the Point: The expanding role of simulation in obstetrics and gynecology medical student education

This article, from the "To the Point" series prepared by the Association of Professors of Gynecology and Obstetrics (APGO) Undergraduate Medical Education Committee (UMEC), provides educators with an overview of the use of simulation in undergraduate medical education in the field of obstetrics and gynecology. Simulation plays an important role in the education of medical students. Students are increasingly serving as clinical observers and providing less direct patient care. Simulation can help standardize education and ensure quality and comparability across an enlarging educational environment. This article summarizes the expanding role of simulation in undergraduate medical education in obstetrics and gynecology and its effect on important learner outcomes such as confidence, knowledge, skills, workplace behaviors, and translation to patient care.

Simulation for Training and Assessment in Hysteroscopy: A Systematic Review

Hysteroscopy simulation complements conventional training on patients, yet evidence-based recommendations about its implementation and use are lacking. This systematic review analyzes and critically discusses hysteroscopy simulation literature published over the last 30 years. Systematic searches on PubMed, Embase, PsychINFO, ERIC, and the Cochrane Library produced 27 original articles published through 2017. Strategies based on different simulation models (e.g., animal organs, vegetables, synthetic uteri, virtual reality) were evaluated by users and appeared to facilitate learning. Observational studies have suggested a large impact on the knowledge and technical skills of novices for a wide range of hysteroscopic procedures, including for diagnosis, resection, and sterilization. Pretest/posttest studies show large improvements in performance time (6 studies; pooled effect size, 1.45; 95% confidence interval, 1.06-1.85) and overall performance scores (4 studies; pooled effect size, 3.19; 95% confidence interval, 1.45-4.94). Additionally, performance assessment on simulated models distinguishes novices from experts. Caution should be exercised because the available evidence largely originates from heterogeneous studies with weak designs, conducted in experimental settings with nonclinical participants (i.e., medical students). Moreover, neither clinical outcomes nor the clinical value of simulation-based assessment has been addressed. Hysteroscopy simulation may be supported ethically and pedagogically, but its role should be evaluated in pragmatic contexts, with robust interventional studies and broader competence-defining outcomes that include nontechnical skills.

Randomized trial of high- and low-fidelity simulation to teach intrauterine contraception placement

BACKGROUND

High-fidelity simulation creates conditions that resemble real circumstances, and can help teach procedures such as intrauterine contraception placement. Its impact on skill retention has not been studied.

OBJECTIVE

We sought to evaluate novice learners' skills, attitudes, and knowledge on placement of intrauterine contraception when trained using a high-fidelity commercially available simulator compared with a low-fidelity simulator.

STUDY DESIGN

We recruited senior nurse practitioner students and interns in obstetrics and gynecology and family medicine inexperienced with intrauterine contraception placement. In this unblinded, randomized controlled trial, participants were assigned to practice within a high-fidelity simulator group or a coasterlike model group. We evaluated intrauterine contraception placement skills, self-perceived comfort and competence, and knowledge before and after simulation, as well as at 3 months. Our primary outcome was the change in scores for intrauterine contraception placement skills before and after practice. Assuming a standard deviation of 15 points, we needed 10 participants per group to detect a 20-point difference in scores with 80% power.

RESULTS

From June through July 2014, 60 participants enrolled; 59 completed the initial study visit and 1 withdrew. In all, 48 (80%) completed the second study visit at 3 months. Demographic characteristics were similar for the randomization groups. We observed an improvement in intrauterine contraception placement skills for both groups following practice on simulators (P < .01); the proportion that improved was similar (20% for the high-fidelity simulator group and 15% for the coaster group, P = .55). Increases in self-perceived comfort and competence with placing copper, levonorgestrel 52-mg, and levonorgestrel 13.5-mg devices were similar (all P ≥ .11). Knowledge assessment scores were comparable between the 2 groups postsimulation (73% for the high-fidelity simulator group and 80% for the coaster group, P = .29) and at 3 months (87% for both groups, P = 1.0).

CONCLUSION

Trainees' knowledge, intrauterine contraception placement skills, and self-perceived comfort and competence were comparable whether they used high- or low-fidelity simulators.

Simulation training for family planning procedures

PURPOSE OF REVIEW

To review the current evidence for use of simulation in family planning procedural training.

RECENT FINDINGS

A variety of simulation models exist for abortion, contraception, and sterilization procedures, ranging from low to high fidelity. Most models for abortion and contraception are low fidelity, inexpensive, and provide opportunities for acquisition and practice of procedural skills. Hysteroscopic and laparoscopic simulation models for sterilization procedures are generally higher fidelity, and their use has been shown to increase knowledge, skill performance, and procedural comfort.

SUMMARY

Existing evaluation of family planning simulation education shows consistently positive results related to improved procedural knowledge and comfort. Although some studies have shown increased provision of family planning services following simulation-training interventions, further evaluation is needed to determine the impact on clinical outcomes.

Testing the Construct Validity of a Virtual Reality Hip Arthroscopy Simulator

PURPOSE

To test the construct validity of the hip diagnostics module of a virtual reality hip arthroscopy simulator.

METHODS

Nineteen orthopaedic surgeons performed a simulated arthroscopic examination of a healthy hip joint using a 70° arthroscope in the supine position. Surgeons were categorized as either expert (those who had performed 250 hip arthroscopies or more) or novice (those who had performed fewer than this). Twenty-one specific targets were visualized within the central and peripheral compartments; 9 via the anterior portal, 9 via the anterolateral portal, and 3 via the posterolateral portal. This was immediately followed by a task testing basic probe examination of the joint in which a series of 8 targets were probed via the anterolateral portal. During the tasks, the surgeon's performance was evaluated by the simulator using a set of predefined metrics including task duration, number of soft tissue and bone collisions, and distance travelled by instruments. No repeat attempts at the tasks were permitted. Construct validity was then evaluated by comparing novice and expert group performance metrics over the 2 tasks using the Mann-Whitney test, with a P value of less than .05 considered significant.

RESULTS

On the visualization task, the expert group outperformed the novice group on time taken (P = .0003), number of collisions with soft tissue (P = .001), number of collisions with bone (P = .002), and distance travelled by the arthroscope (P = .02). On the probe examination, the 2 groups differed only in the time taken to complete the task (P = .025) with no significant difference in other metrics.

CONCLUSIONS

Increased experience in hip arthroscopy was reflected by significantly better performance on the virtual reality simulator across 2 tasks, supporting its construct validity.

CLINICAL RELEVANCE

This study validates a virtual reality hip arthroscopy simulator and supports its potential for developing basic arthroscopic skills.

LEVEL OF EVIDENCE

Level III.

Operative and diagnostic hysteroscopy: A novel learning model combining new animal models and virtual reality simulation

CONTEXT

Hysteroscopy is one of the most common gynaecological procedure. Training for diagnostic and operative hysteroscopy can be achieved through numerous previously described models like animal models or virtual reality simulation. We present our novel combined model associating virtual reality and bovine uteruses and bladders.

STUDY DESIGN

End year residents in obstetrics and gynaecology attended a full day workshop. The workshop was divided in theoretical courses from senior surgeons and hands-on training in operative hysteroscopy and virtual reality Essure^® procedures using the EssureSim™ and Pelvicsim™ simulators with multiple scenarios. Theoretical and operative knowledge was evaluated before and after the workshop and General Points Averages (GPAs) were calculated and compared using a Student's T test.

RESULTS

GPAs were significantly higher after the workshop was completed. The biggest difference was observed in operative knowledge (0,28 GPA before workshop versus 0,55 after workshop, p<0,05). All of the 25 residents having completed the workshop applauded the realism an efficiency of this type of training. The force feedback allowed by the cattle uteruses gives the residents the possibility to manage thickness of resection as in real time surgery. Furthermore, the two-horned bovine uteruses allowed to reproduce septa resection in conditions close to human surgery CONCLUSION: Teaching operative and diagnostic hysteroscopy is essential. Managing this training through a full day workshop using a combined animal model and virtual reality simulation is an efficient model not described before.

Training and Assessment of Hysteroscopic Skills: A Systematic Review

OBJECTIVE

The aim of this systematic review was to identify studies on hysteroscopic training and assessment.

DESIGN

PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools.

RESULTS

A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%).

CONCLUSIONS

This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited.

[Contribution of a virtual hysteroscopic simulator in the learning of hysteroscopic myoma resection]

OBJECTIVES

Uterine myomas are a frequent pathology affecting 20% of women of reproductive age. Myomas induce abnormal uterine bleeding, pelvic pain and increase the risk of infertility and obstetrical complications. Symptomatic sub-mucosal myomas are classically treated by hysteroscopic resection. Simulation is a method of education and training. It could improve quality and security of cares. The aim of this study is to assess the interest of a hysteroscopic simulator for the resection of myoma by novice surgeons.

METHODS

Twenty medical students were recruited, in a prospective study, in august 2014. The virtual-reality simulator VirtaMed HystSim™ (VirtaMed AG, Zurich, Switzerland) was used to perform the hysteroscopic training. All students received a short demonstration of myoma resection. The practice consists of a submucous myoma type 0 resection. The procedure and the evaluation were performed before and after a specific training in hysteroscopic resection of sixty minutes long. The main outcome criteria were time for the resection before and after training. The second criteria were fluid quantity used, number of contact between optic and uterine cavity and uterine perforation.

RESULTS

Twenty students aged from 22 to 24 years were included. The time for the procedure was significantly reduced after training (170s versus 335s, P<0.01). There is the same for fluid quantity used (335 mL versus 717mL, P<0.01) and the number of contact between optic and uterine cavity (0.2 contact versus 3, P=0.012). No perforation occurred in the simulation.

CONCLUSION

The results suggest that hysteroscopic simulator enhances and facilitates hysteroscopic resection for novice surgeons.

Simulator training in fetoscopic laser surgery for twin-twin transfusion syndrome: a pilot randomized controlled trial

OBJECTIVE

To evaluate the effect of a newly developed training curriculum on the performance of fetoscopic laser surgery for twin-twin transfusion syndrome (TTTS) using an advanced high-fidelity simulator model.

METHODS

Ten novices were randomized to receive verbal instructions and either skills training using the simulator (study group; n = 5) or no training (control group; n = 5). Both groups were evaluated with a pre-training and post-training test on the simulator. Performance was assessed by two independent observers and comprised a 52-item checklist for surgical performance (SP) score, measurement of procedure time and number of anastomoses missed. Eleven experts set the benchmark level of performance. Face validity and educational value of the simulator were assessed using a questionnaire.

RESULTS

Both groups showed an improvement in SP score at the post-training test compared with the pre-training test. The simulator-trained group significantly outperformed the control group, with a median SP score of 28 (54%) in the pre-test and 46 (88%) in the post-test vs 25 (48%) and 36 (69%), respectively (P = 0.008). Procedure time decreased by 11 min (from 44 to 33 min) in the study group vs 1 min (from 39 to 38 min) in the control group (P = 0.69). There was no significant difference in the number of missed anastomoses at the post-training test between the two groups (1 vs 0). Subsequent feedback provided by the participants indicated that training on the simulator was perceived as a useful educational activity.

CONCLUSIONS

Proficiency-based simulator training improves performance, indicated by SP score, for fetoscopic laser therapy. Despite the small sample size of this study, practice on a simulator is recommended before trainees carry out laser therapy for TTTS in pregnant women.

Validation of the VBLaST: A Virtual Peg Transfer Task in Gynecologic Surgeons

STUDY OBJECTIVE

To validate the Virtual Basic Laparoscopic Skill Trainer (VBLaST-PT; the peg transfer task) for concurrent validity based on its ability to differentiate between novice, intermediate, and expert groups of gynecologists, and the gynecologists' subjective preference between the physical Fundamentals of Laparoscopic Surgery (FLS) system and the virtual reality system.

DESIGN

Prospective study (Canadian Task Force II-2).

SETTING

Academic medical center.

PARTICIPANTS

Obstetrics and gynecology residents (n = 18) and attending gynecologists (n = 9).

INTERVENTIONS

Twenty-seven subjects were divided into 3 groups: novices (n = 9), intermediates (n = 9), and experts (n = 9). All subjects performed 10 trials of the peg transfer on each simulator. Assessment of laparoscopic performance was based on FLS scoring, whereas a questionnaire was used for subjective evaluation.

MEASUREMENTS AND MAIN RESULTS

The performance scores in the 2 simulators were nearly identical. Experts performed better than intermediates and novices in both the FLS trainer and the VBLAST, and intermediates performed better than novices in both simulators. The results also show a significant learning effect on both trainers for all subgroups; however, the greatest learning effect was in the novice group for both trainers. Subjectively, 74% participants preferred the FLS over the VBLaST for training laparoscopic surgical skills.

CONCLUSION

This study demonstrates that the peg transfer task was reproduced well in the VBLaST in gynecologic surgeons and trainees. The VBLaST has the potential to be a valuable tool in laparoscopic training for gynecologic surgeons.