Effectiveness of telesimulation for pediatric minimally invasive surgery essential skills training

Comparison of distance versus in-person laparoscopy training using a low-cost laparoscopy simulator-a randomized controlled multi-center trial

INTRODUCTION

Simulation training programs are essential for novice surgeons to acquire basic experience to master laparoscopic skills. However, current state-of-the-art laparoscopy simulators are still expensive, limiting the accessibility to practical training lessons. Furthermore, training is time intensive and requires extensive spatial capacity, limiting its availability to surgeons. New laparoscopic simulators offer a cost-effective alternative, which can be used to train in a digital environment, allowing flexible, digital and personalized laparoscopic training. This study investigates if training on low-cost simulators in a digital environment is comparable to in-person training formats.

MATERIALS AND METHODS

From June 2023 to December 2023, 40 laparoscopic novices participated in this multi-center, prospective randomized controlled trial. All participants were randomized to either the ‟distance" (intervention) or the "in-person" (control) group. They were trained in a standardized laparoscopic training curriculum to reach a predefined level of proficiency. After completing the curriculum, participants performed four different laparoscopic tasks on the ForceSense system. Primary endpoints were overall task errors, the overall time for completion of the tasks, and force parameters.

RESULTS

In total, 40 laparoscopic novices completed digital or in-person training. Digital training showed no significant differences in developing basic laparoscopic skills compared to in-person training. There were no significant differences in median overall errors between both training groups for all exercises combined (intervention 3 vs. control 4; p value = 0.74). In contrast, the overall task completion time was significantly lower for the group trained digitally (intervention 827.92 s vs. control 993.42; p value = 0.015). The applied forces during the final assessment showed no significant differences between both groups for all exercises. Overall, over 90% of the participants rated the training as good or very good.

CONCLUSION

Our study shows that students that underwent digital laparoscopic training completed tasks with a similar number of errors but in a shorter time than students that underwent in-person training. Nevertheless, the best strategies to implement such digital training options need to be evaluated further to support surgeons' personal preferences and expectations.

Results of a Novel Long-Term Method for Laparoscopic Skills Online Training

Introduction: Ensuring patient safety in minimally invasive surgery (MIS) within the field of pediatric surgery requires systematic and extensive practice. Many groups have proposed mastery learning programs encompassing a range of training methods. However, short courses often have a narrow focus on specific objectives, limiting opportunities for sustained training. Our aim was to analyze our results with an online long-term competency-based and supervised training. Methods: This is a retrospective cohort study with prospective data collection of scores and performance of trainees during online courses from October 2020 to April 2023. Results: All participants (n = 76) were able to set up their personal training gym and complete the intensive stage of the course. The total score evolved from 2.60 ± 0.56 at the first meeting to 3.67 ± 0.61 at the fourth meeting, exhibiting a significant difference (P < .013). A considerable drop out was observed in the follow-up stage, with only 53.8% of the participants completing the course. When compared with the first meeting, they also showed a significant improvement with a mean general score of 3.85 ± 0.25 (P < .013) Conclusion: We have presented a novel online training program, based on continuous training that demonstrated that the unlimited access to a personal training gym allows surgeons to improve and maintain MIS skills.

Structured feedback and operative video debriefing with critical view of safety annotation in training of laparoscopic cholecystectomy: a randomized controlled study

BACKGROUND

The learning curve in minimally invasive surgery (MIS) is lengthened compared to open surgery. It has been reported that structured feedback and training in teams of two trainees improves MIS training and MIS performance. Annotation of surgical images and videos may prove beneficial for surgical training. This study investigated whether structured feedback and video debriefing, including annotation of critical view of safety (CVS), have beneficial learning effects in a predefined, multi-modal MIS training curriculum in teams of two trainees.

METHODS

This randomized-controlled single-center study included medical students without MIS experience (n = 80). The participants first completed a standardized and structured multi-modal MIS training curriculum. They were then randomly divided into two groups (n = 40 each), and four laparoscopic cholecystectomies (LCs) were performed on ex-vivo porcine livers each. Students in the intervention group received structured feedback after each LC, consisting of LC performance evaluations through tutor-trainee joint video debriefing and CVS video annotation. Performance was evaluated using global and LC-specific Objective Structured Assessments of Technical Skills (OSATS) and Global Operative Assessment of Laparoscopic Skills (GOALS) scores.

RESULTS

The participants in the intervention group had higher global and LC-specific OSATS as well as global and LC-specific GOALS scores than the participants in the control group (25.5 ± 7.3 vs. 23.4 ± 5.1, p = 0.003; 47.6 ± 12.9 vs. 36 ± 12.8, p < 0.001; 17.5 ± 4.4 vs. 16 ± 3.8, p < 0.001; 6.6 ± 2.3 vs. 5.9 ± 2.1, p = 0.005). The intervention group achieved CVS more often than the control group (1. LC: 20 vs. 10 participants, p = 0.037, 2. LC: 24 vs. 8, p = 0.001, 3. LC: 31 vs. 8, p < 0.001, 4. LC: 31 vs. 10, p < 0.001).

CONCLUSIONS

Structured feedback and video debriefing with CVS annotation improves CVS achievement and ex-vivo porcine LC training performance based on OSATS and GOALS scores.

Educational Effectiveness of Telementoring as a Continuing Professional Development Intervention for Surgeons in Practice: A Systematic Review

Objective

We performed a systematic review to determine the educational effectiveness of telementoring as a continuing professional development (CPD) intervention for surgeons in practice.

Background

Surgeons can mentor their peers in remote locations using videoconferencing communication, referred to as telementoring.

Methods

We searched MEDLINE and EMBASE and included studies assessing the educational effectiveness of telementoring interventions used by surgeons in practice. We excluded studies involving only trainees and those not evaluating educational effectiveness. Two reviewers independently screened, extracted data, and assessed study quality using the Medical Education Research Study Quality Instrument (MERSQI; maximum score 18). Educational outcomes were categorized using Moore's Outcomes Framework.

Results

We retrieved a total of 1351 records, and 252 studies were selected for full-text review. Twenty-eight studies were included with 1 randomized controlled trial, 19 cohort studies, 5 qualitative studies, and 3 case studies, totaling 178 surgeons and 499 cases. The average MERSQI score was 10.21 ± 2.2 out of 18. Educational outcomes included surgeons' satisfaction with telementoring interventions (Moore's Level 2) in 12 studies, improvement in surgeons' procedural knowledge (Level 3b) in 3 studies, improvements in surgeons' procedural competence in an educational setting (Level 4) in 4 studies, performance in a workplace-based setting (Level 5) in 23 studies, and patient outcomes (Level 6) in 3 studies. No studies reported community health outcomes (Level 7).

Conclusions

Moderate-level evidence demonstrates the use of telementoring as effective in changing surgeons' knowledge and competence in both educational and workplace-based settings. Its use is also associated with changes in patient outcomes.

Comparative effectiveness of telesimulation versus standard simulation for pediatric Minimally Invasive Surgery (MIS) essential skills training

BACKGROUND

Proctored on site simulation-based surgical education has been integrated in our residents curricula since 2012. Due to COVID-19 pandemic and social distance protocols, we developed a Tele-assisted Essential Skills Training Module (T-ESTM). The aim of this study is to evaluate comparative effectiveness between Telesimulation (T) versus Standard Simulation (S) for minimally invasive surgery (MIS) essential skills training.

METHODS

ESTM includes academic lectures, tutorials for ergonomics and 7 hands-on tasks scheduled into 2 sessions of 3 hours. Initial and final assessment scoring (adapted from GOALS) as well as timing for 3 of the tasks were registered. Telesimulation (T) group accessed the content online and completed their Hands-On practice through a digital communication platform. Standard Simulation (S) group attended conferences and Hands-On practice at the simulation center. Both groups were proctored by the same educators with summative and formative feedback and debriefing. Data was analyzed with the R-studio software program.

RESULTS

Each group had 20 participants with a mean age of 28 ± 5 years. 67.5% were surgeons in training, 47.5% had performed low complexity procedures and 40% had previous experience with simulation training. We observed a significant improvement in scoring and time reduction for all assessed tasks in S and T groups (p < 0.001), with no statistically significant differences when comparing both groups. Similar performance could be achieved with both strategies.

CONCLUSION

Telesimulation is a reproducible and effective educational tool for remote MIS essential skills training, and should be considered as an alternative to on-site simulation programs.

LEVEL OF EVIDENCE

Level II.

TYPE OF STUDY

Clinical Research.

Use of virtual platform for delivery of simulation-based laparoscopic training curriculum in LMICs

BACKGROUND

Laparoscopic surgery is rapidly expanding in low-and middle-income countries (LMICs), yet many surgeons in LMICs have limited formal training in laparoscopy. In 2017, the Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) implemented Global Laparoscopic Advancement Program (GLAP), an in-person simulation-based laparoscopic training curriculum for surgeons in LMICs. In light of COVID-19, SAGES adapted GLAP to a virtual format with telesimulation. This study explores the feasibility and efficacy of virtual laparoscopic simulation training in resource-limited settings.

METHODS

Participants from San Jose, Costa Rica, Leon, México, and Guadalajara, México enrolled in the virtual GLAP curriculum, meeting biweekly for 2-h didactic classes and 2-h hands-on live simulation practice. Surgical residents' laparoscopic skills were evaluated using the five Fundamentals of Laparoscopic Surgery (FLS) tasks during the initial and final weeks of the program. Participants also completed pre-and post-program surveys assessing their perception of simulation-based training.

RESULTS

The study cohort consisted of 16 surgical attendings and 20 general surgery residents. A minimum 70% response rate was recorded across all surveys in the study. By the end of GLAP, residents completed all five tasks of the FLS exam within less time relative to their performance at the beginning of the training program (p < 0.05). Respondents (100%) reported that the program was a good use of their time and that education via telesimulation was easily reproduced. Participants indicated that the practice sessions, guidance, and feedback offered by mentors were their favorite elements of the training.

CONCLUSION

A virtual simulation-based curriculum can be an effective strategy for laparoscopic skills training. Participants demonstrated an improvement in laparoscopic skills, and they appreciated the mentorship and opportunity to practice laparoscopic skills. Future programs can expand on using a virtual platform as a low-cost, effective strategy for providing laparoscopic skills training to surgeons in LMICs.