Virtual Interactive Surgical Skills Classroom: A Parallel-group, Non-inferiority, Adjudicator-blinded, Randomised Controlled Trial (VIRTUAL)

The use of household items to support online surgical knot-tying skills training: a mixed methods study

BACKGROUND

This study investigated the perceptions and performance of medical students regarding their engagement and learning of a knot-tying skill presented in an online demonstration format due to the emergency remote measures that accompanied COVID-19 restrictions.

METHODS

Final-year undergraduate medical students were invited to view an online demonstration of a one-handed knot-tying skill and practice the skill using common household items. They recorded their attempts and uploaded them onto the Flipgrid application. Completed attempts were scored using an adapted Objective Structured Assessment of Technical Skill (OSATS) validated tool. We used a mixed-methods sequential explanatory design; data regarding students' engagement was gathered via a short questionnaire, and a Focus Group Discussion (FGD) was conducted to understand their learning experiences better. Descriptive statistics such as proportions and percentages were used to summarize categorical variables and median for continuous variables. Each video attempt was scored independently by two surgeons; reliability was determined using intraclass correlation; statistical tests were conducted at a 5% level of significance. Responses to open-ended survey questions and qualitative data from the FGDs were analysed using thematic analysis.

RESULTS

Seventy-one students participated in the exercise. Most students (91.5%) expressed confidence in their ability to perform the skill and were able to follow the steps in the video demonstration (83.1%). Median number of times needed to practice before video submission was 7.0 (Interquartile range [IQR] 5.0-10.0). Using the adapted OSATS tool; median scores on student attempts were 19.0 out of 21 (IQR: 17.0-20.0) for Assessor 1 and 18.0 out of 21 (IQR: 17.0-20.0) for Assessor 2, and overall scores showed good reliability between assessors based on intraclass correlation (0.86, 95% CI 0.79-0.90, p < 0.001). Qualitative insights from the students' experiences in learning the skill were generally positive; it was a practical, experiential learning process and they valued the social aspects of learning via Flipgrid. Challenges expressed related to the need for in-person training and formal feedback on how to improve their technique. Suggestions to improve their learning included a request for an interactive session with immediate feedback on attempts, and being able to practice with a friend who would assist with videoing.

CONCLUSION

Basic knot-tying can be taught with acceptable efficiency and student satisfaction using online methods with items available at home.

Utilising an accelerated Delphi process to develop consensus on the requirement and components of a pre-procedural core robotic surgery curriculum

Robot-assisted surgery (RAS) continues to grow globally. Despite this, in the UK and Ireland, it is estimated that over 70% of surgical trainees across all specialities have no access to robot-assisted surgical training (RAST). This study aimed to provide educational stakeholders guidance on a pre-procedural core robotic surgery curriculum (PPCRC) from the perspective of the end user; the surgical trainee. The study was conducted in four Phases: P1: a steering group was formed to review current literature and summarise the evidence, P2: Pan-Specialty Trainee Panel Virtual Classroom Discussion, P3: Accelerated Delphi Process and P4: Formulation of Recommendations. Forty-three surgeons in training representing all surgical specialties and training levels contributed to the three round Delphi process. Additions to the second- and third-round surveys were formulated based on the answers and comments from previous rounds. Consensus opinion was defined as ≥ 80% agreement. There was 100% response from all three rounds. The resulting formulated guidance showed good internal consistency, with a Cronbach alpha of > 0.8. There was 97.7% agreement that a standardised PPCRC would be advantageous to training and that, independent of speciality, there should be a common approach (95.5% agreement). Consensus was reached in multiple areas: 1. Experience and Exposure, 2. Access and context, 3. Curriculum Components, 4 Target Groups and Delivery, 5. Objective Metrics, Benchmarking and Assessment. Using the Delphi methodology, we achieved multispecialty consensus among trainees to develop and reach content validation for the requirements and components of a PPCRC. This guidance will benefit from further validation following implementation.

Struggle in the bubble - a prospective study on the effect of remote learning and distance education on confidence in practical surgical skills acquired during COVID-19

BACKGROUND

The coronavirus disease (COVID-19) has significantly changed healthcare systems and medical education. Universities were required to develop innovative curricula based on remote and distance education to continue medical education. This prospective questionnaire-based study aimed to investigate the impact of COVID-19-associated remote learning on the surgical training of medical students.

METHODS

A 16-item questionnaire-based survey was distributed to medical students at the University Hospital of Münster before and after a surgical skills laboratory (SSL). Two cohorts were included: summer semester 2021 (COV-19), with rigorous social-distancing restrictions requiered SSL to be remotely, and winter semester 2021 (postCOV-19), in which the SSL was provided as a face-to-face, hands-on course.

RESULTS

Both, cohorts showed a significant improvement in self-assessment of pre- and post-course confidence. While no significant difference in the average gain in self-confidence for sterile working was observed between the two cohorts, improvement in self-confidence was significantly higher in the COV-19 cohort regarding skin suturing and knot tying (p < 0.0001). However the average improvement regarding history and physical was significantly higher in the postCOV-19 cohort (p < 0.0001). In subgroup analysis, gender-associated differences varied in the two cohorts and were not related to specific subtasks, while age-stratified analysis revealed superior results for younger students.

CONCLUSION

The results of our study underline the usability, feasibility, and adequacy of remote learning for the surgical training of medical students. The on-site distance education version, presented in the study, allows the continuing of hands-on experience in a safe environment in compliance with governmental social-distancing restrictions.

Harnessing the disruption on medical trainee education due to COVID-19 in New South Wales, Australia

The coronavirus disease (COVID-19) pandemic has caused disruption and uncertainty for junior medical doctor training and education. This has compounded the existing stress experienced by this cohort. However, by choosing appropriate educational models, as well as using novel educational approaches and advancing our online technology capabilities, we may be able to provide acceptable and even, superior solutions for educational training moving forward, as well as promote trainee wellbeing during these uncertain times.

Virtual classroom proficiency-based progression for robotic surgery training (VROBOT): a randomised, prospective, cross-over, effectiveness study

Robotic surgery training has lacked evidence-based standardisation. We aimed to determine the effectiveness of adjunctive interactive virtual classroom training (VCT) in concordance with the self-directed Fundamentals of Robotic Surgery (FRS) curriculum. The virtual classroom is comprised of a studio with multiple audio–visual inputs to which participants can connect remotely via the BARCO weConnect platform. Eleven novice surgical trainees were randomly allocated to two training groups (A and B). In week 1, both groups completed a robotic skills induction. In week 2, Group A received training with the FRS curriculum and adjunctive VCT; Group B only received access to the FRS curriculum. In week 3, the groups received the alternate intervention. The primary outcome was measured using the validated robotic-objective structured assessment of technical skills (R-OSAT) at the end of week 2 (time-point 1) and 3 (time-point 2). All participants completed the training curriculum and were included in the final analyses. At time-point 1, Group A achieved a statistically significant greater mean proficiency score compared to Group B (44.80 vs 35.33 points, p = 0.006). At time-point 2, there was no significant difference in mean proficiency score in Group A from time-point 1. In contrast, Group B, who received further adjunctive VCT showed significant improvement in mean proficiency by 9.67 points from time-point 1 (95% CI 5.18–14.15, p = 0.003). VCT is an effective, accessible training adjunct to self-directed robotic skills training. With the steep learning curve in robotic surgery training, VCT offers interactive, expert-led learning and can increase training effectiveness and accessibility.