Computer-based video training is effective in teaching basic surgical skills to novices without faculty involvement using a self-directed, sequential and incremental program

The use of household items to support online surgical knot-tying skills training: a mixed methods study

BACKGROUND

This study investigated the perceptions and performance of medical students regarding their engagement and learning of a knot-tying skill presented in an online demonstration format due to the emergency remote measures that accompanied COVID-19 restrictions.

METHODS

Final-year undergraduate medical students were invited to view an online demonstration of a one-handed knot-tying skill and practice the skill using common household items. They recorded their attempts and uploaded them onto the Flipgrid application. Completed attempts were scored using an adapted Objective Structured Assessment of Technical Skill (OSATS) validated tool. We used a mixed-methods sequential explanatory design; data regarding students' engagement was gathered via a short questionnaire, and a Focus Group Discussion (FGD) was conducted to understand their learning experiences better. Descriptive statistics such as proportions and percentages were used to summarize categorical variables and median for continuous variables. Each video attempt was scored independently by two surgeons; reliability was determined using intraclass correlation; statistical tests were conducted at a 5% level of significance. Responses to open-ended survey questions and qualitative data from the FGDs were analysed using thematic analysis.

RESULTS

Seventy-one students participated in the exercise. Most students (91.5%) expressed confidence in their ability to perform the skill and were able to follow the steps in the video demonstration (83.1%). Median number of times needed to practice before video submission was 7.0 (Interquartile range [IQR] 5.0-10.0). Using the adapted OSATS tool; median scores on student attempts were 19.0 out of 21 (IQR: 17.0-20.0) for Assessor 1 and 18.0 out of 21 (IQR: 17.0-20.0) for Assessor 2, and overall scores showed good reliability between assessors based on intraclass correlation (0.86, 95% CI 0.79-0.90, p < 0.001). Qualitative insights from the students' experiences in learning the skill were generally positive; it was a practical, experiential learning process and they valued the social aspects of learning via Flipgrid. Challenges expressed related to the need for in-person training and formal feedback on how to improve their technique. Suggestions to improve their learning included a request for an interactive session with immediate feedback on attempts, and being able to practice with a friend who would assist with videoing.

CONCLUSION

Basic knot-tying can be taught with acceptable efficiency and student satisfaction using online methods with items available at home.

Adapting the Gamified Educational Networking Online Learning Management System to Test a Decentralized Simulation-Based Education Model to Instruct Paramedics-in-Training on the Emergency Intraosseous Access and Infusion Skill

Intraosseous (IO) access and infusion is a safe and rapid alternative to intravenous access in obtaining vascular access for administering fluids and drugs. Healthcare professionals, such as primary and advanced care paramedics, use IO access and infusion in emergency circumstances where peripheral intravenous routes are inaccessible. IO access skills require hands-on training, which can be done remotely if the participants have access to simulation, instructions, guidance, and feedback. For the purpose of moving the training outside of the simulation laboratories, we have developed (1) an inexpensive and scalable three-dimensional (3D) printed and silicone-based advanced adult proximal tibial IO access and infusion simulator and (2) a unique learning management system (LMS) for remote simulation-based training. The LMS was built using the Django platform and supports experiential learning by providing access to educational and instructional content (including virtual simulation and serious games), allowing peers to communicate among themselves and with subject-matter experts, provide and receive feedback asynchronously, and engage in learning using gamification elements. The aim of this technical report is to describe the process of development and the final product of the LMS as a research and educational tool to scaffold remote learning of emergency IO skills by paramedics-in-training.

What are the learning objectives in surgical training - a systematic literature review of the surgical competence framework

OBJECTIVE

To map the landscape of contemporary surgical education through a competence framework by conducting a systematic literature review on learning outcomes of surgical education and the instructional methods applied to attain the outcomes.

BACKGROUND

Surgical education has seen a paradigm shift towards competence-based training. However, a gap remains in the literature regarding the specific components of competency taught and the instructional methods employed to achieve these outcomes. This paper aims to bridge this gap by conducting a systematic review on the learning outcomes of surgical education within a competence framework and the instructional methods applied. The primary outcome measure was to elucidate the components of competency emphasized by modern surgical curricula. The secondary outcome measure was to discern the instructional methods proven effective in achieving these competencies.

METHODS

A search was conducted across PubMed, Medline, ProQuest Eric, and Cochrane databases, adhering to PRISMA guidelines, limited to 2017-2021. Keywords included terms related to surgical education and training. Inclusion criteria mandated original empirical studies that described learning outcomes and methods, and targeted both medical students and surgical residents.

RESULTS

Out of 42 studies involving 2097 participants, most concentrated on technical skills within competency-based training, with a lesser emphasis on non-technical competencies. The effect on clinical outcomes was infrequently explored.

CONCLUSION

The shift towards competency in surgical training is evident. However, further studies on its ramifications on clinical outcomes are needed. The transition from technical to clinical competence and the creation of validated assessments are crucial for establishing a foundation for lifelong surgical learning.

Evidence supporting performance measures of laparoscopic appendectomy through a novel surgical proficiency assessment tool and low-cost laparoscopic training system

BACKGROUND

Laparoscopic training remains inaccessible for surgeons in low- and middle-income countries, limiting its widespread adoption. We developed a novel tool for assessment of laparoscopic appendectomy skills through ALL-SAFE, a low-cost laparoscopy training system.

METHODS

This pilot study in Ethiopia, Cameroon, and the USA assessed appendectomy skills using the ALL-SAFE training system. Performance measures were captured using the ALL-SAFE verification of proficiency tool (APPY-VOP), consisting of a checklist, modified Objective Structured Assessment of Technical Skills (m-OSATS), and final rating. Twenty participants, including novice (n = 11), intermediate (n = 8), and expert (n = 1), completed an online module covering appendicitis management and psychomotor skills in laparoscopic appendectomy. After viewing an expert skills demonstration video, participants recorded their performance within ALL-SAFE. Using the APPY-VOP, participants rated their own and three peer videos. We used the Kruskal-Wallis test and a Many-Facet Rasch Model to evaluate (i) capacity of APPY-VOP to differentiate performance levels, (ii) correlation among three APPY-VOP components, and (iii) rating differences across groups.

RESULTS

Checklist scores increased from novice (M = 21.02) to intermediate (M = 23.64) and expert (M = 28.25), with differentiation between experts and novices, P = 0.005. All five m-OSATS domains and global summed, total summed, and final rating discriminated across all performance levels (P < 0.001). APPY-VOP final ratings adequately discriminated Competent (M = 2.0), Borderline (N = 1.8), and Not Competent (M = 1.4) performances, Χ2 (2,85) = 32.3, P = 0.001. There was a positive correlation between ALL-SAFE checklist and m-OSATS summed scores, r(83) = 0.63, P < 0.001. Comparison of ratings suggested no differences across expertise levels (P = 0.69) or location (P = 0.66).

CONCLUSION

APPY-VOP effectively discriminated between novice and expert performance in laparoscopic appendectomy skills in a simulated setting. Scoring alignment across raters suggests consistent evaluation, independent of expertise. These results support the use of APPY-VOP among all skill levels inside a peer rating system. Future studies will focus on correlating proficiency to clinical practice and scaling ALL-SAFE to other settings.

Is Online Video-Based Education an Effective Method to Teach Basic Surgical Skills to Students and Surgical Trainees? A Systematic Review and Meta-analysis

BACKGROUND

Online education has been increasingly utilized over the past decades. The COVID-19 pandemic accelerated the transition of conventional face-to-face curricula to online platforms, with limited evidence for its teaching efficacy. This systematic review aims to assess the effectiveness of online video-based education compared with standard conventional education in teaching basic surgical skills to surgical trainees and students undergoing medical training.

METHODS

We performed a literature search in Embase, Medline, Cochrane CENTRAL and Scopus from inception until February 2022. Studies included were randomised controlled trials (RCTs) and observational studies. We included randomised controlled trials only for meta-analysis. The primary outcome was surgical skill proficiency. The secondary outcomes were participant perception, confidence and satisfaction. Two authors independently assessed the search results for eligibility, extracted the data and assessed the risk of bias using the Cochrane Risk of Bias tool 2. Where appropriate, we performed random effects meta-analyses of the pooled study data to calculate a standardized mean difference.

RESULTS

A total of 11 studies met the inclusion criteria totaling 715 participants; 603 were included in qualitative analysis and 380 in meta-analysis. All included studies were assessed as having a low risk of bias. The majority of studies found no significant difference between conventional and video-based education in teaching basic surgical skills, three studies found video-based education was superior and one study found conventional education was superior. There was no statistically significant difference in skill proficiency between the two groups (standardized mean difference of -0.02 (95% CI: -0.34, 0.30); p=0.90). Video-based education results in an equivalent improvement in confidence and satisfaction rates. Additional benefits of video-based education include convenience, accessibility and efficiency.

CONCLUSIONS

Basic surgical skills can be taught as effectively through online video-based education as conventional teaching methods. Online education should be utilized as an adjunct to medical curricula beyond the COVID-19 era.

Adapting the Gamified Educational Networking (GEN) Learning Management System to Deliver a Virtual Simulation Training Module to Determine the Enhancement of Learning and Performance Outcomes

Microtomy is a medical laboratory sciences procedure that medical laboratory technologists (MLTs) use to cut tissues for microscopic examination. Due to safety concerns and the potential to destroy tissue samples, learners must perform the procedure correctly. In order to allow for safe and controlled learning, this procedure should be conducted in a simulated setting before attempting with human tissues.

The objective of this study is to describe the development and user-based evaluation of a virtual simulation training module. A research group developed the virtual simulation training module's content and design, and a local MLT expert provided the content. Nine students enrolled in a university-based medical laboratory sciences program provided feedback about the module. The results demonstrated that the virtual simulation training module was an effective and user-friendly learning tool for the medical laboratory sciences program. Although more validity and efficacy testing are required in the future, the students indicated a potential to use this module to prepare future students for hands-on exercise in a simulation laboratory setting.

Virtual Interactive Surgical Skills Classroom: A Parallel-group, Non-inferiority, Adjudicator-blinded, Randomised Controlled Trial (VIRTUAL)

OBJECTIVE

This study evaluated the efficacy of virtual classroom training (VCT) in comparison to face-to-face training (FFT) and non-interactive computer-based learning (CBL) for basic surgical skills training.

DESIGN

This was a parallel-group, non-inferiority, prospective randomised controlled trial with three intervention groups conducted in 2021. There were three intervention groups with allocation ratio 1:1:1. Outcome adjudicators were blinded to intervention assignment. Interventions consisted of 90-minute training sessions. VCT was delivered via the BARCO weConnect platform, FFT was provided in-person by expert instructors and CBL was carried out by participants independently. The primary outcome was post-intervention Objective Structured Assessment of Technical Skills score, adjudicated by two experts and adjusted for baseline proficiency. The assessed task was to place three interrupted sutures with hand-tied knots.

SETTING

This multicentre study recruited from five medical schools in London.

PARTICIPANTS

Inclusion criteria were medical student status and access to a personal computer and smartphone. One hundred fifty-nine eligible individuals applied online. Seventy-two participants were randomly selected and stratified by subjective and objective suturing experience prior to permuted block randomization.

RESULTS

Twenty-four participants were allocated to each intervention, all were analysed per-protocol. The sample was 65.3% female with mean age 21.3 (SD 2.1). VCT was non-inferior to FFT (adjusted difference 0.44, 95% CI: -0.54 to 1.75, delta 0.675), VCT was superior to CBL (adjusted difference 1.69, 95% CI: 0.41-2.96) and FFT was superior to CBL (adjusted difference 1.25, 95% CI: 0.20-2.29). The costs per-attendee associated with VCT, FFT and CBL were £22.15, £39.69 and £16.33 respectively. Instructor hours used per student for VCT and FFT were 0.25 and 0.75, respectively.

CONCLUSIONS

VCT provides greater accessibility and resource efficiency compared to FFT, with similar educational benefit. VCT has the potential to improve global availability and accessibility of surgical skills training.

Using refined kano model and decision trees to discover learners' needs for teaching videos

With the advancement of technology and the spread of the COVID19 epidemic, learning can no longer only be done through face-to-face teaching. Numerous digital learning materials have appeared in large numbers, changing people's learning mode. In the era of information explosion, how to capture the learners' attention to teaching videos and improve learning effectiveness is the common goal of every designer of e-leaning teaching content. Previous researches focused on the analysis of learning effectiveness and satisfaction. Instructional designers only provided design elements with high learning effectiveness or high satisfaction, and lacked in-depth analysis of the learners' perspectives. The opinions of these e-learning users are often the key to the success of online teaching videos. Therefore, this study aims at the design elements that will be used in the teaching film. The operation mode of the piano mechanism will be employed as the content of the teaching film. Based on eight elements including arrow cueing, dynamic arrow cueing, spreading-color cueing, contrary to cueing, font style, color application, anthropomorphic, and audiovisual complementarity, we use Refined Kano Model to analyze learners' needs of categorization of each element, and discover learners' expectations for teaching videos. In addition, this study also conducts in-depth data analysis through decision trees algorithm, and stratification analyses using different variables (such as design expertise, using frequency, and usage experience, etc.) to find out the key design factors that affect learners' learning. Depending on the learner's background, the use of e-learning experience, using frequency, and the length of the learning video, our results could provide for reference when designing teaching videos. Instructional designers can better understand how to effectively use design elements, so that the teaching videos can achieve the best learning effect.