Survey of clinician and student impressions of a synthetic canine model for gastrointestinal surgery training

Effect of surgical simulator training on student and live animal outcomes in a feline ovariohysterectomy teaching laboratory

OBJECTIVE

To evaluate the effect of training with a high-fidelity surgical simulator on outcomes of live animals and students participating in a feline ovariohysterectomy teaching laboratory.

STUDY DESIGN

Nonrandomized controlled trial.

SAMPLE POPULATION

Cats (n = 186) and students (n = 146).

METHODS

Live animals were paired with student surgeons. Outcomes for animals and students were evaluated over two consecutive years before (year 1: NO SIM) and after (year 2: SIM) the introduction of a graded student teaching laboratory conducted on a high fidelity surgical simulator. Live animal surgical times and postoperative pain scores using the Glasgow Composite Measure Pain Scale - Feline acute pain scale as well as self-declared student confidence were assessed and the scores of the two groups were compared.

RESULTS

The duration of the live animal surgical procedure was on average 6 min shorter in the SIM group (p = .04). A pain score triggering intervention (> = 5/20) occurred less frequently in the SIM group (n = 1/82) than in the NO-SIM (n = 16/104) group (p < .01). Similarly, rescue analgesia was administered less frequently (4/82 vs 16/104, p = .03) in the SIM group. Student confidence prior to the live animal procedure was higher (median = 7/10 [IQR = 6-8]) in the SIM group than in the NO-SIM group (median = 6/10 [IQR = 4-7]) (p < .01).

CONCLUSION

Surgical simulator training prior to live animal procedures improves live animal outcomes and student confidence.

CLINICAL SIGNIFICANCE

Surgical simulator competency should be considered a prerequisite to participation in live animal teaching laboratories. This would improve both animal welfare and the student experience.

Evaluation of veterinary students' confidence and competence with surgical entrustable professional activities after repeated use of low-fidelity training models

BACKGROUND

This study aimed to evaluate whether low-fidelity surgical training models increased veterinary students' surgical confidence and competence and decreased procedural stress related to core surgical entrustable professional activities (EPAs).

METHODS

Final-year veterinary students repeatedly performed one of three surgical EPAs on a low-fidelity surgical training model (canine castration, subcutaneous lump removal and eyelid laceration repair) and completed a survey at set time points. In addition, a grading rubric was used to assess participants' competence in performing the assigned EPA at two different time points. Survey results and competency gradings were compiled and analysed.

RESULTS

Students' self-assessed confidence significantly increased, and stress significantly decreased, between assessment points on all three EPA surgical training models. Graded competence significantly improved between the assessment points on all training models, and most students deemed the models to be realistic and helpful for student practices.

LIMITATIONS

Limitations relate to the study involving a single cohort from a single institute and the reliance on student self-assessment.

CONCLUSIONS

Repeated exposure to low-fidelity surgical training models increased final-year students' surgical confidence and competence and reduced procedural stress related to three key surgical EPAs. Assessment of competence using a grading rubric was successful and could be incorporated into a competence-based veterinary education assessment framework to allow screening of competence prior to graduation.

Veterinary students' views on surgical entrustable professional activities and the impact of COVID-19 on clinical competence development

Background

The primary purpose of this study was to understand veterinary students’ views on the described key surgical entrustable professional activities (EPAs) and to understand how COVID‐19 restrictions have impacted their clinical skill and competence development.

Methods

Final‐year veterinary students at a single institute completed a web‐based survey distributed by email. The survey aimed to characterise five constructs regarding EPAs, and a specific five‐point Likert‐like scale was created asking explicitly worded questions for each construct.

Results

One hundred and ten students responded. The cohort agreed that the previously described key surgical EPAs were clinically important and relevant, but over 50% of the respondents felt that they had no substantial experience with them and were not confident or comfortable performing them. Additionally, most students (95%) felt their clinical development was negatively impacted by COVID‐19.

Conclusions

The results of this study show that the key EPAs proposed are considered important skills by the undergraduate cohort described and that experience levels when entering the final year are lacking, potentially due to reduced exposure to clinical cases influenced by the COVID‐19 pandemic.

Evaluating validity evidence for 2 instruments developed to assess students' surgical skills in a simulated environment

Objective

To gather and evaluate validity evidence in the form of content and reliability of scores produced by 2 surgical skills assessment instruments, 1) a checklist, and 2) a modified form of the Objective Structured Assessment of Technical Skills (OSATS) global rating scale (GRS).

Study design

Prospective randomized blinded study.

Sample population

Veterinary surgical skills educators (n =10) evaluated content validity. Scores from students in their third preclinical year of veterinary school (n = 16) were used to assess reliability.

Methods

Content validity was assessed using Lawshe's method to calculate the Content Validity Index (CVI) for the checklist and modified OSATS GRS. The importance and relevance of each item was determined in relation to skills needed to successfully perform supervised surgical procedures. The reliability of scores produced by both instruments was determined using generalizability (G) theory.

Results

Based on the results of the content validation, 39 of 40 checklist items were included. The 39‐item checklist CVI was 0.81. One of the 6 OSATS GRS items was included. The 1‐item GRS CVI was 0.80. The G‐coefficients for the 40‐item checklist and 6‐item GRS were 0.85 and 0.79, respectively.

Conclusion

Content validity was very good for the 39‐item checklist and good for the 1‐item OSATS GRS. The reliability of scores from both instruments was acceptable for a moderate stakes examination.

Impact

These results provide evidence to support the use of the checklist described and a modified 1‐item OSAT GRS in moderate stakes examinations when evaluating preclinical third‐year veterinary students' technical surgical skills on low‐fidelity models.

SAGES Reimagining Education & Learning (REAL) project

BACKGROUND

The COVID-19 pandemic has presented multiple challenges for health systems throughout the world. The clinical priorities of redirecting personnel and resources to provide the necessary beds, care, and staff to handle the initial waves of infected individuals, and the drive to develop an effective vaccine, were the most visible and rightly took precedent. However, the spread of the COVID-19 virus also led to less apparent but equally challenging impediments for healthcare professionals. Continuing professional development (CPD) for physicians and surgeons practically ceased as national societies postponed or canceled annual meetings and activities. The traditional in-person conferences were no longer viable options during a pandemic in which social distancing and minimization of contacts was the emerging norm. Like other organizations, The Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) had to first postpone and then cancel altogether the in-person 2020 Annual Meeting due to the contingencies brought about by the COVID-19 pandemic. As a result, the traditional hands-on (HO) courses that typically occur as part of the Annual Meeting, could not take place. SAGES had already begun to re-structure these courses in an effort to increase their effectiveness (Dort, Trickey, Paige, Schwarz, Dunkin in Surg Endosc 33(9):3062-3068, 2019; Dort et al. in Surg Endosc 32(11):4491-4497, 2018; Dort, Trickey, Schwarz, Paige in Surg Endosc 33(9):3062-3068, 2019). The cancelations brought about by COVID-19 provided an opportunity to refine and to innovate further.

METHODS

In this manner, the Re-imaging Education & Learning (REAL) project crystallized, an innovative effort to leverage the latest educational concepts as well as communication and simulation-based technologies to enhance procedural adoption by converting HO courses to a virtual format.

RESULTS AND CONCLUSION

This manuscript describes the key components of REAL, reviewing the restructuring of the HO courses before and after the spread of COVID-19, describing the educational framework underlying it, discussing currently available technologies and materials, and evaluating the advantages of such a format.

If you build it, they will learn: A review of models in veterinary surgical education

Surgical skills are learned through deliberate practice, and veterinary educators are increasingly turning to models for teaching and assessing surgical skills. This review article sought to compile and review the literature specific to veterinary surgical skills models, and to discuss the themes of fidelity, educational outcomes, and validity evidence. Several literature searches using broad terms such as "veterinary surgery model," "veterinary surgical model," and "veterinary surgical simulator" were performed using PubMed, CAB abstracts, and Google scholar. All articles describing a model created and utilized for veterinary surgical training were included. Other review articles were used as a source for additional models. Commercially available models were found using review articles, internet browser searches, and communication with veterinary clinical skills educators. There has been an explosion of growth in the variety of small animal surgical task trainers published in the last several decades. These models teach orthopedic surgery, ligation and suturing, open celiotomy and abdominal surgery, sterilization surgeries, and minimally invasive surgeries. Some models were published with accompanying rubrics for learner assessment; these rubrics have been noted where present. Research in veterinary surgical models is expanding and becoming an area of focus for academic institutions. However, there is room for growth in the collection of validity evidence and in development of models for teaching large animal surgery, training surgical residents, and providing continuing education to practitioners. This review can assist with evaluation of current surgical models and trends, and provide a platform for additional studies and development of best practices.

Evaluation of a laparoscopic abdominal simulator assessment to test readiness for laparoscopic ovariectomy in live dogs

OBJECTIVE

To predict readiness for laparoscopic ovariectomy of live dogs on the basis of performance on a high-fidelity laparoscopic abdominal simulator and to determine interrater reliability of the assessment.

STUDY DESIGN

Experimental study.

SAMPLE POPULATION

Seventeen fourth-year veterinary students.

METHODS

After a standardized laparoscopic training course, each participant performed a laparoscopic ovariectomy with a simulator. This performance was scored in real time by two evaluators using a rubric. Participants achieving a score of 112 of 160 performed a laparoscopic ovariectomy in a live dog, supervised by an instructor in the room. Two evaluators scored video recordings of each procedure using the rubric. Participants' opinions about the simulator were collected with a survey.

RESULTS

All participants scored above the threshold (range, 126-151) and successfully completed laparoscopic ovariectomy in a live dog, with an average of 10 of 17 participants requiring verbal guidance and 5 of 17 participants requiring intervention from the instructor. Interrater concordance was excellent for the rubrics used to score performance on the simulator (R = 0.91) and in vivo (R = 0.81). All participants agreed that the simulator should be used to assess trainee readiness prior to surgery in a live dog.

CONCLUSION

Participants achieving a score of at least 126 of 160 on the simulator were able to perform a laparoscopic ovariectomy in a live dog under supervision. The scoring system for the simulator had excellent interrater concordance.

CLINICAL SIGNIFICANCE

This simulator and scoring system can be used in laparoscopic training programs to assess readiness for progression to the operative setting.