Group Video Feedback is an Effective and Efficient Tool for Enhancing Skills of Surgical Interns

Video-based assessment (VBA) of an open, simulated orthopedic surgical procedure: a pilot study using a single-angle camera to assess surgical skill and decision making

BACKGROUND

Videos have been used in many settings including medical simulation. Limited information currently exists on video-based assessment in surgical training. Effective assessment tools have substantial impact on the future of training. The objectives of this study were as follows: to evaluate the inter-rater reliability of video-based assessment of orthopedic surgery residents performing open cadaveric simulation procedures and to explore the benefits and limitations of video-based assessment.

METHODS

A multi-method technique was used. In the quantitative portion, four residents participated in a Surgical Objective Structured Clinical Examination in 2017 at a quaternary care training center. A single camera bird's-eye view was used to videotape the procedures. Five orthopedic surgeons evaluated the surgical videos using the Ottawa Surgical Competency Operating Room Evaluation. Interclass correlation coefficient was used to calculate inter-rater reliability. In the qualitative section, semi-structured interviews were used to explore the perceived strengths and limitations of video-based assessment.

RESULTS AND DISCUSSION

The scores using video-based assessment demonstrated good inter-rater reliability (ICC = 0.832, p = 0.014) in assessing open orthopedic procedures on cadavers. Qualitatively, the strengths of video-based assessment in this study are its ability to assess global performance and/or specific skills, ability to reassess missed points during live assessment, and potential use for less common procedures. It also allows for detailed constructive feedback, flexible assessment time, anonymous assessment, multiple assessors and serves as a good coaching tool. The main limitations of video-based assessment are poor audio-video quality, and questionable feasibility for assessing readiness for practice.

CONCLUSION

Video-based assessment is a potential adjunct to live assessment in orthopedic open procedures with good inter-rater reliability. Improving audio-video quality will enhance the quality of the assessment and improve the effectiveness of using this tool in surgical training.

Surgical simulation supplements reproductive endocrinology and infertility fellowship training

Objective

To assess if a surgical boot camp improves laparoscopic skill among reproduction endocrinology and infertility (REI) fellows and increases fellow desire to incorporate surgical skills into practice and to examine whether fellowship in vitro fertilization (IVF) volume correlates with surgical efficiency.

Design

Prospective evaluation.

Setting

Simulation Center.

Patients

Forty REI fellows.

Interventions

Fellows were timed before and after training in laparoscopic suturing and knot tying and while using virtual simulators. Fellows were surveyed before boot camp on prior experience with IVF and reproductive surgery, and immediately and 1 month after boot camp on their desire to incorporate surgical skills into practice.

Main Outcome Measures

Efficiency of laparoscopic suturing and knot tying before and after boot camp; likelihood and persistence of incorporating surgical skills into practice immediately and 1 month after boot camp; and correlation between fellowship IVF volume and fellow surgical efficiency.

Results

Fellows experienced significant improvement in laparoscopic suturing (44 sec), intracorporeal knot tying (82 sec), and extracorporeal knot tying (71 sec). Fellows reported being more likely to incorporate operative hysteroscopy (89%), operative laparoscopy (87%), and laparoscopic suturing (84%) into practice immediately following boot camp with no difference 1 month later. Fifty-four percent of fellows reported being more likely to perform robotic surgery after the boot camp, increasing to 70% 1 month later. There were weak correlations between IVF case volume and efficiency in laparoscopic suturing or hysteroscopic polypectomy (Spearman correlation coefficients, -0.14 and -0.03).

Conclusions

An intensive surgical boot camp enhances surgical skill among REI fellows.