Video-Based Coaching: Current Status and Role in Surgical Practice (Part 1) From the Society for Surgery of the Alimentary Tract, Health Care Quality and Outcomes Committee

Video-based Coaching: Current Status and Role in Surgical Practice, Part II- Practical Implementation and Risk Mitigation from the Society for Surgery of the Alimentary Tract, Health Care Quality and Outcomes Committee

INTRODUCTION

Video-based surgical coaching is gaining traction within the surgical community. It has an increasing adoption rate and growing recognition of its utility, especially an advanced continuous professional growth tool, for continued educational purposes. This method offers instructional flexibility in real-time remote settings and asynchronous feedback scenarios. In our first paper, we delineated fundamental principles for video-based coaching, emphasizing the customization of feedback to suit individual surgeon's needs.

METHOD

In this second part of the series, we review into practical applications of video-based coaching, focusing on quality improvements in a team-based setting, such as the trauma bay. Additionally, we address the potential risks associated with surgical video recording, storage, and distribution, particularly regarding medicolegal aspects. We propose a comprehensive framework to facilitate the implementation of video coaching within individual healthcare institutions.

RESULTS

Our paper examines the legal and ethical framework and explores the potential benefits and challenges, offering insights into the real-world implications of this educational approach.

CONCLUSION

This paper contributes to the discourse on integrating video-based coaching into continuous professional development. It aims to facilitate informed decision-making in healthcare institutions, considering the adoption of this innovative educational quality tool.

Crowd-sourced and expert video assessment in minimally invasive esophagectomy

BACKGROUND

Video-based assessment by experts may structurally measure surgical performance using procedure-specific competency assessment tools (CATs). A CAT for minimally invasive esophagectomy (MIE-CAT) was developed and validated previously. However, surgeon's time is scarce and video assessment is time-consuming and labor intensive. This study investigated non-procedure-specific assessment of MIE video clips by MIE experts and crowdsourcing, collective surgical performance evaluation by anonymous and untrained laypeople, to assist procedure-specific expert review.

METHODS

Two surgical performance scoring frameworks were used to assess eight MIE videos. First, global performance was assessed with the non-procedure-specific Global Operative Assessment of Laparoscopic Skills (GOALS) of 64 procedural phase-based video clips < 10 min. Each clip was assessed by two MIE experts and > 30 crowd workers. Second, the same experts assessed procedure-specific performance with the MIE-CAT of the corresponding full-length video. Reliability and convergent validity of GOALS for MIE were investigated using hypothesis testing with correlations (experience, blood loss, operative time, and MIE-CAT).

RESULTS

Less than 75% of hypothesized correlations between GOALS scores and experience of the surgical team (r < 0.3), blood loss (r = - 0.82 to 0.02), operative time (r = - 0.42 to 0.07), and the MIE-CAT scores (r = - 0.04 to 0.76) were met for both crowd workers and experts. Interestingly, experts' GOALS and MIE-CAT scores correlated strongly (r = 0.40 to 0.79), while crowd workers' GOALS and experts' MIE-CAT scores correlations were weak (r = - 0.04 to 0.49). Expert and crowd worker GOALS scores correlated poorly (ICC ≤ 0.42).

CONCLUSION

GOALS assessments by crowd workers lacked convergent validity and showed poor reliability. It is likely that MIE is technically too difficult to assess for laypeople. Convergent validity of GOALS assessments by experts could also not be established. GOALS might not be comprehensive enough to assess detailed MIE performance. However, expert's GOALS and MIE-CAT scores strongly correlated indicating video clip (instead of full-length video) assessments could be useful to shorten assessment time.