Evaluating Surgical Coaching: A Mixed Methods Approach Reveals More Than Surveys Alone

Adapting Surgical Coaching: Feasibility and Perceptions of Intraoperative Resident Peer Coaching

INTRODUCTION

Surgical coaching is utilized to enhance technical, nontechnical, and teaching skills. This study aims to evaluate the feasibility and benefit of a resident peer coaching program.

METHODS

Chief residents (postgraduate year 5) acted as coaches for junior residents (postgraduate year 1-3, "coachees"). All participants completed the Harvard Surgical Coaching for Operative Performance Enhancement curriculum. The coaching structure included 1) preoperative goal setting, 2) unscrubbed intraoperative observation, and 3) postoperative debrief. Upon completion, residents were surveyed to assess their experience. Descriptive and thematic analyses were performed.

RESULTS

There were 22 participants (6 coaches, 16 coachees). Five (83.3%) coaches and 14 (87.5%) coachees reported the program was useful, citing dedicated reflection outside the operating room, in-depth feedback, and structured self-assessment with increased accountability. Thirteen (81.3%) coachees reported perceived improvement in technical skills and 12 (75%) within nontechnical skills. All coaches felt they benefited and improved their ability to provide feedback. When asked how coaching compared to usual methods of operative feedback, 14 (87.5%) coachees and 5 (83.3%) coaches reported it was better, with only 1 coachee reporting it was worse. Benefits over typical operating room teaching included more feedback provided, more specific feedback, and the benefit of peer relationships. Twelve (54.5%) residents cited difficulty with coordinating sessions, but 21 (95.5%) reported that they would participate again.

CONCLUSIONS

Implementation of a resident peer surgical coaching program is feasible. Both coaches and coachees perceive significant benefit with improvement in technical, nontechnical, and feedback delivery skills. Given preference over other methods of operative feedback, expansion of peer coaching programs is warranted.

Standardization and Implementation of a Surgical Coaching Model for Pediatric Urology

To bridge gaps in proficiency and encourage life-long learning following training, coaching models have been utilized in multiple surgical fields; however, not within pediatric urology. In this review of our methodology, we describe the development of a coaching model at a single institution. In our initial experience, the perceived most beneficial aspect of the program was the goal setting process with logistics around debriefs being the most challenging. With our proposed coaching study, we aim to develop a model based upon prior coaching frameworks,1,2 that is feasible and universally adaptable to allow for further advancement of surgical coaching, particularly within the field of pediatric urology.

Surgical coaching in obstetrics and gynecology: an evidence-based strategy to elevate surgical education and promote lifelong learning

The American Board of Medical Specialties, of which the American Board of Obstetrics and Gynecology is a member, released recommendations in 2019 reimagining specialty certification and highlighting the importance of individualized feedback and data-driven advances in clinical practice throughout the physicians' careers. In this article, we presented surgical coaching as an evidence-based strategy for achieving lifelong learning and practice improvement that can help to fulfill the vision of the American Board of Medical Specialties. Surgical coaching involves the development of a partnership between 2 surgeons in which 1 surgeon (the coach) guides the other (the participant) in identifying goals, providing feedback, and facilitating action planning. Previous literature has demonstrated that surgical coaching is viewed as valuable by both coaches and participants. In particular, video-based coaching involves reviewing recorded surgical cases and can be integrated into the physicians' busy schedules as a means of acquiring and advancing both technical and nontechnical skills. Establishing surgical coaching as an option for continuous learning and improvement in practice has the potential to elevate surgical performance and patient care.

Coaching in Surgical Education: A Systematic Review

OBJECTIVE

The objectives of this study were to review the coaching literature to (1) characterize the criteria integral to the coaching process, specifically in surgery, and (2) describe how these criteria have been variably implemented in published studies.

BACKGROUND

Coaching is a distinct educational intervention, but within surgery the term is frequently used interchangeably with other more established terms such as teaching and mentoring.

METHODS

A systematic search was performed of the MEDLINE and Cochrane databases to identify studies that used coach/coaching as an intervention for surgeons for either technical or nontechnical skills. Study quality was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).

RESULTS

A total of 2280 articles were identified and after screening by title, abstract and full text, 35 remained. Thirteen coaching criteria (a-m) were identified in 4 general categories: 1. overarching goal (a. refine performance of an existing skill set), 2. the coach (b. trusting partnership, c. avoids assessment, d. 2-way communication), the coachee (e. voluntary participation, f. self-reflection, g. goal setting, h. action plan, i. outcome evaluation), and the coach-coachee rapport (j. coaching training, k. structured coaching model, l. non-directive, m. open ended questions). Adherence to these criteria ranged from as high of 73% of studies (voluntary participation of coach and coachee) to as low as 7% (use of open-ended questions).

CONCLUSIONS

Coaching is being used inconsistently within the surgical education literature. Our hope is that with establishing criteria for coaching, future studies will implement this intervention more consistently and allow for better comparison and generalization of results.

Surgical data recording in the operating room: a systematic review of modalities and metrics

INTRODUCTION

Operating room recording, via video, audio and sensor-based recordings, is increasingly common. Yet, surgical data science is a new field without clear guidelines. The purpose of this study is to examine existing published studies of surgical recording modalities to determine which are available for use in the operating room, as a first step towards developing unified standards for this field.

METHODS

Medline, EMBASE, CENTRAL and PubMed databases were systematically searched for articles describing modalities of data collection in the operating room. Search terms included 'video-audio media', 'bio-sensing techniques', 'sound', 'movement', 'operating rooms' and others. Title, abstract and full-text screening were completed to identify relevant articles. Descriptive statistical analysis was performed for included studies.

RESULTS

From 3756 citations, 91 studies met inclusion criteria. These studies described 10 unique data-collection modalities for 17 different purposes in the operating room. Data modalities included video, audio, kinematic and eye-tracking among others. Data-collection purposes described included surgical trainee assessment, surgical error, surgical team communication and operating room efficiency.

CONCLUSION

Effective data collection and utilization in the operating room are imperative for the provision of superior surgical care. The future operating room landscape undoubtedly includes multiple modalities of data collection for a plethora of purposes. This review acts as a foundation for employing operating room data in a way that leads to meaningful benefit for patient care.

Development of a peer review of operative teaching process and assessment tool

BACKGROUND

While teaching evaluation systems are common in academia, very little information is available regarding formal coaching and peer review of teaching performance in surgery. This article is a report on the development and implementation of a peer review of operative teaching program.

METHODS

Our process was designed using a multistep sequential model which included developing a peer review of teaching instrument that was piloted to study the efficacy and utility of the tool.

RESULTS

Thirty-nine peer reviews of teaching were conducted. Among the most frequent challenges that faculty identified were allowing residents to struggle/give autonomy, judging when to take over the case, communicating effectively, being patient, balancing education and patient safety, and giving feedback.

CONCLUSIONS

Our peer review of teaching program is systematic, feasible, and can be adopted by other surgery departments. Faculty's identified strengths and challenges have been incorporated into our faculty development curricula.

Best Approaches to Evaluation and Feedback in Post-Graduate Medical Education

PURPOSE OF REVIEW

The objectives of this literature review are to appraise current approaches and assess new technologies that have been utilized for evaluation and feedback of residents, with focus on surgical trainees.

RECENT FINDINGS

In 1999, the Accreditation Council for Graduate Medical Education introduced the Milestone system as a tool for summative evaluation. The organization allows individual program autonomy on how evaluation and feedback are performed. In the past, questionnaire evaluations and informal verbal feedback were employed. However, with the advent of technology, they have taken a different shape in the form of crowdsourcing, mobile platforms, and simulation. Limited data is available on new methods but studies show promise citing low cost and positive impact on resident education. No one "best approach" exists for evaluation and feedback. However, it is apparent that a multimodal approach that is based on the ACGME Milestones can be effective and aid in guiding programs.

Evaluating a Solely Mechanical Articulating Laparoscopic Device: A Prospective Randomized Crossover Study

BACKGROUND

The FlexDex^® (FD) is a solely mechanical articulating device that combines the functionality of robotic surgery with the relative low cost and simplicity of laparoscopy. We sought to evaluate the performance of first-time FD users while performing a simple suture task at locations of varying degrees of difficulty.

STUDY DESIGN

A prospective, randomized crossover study was performed comparing the FD to standard laparoscopy (SL). Two specific groups were evaluated; Group 1 consisted of complete novices, and Group 2 consisted of surgical trainees. Participants performed a simple suture with both FD and SL locations of varying degrees of difficulty (Easy, Moderate, and Hard). The following outcomes were evaluated: Instrument Function and Ergonomics (Comfort/Ergonomics survey), Task Difficulty (National Aeronautics and Space Administration Task Load Index [NASA-TLX]), Task Performance Quality (Objective Structured Assessment of Technical Skills [OSATS]), and Time (seconds).

RESULTS

Twenty-two participants were enrolled with 12 participants in Group 1 and 10 participants in Group 2. Group 1-FD participants experienced overall less shoulder strain (1.2 ± 0.40 versus 1.9 ± 0.90, P = .01), and Group 2-FD participants experienced less shoulder (2.5 ± 0.66 versus 4.0 ± 0.50, P = .01), back (1.1 ± 0.32 versus 1.9 ± 0.74, P = .01), and forearm strain (1.9 ± 0.88 versus 2.5 ± 1.1, P = .04). Group 1 participants using the FD experienced higher mental demand (73 ± 17 versus 48 ± 27, P < .01) and perceived effort (70 ± 20 versus 54 ± 23, P < .001). Both Group 1 and Group 2 FD participants performed tasks at the Hard location more effectively. Both Group 1 (70 versus 87, P = .21) and Group 2 (53 versus 60, P = .55) performed tasks at the Hard location in similar times, while Group 1 (80 versus 177, P = .03) and Group 2 (33 versus 70, P = .001) performed tasks at the Easy location in shorter times using SL.

CONCLUSIONS

This study demonstrates the first assessment of the FD, a mechanically articulating laparoscopic tool. First-time FD users demonstrated improved ergonomics and effectiveness suturing at difficult locations. Future studies will focus on comparison to robotic surgery and translation into clinical applications.