Do residents receive the same OR guidance as surgeons report? Difference between residents' and surgeons' perceptions of OR guidance

Intraoperative teaching methods, models, and frameworks: A scoping review for surgical resident education

BACKGROUND

This review aimed to consolidate the existing literature on intraoperative teaching strategies and highlight areas for future research.

OBJECTIVE

The objective is to review the research conducted regarding the implementation of various teaching frameworks for surgical learners and to present their feasibility, benefits, and limitations within surgical residencies, as well as areas for future research.

METHODS

Two independent investigators searched MEDLINE, EMBASE, and ERIC and reviewed articles on intraoperative teaching strategies for surgical resident education.

RESULTS

3050 abstracts were reviewed, and 66 studies (2.2%) were included. The most common study type was single cohort studies (33%), followed by survey studies (17%). The majority of articles were carried out in General Surgery (50%), or a combination of surgical specialties (17%).

CONCLUSIONS

The BID model encompasses perioperative teaching time points and suggests a universal organizational approach to intraoperative teaching that would likely be compatible with documented competency assessments for residents.

Perceptions and Guiding Strategies to Regulate Entrusted Autonomy of Residents in the Operating Room: A Systematic Literature Review

OBJECTIVE

To provide a systematic literature review of intraoperative entrusted autonomy for surgical residents. Specifically, perceptions from residents and supervising surgeons, supervising behavior and influencing factors on intraoperative teaching and learning are analyzed.

BACKGROUND

Increasing demands on surgical training and the need for effective development of technical skills, amplify the importance of making the most of intraoperative teaching and learning opportunities in the operating room. It is critical for residents to gain the greatest benefit from every surgical case and to achieve operative competence.

METHODS

A systematic literature search identified 921 articles from 2000 to 2022 that addressed surgical education/training, intraoperative supervision/teaching, autonomy and entrustment. 40 studies with heterogeneous designs and methodologies were included.

RESULTS

Four themes were established in the analysis: patient safety, learner, learning environment and supervising surgeon. The patient is identified as the primary responsibility during intraoperative teaching and learning. Supervisors continuously guard patient safety as well as the resident's learning process. Ideal intraoperative learning occurs when the resident has optimal entrusted autonomy during the procedure matching with the current surgical skills level. A safe learning environment with dedicated time for learning are prerequisites for both supervising surgeons and residents. Supervising surgeons' own preferences and confidence levels also play an important role.

CONCLUSIONS

This systematic literature review identifies patient safety as the overriding principle for supervising surgeons when regulating residents' entrusted autonomy. When the supervisor's responsibility toward the patient has been met, there is room for intraoperative teaching and learning. In this process the learner, the learning environment and the supervising surgeon's own preferences all intertwine, creating a triangular responsibility. This review outlines the challenge of establishing an equilibrium in this triangle and the broad arsenal of strategies supervising surgeons use to keep it in balance.

General Surgery Resident Autonomy: Truth and Myth

Within general surgery education circles, the state of autonomy for residents in surgery training programs has been of growing concern. Although there is no direct evidence showing less autonomy in modern surgical training, multiple surrogates have been cited as reasons for concern. Many reasons have been given for lost autonomy including the 80-hour work week, financial constraints, concerns over quality of patient care, patient expectations, new and innovative technologies, legal limitations, and public opinion. This article discusses the current state of general surgery resident autonomy, why autonomy is important, barriers to autonomy, and ways to support autonomy.

A Novel Operative Coaching Program for General Surgery Chief Residents Improves Operative Efficiency

INTRODUCTION

We evaluated the effect of an operative coaching (OC) model on general surgery chief residents' operative efficiency (OE) measured by operative times. We hypothesized that higher levels of entrustment surgeons intend to offer resident in future similar cases are associated with improved OE.

MATERIALS AND METHODS

From July 2018 to June 2019, we used a validated instrument to score prospective resident entrustment in 228 evaluations of 6 chief residents during 12 OC sessions each (3 lap colectomy, 3 lap cholecystectomy, 3 ventral hernia, 3 inguinal hernia). Operative times of matched case CPT codes performed by coached chiefs (N = 500) were matched via CPT code to the cases of uncoached chiefs in the academic year 2016-2017 (N = 478). Statistical analysis was performed using Pearson correlation and one-way ANOVA.

RESULTS

Prospective entrustment scores from coached chief residents were associated with significantly shorter operative times in matched complex cases (CC) (r = -0.58, p = 0.0047). A similar trend was observed in noncomplex cases (NCC) (r = -0.29, p = 0.18). Compared to the historical cohort, coached chief residents showed a decrease in mean operative time during complex cases (p = 0.0008, d = 0.44), but an increase in mean operative times for noncomplex cases (p < 0.0001, d = 0.33).

CONCLUSIONS

An OC model improves chief residents' prospective entrustment leading to increased OE in cases with greater levels of operative complexity, showing a decrease in mean operative time compared to uncoached residents in certain procedures. This is the first report showing formal coaching may be a method to enhance chief resident OE.

Residents Think in the "Now" and Supervisors Think Ahead in the Operating Room. A Survey Study About Task Perception of Residents and Supervising Surgeons

OBJECTIVE

Progressive autonomous task performance is the cornerstone of teaching residents in the operating room, where they are entrusted with autonomy when they meet their supervisors' preferences. To optimize the teaching, supervisors need to be aware of how residents experience parts of the procedure. This study provides insight into how supervisors and residents perceive different tasks of a single surgical procedure.

DESIGN

In this qualitative survey study a cognitive task analysis (CTA) of supervisors and residents for the 47 tasks of an uncemented total hip arthroplasty was executed. Both groups rated the level of attention they would assign to each task and were asked to explain attention scores of 4 or 5.

SETTING

University Medical Centre Groningen (the Netherlands) and its 5 affiliated teaching hospitals.

PARTICIPANTS

Seventeen supervising surgeons and 21 residents.

RESULTS

Normal attention (median attention score 3) was assigned by supervisors to 34 tasks (72.3%) and by residents to 35 tasks (74.5 %). Supervisors rated 12 tasks (25.6%) and residents 9 tasks (19.1%) with a median attention score of 4. In general, supervisors associated high attention with patient outcome and prevention of complications, while residents associated high attention with "effort."

CONCLUSIONS

Supervisors and residents assigned attention to tasks for different reasons. Supervisors think ahead and emphasize patient outcome and prevention of complications when they indicate high attention, while residents think in the "now" and raise attention to execute the tasks themselves. The results of this study allow residents and supervisors to anticipate preferences: residents are able to appreciate why supervisors increase attention to specific tasks, and supervisors obtain information on which tasks require individual guidance of residents. This information can contribute to improve the learning climate in the operating room and task-specific procedural training.

Does Perceived Resident Operative Autonomy Impact Patient Outcomes?

OBJECTIVE

We investigated the association of perceived trainee autonomy with patient clinical outcomes following colorectal surgery.

DESIGN

This was a prospective multi-institutional study that consisted of surgery trainees completing a survey tool immediately after participating in colorectal resections to rate their self-perceived autonomy and case characteristics. Self-perception of autonomy was classified as observer, assistant, surgeon, or teacher. The completed trainee surveys were linked with patient information available through each hospital's internal NSQIP directory. The primary outcome was death and serious morbidity (DSM) and secondary outcome was 30-day readmissions. Separate mixed effects regression models were used to examine the association between perceived trainee autonomy and DSM or 30-day readmissions. Fixed effects were used to control for the effects of the training environment. The models were constructed to adjust for patient and trainee characteristics associated with each outcome independently.

SETTING

This study was conducted at 7 general surgery training programs (5 academic medical centers and 2 independent training programs) with general surgery or colorectal surgery services.

PARTICIPANTS

This study included a total of 63 residents and fellows rotating on surgery services that performed colorectal resections at the included 7 general surgery training programs from January until March 2016.

RESULTS

The 63 trainees that participated in this study completed 417 surveys with over a 95% response rate. National Surgical Quality Improvement Program (NSQIP) patient records were available for 67% (n = 273) of completed surveys. The clinical year of the trainees were 6.1% PGY 1/2, 36% Post graduate year (PGY) 3, 40.9% PGY 4/5, and 17% fellows. Residents perceived their participation in the case to be that of an observer in 9.2% of surveys, an assistant in 51.6% of surveys, and the surgeon/teacher in 39.3% of surveys. About 50% of patients were male, 80% were White, the majority had an American Society of Anesthesiologists classification of 3, almost half had prior abdominal surgery, and over 80% of surgeries were elective. The primary operation types performed were laparoscopic (40.3%) and open (35.9%) partial colectomies. The rate of DSM in patients was approximately 24% when trainees perceived their role as observers, 23% when trainees perceived their role as assistants, and 18% when trainees perceived their role as surgeons/teachers. After adjustment for patient, trainee, and training environment, we found that the perceived level of trainee autonomy of a surgeon/teacher was associated with a 4-fold lower rate of DSM (odds ratio: 0.23, confidence of interval: 0.05-0.97, p = 0.045) compared to observers. The rate of readmissions was approximately 20% when trainees perceived their role as observers, 14% when trainees perceived their role as assistants and 9% when trainees perceived their role as surgeons/teachers. After adjustment for patient, trainee, and training environment, we found that the perceived level of trainee autonomy of a surgeon/teacher was significantly associated with a 10-fold lower rate of 30-day readmissions (odds ratio: 0.09, confidence of interval: 0.01-0.70, p = 0.022) compared to observers.

CONCLUSIONS

There was an association between increased perceived trainee autonomy and improved patient outcomes, suggesting that when trainees identify with an increased role in the operation, patients may have improved care. Further research is needed to understand this association further.

Resident Autonomy in the Operating Room: How Faculty Assess Real-time Entrustability

OBJECTIVE

This study aimed to identify the empirical processes and evidence that expert surgical teachers use to determine whether to take over certain steps or entrust the resident with autonomy to proceed during an operation.

BACKGROUND

Assessing real-time entrustability is inherent in attending surgeons' determinations of residents' intraoperative autonomy in the operating room. To promote residents' autonomy, it is necessary to understand how attending surgeons evaluate residents' performance and support opportunities for independent practice based on the assessment of their entrustability.

METHODS

We conducted qualitative semi-structured interviews with 43 expert surgical teachers from 21 institutions across 4 regions of the United States, using purposeful and snowball sampling. Participants represented a range of program types, program size, and clinical expertise. We applied the Framework Method of content analysis to iteratively analyze interview transcripts and identify emergent themes.

RESULTS

We identified a 3-phase process used by most expert surgical teachers in determining whether to take over intraoperatively or entrust the resident to proceed, including 1) monitoring performance and "red flags," 2) assessing entrustability, and 3) granting autonomy. Factors associated with individual surgeons (eg, level of comfort, experience, leadership role) and the context (eg, patient safety, case, and time) influenced expert surgical teachers' determinations of entrustability and residents' final autonomy.

CONCLUSION

Expert surgical teachers' 3-phase process of decisions on take-over provides a potential framework that may help surgeons identify appropriate opportunities to develop residents' progressive autonomy by engaging the resident in the determination of entrustability before deciding to take over.

Variations in Teaching Assistant Case Experience during General Surgical Residency

In 2014 to 2015, the American Council for Graduate Medical Education required that graduating surgical residents must complete 25 cases as a teaching assistant (TA). The definition of TA varies among programs. The purpose of this study is to gain insight into how many cases residents log as a TA, the operative setting, and the types of cases performed. An online survey of 21 questions was sent via email to all general surgery program directors across the nation between August and October of 2015. Questions regarding the number of cases performed as TA, types of cases performed, and the operative setting were asked. We received 88 responses of 200 surveys sent. Fifty-two per cent of programs stated that their graduating residents log more than 25 cases as TA on graduating. All 88 respondents stated that senior residents acted as TAs in the operating room; of these respondents, 59 per cent stated that senior residents acted as TAs in the clinic also, 66 per cent on floors, and 70 per cent in the emergency room. The definition of TA differs among programs. Also, the types of cases that residents log as TA varies among programs as there are no clear guidelines set by the American Council for Graduate Medical Education as to what constitutes a TA case. Nonetheless, in most programs, senior residents perform more than 25 TA cases.

Orthopaedic Surgery Residency Training: Consideration for a Surgical and Procedural Skills Competency

This perspectives report discusses the need to create a surgical and procedural skills competency for orthopedic surgery residency training programs.

It's worth the wait: optimizing questioning methods for effective intraoperative teaching

BACKGROUND

The use of questioning to engage learners is critical to furthering resident education intraoperatively. Previous studies have demonstrated that higher level questioning and optimal wait times (>3 s) result in learner responses reflective of higher cognition and retention. Given the importance of intraoperative learning, we investigated question delivery in the operating room.

METHODS

A total of 12 laparoscopic cholecystectomies were observed and recorded. All questions were transcribed and classified using Bloom's Taxonomy, a framework associated with hierarchical levels of learning outcomes. Wait time between question end and response was recorded.

RESULTS

Six faculty attendings and seven house officers at our institution were observed. A total of 133 questions were recorded with an average number of questions per case of 11.2. The majority of questions 112 out of 133 (84%) were classified as Bloom's levels 1-3, with only 6% of questions of the highest level. The wait time before the resident answered the question averaged 1.75 s, with attendings interceding after 2.50 s. Question complexity and wait time did not vary based on resident postgraduate year level suggesting limited tailoring of question to learner.

CONCLUSIONS

Intraoperative questioning is not aligned with higher level thinking. The majority of questions were Bloom's level 3 or below, limiting the complexity of answer formulation. Most responses were given within 2 s, hindering opportunity to pursue higher-order thinking. This suggests including higher level questions and tailoring questions to learner level may improve retention and maximize gains. In addition, with attendings answering 20% of their own questions, increasing their wait time offers another area for teaching development.

Perioperative feedback in surgical training: A systematic review

BACKGROUND

Changes in surgical training have raised concerns about residents' operative exposure and preparedness for independent practice. One way of addressing this concern is by optimizing teaching and feedback in the operating room (OR). The objective of this study was to perform a systematic review on perioperative teaching and feedback.

METHODS

A systematic literature search identified articles from 1994 to 2014 that addressed teaching, feedback, guidance, or debriefing in the perioperative period. Data was extracted according to ENTREQ guidelines, and a qualitative analysis was performed.

RESULTS

Thematic analysis of the 26 included studies identified four major topics. Observation of teaching behaviors in the OR described current teaching practices. Identification of effective teaching strategies analyzed teaching behaviors, differentiating positive and negative teaching strategies. Perceptions of teaching behaviors described resident and attending satisfaction with teaching in the OR. Finally models for delivering structured feedback cited examples of feedback strategies and measured their effectiveness.

CONCLUSIONS

This study provides an overview of perioperative teaching and feedback for surgical trainees and identifies a need for improved quality and quantity of structured feedback.

Beliefs and values about intra-operative teaching and learning: a case study of surgical teachers and trainees

Surgeons require advanced psychomotor skills, critical decision-making and teamwork skills. Much of surgical skills training involve progressive trainee participation in supervised operations where case variability, operating team interaction and environment affect learning, while surgical teachers face the key challenge of ensuring patient safety. Using a theoretical framework of situated learning including cognitive apprenticeship, we explored teachers' and trainees' beliefs and values about intra-operative training and reasons for any differences. A qualitative case study method was used where five teacher-trainee pairs participating in an observed teaching operation were separately interviewed about the same operation. Thematic analysis of transcribed interviews and observations was performed with iterative refinement and a reflexive approach was adopted throughout the study. We found that in all cases, teachers and trainees had shared recognition of learning about technical skills whereas they differed in three cases regarding non-technical skills such as surgical reasoning and team management. Factors contributing to teacher and trainee satisfaction with the process were successful trainee completion of operation without need for surgeon take-over, a positive learning environment and learning new things. Teaching-learning behaviours observed and discussed were modeling, coaching and scaffolding, while exploration, reflection and articulation were less common. Our study reveals differing teacher and trainee perspectives of some aspects of intra-operative training and surfaces new reasons other than amount of feedback and autonomy given. Factors contributing to different perspectives include teacher and trainee abilities, values and situational influences. Targeted teaching-learning strategies could enhance intra-operative learning.

Dissecting Attending Surgeons' Operating Room Guidance: Factors That Affect Guidance Decision Making

PURPOSE

The amount of guidance provided by the attending surgeon in the operating room (OR) is a key element in developing residents' autonomy. The purpose of this study is to explore factors that affect attending surgeons' decision making regarding OR guidance provided to the resident.

METHODS

We used video-stimulated recall interviews (VSRI) throughout this 2-phase study. In Phase 1, 3 attending surgeons were invited to review separately 30 to 45 minute video segments of their prerecorded surgical operations to explore factors that influenced their OR guidance decision making. In Phase 2, 3 attending surgeons were observed and documented in the OR (4 operations, 341min). Each operating surgeon reviewed their videotaped surgical performance within 5 days of the operation to reflect on factors that affected their decision making during the targeted guidance events. All VSRI were recorded. Thematic analysis and manual coding were used to synthesize and analyze data from VSRI transcripts, OR observation documents, and field notes.

RESULTS

A total of 255 minutes of VSRI involving 6 surgeons and 7 surgical operations from 5 different procedures were conducted. A total of 13 guidance decision-making influence factors from 4 categories were identified (Cohen's κ = 0.674): Setting (case schedule and patient morbidity), content (procedure attributes and case progress), resident (current competency level, trustworthiness, self-confidence, and personal traits), and attending surgeon (level of experience, level of comfort, preferred surgical technique, OR training philosophy, and responsibility as surgeon). A total of 5 factors (case schedule, patient morbidity, procedure attributes, resident current competency level, and trustworthiness) influenced attending surgeons' pre-OR guidance plans. "OR training philosophy" and "responsibility as surgeon" were anchor factors that affected attending surgeons' OR guidance decision-making patterns.

CONCLUSIONS

Surgeons' OR guidance decision making is a dynamic process that is influenced by 13 situational factors. These factors can be used by residency programs to tailor strategies designed to increase resident autonomy in the OR.

Resident Surgeons Underrate Their Laparoscopic Skills and Comfort Level When Compared With the Rating by Attending Surgeons

OBJECTIVE

The development of operative skills during general surgery residency depends largely on the resident surgeons' (residents) ability to accurately self-assess and identify areas for improvement. We compared evaluations of laparoscopic skills and comfort level of residents from both the residents' and attending surgeons' (attendings') perspectives.

DESIGN

We prospectively observed 111 elective cholecystectomies at the University of Michigan as part of a larger quality improvement initiative. Immediately after the operation, both residents and attendings completed a survey in which they rated the residents' operative proficiency, comfort level, and the difficulty of the case using a previously validated instrument. Residents' and attendings' evaluations of residents' performance were compared using 2-sided t tests.

SETTING

The University of Michigan Health System in Ann Arbor, MI. Large academic, tertiary care institution.

PARTICIPANTS

All general surgery residents and faculty at the University of Michigan performing laparoscopic cholecystectomy between June 1 and August 31, 2013. Data were collected for 28 of the institution's 54 trainees.

RESULTS

Attendings rated residents higher than what residents rated themselves on a 5-point Likert-type scale regarding depth perception (3.86 vs. 3.38, p < 0.005), bimanual dexterity (3.75 vs. 3.36, p = 0.005), efficiency (3.58 vs. 3.18, p < 0.005), tissue handling (3.69 vs. 3.23, p < 0.005), and comfort while performing a case (3.86 vs. 3.38, p < 0.005). Attendings and residents were in agreement on the level of autonomy displayed by the resident during the case (3.31 vs. 3.34, p = 0.85), the level of difficulty of the case (2.98 vs. 2.85, p = 0.443), and the degree of teaching done by the attending during the case (3.61 vs. 3.54, p = 0.701).

CONCLUSIONS

A gap exists between residents' and attendings' perception of residents' laparoscopic skills and comfort level in performing laparoscopic cholecystectomy. These findings call for improved communication between residents and attendings to ensure that graduates are adequately prepared to operate independently. In the context of changing methods of resident evaluations that call for explicitly defined competencies in surgery, it is essential that residents are able to accurately self-assess and be in general agreement with attendings on their level of laparoscopic skills and comfort level while performing a case.