Trainee Autonomy in Minimally Invasive General Surgery in the United States: Establishing a National Benchmark

General Surgery Residents Competence and Autonomy in Core Vascular Surgery Procedures

OBJECTIVE

As vascular surgery has become increasingly sub-specialized, the scope of vascular care that general surgeons can be trained to provide has come into question. Thus, we sought to understand the competence and autonomy of general surgery residents (GSR) in core vascular surgery procedures.

DESIGN

Three core operations in vascular surgery were identified: lower extremity (LE) amputations, arteriovenous fistula (AVF) creation, and LE embolectomy and thrombectomy (thromboembolectomy). Assessment of GSRs autonomy and performance for these operations were obtained from the System for Improving and Measuring Procedural Learning (SIMPL) application from 2018 to 2022. Data were analyzed using a combination of descriptive statics and chi-square tests. Logistic generalized linear mixed models (GLMM) were also performed.

RESULTS

1950 SIMPL operative assessments were analyzed. Senior residents were found to be meaningfully autonomous and competent in 82% (n = 237) and 66% (n = 189) of LE amputation assessments and 50% (n = 225) and 32% (n = 142) of AVF assessments, respectively. The majority of senior residents failed to achieve meaningful autonomy (n = 99, 67%) and competence (n = 116, 80%) for LE thromboembolectomy cases, while the majority of junior and midlevel residents failed to achieve meaningful autonomy and competence for all 3 procedures. For an average case, a senior resident had an 86% (95% CI: 79% - 89%) chance of achieving competence during LE amputation, 41% (95% CI: 43% - 62%) chance during AVF, and 21% (95% CI: 27% - 52%) chance during LE thromboembolectomy.

CONCLUSION

In this study, GSR failed to achieve competence and meaningful autonomy for 3 core procedures, including AVF creation. Notably, the creation of an AVF was recently included within the new Entrustable Professional Activities (EPAs) for general surgery. However, the results of this study suggest that GSR will fail to demonstrate the competence needed for entrustment. Training requirements for general surgery residents in vascular surgery may need to be reassessed.

An At-Home Laparoscopic Curriculum for Junior Residents in Surgery, Obstetrics/Gynecology, and Urology

Introduction

Laparoscopic surgery requires significant training, and prior studies have shown that surgical residents lack key laparoscopic skills. Many educators have implemented simulation curricula to improve laparoscopic training. Given limited time for dedicated, in-person simulation center practice, at-home training has emerged as a possible mechanism by which to expand training and promote practice. There remains a gap in published at-home laparoscopic curricula employing embedded feedback mechanisms.

Methods

We developed a nine-task at-home laparoscopic curriculum and an end-of-curriculum assessment following Kern's six-step approach. We implemented the curriculum over 4 months with first- to third-year residents.

Results

Of 47 invited residents from general surgery, obstetrics/gynecology, and urology, 37 (79%) participated in the at-home curriculum, and 25 (53%) participated in the end-of-curriculum assessment. Residents who participated in the at-home curriculum completed a median of six of nine tasks (interquartile range: 3-8). Twenty-two residents (47%) responded to a postcurriculum survey. Of these, 19 (86%) reported that their laparoscopic skills improved through completion of the curriculum, and the same 19 (86%) felt that the curriculum should be continued for future residents. Residents who completed more at-home curriculum tasks scored higher on the end-of-curriculum assessment (p = .009 with adjusted R 2 of .28) and performed assessment tasks in less time (p = .004 with adjusted R 2 of .28).

Discussion

This learner-centered laparoscopic curriculum provides guiding examples, spaced practice, feedback, and graduated skill development to enable junior residents to improve their laparoscopic skills in a low-stakes, at-home environment.

See One, Do One, Improve One's Wellness: Resident Autonomy in US General Surgery Programs, A Mixed-methods Study

OBJECTIVE

We sought to examine the factors associated with resident perceptions of autonomy and to characterize the relationship between resident autonomy and wellness.

BACKGROUND

Concerns exist that resident autonomy is decreasing, impacting competence.

METHODS

Quantitative data were collected through a cross-sectional survey administered after the 2020 ABSITE. Qualitative data were collected through interviews and focus groups with residents and faculty at 15 programs.

RESULTS

Seven thousand two hundred thirty-three residents (85.5% response rate) from 324 programs completed the survey. Of 5139 residents with complete data, 4424 (82.2%) reported appropriate autonomy, and these residents were less likely to experience burnout [odds ratio (OR) 0.69; 95% CI 0.58-0.83], suicidality (OR 0.69; 95% CI 0.54-0.89), and thoughts of leaving their programs (OR 0.45; 95% CI 0.37-0.54). Women were less likely to report appropriate autonomy (OR 0.81; 95% CI 0.68-0.97). Residents were more likely to report appropriate autonomy if they also reported satisfaction with their workload (OR 1.65; 95% CI 1.28-2.11), work-life balance (OR 2.01; 95% CI 1.57-2.58), faculty engagement (OR 3.55; 95% CI 2.86-4.35), resident camaraderie (OR 2.23; 95% CI, 1.78-2.79), and efficiency and resources (OR 2.37; 95% CI 1.95-2.88). Qualitative data revealed that (1) autonomy gives meaning to the clinical experience of residency, (2) multiple factors create barriers to autonomy, and (3) autonomy is not inherent to the training paradigm, requiring residents to learn behaviors to "earn" it.

CONCLUSION

Autonomy is not considered an inherent part of the training paradigm such that residents can assume that they will achieve it. Resources to function autonomously should be allocated equitably to support all residents' educational growth and wellness.

Graded operative autonomy in emergency appendectomy mirrors case-complexity: surgical training insights from the SnapAppy prospective observational study

INTRODUCTION

Surgical skill, a summation of acquired wisdom, deliberate practice and experience, has been linked to improved patient outcomes. Graded mentored exposure to pathologies and operative techniques is a cornerstone of surgical training. Appendectomy is one of the first procedures surgical trainees perform independently. We hypothesize that, given the embedded training ethos in surgery, coupled with the steep learning curve required to achieve trainer-recognition of independent competency, 'real-world' clinical outcomes following appendectomy for the treatment of acute appendicitis are operator agnostic. The principle of graded autonomy matches trainees with clinical conditions that they can manage independently, and increased complexity drives attending input or assumption of the technical aspects of care, and therefore, one cannot detect an impact of operator experience on outcomes.

MATERIALS AND METHODS

This study is a subgroup analysis of the SnapAppy international time-bound prospective observational cohort study (ClinicalTrials.gov Trial #NCT04365491), including all consecutive patients aged ≥ 15 who underwent appendectomy for appendicitis during a three-month period in 2020-2021. Patient- and surgeon-specific variables, as well as 90-day postoperative outcomes, were collected. Patients were grouped based on operating surgeon experience (trainee only, trainee with direct attending supervision, attending only). Poisson and quantile regression models were used to (adjusted for patient-associated confounders) assess the relationship between surgical experience and postoperative complications or hospital length of stay (hLOS), respectively, adjusted for patient-associated confounders. The primary outcome of interest was any complications within 90 days.

RESULTS

A total of 4,347 patients from 71 centers in 14 countries were included. Patients operated on by trainees were younger (Median (IQR) 33 [24-46] vs 38 [26-55] years, p < 0.001), had lower ASA classifications (ASA ≥ 3: 6.6% vs 11.6%, p < 0.001) and fewer comorbidities compared to those operated on by attendings. Additionally, trainees operated alone on fewer patients with appendiceal perforation (AAST severity grade ≥ 3: 8.7% vs 15.6%, p < 0.001). Regression analyses revealed no association between operator experience and complications (IRR 1.03 95%CI 0.83-1.28 for trainee vs attending; IRR 1.13 95%CI 0.89-1.42 for supervised trainee vs attending) or hLOS.

CONCLUSION

The linkage of case complexity with operator experience within the context of graduated autonomy is a central tenet of surgical training. Either subconsciously, or by design, patients operated on by trainees were younger, fitter and with earlier stage disease. At least in part, these explain why clinical outcomes following appendectomy do not differ depending on the experience of the operating surgeon.

Multicenter retrospective cohort Italian study on elective laparoscopic cholecystectomy performed by the surgical residents

PURPOSE

This retrospective multicenter cohort study aimed to evaluate the clinical outcomes (mortality rate, operative time, complications) of elective laparoscopic cholecystectomy (LC) when performed by a surgical resident in comparison to experienced consultant in the backdrop of Italian academic centers.

METHODS

Retrospective review of all patients undergoing elective LC between January 2016 and January 2022 at six teaching hospitals across Italy was performed. Cases were identified using the Current Procedural Terminology (CPT) code 5123 (LC without cholangiogram). All cases of emergency surgery, ASA score > 3, or when cholecystectomy was performed with another surgical procedure, were excluded. All suitable cases were divided into 2 groups based on primary surgeon: consultant or senior resident. Main outcome was complication rates (intraoperative and peri/postoperative); secondary outcomes included operative time, the length of stay, and the rate of conversion to open.

RESULTS

A total of 2331 cases (1425 females) were included, of which, consultants performed 1683 LCs (72%), while the residents performed 648 (28%) surgeries. The groups were statistically comparable regarding demographics, history of previous abdominal surgery, operative time, or intraoperative complications. The rate of conversion to open cholecystectomy was 1.42% for consultant and none for resident (p = 0.02). A statistically significant difference was observed between groups regarding the average length of stay (2.2 ± 3 vs 1.6 ± 1.3 days p = 0.03). Similarly, postoperative complications (1.7% vs 0.5%) resulted in statistically significant (p = 0.02) favoring resident group.

CONCLUSIONS

Our study demonstrates that in selected patients, senior residents can safely perform LC when supervised by senior staff surgeons.

OUP accepted manuscript

BACKGROUND

Surgical training is aimed towards entrusted professional activity to obtain operative independence. Laparoscopic appendicectomy is performed early in training but except for simulators, real-life evaluation towards proficiency is scarce. The aim of this study was to model how each consecutive step may impact on the overall proficiency score for surgical trainees performing laparoscopic appendicectomy.

METHODS

This was an observational cohort study of laparoscopic appendicectomy performed by junior trainees (PGY1-4) under supervision and evaluated for each of eight steps. Each step was scored on a validated six-point performance scale and classified as 'fail', 'pass', or 'proficient'. Modelling was conducted with a multivariable regression model and artificial neural network model with a multilayer perceptron for the relationship between steps and overall performance.

RESULTS

Of 157 procedures, 97 (61.8 per cent) procedures were evaluated as 'proficient', 46 (29.3 per cent) were 'pass', and 14 (8.9 per cent) were 'fail'. In regression analyses, handling the mesoappendix was significantly associated with procedure proficiency, as were division of appendix, access to abdomen, and ability to handle the small bowel. The widest variation in operative flow was shown for steps involving mesoappendix and division of appendix, conceptualized in 'ebb-and-flow' and 'string-of-pearls' models. Sensitivity analyses for experience using 20 or fewer, 30 or fewer, or more than 30 procedures as cut-offs reproduced comparable results.

CONCLUSIONS

Consistent stumbling blocks for junior trainees performing laparoscopic appendectomies can be conceptualized through novel models that identify steps deemed to be the most difficult to trainees with variable experience.

Multi-institutional Study of Otolaryngology Resident Intraoperative Experiences for Key Indicator Procedures

OBJECTIVE

There is concern that current otolaryngology residents may not receive adequate surgical training. We aimed to characterize residents' surgical experiences at 5 academic centers performing the 14 key indicator procedures (KIPs) outlined by the Accreditation Council for Graduate Medical Education.

STUDY DESIGN

Prospective study.

SETTING

Five otolaryngology training programs.

METHODS

Data were gathered from December 2019 to December 2020 with a smartphone application from the Society for Improving Medical Professional Learning. After each operation, residents and faculty rated trainee autonomy on a 4-level Zwisch scale and performance on a 5-level modified Dreyfus scale.

RESULTS

Residents and attendings (n = 92 and 78, respectively) logged 2984 evaluations. Attending ratings of resident autonomy and performance increased with training level (P < .001). Resident self-assessments of autonomy and performance were lower than paired attending assessments (P < .001). Among attending evaluations of KIPs performed by senior residents (postgraduate year 4 or 5), 55% of cases were performed with meaningful autonomy (passive help or supervision only). Similarly, attendings rated 55% of these cases as a practice-ready or exceptional performance. Senior residents had meaningful autonomy for ≥50% of cases for most KIPs, with the exception of flaps and grafts (40%), pediatric/adult airway (39%), and stapedectomy/ossiculoplasty (33%). Similarly, senior residents received practice-ready or exceptional performance ratings for ≥50% of cases across all KIPs other than pediatric/adult airway (42%) and stapedectomy/ossiculoplasty (33%).

CONCLUSION

In this multicenter study, resident surgical autonomy and performance varied across otolaryngology KIPs. The development of nationwide benchmarks will help programs and residents set educational goals.

LEVEL OF EVIDENCE

2.

Deciphering the inflection points to achieve proficiency for each procedure step during training in laparoscopic appendicectomy

Background

Laparoscopic appendicectomy is a common procedure early in surgical training. A minimum number is usually required for certification in general surgery. However, data on proficiency are scarce. This study aimed to investigate steps towards proficiency in laparoscopic appendicectomy.

Methods

This was a prospective observational cohort study of laparoscopic appendicectomies performed by junior trainees under supervision scored on a six-point performance scale. Structured assessment was done within a defined programme. Procedures performed for uncomplicated appendicitis in adults were included. The procedures were evaluated with LOWESS graphs generated to investigate inflection points. Factors associated with proficiency rates were reported with odds ratios and 95 per cent confidence intervals.

Results

In total 142 laparoscopic procedures were included for 19 trainees (58 per cent female). The cumulative number of procedures during the study was a median of 20 (i.q.r. 8–33). For overall proficiency, an inflection point occurred at 30 procedures. Proficiency rate increased from 51 per cent for 30 or fewer procedures to 93 per cent for more than 30 procedures (odds ratio 11.9 (95 per cent c.i. 3.4 to 40.9); P < 0.001). Inflection points for proficiency for each procedure step varied considerably, with lowest numbers (fewer than 15 procedures) for removing the specimen, and highest for dividing the mesoappendix (more than 55 procedures). Operating time was significantly reduced by a median of 7 minutes after 30 procedures, from median 62 (i.q.r. 25–120) minutes to median 55 (i.q.r. 30–110) minutes for more than 30 procedures.

Conclusion

For junior trainees, variation in proficiency is related to specific procedure steps. Targeted training on specific procedure skills may reduce numbers needed to achieve proficiency in laparoscopic appendicectomy during training.

Learning curve and global benchmark values of laparoscopic sleeve gastrectomy: results of first 100 cases of a newly trained surgeon in an Italian center of excellence

To evaluate whether the learning curve for sleeve gastrectomy could be completed after 50 cases. First 100 patients undergoing LSG under a newly trained laparoscopic surgeon were included in this study and divided into two groups of 50 consecutive patients each. Perioperative outcomes were compared to recently introduced global benchmarks. Short-term weight loss was calculated as Total Weight Loss Percent (%TWL) and complications were classified in accordance with the Clavien–Dindo classification. CUSUM analysis was performed for operative time and hospital stay. Mean preoperative age and BMI were 41.8 ± 10.3 years and 42.9 ± 5.4 kg/m², respectively. Demographics and rate of patients with previous surgery were comparable preoperatively in the two groups. Mean operative time was 92.1 ± 19.3 min and hospital stay was 3.4 ± 0.6 days as per our standard protocol of discharge. Uneventful postoperative course was recorded in 93% of patients and only one case of staple line leak was registered in the first 50 cases (group 1). No statistical difference in BMI and %TWL was found between the two groups at any time of follow-up. Comparison between two groups showed a significant reduction in hospital stay and operative time after the first 50 LSGs (p < 0.05). LSG can be performed by newly trained surgeons proctored by senior tutors. At least 50 cases are needed to meet global benchmark cut-offs and few more cases may be required to reach the plateau of the learning curve.