Trainee Participation Is Associated With Adverse Outcomes in Emergency General Surgery: An Analysis of the National Surgical Quality Improvement Program Database

Resident and Attending Perceptions of Resident Involvement: An Analysis of ACGME Reporting Guidelines

OBJECTIVE

For general surgery residents (Residents) to log an operation, the ACGME requires "significant involvement" in diagnosis (DX), operation selection (SEL), operation (OPR), preoperative (PRE), and postoperative (POC) care. We compared how residents and attending surgeons (Attendings) perceived residents' role in each of these core requirements.

DESIGN

Residents and attendings completed surveys postoperatively regarding responsibility for each core requirement on a 5-point Likert scale from "Completely Attending" to "Completely Resident." Significance was determined using Chi-square analysis (p < 0.05) and degree of agreement was calculated using Spearman's rank correlation (r_s).

SETTING

Boston Medical Center, Boston, MA (tertiary institution).

RESULTS

A total of 302 paired surveys were analyzed. Residents more often performed a significant portion of the later stages of care (DX = 27%, PRE = 29%, SEL = 27%, OPR = 87%, and POC = 84%). Residents completed the majority of each requirement more frequently in operations performed in the acute setting compared to elective operations: DX (70% vs 8%, p < 0.01), PRE (74% vs 10%, p < 0.01), SEL (65% vs 11%, p < 0.01), OPR (100% vs 89%, p = 0.02), POC (100% vs 77%, p < 0.01). Resident participation was inversely related to operational complexity for DX (p < 0.01), PRE (p < 0.01), SEL (p < 0.01), and OPR (p = 0.01). Resident involvement in OPR increased at the end of the academic year (p = 0.05) and when working with junior attendings (<5 years in practice) (p = 0.01). Interpair agreement was greatest for DX (r_s = 0.70) and lowest for POC (r_s = 0.35). When residents and attendings did not agree in their answers, residents generally overstated their contribution to the DX (68%), PRE (58%), and SEL (64%) but understated their contribution in OPR (63%) and POC (62%).

CONCLUSIONS

Residents and attendings demonstrated reliable agreement for most core requirements, but residents were often unable to be involved in all 5 core requirements. Resident involvement was weighted toward later stages of patient care, yet residents often underestimated their contributions. Operational acuity, complexity, and attending experience correlated with resident operative involvement.

Evaluation of Procedural Simulation as a Training and Assessment Tool in General Surgery-Simulating a Laparoscopic Appendectomy

BACKGROUND

Laparoscopic appendectomy is a commonly performed surgical procedure, but few training models have been described for it. We examined a virtual reality module for practising a laparoscopic appendectomy.

METHODS

A prospective cohort study with the following 3 groups of surgeons (n = 45): novices (0 procedures), intermediates (10-50 procedures), and experienced (>100 procedures). After being introduced to the simulator and 1 familiarization attempt on the procedural module, the participants practiced the module 20 times. Movements, task time, and procedure-specific parameters were compared over time.

RESULTS

The time and movement parameters were significantly different during the first attempt, and more experienced surgeons used fewer movements and less time than novices (p < 0.01), although only 2 parameters were significantly different between novices and intermediates. All 3 groups improved significantly over 20 attempts (p < 0.0001). The intraclass correlation coefficient varied between 0.55 and 0.68 and did not differ significantly between the 3 groups (p > 0.05). When comparing novices with experienced surgeons, novices had a higher risk of burn damage to cecum (odds ratio [OR] = 3.0 [95% CI: 1.3; 7.0] p = 0.03), pressure damage to appendix (OR = 3.1 [95% CI: 2.0; 4.9] p < 0.0001), and grasping of the appendix (OR = 2.9 [95% CI: 1.8; 4.7] p < 0.0001). The risk of causing a perforation was not significantly different among the different experience levels (OR = 1.9 [95% CI: 0.9; 3.8] p = 0.14). Only 3 out of 5 error parameters differed significantly when comparing novices and experienced surgeons. Similarly, when comparing intermediates and novices, it was only 2 of the parameters that differed.

DISCUSSION

The simulator module for practising laparoscopic appendectomy may be useful as a training tool, but further development is required before it can be used for assessment purposes. Procedural simulation may demonstrate more variation for movement parameters, and future research should focus on developing better procedure-specific parameters.

Does Trainee Involvement in Fluoroscopic Injections Affect Fluoroscopic Time, Immediate Pain Reduction, and Complication Rate?

BACKGROUND

Patients have expressed concern about undergoing procedures involving trainees, even with direct attending physician supervision. Little literature has examined the effect of trainee involvement on patient outcomes.

OBJECTIVE

We aimed to evaluate the effect of trainee involvement on patient complications, immediate pain reduction, and fluoroscopic time for different fluoroscopic injection types.

DESIGN

Retrospective review.

SETTING

Four academic outpatient institutions with Accreditation Council for Graduate Medical Education (ACGME)-accredited residency (physical medicine and rehabilitation, or anesthesiology) or fellowship (sports medicine or pain medicine) programs from 2000 to 2015.

PATIENTS

All patients receiving fluoroscopically guided hip (HI), sacroiliac joint (SIJI), transforaminal epidural (TFEI), and/or interlaminar epidural injections (ILEI, performed at only 1 institution).

METHODS

Outcome measures were examined based on the presence or absence of a trainee during the procedure.

MAIN OUTCOME MEASUREMENTS

The primary outcome was the number of immediate complications, with secondary outcomes being fluoroscopic time per injection (FTPI) and immediate numeric rating scale percentage improvement.

RESULTS

Trainees were involved in 67.0% of all injections (N = 7,833). Complication rates or improvements in numeric rating scale scores showed no significant differences with trainee involvement for any injection type (P > .05). Trainee involvement was associated with increased FTPI for ILEIs (18.2 ± 10.1 seconds with trainees versus 15.1 ± 8.5 seconds without trainees, P < .001), but not for HIs (P = .60) or SIJIs (P = .51). Trainee involvement with TFEIs was dependent on institution for outcome with respect to FTPI (P < .001), with 28.1 ± 17.9 seconds with trainees and 32.1 ± 22.1 seconds without trainees (P = 0.51).

CONCLUSIONS

This large multicenter study of academic institutions demonstrates that trainee involvement in fluoroscopically guided injections does not affect immediate patient complications or pain improvement. Trainee involvement does not increase fluoroscopic time for most injections, although there is an institutional difference seen. This study supports the notion that appropriate trainee supervision likely does not compromise patient safety for fluoroscopically guided injections.

LEVEL OF EVIDENCE

II.

Risk factors associated with venous thromboembolism in patients undergoing spine surgery

OBJECTIVE

Patients undergoing spinal surgery are at risk for developing venous thromboembolism (VTE). The authors sought to identify risk factors for VTE in these patients.

METHODS

The American College of Surgeons National Surgical Quality Improvement Project database for the years 2006–2010 was reviewed for patients who had undergone spinal surgery according to their primary Current Procedural Terminology code(s). Clinical factors were analyzed to identify associations with VTE.

RESULTS

Patients who underwent spinal surgery (n = 22,434) were identified. The rate of VTE in the cohort was 1.1% (pulmonary embolism 0.4%; deep vein thrombosis 0.8%). Multivariate binary logistic regression analysis revealed 13 factors associated with VTE. Preoperative factors included dependent functional status, paraplegia, quadriplegia, disseminated cancer, inpatient status, hypertension, history of transient ischemic attack, sepsis, and African American race. Operative factors included surgery duration > 4 hours, emergency presentation, and American Society of Anesthesiologists Class III–V, whereas postoperative sepsis was the only significant postoperative factor. A risk score was developed based on the number of factors present in each patient. Patients with a score of ≥ 7 had a 100-fold increased risk of developing VTE over patients with a score of 0. The receiver-operating-characteristic curve of the risk score generated an area under the curve of 0.756 (95% CI 0.726–0.787).

CONCLUSIONS

A risk score based on race, preoperative comorbidities, and operative characteristics of patients undergoing spinal surgery predicts the postoperative VTE rate. Many of these risks can be identified before surgery. Future protocols should focus on VTE prevention in patients who are predisposed to it.

Ensuring Competency of Novice Laparoscopic Surgeons-Exploring Standard Setting Methods and their Consequences

OBJECTIVE

Simulation-based assessment tools have been developed to allow for proficiency-based simulator training in laparoscopy. However, few studies have examined the consequences of different standard setting methods or examined what level of proficiency is considered adequate for trainees. The objectives of the present study were to explore the consequences of different standard setting methods and to examine the proficiency level that surgical trainees are expected to reach, before performing supervised surgery on patients.

DESIGN

Study participants undertook the Training and Assessment of Basic Laparoscopic Techniques test. The tests were video-recorded and rated using a simple scoring system based on number of errors and time. Participants were then asked to assess how high a score a novice should reach before performing supervised surgery on a patient. We then compared 3 methods of standard setting: expert performance level, contrasting groups method, and a modified Angoff method.

SETTING

The study was conducted at the Copenhagen Academy for Medical Education and Simulation. The academy provides surgical simulation training in laparoscopy for trainees at the hospitals in the Capital Region and the Zealand Region of Denmark.

PARTICIPANTS

Participants were recruited among surgical trainees in their first year of specialty training from surgery, gynecology, and urology departments. A total of 40 participants were included and completed the trial.

RESULTS

The different standard setting methods resulted in different pass/fail levels. At the expert performance level, the pass/fail level was 474 points-the contrasting groups method resulted in 358 points and the modified Angoff method resulted in 311 points among experienced surgeons, and 386 points among trainees. The different proficiency levels resulted in a failure rate of 0% to 50% of experienced surgeons and a pass rate of 0% to 25% of novices. Novice laparoscopic surgeons set a higher pass/fail level than experienced surgeons did (p = 0.008).

CONCLUSION

Required proficiency levels varies depending on the standard setting method used, which highlights the importance of using an established standard setting method to set the pass/fail level.

Transumbilical laparoscopic appendectomy performed by residents is safe and feasible

INTRODUCTION

The aim of this study was to compare the clinical outcomes of single-incision transumbilical laparoscopy-assisted appendectomy performed by surgical residents and attending surgeons.

METHODS

We reviewed the clinical outcomes of 131 transumbilical laparoscopy-assisted appendectomies performed from January 2011 to June 2014. During the study period, 13 residents and 6 board-certified attending surgeons performed the procedures. For all operations performed by residents and attending surgeons, we reviewed and compared gender, age, BMI, body temperature, white blood cell count, C-reactive protein serum level, and the presence of a fecalith or abscess. Clinical outcomes including operative time, estimated blood loss, need for additional ports, conversion to open surgery, intraoperative complications, postoperative complications, and postoperative hospital stay were compared between the two groups.

RESULTS

The mean preoperative white blood cell count in the resident-operated group was significantly higher than in the attending-operated group (14.0 vs 10.8 ×10³ /mm³ , P = 0.007). There were no other significant differences in clinical variables between the two groups. Outcomes show that estimated blood loss was significantly higher (23.4 vs 9.8 mL, P = 0.031) and operative time tended to be longer (86.0 vs 72.0 min, P = 0.056) in the resident-operated group. No other significant differences were observed.

CONCLUSION

Transumbilical laparoscopy-assisted appendectomy performed by residents is feasible and safe. It is an acceptable as a part of routine surgical training.

Trainee participation and perioperative complications in benign hysterectomy: the effect of route of surgery

BACKGROUND

Intraoperative trainee involvement in hysterectomy is common. However, the effect of intraoperative trainee involvement on perioperative complications depending on surgical approach is unknown.

OBJECTIVE

To estimate the effect of intraoperative trainee involvement on perioperative complication after vaginal, laparoscopic, and abdominal hysterectomy for benign disease.

METHODS

Patients undergoing laparoscopic, vaginal, or abdominal hysterectomy for benign disease from 2010 to 2012 were identified from the American College of Surgeons National Surgical Quality Improvement Program database. Patients with and without trainee involvement were compared with regard to perioperative complications. Complications that occurred from the start of surgery to 30-days postoperatively were included. Perioperative complications were defined via the use of the validated Clavien-Dindo scale with ≥grade 3 complications defined as major and ≤grade 2 complications defined as minor. Major complications included myocardial infarction, pneumonia, venous thromboembolism, deep or organ space surgical-site infection, stroke, fascial dehiscence, unplanned return to the operating room, renal failure, cardiopulmonary arrest, sepsis, intubation greater than 48 hours, and death. Minor complications included urinary tract infection, blood transfusion, and superficial wound infection. To estimate the effect of trainee involvement depending on route of surgery, a stratified analysis was performed. Bivariable analysis and adjusted multivariable logistic regression were used.

RESULTS

We identified 22,499 patients, of whom 42.1% had trainee participation. Surgical approaches were vaginal (22.7%), abdominal (47.1%), and laparoscopic (30.2%). The rate of major complication was 3.2%, and minor complication was 7.2%. In bivariable analysis, trainee involvement was associated with major complications in vaginal hysterectomy (3.3% vs 2.3%, P = .03), but not laparoscopic (3.0% vs 2.9%, P = .78) or abdominal hysterectomy (4.4% vs 3.6%, P = .07). Trainee involvement was also associated with minor complication in vaginal (7.3% vs 5.4%, P = .007), laparoscopic (5.9% vs 4.3%, P < .001), and abdominal hysterectomy (14.1% vs 9.2%, P < .001). In a multivariable analysis in which we adjusted for age, body mass index, medical comorbidity, American Society of Anesthesiologists score, and surgical complexity, the association between trainee involvement in vaginal hysterectomy and major complication persisted (adjusted odds ratio 1.45, 95% confidence interval 1.03-2.04); however, when operative time was added to the model, there was no longer an association between trainee involvement and major complication (adjusted odds ratio 1.26, 95% confidence interval 0.89-1.80).

CONCLUSION

Surgical approach influences the relationship between trainee involvement and perioperative complication. Operative time is a key mediator of the relationship between trainee involvement and complication, and may be a modifiable risk factor.

Education in thyroid surgery: a matched-pair analysis comparing residents and board-certified surgeons

PURPOSE

Resident participation in operative procedures is mandatory in educational residency programs but remains controversial, especially in the context of patient safety. This study compared the surgical quality and outcomes of thyroidectomies performed by surgical residents (RESs) and board-certified surgeons (BCSs).

METHODS

This retrospective matched-pair study included patients undergoing thyroidectomies for multinodular goiter, Grave's disease and early-stage thyroid cancer that were performed by a RES with BCS supervision between 2006 and 2014. The intraoperative and postoperative course, complication rates and handling of the recurrent laryngeal nerve (RLN) and parathyroid glands were analyzed.

RESULTS

In total, 112 thyroidectomies that were performed by a RES fulfilled the inclusion criteria and were matched 1:1 with BCS patients. We included 88 hemithyroidectomies, 80 subtotal thyroidectomies and 56 total thyroidectomies. No significant differences in the handling of the RLN or parathyroid glands, the rates of postoperative RLN palsies or the rates of hypocalcaemia were found. No intraoperative complications led to the replacement of the RES as the surgeon-in-charge. Three RES and two BCS patients experienced postoperative haemorrhages (p = 0.205), and three surgical site infections (p = 1.000) occurred in each group. The mean operative time and the length of stay did not differ significantly between the two groups.

CONCLUSIONS

Major aspects of patient safety in thyroid surgery are not affected by resident participation. Thyroidectomies performed by RES are not significantly longer and reveal no differences in length of stay or complication rates. The economic burden of resident involvement is modest.

Emergency General Surgery: evolution of a subspecialty by stealth

BACKGROUND

Emergency surgical patients account for around half of all NHS surgical workload and 80 % of surgical deaths. Few trainees opt to CCT in General Surgery, and there is no recognised subspecialty training program in Emergency General Surgery (EGS). Despite this lack of training and relevant assessment by examination, there appears to be an increasing number of EGS posts advertised. This study aims to provide information about potential future employment opportunities for surgical trainees.

METHODS

All consultant surgeon posts, advertised in the British Medical Journal between January 2009 and December 2014 were included. Data collected included specialty, region and institute of advertised post. For the purposes of statistical analysis, data was divided into two separate year bands: 2009-2011 and 2012-2014. Statistical analysis was by Chi-squared test; p <0.01 was considered statistically significant. An online tool was also used to determine experience and attitudes towards EGS amongst Consultant members of the ASGBI and all UK trainees in national training number (NTN) posts.

RESULTS

Over the six-year study period, there were 1240 consultant job adverts in a general surgical specialty. Nine hundred and 75 were substantive posts; the region with the most jobs was London and the South East (n = 278). There were 55 jobs advertised in EGS, either with (20) or without (35) another subspecialty. The number of EGS adverts increased significantly in 2012-14 compared to 2009-11 (p = 0.008). 229 (28 %) Consultants and 309 (22 %) trainees responded to the survey. 16 % of consultants work in NHS institutions with Emergency General Surgeons. Only 21 % of trainees believe EGS will be delivered by EGS consultants in the future whilst 8.2 % of trainees stated EGS as their career plan. Less than half of all UK consultant surgeons see EGS as a subspecialty.

CONCLUSIONS

This data demonstrates increasing societal need for EGS consultants over the last six years and the emergence of Emergency Surgery as a new subspecialty. In order to meet the EGS needs of the NHS, general surgical training and the examination system need to be revised.

Defining competencies for safe thyroidectomy: An international Delphi consensus

BACKGROUND

Current methods for teaching and assessing competencies that characterize expert intraoperative performance are inconsistent, subjective, and lack standardization. This mixed-methods study was designed to define and establish expert consensus on the most important competencies required to perform a thyroidectomy safely.

METHODS

Cognitive task analyses for thyroidectomy were performed with semistructured interviews of experts in thyroid surgery. Verbal data were transcribed verbatim, coded, and categorized according to themes that were synthesized into a list of items. Once qualitative data reached saturation, 26 experts were invited to complete 2-round online Delphi surveys to rank each item on a Likert scale of importance (1-7). Consensus was predefined as a Cronbach's α ≥ 0.80.

RESULTS

Sixty items were synthesized from 5 interviews and categorized into 8 sections: preparation (n = 8), incision/exposure (n = 11), general considerations (n = 4), middle thyroid vein (n = 1), superior pole (n = 5), inferior pole (n = 5), posterolateral dissection (n = 19), and closure (n = 7). Eighteen (69%) experts from 3 countries participated in the Delphi survey. Consensus was achieved after 2 voting rounds (Cronbach's α = 0.95). Greatest weighted sections included "Superior Pole Dissection" and "Posterolateral Dissection."

CONCLUSION

Consensus was achieved on defining the most important competencies for safe thyroidectomy. This blueprint serves as the basis for instructional design and objective assessment tools to evaluate performance.

Components of Hospital Perioperative Infrastructure Can Overcome the Weekend Effect in Urgent General Surgery Procedures

OBJECTIVE

We hypothesized that perioperative hospital resources could overcome the "weekend effect" (WE) in patients undergoing emergent/urgent surgeries.

SUMMARY BACKGROUND DATA

The WE is the observation that surgeon-independent patient outcomes are worse on the weekend compared with weekdays. The WE is often explained by differences in staffing and resources resulting in variation in care between the week and weekend.

METHODS

Emergent/urgent surgeries were identified using the Healthcare Cost and Utilization Project State Inpatient Database (Florida) from 2007 to 2011 and linked to the American Hospital Association (AHA) Annual Survey Database to determine hospital level characteristics. Extended median length of stay (LOS) on the weekend compared with the weekdays (after controlling for hospital, year, and procedure type) was selected as a surrogate for WE.

RESULTS

Included were 126,666 patients at 166 hospitals. A total of 17 hospitals overcame the WE during the study period. Logistic regression, controlling for patient characteristics, identified full adoption of electronic medical records (OR 4.74), home health program (OR 2.37), pain management program [odds ratio (OR) 1.48)], increased registered nurse-to-bed ratio (OR 1.44), and inpatient physical rehabilitation (OR 1.03) as resources that were predictors for overcoming the WE. The prevalence of these factors in hospitals exhibiting the WE for all 5 years of the study period were compared with those hospitals that overcame the WE (P < 0.001).

CONCLUSIONS

Specific hospital resources can overcome the WE seen in urgent general surgery procedures. Improved hospital perioperative infrastructure represents an important target for overcoming disparities in surgical care.

The effect of residents as teaching assistants on operative time in laparoscopic cholecystectomy

BACKGROUND

We examined the effect of primary surgeon (PS) and teaching assistant (TA) seniority on operative time and outcomes for residents performing laparoscopic cholecystectomy (LC).

METHODS

This was a retrospective analysis of urgent LC at a county teaching hospital. Relevant data included postgraduate year (PGY) of the PS and TA and markers of disease severity. Primary outcome was operative time. Secondary outcomes were conversion to open cholecystectomy and complications.

RESULTS

There were 1,202 LCs; 415 included an intraoperative cholangiogram. On multivariable analysis, every PGY increase of PS decreased operative time by 3.2 minutes (P = .02). For every PGY increase of TA, operative time decreased 10.8 minutes (P < .001). Acute or gangrenous pathology increased conversion to open surgery (P < .001). Seniority of PS and TA was not associated with increases in conversion or complication rates.

CONCLUSIONS

Residents' operative time improves as experience with LC increases. These improvements become more profound after adjusting for the seniority of the TA.