The Impact of ACGME Work-Hour Reforms on the Operative Experience of Fellows in Surgical Subspecialty Programs

A Dual-Institutional Study on First Year Practice Outcomes of Pediatric Surgeons Who Trained in the Era of Work Hour Restrictions

BACKGROUND

In July 2003, an 80-h work week restriction for residencies was mandated. This was met with skepticism regarding its potential impact on operative training. We hypothesized no difference in outcomes for pediatric surgeons who trained under duty hour restrictions compared to historical complication rates.

METHODS

Dual-institutional review of pediatric patients who underwent five of the most common operations (2013-2018) by first-year pediatric surgeons who trained under duty hour restrictions was performed. Tests of proportions were used to compare complication rates to published rates on data collected prior to 2003.

RESULTS

Patient mean age was 10.1 years. No significant differences (p values > 0.05) were found in laparoscopic appendectomy rates of infection, bleeding or intra-abdominal abscess compared to previously published rates. Pyloromyotomy rates of infection or duodenal perforation were not different. No differences were detected in rates of infection, recurrence or testicular atrophy for inguinal hernia repair. Umbilical hernia rates of infection, bleeding, and recurrence were also not different. There was no difference in CVC rates of hemopneumothoraces; significantly more bleeding events were detected (1.2% vs. 0.1%; p value = 0.04).

CONCLUSION

In this study, first-year complication rates of pediatric surgeons who trained under duty hour restrictions were not significantly different when compared to published rates.

Prevalence of and Associations With Distress and Professional Burnout Among Otolaryngologists: Part I, Trainees

OBJECTIVE

To assess the prevalence of distress and burnout in otolaryngology trainees, including associations with relevant sociodemographic and professional factors, and to compare these results with those of attending otolaryngologists.

STUDY DESIGN

A cross-sectional survey of trainees and attending physicians.

SETTING

Twelve academic otolaryngology programs.

METHODS

Distress and burnout were measured with the Expanded Physician Well-being Index and the 2-item Maslach Burnout Inventory. The Patient Health Questionnaire-2 and Generalized Anxiety Disorder-2 were used to screen for depressive disorders and anxiety disorders, respectively. Associations with sociodemographic and professional characteristics were assessed.

RESULTS

Of the 613 surveys administered to trainees and attending physicians, 340 were completed (56%). Among 154 trainees, distress was present in 49%, professional burnout in 35%, positive depressive disorder screening in 5%, and positive anxiety disorder screening in 16%. In univariable analysis, female gender, hours worked in a typical week (HW), and nights on call in a typical week (NOC) were significantly associated with distress. In multivariable analysis, female gender (odds ratio, 3.91; P = .001) and HW (odds ratio for each 10 HW, 1.89; P = .003) remained significantly associated with distress. Female gender, HW, and NOC were significantly associated with burnout univariably, although only HW (odds ratio for each 10 HW, 1.92; P = .003) remained significantly associated with burnout in a multivariable setting. Attending physicians had less distress than trainees (P = .02) and felt less callous and less emotionally hardened than trainees (P < .001).

CONCLUSION

Otolaryngology trainees experience significant work-place distress (49%) and burnout (35%). Gender, HW, and NOC had the strongest associations with distress and burnout.

Training Effects of Visual Stroboscopic Impairment on Surgical Performance: A Randomized-Controlled Trial

OBJECTIVE

There have been numerous advances to accelerate and improve quality and dexterous proficiency of surgical training to meet the growing US demand of graduating surgeons. The authors aimed to investigate the learning effects of such limited visual input on the surgical proficiency in untrained novice surgeons.

DESIGN

A prospective randomized-controlled study was created with 11 participants in the study and 11 in the control group.

SETTING

An inanimate surgical simulation lab of a tertiary academic institution (Houston Methodist Hospital, Houston, Texas).

PARTICIPANTS

Adult medical students in the experimental group were wearing stroboscopic eyewear while performing the same tasks as students in the control group with normal vision. For 5 weeks, the subjects were scored during 3 standardized surgical tasks from the American College of Surgeons and the Association of Program Directors in Surgery Resident Skills Curriculum: knot tying, simple interrupted sutures, and a running stitch. Pretrial, we employed the State-Trait Anxiety Inventory and post-trial, the NASA Task Load Index.

RESULTS

The demographic characteristics of our study participants were uniformly distributed between the 2 cohorts: each group had 7 males and 4 females. Average ages were 23.6 and 24.2 years (p = 0.471). The anxiety was low during all 5 sessions and indifferent between both groups. At the end of the study, no changes were observed in the stroboscopic group for the knot-tying task (p = 0.619). However, for the simple interrupted and the running stitch, the students with stroboscopic glasses performed significantly better (p = 0.001 and p = 0.024, respectively). The stroboscopic students also had significantly lower NASA workload scores (p = 0.001).

CONCLUSIONS

Regular training with stroboscopic glasses that limit visual input has a significant positive effect on the technical skills of novice surgical trainees with regards to more complex tasks such as multiple simple interrupted suturing or running suture. Intermittently impaired vision is beneficial in the early education of students and surgical residents.

The ACGME Case Log System May Not Accurately Represent Operative Experience Among General Surgery Interns

OBJECTIVE

To assess if the Accreditation Council for Graduate Medical Education (ACGME) case log system accurately captures operative experience of our postgraduate year 1 (PGY-1) residents.

DESIGN

ACGME case log information was retrospectively obtained for 5 cohorts of PGY-1 residents (2011-2015) and compared to the number of operative cases captured by an institutional automated operative case report system, Surgical Access Utility System (SAUS). SAUS automatically captures all surgical team members who are listed in the operative dictation for a given case, including interns. A paired t-test analysis was used to compare number of cases coded between the 2 systems.

SETTING

Academic, tertiary care referral center with a large general surgery training program.

PARTICIPANTS

PGY-1 general surgery trainees (interns) from the years 2011-2015.

RESULTS

Forty-nine PGY-1 general surgery residents were identified over a 5-year period. Mean operative case volume per intern, per year, captured by the automated SAUS was 176.5 ± 28.1 (SD) compared to 126.3 ± 58.0 ACGME cases logged (mean difference = 50.2 cases, p < 0.001).

CONCLUSIONS

ACGME case log data may not accurately reflect the actual operative experience of our PGY-1 residents. If such data holds true for other general surgery training programs, the true impact of duty hour regulations on operative volume may be unclear when using the ACGME case log data. This current standard approach for using ACGME case logs as a representation of operative experience requires further scrutiny and potential revision to more accurately determine operative experience for accreditation purposes.

A novel use of the discrete templated notes within an electronic health record software to monitor resident supervision

Objective

Monitoring the supervision of residents can be a challenging task. We describe our experience with the implementation of a templated note system for documenting procedures with the aim of enabling automated, discrete, and standardized capture of documentation of supervision of residents performing floor-based procedures, with minimal extra effort from the residents.

Materials and methods

Procedural note templates were designed using the standard existing template within a commercial electronic health record software. Templates for common procedures were created such that residents could document every procedure performed outside of the formal procedural areas. Automated reports were generated and letters were sent to noncompliers.

Results

A total of 27 045 inpatient non-formal procedural area procedures were recorded from August 2012 to June 2014. Compliance with NoteWriter template usage averaged 86% in the first year and increased to 94.6% in the second year ( P  = .0055).

Initially, only 12.5% of residents documented supervision of any form. By the end of the first year, this was above 80%, with the gains maintained into the second year and beyond. Direct supervision was documented to have occurred where required in 62.8% in the first year and increased to 99.8% in the second year ( P  = .0001) after the addition of hard stops. Notification of attendings prior to procedures was documented 100% of the time by September 2013. Letters sent to errant residents decreased from 3.6 to 0.83 per 100 residents per week.

Conclusion

The templated procedure note system with hard stops and integrated reporting can successfully be used to improve monitoring of resident supervision. This has potential impact on resident education and patient safety.

Paediatric cardiology fellowship training: effect of work-hour regulations on scholarly activity

BACKGROUND

In 2003, work-hour regulations were implemented by the Accreditation Council for Graduate Medical Education. Much has been published regarding resident rest and quality of life as well as patient safety. There has been no examination on the effect of work-hour restrictions on academic productivity of fellows in training. Paediatric subspecialty fellows have a scholarly requirement mandated by the American Board of Pediatrics. We have examined the impact of work-hour restrictions on the scholarly productivity of paediatric cardiology fellows during their fellowship.

METHODS

We conducted a literature search for all paediatric cardiology fellows between 1998 and 2007 at a single academic institution as first or senior authors on papers published during their 3-year fellowship and 3 years after completion of their categorical fellowship (n=63, 30 fellows before 2003 and 33 fellows after 2003). The numbers of first- or senior-author fellow publications before and after 2003 were compared. We also collected data on final paediatric cardiology subspecialty career choice.

RESULTS

There was no difference in the number of fellow first-author publications before and after 2003. Before work-hour restrictions, the mean number of publications per fellow was 2.1 (±2.2), and after work-hour restrictions it was 2.0 (±1.8), (p=0.89). By subspecialty career choice, fellows who select electrophysiology, preventative cardiology, and heart failure always published within the 6-year time period.

CONCLUSIONS

Since the implementation of work-hour regulations, total number of fellow first-authored publications has not changed. The role of subspecialty choice may play a role in academic productivity of fellows in training.

Implications of transitioning to a resident night float system in neurosurgery: mortality, length of stay, and resident experience

OBJECTIVE Many neurosurgical training programs have moved from a 24-hour resident call system to a night float system, but the impact on outcomes is unclear. Here, the authors compare length of stay (LOS) for neurosurgical patients admitted before and after initiation of a night float system at a tertiary care training hospital. METHODS The neurosurgical residency at the University of Alabama at Birmingham transitioned from 24-hour call to a night float resident coverage system in July 2013. In this cohort study, all patients admitted to the neurosurgical service for 1 year before and 1 year after this transition were compared with respect to hospital and ICU LOSs, adjusted for potential confounders. RESULTS A total of 4619 patients were included. In the initial bivariate analysis, night float was associated with increased ICU LOS (p = 0.032) and no change in overall LOS (p = 0.65). However, coincident with the transition to a night float system was an increased frequency of resident service transitions, which were highly associated with hospital LOS (p < 0.01) and ICU LOS (p < 0.01). After adjusting for resident service transitions, initiation of the night float system was associated with decreased hospital LOS (p = 0.047) and no change in ICU LOS (p = 0.35). CONCLUSIONS This study suggests that a dedicated night float resident may improve night-to-night continuity of care and decrease hospital LOS, but caution must be exercised when initiation of night float results in increased resident service transitions.

No Correlation Between Work-Hours and Operative Volumes--A Comparison Between United States and Danish Operative Volumes Achieved During Surgical Residency

OBJECTIVE

Since 2003, United States residents have been limited to an 80-hour workweek. This has prompted concerns of reduced educational quality, especially inadequate operating exposure. In contrast, the Danish surgical specialty-training program mandates a cap on working hours of 37 per week. We hypothesize that there is no direct correlation between work-hours and operative volume achieved during surgical residency. To test the hypothesis, we compare Danish and US operative volumes achieved during surgical residency training.

DESIGN

Retrospective comparative study.

PARTICIPANTS

The data from the US population was extracted from the Accreditation Council for Graduate Medical Education database for General Surgery residents from 2012 to 2013. For Danish residents, a questionnaire with case categories matching the Accreditation Council for Graduate Medical Education categories were sent to all Danish surgeons graduating the national surgical residency program in 2012 or 2013, 54 in total.

RESULTS

In all, 30 graduated residents (55%) responded to the Danish survey. We found no significant differences in mean total major procedures (1002.4 vs 976.9, p = 0.28) performed during residency training, but comparing average major procedures per year, the US residents achieve significantly more (132.3 vs 195.4, p <0.01). When factoring in differences in time spent in training, this amounts to a weekly average difference of 1.2 cases throughout training.

CONCLUSIONS

In this study, we find no difference in overall surgical volumes between Danes and US residents during their surgical training. When time in training was accounted for, differences between weekly surgical volumes achieved were minor, indicating a lack of direct correlation between weekly work-hours and operative volumes achievable. Factors other than work-hours seem to effect on operative volumes achieved during training.

A Narrative Review of High-Quality Literature on the Effects of Resident Duty Hours Reforms

PURPOSE

To summarize current high-quality studies evaluating the effect and efficacy of resident duty hours reforms (DHRs) on patient safety and resident education and well-being.

METHOD

The authors searched PubMed and Medline in August 2012 and again in May 2013 for literature (1987-2013) about the effects of DHRs. They assessed the quality of articles using the Medical Education Research Study Quality Instrument (MERSQI) scoring system. They considered randomized controlled trials (RCTs), partial RCTs, and all studies with a MERSQI score ≥ 14 to be "high-quality" methodology studies.

RESULTS

A total of 72 high-quality studies met inclusion criteria. Most studies showed no change or slight improvement in mortality and complication rates after DHRs. Resident well-being was generally improved, but there was a perceived negative impact on education (knowledge acquisition, skills, and cognitive performance) following DHRs. Eleven high-quality studies assessed the impact of DHR interventions; all reported a neutral to positive impact. Seven high-quality studies assessed costs associated with DHRs and demonstrated an increase in hospital costs.

CONCLUSIONS

The results of most studies that allow enough time for DHR interventions to take effect suggest a benefit to patient safety and resident well-being, but the effect on the quality of training remains unknown. Additional methodologically sound studies on the impact of DHRs are necessary. Priorities for future research include approaches to optimizing education and clinical proficiency and studies on the effect of intervention strategies on both education and patient safety. Such studies will provide additional information to help improve duty hours policies.

Morbidity, mortality, and health care costs for patients undergoing spine surgery following the ACGME resident duty-hour reform

Object

The Accreditation Council for Graduate Medical Education (ACGME) implemented resident duty-hour restrictions on July 1, 2003, in concern for patient and resident safety. Whereas studies have shown that duty-hour restrictions have increased resident quality of life, there have been mixed results with respect to patient outcomes. In this study, the authors have evaluated the effect of duty-hour restrictions on morbidity, mortality, length of stay (LOS), and charges in patients who underwent spine surgery.

Methods

The Nationwide Inpatient Sample was used to evaluate the effect of duty-hour restrictions on complications, mortality, LOS, and charges by comparing the prereform (2000–2002) and postreform (2005–2008) periods. Outcomes were compared between nonteaching and teaching hospitals using a difference-in-differences (DID) method.

Results

A total of 693,058 patients were included in the study. The overall complication rate was 8.6%, with patients in the postreform era having a significantly higher rate than those in the pre–duty-hour restriction era (8.7% vs 8.4%, p < 0.0001). Examination of hospital teaching status revealed complication rates to decrease in nonteaching hospitals (8.2% vs 7.6%, p < 0.0001) while increasing in teaching institutions (8.6% vs 9.6%, p < 0.0001) in the duty-hour reform era. The DID analysis to compare the magnitude in change between teaching and nonteaching institutions revealed that teaching institutions to had a significantly greater increase in complications during the postreform era (p = 0.0002). The overall mortality rate was 0.37%, with no significant difference between the pre– and post–duty-hour eras (0.39% vs 0.36%, p = 0.12). However, the mortality rate significantly decreased in nonteaching hospitals in the postreform era (0.30% vs 0.23%, p = 0.0008), while remaining the same in teaching institutions (0.46% vs 0.46%, p = 0.75). The DID analysis to compare the changes in mortality between groups revealed that the difference between the effects approached significance (p = 0.069). The mean LOS for all patients was 4.2 days, with hospital stay decreasing in nonteaching hospitals (3.7 vs 3.5 days, p < 0.0001) while significantly increasing in teaching institutions (4.7 vs 4.8 days, p < 0.0001). The DID analysis did not demonstrate the magnitude of change for each group to differ significantly (p = 0.26). Total patient charges were seen to rise significantly in the post–duty-hour reform era, increasing from $40,000 in the prereform era to $69,000 in the postreform era. The DID analysis did not reveal a significant difference between the changes in charges between teaching and nonteaching hospitals (p = 0.55).

Conclusions

The implementation of duty-hour restrictions was associated with an increased risk of postoperative complications for patients undergoing spine surgery. Therefore, contrary to its intended purpose, duty-hour reform may have resulted in worse patient outcomes. Additional studies are needed to evaluate strategies to mitigate these effects and assist in the development of future health care policy.

Worse outcomes for patients undergoing brain tumor and cerebrovascular procedures following the ACGME resident duty-hour restrictions

OBJECT

On July 1, 2003, the Accreditation Council for Graduate Medical Education (ACGME) implemented duty-hour restrictions for resident physicians due to concerns for patient and resident safety. Though duty-hour restrictions have increased resident quality of life, studies have shown mixed results with respect to patient outcomes. In this study, the authors have evaluated the effect of duty-hour restrictions on morbidity, mortality, length of stay, and charges in patients who underwent brain tumor and cerebrovascular procedures.

METHODS

The Nationwide Inpatient Sample was used to evaluate the effect of duty-hour restrictions on complications, mortality, length of stay, and charges by comparing the pre-reform (2000-2002) and post-reform (2005-2008) periods. Outcomes were compared between nonteaching and teaching hospitals using a difference-in-differences (DID) method.

RESULTS

A total of 90,648 patients were included in the analysis. The overall complication rate was 11.7%, with the rates not significantly differing between the pre- and post-duty hour eras (p = 0.26). Examination of hospital teaching status revealed that complication rates decreased in nonteaching hospitals (12.1% vs 10.4%, p = 0.0004) and remained stable in teaching institutions (11.8% vs 11.9%, p = 0.73) in the post-reform era. Multivariate analysis demonstrated a significantly higher complication risk in teaching institutions (OR 1.33 [95% CI 1.11-1.59], p = 0.0022), with no significant change in nonteaching hospitals (OR 1.11 [95% CI 0.91-1.37], p = 0.31). A DID analysis to compare the magnitude in change between teaching and nonteaching institutions revealed that teaching hospitals had a significantly greater increase in complications during the post-reform era than nonteaching hospitals (p = 0.040). The overall mortality rate was 3.0%, with a significant decrease occurring in the post-reform era in both nonteaching (5.0% vs 3.2%, p < 0.0001) and teaching (3.2% vs 2.3%, p < 0.0001) hospitals. DID analysis to compare the changes in mortality between groups did not reveal a significant difference (p = 0.40). The mean length of stay for all patients was 8.7 days, with hospital stay decreasing from 9.2 days to 8.3 days in the post-reform era (p < 0.0001). The DID analysis revealed a greater length of stay decrease in nonteaching hospitals than teaching institutions, which approached significance (p = 0.055). Patient charges significantly increased in the post-reform era for all patients, increasing from $70,900 to $96,100 (p < 0.0001). The DID analysis did not reveal a significant difference between the changes in charges between teaching and nonteaching hospitals (p = 0.17).

CONCLUSIONS

The implementation of duty-hour restrictions correlated with an increased risk of postoperative complications for patients undergoing brain tumor and cerebrovascular neurosurgical procedures. Duty-hour reform may therefore be associated with worse patient outcomes, contrary to its intended purpose. Due to the critical condition of many neurosurgical patients, this patient population is most sensitive and likely to be negatively affected by proposed future increased restrictions.

An ACGME Duty Hour Compliant 3-Person Night Float System for Neurological Surgery Residency Programs

BACKGROUND

In 2003, the Accreditation Council for Graduate Medical Education (ACGME) instituted the 24+6-hour work schedule and 80-hour workweek, and in 2011, it enhanced work hour and supervision standards.

INNOVATION

In response, Oregon Health & Science University's (OHSU) neurological surgery residency instituted a 3-person night float system.

METHODS

We analyzed work hour records and operative experience for 1 year before and after night float implementation in a model that shortened a combined introductory research and basic clinical neurosciences rotation from 12 to 6 months. We analyzed residents' perception of the system using a confidential survey. The ACGME 2011 work hour standards were applied to both time periods.

RESULTS

AFTER NIGHT FLOAT IMPLEMENTATION, THE NUMBER OF DUTY HOUR VIOLATIONS WAS REDUCED: 28-hour shift (11 versus 235), 8 hours off between shifts (2 versus 20), 80 hours per week (0 versus 17), and total violations (23 versus 275). Violations increased only for the less than 4 days off per 4-week interval rule (10 versus 3). No meaningful difference was seen in the number of operative cases performed per year at any postgraduate year (PGY) training level: PGY-2 (336 versus 351), PGY-3 (394 versus 354), PGY-4 (803 versus 802), PGY-5 (1075 versus 1040), PGY-7 (947 versus 913), and total (3555 versus 3460). Residents rated the new system favorably.

CONCLUSIONS

To meet 2011 ACGME duty hour standards, the OHSU neurological surgery residency instituted a 3-person night float system. A nearly complete elimination of work hour violations did not affect overall resident operative experience.

Trends in operative experience of pediatric surgical residents in the United States and Canada

PURPOSE

Expansion of the number of training programs in pediatric surgery occurred from 2003 through 2010. We sought to determine the effect of program expansion on case volume and distribution of operative experience.

METHODS

Public domain data on pediatric surgery resident summary statistics available from the Accreditation Council for Graduate Medical Education (ACGME) from July 2003 through June 2010 were analyzed. Total case volume as primary surgeon or teaching assistant, mean case volume per resident, standard deviation, mode, minimum, and maximum number of cases per resident were evaluated. Mean total cases per resident, minimally invasive laparoscopic and thoracoscopic cases, and requisite cases as defined by the ACGME categories of: tumor, important pediatric surgical, and neonatal cases were analyzed by a Cuzick Wilcoxon-type nonparametric trend statistic using a significance level of 0.05. Skew was assessed by Pearson coefficient with levels of -0.5 to 0.5 defining a parametric distribution.

RESULTS

The number of pediatric surgical training residents increased by 42% during the years reported, from 24 to 34. No statistically significant difference was found in the mean number of total cases or requisite cases per resident. The mean volume of minimally invasive procedures increased significantly. Case volume per resident was non-parametrically distributed with increasing positive skew over time.

CONCLUSIONS

The increase in number of pediatric surgical resident training positions has not adversely affected overall operative experience or exposure to highly specialized requisite cases, on average. The increasing positive skew of total and index cases, however, suggests that variability between programs in case exposure is increasing over time.