Resident work hour limits and patient safety

Which, how, and what? Using digital tools to train surgical skills; a systematic review and meta-analysis

Background

Digital tools like digital box trainers and VR seem promising in delivering safe and tailored practice opportunities outside of the surgical clinic, yet understanding their efficacy and limitations is essential. This study investigated Which digital tools are available to train surgical skills, How these tools are used, How effective they are, and What skills they are intended to teach.

Methods

Medline, Embase, and Cochrane libraries were systematically reviewed for randomized trials, evaluating digital skill-training tools based on objective outcomes (skills scores and completion time) in surgical residents. Digital tools effectiveness were compared against controls, wet/dry lab training, and other digital tools. Tool and training factors subgroups were analysed, and studies were assessed on their primary outcomes: technical and/or non-technical.

Results

The 33 included studies involved 927 residents and six digital tools; digital box trainers, (immersive) virtual reality (VR) trainers, robot surgery trainers, coaching and feedback, and serious games. Digital tools outperformed controls in skill scores (SMD 1.66 [1.06, 2.25], P < 0.00001, I2 = 83 %) and completion time (SMD -1.05 [-1.72, -0.38], P = 0.0001, I2 = 71 %). There were no significant differences between digital tools and lab training, between tools, or in other subgroups. Only two studies focussed on non-technical skills.

Conclusion

While the efficacy of digital tools in enhancing technical surgical skills is evident - especially for VR-trainers -, there is a lack of evidence regarding non-technical skills, and need to improve methodological robustness of research on new (digital) tools before they are implemented in curricula.

Key message

This study provides critical insight into the increasing presence of digital tools in surgical training, demonstrating their usefulness while identifying current challenges, especially regarding methodological robustness and inattention to non-technical skills.

Making the Financial Case for Surgical Resident Well-being: A Scoping Review

OBJECTIVE

To conduct a scoping review of literature on financial implications of surgical resident well-being.

BACKGROUND

Surgeon well-being affects clinical outcomes, patient experience, and health care economics. However, our understanding of the relationship between surgical resident well-being and organizational finances is limited.

METHODS

Authors searched PubMed, Web of Science, and Embase with no date or language restrictions. Searches of the gray literature included hand references of articles selected for data extraction and reviewing conference abstracts from Embase. Two reviewers screened articles for eligibility based on title and abstract then reviewed eligible articles in their entirety. Data were extracted and analyzed using conventional content analysis.

RESULTS

Twenty-five articles were included, 5 (20%) published between 2003 and 2010, 12 (48%) between 2011 and 2018, and 8 (32%) between 2019 and 2021. One (4%) had an aim directly related to the research question, but financial implications were not considered from the institutional perspective. All others explored factors impacting well-being or workplace sequelae of well-being, but the economics of these elements were not the primary focus. Analysis of content surrounding financial considerations of resident well-being revealed 5 categories; however, no articles provided a comprehensive business case for investing in resident well-being from the institutional perspective.

CONCLUSIONS

Although the number of publications identified through the present scoping review is relatively small, the emergence of publications referencing economic issues associated with surgical resident well-being may suggest a growing recognition of this area's importance. This scoping review highlights a gap in the literature, which should be addressed to drive the system-level change needed to improve surgical resident well-being.

The Association of Experienced Long Working Hours and Depression, Anxiety, and Suicidal Ideation Among Chinese Medical Residents During the COVID-19 Pandemic: A Multi-Center Cross-Sectional Study

Background

Long working hours are common among medical residents and may increase the risk of mental disorders. We aimed to investigate the association between experienced long working hours and depression, anxiety, and suicidal ideation among Chinese medical residents during the COVID-19 pandemic.

Methods

This study was conducted in September 2022; 1343 residents from three center in Northeastern China were included in the final analysis (effective response rate: 87.61%). The data were collected from participants via online self-administered questionnaires. Depression and anxiety were measured by the Patient Health Questionnaire (PHQ-9) and the General Anxiety Disorder (GAD-7) scale, respectively. Adjusted odds ratios and 95% confidence intervals were determined after adjusting for potential confounders by binary unconditional logistic regression.

Results

The effective response rate was 87.61%. Among the 1343 participants, 12.88% (173), 9.90% (133), and 9.68% (130) had experienced major depression, major anxiety, and suicidal ideation, respectively. We found that longer weekly worktime increased the risk of major depression, particularly in those who worked for more than 60 hours per week (≥ 61 hours vs ≤ 40 hours, OR=1.87, P for trend = 0.003). However, this trend was not observed for either major anxiety or suicidal ideation (P for trend > 0.05 for both).

Conclusion

This study revealed that there was a considerable incidence of poor mental health among medical residents; furthermore, the longer weekly worktime was associated with a higher risk of major depression, especially for those who worked more than 60 hours per week, but this association was not observed in either major anxiety or suicidal ideation. This may help policymakers to develop targeted interventions.

Pulling Back from the Brink: A Multi-Pronged Approach to Address General Surgery Resident Clinical Work Hour Adherence

PURPOSE

The conflict between prioritizing education for surgical trainees, promoting trainee wellness, and maintaining optimal patient care has remained challenging since the introduction of the Accreditation Council for Graduate Medical Education (ACGME) work hour restrictions in 2003. There is still a dearth of research examining which interventions successfully enable duty hour adherence. This study assessed the impact of a combination of strategic interventions on improving clinical work hour adherence.

METHODS

Monthly clinical work hour submission rates were assessed for all general surgery residents at a single university-based residency program over a 3-year period (2018-2021). Interventions targeted 3 domains and were implemented between academic years 2018 to 2019 (control) and 2020 to 2021 (intervention): 1) improving the accuracy and transparency of work hour reporting, 2) facilitating more timely interventions, and 3) structural scheduling changes. All 80-hour work week and continuous work hour violations were assessed. Findings were also compared to the corresponding ACGME Resident Survey results.

RESULTS

There was no significant difference in the rate of monthly work hour submissions pre- and postintervention (78% vs 75%, p = 0.057). However, the number of total reported monthly violations decreased significantly (mean 13.8 vs 2.4, p < 0.01), including decreases in both 80-hour work week and continuous work hour violations (mean 4.7 vs 1.6, p < 0.001 and 9.1 vs 0.8, p < 0.001, respectively). Reported compliance also increased on the annual ACGME resident surveys, where 61% vs 95% of residents felt they were compliant with the 80-hour work week and 71% vs 95% felt they were compliant with the continuous work hours (2018-19 vs 2020-21).

CONCLUSION

Innovative strategies addressing schedule changes, the culture of work hour reporting, and early intervention significantly decreased the number of duty hour violations at our institution. Reported resident compliance also improved based on ACGME Resident Survey data. These data may inform similar multifaceted approaches at other institutions to improve overall work hour adherence.

Educational Quality of YouTube Cholesteatoma Surgery Videos: Areas for Improvement

Otolaryngology surgical education continues to evolve where trainees increasingly use videos to learn technical skills. Trainees commonly use YouTube, but no study to date has evaluated the educational quality (EQ) of otologic surgical videos on YouTube. We aim to assess the EQ of cholesteatoma surgical videos. Cholesteatoma surgical videos were queried using YouTube search terms, assessed using LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS), a validated assessment tool for publication, and categorized into low (0-6), medium (7-12), and high (13-18) EQ groups. In total, 74 videos were identified (mean LAP-VEGaS score = 9.6 ± 4.0) and 44.6% had medium EQ. Videos commonly lacked graphic aids to highlight anatomy (71.6%) and postprocedural outcomes (68.9%). LAP-VEGaS scores were greater in videos originating from US surgeons compared to non-US surgeons (12.4 ± 3.4 vs 8.0 ± 3.5; P < .001). Our study highlights that otolaryngology trainees may experience difficulty finding high-EQ cholesteatoma surgery videos on YouTube. Areas for improved EQ content are discussed. Level of evidence: IV.

How are Patient Order and Shift Timing Associated With Imaging Choices in the Emergency Department? Evidence From Niagara Health Administrative Data

STUDY OBJECTIVE

We assessed whether the timing and order of patients over emergency shifts are associated with receiving diagnostic imaging in the emergency department and characterized whether changes in imaging are associated with changes in patients returning to the ED.

METHODS

In this retrospective study, we used multivariate and instrumental variable regressions to examine how the timing and order of patients are associated with the use of diagnostic imaging. Outcomes include whether a patient receives a radiograph, a computed tomography (CT) scan, an ultrasound, and 7-day bouncebacks to the ED. The variables of interest are time and order during a physician's shift in which a patient is seen.

RESULTS

A total of 841,683 ED visits were examined from an administrative database of all ED visits to Niagara Health. Relative to the first patient, the probability of receiving a radiograph, CT, and ultrasound decreases by 6.4%, 9.1%, and 3.8% if a patient is the 15th patient seen during a shift. Relative to the first minute, the probability of receiving a radiograph, CT, or ultrasound increases by 1.9%, 2.7%, and 1.1% if a patient is seen in the 180th minute. Seven-day bounceback rates are not consistently associated with patient order or timing in a shift and imaging orders.

CONCLUSION

Imaging in the ED is associated with shift length and especially patient order, suggesting that physicians make different imaging decisions over the course of their shifts. Additional imaging does not translate into reductions in subsequent bouncebacks to the hospital.

Impact of Enforcement of the Act to Improve Training Conditions and the Status of Medical Residents in Emergency Abdominal Surgery

PURPOSE

In 2018, the Act to Improve Training Conditions and the Status of Medical Residents (AITR) was fully implemented in South Korea. This study aimed to investigate the effects of AITR implementation on the clinical outcomes of patients who underwent emergency abdominal surgery.

MATERIALS AND METHODS

A total of 2571 patients who underwent emergency abdominal surgery after visiting the emergency room (ER) between 2015 and 2019 was included. Electronic medical records were retrospectively reviewed. In addition, a comparative analysis was performed for patient groups treated before and after AITR implementation.

RESULTS

The median patient age was 48.0 years, and 49.2% of them were male. Appendicitis was the most common diagnosis (82.6%), followed by major abdominal emergencies (9.9%) and cholecystitis (7.5%). The median time from arrival to surgery was 439 min, and 52 (2.0%) patients died. A comparison of patients who underwent surgery before (pre-AITR; 1453, 56.5%) and after (post-AITR; 1118, 43.5%) AITR implementation revealed a significant difference in age, number of residents on a 24-h shift, and diagnosis. The time from ER arrival to surgery was not significantly longer after AITR implementation than before AITR implementation (434 min vs. 443 min, p=0.230). AITR was not a significant risk factor for mortality (p=0.225).

CONCLUSION

The time from ER arrival to emergency surgery did not increase significantly after AITR implementation, and there was no difference in the patients' clinical outcomes.

Do obstetrics trainees working hours affect caesarean section rates in normal risk women?

OBJECTIVES

The rate of caesarean section (CS) is increasing globally. The nulliparous, term, singleton, vertex presentation, spontaneously labouring woman (Robson Group 1/RG1) is considered low risk for CS. It has been hypothesized that more CS occur at nighttime or at weekends due to doctor fatigue. The European Working Time Directive (EWTD) was implemented in our institution in 2013 to limit doctor working hours, which aimed at reducing fatigue but arguably fractures continuity of care. This study aimed to determine the effect of nocturnal hours and weekend on-call as well as the implementation of EWTD on our RG1 CS rates.

STUDY DESIGN

This was a population-based study in a tertiary referral centre from 2008-2017. The inclusion criteria for our study were limited to RG1. Data were analysed from an established clinical database, including mode and time of delivery. Descriptive statistics are presented as number and percent for categorical variables. Relative frequencies were tested using chi-squared test. All statistical analyses were performed using SPSS Version 26. Statistical significance was defined as p < .05.

RESULTS

There were 86,473 deliveries over the 10-year study period. There were 18,761 women in RG1. Overall the RG1 CS rate was 12.9 % (n = 2415). Rates of CS in the RG1 were not statistically different between those delivering on weekdays (12.9 %, n = 1726/13,430) and weekends (12.9 %, n = 689/5,331, OR 0.99, 95 % CI = 0.90-1.09, p = .89). During daytime hours the CS rate was 12.1 % (n = 777/6411) and at nighttime was 13.3 % (n = 1638/12,350, OR 1.10, 95 % CI = 1.01-1.21, p = .03). Comparing the time periods pre and post EWTD implementation, there was a significant increase in CS rates (12.1 % n = 1319/10,873 V 13.9 % n = 1096/7,888, OR 1.17, 95 % CI = 1.07-1.27 p < .001). With respect to other modes of delivery in RG1 pre and post EWTD, there was a statistically significant decrease in operative vaginal delivery (OVD) rates (40.1%, n=4,360 V 37.7%, n=2,973, OR 0.90, 95% CI = 0.85-0.95, p = .001) CONCLUSION: This study shows an association between obstetric trainee working practices, RG1 CS and OVD rates; this is most pronounced at night and after the introduction of the EWTD. It is unlikely that obstetric trainee working practices are the only factor related to the increasing CS rate and reduced OVD rate. Consideration should be giving to addressing the needs of obstetric trainees in relation to achieving their competencies with now reduced labour ward exposure. Further study is required to see if alternate arrangements in relation to simulation training could increase the OVD rate and reduce the CS rate.

Use of interrupted time series methods in the evaluation of health system quality improvement interventions: a methodological systematic review

BACKGROUND

When randomisation is not possible, interrupted time series (ITS) design has increasingly been advocated as a more robust design to evaluating health system quality improvement (QI) interventions given its ability to control for common biases in healthcare QI. However, there is a potential risk of producing misleading results when this rather robust design is not used appropriately. We performed a methodological systematic review of the literature to investigate the extent to which the use of ITS has followed best practice standards and recommendations in the evaluation of QI interventions.

METHODS

We searched multiple databases from inception to June 2018 to identify QI intervention studies that were evaluated using ITS. There was no restriction on date, language and participants. Data were synthesised narratively using appropriate descriptive statistics. The risk of bias for ITS studies was assessed using the Cochrane Effective Practice and Organisation of Care standard criteria. The systematic review protocol was registered in PROSPERO (registration number: CRD42018094427).

RESULTS

Of 4061 potential studies and 2028 unique records screened for inclusion, 120 eligible studies assessed eight QI strategies and were from 25 countries. Most studies were published since 2010 (86.7%), reported data using monthly interval (71.4%), used ITS without a control (81%) and modelled data using segmented regression (62.5%). Autocorrelation was considered in 55% of studies, seasonality in 20.8% and non-stationarity in 8.3%. Only 49.2% of studies specified the ITS impact model. The risk of bias was high or very high in 72.5% of included studies and did not change significantly over time.

CONCLUSIONS

The use of ITS in the evaluation of health system QI interventions has increased considerably over the past decade. However, variations in methodological considerations and reporting of ITS in QI remain a concern, warranting a need to develop and reinforce formal reporting guidelines to improve its application in the evaluation of health system QI interventions.

Junior doctor training: has the pendulum swung too far?

The current Australian Medical Association doctors in training enterprise agreement dictates that hours beyond 38 or 43 ordinary hours per week incur overtime. Costly overtime has led to strict adherence to ordinary hours with dramatically reduced rostered and unrostered overtime. The stringent regulation over ordinary hours may protect doctors at a cost to training and potentially patient safety. Reduced shift duration adds to the number of clinical handovers, while reduced exposure to patients and training opportunities may prolong training time. Now is the time for renegotiation of working hours, which are most favourable for doctor training and well-being.

Effects of transcranial direct-current stimulation on laparoscopic surgical skill acquisition

Background

Changes in medical education may limit opportunities for trainees to gain proficiency in surgical skills. Transcranial direct-current stimulation (tDCS) can augment motor skill learning and may enhance surgical procedural skill acquisition. The aim of this study was to determine the effects of tDCS on simulation-based laparoscopic surgical skill acquisition.

Methods

In this double-blind, sham-controlled randomized trial, participants were randomized to receive 20 min of anodal tDCS or sham stimulation over the dominant primary motor cortex, concurrent with Fundamentals of Laparoscopic Surgery simulation-based training. Primary outcomes of laparoscopic pattern-cutting and peg transfer tasks were scored at baseline, during repeated performance over 1 h, and again at 6 weeks. Intent-to-treat analysis examined the effects of treatment group on skill acquisition and retention.

Results

Of 40 participants, those receiving tDCS achieved higher mean(s.d.) final pattern-cutting scores than participants in the sham group (207·6(30·0) versus 186·0(32·7) respectively; P = 0·022). Scores were unchanged at 6 weeks. Effects on peg transfer scores were not significantly different (210·2(23·5) in the tDCS group versus 201·7(18·1) in the sham group; P = 0·111); the proportion achieving predetermined proficiency levels was higher for tDCS than for sham stimulation. Procedures were well tolerated with no serious adverse events and no decreases in motor measures.

Conclusion

The addition of tDCS to laparoscopic surgical training may enhance skill acquisition. Trials of additional skills and translation to non-simulated performance are required to determine the potential value in medical education and impact on patient outcomes. Registration number: NCT02756052 (https://clinicaltrials.gov/).

Running Memory for Clinical Handoffs: A Look at Active and Passive Processing

OBJECTIVE

The goal of the present study was to examine the effects of domain-relevant expertise on running memory and the ability to process handoffs of information. In addition, the role of active or passive processing was examined.

BACKGROUND

Currently, there is little research that addresses how individuals with different levels of expertise process information in running memory when the information is needed to perform a real-world task.

METHOD

Three groups of participants differing in their level of clinical expertise (novice, intermediate, and expert) performed an abstract running memory span task and two tasks resembling real-world activities, a clinical handoff task and an air traffic control (ATC) handoff task. For all tasks, list length and the amount of information to be recalled were manipulated.

RESULTS

Regarding processing strategy, all participants used passive processing for the running memory span and ATC tasks. The novices also used passive processing for the clinical task. The experts, however, appeared to use more active processing, and the intermediates fell in between.

CONCLUSION

Overall, the results indicated that individuals with clinical expertise and a developed mental model rely more on active processing of incoming information for the clinical task while individuals with little or no knowledge rely on passive processing.

APPLICATION

The results have implications about how training should be developed to aid less experienced personnel identify what information should be included in a handoff and what should not.

Impact of the 2003 ACGME Resident Duty Hour Reform on Hospital-Acquired Conditions: A National Retrospective Analysis

BACKGROUND

The Accreditation Council for Graduate Medical Education reforms in 2003 instituted an 80-hour weekly limit for resident physicians. Critics argue that these restrictions have increased handoffs among residents and the potential for a decline in patient safety. "Never events" hospital-acquired conditions (HACs) are a set of preventable events used as a quality metric in hospital safety analyses.

OBJECTIVE

This analysis evaluated post-work hour reform effects on HAC incidence for US hospital inpatients, using the National Inpatient Sample.

METHODS

Data were collected from 2000-2002 (pre-2003) and 2004-2006 (post-2003) time periods. HAC incidence in academic and non-academic centers was evaluated in multivariate analysis assessing for likelihood of HAC occurrence, prolonged length of stay (pLOS), and increased total charges.

RESULTS

The data encompassed approximately 111 million pre-2003 and 117 million post-2003 admissions. Patients were 10% more likely to incur a HAC in the post-2003 versus pre-2003 era (odds ratio [OR] = 1.10; 95% confidence interval [CI] 1.06-1.14; P < .01). Teaching hospitals exhibited an 18% (OR = 1.18; 95% CI 1.11-1.27; P < .01) increase in HAC likelihood, with no change in nonteaching settings (OR = 1.03; 95% CI 1.00-1.06; P > .05). Patients with ≥ 1 HAC were associated with a 60% likelihood of elevated charges (OR = 1.60; 95% CI 1.50-1.72; P < .01) and 65% likelihood of pLOS (OR = 1.65; 95% CI 1.60-1.70; P < .01).

CONCLUSIONS

Post-2003 era patients were associated with 10% increased likelihood of HAC, with effects noted primarily at teaching hospitals.

Post-call delirium

Although frequently diagnosed in hospital in-patients, delirium is often recognised but under-reported in the housestaff population. It is estimated that more than 90% of housestaff will experience regular episodes of post-call delirium. This paper identifies diagnostic criteria and discusses approaches to treatment.

What Is Known: Examining the Empirical Literature in Resident Work Hours Using 30 Influential Articles

BACKGROUND

Examining influential, highly cited articles can show the advancement of knowledge about the effect of resident physicians' long work hours, as well as the benefits and drawbacks of work hour limits.

OBJECTIVE

A narrative review of 30 articles, selected for their contribution to the literature, explored outcomes of interest in the research on work hours-including patient safety, learning, and resident well-being.

METHODS

Articles were selected from a comprehensive review. Citation volume, quality, and contribution to the evolving thinking on work hours and to the Accreditation Council for Graduate Medical Education standards were assessed.

RESULTS

Duty hour limits are supported by the scientific literature, particularly limits on weekly hours and reducing the frequency of overnight call. The literature shows declining hours and call frequency over 4 decades of study, although the impact on patient safety, learning, and resident well-being is not clear. The review highlighted limitations of the scientific literature on resident hours, including small samples and reduced generalizability for intervention studies, and the inability to rule out confounders in large studies using administrative data. Key areas remain underinvestigated, and accepted methodology is challenged when assessing the impact of interventions on the multiple outcomes of interest.

CONCLUSIONS

The influential literature, while showing the beneficial effect of work hour limits, does not answer all questions of interest in determining optimal limits on resident hours. Future research should use methods that permit a broader, collective examination of the multiple, often competing attributes of the learning environment that collectively promote patient safety and resident learning and well-being.

National Cluster-Randomized Trial of Duty-Hour Flexibility in Surgical Training

BACKGROUND

Concerns persist regarding the effect of current surgical resident duty-hour policies on patient outcomes, resident education, and resident well-being.

METHODS

We conducted a national, cluster-randomized, pragmatic, noninferiority trial involving 117 general surgery residency programs in the United States (2014-2015 academic year). Programs were randomly assigned to current Accreditation Council for Graduate Medical Education (ACGME) duty-hour policies (standard-policy group) or more flexible policies that waived rules on maximum shift lengths and time off between shifts (flexible-policy group). Outcomes included the 30-day rate of postoperative death or serious complications (primary outcome), other postoperative complications, and resident perceptions and satisfaction regarding their well-being, education, and patient care.

RESULTS

In an analysis of data from 138,691 patients, flexible, less-restrictive duty-hour policies were not associated with an increased rate of death or serious complications (9.1% in the flexible-policy group and 9.0% in the standard-policy group, P=0.92; unadjusted odds ratio for the flexible-policy group, 0.96; 92% confidence interval, 0.87 to 1.06; P=0.44; noninferiority criteria satisfied) or of any secondary postoperative outcomes studied. Among 4330 residents, those in programs assigned to flexible policies did not report significantly greater dissatisfaction with overall education quality (11.0% in the flexible-policy group and 10.7% in the standard-policy group, P=0.86) or well-being (14.9% and 12.0%, respectively; P=0.10). Residents under flexible policies were less likely than those under standard policies to perceive negative effects of duty-hour policies on multiple aspects of patient safety, continuity of care, professionalism, and resident education but were more likely to perceive negative effects on personal activities. There were no significant differences between study groups in resident-reported perception of the effect of fatigue on personal or patient safety. Residents in the flexible-policy group were less likely than those in the standard-policy group to report leaving during an operation (7.0% vs. 13.2%, P<0.001) or handing off active patient issues (32.0% vs. 46.3%, P<0.001).

CONCLUSIONS

As compared with standard duty-hour policies, flexible, less-restrictive duty-hour policies for surgical residents were associated with noninferior patient outcomes and no significant difference in residents' satisfaction with overall well-being and education quality. (FIRST ClinicalTrials.gov number, NCT02050789.).

A high-volume trauma intensive care unit can be successfully staffed by advanced practitioners at night

PURPOSE

It remains unknown whether critically ill trauma patients can be successfully managed by advanced practitioners (APs). The purpose of this study was to examine the impact of night coverage by APs in a high-volume trauma intensive care unit (ICU) on patient outcomes and care processes.

MATERIALS AND METHODS

During the study period, our ICU was staffed by APs during the night shift (7 pm-7 am) from Sunday to Wednesday and by resident physicians (RPs) from Thursday to Saturday. On-call trauma fellows and attending surgeons in house supervised both APs and RPs. Patient outcomes and care processes by APs was compared with those admitted by RPs.

RESULTS

A total of 289 patients were identified between July 2013 and February 2014. Median lactate clearance rate within 24 hours of admission was similar between study groups (10.0% vs 9.1%; P = .39). Advanced practitioners and RPs transfused patients requiring massive transfusion with a similar blood product ratio (packed red blood cell:fresh frozen plasma) (2.1:1 vs 1.7:1; P = .32). In a multiple logistic regression analysis, AP coverage was not associated with any clinical outcome differences.

CONCLUSIONS

Our data suggest that, with adequate supervision, a high-volume trauma ICU can be safely staffed by APs overnight.

A Narrative Review of High-Quality Literature on the Effects of Resident Duty Hours Reforms

PURPOSE

To summarize current high-quality studies evaluating the effect and efficacy of resident duty hours reforms (DHRs) on patient safety and resident education and well-being.

METHOD

The authors searched PubMed and Medline in August 2012 and again in May 2013 for literature (1987-2013) about the effects of DHRs. They assessed the quality of articles using the Medical Education Research Study Quality Instrument (MERSQI) scoring system. They considered randomized controlled trials (RCTs), partial RCTs, and all studies with a MERSQI score ≥ 14 to be "high-quality" methodology studies.

RESULTS

A total of 72 high-quality studies met inclusion criteria. Most studies showed no change or slight improvement in mortality and complication rates after DHRs. Resident well-being was generally improved, but there was a perceived negative impact on education (knowledge acquisition, skills, and cognitive performance) following DHRs. Eleven high-quality studies assessed the impact of DHR interventions; all reported a neutral to positive impact. Seven high-quality studies assessed costs associated with DHRs and demonstrated an increase in hospital costs.

CONCLUSIONS

The results of most studies that allow enough time for DHR interventions to take effect suggest a benefit to patient safety and resident well-being, but the effect on the quality of training remains unknown. Additional methodologically sound studies on the impact of DHRs are necessary. Priorities for future research include approaches to optimizing education and clinical proficiency and studies on the effect of intervention strategies on both education and patient safety. Such studies will provide additional information to help improve duty hours policies.

Interrupted time-series analysis: studying trends in neurosurgery

OBJECT

Neurosurgery studies traditionally have evaluated the effects of interventions on health care outcomes by studying overall changes in measured outcomes over time. Yet, this type of linear analysis is limited due to lack of consideration of the trend’s effects both pre- and postintervention and the potential for confounding influences. The aim of this study was to illustrate interrupted time-series analysis (ITSA) as applied to an example in the neurosurgical literature and highlight ITSA’s potential for future applications.

METHODS

The methods used in previous neurosurgical studies were analyzed and then compared with the methodology of ITSA.

RESULTS

The ITSA method was identified in the neurosurgical literature as an important technique for isolating the effect of an intervention (such as a policy change or a quality and safety initiative) on a health outcome independent of other factors driving trends in the outcome. The authors determined that ITSA allows for analysis of the intervention’s immediate impact on outcome level and on subsequent trends and enables a more careful measure of the causal effects of interventions on health care outcomes.

CONCLUSIONS

ITSA represents a significant improvement over traditional observational study designs in quantifying the impact of an intervention. ITSA is a useful statistical procedure to understand, consider, and implement as the field of neurosurgery evolves in sophistication in big-data analytics, economics, and health services research.

Perceptions of Leaders and Clinician Educators on the Impact of International Accreditation

BACKGROUND

Graduate medical education (GME) is responding to calls for reform by adopting competency-based frameworks and, in some countries, by rapidly implementing external accreditation systems. The Accreditation Council for Graduate Medical Education International (ACGME-I) began accrediting institutions in 2009. This study aimed to describe ACGME-I-accredited institutions and explore perceptions of their leaders and clinician educators (CEs) regarding preparedness, challenges, and initial impact of accreditation.

METHOD

Cross-sectional surveys of all ACGME-I-accredited institutions' leaders and CEs were conducted from June 2013 to June 2014. Eligible participants were identified through institution Web sites and GME offices. Combinations of Web- and paper-based surveys were employed.

RESULTS

Completed surveys were received from 24 (70.6%) of 34 institutional leaders and 274 (76.3%) of 359 CEs, representing 3 countries, 8 academic medical centers, 2 affiliated teaching hospitals, and 47 residency programs. Leaders and CEs felt prepared in the domains of knowledge and implementation of the competencies. Top challenges were excessive "demands on faculty time" and "bureaucratic procedures." The majority of both groups perceived a positive impact of accreditation on all learner, faculty, institution, and patient outcomes; most perceived no impact on patient satisfaction. Overall, 79.2% of leaders and 75.8% of CEs agreed or strongly agreed that seeking ACGME-I accreditation was worthwhile.

CONCLUSIONS

This study indicates that despite the challenges identified, initial perceptions of the impact of ACGME-I accreditation are positive. Findings from this study may be useful to institutions and countries considering similar GME reform, though long-term outcome data are needed.

On resident duty hour restrictions and neurosurgical training: review of the literature

Within neurosurgery, the national mandate of the 2003 duty hour restrictions (DHR) by the Accreditation Council for Graduate Medical Education (ACGME) has been controversial. Ensuring the proper education and psychological well-being of residents while fulfilling the primary purpose of patient care has generated much debate. Most medical disciplines have developed strategies that address service needs while meeting educational goals. Additionally, there are numerous studies from those disciplines; however, they are not specifically relevant to the needs of a neurosurgical residency. The recent implementation of the 2011 DHR specifically aimed at limiting interns to 16-hour duty shifts has proven controversial and challenging across the nation for neurosurgical residencies--again bringing education and service needs into conflict. In this report the current literature on DHR is reviewed, with special attention paid to neurosurgical residencies, discussing resident fatigue, technical training, and patient safety. Where appropriate, other specialty studies have been included. The authors believe that a one-size-fits-all approach to residency training mandated by the ACGME is not appropriate for the training of neurosurgical residents. In the authors' opinion, an arbitrary timeline designed to limit resident fatigue limits patient care and technical training, and has not improved patient safety.

Residents as Educators: A Modern Model

Education during surgical residency has changed significantly. As part of the shifting landscape, the importance of an organized and structured curriculum has increased. However, establishing this is often difficult secondary to clinical demands and pressure both on faculty and residents. We present a peer-assisted learning model for academic institutions without professional non-clinical educations. The "resident as educator" (RAE) model empowers residents to be the organizers of the education curriculum. RAE is built on a culture of commitment to education, skill development and team building, allowing the upper level residents to develop and execute the curriculum. Several modules designed to address junior level residents and medical students' educational needs have been implemented, including (1) intern boot camp, (2) summer school, (3) technical skill sessions, (4) trauma orientation, (5) weekly teaching conferences, and (4) a fourth year medical student surgical preparation course. Promoting residents as educators leads to an overall benefit for the program by being cost-effective and time-efficient, while simultaneously promoting professional development of residents and a culture of education.

How to Further Decrease the Efficiency of Care at a Level I Trauma Center: Implement the Amended Resident Work Hours

Work-hour restrictions were amended in 2011 to limit interns to 16 continuous duty hours, essentially requiring a night float system of 12-hour shifts. We hypothesize that there has been no improvement in outcomes after implementation of the amended work-hour restrictions. Outcomes from trauma admissions were queried from the trauma registry from 2009 to 2011 (PRE) and 2011 to 2013 (POST). The primary outcome was mortality with secondary outcomes intensive care unit length of stay (LOS) and LOS. Patients were stratified based on age, mechanism, gender, blood pressure, heart rate, and injury severity (Injury Severity Score, Glasgow Coma Scale, Base Deficit). Outcomes were then compared from admissions PRE to POST. A total of 9178 patients were included in the study population. The mean age was 42 with most being male (72%) and blunt mechanism (81%). Patient populations were well matched except patients in the POST period were slightly older (43 vs 42 years; P = 0.01). Intensive care unit LOS and LOS were higher in the POST period. After adjusted analysis, admission in the POST period was not a predictor of mortality (odds ratio 0.857; confidence interval 0.655–1.12). The POST period was an independent predictor for LOS (β = 0.74; P = 0.002). This study adds to the mounting evidence that the implementation of the amended limits on work hours leads to furthermore decreased efficiency of care.

Effects of Postgraduate Medical Education "Boot Camps" on Clinical Skills, Knowledge, and Confidence: A Meta-Analysis

BACKGROUND

Throughout their medical education, learners face multiple transition periods associated with increased demands, producing stress and concern about the adequacy of their skills for their new role.

OBJECTIVE

We evaluated the effectiveness of boot camps in improving clinical skills, knowledge, and confidence during transitions into postgraduate or discipline-specific residency programs.

METHODS

Boot camps are in-training courses combining simulation-based practice with other educational methods to enhance learning and preparation for individuals entering new clinical roles. We performed a search of MEDLINE, CINAHL, PsycINFO, EMBASE, and ERIC using boot camp and comparable search terms. Inclusion criteria included studies that reported on medical education boot camps, involved learners entering new clinical roles in North American programs, and reported empirical data on the effectiveness of boot camps to improve clinical skills, knowledge, and/or confidence. A random effects model meta-analysis was performed to combined mean effect size differences (Cohen's d) across studies based on pretest/posttest or comparison group analyses.

RESULTS

The search returned 1096 articles, 15 of which met all inclusion criteria. Combined effect size estimates showed learners who completed boot camp courses had significantly "large" improvements in clinical skills (d  =  1.78; 95% CI 1.33-2.22; P < .001), knowledge (d  =  2.08; 95% CI 1.20-2.96; P < .001), and confidence (d  =  1.89; 95% CI 1.63-2.15; P < .001).

CONCLUSIONS

Boot camps were shown as an effective educational strategy to improve learners' clinical skills, knowledge, and confidence. Focus on pretest/posttest research designs limits the strength of these findings.

Perceived effects of the 16-hour workday restriction on surgical specialties: Quebec's experience

OBJECTIVE

Quebec was the first Canadian province to implement a 16-hour workday restriction. Our aim was to assess and compare Quebec's surgical residents' and professors' perception regarding the effects on the educational environment, quality of care, and quality of life.

DESIGN

The Surgical Theater Educational Environment Measure, the Postgraduate Hospital Educational Environment Measure, quality of the medical act, and quality-of-life questionnaires were administered 6 months after the work-hour restrictions.

SETTING

Université de Montréal Surgery Department, Montréal, Québec, Canada; Université de Sherbrooke Surgery Department, Sherbrooke, Québec, Canada; Université Laval Surgery Department, Québec, Québec, Canada; and McGill University Surgery Department, Montréal, Québec, Canada.

PARTICIPANTS

Surgical residents and professors of all specialties within the 4 university surgery departments in Quebec through a voluntary web-based survey.

RESULTS

A total of 280 questionnaires were analyzed with response rates of 29.7% and 16.4% for residents and professors, respectively. Data were coded on a scale from 2 (strong improvement perception) to -2 (strong deterioration perception). The professors perceived a higher negative effect than the residents did on the educational environment, i.e., role of autonomy (-0.399 vs. -0.577, p < 0.001), teaching (-0.496 vs. -0.540, p < 0.001), social support (-0.345 vs. -0.535, p < 0.001), and surgical learning (-0.409 vs. -0.626, p < 0.001). The professors also observed a higher negative effect on patients' safety (-0.199 vs. -0.595, p = 0.003) and quality of care (-0.077 vs. -0.421, p = 0.014). The latter was even perceived as unchanged by residents (-0.077, 95% CI: -0.249 to 0.095). The residents perceived a negative effect on their quality of life, whereas the professors believed the contrary (0.500 vs -0.496, p < 0.001). More professors than residents believed residency should be prolonged (80.8% vs. 50.6%, p < 0.001).

CONCLUSIONS

Residents and professors perceive a mild negative effect on the educational environment and quality of care, whereas their perception on quality of life is opposite. The professors seem concerned about adequate training to the point of considering increasing training length.

Patient safety in the era of the 80-hour workweek

OBJECTIVE

In 2003, duty-hour regulations (DHR) were initially implemented for residents in the United States to improve patient safety and protect resident's well-being. The effect of DHR on patient safety remains unclear. The study objective was to evaluate the effect of DHR on patient safety.

DESIGN

Using an interrupted time series analysis, we analyzed selected patient safety indicators (PSIs) for 376 million discharges in teaching (T) vs nonteaching (NT) hospitals before and after implementation of DHR in 2003 that restricted resident work hours to 80 hours per week. The PSIs evaluated were postoperative pulmonary embolus or deep venous thrombosis (PEDVT), iatrogenic pneumothorax (PTx), accidental puncture or laceration, postoperative wound dehiscence (WD), postoperative hemorrhage or hematoma, and postoperative physiologic or metabolic derangement. Propensity scores were used to adjust for differences in patient comorbidities between T and NT hospitals and between discharge quarters. The primary outcomes were differences in the PSI rates before and after DHR implementation. The PSI differences between T and NT institutions were the secondary outcome.

SETTING

T and NT hospitals in the United States.

PARTICIPANTS

Participants were 376 million patient discharges from 1998 to 2007 in the Nationwide Inpatient Sample.

RESULTS

Declining rates of PTx in both T and NT hospitals preintervention slowed only in T hospitals postintervention (p = 0.04). Increasing PEDVT rates in both T and NT hospitals increased further only in NT hospitals (p = 0.01). There were no differences in the PSI rates over time for hemorrhage or hematoma, physiologic or metabolic derangement, accidental puncture or laceration, or WD. T hospitals had higher rates than NT hospitals both preintervention and postintervention for all the PSIs except WD.

CONCLUSIONS

Trends in rates for 2 of the 6 PSIs changed significantly after DHR implementation, with PTx rates worsening in T hospitals and PEDVT rates worsening in NT hospitals. Lack of consistent patterns of change suggests no measurable effect of the policy change on these PSIs.

The effect of duty hour regulations on outcomes of neurological surgery in training hospitals in the United States: duty hour regulations and patient outcomes

OBJECT

The effects of sleep deprivation on performance have been well documented and have led to changes in duty hour regulation. New York State implemented stricter duty hours in 1989 after sleep deprivation among residents was thought to have contributed to a patient's death. The goal of this study was to determine if increased regulation of resident duty hours results in measurable changes in patient outcomes.

METHODS

Using the Nationwide Inpatient Sample (NIS), patients undergoing neurosurgical procedures at hospitals with neurosurgery training programs were identified and screened for in-hospital complications, in-hospital procedures, discharge disposition, and in-hospital mortality. Comparisons in the above outcomes were made between New York hospitals and non-New York hospitals before and after the Accreditation Council for Graduate Medical Education (ACGME) regulations were put into effect in 2003.

RESULTS

Analysis of discharge disposition demonstrated that 81.9% of patients in the New York group 2000-2002 were discharged to home compared with 84.1% in the non-New York group 2000-2002 (p = 0.6, adjusted multivariate analysis). In-hospital mortality did not significantly differ (p = 0.7). After the regulations were implemented, there was a nonsignificant decrease in patients discharged to home in the non-New York group: 84.1% of patients in the 2000-2002 group compared with 81.5% in the 2004-2006 group (p = 0.6). In-hospital mortality did not significantly change (p = 0.9). In New York there was no significant change in patient outcomes with the implementation of the regulations; 81.9% of patients in the 2000-2002 group were discharged to home compared with 78.0% in the 2004-2006 group (p = 0.3). In-hospital mortality did not significantly change (p = 0.4). After the regulations were in place, analysis of discharge disposition demonstrated that 81.5% of patients in the non-New York group 2004-2006 were discharged to home compared with 78.0% in the New York group 2004-2006 (p = 0.01). In-hospital mortality was not significantly different (p = 0.3).

CONCLUSIONS

Regulation of resident duty hours has not resulted in significant changes in outcomes among neurosurgical patients.

A systematic review of the effects of resident duty hour restrictions in surgery: impact on resident wellness, training, and patient outcomes

BACKGROUND

In 2003, the Accreditation Council for Graduate Medical Education (ACGME) mandated 80-hour resident duty limits. In 2011 the ACGME mandated 16-hour duty maximums for PGY1 (post graduate year) residents. The stated goals were to improve patient safety, resident well-being, and education. A systematic review and meta-analysis were performed to evaluate the impact of resident duty hours (RDH) on clinical and educational outcomes in surgery.

METHODS

A systematic review (1980-2013) was executed on CINAHL, Cochrane Database, Embase, Medline, and Scopus. Quality of articles was assessed using the GRADE guidelines. Sixteen-hour shifts and night float systems were analyzed separately. Articles that examined mortality data were combined in a random-effects meta-analysis to evaluate the impact of RDH on patient mortality.

RESULTS

A total of 135 articles met the inclusion criteria. Among these, 42% (N = 57) were considered moderate-high quality. There was no overall improvement in patient outcomes as a result of RDH; however, some studies suggest increased complication rates in high-acuity patients. There was no improvement in education related to RDH restrictions, and performance on certification examinations has declined in some specialties. Survey studies revealed a perception of worsened education and patient safety. There were improvements in resident wellness after the 80-hour workweek, but there was little improvement or negative effects on wellness after 16-hour duty maximums were implemented.

CONCLUSIONS

Recent RDH changes are not consistently associated with improvements in resident well-being, and have negative impacts on patient outcomes and performance on certification examinations. Greater flexibility to accommodate resident training needs is required. Further erosion of training time should be considered with great caution.

Teaching and Assessing Colorectal Surgery Residents in the Age of ACGME Competencies: Pieces of the Whole

Educators have struggled with teaching and evaluation of the six Accreditation Council for Graduate Medical Education (ACGME) core competencies since their introduction in 1999. In addition, many authors have questioned the construct validity of the competencies. Concern has also arisen regarding the educational effects of the competencies and the subsequent limitation of resident duty hours, the combination of which have forced unprecedented changes in American graduate medical education. This article attempts to present an understanding of how these events have had direct and indirect effects on the education of residents in colon and rectal surgery, and to provide a framework for educators in colon and rectal surgery to adapt in their curricula.

Increased error rates in preliminary reports issued by radiology residents working more than 10 consecutive hours overnight

RATIONALE AND OBJECTIVES

To determine if the rate of major discrepancies between resident preliminary reports and faculty final reports increases during the final hours of consecutive 12-hour overnight call shifts.

MATERIALS AND METHODS

Institutional review board exemption status was obtained for this study. All overnight radiology reports interpreted by residents on-call between January 2010 and June 2010 were reviewed by board-certified faculty and categorized as major discrepancies if they contained a change in interpretation with the potential to impact patient management or outcome. Initial determination of a major discrepancy was at the discretion of individual faculty radiologists based on this general definition. Studies categorized as major discrepancies were secondarily reviewed by the residency program director (M.H.S.) to ensure consistent application of the major discrepancy designation. Multiple variables associated with each report were collected and analyzed, including the time of preliminary interpretation, time into shift study was interpreted, volume of studies interpreted during each shift, day of the week, patient location (inpatient or emergency department), block of shift (2-hour blocks for 12-hour shifts), imaging modality, patient age and gender, resident identification, and faculty identification. Univariate risk factor analysis was performed to determine the optimal data format of each variable (ie, continuous versus categorical). A multivariate logistic regression model was then constructed to account for confounding between variables and identify independent risk factors for major discrepancies.

RESULTS

We analyzed 8062 preliminary resident reports with 79 major discrepancies (1.0%). There was a statistically significant increase in major discrepancy rate during the final 2 hours of consecutive 12-hour call shifts. Multivariate analysis confirmed that interpretation during the last 2 hours of 12-hour call shifts (odds ratio (OR) 1.94, 95% confidence interval (CI) 1.18-3.21), cross-sectional imaging modality (OR 5.38, 95% CI 3.22-8.98), and inpatient location (OR 1.81, 95% CI 1.02-3.20) were independent risk factors for major discrepancy.

CONCLUSIONS

In a single academic medical center, major discrepancies in resident preliminary reports increased significantly during the final 2 hours of consecutive 12-hour overnight call shifts. This finding could be related to either fatigue or circadian desynchronization. Discrimination of these two potential etiologies requires additional investigation as major discrepancies in resident reports have the potential to negatively impact patient care/outcome. Cross-sectional imaging modalities including computed tomography and ultrasound (versus conventional radiography), as well as inpatient location (versus Emergency Department location), were also associated with significantly higher major discrepancy rates.

Duty-hour limits and patient care and resident outcomes: can high-quality studies offer insight into complex relationships?

Long hours are an accepted component of resident education, yet data suggest they contribute to fatigue that may compromise patient safety. A systematic review confirms that limiting duty hours increases residents' hours of sleep and improves objective measures of alertness. Most studies of operative experience for surgical residents found no effect, and there is evidence of a limited positive effect on residents' mood. We find a mixed effect on patient safety, although problems with supervision, rather than the limits, may be responsible or contibute; evidence of reduced continuity of care and reduced continuity in residents' clinical education; and evidence that increased workload under the limits has a negative effect on patient and resident outcomes. We highlight specific areas for research and offer recommendations for national policy.