An Improvement Approach to Integrate Teaching Teams in the Reporting of Safety Events

Graduate medical education-led continuous assessment of burnout and learning environments to improve residents' wellbeing

BACKGROUND

Promoting residents' wellbeing and decreasing burnout is a focus of Graduate Medical Education (GME). A supportive clinical learning environment is required to optimize residents' wellness and learning.

OBJECTIVE

To determine if longitudinal assessments of burnout and learning environment as perceived by residents combined with applying continuous quality Model for Improvement and serial Plan, Do, Study, Act (PDSA) cycles to test interventions would improve residents' burnout.

METHODS

From November 2017 to January 2020, 271 GME residents in internal medicine, general surgery, psychiatry, emergency medicine, family medicine and obstetrics and gynecology, were assessed over five cycles by Maslach Burnout Inventory (MBI), and by clinical learning environment factors (which included personal/social relationships, self-defined burnout, program burnout support, program back-up support, clinical supervision by faculty, and sleep difficulties). The results of the MBI and clinical learning environment factors were observed and analyzed to determine and develop indicated Institutional and individual program interventions using a Plan, Do, Study, Act process with each of the five cycles.

RESULTS

The response rate was 78.34%. MBI parameters for all GME residents improved over time but were not statistically significant. Residents' positive perception of the clinical supervision by faculty was significantly and independently associated with improved MBI scores, while residents' self-defined burnout; and impaired personal relations perceptions were independently significantly associated with adverse MBI scores on liner regression. For all GME, significant improvements improved over time in residents' perception of impaired personal relationships (p < 0.001), self-defined burnout (p = 0.013), program burn-out support (p = 0.002) and program back-up support (p = 0.028). For the Internal Medicine Residency program, there were statistically significant improvements in all three MBI factors (p < 0.001) and in clinical learning environment measures (p = 0.006 to < 0.001). Interventions introduced during the PDSA cycles included organization-directed interventions (such as: faculty and administrative leadership recruitment, workflow interventions and residents' schedule optimization), and individual interventions (such as: selfcare, mentoring and resilience training).

CONCLUSION

In our study, for all GME residents, clinical learning environment factors in contrast to MBI factors showed significant improvements. Residents' positive perception of the clinical learning environment was associated with improved burnout measures. Residents in separate programs responded differently with one program reaching significance in all MBI and clinical learning environment factors measured. Continuous wellbeing assessment of all GME residents and introduction of Institutional and individual program interventions was accomplished.

Increasing Patient Safety Event Reporting Among Pediatric Residents

Background and objective

Despite their role as frontline providers, resident physicians often underreport adverse patient events or safety issues they encounter. The objective of this study was to increase the number of patient safety events (PSE) reported at our institution through the implementation of a longitudinal, multi-pronged approach.

Methods

We designed and implemented a series of interventions focused on increasing patient safety events reported by resident physicians from October 2018 to April 2021. Interventions consisted of formal didactic sessions, increasing awareness among organizational leaders about the integral role of residents, implementing a direct feedback process to residents regarding the events, and encouraging them to develop solutions to their PSE that were associated with a financial incentive. We collected the rates of reports every month to assess the impact of our interventions.

Results

The mean number of PSEs submitted monthly increased from zero to two reports at baseline to 10.4 during the study period. The mean number of PSE increased to 5.8 (range: 2-11) at the end of the first intervention. Following the third intervention, the average number of reported PSE was 12.3 (range: 5-18). There was a continued increase in the number of events reported across the study period, which was sustained. The outcome of interest was not achieved after intervention 1 but was achieved in 27% and 62% of months following interventions two and three. By theend of the study period, our goal of >13 PSEs per month was consistently met. The most significant increase in reporting occurred when residents received positive timely feedback regarding their reports.

Conclusions

The number of patient safety events reported by pediatric residents increased at our institution following the implementation of a multi-pronged approach including enhanced education, recognition of the residents as frontline reporters among institutional stakeholders, and direct feedback regarding submissions. Our strategies may be replicated at other residency programs seeking to establish resident involvement in safety initiatives. Further work is necessary to ensure residents gain an understanding of how patient safety events are addressed and prevented at an organizational level.

I-PSI: Short- and Long-Term Efficacy of a Comprehensive Initiative to Promote Patient Safety Event Reporting by Trainees

Despite benefits of safety event reporting, few are trainee initiated. A comprehensive intervention was created to increase trainee reporting, partnering a trainee safety council with high-level faculty. Data were collected for 12 months pre intervention and 30 months post intervention, including short-term (1-12 mo) and long-term (13-30 mo) follow-up. A total of 2337 trainee events were submitted over the study period, primarily communication-related (40%) and on the medicine service (39%). Monthly submissions increased from 29.3 pre intervention to 66.2, 77.7, and 58.6 events/mo at post intervention, short-term follow-up, and long-term follow-up, respectively (P < 0.001). Proportion of hospital events submitted by trainees increased from 2.3% pre intervention to 4.1%, 4.9%, and 3.6% at post intervention, short-term, and long-term follow-up, respectively (P < 0.001). Trainee monthly submissions (P = 0.015) and proportion of hospital events (P < 0.001) declined from short- to long-term follow-up. Low- and intermediate-level harm events significantly increased post intervention (P < 0.001) while high-level events did not (P = 0.15-1.0). Our comprehensive intervention increased trainee event submissions at long-term follow-up.

Application of continuous quality improvement to medical education

CONTEXT

The explicit, intentional and systematic application of continuous quality improvement (QI) in medical education practice and research can improve medical education and help it achieve its goals. Quality improvement and medical education share a foundation centred on learning-experiencing, reflecting, thinking and acting in continuous cycles that spiral to sustained advancement. This suggests that a QI mindset can be brought to bear on various aspects of medical education research and practice.

DISCUSSION

To explore this possibility, we turn to W. Edwards Deming's System of Profound Knowledge, widely regarded as one of the foundational frameworks in quality improvement, where he argues strongly that there are four highly interrelated elements that are required for improvement: Appreciation of a System, Theory of Knowledge, Knowledge about Variation and Knowledge of Psychology. In this article, we define and explore each of the four domains and their application in medical education, highlighting both opportunities and challenges.

CONCLUSION

Medical educators who utilise QI in their educational practices can help create learning environments that imprint positively on learners and contribute to better outcomes in their clinical learning environments. We provide recommendations for how educators' informed use of QI can improve medical education and help it achieve its ultimate goal of improved health and health care.

A Narrative Review of Strategies to Increase Patient Safety Event Reporting by Residents

BACKGROUND

Because residents are often on the frontlines of patient care and are likely to witness adverse events firsthand, it is critical they report patient safety events. They may, however, be underreporting.

OBJECTIVE

We examined the current literature to identify strategies to increase patient safety event reporting by residents.

METHODS

We used CINAHL (EBSCO Information Services, Ipswich, MA), EMBASE (Elsevier, Amsterdam, the Netherlands), PsycINFO (APA Publishing, Washington, DC), and PubMed (National Center for Biotechnology Information, Bethesda, MD) databases. The search was limited to English-language articles published in peer-reviewed journals through March 2020. Key terms included "residents, trainees, fellows, interns, graduate medical education, house staff, event reporting, patient safety reporting, incident reporting, adverse event, and medical error." To organize findings, we adapted a published framework of strategies for encouraging self-protective behavior.

RESULTS

We identified 68 articles that described strategies used to increase event reporting. The most sustainable interventions used a combination of 3 of the 5 strategies: behavior modeling, surveys and messaging, and required limited financial support. The survey creates awareness; the behavior modeling is critical for educational purposes, and the reminders help to reinforce the new behavior and embed it into routine patient care activities. We noted a dearth of studies involving trainees in root cause analysis following submission of event reports.

CONCLUSIONS

The most successful sustainable interventions were those that combined strategies that minimized time for busy physicians, incorporated accessible event reporting in already existing medical records, and became part of a normal workflow in patient care.

Encouraging Resident Adverse Event Reporting: A Qualitative Study of Suggestions from the Front Lines

INTRODUCTION

Little is known about what motivates residents to report adverse events. The goals of the qualitative study were to: (1) better understand facilitators to residents' event reporting and (2) identify effective interventions that encourage residents to report.

METHODS

The authors conducted focus groups of upper-level residents from 4 training programs (2 internal medicine, a pediatric, and a combined medicine-pediatric) who rotated at 3 institutions within a large healthcare system in 2016. Quantitative data on reporting experience were gathered. Focus groups were audio recorded and transcribed. Two coders reviewed transcripts using the editing approach and organized codes into themes.

RESULTS

Sixty-four residents participated in 8 focus groups. Residents were universally exposed to reportable events and knew how to report. Residents' reporting behavior varied by site according to local culture, with residents filing more reports at the pediatric hospital compared to other sites, but all groups expressed similar general views about facilitators to reporting. Facilitators included familiarity with the investigation process, reporting via telephone, and routine safety educational sessions with safety administrators. Residents identified specific interventions that encouraged reporting at the pediatric hospital, including incorporating an attending physician review of events into sign-out and training on error disclosure.

CONCLUSIONS

This study provides insight into what motivates resident event reporting and describes concrete interventions to increase reporting. Our findings are consistent with the Theoretical Domains Framework of behavioral change. These strategies could prove successful at other pediatric hospitals to build a culture that values reporting and prepares residents as patient safety champions.

Using Patient Safety Reporting Systems to Understand the Clinical Learning Environment: A Content Analysis

OBJECTIVE

To examine patient safety event reporting behavior by trainees caring for surgical patients compared to other clinicians.

DESIGN

Qualitative analysis of a patient safety event reporting system comparing reports entered by trainees to those entered by attending physicians and nurses. Categorical data associated with reports were compared, and free-text event descriptions underwent content analysis focusing on themes related to report completeness and report focus.

SETTING

The Hospital of the University of Pennsylvania, an academic tertiary care hospital in Philadelphia, Pennsylvania.

PARTICIPANTS

All patient safety event reports related to surgical patients from a 6-month period (July-December 2016).

RESULTS

One thousand four hundred twenty-three reports were entered by trainees (T), attendings (A), and nurses (N). Trainees had a lower number of reports entered per reporter compared to nurses (T median [IQR]: 1 [1-2], N: 2 [1-3]), and the highest percentage of reports entered anonymously for any group (T: 28.7%, N: 9.9%, A: 4.6%). The overall distribution of event location and event type differed significantly between groups (p < 0.001). Trainee reports were found to have a broader range of focus, more elements associated with completeness of reports, and more frequent use of blame language.

CONCLUSIONS

Surgical trainees report a wide variety of issues in the perioperative, floor, and ICU settings. Their reports often include more details than those entered by other clinicians, but feature higher rates of anonymous reporting and use of blame language. Analysis of patient safety event reports by trainees compared with other healthcare professionals can reveal important insights into the clinical learning environment and areas for safety improvement.

Assessment of knowledge and attitudes towards safety events reporting among residents in a community health system

Background: Resident physicians are known to be infrequent reporters of patient safety events (PSE). Previous studies assessing barriers to resident PSE reporting have not considered possible cultural barriers faced by international medical graduates (IMG). This study aimed to assess the knowledge and attitudes of residents regarding PSE and possible barriers contributing to poor resident reporting.

Methods: A cross sectional survey of all house staff undergoing post-graduate residency training at two independent community hospital based academic medical centers was conducted through an online questionnaire. Sample case vignettes were created to assess the residents’ ability to identify safety events and classify them as near miss, adverse events or sentinel events and decide whether they were reportable.

Results: The Reporting of PSE increased significantly by year of residency training (p < 0.005), with time taken to file a PSE being the strongest perceived barrier. There was no difference in PSE reporting between IMG’s and non- IMG’s. We identified major knowledge gaps with only 73.9%, 79.6% and 94.3% of respondents correctly identifying sentinel events, adverse events, and near misses, respectively. 58.1% of respondents did not think near misses were reportable.

Conclusions: A lack of knowledge is the most important barrier towards PSE reporting. A different cultural background and lack of previous exposure to patient safety report by IMGs is not a significant barrier towards safety event reporting. In the short-term, it appears that focusing limited institutional resources on education rather than acculturation issues would have the greatest benefit.

The Psychiatry Morbidity and Mortality Incident Reporting Tool Increases Psychiatrist Participation in Reporting Adverse Events

OBJECTIVES

Although the reporting of adverse events (AEs) is widely thought to be a key first step to improving patient safety in hospital systems, underreporting remains a common problem, particularly among physicians. We aimed to increase the number of safety reports filed by psychiatrists in our hospital system.

METHODS

We piloted an online survey for psychiatry-specific AE reporting, the Psychiatry Morbidity and Mortality Incident Reporting Tool (PMIRT) for a 1-year period. An e-mail prompt containing a link to the survey was sent on a weekly basis to all psychiatry department clinical staff. The primary outcome was the total number of events reported by psychiatrists through PMIRT; secondary outcomes were the total number of AEs and the number of serious harm events filed by psychiatrists in our hospital's formal event reporting system before and after implementation of the new protocol.

RESULTS

Psychiatrists filed 65 reports in PMIRT during the study period. The average number of AEs reported by psychiatrists in the hospital's formal event reporting system significantly increased after the intervention (P = 0.0251), and the average number of serious harm events reported by psychiatrists increased nonsignificantly (P = 0.1394).

CONCLUSIONS

The combination of an increase in awareness of event reporting with a psychiatry-specific AE reporting tool resulted in a significant improvement in the number of reports by psychiatrists.

Increasing Patient Safety Event Reporting in an Emergency Medicine Residency

Patient safety event reporting is an important component for fostering a culture of safety. Our tertiary care hospital utilizes a computerized patient safety event reporting system that has been historically underutilized by residents and faculty, despite encouragement of its use. The objective of this quality project was to increase patient safety event reporting within our Emergency Medicine residency program. Knowledge of event reporting was evaluated with a survey. Eighteen residents and five faculty participated in a formal educational session on event reporting followed by feedback every two months on events reported and actions taken. The educational session included description of which events to report and the logistics of accessing the reporting system. Participants received a survey after the educational intervention to assess resident familiarity and comfort with using the system. The total number of events reported was obtained before and after the educational session. After the educational session, residents reported being more confident in knowing what to report as a patient safety event, knowing how to report events, how to access the reporting tool, and how to enter a patient safety event. In the 14 months preceding the educational session, an average of 0.4 events were reported per month from the residency. In the nine months following the educational session, an average of 3.7 events were reported per month by the residency. In addition, the reported events resulted in meaningful actions taken by the hospital to improve patient safety, which were shared with the residents. Improvement efforts including an educational session, feedback to the residency of events reported, and communication of improvements resulting from reported events successfully increased the frequency of safety event reporting in an Emergency Medicine residency.