Developing Evidence for New Patient Safety Bundles Through Multihospital Collaboration

Pediatric Ventilator-Associated Events Before and After a Multicenter Quality Improvement Initiative

Importance

Pediatric ventilator-associated events (PedVAEs, defined as a sustained worsening in oxygenation after a baseline period of stability or improvement) are useful for surveillance of complications from mechanical ventilation. It is unclear whether interventions to mitigate known risk factors can reduce PedVAE rates.

Objective

To assess whether adherence to 1 or more test factors in a quality improvement bundle was associated with a reduction in PedVAE rates.

Design, Setting, and Participants

This multicenter quality improvement study obtained data from 2017 to 2020 for patients who were mechanically ventilated and cared for in neonatal, pediatric, and cardiac intensive care units (ICUs). These ICUs were located in 95 hospitals participating in the Children's Hospitals' Solutions for Patient Safety (SPS) network in North America. Data analyses were performed between September 2021 and April 2023.

Intervention

A quality improvement bundle consisted of 3 test factors: multidisciplinary apparent cause analysis, daily discussion of extubation readiness, and daily discussion of fluid balance goals. This bundle was distributed to a subgroup of hospitals that volunteered to participate in a collaborative PedVAE prevention initiative under the SPS network guidance in July 2018.

Main Outcomes and Measures

Each SPS network hospital submitted monthly PedVAE rates from January 1, 2017, to May 31, 2020, and test factor data were submitted from July 1, 2018, to May 31, 2020. Analyses focused on hospitals that reliably submitted PedVAE rate data, defined as outcomes data submission through May 31, 2020, for at least 80% of the baseline and postbaseline periods.

Results

Of the 95 hospitals in the SPS network that reported PedVAE data, 21 were grouped in the Pioneer cohort and 74 in the non-Pioneer cohort. Only 12 hospitals (57%) from the 21 Pioneer hospitals and 33 (45%) from the 74 non-Pioneer hospitals were considered to be reliable reporters of outcome data. Among the 12 hospitals, the PedVAE rate decreased from 1.9 to 1.4 events per 1000 ventilator days (absolute rate difference, -0.6; 95% CI, -0.5 to -0.7; P < .001). No significant change in the PedVAE rate was seen among the 33 hospitals that reliably submitted PedVAE rates but did not implement the bundle. Of the 12 hospitals, 3 that reliably performed daily discussion of extubation readiness had a decrease in PedVAE rate from 2.6 to 1.2 events per 1000 ventilator days (absolute rate difference, -1.4; 95% CI, -1.0 to -1.7; P < .001), whereas the other 9 hospitals that did not implement this discussion did not have a decrease.

Conclusions and Relevance

This study found that a multicenter quality improvement intervention targeting PedVAE risk factors was associated with a substantial reduction in the rate of PedVAEs in hospital ICUs. The findings suggest that ICU teams seeking to reduce PedVAEs incorporate daily discussion of extubation readiness during morning rounds.

Association Between Hospital-Acquired Harm Outcomes and Membership in a National Patient Safety Collaborative

IMPORTANCE

Hospital engagement networks supported by the US Centers for Medicare & Medicaid Services Partnership for Patients program have reported significant reductions in hospital-acquired harm, but methodological limitations and lack of peer review have led to persistent questions about the effectiveness of this approach.

OBJECTIVE

To evaluate associations between membership in Children's Hospitals' Solutions for Patient Safety (SPS), a federally funded hospital engagement network, and hospital-acquired harm using standardized definitions and secular trend adjustment.

DESIGN, SETTING, AND PARTICIPANTS

This prospective hospital cohort study included 99 children's hospitals. Using interrupted time series analyses with staggered intervention introduction, immediate and postimplementation changes in hospital-acquired harm rates were analyzed, with adjustment for preexisting secular trends. Outcomes were further evaluated by early-adopting (n = 73) and late-adopting (n = 26) cohorts.

EXPOSURES

Hospitals implemented harm prevention bundles, reported outcomes and bundle compliance using standard definitions to the network monthly, participated in learning events, and implemented a broad safety culture program. Hospitals received regular reports on their comparative performance.

MAIN OUTCOMES AND MEASURES

Outcomes for 8 hospital-acquired conditions were evaluated over 1 year before and 3 years after intervention.

RESULTS

In total, 99 hospitals met the inclusion criteria and were included in the analysis. A total of 73 were considered part of the early-adopting cohort (joined between 2012-2013) and 26 were considered part of the late-adopting cohort (joined between 2014-2016). A total of 42 hospitals were freestanding children's hospitals, and 57 were children's hospitals within hospital or health systems. The implementation of SPS was associated with an improvement in hospital-acquired condition rates in 3 of the 8 conditions after accounting for secular trends. Membership in the SPS was associated with an immediate reduction in central catheter-associated bloodstream infections (coefficient = -0.152; 95% CI, -0.213 to -0.019) and falls of moderate or greater severity (coefficient = -0.331; 95% CI, -0.594 to -0.069). The implementation of the SPS was associated with a reduction in the monthly rate of adverse drug events (coefficient = -0.021; 95% CI, -0.034 to -0.008) in the post-SPS period. The study team observed larger decreases for the early-adopting cohort compared with the late-adopting cohort.

CONCLUSIONS AND RELEVANCE

Through the application of rigorous methods (standard definitions and longitudinal time series analysis with adjustment for secular trends), this study provides a more thorough analysis of the association between the Partnership for Patients hospital engagement network model and reductions in hospital-acquired conditions. These findings strengthen previous claims of an association between this model and improvement. However, inconsistent observations across hospital-acquired conditions when adjusted for secular trends suggests that some caution regarding attributing all effects observed to this model is warranted.

Implementation of a central-line bundle: a qualitative study of three clinical units

Background

Evidence for the central line-associated bloodstream infection (CLABSI) bundle effectiveness remains mixed, possibly reflecting implementation challenges and persistent ambiguities in how CLABSIs are counted and bundle adherence measured. In the context of a tertiary pediatric hospital that had reduced CLABSI by 30% as part of an international safety program, we aimed to examine unit-based socio-cultural factors influencing bundle practices and measurement, and how they come to be recognized and attended to by safety leaders over time in an organization-wide bundle implementation effort.

Methods

We used an interpretivist qualitative research approach, based on 74 interviews, approximately 50 h of observations, and documents. Data collection focused on hospital executives and safety leadership, and three clinical units: a medical specialty unit, an intensive care unit, and a surgical unit. We used thematic analysis and constant comparison methods for data analysis.

Results

Participants had variable beliefs about the central-line bundle as a quality improvement priority based on their professional roles and experiences and unit setting, which influenced their responses. Nursing leaders were particularly concerned about CLABSI being one of an overwhelming number of QI targets for which they were responsible. Bundle implementation strategies were initially reliant on unit-based nurse education. Over time there was recognition of the need for centralized education and reinforcement tactics. However, these interventions achieved limited impact given the influence of competing unit workflow demands and professional roles, interactions, and routines, which were variably targeted in the safety program. The auditing process, initially a responsibility of units, was performed in different ways based on individuals’ approaches to the process. Given concerns about auditing reliability, a centralized approach was implemented, which continued to have its own variability.

Conclusions

Our findings report on a contextualized, dynamic implementation approach that required movement between centralized and unit-based approaches and from a focus on standardization to some recognition of a role for customization. However, some factors related to bundle compliance and measurement remain unaddressed, including harder to change socio-cultural factors likely important to sustainability of the CLABSI reductions and fostering further improvements across a broader safety agenda.

Clarifying radiology's role in safety events: a 5-year retrospective common cause analysis of safety events at a pediatric hospital

BACKGROUND

Common cause analysis of hospital safety events that involve radiology can identify opportunities to improve quality of care and patient safety.

OBJECTIVE

To study the most frequent system failures as well as key activities and processes identified in safety events in an academic children's hospital that underwent root cause analysis and in which radiology was determined to play a contributing role.

MATERIALS AND METHODS

All safety events involving diagnostic or interventional radiology from April 2013 to November 2018, for which the hospital patient safety department conducted root cause analysis, were retrospectively analyzed. Pareto charts were constructed to identify the most frequent modalities, system failure modes, key processes and key activities.

RESULTS

In 19 safety events, 64 sequential interactions were attributed to the radiology department by the patient safety department. Five of these safety events were secondary to diagnostic errors. Interventional radiology, radiography and diagnostic fluoroscopy accounted for 89.5% of the modalities in these safety events. Culture and process accounted for 55% of the system failure modes. The three most common key processes involved in these sequential interactions were diagnostic (39.1%) and procedural services (25%), followed by coordinating care and services (18.8%). The two most common key activities were interpreting/analyzing (21.9%) and coordinating activities (15.6%).

CONCLUSION

Proposing and implementing solutions based on the analysis of a single safety event may not be a robust strategy for process improvement. Common cause analyses of safety events allow for a more robust understanding of system failures and have the potential to generate more specific process improvement strategies to prevent the reoccurrence of similar errors. Our analysis demonstrated that the most common system failure modes in safety events attributed to radiology were culture and process. However, the generalizability of these findings is limited given our small sample size. Aligning with other children's hospitals to use standard safety event terminology and shared databases will likely lead to greater clarity on radiology's direct and indirect contributions to patient harm.

Assessment of an Unplanned Extubation Bundle to Reduce Unplanned Extubations in Critically Ill Neonates, Infants, and Children

IMPORTANCE

Unplanned extubations (UEs) in children contribute to significant morbidity and mortality, with an arbitrary benchmark target of less than 1 UE per 100 ventilator days. However, there have been no multicenter initiatives to reduce these events.

OBJECTIVE

To determine if a multicenter quality improvement initiative targeting all intubated neonatal and pediatric patients is associated with a reduction in UEs and morbidity associated with UE events.

DESIGN, SETTING, AND PARTICIPANTS

This multicenter quality improvement initiative enrolled patients from pediatric, neonatal, and cardiac intensive care units (ICUs) in 43 participating children's hospitals from March 2016 to December 2018. All patients with an endotracheal tube requiring mechanical ventilation were included in the study.

INTERVENTIONS

Participating hospitals implemented a quality improvement bundle to reduce UEs, which included standardized anatomic reference points and securement methods, protocol for high-risk situations, and multidisciplinary apparent cause analyses.

MAIN OUTCOMES AND MEASURES

The main outcome measures for this study included bundle compliance with each factor tested and UE rates on the center level and on the cohort level.

RESULTS

Among the 43 children's hospitals, the quality improvement initiative was associated with an aggregate 24.1% reduction in UE events, from a baseline rate of 1.135 UEs per 100 ventilator days to 0.862 UEs per 100 ventilator days. Across ICU settings studied, the pediatric ICU and neonatal ICU demonstrated centerline shifts, with an absolute reduction in events of 20.6% (from a baseline rate of 0.729 UEs per 100 ventilator days to 0.579 UEs per 100 ventilator days) and 17.6% (from a baseline rate of 1.555 UEs per 100 ventilator days to 1.282 UEs per 100 ventilator days), respectively. Most UEs required reintubation within 1 hour (mean of 120 of 206 events per month [58.3%]), followed by UEs that did not require reintubation (mean of 78 of 206 events per month [37.9%]) and UEs that resulted in cardiovascular collapse (mean of 8 of 206 events per month [3.9%]). Cardiovascular collapse events represented the most significant consequence of UE studied, and the collaborative reduced these UE events by 36.6%, from a study baseline rate of 0.041 UEs per 100 ventilator days to 0.026 UEs per 100 ventilator days.

CONCLUSIONS AND RELEVANCE

This multicenter quality improvement initiative was associated with a reduction in UEs across different pediatric populations in diverse settings. A significant reduction in event rate and rate of harm (cardiovascular collapse) was observed, which was sustained over the time course of the intervention. This quality improvement process and UE bundle may be considered standard of care for pediatric hospitals in the future.