Variation in Public Reporting of Central Line–Associated Bloodstream Infections by State

Clinical Adjudication of Hemodialysis Catheter-Related Bloodstream Infections: Findings from the REDUCCTION Trial

Key Points

The inter-rater reliability of reporting hemodialysis catheter-related infectious events between site investigators and trial adjudicators in Australia and New Zealand was substantial. The high concordance level in reporting catheter infections improves confidence in using site-level bacteremia rates as a clinical metric for quality benchmarking and future pragmatic clinical trials. A rigorous adjudication protocol may not be needed if clearly defined criteria to ascertain catheter-associated bacteremia are used.

Background

Hemodialysis catheter-related bloodstream infection (HD-CRBSI) are a significant source of morbidity and mortality among dialysis patients, but benchmarking remains difficult because of varying definitions of HD-CRBSI. This study explored the effect of clinical adjudication process on HD-CRBSI reporting.

Methods

The REDUcing the burden of Catheter ComplicaTIOns: a National approach trial implemented an evidence-based intervention bundle using a stepped-wedge design to reduce HD-CRBSI rates in 37 Australian kidney services. Six New Zealand services participated in an observational capacity. Adult patients with a new hemodialysis catheter between December 2016 and March 2020 were included. HD-CRBSI events reported were compared with the adjudicated outcomes using the end point definition and adjudication processes of the REDUcing the burden of Catheter ComplicaTIOns: a National approach trial. The concordance level was estimated using Gwet agreement coefficient (AC1) adjusted for service-level effects and implementation tranches (Australia only), with the primary outcome being the concordance of confirmed HD-CRBSI.

Results

A total of 744 hemodialysis catheter-related infectious events were reported among 7258 patients, 12,630 catheters, and 1.3 million catheter-exposure days. The majority were confirmed HD-CRBSI, with 77.9% agreement and substantial concordance (AC1=0.77; 95% confidence interval [CI], 0.73 to 0.81). Exit site infections have the highest concordance (AC1=0.85; 95% CI, 0.78 to 0.91); the greatest discordance was in events classified as other (AC1=0.33; 95% CI, 0.16 to 0.49). The concordance of all hemodialysis catheter infectious events remained substantial (AC1=0.80; 95% CI, 0.76 to 0.83) even after adjusting for the intervention tranches in Australia and overall service-level clustering.

Conclusions

There was a substantial level of concordance in overall and service-level reporting of confirmed HD-CRBSI. A standardized end point definition of HD-CRBSI resulted in comparable hemodialysis catheter infection rates in Australian and New Zealand kidney services. Consistent end point definition could enable reliable benchmarking outside clinical trials without the need for independent clinical adjudication.

Hospital-onset bacteremia and fungemia: An evaluation of predictors and feasibility of benchmarking comparing two risk-adjusted models among 267 hospitals

Objectives:

To evaluate the prevalence of hospital-onset bacteremia and fungemia (HOB), identify hospital-level predictors, and to evaluate the feasibility of an HOB metric.

Methods:

We analyzed 9,202,650 admissions from 267 hospitals during 2015–2020. An HOB event was defined as the first positive blood-culture pathogen on day 3 of admission or later. We used the generalized linear model method via negative binomial regression to identify variables and risk markers for HOB. Standardized infection ratios (SIRs) were calculated based on 2 risk-adjusted models: a simple model using descriptive variables and a complex model using descriptive variables plus additional measures of blood-culture testing practices. Performance of each model was compared against the unadjusted rate of HOB.

Results:

Overall median rate of HOB per 100 admissions was 0.124 (interquartile range, 0.00–0.22). Facility-level predictors included bed size, sex, ICU admissions, community-onset (CO) blood culture testing intensity, and hospital-onset (HO) testing intensity, and prevalence (all P < .001). In the complex model, CO bacteremia prevalence, HO testing intensity, and HO testing prevalence were the predictors most associated with HOB. The complex model demonstrated better model performance; 55% of hospitals that ranked in the highest quartile based on their raw rate shifted to a lower quartile when the SIR from the complex model was applied.

Conclusions:

Hospital descriptors, aggregate patient characteristics, community bacteremia and/or fungemia burden, and clinical blood-culture testing practices influence rates of HOB. Benchmarking an HOB metric is feasible and should endeavor to include both facility and clinical variables.

Strategies to Prevent Central Line-Associated Bloodstream Infections in Acute Care Hospitals: 2014 Update

Previously published guidelines are available that provide comprehensive recommendations for detecting and preventing healthcare-associated infections (HAIs). The intent of this document is to highlight practical recommendations in a concise format designed to assist acute care hospitals in implementing and prioritizing their central line-associated bloodstream infection (CLABSI) prevention efforts. This document updates “Strategies to Prevent Central Line-Associated Bloodstream Infections in Acute Care Hospitals,” published in 2008. This expert guidance document is sponsored by the Society for Healthcare Epidemiology of America (SHEA) and is the product of a collaborative effort led by SHEA, the Infectious Diseases Society of America (IDSA), the American Hospital Association (AHA), the Association for Professionals in Infection Control and Epidemiology (APIC), and The Joint Commission, with major contributions from representatives of a number of organizations and societies with content expertise. The list of endorsing and supporting organizations is presented in the introduction to the 2014 updates.

State-mandated reporting of health care-associated infections in the United States: trends over time

Over the past decade, most US states and territories began mandating that acute care hospitals report health care-associated infections (HAIs) to their departments of health. Trends in state HAI law enactment and data submission requirements were determined through systematic legal review; state HAI coordinators were contacted to confirm collected data. As of January 31, 2013, 37 US states and territories (71%) had adopted laws requiring HAI data submission, most of which were enacted and became effective in 2006 and 2007. Most states with HAI laws required reporting of central line-associated bloodstream infections in adult intensive care units (92%), and about half required reporting of methicillin-resistant Staphylococcus aureus and Clostridium difficile infections (54% and 51%, respectively). Overall, data submission requirements were found to vary across states. Considering the facility and state resources needed to comply with HAI reporting mandates, future studies should focus on whether these laws have had the desired impact of reducing infection rates.

Strategies to Prevent Central Line-Associated Bloodstream Infections in Acute Care Hospitals: 2014 Update

Previously published guidelines are available that provide comprehensive recommendations for detecting and preventing healthcare-associated infections (HAIs). The intent of this document is to highlight practical recommendations in a concise format designed to assist acute care hospitals in implementing and prioritizing their central line-associated bloodstream infection (CLABSI) prevention efforts. This document updates “Strategies to Prevent Central Line-Associated Bloodstream Infections in Acute Care Hospitals,” published in 2008. This expert guidance document is sponsored by the Society for Healthcare Epidemiology of America (SHEA) and is the product of a collaborative effort led by SHEA, the Infectious Diseases Society of America (IDSA), the American Hospital Association (AHA), the Association for Professionals in Infection Control and Epidemiology (APIC), and The Joint Commission, with major contributions from representatives of a number of organizations and societies with content expertise. The list of endorsing and supporting organizations is presented in the introduction to the 2014 updates.

Diagnosing and Reporting of Central Line–Associated Bloodstream Infections

Background.

The diagnosis of central line-associated bloodstream infections (CLABSIs) is often controversial, and existing guidelines differ in important ways.

Objective.

To determine both the range of practices involved in obtaining blood culture samples and how central line-associated infections are diagnosed and to obtain members' opinions regarding the process of designating bloodstream infections as publicly reportable CLABSIs.

Design.

Electronic and paper 11-question survey of infectious-diseases physician members of the Infectious Diseases Society of America Emerging Infections Network (IDSA EIN).

Participants.

All 1,364 IDSA EIN members were invited to participate.

Results.

692 (51%) members responded; 52% of respondents with adult practices reported that more than half of the blood culture samples for intensive care unit (ICU) patients with central lines were drawn through existing lines. A sizable majority of respondents used time to positivity, differential time to positivity when paired blood cultures are used, and quantitative culture of catheter tips when diagnosing CLABSI or determining the source of that bacteremia. When determining whether a bacteremia met the reportable CLABSI definition, a majority used a decision method that involved clinical judgment.

Conclusions.

Our survey documents a strong preference for drawing 1 set of blood culture samples from a peripheral line and 1 from the central line when evaluating fever in an ICU patient, as recommended by IDSA guidelines and in contrast to current Centers for Disease Control and Prevention recommendations. Our data show substantial variability when infectious-diseases physicians were asked to determine whether bloodstream infections were primary bacteremias, and therefore subject to public reporting by National Healthcare Safety Network guidelines, or secondary bacteremias, which are not reportable.

Evaluating the impact of mandatory public reporting on participation and performance in a program to reduce central line-associated bloodstream infections: evidence from a national patient safety collaborative

BACKGROUND

It is not clear whether mandatory reporting influences the efforts and performance of hospitals to prevent hospital-acquired infections. This study examines whether mandatory reporting impacted participation and performance in reducing central line-associated bloodstream infections (CLABSIs) in a national patient safety collaborative.

METHODS

We analyzed 1,046 adult intensive care units (ICUs) participating in the national On the CUSP: Stop BSI program. We used a difference-in-difference approach to compare changes in CLABSI rates in states with no public reporting mandate, recent mandates, and longer-standing mandates. Chi-square tests were used to examine the differences in the participation rate.

RESULTS

States enacting a law requiring mandatory public reporting of CLABSI rates around the time of the national program had the highest hospital participation rates (approximately 50%). Compared with units in states with no reporting requirement, units in the states with voluntary reporting systems or with longer periods of mandatory reporting experience had higher CLABSI rates at baseline and greater reductions in CLABSI in the first 6 months. State groups with mandatory public reporting of CLABSI showed a trend toward greater reduction in CLABSI after 1 year of program implementation.

CONCLUSION

Mandatory reporting requirements may spark hospitals to turn to proven infection prevention interventions to improve CLABSI rates. Reporting requirements do not teach sites how to reduce rates. ICUs need both motivation and facilitation to reach consumer expectations for infection prevention.

Compliance with prevention practices and their association with central line-associated bloodstream infections in neonatal intensive care units

BACKGROUND

Bundles and checklists have been shown to decrease the rates of central line-associated bloodstream infections (CLABSIs), but implementation of these practices and association with CLABSI rates have not been described nationally. We describe implementation and levels of compliance with preventive practices in a sample of US neonatal intensive care units (NICUs) and assess their association with CLABSI rates.

METHODS

An online survey assessing infection prevention practices was sent to hospitals participating in National Healthcare Safety Network CLABSI surveillance in October 2011. Participating hospitals permitted access to their NICU CLABSI rates. Multivariable regressions were used to test the association between compliance with NICU-specific CLABSI prevention practices and corresponding CLABSI rates.

RESULTS

Overall, 190 level II/III and level III NICUs participated. The majority of NICUs had written policies (84%-93%) and monitored compliance with bundles and checklists (88%-91%). Reporting ≥95% compliance for any of the practices ranged from 50%-63%. Reporting of ≥95% compliance with insertion checklist and assessment of daily line necessity were significantly associated with lower CLABSI rates (P < .05).

CONCLUSIONS

Most of the NICUs in this national sample have instituted CLABSI prevention policies and monitor compliance, although reporting compliance ≥95% was suboptimal. Reporting ≥95% compliance with select CLABSI prevention practices was associated with lower CLABSI rates. Future studies should focus on identifying and improving compliance with effective CLABSI prevention practices in neonates.

The association of state legal mandates for data submission of central line-associated bloodstream infections in neonatal intensive care units with process and outcome measures

OBJECTIVE

To determine the association between state legal mandates for data submission of central line-associated bloodstream infections (CLABSIs) in neonatal intensive care units (NICUs) with process and outcome measures.

DESIGN

Cross-sectional study.

PARTICIPANTS

National sample of level II/III and III NICUs participating in National Healthcare Safety Network (NHSN) surveillance.

METHODS

State mandates for data submission of CLABSIs in NICUs in place by 2011 were compiled and verified with state healthcare-associated infection coordinators. A web-based survey of infection control departments in October 2011 assessed CLABSI prevention practices, ie, compliance with checklist/bundle components (process measures) in ICUs including NICUs. Corresponding 2011 NHSN NICU CLABSI rates (outcome measures) were used to calculate standardized infection ratios (SIRs). Association between mandates and process and outcome measures was assessed by multivariable logistic regression.

RESULTS

Among 190 study NICUs, 107 (56.3%) were located in states with mandates, with mandates in place >3 years in 52 (49%). More NICUs in states with mandates reported ≥95% compliance to at least 1 CLABSI prevention practice (52.3%-66.4%) than NICUs in states without mandates (28.9%-48.2%). Mandates were predictors of ≥95% compliance with all practices (odds ratio, 2.8; 95% confidence interval, 1.4-6.1). NICUs in states with mandates reported lower mean CLABSI rates in the ≤750-g birth weight group (2.4 vs 5.7 CLABSIs/1,000 central line-days) but not in others. Mandates were not associated with SIR <1.

CONCLUSIONS

State mandates for NICU CLABSI data submission were significantly associated with ≥95% compliance with CLABSI prevention practices, which declined with the duration of mandate but not with lower CLABSI rates.

Examining the differences in format and characteristics of zoonotic virus surveillance data on state agency websites

Background

Zoonotic viruses are infectious organisms transmittable between animals and humans. Agencies of public health, agriculture, and wildlife conduct surveillance of zoonotic viruses and often report data on their websites. However, the format and characteristics of these data are not known.

Objective

To describe and compare the format and characteristics of statistics of zoonotic viruses on state public health, agriculture, and wildlife agency websites.

Methods

For each state, we considered the websites of that state’s public health, agriculture, and wildlife agency. For each website, we noted the presence of any statistics for zoonotic viruses from 2000-2012. We analyzed the data using numerous categories including type of statistic, temporal and geographic level of detail, and format. We prioritized our analysis within each category based on assumptions of individuals’ preferences for extracting and analyzing data from websites. Thus, if two types of data (such as city and state-level) were present for a given virus in a given year, we counted the one with higher priority (city). External links from agency sites to other websites were not considered.

Results

From 2000-2012, state health departments had the most extensive virus data, followed by agriculture, and then wildlife. We focused on the seven viruses that were common across the three agencies. These included rabies, West Nile virus, eastern equine encephalitis, St. Louis encephalitis, western equine encephalitis, influenza, and dengue fever. Simple numerical totals were most often used to report the data (89% for public health, 81% for agriculture, and 82% for wildlife), and proportions were not different (chi-square P=.15). Public health data were most often presented yearly (66%), while agriculture and wildlife agencies often described cases as they occurred (Fisher’s Exact test P<.001). Regarding format, public health agencies had more downloadable PDF files (68%), while agriculture (61%) and wildlife agencies (46%) presented data directly in the text of the HTML webpage (Fisher’s Exact test P<.001). Demographics and other information including age, gender, and host were limited. Finally, a Fisher’s Exact test showed no association between geography data and agency type (P=.08). However, it was noted that agriculture department data was often at the county level (63%), while public health was mixed between county (38%) and state (35%).

Conclusions

This study focused on the format and characteristics of statistics of zoonotic viruses on websites of state public health, wildlife, and agriculture agencies in the context of population health surveillance. Data on zoonotic viruses varied across agencies presenting challenges for researchers needing to integrate animal and human data from different websites.

What counts? An ethnographic study of infection data reported to a patient safety program

CONTEXT

Performance measures are increasingly widely used in health care and have an important role in quality. However, field studies of what organizations are doing when they collect and report performance measures are rare. An opportunity for such a study was presented by a patient safety program requiring intensive care units (ICUs) in England to submit monthly data on central venous catheter bloodstream infections (CVC-BSIs).

METHODS

We conducted an ethnographic study involving ∼855 hours of observational fieldwork and 93 interviews in 17 ICUs plus 29 telephone interviews.

FINDINGS

Variability was evident within and between ICUs in how they applied inclusion and exclusion criteria for the program, the data collection systems they established, practices in sending blood samples for analysis, microbiological support and laboratory techniques, and procedures for collecting and compiling data on possible infections. Those making decisions about what to report were not making decisions about the same things, nor were they making decisions in the same way. Rather than providing objective and clear criteria, the definitions for classifying infections used were seen as subjective, messy, and admitting the possibility of unfairness. Reported infection rates reflected localized interpretations rather than a standardized dataset across all ICUs. Variability arose not because of wily workers deliberately concealing, obscuring, or deceiving but because counting was as much a social practice as a technical practice.

CONCLUSIONS

Rather than objective measures of incidence, differences in reported infection rates may reflect, at least to some extent, underlying social practices in data collection and reporting and variations in clinical practice. The variability we identified was largely artless rather than artful: currently dominant assumptions of gaming as responses to performance measures do not properly account for how categories and classifications operate in the pragmatic conduct of health care. These findings have important implications for assumptions about what can be achieved in infection reduction and quality improvement strategies.