Turning up the volume to address biases in predicted healthcare-associated infections and enhance U.S. hospital rankings: A data-driven approach

OBJECTIVES

To examine potential biases in standardized infection ratio (SIR) metrics due to static U.S. Centers for Disease Control and Prevention (CDC) parameters and non-linearity of infection outcomes with volume. Correspondingly, to enhance the CDC predictions by incorporating additional information from volume metrics and explore an alternative approach to more fairly rank hospitals to address the SIR=0 problem.

METHODS

This population-based study uses publicly available 2019 healthcare-associated infections (HAI) data from 3096 acute care U.S. hospitals. HAI-specific Poisson generalized additive models illustrate the recalibration of CDC predictions, using volume-based spline functions to adjust for biases. Implied cumulative distribution functions (CDF) were derived, and HAI-facility-specific probabilities were calculated. Hospital rankings implied from these HAI-stratified probabilities were calculated.

RESULTS

Calibration plots demonstrate existing biases associated with CDC infection over-predictions. Volume-based spline functions were significant for all HAIs (P<.0004). CDF-based rankings resulted in larger discrimination across hospitals based on strength of evidence, especially among SIR=0 facilities. National maps depict ranking differences by HAI and state.

CONCLUSION

Adjustment of SIR biases, which differ by facility volume, is needed to produce more accurate and fairer hospital rankings.

Indirect Versus Direct Standardization Methods for Reporting Healthcare-Associated Infections: An Analysis of Central Line-Associated Bloodstream Infections in Maryland

Whether healthcare-associated infection data should be presented using indirect (current CMS/CDC methodology) or direct standardization remains controversial. We applied both methods to central-line-associated bloodstream infection data from 45 acute-care hospitals in Maryland from 2012 to 2014. We found that the 2 methods generate different hospital rankings with payment implications. Infect Control Hosp Epidemiol 2017;38:989-992.

Standardized Infection Ratio for Surgical Site Infection after Colon Surgery: Discord in Models Measuring Healthcare Quality

The government publishes 3 different public report surgical site infection (SSI) metrics, all called standardized infection ratios (SIRs), that impact perceived hospital quality. We conducted a non-random cross-sectional observational pilot study of 20 California hospitals that voluntarily submitted colon surgery and SSI data. Discordant SIR values, leading to contradictory conclusions, occurred in 35% of these hospitals. Infect Control Hosp Epidemiol 2016;1-5.

Buyer beware: health choices information broadcast to the public

Purpose

– This paper is based on the author’s 2015 Northwest Patient Safety Conference presentation, consistent with a conference theme of improving doctor-patient communication. The paper aims to discuss these issues.

Design/methodology/approach

– Ongoing systematic accumulation and critical review of research literature regarding design of effective public information websites, conducted from 2008-2015 while the author was supervising the prototyping, refinement and evaluation of healthcare-associated infections public information websites.

Findings

– In 2005, the US Centers for Medicare and Medicaid Services launched its Hospital Compare website, announced as an enormous step forward by providing objective information to inform consumer choices. Subsequently, many other websites and programs emerged to report quality-of-care ratings of hospitals and doctors, and provide other advice intended to help the public inform their choices. When objectively evaluated to a scientific publication-level standard, websites like Hospital Compare show relatively low usage and disappointing impact; individual providers rank so differently across ratings websites that it is difficult to see how trustworthy conclusions could be drawn; and much of the advice offered through popular media is not supported by believable evidence. Further, research shows healthcare professionals and members of the lay public view concepts of evidence and evidence-based decisions quite differently. Badly informed misguided decisions can have negative consequences for providers, patients and public trust.

Originality/value

– Populism and celebrity seem to have trumped science during recent growth of public information resources for health choices. This paper summarizes serious flaws underlying resulting information products, indicating necessary changes to better serve a legitimate need.

Diminishing Surgical Site Infections in Australia: Time Trends in Infection Rates, Pathogens and Antimicrobial Resistance Using a Comprehensive Victorian Surveillance Program, 2002–2013

OBJECTIVE

To evaluate time trends in surgical site infection (SSI) rates and SSI pathogens in Australia.

DESIGN

Prospective multicenter observational cohort study.

SETTING

A group of 81 Australian healthcare facilities participating in the Victorian Healthcare Associated Infection Surveillance System (VICNISS).

PATIENTS

All patients underwent surgeries performed between October 1, 2002, and June 30, 2013. National Healthcare Safety Network SSI surveillance methods were employed by the infection prevention staff at the participating hospitals.

INTERVENTION

Procedure-specific risk-adjusted SSI rates were calculated. Pathogen-specific and antimicrobial-resistant (AMR) infections were modeled using multilevel mixed-effects Poisson regression.

RESULTS

A total of 183,625 procedures were monitored, and 5,123 SSIs were reported. Each year of observation was associated with 11% risk reduction for superficial SSI (risk ratio [RR], 0.89; 95% confidence interval [CI], 0.88–0.90), 9% risk reduction for deep SSI (RR, 0.91; 95% CI, 0.90–0.93), and 5% risk reduction for organ/space SSI (RR, 0.95; 95% CI, 0.93–0.97). Overall, 3,318 microbiologically confirmed SSIs were reported. Of these SSIs, 1,174 (35.4%) were associated with orthopedic surgery, 827 (24.9%) with coronary artery bypass surgery, 490 (14.8%) with Caesarean sections, and 414 (12.5%) with colorectal procedures. Staphylococcus aureus was the most frequently identified pathogen, and a statistically significant increase in infections due to ceftriaxone-resistant Escherichia coli was observed (RR, 1.37; 95% CI, 1.10–1.70).

CONCLUSIONS

Standardized SSI surveillance methods have been implemented in Victoria, Australia. Over an 11-year period, diminishing rates of SSIs have been observed, although AMR infections increased significantly. Our findings facilitate the refinement of recommended surgical antibiotic prophylaxis regimens and highlight the need for a more expansive national surveillance strategy to identify changes in epidemiology.

Infect Control Hosp Epidemiol 2015;00(0): 1–8

Can inpatient hospital experiences predict central line-associated bloodstream infections?

Background

Factors that increase the risk of central line-associated bloodstream infections (CLABSIs) are not fully understood. Recently, Hospital Compare began compiling data from hospital-required reporting to the CDC's National Healthcare Safety Network on CLABSIs in intensive care units (ICUs), at over 4,000 Medicare-certified hospitals in the United States, and made this data accessible on a central website. Also available on the same website are results from the Hospital Consumer Assessment of Healthcare Providers and Systems survey of patients' hospital experiences. Utilizing both databases, our objective was to determine whether patients' hospital experiences were significantly associated with increased risk for reported ICU CLABSI.

Methods and Findings

We conducted a zero-inflated Poisson regression analysis at the hospital level on CLABSI-observed cases by ICUs in acute care hospitals (n = 1987) in the United States between January 1, 2011, and December 31, 2011. During this period there were a total of 10,866 CLABSI cases and 9,543,765 central line days. In our final model, the percent of patients who reported that they “sometimes” or “never” received help as soon as they wanted was significantly associated with an increased risk for CLABSIs.

Conclusions

Using national datasets, we found that inpatients' hospital experiences were significantly associated with an increased risk of ICU reported CLABSIs. This study suggests that hospitals with lower staff responsiveness, perhaps because of an understaffing of nurse and supportive personnel, are at an increased risk for CLABSIs. This study bolsters the evidence that patient surveys may be a useful surrogate to predicting the incidence of hospital acquired conditions, including CLABSIs. Moreover, our study found that poor staff responsiveness may be indicative of greater hospital problems and generally poorly performing hospitals; and that this finding may be a symptom of hospitals with a multitude of problems, including patient safety problems, and not a direct cause.