Validation of the surveillance and reporting of central line-associated bloodstream infection denominator data

External and internal validation of healthcare-associated infection data collected by the Korean National healthcare-associated Infections Surveillance System (KONIS)

BACKGROUND

This study analyzed the validity of healthcare-associated infection (HAI) data of the Korean National healthcare-associated Infections Surveillance System.

METHODS

The validation process consisted of external (EV) and internal (IV) validation phases. Of the 193 hospitals that participated from July 2016 through June 2017, EV was performed for 10 hospitals that were selected based on the HAI rate percentile. The EV team reviewed 295 medical records for 60 HAIs and 235 non-HAI control patients. IV was performed for both the 10 EV hospitals and 11 other participating hospitals that did not report any HAIs.

RESULTS

In the EV, the diagnosis of urinary tract infections had a sensitivity of 72.0% and a specificity of 99.3%. The respective sensitivities of bloodstream infection and pneumonia were 63.2% and 70.6%; the respective specificities were 98.8% and 99.6%. The agreement (ĸ) between the EV and IV for 10 hospitals was 0.754 for urinary tract infections and 0.674 for bloodstream infections (P < .001, respectively). Additionally, IV found additional cases among 11 zero-report hospitals.

DISCUSSION

This study demonstrates the need for ongoing validation and continuous training to maintain the accuracy of nationwide surveillance data.

CONCLUSIONS

IV should be considered a validation method to supplement EV.

Healthcare-associated infections and conditions in the era of digital measurement

As the third edition of the Compendium of Strategies to Prevent Healthcare-Associated Infections in Acute Care Hospitals is released with the latest recommendations for the prevention and management of healthcare-associated infections (HAIs), a new approach to reporting HAIs is just beginning to unfold. This next generation of HAI reporting will be fully electronic and based largely on existing data in electronic health record (EHR) systems and other electronic data sources. It will be a significant change in how hospitals report HAIs and how the Centers for Disease Control and Prevention (CDC) and other agencies receive this information. This paper outlines what that future electronic reporting system will look like and how it will impact HAI reporting.

A systemwide approach to validation of electronic device denominator data

A multidisciplinary team collaborated to develop and validate a process to electronically capture patient and device denominator data at 6 hospitals in the same healthcare system. Validation was completed within 4-16 months. Manual count errors were identified as the main driver of electronic versus manual discrepancies.

Automating surveillance for healthcare-associated infections: Rationale and current realities (Part I/III)

Infection surveillance is one of the cornerstones of infection prevention and control. Measurement of process metrics and clinical outcomes, such as detection of healthcare-associated infections (HAIs), can be used to support continuous quality improvement. HAI metrics are reported as part of the CMS Hospital-Acquired Conditions Program, and they influence facility reputation and financial outcomes.

Beyond the abacus: Leveraging the electronic medical record for central line day surveillance

Manual counting is considered the gold standard for device day recording by the National Health Safety Network. We describe the development of a process for an electronic count of central line days across our ten-hospital health care system. Our validation process identified discordance between the electronic count and the manual count for 71% of patient care units. Adjudication of the count differences by chart review identified the electronic count to be correct 97% of the time.

A systematic review of central-line-associated bloodstream infection (CLABSI) diagnostic reliability and error

OBJECTIVE

To establish the reliability of the application of National Health and Safety Network (NHSN) central-line-associated bloodstream infection (CLABSI) criteria within established reporting systems internationally.

DESIGN

Diagnostic-test accuracy systematic review.

METHODS

We conducted a search of Medline, SCOPUS, the Cochrane Library, CINAHL (EbscoHost), and PubMed (NCBI). Cohort studies were eligible for inclusion if they compared publicly reported CLABSI rates and were conducted by independent and expertly trained reviewers using NHSN/Centers for Disease Control (or equivalent) criteria. Two independent reviewers screened, extracted data, and assessed risk of bias using the QUADAS 2 tool. Sensitivity, specificity, negative and positive predictive values were analyzed.

RESULTS

A systematic search identified 1,259 publications; 9 studies were eligible for inclusion (n = 7,160 central lines). Publicly reported CLABSI rates were more likely to be underestimated (7 studies) than overestimated (2 studies). Specificity ranged from 0.70 (95% confidence interval [CI], 0.58-0.81) to 0.99 (95% CI, 0.99-1.00) and sensitivity ranged from 0.42 (95% CI, 0.15-0.72) to 0.88 (95% CI, 0.77-0.95). Four studies, which included a consecutive series of patients (whole cohort), reported CLABSI incidence between 9.8% and 20.9%, and absolute CLABSI rates were underestimated by 3.3%-4.4%. The risk of bias was low to moderate in most included studies.

CONCLUSIONS

Our findings suggest consistent underestimation of true CLABSI incidence within publicly reported rates, weakening the validity and reliability of surveillance measures. Auditing, education, and adequate resource allocation is necessary to ensure that surveillance data are accurate and suitable for benchmarking and quality improvement measures over time.

REGISTRATION

Prospectively registered with International prospective register of systematic reviews (PROSPERO ID CRD42015021989; June 7, 2015). https://www.crd.york.ac.uk/PROSPERO/display_record.php?ID%3dCRD42015021989.

The expansion of National Healthcare Safety Network enrollment and reporting in nursing homes: Lessons learned from a national qualitative study

BACKGROUND

This study explored nursing home (NH) personnel perceptions of the National Healthcare Safety Network (NHSN).

METHODS

NHs were purposively sampled based on NHSN enrollment and reporting status, and other facility characteristics. We recruited NH personnel knowledgeable about the facility's decision-making processes and infection prevention program. Interviews were conducted over-the-phone and audio-recorded; transcripts were analyzed using conventional content analysis.

RESULTS

We enrolled 14 NHs across the United States and interviewed 42 personnel. Six themes emerged: Benefits of NHSN, External Support and Motivation, Need for a Champion, Barriers, Risk Adjustment, and Data Integrity. We did not find substantive differences in perceptions of NHSN value related to participants' professional roles or enrollment category. Some participants from newly enrolled NHs felt well supported through the NHSN enrollment process, while participants from earlier enrolled NHs perceived the process to be burdensome. Among participants from non-enrolled NHs, as well as some from enrolled NHs, there was a lack of knowledge of NHSN.

CONCLUSIONS

This qualitative study helps fill a gap in our understanding of barriers and facilitators to NHSN enrollment and reporting in NHs. Improved understanding of factors influencing decision-making processes to enroll in and maintain reporting to NHSN is an important first step towards strengthening infection surveillance in NHs.

Distribution of Central Line-Associated Bloodstream Infections Determined From Washington State’s Annual Reporting Validation Program, 2009–2013

Healthcare-associated infection reporting validation is essential because this information is increasingly used in public healthcare quality assurances and care reimbursement. Washington State’s validation of central line-associated bloodstream infection reporting applies credible quality sciences methods to ensure that hospital reporting accuracy is maintained. This paper details findings and costs from our experience.

Infect Control Hosp Epidemiol 2017;38:489–492

Hemovigilance in Massachusetts and the adoption of statewide hospital blood bank reporting using the National Healthcare Safety Network

A collaboration that grew over time between local hemovigilance stakeholders and the Massachusetts Department of Public Health (MDPH) resulted in the change from a paper-based method of reporting adverse reactions and monthly transfusion activity for regulatory compliance purposes to statewide adoption of electronic reporting via the National Healthcare Safety Network (NHSN). The NHSN is a web-based surveillance system that offers the capacity to capture transfusion-related adverse events, incidents, and monthly transfusion statistics from participating facilities. Massachusetts' hospital blood banks share the data they enter into NHSN with the MDPH to satisfy reporting requirements. Users of the NHSN Hemovigilance Module adhere to specified data entry guidelines, resulting in data that are comparable and standardized. Keys to successful statewide adoption of this reporting method include the fostering of strong partnerships with local hemovigilance champions and experts, engagement of regulatory and epidemiology divisions at the state health department, the leveraging of existing relationships with hospital NHSN administrators, and the existence of a regulatory deadline for implementation. Although limitations exist, successful implementation of statewide use of the NHSN Hemovigilance Module for hospital blood bank reporting is possible. The result is standardized, actionable data at both the hospital and state level that can facilitate interfacility comparisons, benchmarking, and opportunities for practice improvement.

Prospective Validation of Central Line–Days Derived From an Electronic Medical Record System

Validation of the number of central line–days by hospitals is required by the National Healthcare Safety Network. A prospective study that compared a daily report of such days generated by an electronic medical record with observational audits by nurses revealed that the report was 100% sensitive and 99.9% specific.

Infect. Control Hosp. Epidemiol. 2015;36(9):1098–1099

Denominator doesn't matter: standardizing healthcare-associated infection rates by bed days or device days

OBJECTIVE

To examine the impact on infection rates and hospital rank for catheter-associated urinary tract infection (CAUTI), central line-associated bloodstream infection (CLABSI), and ventilator-associated pneumonia (VAP) using device days and bed days as the denominator

DESIGN

Retrospective survey from October 2010 to July 2013 SETTING: Veterans Health Administration medical centers providing acute medical and surgical care

PATIENTS

Patients admitted to 120 Veterans Health Administration medical centers reporting healthcare-associated infections

METHODS

We examined the importance of using device days and bed days as the denominator between infection rates and hospital rank for CAUTI, CLABSI, and VAP for each medical center. The relationship between device days and bed days as the denominator was assessed using a Pearson correlation, and changes in infection rates and device utilization were evaluated by an analysis of variance.

RESULTS

A total of 7.9 million bed days were included. From 2011 to 2013, CAUTI decreased whether measured by device days (2.32 to 1.64, P=.001) or bed days (4.21 to 3.02, P=.006). CLABSI decreased when measured by bed days (1.67 to 1.19, P=.04). VAP rates and device utilization ratios for CAUTI, CLABSI, and VAP were not statistically different across time. Infection rates calculated with device days were strongly correlated with infection rates calculated with bed days (r=0.79-0.94, P<.001). Hospital relative performance measured by ordered rank was also strongly correlated for both denominators (r=0.82-0.96, P<.001).

CONCLUSIONS

These findings suggest that device days and bed days are equally effective adjustment metrics for comparing healthcare-associated infection rates between hospitals in the setting of stable device utilization.

Transfusion-related adverse reactions reported to the National Healthcare Safety Network Hemovigilance Module, United States, 2010 to 2012

BACKGROUND

In 2010, health care facilities in the United States began voluntary enrollment in the National Healthcare Safety Network (NHSN) Hemovigilance Module. Participants report transfusion practices; red blood cell, platelet (PLT), plasma, and cryoprecipitate units transfused; and transfusion-related adverse reactions and process errors to the Centers for Disease Control and Prevention through a secure, Internet-accessible surveillance application available to transfusing facilities.

STUDY DESIGN AND METHODS

Facilities submitting at least 1 month of transfused components data and adverse reactions from January 1, 2010, to December 31, 2012, were included in this analysis. Adverse reaction rates for transfused components, stratified by component type and collection and modification methods, were calculated.

RESULTS

In 2010 to 2012, a total of 77 facilities reported 5136 adverse reactions among 2,144,723 components transfused (239.5/100,000). Allergic (46.8%) and febrile nonhemolytic (36.1%) reactions were most frequent; 7.2% of all reactions were severe or life-threatening and 0.1% were fatal. PLT transfusions (421.7/100,000) had the highest adverse reaction rate.

CONCLUSION

Adverse transfusion reaction rates from the NHSN Hemovigilance Module in the United States are comparable to early hemovigilance reporting from other countries. Although severe reactions are infrequent, the numbers of transfusion reactions in US hospitals suggest that interventions to prevent these reactions are important for patient safety. Further investigation is needed to understand the apparent increased risk of reactions from apheresis-derived blood components. Comprehensive evaluation, including data validation, is important to continued refinement of the module.