An automated algorithm to preselect patients to be assessed individually in point prevalence surveys for hospital-acquired infections in surgery

Risk factors for surgical site infections using a data-driven approach

Objective

The objective of this study was to identify risk factors for surgical site infection from digestive, thoracic and orthopaedic system surgeries using clinical and data-driven cut-off values. A second objective was to compare the identified risk factors in this study to risk factors identified in literature.

Summary background data

Retrospective data of 3 250 surgical procedures performed in large tertiary care hospital in The Netherlands during January 2013 to June 2014 were used.

Methods

Potential risk factors were identified using a literature scan and univariate analysis. A multivariate forward-step logistic regression model was used to identify risk factors. Standard medical cut-off values were compared with cut-offs determined from the data.

Results

For digestive, orthopaedic and thoracic system surgical procedures, the risk factors identified were preoperative temperature of ≥38°C and antibiotics used at the time of surgery. C-reactive protein and the duration of the surgery were identified as a risk factors for digestive surgical procedures. Being an adult (age ≥18) was identified as a protective effect for thoracic surgical procedures. Data-driven cut-off values were identified for temperature, age and CRP which can explain the SSI outcome up to 19.5% better than generic cut-off values.

Conclusions

This study identified risk factors for digestive, orthopaedic and thoracic system surgical procedures and illustrated how data-driven cut-offs can add value in the process. Future studies should investigate if data-driven cut-offs can add value to explain the outcome being modelled and not solely rely on standard medical cut-off values to identify risk factors.

Electronically assisted surveillance systems of healthcare-associated infections: a systematic review

Background

Surveillance of healthcare-associated infections (HAI) is the basis of each infection control programme and, in case of acute care hospitals, should ideally include all hospital wards, medical specialties as well as all types of HAI. Traditional surveillance is labour intensive and electronically assisted surveillance systems (EASS) hold the promise to increase efficiency.

Objectives

To give insight in the performance characteristics of different approaches to EASS and the quality of the studies designed to evaluate them.

Methods

In this systematic review, online databases were searched and studies that compared an EASS with a traditional surveillance method were included. Two different indicators were extracted from each study, one regarding the quality of design (including reporting efficiency) and one based on the performance (e.g. specificity and sensitivity) of the EASS presented.

Results

A total of 78 studies were included. The majority of EASS (n = 72) consisted of an algorithm-based selection step followed by confirmatory assessment. The algorithms used different sets of variables. Only a minority (n = 7) of EASS were hospital-wide and designed to detect all types of HAI. Sensitivity of EASS was generally high (> 0.8), but specificity varied (0.37–1). Less than 20% (n = 14) of the studies presented data on the efficiency gains achieved.

Conclusions

Electronically assisted surveillance of HAI has yet to reach a mature stage and to be used routinely in healthcare settings. We recommend that future studies on the development and implementation of EASS of HAI focus on thorough validation, reproducibility, standardised datasets and detailed information on efficiency.

Validation of a semi-automated surveillance system for surgical site infections: Improving exhaustiveness, representativeness, and efficiency

OBJECTIVES

To assess whether electronic records data could improve the efficiency, exhaustiveness, and representativeness of SSI surveillance by selecting a group of high-risk patients for manual review.

METHODS

Colorectal surgeries (2016-2018) and cholecystectomies (2017-2018) were selected. Post-surgical antibiotic use, positive culture, C-reactive protein (CRP) values, body temperature, leukocyte count, surgical re-intervention, admission to the emergency room, and hospital readmission were retrieved. For representativeness, procedures registered in HAI-Net were compared with non-included procedures, and the validity of each variable (or combination) was tested considering the presence of SSI as the gold standard. The proportion of procedures flagged for manual review by each criterion was estimated.

RESULTS

Little more than 50% of procedures were included in HAI-Net (SSI risk: 10.6% for colorectal and 2.9% for cholecystectomies). Non-included procedures showed higher proportions of infection markers. Antibiotic use and CRP >100 mg/dl presented the highest sensitivity for both surgical groups, while antibiotic use achieved the highest positive predictive value in both groups (22% and 21%, respectively) and flagged fewer colorectal procedures (47.7%).

CONCLUSIONS

Current SSI surveillance has major limitations. Thus, the reported incidence seems unreliable and underestimated. Antibiotic use appears to be the best criterion to select a sub-sample of procedures for manual review, improving the exhaustiveness and efficiency of the system.

Computer-assisted, high-frequency, hospital-wide point prevalence surveys of hospital-acquired infections in a tertiary care hospital, the Netherlands, 2013 to 2014

Background

Surveillance of hospital-acquired infections (HAI) often relies on point prevalence surveys (PPS) to detect major deviations in the occurrence of HAI, supplemented with incidence measurements when more detailed information is needed. In a 1,320-bed university medical centre in the Netherlands, we evaluated an electronically assisted surveillance system based on frequently performed computer-assisted PPS (CAPPS).

Aim

The primary goals were to evaluate the performance of this method to detect trends and to determine how adjustments in the frequency with which the CAPPS are performed would affect this performance. A secondary goal was to evaluate the performance of the algorithm (nosocomial infection index (Nii)) used.

Methods

We analysed the data of 77 hospital-wide PPS, performed over a 2-year period (2013 and 2014) and including 25,056 patients.

Results

Six trends with statistical significance were detected. The probability to detect such trends rapidly decreased when PPS are performed at a lower frequency. The Nii and its dynamics strongly correlated with the presence of HAI.

Conclusion

Performing computer-assisted, high frequency hospital-wide PPS, is a feasible method that will detect even subtle changes in HAI prevalence over time.

Technology to Support Integrated Antimicrobial Stewardship Programs: A User Centered and Stakeholder Driven Development Approach

The rise of antimicrobial resistance (AMR) is a severe global health problem. Tackling this problem requires the prudent prescribing of antimicrobials. This is promoted through Antimicrobial Stewardship Programs (ASPs). In this position paper we describe i) how a socio-technical multidisciplinary approach (based on the CeHRes Roadmap) can be applied in the development and implementation of Antimicrobial Stewardship technologies and ii) how this approach can be of value to support Antimicrobial Stewardship in practice. The CeHRes Roadmap entails five different phases to explore and test how an eHealth technology can be tailored to the target group and successfully implemented in practice: i) contextual inquiry, ii) value specification, iii) design, iv) operationalization, v) evaluation. In this position paper we describe the lessons learned from research and practice to guide future developments of technology based ASP interventions. Since AMR is a huge wicked problem on a global level, it requires innovative methods and models to empower general public and professionals to be proactive rather than reactive in a digitalized world. We highlight how to combat the dangerous rise of antimicrobial resistance in the future.

Internal and External Validation of a Computer-Assisted Surveillance System for Hospital-Acquired Infections in a 754-Bed General Hospital in the Netherlands

OBJECTIVE To evaluate a computer-assisted point-prevalence survey (CAPPS) for hospital-acquired infections (HAIs). DESIGN Validation cohort. SETTING A 754-bed teaching hospital in the Netherlands. METHODS For the internal validation of a CAPPS for HAIs, 2,526 patients were included. All patient records were retrospectively reviewed in depth by 2 infection control practitioners (ICPs) to determine which patients had suffered an HAI. Preventie van Ziekenhuisinfecties door Surveillance (PREZIES) criteria were used. Following this internal validation, 13 consecutive CAPPS were performed in a prospective study from January to March 2013 to determine weekly, monthly, and quarterly HAI point prevalence. Finally, a CAPPS was externally validated by PREZIES (Rijksinstituut voor Volksgezondheid en Milieu [RIVM], Bilthoven, Netherlands). In all evaluations, discrepancies were resolved by consensus. RESULTS In our series of CAPPS, 83% of the patients were automatically excluded from detailed review by the ICP. The sensitivity of the method was 91%. The time spent per hospital-wide CAPPS was ~3 hours. External validation showed a negative predictive value of 99.1% for CAPPS. CONCLUSIONS CAPPS proved to be a sensitive, accurate, and efficient method to determine serial weekly point-prevalence HAI rates in our hospital. Infect Control Hosp Epidemiol 2016;1-6.

Incidence rates of hospital-acquired urinary tract and bloodstream infections generated by automated compilation of electronically available healthcare data

BACKGROUND

Monitoring of hospital-acquired infection (HAI) by automated compilation of registry data may address the disadvantages of laborious, costly and potentially subjective and often random sampling of data by manual surveillance.

AIM

To evaluate a system for automated monitoring of hospital-acquired urinary tract (HA-UTI) and bloodstream infections (HA-BSI) and to report incidence rates over a five-year period in a Danish hospital trust.

METHODS

Based primarily on electronically available data relating to microbiology results and antibiotic prescriptions, the automated monitoring of HA-UTIs and HA-BSIs was validated against data from six previous point-prevalence surveys (PPS) from 2010 to 2013 and data from a manual assessment (HA-UTI only) of one department of internal medicine from January 2010. Incidence rates (infections per 1000 bed-days) from 2010 to 2014 were calculated.

FINDINGS

Compared with the PPSs, the automated monitoring showed a sensitivity of 88% in detecting UTI in general, 78% in detecting HA-UTI, and 100% in detecting BSI in general. The monthly incidence rates varied between 4.14 and 6.61 per 1000 bed-days for HA-UTI and between 0.09 and 1.25 per 1000 bed-days for HA-BSI.

CONCLUSION

Replacing PPSs with automated monitoring of HAIs may provide better and more objective data and constitute a promising foundation for individual patient risk analyses and epidemiological studies. Automated monitoring may be universally applicable in hospitals with electronic databases comprising microbiological findings, admission data, and antibiotic prescriptions.

Point prevalence of appropriate antimicrobial therapy in a Dutch university hospital

Antimicrobial stewardship teams have been shown to increase appropriate empirical antibiotic therapy and reduce medical errors and costs in targeted populations, but the effect in non-targeted populations is still unclear. The aim of this study was to determine the prevalence of inappropriate antibiotic use in a large university hospital and identify areas in which antimicrobial stewardship will be the most effective. In a point prevalence survey we assessed the appropriateness of antibiotic therapy using an electronic surveillance system in combination with a standardized method for duration of therapy, dosage, dosage interval, route of administration, and choice of antibiotic drug. Patients using at least one antibiotic drug were included. Among 996 patients admitted in the surveyed wards, 337 patients (33.8 %) used one or more antibiotic drugs. Two hundred and twenty-one patients (22.2 %) used antibiotic medication therapeutically, with a total of 307 antibiotic prescriptions. Antibiotic therapy was deemed inappropriate in 90 (29.3 %) of these prescribed antibiotics, with an unjustified prescription as the most common reason for an inappropriate prescription. Use of fluoroquinolones and amoxicillin/clavulanic acid and a presumed diagnosis of fever of unknown origin, urinary tract infection, and respiratory tract infection were associated with inappropriate antibiotic therapy. Our study provides insight into the (in)appropriateness of antibiotic prescriptions in a tertiary care center in the Netherlands and identifies areas for improvement. The use of an electronic surveillance system for this point prevalence study is easy and may serve as a baseline measurement for the future effect of antibiotic stewardship.

Evaluation of an algorithm for electronic surveillance of hospital-acquired infections yielding serial weekly point prevalence scores

Surveillance of hospital-acquired infections can be approximated by repeated surveys that are performed in a standardized, cost-effective manner. We developed an integrated software system for serial electronic hospital-wide point prevalence surveys using algorithms that proved highly sensitive and specific over a 5-year period in a large university medical center.