Virtual Breakthrough Series, Part 1: Preventing Catheter-Associated Urinary Tract Infection and Hospital-Acquired Pressure Ulcers in the Veterans Health Administration

A Virtual Breakthrough Series Collaborative for Missed Test Results: A Stepped-Wedge Cluster-Randomized Clinical Trial

Importance

Missed test results, defined as test results not followed up within an appropriate time frame, are common and lead to delays in diagnosis and treatment.

Objective

To evaluate the effect of a quality improvement collaborative, the Virtual Breakthrough Series (VBTS), on the follow-up rate of 2 types of test results prone to being missed: chest imaging suspicious for lung cancer and laboratory findings suggestive of colorectal cancer.

Design, Setting, and Participants

This stepped-wedge cluster-randomized clinical trial was conducted between February 2020 and March 2022 at 12 Department of Veterans Affairs (VA) medical centers, with a predefined 3-cohort roll-out. Each cohort was exposed to 3 phases: preintervention, action, and continuous improvement. Follow-up ranged from 0 to 12 months, depending on cohort. Teams at each site were led by a project leader and included diverse interdisciplinary representation, with a mix of clinical and technical experts, senior leaders, nursing champions, and other interdisciplinary team members. Analysis was conducted per protocol, and data were analyzed from April 2022 to March 2024.

Intervention

All teams participated in a VBTS, which included instruction on reducing rates of missed test results at their site.

Main Outcomes and Measures

The primary outcome was changes in the percentage of abnormal test result follow-up, comparing the preintervention phase with the action phase. Secondary outcomes were effects across cohorts and the intervention's effect on sites with the highest and lowest preintervention follow-up rates. Previously validated electronic algorithms measured abnormal imaging and laboratory test result follow-up rates.

Results

A total of 11 teams completed the VBTS and implemented 47 (mean, 4 per team; range, 3-8 per team; mode, 3 per team) unique interventions to improve missed test results. A total of 40 027 colorectal cancer-related tests were performed, with 5130 abnormal results, of which 1286 results were flagged by the electronic trigger (e-trigger) algorithm as being missed. For lung cancer-related studies, 376 765 tests were performed, with 7314 abnormal results and 2436 flagged by the e-trigger as being missed. There was no significant difference in the percentage of abnormal test results followed up by study phase, consistent across all 3 cohorts. The estimated mean difference between the preintervention and action phases was -0.78 (95% CI, -6.88 to 5.31) percentage points for the colorectal e-trigger and 0.36 (95% CI, -5.19 to 5.9) percentage points for the lung e-trigger. However, there was a significant effect of the intervention by site, with the site with the lowest follow-up rate at baseline increasing its follow-up rate from 27.8% in the preintervention phase to 55.6% in the action phase.

Conclusions and Relevance

In this cluster-randomized clinical trial of the VBTS intervention, there was no improvement in the percentage of test results receiving follow-up. However, the VBTS may offer benefits for sites with low baseline performance.

Trial Registration

ClinicalTrials.gov Identifier: NCT04166240.

Why Test Results Are Still Getting "Lost" to Follow-up: a Qualitative Study of Implementation Gaps

BACKGROUND

Lack of timely follow-up of abnormal test results is common and has been implicated in missed or delayed diagnosis, resulting in potential for patient harm.

OBJECTIVE

As part of a larger project to implement change strategies to improve follow-up of diagnostic test results, this study sought to identify specifically where implementation gaps exist, as well as possible solutions identified by front-line staff.

DESIGN

We used a semi-structured interview guide to collect qualitative data from Veterans Affairs (VA) facility staff who had experience with test results management and patient safety.

SETTING

Twelve VA facilities across the USA.

PARTICIPANTS

Facility staff members (n = 27), including clinicians, lab and imaging professionals, nursing staff, patient safety professionals, and leadership.

APPROACH

We conducted a content analysis of interview transcripts to identify perceived barriers and high-risk areas for effective test result management, as well as recommendations for improvement.

RESULTS

We identified seven themes to guide further development of interventions to improve test result follow-up. Themes related to trainees, incidental findings, tracking systems for electronic health record notifications, outdated contact information, referrals, backup or covering providers, and responsibility for test results pending at discharge. Participants provided recommendations for improvement within each theme.

CONCLUSIONS

Perceived barriers and recommendations for improving test result follow-up often reflected previously known problems and their corresponding solutions, which have not been consistently implemented in practice. Better policy solutions and improvement methods, such as quality improvement collaboratives, may bridge the implementation gaps between knowledge and practice.

Implementing Treat to Target (TTT) for Rheumatoid Arthritis (RA) During COVID: Results of a Virtual Learning Collaborative (LC) Program

Objective

A treat‐to‐target (TTT) approach improves outcomes in rheumatoid arthritis (RA). In prior work, we found that a learning collaborative (LC) program improved implementation of TTT. We conducted a shorter virtual LC to assess the feasibility and effectiveness of this model for quality improvement and to assess TTT during virtual visits.

Methods

We tested a 6‐month virtual LC in ambulatory care. The LC was conducted during the 2020–2021 COVID‐19 pandemic when many patient visits were conducted virtually. All LC meetings used videoconferencing and a website to share data. The LC comprised a 6‐hour kickoff session and 6 monthly webinars. The LC discussed TTT in RA, its rationale, and rapid cycle improvement as a method for implementing TTT. Practices provided de‐identified patient visit data. Monthly webinars reinforced topics and demonstrated data on TTT adherence. This was measured as the percentage of TTT processes completed. We compared TTT adherence between in‐person visits versus virtual visits.

Results

Eighteen sites participated in the LC, representing 45 rheumatology clinicians. Sites inputted data on 1,826 patient visits, 78% of which were conducted in‐person and 22% of which were held in a virtual setting. Adherence with TTT improved from a mean of 51% at baseline to 84% at month 6 (P for trend < 0.001). Each aspect of TTT also improved. Adherence with TTT during virtual visits was lower (65%) than during in‐person visits (79%) (P < 0.0001).

Conclusion

Implementation of TTT for RA can be improved through a relatively low‐cost virtual LC. This improvement in TTT implementation was observed despite the COVID‐19 pandemic, but we did observe differences in TTT adherence between in‐person visits and virtual visits.

Temporal Trends and Hospital Variation in Time-to-Antibiotics Among Veterans Hospitalized With Sepsis

Importance

It is unclear whether antimicrobial timing for sepsis has changed outside of performance incentive initiatives.

Objective

To examine temporal trends and variation in time-to-antibiotics for sepsis in the US Department of Veterans Affairs (VA) health care system.

Design, Setting, and Participants

This observational cohort study included 130 VA hospitals from 2013 to 2018. Participants included all patients admitted to the hospital via the emergency department with sepsis from 2013 to 2018, using a definition adapted from the Centers for Disease Control and Prevention Adult Sepsis Event definition, which requires evidence of suspected infection, acute organ dysfunction, and systemic antimicrobial therapy within 12 hours of presentation. Data were analyzed from October 6, 2020, to July 1, 2021.

Exposures

Time from presentation to antibiotic administration.

Main Outcomes and Measures

The main outcome was differences in time-to-antibiotics across study periods, hospitals, and patient subgroups defined by presenting temperature and blood pressure. Temporal trends in time-to-antibiotics were measured overall and by subgroups. Hospital-level variation in time-to-antibiotics was quantified after adjusting for differences in patient characteristics using multilevel linear regression models.

Results

A total of 111 385 hospitalizations for sepsis were identified, including 107 547 men (96.6%) men and 3838 women (3.4%) with a median (interquartile range [IQR]) age of 68 (62-77) years. A total of 7574 patients (6.8%) died in the hospital, and 13 855 patients (12.4%) died within 30 days. Median (IQR) time-to-antibiotics was 3.9 (2.4-6.5) hours but differed by presenting characteristics. Unadjusted median (IQR) time-to-antibiotics decreased over time, from 4.5 (2.7-7.1) hours during 2013 to 2014 to 3.5 (2.2-5.9) hours during 2017 to 2018 (P < .001). In multilevel models adjusted for patient characteristics, median time-to-antibiotics declined by 9.0 (95% CI, 8.8-9.2) minutes per calendar year. Temporal trends in time-to-antibiotics were similar across patient subgroups, but hospitals with faster baseline time-to-antibiotics had less change over time, with hospitals in the slowest tertile decreasing time-to-antibiotics by 16.6 minutes (23.1%) per year, while hospitals in the fastest tertile decreased time-to-antibiotics by 7.2 minutes (13.1%) per year. In the most recent years (2017-2018), median time-to-antibiotics ranged from 3.1 to 6.7 hours across hospitals (after adjustment for patient characteristics), 6.8% of variation in time-to-antibiotics was explained at the hospital level, and odds of receiving antibiotics within 3 hours increased by 65% (95% CI, 56%-77%) for the median patient if moving to a hospital with faster time-to-antibiotics.

Conclusions and Relevance

This cohort study across nationwide VA hospitals found that time-to-antibiotics for sepsis has declined over time. However, there remains significant variability in time-to-antibiotics not explained by patient characteristics, suggesting potential unwarranted practice variation in sepsis treatment. Efforts to further accelerate time-to-antibiotics must be weighed against risks of overtreatment.

A cluster randomized controlled trial comparing Virtual Learning Collaborative and Technical Assistance strategies to implement an early palliative care program for patients with advanced cancer and their caregivers: a study protocol

BACKGROUND

Virtual Learning Collaboratives (VLC), learning communities focused on a common purpose, are used frequently in healthcare settings to implement best practices. Yet, there is limited research testing the effectiveness of this approach compared to other implementation strategies. This study evaluates the effectiveness of a VLC compared to Technical Assistance (TA) among community oncology practices implementing ENABLE (Educate, Nurture, Advise, Before Life Ends), an evidence-based, early palliative care telehealth, psycho-educational intervention for patients with newly diagnosed advanced cancer and their caregivers.

METHODS

Using Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) and Proctor's Implementation Outcomes Frameworks, this two-arm hybrid type-III cluster-randomized controlled trial (RCT) will compare two implementation strategies, VLC versus TA, among the 48 National Cancer Institute Community Oncology Research Program (NCORP) practice clusters that have not historically provided palliative care to all patients with advanced cancer. Three cohorts of practice clusters will be randomized to the study arms. Each practice cluster will recruit 15-27 patients and a family caregiver to participate in ENABLE. The primary study outcome is ENABLE uptake (patient level), i.e., the proportion of eligible patients who complete the ENABLE program (receive a palliative care assessment and complete the six ENABLE sessions over 12 weeks). The secondary outcome is overall program implementation (practice cluster level), as measured by the General Organizational Index at baseline, 6, and 12 months. Exploratory aims assess patient and caregiver mood and quality of life outcomes at baseline, 12, and 24 weeks. Practice cluster randomization will seek to keep the proportion of rural practices, practice sizes, and minority patients seen within each practice balanced across the two study arms.

DISCUSSION

This study will advance the field of implementation science by evaluating VLC effectiveness, a commonly used but understudied, implementation strategy. The study will advance the field of palliative care by building the capacity and infrastructure to implement an early palliative care program in community oncology practices.

TRIAL REGISTRATION

Clinicaltrials.gov . NCT04062552; Pre-results. Registered: August 20, 2019. https://clinicaltrials.gov/ct2/show/NCT04062552?term=NCT04062552&draw=2&rank=1.

The LEAP Program: Quality Improvement Training to Address Team Readiness Gaps Identified by Implementation Science Findings

BACKGROUND

Integrating evidence-based innovations (EBIs) into sustained use is challenging; most implementations in health systems fail. Increasing frontline teams' quality improvement (QI) capability may increase the implementation readiness and success of EBI implementation.

OBJECTIVES

Develop a QI training program ("Learn. Engage. Act. Process." (LEAP)) and evaluate its impact on frontline obesity treatment teams to improve treatment delivered within the Veterans Health Administration (VHA).

DESIGN

This was a pre-post evaluation of the LEAP program. MOVE! coordinators (N = 68) were invited to participate in LEAP; 24 were randomly assigned to four starting times. MOVE! coordinators formed teams to work on improvement aims. Pre-post surveys assessed team organizational readiness for implementing change and self-rated QI skills. Program satisfaction, assignment completion, and aim achievement were also evaluated.

PARTICIPANTS

VHA facility-based MOVE! teams.

INTERVENTIONS

LEAP is a 21-week QI training program. Core components include audit and feedback reports, structured curriculum, coaching and learning community, and online platform.

MAIN MEASURES

Organizational readiness for implementing change (ORIC); self-rated QI skills before and after LEAP; assignment completion and aim achievement; program satisfaction.

KEY RESULTS

Seventeen of 24 randomized teams participated in LEAP. Participants' self-ratings across six categories of QI skills increased after completing LEAP (p< 0.0001). The ORIC measure showed no statistically significant change overall; the change efficacy subscale marginally improved (p < 0.08), and the change commitment subscale remained the same (p = 0.66). Depending on the assignment, 35 to 100% of teams completed the assignment. Nine teams achieved their aim. Most team members were satisfied or very satisfied (81-89%) with the LEAP components, 74% intended to continue using QI methods, and 81% planned to continue improvement work.

CONCLUSIONS

LEAP is scalable and does not require travel or time away from clinical responsibilities. While QI skills improved among participating teams and most completed the work, they struggled to do so amid competing clinical priorities.

Improving patient satisfaction: the virtual breakthrough series collaborative

PURPOSE

The purpose of this paper is to improve the Siloam Hospitals' (SHs) patient satisfaction index (PSI) and overcome Indonesia's geographical barriers.

DESIGN/METHODOLOGY/APPROACH

The topic was selected for reasons guided by the Institute of Healthcare Improvement virtual breakthrough series collaborative (VBSC). Subject matter experts came from existing global quality development in collaboration with sales and marketing, and talent management agencies/departments. Patient satisfaction (PS) was measured using the SH Customer Feedback Form. Data were analysed using Friedman's test.

FINDINGS

The in-patient (IP) department PSI repeated measures comparison during VBSC, performed using Friedman's test, showed a statistically significant increase in the PSI, χ² = 44.00, p<0.001. Post hoc analysis with Wilcoxon signed-rank test was conducted with a Bonferroni correction applied, which resulted in a significant increase between the baseline and action phases ( Z=3.317, p=0.003) between the baseline and continuous improvement phases ( Z=6.633, p<0.001), and between the action and continuous improvement phases ( Z=3.317, p=0.003), suggesting that IP PSI was continuously increasing during all VBSC phases. Like IP PSI, the out-patient department PSI was also continuously increasing during all VBSC phases.

RESEARCH LIMITATIONS/IMPLICATIONS

The VBSC was not implemented using a control group. Factors other than the VBSC may have contributed to increased PS.

PRACTICAL IMPLICATIONS

The VBSC was conducted using virtual telecommunication. Although conventional breakthrough series might result in better cohesiveness and commitment, Indonesian geographical barriers forced an alternative strategy, which is much more cost-effective.

ORIGINALITY/VALUE

The VBSC, designed to improve PS, has never been implemented in any Indonesian private hospital group. Other hospital groups might also appreciate knowing about the VBSC to improve their PSI.

Effectiveness of a bundled approach to reduce urinary catheters and infection rates in trauma patients

BACKGROUND

Catheter-associated urinary tract infections (CAUTIs) are common nosocomial infections. In 2015, the Centers for Medicare and Medicaid Services began imposing financial penalties for institutions where CAUTI rates are higher than predicted. However, the surveillance definition for CAUTI is not a clinical diagnosis and may represent asymptomatic bacteriuria. The objective of this study was to compare rates of urinary catheterization and CAUTI before and after the implementation of a bundled intervention.

METHODS

This retrospective review evaluated trauma patients from January 2013-January 2015. The bundled intervention optimized the urinary catheterization process and culturing practices to reduce false positives. The CAUTI rate was defined as a positive surveillance CAUTI divided by total catheter days multiplied by 1,000 days.

RESULTS

A total of 6,236 patients were included (pre: n = 5,003; post: n = 1,233). Fewer patients in the post bundle group received a urinary catheter (pre: 25% vs post: 16%; P < .001). After bundle implementation, the CAUTI rate reduced over one third (pre: 4.07 vs post: 2.56; incidence rate ratio, 0.63; 95% confidence interval, 0.19-2.07).

CONCLUSIONS

Although the number of patients exposed to urinary catheters and catheter days was decreased, optimization of culturing practices was essential to prevent the CAUTI rate from increasing from a reduced denominator. Implementation of a CAUTI prevention bundle works synergistically to improve patient safety and hospital performance.

Assessing a National Collaborative Program To Prevent Catheter-Associated Urinary Tract Infection in a Veterans Health Administration Nursing Home Cohort

OBJECTIVECollaborative programs have helped reduce catheter-associated urinary tract infection (CAUTI) rates in community-based nursing homes. We assessed whether collaborative participation produced similar benefits among Veterans Health Administration (VHA) nursing homes, which are part of an integrated system.SETTINGThis study included 63 VHA nursing homes enrolled in the "AHRQ Safety Program for Long-Term Care," which focused on practices to reduce CAUTI.METHODSChanges in CAUTI rates, catheter utilization, and urine culture orders were assessed from June 2015 through May 2016. Multilevel mixed-effects negative binomial regression was used to derive incidence rate ratios (IRRs) representing changes over the 12-month program period.RESULTSThere was no significant change in CAUTI among VHA sites, with a CAUTI rate of 2.26 per 1,000 catheter days at month 1 and a rate of 3.19 at month 12 (incidence rate ratio [IRR], 0.99; 95% confidence interval [CI], 0.67-1.44). Results were similar for catheter utilization rates, which were 11.02% at month 1 and 11.30% at month 12 (IRR, 1.02; 95% CI, 0.95-1.09). The numbers of urine cultures per 1,000 residents were 5.27 in month 1 and 5.31 in month 12 (IRR, 0.93; 95% CI, 0.82-1.05).CONCLUSIONSNo changes in CAUTI rates, catheter use, or urine culture orders were found during the program period. One potential reason was the relatively low baseline CAUTI rate, as compared with a cohort of community-based nursing homes. This low baseline rate is likely related to the VHA's prior CAUTI prevention efforts. While broad-scale collaborative approaches may be effective in some settings, targeting higher-prevalence safety issues may be warranted at sites already engaged in extensive infection prevention efforts.Infect Control Hosp Epidemiol 2018;820-825.