Audit and feedback: effects on professional practice and healthcare outcomes

Deploying an asthma dashboard to support quality improvement across a nationally representative sentinel network of 7.6 million people in England

Every year, there are ~100,000 hospital admissions for asthma in the UK, many of which are potentially preventable. Evidence suggests that carefully conceptualised and implemented audit and feedback (A&F) cycles have the potential to improve clinical outcomes for those with chronic conditions. We wanted to investigate the technical feasibility of developing a near-real time asthma dashboard to support A&F interventions for asthma management in primary care. We extracted cross-sectional data on asthma from 756 participating GP practices in the Oxford-Royal College of General Practitioners Research and Surveillance Centre (RCGP RSC) database in England comprising 7.6 million registered people. Summary indicators for a GP practice were compared to all participating RCGP RSC practices using practice-level data, for the week 6-12th-Mar-2023. A weekly, automated asthma dashboard with features that can support electronic-A&F cycles that compared key asthma indicators for a GP practice to RCGP RSC could be created ( https://tinyurl.com/3ydtrt85 ): 12-weeks-incidence 0.4% vs 0.4%, annual prevalence 6.1% vs 6.7%, inhaled relievers to preventer 1.2 vs 1.1, self-management plan given 83.4% vs 60.8%, annual reviews 36.8% vs 57.3%, prednisolone prescriptions 2.0% vs 3.2%, influenza vaccination 56.6% vs 55.5%, pneumococcal vaccination ever (aged ≥65 years) 90.2% vs 84.1% and current smokers 14.9% vs 14.8%. Across the RCGP RSC, the rate of hospitalisations was 0.024%; comparative data had to be suppressed for the study practice because of small numbers. We have successfully created an automated near real-time asthma dashboard that can be used to support A&F initiatives to improve asthma care and outcomes in primary care.

Tailored vs. General COVID-19 prevention for adults with mental disabilities residing in group homes: a randomized controlled effectiveness-implementation trial

BACKGROUND

People with serious mental illness (SMI) and people with intellectual disabilities/developmental disabilities (ID/DD) are at higher risk for COVID-19 and more severe outcomes. We compare a tailored versus general best practice COVID-19 prevention program in group homes (GHs) for people with SMI or ID/DD in Massachusetts (MA).

METHODS

A hybrid effectiveness-implementation cluster randomized control trial compared a four-component implementation strategy (Tailored Best Practices: TBP) to dissemination of standard prevention guidelines (General Best-Practices: GBP) in GHs across six MA behavioral health agencies. GBP consisted of standard best practices for preventing COVID-19. TBP included GBP plus four components including: (1) trusted-messenger peer testimonials on benefits of vaccination; (2) motivational interviewing; (3) interactive education on preventive practices; and (4) fidelity feedback dashboards for GHs. Primary implementation outcomes were full COVID-19 vaccination rates (baseline: 1/1/2021-3/31/2021) and fidelity scores (baseline: 5/1/21-7/30/21), at 3-month intervals to 15-month follow-up until October 2022. The primary effectiveness outcome was COVID-19 infection (baseline: 1/1/2021-3/31/2021), measured every 3 months to 15-month follow-up. Cumulative incidence of vaccinations were estimated using Kaplan-Meier curves. Cox frailty models evaluate differences in vaccination uptake and secondary outcomes. Linear mixed models (LMMs) and Poisson generalized linear mixed models (GLMMs) were used to evaluate differences in fidelity scores and incidence of COVID-19 infections.

RESULTS

GHs (n=415) were randomized to TBP (n=208) and GBP (n=207) including 3,836 residents (1,041 ID/DD; 2,795 SMI) and 5,538 staff. No differences were found in fidelity scores or COVID-19 incidence rates between TBP and GBP, however TBP had greater acceptability, appropriateness, and feasibility. No overall differences in vaccination rates were found between TBP and GBP. However, among unvaccinated group home residents with mental disabilities, non-White residents achieved full vaccination status at double the rate for TBP (28.6%) compared to GBP (14.4%) at 15 months. Additionally, the impact of TBP on vaccine uptake was over two-times greater for non-White residents compared to non-Hispanic White residents (ratio of HR for TBP between non-White and non-Hispanic White: 2.28, p = 0.03).

CONCLUSION

Tailored COVID-19 prevention strategies are beneficial as a feasible and acceptable implementation strategy with the potential to reduce disparities in vaccine acceptance among the subgroup of non-White individuals with mental disabilities.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04726371, 27/01/2021. https://clinicaltrials.gov/study/NCT04726371 .

Optimising a clinical decision support tool to improve chronic kidney disease management in general practice

BACKGROUND

Early identification and treatment of chronic disease is associated with better clinical outcomes, lower costs, and reduced hospitalisation. Primary care is ideally placed to identify patients at risk of, or in the early stages of, chronic disease and to implement prevention and early intervention measures. This paper evaluates the implementation of a technological intervention called Future Health Today that integrates with general practice EMRs to (1) identify patients at-risk of, or with undiagnosed or untreated, chronic kidney disease (CKD), and (2) provide guideline concordant recommendations for patient care. The evaluation aimed to identify the barriers and facilitators to successful implementation.

METHODS

Future Health Today was implemented in 12 general practices in Victoria, Australia. Fifty-two interviews with 30 practice staff were undertaken between July 2020 and April 2021. Practice characteristics were collected directly from practices via survey. Data were analysed using inductive and deductive qualitative analysis strategies, using Clinical Performance - Feedback Intervention Theory (CP-FIT) for theoretical guidance.

RESULTS

Future Health Today was acceptable, user friendly and useful to general practice staff, and supported clinical performance improvement in the identification and management of chronic kidney disease. CP-FIT variables supporting use of FHT included the simplicity of design and delivery of actionable feedback via FHT, good fit within existing workflow, strong engagement with practices and positive attitudes toward FHT. Context variables provided the main barriers to use and were largely situated in the external context of practices (including pressures arising from the COVID-19 pandemic) and technical glitches impacting installation and early use. Participants primarily utilised the point of care prompt rather than the patient management dashboard due to its continued presence, and immediacy and relevance of the recommendations on the prompt, suggesting mechanisms of compatibility, complexity, actionability and credibility influenced use. Most practices continued using FHT after the evaluation phase was complete.

CONCLUSIONS

This study demonstrates that FHT is a useful and acceptable software platform that provides direct support to general practice in identifying and managing patients with CKD. Further research is underway to explore the effectiveness of FHT, and to expand the conditions on the platform.

Exploring Anesthesia Provider Preferences for Precision Feedback: Preference Elicitation Study

Background

Health care professionals must learn continuously as a core part of their work. As the rate of knowledge production in biomedicine increases, better support for health care professionals' continuous learning is needed. In health systems, feedback is pervasive and is widely considered to be essential for learning that drives improvement. Clinical quality dashboards are one widely deployed approach to delivering feedback, but engagement with these systems is commonly low, reflecting a limited understanding of how to improve the effectiveness of feedback about health care. When coaches and facilitators deliver feedback for improving performance, they aim to be responsive to the recipient's motivations, information needs, and preferences. However, such functionality is largely missing from dashboards and feedback reports. Precision feedback is the delivery of high-value, motivating performance information that is prioritized based on its motivational potential for a specific recipient, including their needs and preferences. Anesthesia care offers a clinical domain with high-quality performance data and an abundance of evidence-based quality metrics.

Objective

The objective of this study is to explore anesthesia provider preferences for precision feedback.

Methods

We developed a test set of precision feedback messages with balanced characteristics across 4 performance scenarios. We created an experimental design to expose participants to contrasting message versions. We recruited anesthesia providers and elicited their preferences through analysis of the content of preferred messages. Participants additionally rated their perceived benefit of preferred messages to clinical practice on a 5-point Likert scale.

Results

We elicited preferences and feedback message benefit ratings from 35 participants. Preferences were diverse across participants but largely consistent within participants. Participants' preferences were consistent for message temporality (α=.85) and display format (α=.80). Ratings of participants' perceived benefit to clinical practice of preferred messages were high (mean rating 4.27, SD 0.77).

Conclusions

Health care professionals exhibited diverse yet internally consistent preferences for precision feedback across a set of performance scenarios, while also giving messages high ratings of perceived benefit. A "one-size-fits-most approach" to performance feedback delivery would not appear to satisfy these preferences. Precision feedback systems may hold potential to improve support for health care professionals' continuous learning by accommodating feedback preferences.

Gastroenterologist and surgeon perceptions of recommendations for optimal endoscopic localization of colorectal neoplasms

National consensus recommendations have recently been developed to standardize colorectal tumour localization and documentation during colonoscopy. In this qualitative semi-structured interview study, we identified and contrast the perceived barriers and facilitators to using these new recommendations according to gastroenterologists and surgeons in a large central Canadian city. Interviews were analyzed according to the Consolidated Framework for Implementation Research (CFIR) through directed content analysis. Solutions were categorized using the Expert Recommendations for Implementing Change (ERIC) framework. Eleven gastroenterologists and ten surgeons participated. Both specialty groups felt that the new recommendations were clearly written, adequately addressed current care practice tensions, and offered a relative advantage versus existing practices. The new recommendations appeared appropriately complex, applicable to most participants, and could be trialed and adapted prior to full implementation. Major barriers included a lack of relevant external or internal organizational incentives, non-existing formal feedback processes, and a lack of individual familiarity with the evidence behind some recommendations. With application of the ERIC framework, common barriers could be addressed through accessing new funding, altering incentive structures, changing record systems, educational interventions, identifying champions, promoting adaptability, and employing audit/feedback processes. Future research is needed to test strategies for feasibility and effectiveness.

Mailed feedback to primary care physicians on antibiotic prescribing for patients aged 65 years and older: pragmatic, factorial randomised controlled trial

OBJECTIVES

To evaluate whether providing family physicians with feedback on their antibiotic prescribing compared with that of their peers reduces antibiotic prescriptions. To also identify effects on antibiotic prescribing from case-mix adjusted feedback reports and messages emphasising antibiotic associated harms.

DESIGN

Pragmatic, factorial randomised controlled trial.

SETTING

Primary care physicians in Ontario, Canada PARTICIPANTS: All primary care physicians were randomly assigned a group if they were eligible and actively prescribing antibiotics to patients 65 years or older. Physicians were excluded if had already volunteered to receive antibiotic prescribing feedback from another agency, or had opted out of the trial.

INTERVENTION

A letter was mailed in January 2022 to physicians with peer comparison antibiotic prescribing feedback compared with the control group who did not receive a letter (4:1 allocation). The intervention group was further randomised in a 2x2 factorial trial to evaluate case-mix adjusted versus unadjusted comparators, and emphasis, or not, on harms of antibiotics.

MAIN OUTCOME MEASURES

Antibiotic prescribing rate per 1000 patient visits for patients 65 years or older six months after intervention. Analysis was in the modified intention-to-treat population using Poisson regression.

RESULTS

5046 physicians were included and analysed: 1005 in control group and 4041 in intervention group (1016 case-mix adjusted data and harms messaging, 1006 with case-mix adjusted data and no harms messaging, 1006 unadjusted data and harms messaging, and 1013 unadjusted data and no harms messaging). At six months, mean antibiotic prescribing rate was 59.4 (standard deviation 42.0) in the control group and 56.0 (39.2) in the intervention group (relative rate 0.95 (95% confidence interval 0.94 to 0.96). Unnecessary antibiotic prescribing (0.89 (0.86 to 0.92)), prolonged duration prescriptions defined as more than seven days (0.85 (0.83 to 0.87)), and broad spectrum prescribing (0.94 (0.92 to 0.95)) were also significantly lower in the intervention group compared with the control group. Results were consistent at 12 months post intervention. No significant effect was seen for including emphasis on harms messaging. A small increase in antibiotic prescribing with case-mix adjusted reports was noted (1.01 (1.00 to 1.03)).

CONCLUSIONS

Peer comparison audit and feedback letters significantly reduced overall antibiotic prescribing with no benefit of case-mix adjustment or harms messaging. Antibiotic prescribing audit and feedback is a scalable and effective intervention and should be a routine quality improvement initiative in primary care.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04594200.

Introducing Virtual Reality in a STEMI Coronary Syndrome Course: Qualitative Evaluation with Nurses and Doctors

In the increasing number of medical education topics taught with virtual reality (VR), the prehospital management of ST-segment elevation myocardial infarction (STEMI) had not been considered. This article proposes an implemented VR system for STEMI training and introduces it in an institutional course addressed to emergency nurses and case manager (CM) doctors. The system comprises three different applications to, respectively, allow (a) the course instructor to control the conditions of the virtual patient, (b) the CM to communicate with the nurse in the virtual field and receive from him/her the patient's parameters and electrocardiogram, and (c) the nurse to interact with the patient in the immersive VR scenario. We enrolled 17 course participants to collect their perceptions and opinions through a semistructured interview. The thematic analysis showed the system was appreciated (n = 17) and described as engaging (n = 4), challenging (n = 5), useful to improve self-confidence (n = 4), innovative (n = 5), and promising for training courses (n = 10). Realism was also appreciated (n = 13), although with some drawbacks (e.g., oversimplification; n = 5). Overall, participants described the course as an opportunity to share opinions (n = 8) and highlight issues (n = 4) and found it useful for novices (n = 5) and, as a refresh, for experienced personnel (n = 6). Some participants suggested improvements in the scenarios' type (n = 5) and variability (n = 5). Although most participants did not report usage difficulties with the VR system (n = 13), many described the need to get familiar with it (n = 13) and the specific gestures it requires (n = 10). Three suffered from cybersickness.

Does higher performance in a national licensing examination predict better quality of care? A longitudinal observational study of Ethiopian anesthetists

BACKGROUND

Ethiopia made a national licensing examination (NLE) for associate clinician anesthetists a requirement for entry into the practice workforce. However, there is limited empirical evidence on whether the NLE scores of associate clinicians predict the quality of health care they provide in low-income countries. This study aimed to assess the association between anesthetists' NLE scores and three selected quality of patient care indicators.

METHODS

A multicenter longitudinal observational study was conducted between January 8 and February 7, 2023, to collect quality of care (QoC) data on surgical patients attended by anesthetists (n = 56) who had taken the Ethiopian anesthetist NLE since 2019. The three QoC indicators were standards for safe anesthesia practice, critical incidents, and patient satisfaction. The medical records of 991 patients were reviewed to determine the standards for safe anesthesia practice and critical incidents. A total of 400 patients responded to the patient satisfaction survey. Multivariable regressions were employed to determine whether the anesthetist NLE score predicted QoC indicators.

RESULTS

The mean percentage of safe anesthesia practice standards met was 69.14%, and the mean satisfaction score was 85.22%. There were 1,120 critical incidents among 911 patients, with three out of five experiencing at least one. After controlling for patient, anesthetist, facility, and clinical care-related confounding variables, the NLE score predicted the occurrence of critical incidents. For every 1% point increase in the total NLE score, the odds of developing one or more critical incidents decreased by 18% (aOR = 0.82; 95% CI = 0.70 = 0.96; p = 0.016). No statistically significant associations existed between the other two QoC indicators and NLE scores.

CONCLUSION

The NLE score had an inverse relationship with the occurrence of critical incidents, supporting the validity of the examination in assessing graduates' ability to provide safe and effective care. The lack of an association with the other two QoC indicators requires further investigation. Our findings may help improve education quality and the impact of NLEs in Ethiopia and beyond.

Paediatric oncologists' perspectives on Strategic solutions to develop Integrated Cancer Palliative Care: feedback intervention theory as an explanatory Framework

BACKGROUND

Globally, children with cancer often experience delays in palliative care referral or are infrequently referred. Therefore, we conducted a qualitative study to gain insight from paediatric oncologists into what enables or deters palliative care referral. Strategic solutions to develop integrated palliative care was a critical study theme. In this paper, we have explained and interpreted these strategic solutions through the lens of feedback intervention theory.

METHODOLOGY

The study findings were interpreted using Kumar's six-step approach that enabled systematic evaluation of a theory's appropriateness and alignment with the researcher's paradigm, methodology, and study findings. It also explained how theory informed analysis and elucidated challenges or the development of new models. The feedback intervention theory appraises the discrepancy between actual and desired goals and provides feedback to improve it.

RESULTS

Strategic solutions generated from the study findings were coherent with the aspects elucidated in theory, like coping mechanisms, levels of feedback hierarchy, and factors determining the effect of the feedback intervention on performance. Paediatric oncologists suggested integrating palliative care providers in the team innocuously, improving communication between teams, relabelling palliative care as symptom control, and working with a skilled and accessible palliative care team. The paper proposes an infinite loop model developed from the study, which has the potential to foster integrated palliative care through excellent collaboration and continuous feedback.

CONCLUSION

Applying feedback intervention theory can bridge the gap between actual and desired practice for integrated cancer palliative care in paediatric oncology.

Determinants of appropriate antibiotic and NSAID prescribing in unscheduled outpatient settings in the veterans health administration

BACKGROUND

Despite efforts to enhance the quality of medication prescribing in outpatient settings, potentially inappropriate prescribing remains common, particularly in unscheduled settings where patients can present with infectious and pain-related complaints. Two of the most commonly prescribed medication classes in outpatient settings with frequent rates of potentially inappropriate prescribing include antibiotics and nonsteroidal anti-inflammatory drugs (NSAIDs). In the setting of persistent inappropriate prescribing, we sought to understand a diverse set of perspectives on the determinants of inappropriate prescribing of antibiotics and NSAIDs in the Veterans Health Administration.

METHODS

We conducted a qualitative study guided by the Consolidated Framework for Implementation Research and Theory of Planned Behavior. Semi-structured interviews were conducted with clinicians, stakeholders, and Veterans from March 1, 2021 through December 31, 2021 within the Veteran Affairs Health System in unscheduled outpatient settings at the Tennessee Valley Healthcare System. Stakeholders included clinical operations leadership and methodological experts. Audio-recorded interviews were transcribed and de-identified. Data coding and analysis were conducted by experienced qualitative methodologists adhering to the Consolidated Criteria for Reporting Qualitative Studies guidelines. Analysis was conducted using an iterative inductive/deductive process.

RESULTS

We conducted semi-structured interviews with 66 participants: clinicians (N = 25), stakeholders (N = 24), and Veterans (N = 17). We identified six themes contributing to potentially inappropriate prescribing of antibiotics and NSAIDs: 1) Perceived versus actual Veterans expectations about prescribing; 2) the influence of a time-pressured clinical environment on prescribing stewardship; 3) Limited clinician knowledge, awareness, and willingness to use evidence-based care; 4) Prescriber uncertainties about the Veteran condition at the time of the clinical encounter; 5) Limited communication; and 6) Technology barriers of the electronic health record and patient portal.

CONCLUSIONS

The diverse perspectives on prescribing underscore the need for interventions that recognize the detrimental impact of high workload on prescribing stewardship and the need to design interventions with the end-user in mind. This study revealed actionable themes that could be addressed to improve guideline concordant prescribing to enhance the quality of prescribing and to reduce patient harm.

Implementation of an enhanced recovery after surgery protocol for colorectal cancer in a regional hospital network supported by audit and feedback: a stepped wedge, cluster randomised trial

BACKGROUND

Enhanced recovery after surgery (ERAS) protocols are known to potentially improve the management and outcomes of patients undergoing colorectal surgery, with limited evidence of their implementation in hospital networks and in a large population. We aimed to assess the impact of the implementation of an ERAS protocol in colorectal cancer surgery in the entire region of Piemonte, Italy, supported by an audit and feedback (A&F) intervention.

METHODS

A large, stepped wedge, cluster randomised trial enrolled patients scheduled for elective surgery at 29 general surgery units (clusters). At baseline (first 3 months), standard care was continued in all units. Thereafter, four groups of clusters began to adopt the ERAS protocol successively. By the end of the study, each cluster had a period in which standard care was maintained (control) and a period in which the protocol was applied (experimental). ERAS implementation was supported by initial training and A&F initiatives. The primary endpoint was length of stay (LOS) without outliers (>94th percentile), and the secondary endpoints were outliers for LOS, postoperative medical and surgical complications, quality of recovery and compliance with ERAS items.

RESULTS

Of 2626 randomised patients, 2397 were included in the LOS analysis (1060 in the control period and 1337 in the experimental period). The mean LOS without outliers was 8.5 days during the control period (SD 3.9) and 7.5 (SD 3.5) during the experimental one. The adjusted difference between the two periods was a reduction of -0.58 days (95% CI -1.07, -0.09; p=0.021). The compliance with ERAS items increased from 52.4% to 67.3% (estimated absolute difference +13%; 95% CI 11.4%, 14.7%). No difference in the occurrence of complications was evidenced (OR 1.22; 95% CI 0.89, 1.68).

CONCLUSION

Implementation of the ERAS protocol for colorectal cancer, supported by A&F approach, led to a substantial improvement in compliance and a reduction in LOS, without meaningful effects on complications. Trial registration number NCT04037787.

Learning together for better health using an evidence-based Learning Health System framework: a case study in stroke

BACKGROUND

In the context of expanding digital health tools, the health system is ready for Learning Health System (LHS) models. These models, with proper governance and stakeholder engagement, enable the integration of digital infrastructure to provide feedback to all relevant parties including clinicians and consumers on performance against best practice standards, as well as fostering innovation and aligning healthcare with patient needs. The LHS literature primarily includes opinion or consensus-based frameworks and lacks validation or evidence of benefit. Our aim was to outline a rigorously codesigned, evidence-based LHS framework and present a national case study of an LHS-aligned national stroke program that has delivered clinical benefit.

MAIN TEXT

Current core components of a LHS involve capturing evidence from communities and stakeholders (quadrant 1), integrating evidence from research findings (quadrant 2), leveraging evidence from data and practice (quadrant 3), and generating evidence from implementation (quadrant 4) for iterative system-level improvement. The Australian Stroke program was selected as the case study as it provides an exemplar of how an iterative LHS works in practice at a national level encompassing and integrating evidence from all four LHS quadrants. Using this case study, we demonstrate how to apply evidence-based processes to healthcare improvement and embed real-world research for optimising healthcare improvement. We emphasize the transition from research as an endpoint, to research as an enabler and a solution for impact in healthcare improvement.

CONCLUSIONS

The Australian Stroke program has nationally improved stroke care since 2007, showcasing the value of integrated LHS-aligned approaches for tangible impact on outcomes. This LHS case study is a practical example for other health conditions and settings to follow suit.

Disparities in Access to Deep Brain Stimulation for Parkinson's Disease and Proposed Interventions: A Literature Review

BACKGROUND

Deep brain stimulation (DBS) is an effective therapy for Parkinson's disease (PD), but disparities exist in access to DBS along gender, racial, and socioeconomic lines.

SUMMARY

Women are underrepresented in clinical trials and less likely to undergo DBS compared to their male counterparts. Racial and ethnic minorities are also less likely to undergo DBS procedures, even when controlling for disease severity and other demographic factors. These disparities can have significant impacts on patients' access to care, quality of life, and ability to manage their debilitating movement disorders.

KEY MESSAGES

Addressing these disparities requires increasing patient awareness and education, minimizing barriers to equitable access, and implementing diversity and inclusion initiatives within the healthcare system. In this systematic review, we first review literature discussing gender, racial, and socioeconomic disparities in DBS access and then propose several patient, provider, community, and national-level interventions to improve DBS access for all populations.

Evaluating a Physician Audit and Feedback Intervention to Increase Clinical Trial Enrollment in Radiation Oncology in a Multisite Tertiary Cancer Center: A Randomized Study

PURPOSE

Clinical trial participation continues to be low, slowing new cancer therapy development. Few strategies have been prospectively tested to address barriers to enrollment. We investigated the effectiveness of a physician audit and feedback report to improve clinical trial enrollment.

METHODS AND MATERIALS

We conducted a randomized quality improvement study among radiation oncologists at a multisite tertiary cancer network. Physicians in the intervention group received quarterly audit and feedback reports comparing the physician's trial enrollments with those of their peers. The primary outcome was trial enrollments.

RESULTS

Among physicians randomized to receive the feedback report (n = 30), the median proportion of patients enrolled during the study period increased to 6.1% (IQR, 2.6%-9.3%) from 3.2% (IQR, 1.1%-10%) at baseline. Among those not receiving the feedback report (n = 29), the median proportion of patients enrolled increased to 4.1% (IQR, 1.3%-7.6%) from 1.6% (IQR, 0%-4.1%) at baseline. There was a nonsignificant change in the proportion of enrollments associated with receiving the feedback report (-0.6%; 95% CI, -3.0% to 1.8%; P = .6). Notably, there was an interaction between baseline trial accrual and receipt of feedback reports (P = .005), with enrollment declining among high accruers. There was an increase in enrollment throughout the study, regardless of study group (P = .001).

CONCLUSIONS

In this study, a positive effect of physician audit and feedback on clinical trial enrollment was not observed. Future efforts should avoid disincentivizing high accruers and might consider pairing feedback with other patient- or physician-level strategies. The increase in trial enrollment in both groups over time highlights the importance of including a comparison group in quality improvement studies to reduce confounding from secular trends.

Evaluating feedback reports to support documentation of veterans' care preferences in home based primary care

BACKGROUND

To evaluate the effectiveness of delivering feedback reports to increase completion of LST notes among VA Home Based Primary Care (HBPC) teams. The Life Sustaining Treatment Decisions Initiative (LSTDI) was implemented throughout the Veterans Health Administration (VHA) in the United States in 2017 to ensure that seriously ill Veterans have care goals and LST decisions elicited and documented.

METHODS

We distributed monthly feedback reports summarizing LST template completion rates to 13 HBPC intervention sites between October 2018 and February 2020 as the sole implementation strategy. We used principal component analyses to match intervention to 26 comparison sites and used interrupted time series/segmented regression analyses to evaluate the differences in LST template completion rates between intervention and comparison sites. Data were extracted from national databases for VA HBPC in addition to interviews and surveys in a mixed methods process evaluation.

RESULTS

LST template completion rose from 6.3 to 41.9% across both intervention and comparison HBPC teams between March 1, 2018, and February 26, 2020. There were no statistically significant differences for intervention sites that received feedback reports.

CONCLUSIONS

Feedback reports did not increase documentation of LST preferences for Veterans at intervention compared with comparison sites. Observed increases in completion rates across intervention and comparison sites can likely be attributed to implementation strategies used nationally as part of the national roll-out of the LSTDI. Our results suggest that feedback reports alone were not an effective implementation strategy to augment national implementation strategies in HBPC teams.

Implementation Strategies to Promote Short-Course Radiation for Bone Metastases

Importance

For patients with nonspine bone metastases, short-course radiotherapy (RT) can reduce patient burden without sacrificing clinical benefit. However, there is great variation in uptake of short-course RT across practice settings.

Objective

To evaluate whether a set of 3 implementation strategies facilitates increased adoption of a consensus recommendation to treat nonspine bone metastases with short-course RT (ie, ≤5 fractions).

Design, Setting, and Participants

This prospective, stepped-wedge, cluster randomized quality improvement study was conducted at 3 community-based cancer centers within an existing academic-community partnership. Rollout was initiated in 3-month increments between October 2021 and May 2022. Participants included treating physicians and patients receiving RT for nonspine bone metastases. Data analysis was performed from October 2022 to May 2023.

Exposures

Three implementation strategies-(1) dissemination of published consensus guidelines, (2) personalized audit-and-feedback reports, and (3) an email-based electronic consultation platform (eConsult)-were rolled out to physicians.

Main Outcomes and Measures

The primary outcome was adherence to the consensus recommendation of short-course RT for nonspine bone metastases. Mixed-effects logistic regression at the bone metastasis level was used to model associations between the exposure of physicians to the set of strategies (preimplementation vs postimplementation) and short-course RT, while accounting for patient and physician characteristics and calendar time, with a random effect for physician. Physician surveys were administered before implementation and after implementation to assess feasibility, acceptability, and appropriateness of each strategy.

Results

Forty-five physicians treated 714 patients (median [IQR] age at treatment start, 67 [59-75] years; 343 women [48%]) with 838 unique nonspine bone metastases during the study period. Implementing the set of strategies was not associated with use of short-course RT (odds ratio, 0.78; 95% CI, 0.45-1.34; P = .40), with unadjusted adherence rates of 53% (444 lesions) preimplementation vs 56% (469 lesions) postimplementation; however, the adjusted odds of adherence increased with calendar time (odds ratio, 1.68; 95% CI, 1.20-2.36; P = .003). All 3 implementation strategies were perceived as being feasible, acceptable, and appropriate; only the perception of audit-and-feedback appropriateness changed before vs after implementation (19 of 29 physicians [66%] vs 27 of 30 physicians [90%]; P = .03, Fisher exact test), with 20 physicians (67%) preferring reports quarterly.

Conclusions and Relevance

In this quality improvement study, a multicomponent set of implementation strategies was not associated with increased use of short-course RT within an academic-community partnership. However, practice improved with time, perhaps owing to secular trends or physician awareness of the study. Audit-and-feedback was more appropriate than anticipated. Findings support the need to investigate optimal approaches for promoting evidence-based radiation practice across settings.

Intervention for reducing the overuse of upper endoscopy in patients <45 years: a protocol for a stepwise intervention programme

Utilisation rates for healthcare services vary widely both within and between nations. Moreover, healthcare providers with insurance-based reimbursement systems observe an effect of social determinants of health on healthcare utilisation rates and outcomes. Even in countries with publicly funded universal healthcare such as Norway, utilisation rates for medical and surgical interventions vary between and within health regions and hospitals.Most interventions targeting overuse and high utilisation rates are based on the assumption that knowledge of areas of unwarranted variation in healthcare automatically will lead to a reduction in unwarranted variation. Recommendations regarding how to reduce this variation are often not very detailed or prominent.This paper describes a protocol for reducing the overuse of upper endoscopy in a Norwegian health region. The protocol uses a combination of digital tools and psychological methods targeting behavioural change in order to alter healthcare workers' approach to patient care.The aim of the planned intervention is to evaluate the effectiveness of a multifaceted set of interventions to reduce the overuse of upper endoscopy in patients under 45 years. A secondary aim is to evaluate the specific effect of the various parts of the intervention.

Feasibility of a quality-improvement program based on routinely collected health outcomes in Dutch primary care physical therapist practice: a mixed-methods study

BACKGROUND

This study evaluates the feasibility of a nine-month advanced quality-improvement program aimed at enhancing the quality of care provided by primary care physical therapists in the Netherlands. The evaluation is based on routinely collected health outcomes of patients with nonspecific low back pain, assessing three feasibility domains: (1) appropriateness, feasibility, and acceptability for quality-improvement purposes; (2) impact on clinical performance; and (3) impact on learning and behavioral change.

METHODS

A mixed-methods quality-improvement study using a concurrent triangulation design was conducted in primary care physical therapist practice. Feedback reports on the processes and outcomes of care, peer assessment, and self-assessment were used in a Plan-Do-Study-Act cycle based on self-selected goals. The program's appropriateness, feasibility, and acceptability, as well as the impact on clinical performance, were evaluated using the Intervention Appropriate Measure, Feasibility Intervention Measure, Acceptability Intervention Measure (for these three measure, possible scores range from 4 to 20), and with a self-assessment of clinical performance (scored 0-10), respectively. The impact on learning and behavioral change was evaluated qualitatively with a directed content analysis.

RESULTS

Ten physical therapists from two practices participated in this study. They rated the program with a mean of 16.5 (SD 1.9) for appropriateness, 17.1 (SD 2.2) for feasibility, and 16.4 (SD 1.5) for acceptability. Participants gave their development in clinical performance a mean score of 6.7 (SD 1.8). Participants became aware of the potential value of using outcome data and gained insight into their own routines and motivations. They changed their data collection routines, implemented data in their routine practice, and explored the impact on their clinical behavior.

CONCLUSIONS

This explorative study demonstrated that a quality-improvement program, using health outcomes from a national registry, is judged to be feasible.

IMPACT STATEMENT

This study provides preliminary evidence on how physical therapists may use health outcomes to improve their quality, which can be further used in initiatives to improve outcome-based care in primary physical therapy.

Using the WHO individual near miss case review (NMCR) cycle to improve quality of emergency obstetric care and maternal outcome in Keren hospital, Eritrea: an interrupted time series analysis

BACKGROUND

In 2016, the WHO regional office for Europe prepared a manual for conducting routine facility based individual near miss case review cycle. This study evaluates the effectiveness of the individual near miss case review (NMCR) cycle in improving quality of emergency obstetric care and maternal outcome in Keren hospital.

METHODS

An interrupted time series design was used to achieve the objectives of this study. Monthly data on women with potentially life-threatening conditions (PLTCs) admitted between April 2018 and October 2022 (i.e. 33 months pre-implementation and 22 months post-implementation) were collected from medical records. Segmented regression analysis was used to assess the intervention's effect on three process and outcome measures, namely, SMO, delayed care, and substandard care. The intervention was expected a priori to show immediate improvements without time-lag followed by gradual increment in slope. Segmented regression analyses were performed using the "itsa' command in STATA.

RESULTS

During the entire study period, 4365 women with potentially life threatening conditions were identified. There was a significant reduction in the post-implementation period in the proportion of mothers with PLTC who experienced SMO (- 8.86; p <  0.001), delayed care (- 8.76; p <  0.001) and substandard care (- 5.58; p <  0.001) compared to pre-implementation period. Results from the segmented regression analysis revealed that the percentage of women with SMO showed a significant 4.75% (95% CI: - 6.95 to - 2.54, p <  0.001) reduction in level followed by 0.28 percentage points monthly (95% CI: - 0.37 to - 0.14, p <  0.001) drop in trend. Similarly, a significant drop of 3.50% (95% CI: - 4.74 to - 2.26, p <  0.001) in the level of substandard care along with a significant decrease of 0.21 percentage points (95% CI: - 0.28 to - 0.14, p < 0.001) in the slope of the regression line was observed. The proportion of women who received delayed care also showed a significant 7% (95% CI: - 9.28 to - 4.68, p < 0.001) reduction in post-implementation level without significant change in slope.

CONCLUSIONS

Our findings suggest that the WHO individual NMCR cycle was associated with substantial improvements in quality of emergency obstetric care and maternal outcome. The intervention also bears a great potential for scaling-up following the guidance provided in the WHO NMCR manual.

Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation

BACKGROUND

Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients' experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM.

OBJECTIVE

This study examined the usability of an electronic real-time measurement system to monitor surgical patients' experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction.

METHODS

We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients' experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction).

RESULTS

A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access.

CONCLUSIONS

A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients' experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2023-079155.

Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method

BACKGROUND

Audit and feedback (A&F) is a widely used implementation strategy to evaluate and improve medical practice. The optimal design of an A&F system is uncertain and structured process evaluations are currently lacking. This study aimed to develop and validate a questionnaire to evaluate the use of automated A&F systems.

METHODS

Based on the Clinical Performance Feedback Intervention Theory (CP-FIT) and the REFLECT-52 (REassessing audit & Feedback interventions: a tooL for Evaluating Compliance with suggested besT practices) evaluation tool a questionnaire was designed for the purpose of evaluating automated A&F systems. A Rand-modified Delphi method was used to develop the process evaluation and obtain validation. Fourteen experts from different domains in primary care consented to participate and individually scored the questions on a 9-point Likert scale. Afterwards, the questions were discussed in a consensus meeting. After approval, the final questionnaire was compiled.

RESULTS

A 34-question questionnaire composed of 57 items was developed and presented to the expert panel. The consensus meeting resulted in a selection of 31 questions, subdivided into 43 items. A final list of 30 questions consisting of 42 items was obtained.

CONCLUSION

A questionnaire consisting of 30 questions was drawn up for the assessment and improvement of automated A&F systems, based on CP-FIT and REFLECT-52 theory and approved by experts. Next steps will be piloting and implementation of the questionnaire.

Longitudinal evaluation of an electronic audit and feedback system for patient safety in a large tertiary hospital setting

Objective: This study sought to assess the impact of a novel electronic audit and feedback (e-A&F) system on patient outcomes. Methods: The e-A&F intervention was implemented in a tertiary hospital and involved near real-time feedback via web-based dashboards. We used a segmented regression analysis of interrupted time series. We modelled the pre-post change in outcomes for the (1) announcement of this priority list, and (2) implementation of the e-A&F intervention to have affected patient outcomes. Results: Across the study period there were 222,792 episodes of inpatient care, of which 13,904 episodes were found to contain one or more HACs, a risk of 6.24%. From the point of the first intervention until the end of the study the overall risk of a HAC reduced from 8.57% to 4.12% - a 51.93% reduction. Of this reduction the proportion attributed to each of these interventions was found to be 29.99% for the announcement of the priority list and 21.93% for the implementation of the e-A&F intervention. Discussion: Our findings lend evidence to a mechanism that the announcement of a measurement framework, at a national level, can lead to local strategies, such as e-A&F, that lead to significant continued improvements over time.

Implementing routine paediatric height/length and weight screening and weight management advice by clinicians: an evaluation

OBJECTIVE

To determine the views of health care professionals (HCPs) in South Western Sydney Local Health District (SWSLHD) about the effectiveness of implementation strategies used to increase routine height/length and weight screening, advice, and referral for children and adolescents. A secondary aim was to explore the prevalence of weight bias among HCPs.

METHODS

A questionnaire was sent to all HCPs who had undertaken online or face-to-face training between December 2018 and June 2020 in SWSLHD (n=840). The questionnaire collected data on their experience of routine height and weight screening and the effectiveness of strategies used in the implementation. It also included a weight bias assessment. Data were provided by the New South Wales (NSW) Ministry of Health on the performance of routine height/length and weight measures entered into the electronic medical records (eMR) in SWSLHD.

RESULTS

Of the 840 questionnaires sent, 87 were undeliverable; of the remaining 753, 285 were returned (38% response rate). More than half (53%, 151/285) of the participants were nurses. Most HCPs agreed that there was a need for routine screening and reported that education, training, and access to resources were the most helpful implementation strategies. Most HCPs were confident in performing routine screening but were less confident in raising the issue of weight with children and their families. Barriers to implementation were lack of time, equipment, appropriate clinical setting, and HCPs' perceptions and beliefs about obesity.

CONCLUSION

Routine screening is the first step in identifying children and adolescents at risk of overweight and obesity, but many HCP found it challenging to incorporate into daily practice. Multifaceted strategies are effective in increasing routine screening across diverse healthcare settings so that children and adolescents receive timely and appropriate intervention.

Early ambulation protocol after diagnostic transfemoral cerebral angiography: an evidence-based practice project

BACKGROUND

No uniform consensus has been achieved regarding the ambulation protocol after transfemoral cerebral angiography (TFA). Until now, in most hospitals patients are prescribed 8-12 h strict immobilization along with bed rest in the supine position after TFA in China, which causes great discomfort to patients.

OBJECTIVE

To evaluate the effect of an evidence-based early ambulation protocol on the prevention of vascular complications and general discomfort in patients following transfemoral cerebral angiography (TFA).

METHODS

A prospective quasi-experimental study was conducted on 214 patients undergoing TFA with manual compression. Patients in the experimental group were placed supine position for 2 h with a sandbag placed on the wound dressing, followed by a semi-seated position for another 2 h. After this period, patients took 2 h bed rest (move freely) with the sandbag removed, and were allowed to get out of bed 6 h after TFA. Patients in the control group were restricted to an 8 h bed rest in a supine position with the affected leg straight and immobilized. The vascular complications (bleeding, hematoma, ecchymosis) and levels of comfort (low back pain, leg pain, and blood pressure) were evaluated after the procedure. Numeric Rating Scale (NRS) pain scores, systolic blood pressure (SBP); diastolic blood pressure (DBP) were measured hourly for 8 h after TFA.

RESULTS

There was no significant difference in the two groups with regard to vascular complications including bleeding events (P = 0.621), bleeding volume (P = 0.321), and area of hematoma (P = 0.156). The area of ecchymosis in the experimental group was significantly smaller than the control group (P = 0.031). Compared with the control group, the NRS score for low back pain in the 4th, 5th, 6th, 7th, and 8th hour after TFA were significantly lower (P < 0.05), and the NRS score for leg pain in the 5th, 6th, 7th, 8th hour after TFA were significantly lower (P < 0.05). The SBP and DBP in the 6th, 7th, and 8th hour after TFA were significantly lower than the control group (all P < 0.05).

CONCLUSIONS

The evidence-based early ambulation protocol can effectively and safely increase comfort and decrease the pain level for patients undergoing TFA, without change in the incidence of vascular complications.

Reconsidering performance management to support innovative changes in health care services

PURPOSE

A large number of studies indicate that coercive forms of organizational control and performance management in health care services often backfire and initiate dysfunctional consequences. The purpose of this article is to discuss new approaches to performance management in health care services when the purpose is to support innovative changes in the delivery of services.

DESIGN/METHODOLOGY/APPROACH

The article represents cross-boundary work as the theoretical and empirical material used to discuss and reconsider performance management comes from several relevant research disciplines, including systematic reviews of audit and feedback interventions in health care and extant theories of human motivation and organizational control.

FINDINGS

An enabling approach to performance management in health care services can potentially contribute to innovative changes. Key design elements to operationalize such an approach are a formative and learning-oriented use of performance measures, an appeal to self- and social-approval mechanisms when providing feedback and support for local goals and action plans that fit specific conditions and challenges.

ORIGINALITY/VALUE

The article suggests how to operationalize an enabling approach to performance management in health care services. The framework is consistent with new governance and managerial approaches emerging in public sector organizations more generally, supporting a higher degree of professional autonomy and the use of nonfinancial incentives.

Developing and testing a reflection method for implementation of the informal care guideline in community nursing: Design-based research

AIM

To develop a reflection method for community nurses and certified nursing assistants to support the implementation of the Dutch Informal Care guideline in daily care.

DESIGN

Design-based research.

METHODS

A design group and four test groups of community nurses and nursing assistants were formed to develop a reflection method that aligns with the needs and preferences of its end-users. The design and test group meetings were video recorded. The video data were iteratively discussed and analysed thematically to adapt and refine the method and to identify its key features.

RESULTS

A final reflection method was developed. Five main themes were identified from the analysis: the group, reflective triggers, knowledge about the guidelines, the coach and preconditions. The themes are linked to nine key features representing the building blocks of the reflection method. The key features are group size, participants with different (educational) backgrounds, pairs of participants, expressing thoughts, video feedback, reflection game, making the connection with the guideline, coaching as a process facilitator and meeting organizational and contextual conditions for implementation.

CONCLUSION

An evidence- and practice-based reflection method for community nurses and certified nursing assistants is developed to support the implementation. By involving community nurses and certified nursing assistants, the method closely matches their needs and preferences. Critical elements of the reflection method are a game element, video feedback and working in pairs in a group of participants from different (educational) backgrounds. Guidance is needed to make the transfer from theory to practice.

IMPACT

A reflection method for community nurses and certified nursing assistants was developed to enhance care work according to guideline recommendations, aiming to improve the care provided by informal caregivers.

REPORT METHOD

The COREQ guideline was used.

PATIENT OR PUBLIC CONTRIBUTION

This reflection method was developed in close collaboration with all stakeholders during the entire study.

An assessment of adaptation and fidelity in the implementation of an audit and feedback-based intervention to improve transition to adult type 1 diabetes care in Ontario, Canada

BACKGROUND

The fit between an intervention and its local context may affect its implementation and effectiveness. Researchers have stated that both fidelity (the degree to which an intervention is delivered, enacted, and received as intended) and adaptation to the local context are necessary for high-quality implementation. This study describes the implementation of an audit and feedback (AF)-based intervention to improve transition to type 1 diabetes adult care, at five sites, in terms of adaptation and fidelity.

METHODS

An audit and feedback (AF)-based intervention for healthcare teams to improve transition to adult care for patients with type 1 diabetes was studied at five pediatric sites. The Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) was used to document the adaptations made during the study. Fidelity was determined on three different levels: delivery, enactment, and receipt.

RESULTS

Fidelity of delivery, receipt, and enactment were preserved during the implementation of the intervention. Of the five sites, three changed their chosen quality improvement initiative, however, within the parameters of the study protocol; therefore, fidelity was preserved while still enabling participants to adapt accordingly.

CONCLUSIONS

We describe implementing a multi-center AF-based intervention across five sites in Ontario to improve the transition from pediatric to adult diabetes care for youth with type 1 diabetes. This intervention adopted a balanced approach considering both adaptation and fidelity to foster a community of practice to facilitate implementing quality improvement initiatives for improving transition to adult diabetes care. This approach may be adapted for improving transition care for youth with other chronic conditions and to other complex AF-based interventions.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.

Prescribing Portraits to Optimize Prescribing of Proton Pump Inhibitors in Long-Term Care: PPI-T STOP Study

Background

Proton pump inhibitors (PPIs) are among the most commonly prescribed medications in Canada, particularly for older adults (at least 65 years of age). Overprescribing of long-term PPIs leads to health care system waste and is associated with adverse effects, including infections and fractures. The high prevalence of PPI prescribing in long-term care (LTC) facilities prompted an evaluation of systematic approaches to PPI deprescribing.

Objective

To assess the impact of individualized prescribing portraits, a type of audit-and-feedback quality improvement intervention, on PPI deprescribing in the LTC setting.

Methods

This prospective, nonblinded, uncontrolled, pre-post quality improvement study was conducted from December 2021 to April 2022 at a 126-bed LTC facility in Vancouver, British Columbia. A PPI prescribing portrait was developed for each prescriber (n = 5) at the LTC facility, containing the prescriber's personal PPI prescribing metrics as compared with those of their peers across all LTC facilities within the same health authority; an evidence summary for PPI deprescribing; and a personalized list of the prescriber's PPI-treated residents, along with their respective PPI indications and strategies for PPI deprescribing. Three months after the prescribers received their PPI prescribing portraits, the number and types of PPI deprescribing orders were recorded.

Results

The implementation of prescribing portraits resulted in 17 (61%) of 28 PPI-treated residents receiving a deprescribing order by the end of the study period. Of the 28 PPI-treated residents, 20 were determined to be eligible for PPI deprescribing according to the evidence summary presented in the prescribing portrait; of these 20 residents, 16 (80%) appropriately received PPI deprescribing.

Conclusions

Individualized prescribing portraits had the potential to increase evidence-based PPI deprescribing among LTC residents, beyond the extent of deprescribing previously achieved through standard of care.

Identifying the impact of audit and feedback on the professional role of the nurse and psychological well-being: An integrative systematic review

This systematic review aimed to critically synthesis evidence to identify the impact that audit and feedback processes have on the professional role of the nurse and psychological well-being. Little is known about the extent to which audit and feedback processes can positively or negatively impact the professional role of the nurse and psychological well-being. An integrative systematic review was conducted. Covidence systematic review software was used to manage the screening process. Data extraction and methodological quality appraisal were conducted in parallel, and a narrative synthesis was conducted. Nurse participation and responsiveness to audit and feedback processes depended on self-perceived motivation, content, and delivery; and nurses viewed it as an opportunity for professional development. However, audit was reported to negatively impact nurses' psychological well-being, with impacts on burnout, stress, and demotivation in the workplace. Targeting framing, delivery, and content of audit and feedback is critical to nurses' satisfaction and successful quality improvement.

Perceptions of the effectiveness of using patient encounter data as an education and reflection tool in general practice training

Introduction Patient encounter tools provide feedback and potentially reflection on general practitioner (GP) registrars' in-practice learning and may contribute to the formative assessment of clinical competencies. However, little is known about the perceived utility of such tools. Aim To investigate the perceived utility of a patient encounter tool by GP registrars, their supervisors, and medical educators (MEs). Methods General practice registrars, supervisors and MEs from two Australian regional training organisations completed a cross-sectional questionnaire. Registrars rated how Registrar Clinical Encounters in Training (ReCEnT), a patient encounter tool, influenced their reflection on, and change in, clinical practice, learning and training. Supervisors' and MEs' perceptions provided contextual information about understanding their registrars' clinical practice, learning and training needs. Results Questionnaires were completed by 48% of registrars (n  = 90), 22% of supervisors (n  = 182), and 61% of MEs (n  = 62). Most registrars agreed that ReCEnT helped them reflect on their clinical practice (79%), learning needs (69%) and training needs (72%). Many registrars reported changing their clinical practice (54%) and learning approaches (51%). Fewer (37%) agreed that ReCEnT influenced them to change their training plans. Most supervisors (68%) and MEs (82%) agreed ReCEnT reports helped them better understand their registrars' clinical practice. Similarly, most supervisors (63%) and MEs (68%) agreed ReCEnT reports helped them better understand their registrars' learning and training needs. Discussion ReCEnT can prompt self-reflection among registrars, leading to changes in clinical practice, learning approaches and training plans. Reaching its potential as an assessment for learning (as opposed to an assessment of learning) requires effective engagement between registrars, their supervisors and MEs.

A Virtual Hospital Model of Care for Low Back Pain, Back@Home: Protocol for a Hybrid Effectiveness-Implementation Type-I Study

BACKGROUND

Low back pain (LBP) was the fifth most common reason for an emergency department (ED) visit in 2020-2021 in Australia, with >145,000 presentations. A total of one-third of these patients were subsequently admitted to the hospital. The admitted patient care accounts for half of the total health care expenditure on LBP in Australia.

OBJECTIVE

The primary aim of the Back@Home study is to assess the effectiveness of a virtual hospital model of care to reduce the length of admission in people presenting to ED with musculoskeletal LBP. A secondary aim is to evaluate the acceptability and feasibility of the virtual hospital and our implementation strategy. We will also investigate rates of traditional hospital admission from the ED, representations and readmissions to the traditional hospital, demonstrate noninferiority of patient-reported outcomes, and assess cost-effectiveness of the new model.

METHODS

This is a hybrid effectiveness-implementation type-I study. To evaluate effectiveness, we plan to conduct an interrupted time-series study at 3 metropolitan hospitals in Sydney, New South Wales, Australia. Eligible patients will include those aged 16 years or older with a primary diagnosis of musculoskeletal LBP presenting to the ED. The implementation strategy includes clinician education using multimedia resources, staff champions, and an "audit and feedback" process. The implementation of "Back@Home" will be evaluated over 12 months and compared to a 48-month preimplementation period using monthly time-series trends in the average length of hospital stay as the primary outcome. We will construct a plot of the observed and expected lines of trend based on the preimplementation period. Linear segmented regression will identify changes in the level and slope of fitted lines, indicating immediate effects of the intervention, as well as effects over time. The data will be fully anonymized, with informed consent collected for patient-reported outcomes.

RESULTS

As of December 6, 2023, a total of 108 patients have been cared for through Back@Home. A total of 6 patients have completed semistructured interviews regarding their experience of virtual hospital care for nonserious back pain. All outcomes will be evaluated at 6 months (August 2023) and 12 months post implementation (February 2024).

CONCLUSIONS

This study will serve to inform ongoing care delivery and implementation strategies of a novel model of care. If found to be effective, it may be adopted by other health districts, adapting the model to their unique local contexts.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/50146.

Knowledge translation strategies used for sustainability of an evidence-based intervention in child health: a multimethod qualitative study

BACKGROUND

Sustainability of evidence-based interventions (EBIs) is suboptimal in healthcare. Evidence on how knowledge translation (KT) strategies are used for the sustainability of EBIs in practice is lacking. This study examined what and how KT strategies were used to facilitate the sustainability of Alberta Family Integrated Care (FICare)™, a psychoeducational model of care scaled and spread across 14 neonatal intensive care units, in Alberta, Canada.

METHODS

First, we conducted an environmental scan of relevant documents to determine the use of KT strategies to support the sustainability of Alberta FICare™. Second, we conducted semi-structured interviews with decision makers and operational leaders to explore what and how KT strategies were used for the sustainability of Alberta FICare™, as well as barriers and facilitators to using the KT strategies for sustainability. We used the Expert Recommendations for Implementation Change (ERIC) taxonomy to code the strategies. Lastly, we facilitated consultation meetings with the Alberta FICare™ leads to share and gain insights and clarification on our findings.

RESULTS

We identified nine KT strategies to facilitate the sustainability of Alberta FICare™: Conduct ongoing training; Identify and prepare local champions; Research co-production; Remind clinicians; Audit and provide feedback; Change record systems; Promote adaptability; Access new funding; and Involve patients/consumers and family members. A significant barrier to the sustainability of Alberta FICare™ was a lack of clarity on who was responsible for the ongoing maintenance of the intervention. A key facilitator to sustainability of Alberta FICare was its alignment with the Maternal, Newborn, Child & Youth Strategic Clinical Network (MNCY SCN) priorities. Co-production between researchers and health system partners in the design, implementation, and scale and spread of Alberta FICare™ was critical to sustainability.

CONCLUSION

This research highlights the importance of clearly articulating who is responsible for continued championing for the sustainability of EBIs. Additionally, our research demonstrates that the adaptation of interventions must be considered from the onset of implementation so interventions can be tailored to align with contextual barriers for sustainability. Clear guidance is needed to continually support researchers and health system leaders in co-producing strategies that facilitate the long-term sustainability of effective EBIs in practice.

Effects of a team Quality Improvement method in a national clinical audit programme of four clinical specialties in Ministry of Health hospitals in Saudi Arabia

In 2018, the Ministry of Health (MoH) in Saudi Arabia developed a clinical excellence strategy. An objective was to reduce variation in clinical practices in MoH hospitals, particularly for conditions with high mortality in Saudi Arabia, by applying best practice clinical standards and using the clinical audit process to measure clinical practice. The strategy included working with multiprofessional teams in hospitals to implement improvements needed in clinical practice. To test the feasibility of carrying out national clinical audits in MoH hospitals, audits were carried out in 16 MoH hospitals on four clinical subjects-acute myocardial infarction, major trauma, sepsis, and stroke. Clinical expert groups, including Saudi clinicians and an international clinical expert, developed clinical care standards for the four conditions from analyses of international and Saudi clinical guidelines. The audits were designed with the expert groups. Multiprofessional teams were appointed to carry out the audits in designated MoH hospitals. Data collectors in each hospital were trained to collect data. Workshops were held with the teams on the clinical care standards and how data would be collected for the audits, and later, on the findings of data collection and how to use the improvement process to implement changes to improve compliance with the standards. After 4 months, data collection was repeated to determine if compliance with the clinical care standards had improved. Data collected from each hospital for both cycles of data collection were independently reliably tested. All designated hospitals participated in the audits, collecting and submitting data for two rounds of data collection and implementing improvement plans after the first round of data collection. All hospitals made substantial improvements in clinical practices. Of a total of 84 measures used to assess compliance with a total of 52 clinical care standards for the four clinical conditions, improvements were made by hospital teams in 58 (69.1%) measures. Improvements were statistically significant for 34 (40.5%) measures. The project demonstrated that well-designed and executed audits using evidence-based clinical care standards can result in substantial improvements in clinical practices in MoH hospitals in Saudi Arabia. Keys to success were the improvement methodology built into the audit process and the requirement for hospitals to appoint multiprofessional teams to carry out the audits. The approach adds to evidence on the effectiveness of clinical audits in achieving improvements in clinical quality and can be replicated in national audit programmes.

Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

BACKGROUND

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

METHODS

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

RESULTS

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities' first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. "Weak diagnosis or management of obstetric complications" was identified as the main problem, and "actions to reinforce norms and protocols" was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

CONCLUSION

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

Performance Data Advocacy for Continuing Professional Development in Health Professions

ABSTRACT

Efforts to optimize continuing professional development (CPD) are ongoing and include advocacy for the use of clinician performance data. Several educational and quality-based frameworks support the use of performance data to achieve intended improvement outcomes. Although intuitively appealing, the role of performance data for CPD has been uncertain and its utility mainly assumed. In this Scholarly Perspective, the authors briefly review and trace arguments that have led to the conclusion that performance data are essential for CPD. In addition, they summarize and synthesize a recent and ongoing research program exploring the relationship physicians have with performance data. They draw on Collins, Onwuegbuzie, and Johnson's legitimacy model and Dixon-Woods' integrative approach to generate inferences and ways of moving forward. This interpretive approach encourages questioning or raising of assumptions about related concepts and draws on the perspectives (i.e., interpretive work) of the research team to identify the most salient points to guide future work. The authors identify 6 stimuli for future programs of research intended to support broader and better integration of performance data for CPD. Their aims are to contribute to the discourse on data advocacy for CPD by linking conceptual, methodologic, and analytic processes and to stimulate discussion on how to proceed on the issue of performance data for CPD purposes. They hope to move the field from a discussion on the utility of data for CPD to deeper integration of relevant conceptual frameworks.

Statewide Initiative to Reduce Patient Radiation Doses During Percutaneous Coronary Intervention

BACKGROUND

Improved radiation safety practices are needed across hospitals performing percutaneous coronary intervention (PCI). This study was performed to assess the temporal trend in PCI radiation doses concurrent with the conduct of a statewide radiation safety initiative.

METHODS

A statewide initiative to reduce PCI radiation doses was conducted in Michigan between 2017 and 2021 and included focused radiation safety education, reporting of institutional radiation doses, and implementation of radiation performance metrics for hospitals. Using data from a large statewide registry, PCI discharges between July 1, 2016, and July 1, 2022, having a procedural air kerma (AK) recorded were analyzed for temporal trends. A multivariable regression analysis was performed to determine whether declines in procedural AK over time were attributable to changes in known predictors of radiation doses.

RESULTS

Among 131 619 PCI procedures performed during the study period, a reduction in procedural AK was observed over time, from a median dose of 1.46 (0.86-2.37) Gy in the first year of the study to 0.97 (0.56-1.64) Gy in the last year of the study (P<0.001). The proportion of cases with an AK ≥5 Gy declined from 4.24% to 0.86% over the same time period (P<0.0001). After adjusting for variables known to impact radiation doses, a 1-year increase in the date of PCI was associated with a 7.61% (95% CI, 7.38%-7.84%) reduction in procedural AK (P<0.0001).

CONCLUSIONS

Concurrent with the conduct of a statewide initiative to reduce procedural radiation doses, a progressive and significant decline in procedural radiation doses was observed among patients undergoing PCI in the state of Michigan.

Development of theoretically informed audit and feedback: An exemplar from a complex implementation strategy to improve asthma self-management in UK primary care

RATIONALE

Audit and feedback is an evidence-based implementation strategy, but studies reporting the use of theory to guide design elements are limited.

AIMS AND OBJECTIVES

Within the context of a programme of research aiming to improve the implementation of supported asthma self-management in UK primary care (IMPlementing IMProved Asthma self-management as RouTine [IMP2 ART]), we aimed to design and develop theoretically-informed audit and feedback that highlighted supported asthma self-management provision and areas for improvement in primary care general practices.

METHOD

Aligned with the Medical Research Council (MRC) complex intervention framework, the audit and feedback was developed in three phases: (1) Development: literature and theory exploration, and prototype audit and feedback design; (2) Feasibility: eliciting feedback on the audit and feedback from general practice staff (n = 9); (3) Prepiloting: delivering the audit and feedback within the IMP2 ART implementation strategy (incorporating patient and professional resources and an asthma review template) and eliciting clinician feedback (n = 9).

RESULTS

Audit and feedback design was guided by and mapped to existing literature suggestions and theory (e.g., Theoretical Domains Framework, Behaviour Change Technique Taxonomy). Feedback on the prototype audit and feedback confirmed feasibility but identified some refinements (a need to highlight supporting self-management and importance of asthma action plans). Prepiloting informed integration with other IMP2 ART programme strategies (e.g., patient resources and professional education).

CONCLUSION

We conclude that a multistage development process including theory exploration and mapping, contributed to the design and delivery of the audit and feedback. Aligned with the MRC framework, the IMP2 ART strategy (incorporating the audit and feedback) is now being tested in a UK-wide cluster randomised controlled trial.

The Role of Clinical Audits in Advancing Quality and Safety in Healthcare Services: A Multiproject Analysis From a Jordanian Hospital

Introduction Clinical audits have become essential instruments for evaluating and improving the standard of patient care in healthcare services. While individual clinical audits focus on particular aspects of care, multiple clinical audits across various domains, specialties, or departments provide a more comprehensive understanding of clinical practice and encourage systemic improvements. Methodology This study employed a mixed-methods approach to review and assess various clinical audits and quality improvement initiatives conducted at Al-Karak Governmental Hospital in southern Jordan. The study aimed to identify obstacles and possibilities of conducting clinical audits and provide suggestions for enhancing audit procedures and results. Data were collected from both retrospective and prospective sources and analyzed using descriptive and inferential statistics. Results The study comprised 11 audits conducted in three medical departments, namely surgery, obstetrics and gynecology (OB/GYN), and pediatrics, with a total of 618 participants. The improvements in adherence to guidelines after the second loop of all the audits were significant and showed significant improvements in adherence to guidelines, demonstrating the efficacy of clinical audits in improving clinical practice and outcomes. Conclusions Clinical audits are essential for maintaining and improving quality and safety in healthcare services, particularly in developing nations where emergency obstetric care is lacking. Multiple clinical audits provide a comprehensive understanding of clinical practice and encourage systemic improvements. The findings of our study suggest that clinical audits can lead to significant improvements in adherence to guidelines and better clinical outcomes. Future research should focus on identifying best practices for conducting clinical audits and evaluating their long-term viability and expandability.

Exercise-based cardiac rehabilitation after acute myocardial infarction in Sweden - standards, costs, and adherence to European guidelines (The Perfect-CR study)

AIMS

Information on standards including structure- and process-based metrics and how exercise-based cardiac rehabilitation (EBCR) is delivered in relation to guidelines is lacking. The aims of the study were to evaluate standards and adherence to guidelines at Swedish CR centers and to conduct a cost analysis of the physiotherapy-related activities of EBCR.

METHODS AND RESULTS

EBCR standards at all 78 CR centers in Sweden in 2016 were surveyed. The questions were based on guideline-recommended core components of EBCR for patients after a myocardial infarction (MI). The cost analysis included the identification, quantification, and valuation of EBCR-related cost items. Patients were offered a pre-discharge consultation with a physiotherapist at n = 61, 78% of the centers. A pre-exercise screening visit was routinely offered at n = 64, 82% of the centers, at which a test of aerobic capacity was offered in n = 58, 91% of cases, most often as a cycle ergometer exercise test n = 55, 86%. A post-exercise assessment was offered at n = 44, 56% of the centers, with a functional test performed at n = 30, 68%. Almost all the centers n = 76, 97% offered supervised EBCR programs. The total cost of delivering physiotherapy-related activities of EBCR according to guidelines was approximately 437 euro (4,371 SEK) per patient. Delivering EBCR to one MI patient required 11.25 hours of physiotherapy time.

CONCLUSION

While the overall quality of EBCR programs in Sweden is high, there are several areas of potential improvement to reach the recommended European standards across all centers. To improve the quality of EBCR, further compliance with guidelines is warranted.

Feasibility and perceptions of a benzodiazepine deprescribing quality improvement initiative for primary care providers in Japan

BACKGROUND

Quality improvement (QI) initiatives in primary care in Japan are rare. One crucial area for QI is the appropriate prescription of benzodiazepines due to the large and growing elderly population in the country.

OBJECTIVE

This study aimed to determine the feasibility and other perceptions of a Benzodiazepine receptor agonist medications (BZRAs) deprescribing QI initiative for primary care providers (PCPs) in Japanese primary care clinics.

DESIGN

A qualitative study within a QI initiative.

PARTICIPANTS

We recruited 11 semi-public clinics and 13 providers in Japan to participate in a BZRAs deprescribing initiative from 2020 to 2021. After stratifying the clinics according to size, we randomly allocated implementation clinics to either an Audit only or an Audit plus Coaching group.

INTERVENTIONS

For the Audit, we presented clinics with two BZRAs-related indicators. We provided monthly web-based meetings for the Coaching to support their QI activities.

APPROACH

After the nine-month initiative, we conducted semi-structured interviews and used content analysis to identify themes. We organized the themes and assessed the key factors of implementation using the Consolidated Framework for Implementation Research (CFIR) framework.

KEY RESULTS

Audit plus Coaching was perceived as more valuable than Audit only intervention. Participants expressed intellectual curiosity about the QI initiative from resources outside their clinic. However, adopting a team-based QI approach in a small clinic was perceived as challenging, and selecting the indicators was important for meaningful QI.

CONCLUSION

The small size of the clinic could be a potential barrier, but enhancing academic curiosity may facilitate QI initiatives in primary care in Japan. Further implementation trials are needed to evaluate the possibility of QI with more various indicators and a more extended period of time.

Access to automated comparative feedback reports in primary care - a study of intensity of use and relationship with clinical performance among Swedish primary care practices

BACKGROUND

Digital applications that automatically extract information from electronic medical records and provide comparative visualizations of the data in the form of quality indicators to primary care practices may facilitate local quality improvement (QI). A necessary condition for such QI to work is that practices actively access the data. The purpose of this study was to explore the use of an application that visualizes quality indicators in Swedish primary care, developed by a profession-led QI initiative ("Primärvårdskvalitet"). We also describe the characteristics of practices that used the application more or less extensively, and the relationships between the intensity of use and changes in selected performance indicators.

METHODS

We studied longitudinal data on 122 primary care practices' visits to pages (page views) in the application over a period up to 5 years. We compared high and low users, classified by the average number of monthly page views, with respect to practice and patient characteristics as well as baseline measurements of a subset of the performance indicators. We estimated linear associations between visits to pages with diabetes-related indicators and the change in measurements of selected diabetes indicators over 1.5 years.

RESULTS

Less than half of all practices accessed the data in a given month, although most practices accessed the data during at least one third of the observed months. High and low users were similar in terms of most studied characteristics. We found statistically significant positive associations between use of the diabetes indicators and changes in measurements of three diabetes indicators.

CONCLUSIONS

Although most practices in this study indicated an interest in the automated feedback reports, the intensity of use can be described as varying and on average limited. The positive associations between the use and changes in performance suggest that policymakers should increase their support of practices' QI efforts. Such support may include providing a formalized structure for peer group discussions of data, facilitating both understanding of the data and possible action points to improve performance, while maintaining a profession-led use of applications.

Healthcare professional communication behaviours, skills, barriers, and enablers: Exploring the perspectives of people living with Inflammatory Bowel Disease

This qualitative study conceptualised effective communication behaviours of healthcare professionals (gastroenterologists, surgeons, nurses, and general practitioners) and explored communication barriers and facilitators from the perspective of adults with Inflammatory Bowel Disease (IBD). Seventeen qualitative interviews were conducted with people living with IBD in the UK or USA (n = 17) and their spouses (n = 4). An inductive content analysis was firstly applied to participants' accounts to define which healthcare professionals' behaviours and skills were perceived as essential for effective communication. An inductive reflexive thematic analysis elucidated themes of perceived barriers and facilitators experienced when communicating with their IBD healthcare professionals. Thirty-three provider communication behaviours were grouped into nine healthcare professional skills. Five themes encompassed 11 barriers and facilitators: professionals' knowledge and behaviour, unequal power, patient navigation skills, time constraints and demand, and continuity and collaboration of care. For patients and some spouses, enhancing communication in IBD services means increasing patient, family, and health professional knowledge, encouraging collaborative partnership working, and promoting healthcare professional skills to communicate effectively within the reality of time restraints.

Quality Review Committee Audit Improves Thoracic Enhanced Recovery After Surgery Protocol Compliance

INTRODUCTION

Compliance with thoracic Enhanced Recovery After Surgery (ERAS) protocols is critical to achieving their maximum benefits. We sought to examine utilization of quality review meetings as a method to improve protocol compliance through identification and resolution of barriers with compliance.

METHODS

A multidisciplinary committee implemented a thoracic ERAS protocol for anatomic lung resections across five hospitals within our health system. Compliance data at one institution were tracked for 4 mo after initiation of the ERAS protocol; a quality review meeting was held at one hospital, and two additional months of compliance data were recorded. Outcomes of interest were compliance changes to five protocol elements. Pathway elements deferred due to "mindful deviation" were excluded. Chi-square and Fisher's exact tests were used to compare compliance differences.

RESULTS

We included 81 patients: 53 patients before the quality review meeting and 28 after. There were 405 compliance opportunities; 68 (17%) were excluded for mindful deviation, leaving 337 (83%) for inclusion. Overall compliance improved from 53% before to 84% after the quality review meeting. Compliance to avoiding intraoperative urinary catheters, placing chest tubes to water seal in postanesthesia care unit, liberal chest tube removal, and postoperative multimodal pain regimen use improved after the quality review meeting (P values <0.05). Use of preoperative pain bundles was not significantly different (87% versus 96%, P = 0.25).

CONCLUSIONS

Conducting a quality review meeting significantly improved ERAS protocol element use at our intervention healthcare region. This methodology should be considered at other institutions implementing surgical protocols.

Implementation and evaluation of a nurse-led intervention to augment an existing residential aged care facility outreach service with a visual telehealth consultation: stepped-wedge cluster randomised controlled trial

BACKGROUND

Up to 75% of residents from residential aged care facilities (RACF) are transferred to emergency departments (ED) annually to access assessment and care for unplanned or acute health events. Emergency department presentations of RACF residents can be both expensive and risky, and many are unnecessary and preventable. Processes or triage systems to assess residents with a health event, prior to transfer, may reduce unnecessary ED transfer. The Aged Care Emergency (ACE) service is a nurse-led ED outreach service that provides telephone support to RACF nurses regarding residents' health events. This service is available Monday to Friday, 8am to 4 pm (ED ACE hours). The primary objective of this study was to assess whether the augmentation of the phone-based ED ACE service with the addition of a visual telehealth consultation (VTC) would reduce RACF rate of ED presentations compared to usual care. The secondary objectives were to 1) monitor presentations to ED within 48 h post VTC to detect any adverse events and 2) measure RACF staff perceptions of VTC useability and acceptability.

METHODS

This implementation study used a stepped wedge cluster randomised controlled trial design. Study settings were four public hospital EDs and 16 RACFs in two Local Health Districts. Each ED was linked to 4 RACFs with approximately 350 RACF beds, totalling 1435 beds across 16 participating RACFs. Facilities were randomised into eight clusters with each cluster comprising one ED and two RACFs.

RESULTS

A negative binomial regression demonstrated a 29% post-implementation reduction in the rate of ED presentations (per 100 RACF beds), within ED ACE hours (IRR [95% CI]: 0.71 [0.46, 1. 09]; p = 0.122). A 29% reduction, whilst not statistically significant, is still clinically important and impactful for residents and EDs. A post-hoc logistic regression demonstrated a statistically significant 69% reduction in the probability that an episode of care resulted in an ED presentation within ED ACE hours post-implementation compared to pre-implementation (OR [95% CI]: 0.31 [0.11, 0.87]; p = 0.025).

CONCLUSION

Findings have shown the positive impact of augmenting ACE with a VTC. Any reduction of resident presentations to a busy ED is beneficial to healthcare overall, but more so to the individual older person who can recover safely and comfortably in their own RACF.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ID ACTR N12619001692123) (02/12/2019) https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=378629andisReview=true.

What are the features of high-performing quality improvement collaboratives? A qualitative case study of a state-wide collaboratives programme

OBJECTIVES

Despite their widespread use, the evidence base for the effectiveness of quality improvement collaboratives remains mixed. Lack of clarity about 'what good looks like' in collaboratives remains a persistent problem. We aimed to identify the distinctive features of a state-wide collaboratives programme that has demonstrated sustained improvements in quality of care in a range of clinical specialties over a long period.

DESIGN

Qualitative case study involving interviews with purposively sampled participants, observations and analysis of documents.

SETTING

The Michigan Collaborative Quality Initiatives programme.

PARTICIPANTS

38 participants, including clinicians and managers from 10 collaboratives, and staff from the University of Michigan and Blue Cross Blue Shield of Michigan.

RESULTS

We identified five features that characterised success in the collaboratives programme: learning from positive deviance; high-quality coordination; high-quality measurement and comparative performance feedback; careful use of motivational levers; and mobilising professional leadership and building community. Rigorous measurement, securing professional leadership and engagement, cultivating a collaborative culture, creating accountability for quality, and relieving participating sites of unnecessary burdens associated with programme participation were all important to high performance.

CONCLUSIONS

Our findings offer valuable learning for optimising collaboration-based approaches to improvement in healthcare, with implications for the design, structure and resourcing of quality improvement collaboratives. These findings are likely to be useful to clinicians, managers, policy-makers and health system leaders engaged in multiorganisational approaches to improving quality and safety.

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms

BACKGROUND

Unwarranted clinical variation in hospital care includes the underuse, overuse, or misuse of services. Audit and feedback is a common strategy to reduce unwarranted variation, but its effectiveness varies widely across contexts. We aimed to identify implementation strategies, mechanisms, and contextual circumstances contributing to the impact of audit and feedback on unwarranted clinical variation.

METHODS

Realist study examining a state-wide value-based healthcare program implemented between 2017 and 2021 in New South Wales, Australia. Three initiatives within the program included audit and feedback to reduce unwarranted variation in inpatient care for different conditions. Multiple data sources were used to formulate the initial audit and feedback program theory: a systematic review, realist review, program document review, and informal discussions with key program stakeholders. Semi-structured interviews were then conducted with 56 participants to refute, refine, or confirm the initial program theories. Data were analysed retroductively using a context-mechanism-outcome framework for 11 transcripts which were coded into the audit and feedback program theory. The program theory was validated with three expert panels: senior health leaders (n = 19), Agency for Clinical Innovation (n = 11), and Ministry of Health (n = 21) staff.

RESULTS

The program's audit and feedback implementation strategy operated through eight mechanistic processes. The strategy worked well when clinicians (1) felt ownership and buy-in, (2) could make sense of the information provided, (3) were motivated by social influence, and (4) accepted responsibility and accountability for proposed changes. The success of the strategy was constrained when the audit process led to (5) rationalising current practice instead of creating a learning opportunity, (6) perceptions of unfairness and concerns about data integrity, 7) development of improvement plans that were not followed, and (8) perceived intrusions on professional autonomy.

CONCLUSIONS

Audit and feedback strategies may help reduce unwarranted clinical variation in care where there is engagement between auditors and local clinicians, meaningful audit indicators, clear improvement plans, and respect for clinical expertise. We contribute theoretical development for audit and feedback by proposing a Model for Audit and Feedback Implementation at Scale. Recommendations include limiting the number of audit indicators, involving clinical staff and local leaders in feedback, and providing opportunities for reflection.

Excess Bed Days and Hospitalization Costs Associated With 30-Day Complications Following Catheter Ablation of Atrial Fibrillation

BACKGROUND

The incidence and type of complications following catheter ablation of atrial fibrillation have been extensively examined, but the impact associated with these complications on the length of stay and hospitalization costs is unknown.

METHODS AND RESULTS

This cohort study included 20 117 adult patients (mean age 62.6±11.4 years, 30.3% women, median length of stay 1 day [interquartile range 1-2 days]) undergoing atrial fibrillation ablation in financial years 2011 to 2017 in Australia with available cost data from the National Hospital Cost Data Collection, which determines government reimbursement of health services provided. The primary outcome was the costs associated with complications occurring up to 30 days postdischarge adjusted for inflation to 2021 Australian dollars. We used generalized linear models to estimate the increase in length of stay and cost associated with complications, adjusting for patient characteristics. Within 30 days of hospital discharge, 1151 (5.72%) patients experienced a complication with bleeding (3.35%) and pericardial effusion (0.75%) being the most common. On average, the occurrence of a complication was associated with an adjusted 3.3 (95% CI, 3.1-3.6) excess bed days of hospital care (totaling 3851 days), and a $7812 (95% CI, $6754-$8870) increase in hospitalization cost (totaling $9.0 million). Most of the total excess cost was attributable to bleeding ($3.8 million, 41.9% of total excess cost) and pericardial effusion ($1.6 million, 18.2%).

CONCLUSIONS

Complications following atrial fibrillation ablation were associated with significant increase in length of stay and hospitalization costs, most of which were attributable to bleeding and pericardial effusion. Strategies to improve procedural safety and reduce health care costs should focus on these complications.