Audit and feedback: effects on professional practice and healthcare outcomes

Alarm with care-a de-implementation strategy to reduce fall prevention alarm use in US hospitals: a study protocol for a hybrid 2 effectiveness-implementation trial

BACKGROUND

Fall prevention alarms are commonly used among US hospitals as a fall prevention strategy despite limited evidence of effectiveness. Further, fall prevention alarms are harmful to healthcare staff (e.g., alarm fatigue) and patients (e.g., sleep disturbance, mobility restriction). There is a need for research to develop and test strategies for reducing use of fall prevention alarms in US hospitals.

METHODS

To address this gap, we propose testing the effectiveness and implementation of Alarm with Care, a de-implementation strategy to reduce fall prevention alarm use using a stepped-wedge randomized controlled trial among 30 adult medical or medical surgical units from nonfederal US acute care hospitals. Guided by the Choosing Wisely De-Implementation Framework, we will (1) identify barriers to fall prevention alarm de-implementation and develop tailored de-implementation strategies for each unit and (2) compare the implementation and effectiveness of high- versus low-intensity coaching to support site-specific de-implementation of fall prevention alarms. We will evaluate effectiveness and implementation outcomes and examine the effect of multi-level (e.g., hospital, unit, and patient) factors on effectiveness and implementation. Rate of fall prevention alarm use is the primary outcome. Balancing measures will include fall rates and fall-related injuries. Implementation outcomes will include feasibility, acceptability, appropriateness, and fidelity.

DISCUSSION

Findings from this line of research could be used to support scale-up of fall prevention alarm de-implementation in other healthcare settings. Further, research generated from this proposal will advance the field of de-implementation science by determining the extent to which low-intensity coaching is an effective and feasible de-implementation strategy.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT06089239 . Date of registration: October 17, 2023.

Knowledge translation strategies to support the sustainability of evidence-based interventions in healthcare: a scoping review

BACKGROUND

Knowledge translation (KT) strategies are widely used to facilitate the implementation of EBIs into healthcare practices. However, it is unknown what and how KT strategies are used to facilitate the sustainability of EBIs in institutional healthcare settings.

OBJECTIVES

This scoping review aimed to consolidate the current evidence on (i) what and how KT strategies are being used for the sustainability of EBIs in institutional healthcare settings; (ii) the reported KT strategy outcomes (e.g., acceptability) for EBI sustainability, and (iii) the reported EBI sustainability outcomes (e.g., EBI activities or component of the intervention continue).

METHODS

We conducted a scoping review of five electronic databases. We included studies describing the use of specific KT strategies to facilitate the sustainability of EBIs (more than 1-year post-implementation). We coded KT strategies using the clustered ERIC taxonomy and AIMD framework, we coded KT strategy outcomes using Tierney et al.'s measures, and EBI sustainability outcomes using Scheirer and Dearing's and Lennox's taxonomy. We conducted descriptive numerical summaries and a narrative synthesis to analyze the results.

RESULTS

The search identified 3776 studies for review. Following the screening, 25 studies (reported in 27 papers due to two companion reports) met the final inclusion criteria. Most studies used multi-component KT strategies for EBI sustainability (n = 24). The most common ERIC KT strategy clusters were to train and educate stakeholders (n = 38) and develop stakeholder interrelationships (n = 34). Education was the most widely used KT strategy (n = 17). Many studies (n = 11) did not clearly report whether they used different or the same KT strategies between EBI implementation and sustainability. Seven studies adapted KT strategies from implementation to sustainability efforts. Only two studies reported using a new KT strategy for EBI sustainability. The most reported KT strategy outcomes were acceptability (n = 10), sustainability (n = 5); and adoption (n = 4). The most commonly measured EBI sustainability outcome was the continuation of EBI activities or components (n = 23), followed by continued benefits for patients, staff, and stakeholders (n = 22).

CONCLUSIONS

Our review provides insight into a conceptual problem where initial EBI implementation and sustainability are considered as two discrete time periods. Our findings show we need to consider EBI implementation and sustainability as a continuum and design and select KT strategies with this in mind. Our review has emphasized areas that require further research (e.g., KT strategy adaptation for EBI sustainability). To advance understanding of how to employ KT strategies for EBI sustainability, we recommend clearly reporting the dose, frequency, adaptations, fidelity, and cost of KT strategies. Advancing our understanding in this area would facilitate better design, selection, tailored, and adapted use of KT strategies for EBI sustainability, thereby contributing to improved patient, provider, and health system outcomes.

Measuring and monitoring patient safety in hospitals in the Republic of Ireland

BACKGROUND

Measuring and monitoring safety (MMS) is critical to the success of safety improvement efforts in healthcare. However, a major challenge to improving safety is the lack of high quality information to support performance evaluation.

AIMS

The aim of this study was to use Vincent et al.'s MMS framework to evaluate the methods used to MMS in Irish hospitals and make recommendations for improvement.

METHODS

The first phase of this qualitative study used document analysis to review national guidance on MMS in Ireland. The second phase consisted of semi-structured interviews with key stakeholders on their understanding of MMS. The MMS framework was used to classify the methods identified.

RESULTS

Six documents were included for analysis, and 24 semi-structured interviews were conducted with key stakeholders working in the Irish healthcare system. A total of 162 methods of MMS were identified, with one method of MMS addressing two dimensions. Of these MMS methods, 30 (18.4%) were concerned with past harm, 40 (24.5%) were concerned with the reliability of safety critical processes, 16 (9.8%) were concerned with sensitivity to operations, 28 (17.2%) were concerned with anticipation and preparedness, and 49 (30%) were concerned with integration and learning.

CONCLUSIONS

There are a wide range of methods of MMS in Irish hospitals. It is suggested that there is a need to identify those methods of MMS that are particularly useful in reducing harm and supporting action and improvement and do not place a large burden on healthcare staff to either use or interpret.

What would other emergency stroke teams do? Using explainable machine learning to understand variation in thrombolysis practice

INTRODUCTION

The aim of this work was to understand between-hospital variation in thrombolysis use among emergency stroke admissions in England and Wales.

PATIENTS

A total of 88,928 patients who arrived at all 132 emergency stroke hospitals in England Wales within 4 h of stroke onset, from 2016 to 2018.

METHODS

Machine learning was applied to the Sentinel Stroke National Audit Programme (SSNAP) data set, to learn which patients in each hospital would likely receive thrombolysis. We used XGBoost machine learning models, coupled with a SHAP model for explainability; Shapley (SHAP) values, providing estimates of how patient features, and hospital identity, influence the odds of receiving thrombolysis.

RESULTS

Thrombolysis use in patients arriving within 4 h of known or estimated stroke onset ranged 7% -49% between hospitals. The odds of receiving thrombolysis reduced 9-fold over the first 120 min of arrival-to-scan time, varied 30-fold with stroke severity, reduced 3-fold with estimated rather than precise stroke onset time, fell 6-fold with increasing pre-stroke disability, fell 4-fold with onset during sleep, fell 5-fold with use of anticoagulants, fell 2-fold between 80 and 110 years of age, reduced 3-fold between 120 and 240 min of onset-to-arrival time and varied 13-fold between hospitals. The majority of between-hospital variance was explained by the hospital, rather than the differences in local patient populations.

CONCLUSIONS

Using explainable machine learning, we identified that the majority of the between-hospital variation in thrombolysis use in England and Wales may be explained by differences in in-hospital processes and differences in attitudes to judging suitability for thrombolysis.

Addressing the "Last Mile" Problem in Educational Research: Educational Researchers' Interest, Knowledge, and Use of Implementation Science Constructs

Although evidence-based practices can enhance educational outcomes, a persistent gap exists between research and practice. Advancing the understanding and use of implementation science among educational researchers has potential to close this gap. This study uses person-centered approaches to identify profiles of educational researchers (N = 140) according to interest, knowledge, and use of four implementation science constructs (determinants, strategies, outcomes, theories). We examined whether profile membership was predicted by researcher career level/type and project topic and type. Participants were moderately to very interested to learn more about implementation constructs, but were only a little to somewhat likely to be knowledgeable about them or incorporate them into their research. Three profiles were identified: High Knowledge/High Use/High Interest, Low Knowledge/Low Use/High Interest, and Low Knowledge/Low Use/Low Interest. Profile membership was not predicted by project type, topic area, or career level. Implications for enhancing implementation science training for educational researchers are discussed.

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals

BACKGROUND

Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change.

METHODS

We conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs ('Education (unspecified)' and 'Feedback (unspecified)') were added, such that 95 BCTs were considered for coding.

RESULTS

In total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were 'Feedback on behaviour' (present 89% of the time; e.g. feedback on drug prescribing), 'Instruction on how to perform the behaviour' (71%; e.g. issuing a clinical guideline), 'Social comparison' (52%; e.g. feedback on performance of peers), 'Credible source' (41%; e.g. endorsements from respected professional body), and 'Education (unspecified)' (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0-15 per arm), of which the most common were identical to those identified in treatment arms.

CONCLUSIONS

A&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness.

TRIAL REGISTRATIONS

N/A.

Managing unwarranted variation in hospital care - findings from a regional audit in Norway

BACKGROUND/AIM

There has been increasing focus and research over the past decades on defining, identifying, visualizing and reducing unwarranted clinical variation in clinical practice. Both clinician-driven initiatives such as the US based "Choosing Wisely" campaign and the top-down driven "Evidence-based intervention programme (EBI)" launched by NHS UK to improve quality of care by reducing unnecessary interventions have shown marginal results. We present the findings from a mixed-methods audit performed to evaluate the compliance by senior hospital leaders of a new regional strategy to reduce unwarranted variation in outcomes and utilization rates.

METHODS

Seventy-five mid- to senior-division and department leaders from eight hospital trusts in South-Eastern Norway Regional Trust (HSO) were invited to participate in evaluating the response and compliance of the regional leadership strategy for reducing unwarranted variation in patient outcomes and service utilization rates.

RESULTS

The audit revealed that the aim of reducing unwanted variation was not clearly communicated by senior HSO management. There was varying use of data from the national quality registers and health atlases for quality improvement. One third of the clinical leaders reported a lack of scrutiny of their work and were insufficiently aware of the HSO's top-management and the hospital's Boards strategic expectations about the importance of reducing unwarranted variation in their hospital utilization.

CONCLUSIONS

We found that the strategic aim of reducing unwanted clinical variation was not clearly communicated by senior HSO management to hospital boards and senior management. The hospitals could benefit from a better understanding of causes of variation by strengthening their efforts to reduce unwarranted variation in utilization rates as a key element in improving health care quality and patient safety. The findings of the audit are relevant for other healthcare organizations trying to improve their quality and reduce unnecessary variation.

Evaluation of an implementation support package to increase community mental health clinicians' routine delivery of preventive care for multiple health behaviours: a non-randomised controlled trial

BACKGROUND

People with a mental health condition are more likely to engage in risk behaviours compared to people without. Delivery of preventive care to improve such behaviours is recommended for community mental health services, but inadequately implemented. This study assessed the effectiveness of an implementation support package on clinicians' delivery of preventive care (assessment, advice, referral) for four risk behaviours (tobacco smoking, harmful alcohol consumption, physical inactivity, inadequate fruit and vegetable intake) compared to no implementation support. The participatory approach to developing the support package, and fidelity of the implementation strategies, are also described.

METHODS

A non-randomised controlled trial was undertaken in 2019-2020 with two community mental health services (control and target) in one health district in New South Wales, Australia. A 4-month support package consisting of multiple implementation strategies was delivered to one site following a two-phase participatory design process. Five implementation strategies were proposed to service managers by researchers. After consultation with managers and clinicians, the final implementation support package included four strategies: training and education materials, enabling resources and prompts, client activation material, and audit and feedback. Client-reported receipt of the three elements of preventive care for the four risk behaviours was collected from a cross-sectional sample of clients who had recently attended the service at baseline (6 months) and follow-up (5 months). Logistic regression models examined change in receipt of preventive care to assess effectiveness.

RESULTS

A total of 860 client surveys were completed (control baseline n = 168; target baseline n = 261; control follow-up n = 164; and target follow-up n = 267). Analyses revealed no significant differential changes in preventive care receipt between the target and control sites from baseline to follow-up, including across the four primary outcomes: assessed for all behaviours (OR = 1.19; 95% CI 0.55, 2.57; p = 0.65); advised for all relevant risk behaviours (OR = 1.18; 95% CI 0.39, 3.61; p = 0.77); referred for any relevant risk behaviour (OR = 0.80; 95% CI 0.40, 1.63; p = 0.55); and complete care (OR = 3.11; 95% CI 0.62, 15.63; p = 0.17). Fidelity of the implementation strategies was limited as one of the four strategies (audit and feedback) was not delivered, components of two strategies (enabling resources and prompts, and client activation material) were not delivered as intended, and one strategy (education and training) was delivered as intended although some components were offered late in the implementation period.

CONCLUSIONS

The implementation support package was ineffective at increasing preventive care delivery. Further investigation is required to determine optimal participatory design methods to develop effective implementation strategies, including those that support delivery of care in community mental health settings within the ongoing context of uncertain environmental challenges.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trials Registry ACTRN12619001379101.

IMP2ART: development of a multi-level programme theory integrating the COM-B model and the iPARIHS framework, to enhance implementation of supported self-management of asthma in primary care

BACKGROUND

Supported asthma self-management, incorporating an asthma action plan and annual clinical review, has been recommended by UK/global guidelines for over three decades. However, implementation remains poor, as only around a third of individuals receive basic asthma care, according to the UKs leading respiratory charity Asthma and Lung UK. A systematic review of implementation studies recommended that a whole systems approach targeting patients, healthcare professional education, and organisations is needed to improve implementation of supported asthma self-management in primary care. The IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) is a national Hybrid-II implementation cluster randomised controlled trial that aims to evaluate such an approach. This paper describes the development of the implementation strategy for IMP2ART with particular focus on the integration of multiple level theories.

METHODS

The Medical Research Council design and evaluation of complex interventions framework and the Person-Based Approach to intervention development were used as guidance for stages of strategy development. Specifically, we (i) set up a multidisciplinary team (including practicing and academic clinicians, health psychologists, public health and patient colleagues), (ii) reviewed and integrated evidence and theory, (iii) developed guiding principles, (iv) developed prototype materials, and (v) conducted a pre-pilot study before final refinement.

RESULTS

The implementation strategy included resources for patients, team-based and individual healthcare professional education, practice audit and feedback, and an asthma review template, as well as a facilitator role accessible to primary care practices for 12 months. The synthesis of the integrated Promoting Action on Research Implementation in Health Services (iPARIHS) and Capability, Opportunity, Motivation and Behaviour (COM-B) frameworks led to an evolved framework bringing together important implementation and behaviour change elements which will be used as a basis for the study process evaluation.

CONCLUSIONS

A description of rigorous implementation strategy development for the IMP2ART study is provided along with newly theorised integration of implementation and behaviour change science which may be of benefit to others targeting implementation in primary care.

TRIAL REGISTRATION

ISRCTN15448074. Registered on 2nd December 2019.

Developing an Audit and Feedback Dashboard for Family Physicians: User-Centered Design Process

BACKGROUND

Audit and feedback (A&F), the summary and provision of clinical performance data, is a common quality improvement strategy. Successful design and implementation of A&F-or any quality improvement strategy-should incorporate evidence-informed best practices as well as context-specific end user input.

OBJECTIVE

We used A&F theory and user-centered design to inform the development of a web-based primary care A&F dashboard. We describe the design process and how it influenced the design of the dashboard.

METHODS

Our design process included 3 phases: prototype development based on A&F theory and input from clinical improvement leaders; workshop with family physician quality improvement leaders to develop personas (ie, fictional users that represent an archetype character representative of our key users) and application of those personas to design decisions; and user-centered interviews with family physicians to learn about the physician's reactions to the revised dashboard.

RESULTS

The team applied A&F best practices to the dashboard prototype. Personas were used to identify target groups with challenges and behaviors as a tool for informed design decision-making. Our workshop produced 3 user personas, Dr Skeptic, Frazzled Physician, and Eager Implementer, representing common users based on the team's experience of A&F. Interviews were conducted to further validate findings from the persona workshop and found that (1) physicians were interested in how they compare with peers; however, if performance was above average, they were not motivated to improve even if gaps compared to other standards in their care remained; (2) burnout levels were high as physicians are trying to catch up on missed care during the pandemic and are therefore less motivated to act on the data; and (3) additional desired features included integration within the electronic medical record, and more up-to-date and accurate data.

CONCLUSIONS

We found that carefully incorporating data from user interviews helped operationalize generic best practices for A&F to achieve an acceptable dashboard that could meet the needs and goals of physicians. We demonstrate such a design process in this paper. A&F dashboards should address physicians' data skepticism, present data in a way that spurs action, and support physicians to have the time and capacity to engage in quality improvement work; the steps we followed may help those responsible for quality improvement strategy implementation achieve these aims.

Adapting and implementing breast cancer follow-up in primary care: protocol for a mixed methods hybrid type 1 effectiveness-implementation cluster randomized study

BACKGROUND

Advances in detection and treatment for breast cancer have led to an increase in the number of individuals managing significant late and long-term treatment effects. Primary care has a role in caring for patients with a history of cancer, yet there is little guidance on how to effectively implement survivorship care evidence into primary care delivery.

METHODS

This protocol describes a multi-phase, mixed methods, stakeholder-driven research process that prioritizes actionable, evidence-based primary care improvements to enhance breast cancer survivorship care by integrating implementation and primary care transformation frameworks: the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework and the Practice Change Model (PCM). Informed by depth interviews and a four round Delphi panel with diverse stakeholders from primary care and oncology, we will implement and evaluate an iterative clinical intervention in a hybrid type 1 effectiveness-implementation cluster randomized design in twenty-six primary care practices. Multi-component implementation strategies will include facilitation, audit and feedback, and learning collaboratives. Ongoing data collection and analysis will be performed to optimize adoption of the intervention. The primary clinical outcome to test effectiveness is comprehensive breast cancer follow-up care. Implementation will be assessed using mixed methods to explore how organizational and contextual variables affect adoption, implementation, and early sustainability for provision of follow-up care, symptom, and risk management activities at six- and 12-months post implementation.

DISCUSSION

Study findings are poised to inform development of scalable, high impact intervention processes to enhance long-term follow-up care for patients with a history of breast cancer in primary care. If successful, next steps would include working with a national primary care practice-based research network to implement a national dissemination study. Actionable activities and processes identified could also be applied to development of organizational and care delivery interventions for follow-up care for other cancer sites.

TRIAL REGISTRATION

Registered with ClinicalTrials.gov on June 2, 2022: NCT05400941.

A Peer Data Benchmarking Intervention to Reduce Opioid Overprescribing: A Randomized Controlled Trial

BACKGROUND

Driving physician behavior change has been an elusive goal for quality improvement efforts aimed at reducing low-value care. We proposed the use of "nudge" interventions at the surgeon level in order to reduce post-surgical opioid overprescribing in accordance with consensus guidelines.

METHODS

We used 2017 Medicare data to identify outlier surgeons. A peer data benchmarking report that showed each surgeon the average number of opioid tablets they prescribed for an open inguinal hernia repair procedure from January 1, 2017 to December 31, 2017. We conducted a 1:1 randomized controlled trial providing outlier surgeons a report of their opioid prescribing patterns for a standard operation compared to the national average and prescribing guidelines.

RESULTS

There were 489 surgeons randomized to the intervention, of which 180 (36.8%) had data in the post-intervention period. Data was available for 87 surgeons in the intervention group and 93 surgeons in the control group. 97.7% of surgeons in the intervention group reduced their opioid prescribing pattern compared to 95.7% in the control group. Surgeons who received the data benchmarking report intervention prescribed 14.3% less opioids than surgeons in the control group (10.54 (SD 5.34) vs. 12.30 (SD 6.02), P = .04). The intervention was associated with a 1.83 lower mean number of opioid tablets prescribed per patient in the multivariable linear regression model after controlling for other factors (Intervention group vs. control group 95% CI [-3.61, -.04], P = .04).

DISCUSSION

The implementation of a peer data benchmarking intervention can drive physician behavior change towards high-value care.

Effect of a Performance Feedback Dashboard on Hospitalist Laboratory Test Utilization

BACKGROUND

Healthcare spending continues to be an area of improvement across all forms of medicine. Overtreatment or low-value care, including overutilization of laboratory testing, has an estimated annual cost of waste of $75.7-$101.2 billion annually. Providing performance feedback to hospitalists has been shown to be an effective way to encourage the practice of quality-improvement-focused medicine. There remains limited data regarding the implementation of performance feedback and direct results on hospital laboratory testing spending in the short term.

OBJECTIVE

The objective of this project was to identify whether performance-based feedback on laboratory utilization between both hospitalists and resident teams results in more conservative utilization of laboratory testing.

DESIGN, SETTING, PARTICIPANTS

This quality improvement project was conducted at a tertiary academic medical center, including both direct-care and house-staff teams.

INTERVENTION OR EXPOSURE

A weekly performance feedback report was generated and distributed to providers detailing laboratory test utilization by all hospitalists in a ranked system, normalized by the census of patients, for 3 months.

MAIN OUTCOMES AND MEASURES

The outcome measure was cumulative laboratory utilization during the intervention period compared to baseline utilization during the corresponding 3 months in the year prior and the weekly trend in laboratory utilization over 52 weeks. The aggregate laboratory utilization rate during intervention and control time periods was defined as the total number of laboratory tests ordered divided by the total number of patient encounters. Additionally, the cost difference was averaged per quarter and reported. The week-by-week trend in laboratory utilization was evaluated using a statistical process control (SPC) chart.

RESULTS

We found that following intervention during January-March 2020, the cumulative complete blood count utilization rate decreased from 5.54 to 4.83 per patient encounter and the basic metabolic panels/CMP utilization rate decreased from 6.65 to 6.11 per patient encounter compared with January-March 2019. This equated to cost savings of ~$42,700 in total for the quarter. Nonrandom variation was seen on SPC charts in weekly laboratory utilization rates for common laboratory tests during the intervention period.

CONCLUSIONS

We found that our intervention did result in a decrease in laboratory test utilization rates across direct-care and house-staff teams. This study lays promising groundwork for one tool that can be used to eliminate a source of hospital waste and improve the quality and efficiency of patient care.

Enhancing the appropriateness of eyecare delivery: the iCaretrack approach

Optometrists play an integral role in primary eyecare services, including prevention, diagnosis, and management of acute and chronic eye conditions. Therefore, it remains essential that the care they provide be timely and appropriate to ensure the best patient outcomes and optimal utilisation of resources. However, optometrists continuously face many challenges that can affect their ability to provide appropriate care (i.e., the care in line with evidence-based clinical practice guidelines). To address any resulting evidence-to-practice gaps, programs are needed that support and enable optometrists to adopt and utilise the best evidence in clinical practice. Implementation science is a field of research that can be applied to improving the adoption and maintenance of evidence-based practices in routine care, through systematic development and application of strategies or interventions to address barriers to evidence-based practice. This paper demonstrates an approach using implementation science to enhance optometric eyecare delivery. A brief overview of the methods used to identify existing gaps in appropriate eyecare delivery is presented. An outline of the process used to understand the behavioural barriers responsible for such gaps follows, involving theoretical models and frameworks. The resulting development of an online program for optometrists to enhance their capability, motivation, and opportunity to provide evidence-based eyecare is described, using the Behaviour Change Model and co-design methods. The importance of and methods used in evaluating such programs are also discussed. Finally, reflections on the experience and key learnings from the project are shared. While the paper focuses on experiences in improving glaucoma and diabetic eyecare in the Australian optometry context, this approach can be adapted to other conditions and contexts.

Adapting a quality improvement collaborative to a new national context: a co-design and feasibility study to improve dementia care in Ireland

BACKGROUND

Adaptation seeks to increase intervention fit with context, an important influence upon implementation. People with dementia in acute hospitals in Ireland do not routinely receive best care. To improve care in Ireland, we sought to adapt an existing quality improvement collaborative, to support the improvement capabilities of recipients of feedback from the Irish National Audit of Dementia.

METHODS

The study followed a staged process to co-design adaptations to reflect contextual differences between the English and the Irish healthcare systems, and to explore feasibility of the adapted Quality Improvement Collaborative in Ireland. We used co-design group meetings involving dementia clinicians from three hospitals, delivered the intervention virtually and interviewed healthcare workers from seven hospitals to adapt and explore the fidelity, affective response and reported appropriateness of the intervention.

RESULTS

The intervention required adaptation to reflect differences in strategic intention, ways of working and hospital social structures. There was evidence that the adapted intervention generated a positive affective response, was perceived as appropriate and led to fidelity of receipt and response.

CONCLUSION

We describe implications for the adaptation of interventions to increase participants' quality improvement capabilities and highlight the importance of socio-adaptive work. We propose further work to explore antecedents of senior positional leader engagement, to describe the delivery of intra-participant behaviour change techniques and to adapt the intervention to other clinical domains.

Types and effects of feedback for emergency ambulance staff: a systematic mixed studies review and meta-analysis

BACKGROUND

Extensive research has been conducted into the effects of feedback interventions within many areas of healthcare, but prehospital emergency care has been relatively neglected. Exploratory work suggests that enhancing feedback and follow-up to emergency medical service (EMS) staff might provide staff with closure and improve clinical performance. Our aim was to summarise the literature on the types of feedback received by EMS professionals and its effects on the quality and safety of patient care, staff well-being and professional development.

METHODS

A systematic review and meta-analysis, including primary research studies of any method published in peer-reviewed journals. Studies were included if they contained information on systematic feedback to emergency ambulance staff regarding their performance. Databases searched from inception were MEDLINE, Embase, AMED, PsycINFO, HMIC, CINAHL and Web of Science, with searches last updated on 2 August 2022. Study quality was appraised using the Mixed Methods Appraisal Tool. Data analysis followed a convergent integrated design involving simultaneous narrative synthesis and random effects multilevel meta-analyses.

RESULTS

The search strategy yielded 3183 articles, with 48 studies meeting inclusion criteria after title/abstract screening and full-text review. Interventions were categorised as audit and feedback (n=31), peer-to-peer feedback (n=3), postevent debriefing (n=2), incident-prompted feedback (n=1), patient outcome feedback (n=1) or a combination thereof (n=4). Feedback was found to have a moderate positive effect on quality of care and professional development with a pooled effect of d=0.50 (95% CI 0.34, 0.67). Feedback to EMS professionals had large effects in improving documentation (d=0.73 (0.00, 1.45)) and protocol adherence (d=0.68 (0.12, 1.24)), as well as small effects in enhancing cardiac arrest performance (d=0.46 (0.06, 0.86)), clinical decision-making (d=0.47 (0.23, 0.72)), ambulance times (d=0.43 (0.12, 0.74)) and survival rates (d=0.22 (0.11, 0.33)). The between-study heterogeneity variance was estimated at σ2=0.32 (95% CI 0.22, 0.50), with an I2 value of 99% (95% CI 98%, 99%), indicating substantial statistical heterogeneity.

CONCLUSION

This review demonstrated that the evidence base currently does not support a clear single point estimate of the pooled effect of feedback to EMS staff as a single intervention type due to study heterogeneity. Further research is needed to provide guidance and frameworks supporting better design and evaluation of feedback interventions within EMS.

PROSPERO REGISTRATION NUMBER

CRD42020162600.

Addressing the end-of-life actions in the National Safety and Quality Health Service Standards (2nd edn): a national survey

Objectives To describe current and planned processes and outcome measures to address implementation of the six end-of-life actions in the National Safety and Quality Health Service (NSQHS) Standards (2nd edn) and explore associated barriers and enablers. Methods This study used an exploratory mixed methods national survey of acute healthcare facilities between September 2018 and March 2019. This study involved public and private facilities (N  = 765) that provided end-of-life care, which are required to be accredited to the NSQHS Standards. Participants include those responsible for reporting implementation of end-of-life care actions at a facility providing end-of-life care. Participants were asked what processes and outcome measures were implemented or being planned to address the end-of-life care actions, and the associated barriers and enablers. Results Fifty respondents (6.5% response rate) from across Australia contributed data, reporting greater confidence in addressing Actions 5.16: Clinicians have access to Specialist Palliative Care Services; 5.17: Advance care plans can be received from patients and stored in medical records; and 5.18: Supervision and support is available for workforce providing end-of-life care. Barriers associated with the actions that were the most challenging to address included: competing clinical priorities, and insufficient resources to provide best practice end-of-life care; and the burdensome nature of conducting audits. Enablers included: (1) local, jurisdictional, and national strategic plans and policies; (2) support from Specialist Palliative Care Services; (3) access to resources and data; (4) standardised approaches to implementation and measuring outcomes; and (5) clinician, consumer and community engagement and education on end-of-life care. Conclusion Enablers and barriers in implementing the six end-of-life care actions were identified. Respondents reported that high-level support and direction, system-wide approaches, practical clinical support, and widespread community and clinician engagement would enable their facility to better address the end-of-life actions.

A Self-Sustaining Antibiotic Prophylaxis Program to Reduce Surgical Site Infections

Background: Our multi-institutional healthcare system had a higher-than-expected surgical site infection (SSI) rate. We aimed to improve our peri-operative antibiotic administration process. Gap analysis identified three opportunities for process improvement: standardized antibiotic selection, standardized second-line antibiotic agents for patients with allergies, and feedback regarding antibiotic administration compliance. Hypothesis: Implementation of a multifaceted quality improvement initiative including a near-real-time pre-operative antibiotic compliance feedback tool will improve compliance with antibiotic administration protocols, subsequently lowering SSI rate. Methods: A compliance feedback tool designed to provide monthly reports to all anesthesia and surgical personnel was implemented at two facilities, in September 2017 and December 2018. Internal case data were tracked for antibiotic compliance through June 2021, and these data were merged with American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) data at the case level to provide process and outcome measures for SSIs. Implementation success was evaluated by comparing protocol compliance and risk-adjusted rates of superficial and deep SSI before and after the quality improvement implementation. Results: A total of 20,385 patients were included in this study; 11,548 patients in the pre-implementation and 8,837 in the post-implementation groups. Baseline patient and operative characteristics were similar between groups, except the post-implementation group had a higher median expected SSI rate (2.2% vs. 1.6%). Post-implementation, antibiotic protocol compliance increased from 86.3% to 97.6%, and superficial and deep SSIs decreased from 2.8% to 1.9% (p < 0.001). The odds of superficial and deep SSI in patients in the post-implementation group was 0.69 (0.57, 0.83) times the odds of superficial and deep SSI in pre-implementation patients while adjusting for age, gender, diabetes mellitus, American Society of Anesthesiologists Physical Status (ASA) classification, wound class, smoking, and chronic obstructive pulmonary disease (COPD). Observed-to-expected ratios of superficial and deep SSI decreased from 0.82 to 0.48 after the intervention. Conclusions: Surgical antibiotic prophylaxis standardization and providing near-real-time individualized feedback resulted in sustained improvement in peri-operative antibiotic compliance rates and reduced superficial and deep SSIs.

Feasibility and Acceptability of an Online Oncologist Training to Optimize Oncologist-Patient Communication and Value-Concordant Care in Advanced Cancer

Introduction: This pilot study tested the feasibility and acceptability of a low-resource-intensive scalable online communication training designed to improve oncologists' skills in prognostic and value-concordant care discussions with advanced cancer patients. Methods: The training consisted of on-demand videos on how to convey prognostic information, manage patient emotions, and elicit patient values and incorporate these values into treatment decision making. Post-intervention, oncologists reported on their perceptions of the training. Results: Fifteen oncologists were enrolled, of whom, 13 completed the training, and 14 completed post-intervention interviews. Most oncologists reported the intervention was acceptable: 92.9% indicated the intervention was "moderately" to "very helpful"; 78.6% rated it as "somewhat" to "very much" impactful on their communication with patients. Conclusions: The present self-paced online communication training was acceptable to oncologists, supporting additional research, including evaluating intervention efficacy for improving oncologists' communication skills and value-concordant care in advanced cancer.

Impact of nonphysician, technology-guided alert level selection on rates of appropriate trauma triage in the United States: a before and after study

Purpose

Overtriage and undertriage rates are critical metrics in trauma, influenced by both trauma team activation (TTA) criteria and compliance with these criteria. Analysis of undertriaged patients at a level I trauma center revealed suboptimal compliance with existing criteria. This study assessed triage patterns after implementing compliance-focused process interventions.

Methods

A physician-driven, free-text alert system was modified to a nonphysician, hospital dispatcher-guided system. The latter employed dropdown menus to maximize compliance with criteria. The preintervention period included patients who presented between May 12, 2020, and December 31, 2020. The postintervention period incorporated patients who presented from May 12, 2021, through December 31, 2021. We evaluated appropriate triage, overtriage, and undertriage using the Standardized Trauma Assessment Tool. Statistical analyses were conducted with an α level of 0.05.

Results

The new system was associated with improved compliance with existing TTA criteria (from 70.3% to 79.3%, P=0.023) and decreased undertriage (from 6.0% to 3.2%, P=0.002) at the expense of increasing overtriage (from 46.6% to 57.4%, P<0.001), ultimately decreasing the appropriate triage rate (from 78.4% to 74.6%, P=0.007).

Conclusions

This study assessed a workflow change designed to improve compliance with TTA criteria. Improved compliance decreased undertriage to below the target threshold of 5%, albeit at the expense of increased overtriage. The decrease in appropriate triage despite compliance improvements suggests that the current criteria at this institution are not adequately tailored to optimally balance the minimization of undertriage and overtriage. This finding underscores the importance of improved compliance in evaluating the efficacy of TTA criteria.

Mortality in the Emergency Department and the Effectiveness of Conventional Safety Event Reporting

Background Patient mortality reviews identify care, system, and process deficiencies. Patient deaths undergo quarterly review in our academic emergency department (ED), whereas in other departments, mortality reviews are requested by the pronouncing physician within 24 hours. In the ED, individual physicians encounter barriers to 24-hour reviews, including feasibility, the perception of futility, re-exposure to traumatic events, and a high frequency of pre-hospital and non-preventable deaths. This quality review aimed to determine the preventable death rate, contributing factors to ED patient mortality, cases requiring further review, and the capture rate of individual case submissions into the patient safety reporting system. Methods A retrospective chart review was performed on all patient deaths occurring in our ED from July 2019 to February 2020. All patients 18 years or older who were pronounced dead in the ED during our data collection period were included. Patients declared deceased pre-hospital, on an inpatient floor, or in the operating room were excluded. Deaths were assessed for characteristics such as sex, presence of a pulse upon arrival, diagnostics and interventions performed, and whether the cause of death was traumatic or medical. Deaths were categorized on a 5-point Likert scale ranging from "not preventable" to "likely preventable." The presence or absence of contributing factors and the need for further review were recorded. Results Of the 166 reviewed cases, 87% (n=144) were non-preventable due to a terminal condition upon arrival, 12% (n=20) were non-preventable despite maximal efforts, 0.6% (n=1) were non-preventable despite a medical or systems error, and 0.6% (n=1) were possibly preventable due to a medical or systems error. No cases were definitively preventable. Only 1.2% (n=2) of cases required further safety review. In 55% (n=91) of cases, the patient arrived without a pulse. Medical deaths (60%, n=100) outnumbered traumatic deaths (39%, n=64). The most utilized diagnostic test was ultrasound (67%, n=111), and the most utilized intervention was advanced cardiac life support (59%, n=98). Conclusion There is a high prevalence of unpreventable deaths in the ED (99%, n=164). Only two cases (1.2%) were identified for further patient safety review. Standard safety event reporting practices correctly identified all possibly preventable ED deaths.

A cluster randomised controlled trial, process and economic evaluation of quality improvement collaboratives aligned to a national audit to improve the care for people with diabetes (EQUIPD): study protocol

BACKGROUND

People with type 1 diabetes and raised glucose levels are at greater risk of retinopathy, nephropathy, neuropathy, cardiovascular disease, sexual health problems and foot disease. The UK National Institute for Health and Care Excellence (NICE) recommends continuous subcutaneous 'insulin pump' therapy for people with type 1 diabetes whose HbA1c is above 69 mmol/mol. Insulin pump use can improve quality of life, cut cardiovascular risk and increase treatment satisfaction. About 90,000 people in England and Wales meet NICE criteria for insulin pumps but do not use one. Insulin pump use also varies markedly by deprivation, ethnicity, sex and location. Increasing insulin pump use is a key improvement priority. Audit and feedback is a common but variably effective intervention. Limited capabilities of healthcare providers to mount effective responses to feedback from national audits, such as the National Diabetes Audit (NDA), undermines efforts to improve care. We have co-developed a theoretically and empirically informed quality improvement collaborative (QIC) to strengthen local responses to feedback with patients and carers, national audits and healthcare providers. We will evaluate whether the QIC improves the uptake of insulin pumps following NDA feedback.

METHODS

We will undertake an efficient cluster randomised trial using routine data. The QIC will be delivered alongside the NDA to specialist diabetes teams in England and Wales. Our primary outcome will be the proportion of people with type 1 diabetes and an HbA1c above 69 mmol/mol who start and continue insulin pump use during the 18-month intervention period. Secondary outcomes will assess change in glucose control and duration of pump use. Subgroup analyses will explore impacts upon inequalities by ethnicity, sex, age and deprivation. A theory-informed process evaluation will explore diabetes specialist teams' engagement, implementation, fidelity and tailoring through observations, interviews, surveys and documentary analysis. An economic evaluation will micro-cost the QIC, estimate cost-effectiveness of NDA feedback with QIC and estimate the budget impact of NHS-wide QIC roll out.

DISCUSSION

Our study responds to a need for more head-to-head trials of different ways of reinforcing feedback delivery. Our findings will have implications for other large-scale audit and feedback programmes.

TRIAL REGISTRATION

ISRCTN82176651 Registered 18 October 2022.

Development of a conceptual framework to scale up co-managed care for older patients with hip fracture in China: a qualitative study

BACKGROUND

Hip fracture creates a major burden on society due to high mortality, loss of independence and excess medical costs for older people. A multidisciplinary co-managed model of care is widely considered as the best practice for the management of older patients with hip fracture. The study aims to develop a conceptual framework to inform the future scale-up of this model of care through the identification of barriers and enablers that may influence successful uptake.

METHODS

This qualitative study was conducted within an interventional study, which aimed to test the effectiveness of co-managed model of care for older patients with hip fracture. Health providers and health administrators from three hospitals were purposively selected and interviewed in-depth. The Consolidated Framework for Implementation Research (CFIR) was used to develop interview guides, collect and analyse data. Inductive and deductive approaches were used to generate enablers or barriers, aligned with the CFIR constructs. All barriers or enablers were inductively summarised to a conceptual framework with essential components to guide the implementation of co-managed model of care in other hospitals.

RESULTS

A total of 13 health providers and 3 health administrators were recruited. The main barriers to co-managed care implementation included perceived complexity of implementation, insufficient international collaboration and incentives, the absence of national guideline support and lack of digital health applications for communication between health providers, insufficient number of health providers and beds, and poor understanding about the effectiveness of this care model. A conceptual framework for future scale-up was then developed, consisting of the following essential components: hospital authority support, enabling environment, adequate number of beds, sufficient and skilled health providers, use of digital health technology, regular quality supervision, evaluation and feedback, and external collaborations.

CONCLUSIONS

Despite the complexity of the intervention, the co-managed model of care has the potential to be implemented and promoted in China and in similar settings, although there is a need to demonstrate feasibility in different settings.

Using audit and feedback to guide tailored implementations of measurement-based care in community mental health: a multiple case study

BACKGROUND

Audit and feedback (A&F) is an implementation strategy that can facilitate implementation tailoring by identifying gaps between desired and actual clinical care. While there are several theory-based propositions on which A&F components lead to better implementation outcomes, many have not been empirically investigated, and there is limited guidance for stakeholders when applying A&F in practice. The current study aims to illustrate A&F procedures in six community mental health clinics, with an emphasis on reporting A&F components that are relevant to theories of how feedback elicits behavior change.

METHODS

Six clinics from a larger trial using a tailored approach to implement measurement-based care (MBC) were analyzed for feedback content, delivery mechanisms, barriers to feedback, and outcomes of feedback using archival data. Pattern analysis was conducted to examine relations between A&F components and changes in MBC use.

RESULTS

Several sites utilized both aggregate and individualized data summaries, and data accuracy concerns were common. Feedback cycles featuring individual-level clinician data, data relevant to MBC barriers, and information requested by data recipients were related to patterns of increased MBC use.

CONCLUSIONS

These findings support extant theory, such as Feedback Intervention Theory. Mental health professionals wishing to apply A&F should consider establishing reciprocal feedback mechanisms on the quality and amount of data being received and adopting specific roles communicating and addressing data quality concerns.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02266134.

Taking the first step: protocol for a cluster randomised implementation trial comparing strategies on access to exercise programmes for people with knee osteoarthritis

INTRODUCTION

This cluster randomised implementation trial will assess the effect of two behavioural change interventions on the proportion of people with structural knee osteoarthritis (OA) referred and attending exercise-based professionals (physiotherapists and exercise physiologists). The interventions are designed to increase awareness of guidelines, benefits and access pathways for exercise therapy. We hypothesise either strategy will result in more people with knee OA being referred and attending physiotherapy/exercise physiology than current standard of care.

METHODS AND ANALYSIS

We will recruit 30 radiology clinics. 10 clinics will be randomly assigned to each trial arm with 1020 people with knee OA consecutively recruited (102 people per practice) into each arm. Intervention arm 1 is an educational reminder message targeted at primary care practitioners with a hyperlink to national guidelines regarding knee OA clinical management. It will be included in the reporting template of a plain knee X-ray. Intervention arm 2 is the reminder message and a patient-facing infographic explaining the benefits and access pathways for exercise. Both interventions will be delivered once, by the radiology clinics, when a person undergoes plain X-ray for non-traumatic knee pain/dysfunction. The primary outcome is referral to physiotherapist/exercise physiology. The secondary outcome is attendance to that appointment. Both outcomes are self-reported via an online survey administered 4 weeks after the X-ray. Additional survey questions explore facilitators and barriers to appointment attendance and acceptability of the interventions. A subsample of the intervention groups will be recruited for semistructured telephone-based interviews to further explore these latter outcomes.

ETHICS AND DISSEMINATION

The study protocol was approved by Macquarie University Human Research Ethics Committee (#520221190343842) and prospectively registered with the Australian New Zealand Clinical Trials Registry. The findings of the trial will be disseminated through peer-reviewed scientific journals and conferences. We will engage with Australian physician colleges and main-stream media to distribute findings.

TRIAL REGISTRATION NUMBER

ACTRN12622001414707p.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: study protocol for a hybrid type 2 effectiveness-implementation cluster-randomized trial using train-the-trainer

BACKGROUND

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes and (b) providers' perceptions of fit.

METHODS

TTT will be implemented in nine CMHCs in California, USA (N = 60 providers; N = 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality), and (3) evaluate other possible moderators.

DISCUSSION

This trial has potential to (a) inform the process of embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) add to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advance our understanding of providers' perceptions of EBPT "fit" across TTT generations.

TRIAL REGISTRATION

ClinicalTrials.gov identifier NCT05805657 . Registered on April 10, 2023.

Best practice guidance for antibiotic audit and feedback interventions in primary care: a modified Delphi study from the Joint Programming Initiative on Antimicrobial resistance: Primary Care Antibiotic Audit and Feedback Network (JPIAMR-PAAN)

BACKGROUND

Primary care is a critical partner for antimicrobial stewardship efforts given its high human antibiotic usage. Peer comparison audit and feedback (A&F) is often used to reduce inappropriate antibiotic prescribing. The design and implementation of A&F may impact its effectiveness. There are no best practice guidelines for peer comparison A&F in antibiotic prescribing in primary care.

OBJECTIVE

To develop best practice guidelines for peer comparison A&F for antibiotic prescribing in primary care in high income countries by leveraging international expertise via the Joint Programming Initiative on Antimicrobial Resistance-Primary Care Antibiotic Audit and Feedback Network.

METHODS

We used a modified Delphi process to achieve convergence of expert opinions on best practice statements for peer comparison A&F based on existing evidence and theory. Three rounds were performed, each with online surveys and virtual meetings to enable discussion and rating of each best practice statement. A five-point Likert scale was used to rate consensus with a median threshold score of 4 to indicate a consensus statement.

RESULTS

The final set of guidelines include 13 best practice statements in four categories: general considerations (n = 3), selecting feedback recipients (n = 1), data and indicator selection (n = 4), and feedback delivery (n = 5).

CONCLUSION

We report an expert-derived best practice recommendations for designing and evaluating peer comparison A&F for antibiotic prescribing in primary care. These 13 statements can be used by A&F designers to optimize the impact of their quality improvement interventions, and improve antibiotic prescribing in primary care.

Professional medical education approaches: mobilizing evidence for clinicians

Rapidly proliferating high-quality evidence supports daily decision-making in clinical practice. Continuing professional medical education links this evidence to practicing clinicians who are strongly motivated to improve the quality of their care by using the latest information. Approaches to professional education vary, and their effects depend on specific scenarios. This narrative review summarizes the main approaches for professional medical education that facilitate the mobilization of evidence for clinicians. It includes traditional learning (passive and active dissemination of educational materials, lectures, and mass media dissemination), constructivist learning (engaging in local consensus processes and education outreach visits, interfacing with local opinion leaders, conducting patient-mediated interventions, employing audit and feedback processes, and utilizing clinical decision-supporting systems), and blended learning approaches (the integration of in-person or online passive learning with active and creative learning by the learners). An optimized selection from these approaches is challenging but critical to clinicians and healthcare systems.

Process, structural, and outcome quality indicators to support perioperative opioid stewardship: a rapid review

Opioids are effective analgesics but can cause harm. Opioid stewardship is key to ensuring that opioids are used effectively and safely. There is no agreed set of quality indicators relating to the use of opioids perioperatively. This work is part of the Yorkshire Cancer Research Bowel Cancer Quality Improvement programme and aims to develop useful quality indicators for the improvement of care and patient outcomes at all stages of the perioperative journey.A rapid review was performed to identify original research and reviews in which quality indicators for perioperative opioid use are described. A data tool was developed to enable reliable and reproducible extraction of opioid quality indicators.A review of 628 abstracts and 118 full-text publications was undertaken. Opioid quality indicators were identified from 47 full-text publications. In total, 128 structure, process and outcome quality indicators were extracted. Duplicates were merged, with the final extraction of 24 discrete indicators. These indicators are based on five topics: patient education, clinician education, pre-operative optimization, procedure, and patient-specific prescribing and de-prescribing and opioid-related adverse drug events.The quality indicators are presented as a toolkit to contribute to practical opioid stewardship. Process indicators were most commonly identified and contribute most to quality improvement. Fewer quality indicators relating to intraoperative and immediate recovery stages of the patient journey were identified. An expert clinician panel will be convened to agree which of the quality indicators identified will be most valuable in our region for the management of patients undergoing surgery for bowel cancer.

Evaluating the effectiveness of a multifaceted intervention to reduce low-value care in adults hospitalized following trauma: a protocol for a pragmatic cluster randomized controlled trial

BACKGROUND

While simple Audit & Feedback (A&F) has shown modest effectiveness in reducing low-value care, there is a knowledge gap on the effectiveness of multifaceted interventions to support de-implementation efforts. Given the need to make rapid decisions in a context of multiple diagnostic and therapeutic options, trauma is a high-risk setting for low-value care. Furthermore, trauma systems are a favorable setting for de-implementation interventions as they have quality improvement teams with medical leadership, routinely collected clinical data, and performance-linked to accreditation. We aim to evaluate the effectiveness of a multifaceted intervention for reducing low-value clinical practices in acute adult trauma care.

METHODS

We will conduct a pragmatic cluster randomized controlled trial (cRCT) embedded in a Canadian provincial quality assurance program. Level I-III trauma centers (n = 30) will be randomized (1:1) to receive simple A&F (control) or a multifaceted intervention (intervention). The intervention, developed using extensive background work and UK Medical Research Council guidelines, includes an A&F report, educational meetings, and facilitation visits. The primary outcome will be the use of low-value initial diagnostic imaging, assessed at the patient level using routinely collected trauma registry data. Secondary outcomes will be low-value specialist consultation, low-value repeat imaging after a patient transfer, unintended consequences, determinants for successful implementation, and incremental cost-effectiveness ratios.

DISCUSSION

On completion of the cRCT, if the intervention is effective and cost-effective, the multifaceted intervention will be integrated into trauma systems across Canada. Medium and long-term benefits may include a reduction in adverse events for patients and an increase in resource availability. The proposed intervention targets a problem identified by stakeholders, is based on extensive background work, was developed using a partnership approach, is low-cost, and is linked to accreditation. There will be no attrition, identification, or recruitment bias as the intervention is mandatory in line with trauma center designation requirements, and all outcomes will be assessed with routinely collected data. However, investigators cannot be blinded to group allocation and there is a possibility of contamination bias that will be minimized by conducting intervention refinement only with participants in the intervention arm.

TRIAL REGISTRATION

This protocol has been registered on ClinicalTrials.gov (February 24, 2023, # NCT05744154 ).

Identifying Quality Indicators for the Care of Hospitalized Injured Older Adults: A Scoping Review of the Literature

OBJECTIVES

Older adults represent more than 50% of trauma admissions in many high-income countries. Furthermore, they are at increased risk for complications, resulting in worse health outcomes than younger adults and a significant health care utilization burden. Quality indicators (QIs) are used to assess the quality of care in trauma systems, but few QIs reflect responses to older patients' specific needs. We aimed to (1) identify QIs used to assess acute hospital care for injured older patients, (2) assess support for identified QIs and, (3) identify gaps in existing QIs.

DESIGN

Scoping review of the scientific and gray literature.

METHODS

Selection and data extraction were performed by 2 independent reviewers. The level of support was assessed by the number of sources reporting QIs and whether they were developed according to scientific evidence, expert consensus, and patients' perspectives.

RESULTS

Of 10,855 identified studies, 167 were eligible. Among 257 different QIs identified, 52% were hip fracture specific. Gaps were identified for head injuries, rib, and pelvic ring fractures. Although 61% of QIs assessed care processes, 21% and 18% focused on structures and outcomes, respectively. Although most QIs were based on literature reviews and/or expert consensus, patients' perspective was rarely accounted for. The 15 QIs with the highest level of support included minimum time between emergency department arrival and ward admission, minimum time to surgery for fractures, assessment by a geriatrician, orthogeriatric review for hip fracture patients, delirium screening, prompt and appropriate analgesia, early mobilizations, and physiotherapy.

CONCLUSION AND IMPLICATIONS

Multiple QIs were identified, but their level of support was limited, and important gaps were identified. Future work should focus on achieving consensus for a set of QIs to assess the quality of trauma care to older adults. Such QIs could be used for quality improvement and ultimately improve outcomes for injured older adults.

Feedback on audit and action planning for dental caries control: a qualitative study to investigate the acceptability among interdisciplinary pediatric dental care teams

Introduction

American Indian and Alaska Native children suffer from the poorest oral health of all populational groups in the United States. Evidence-based practices (EBP) for caries control are well established, but systematically implementing such practices have proven difficult. Audit and feedback with goal setting, and action planning to implement these EBPs have not been tested or adapted for Alaska Native healthcare settings. The aim of this study was to investigate acceptability and perceived feasibility of an audit and feedback intervention for pediatric dental caries control among dental providers and patient stakeholders.

Methods

The pilot program was implemented in two dental clinics from a tribal healthcare consortium in Alaska. Key-informant interviews were conducted to investigate the contextual, organizational, and behavioral facilitators and barriers to the implementation and expansion of the program. Interview transcripts were analyzed by two researchers using thematic analysis.

Results

Eight key informants were interviewed twice (during and after the intervention period), and one once, for a total of 17 interviews. Patient stakeholders were not interviewed due to COVID-19 pandemic clinic closures and social isolation mandates. Three principal themes emerged: a positive organizational climate and culture fostered the acceptability of the program, the positive impacts of the program observed in the pediatric dental teams and the organization, and the challenges to implement the program including understanding the data reports, trusting the accuracy of the data, and competing priorities.

Conclusions

The intervention of audit and feedback with goal setting and action planning was well accepted and perceived as feasible by the study participants given the financial and human resources provided by the research project. This qualitative study can inform the design and evaluation of process-oriented implementation strategies geared towards decreasing health inequities and improving health outcomes, such as dental caries in American Indian and Alaska Native children and adolescents.

Potential social marketing applications for knowledge translation in healthcare: a scoping review protocol

INTRODUCTION

Knowledge translation has emerged as a practice and a science to bridge the gap between evidence and practice in healthcare. While the field has appropriately borrowed from other related fields to advance its science, there remain fields less mined. One such field with potential relevance to knowledge translation, but limited application to date, is social marketing. This review aims to determine elements of social marketing interventions that could be applied to knowledge translation science. Our objectives are to: (1) summarise the types of studies that have tested social marketing interventions in controlled intervention study designs; (2) describe the social marketing interventions and their effects; and (3) propose strategies for the integration of social marketing interventions into knowledge translation science.

METHODS AND ANALYSIS

This scoping review will be conducted using the Joanna Briggs Institute Methodological Guidance. For the first and second objectives, all English-language studies published from 1971 onwards will be included if they (1) used a randomised or non-randomised controlled intervention design, and (2) tested a social marketing intervention as defined by five essential social marketing criteria. The research team will address the third objective through discussion and consensus. All screening and extraction will be performed independently by two reviewers. Variables extracted will include intervention details using essential and desirable social marketing criteria and the context, mechanism and outcomes of the interventions.

ETHICS AND DISSEMINATION

This project is a secondary analysis of published papers and does not require ethics approval. We will disseminate our review outputs in knowledge translation journals and present at relevant conferences across the spectrum of the field. We will produce a short and long version of a plain language summary that will be tailored to various groups including implementation scientists and quality improvement researchers.

REGISTRATION DETAILS

Open Science Framework Registration link: osf.io/6q834.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: Study protocol for a hybrid type 2 effectiveness-implementation cluster- randomized trial using train-the-trainer

Background

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes (b) providers' perceptions of fit.

Methods

TTT will be implemented in nine CMHCs in California, United States (N= 60 providers; N= 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will: (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality); and (3) evaluate other possible moderators.

Discussion

This trial has potential to inform the process of (a) embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) adding to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advancing our understanding of providers' perceptions of EBPT 'fit' across TTT generations.

Trial registration

Clinicaltrials.gov identifier: NCT05805657. Registered on April 10, 2023. https://clinicaltrials.gov/ct2/show/NCT05805657.

Audit, Feedback, and Education to Improve Quality and Outcomes in Transurethral Resection and Single-Instillation Intravesical Chemotherapy for Nonmuscle Invasive Bladder Cancer Treatment: Protocol for a Multicenter International Observational Study With an Embedded Cluster Randomized Trial

BACKGROUND

Nonmuscle invasive bladder cancer (NMIBC) accounts for 75% of bladder cancers. It is common and costly. Cost and detriment to patient outcomes and quality of life are driven by high recurrence rates and the need for regular invasive surveillance and repeat treatments. There is evidence that the quality of the initial surgical procedure (transurethral resection of bladder tumor [TURBT]) and administration of postoperative bladder chemotherapy significantly reduce cancer recurrence rates and improve outcomes (cancer progression and mortality). There is surgeon-reported evidence that TURBT practice varies significantly across surgeons and sites. There is limited evidence from clinical trials of intravesical chemotherapy that NMIBC recurrence rate varies significantly between sites and that this cannot be accounted for by differences in patient, tumor, or adjuvant treatment factors, suggesting that how the surgery is performed may be a reason for the variation.

OBJECTIVE

This study primarily aims to determine if feedback on and education about surgical quality indicators can improve performance and secondarily if this can reduce cancer recurrence rates. Planned secondary analyses aim to determine what surgeon, operative, perioperative, institutional, and patient factors are associated with better achievement of TURBT quality indicators and NMIBC recurrence rates.

METHODS

This is an observational, international, multicenter study with an embedded cluster randomized trial of audit, feedback, and education. Sites will be included if they perform TURBT for NMIBC. The study has four phases: (1) site registration and usual practice survey; (2) retrospective audit; (3) randomization to audit, feedback, and education intervention or to no intervention; and (4) prospective audit. Local and national ethical and institutional approvals or exemptions will be obtained at each participating site.

RESULTS

The study has 4 coprimary outcomes, which are 4 evidence-based TURBT quality indicators: a surgical performance factor (detrusor muscle resection); an adjuvant treatment factor (intravesical chemotherapy administration); and 2 documentation factors (resection completeness and tumor features). A key secondary outcome is the early cancer recurrence rate. The intervention is a web-based surgical performance feedback dashboard with educational and practical resources for TURBT quality improvement. It will include anonymous site and surgeon-level peer comparison, a performance summary, and targets. The coprimary outcomes will be analyzed at the site level while recurrence rate will be analyzed at the patient level. The study was funded in October 2020 and began data collection in April 2021. As of January 2023, there were 220 hospitals participating and over 15,000 patient records. Projected data collection end date is June 30, 2023.

CONCLUSIONS

This study aims to use a distributed collaborative model to deliver a site-level web-based performance feedback intervention to improve the quality of endoscopic bladder cancer surgery. The study is funded and projects to complete data collection in June 2023.

TRIAL REGISTRATION

ClinicalTrials.org NCT05154084; https://clinicaltrials.gov/ct2/show/NCT05154084.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/42254.

Decision-making on the fly: a qualitative study of physicians in out-of-hospital emergency medical services

BACKGROUND

Out-of-hospital Emergency Medical Services (OHEMS) require fast and accurate assessment of patients and efficient clinical judgment in the face of uncertainty and ambiguity. Guidelines and protocols can support staff in these situations, but there is significant variability in their use. Therefore, the aim of this study was to increase our understanding of physician decision-making in OHEMS, in particular, to characterize the types of decisions made and to explore potential facilitating and hindering factors.

METHODS

Qualitative interview study of 21 physicians in a large, publicly-owned and operated OHEMS in Croatia. Data was subjected to an inductive content analysis.

RESULTS

Physicians (mostly young, female, and early in their career), made three decisions (transport, treat, and if yes on either, how) after an initial patient assessment. Decisions were influenced by patient needs, but to a greater extent by factors related to themselves and patients (microsystem), their organization (mesosystem), and the larger health system (macrosystem). This generated a high variability in quality and outcomes. Participants desired support through further training, improved guidelines, formalized feedback, supportive management, and health system process redesign to better coordinate and align care across organizational boundaries.

CONCLUSIONS

The three decisions were made complex by contextual factors that largely lay outside physician control at the mesosystem level. However, physicians still took personal responsibility for concerns more suitably addressed at the organizational level. This negatively impacted care quality and staff well-being. If managers instead adopt a learning orientation, the path from novice to expert physician could be more ably supported through organizational demands and practices aligned with real-world practice. Questions remain on how managers can better support the learning needed to improve quality, safety, and physicians' journey from novice to expert.

Qualitative study of international key informants' perspectives on the current and future state of healthcare quality measurement and feedback

OBJECTIVES

The aim of this study is to explore the current and future state of quality measurement and feedback and identify factors influencing measurement feedback systems, including the barriers and enablers to their effective design, implementation, use and translation into quality improvement.

DESIGN

This qualitative study used semistructured interviews with key informants. A deductive framework analysis was conducted to code transcripts to the Theoretical Domains Framework (TDF). An inductive analysis was used to produce subthemes and belief statements within each TDF domain.

SETTING

All interviews were conducted by videoconference and audio-recorded.

PARTICIPANTS

Key informants were purposively sampled experts in quality measurement and feedback, including clinical (n=5), government (n=5), research (n=4) and health service leaders (n=3) from Australia (n=7), the USA (n=4), the UK (n=2), Canada (n=2) and Sweden (n=2).

RESULTS

A total of 17 key informants participated in the study. The interview length ranged from 48 to 66 min. 12 theoretical domains populated by 38 subthemes were identified as relevant to measurement feedback systems. The most populous domains included environmental context and resources, memory, attention and decision-making, and social influences. The most populous subthemes included 'quality improvement culture', 'financial and human resource support' and 'patient-centred measurement'. There were minimal conflicting beliefs outside of 'data quality and completeness'. Conflicting beliefs in these subthemes were predominantly between government and clinical leaders.

CONCLUSIONS

Multiple factors were found to influence measurement feedback systems and future considerations are presented within this manuscript. The barriers and enablers that impact these systems are complex. While there are some clear modifiable factors in the design of measurement and feedback processes, influential factors described by key informants were largely socioenvironmental. Evidence-based design and implementation, coupled with a deeper understanding of the implementation context, may lead to enhanced quality measurement feedback systems and ultimately improved care delivery and patient outcomes.

Enhancing the quality of psychological interventions delivered by telephone in mental health services: increasing the likelihood of successful implementation using a theory of change

BACKGROUND

The implementation of new and complex interventions in mental health settings can be challenging. This paper explores the use of a Theory of Change (ToC) for intervention design and evaluation to increase the likelihood of complex interventions being effective, sustainable, and scalable. Our intervention was developed to enhance the quality of psychological interventions delivered by telephone in primary care mental health services.

METHODS

A ToC represents how our designed quality improvement intervention targeting changes at service, practitioner, and patient levels was expected to improve engagement in, and the quality of, telephone-delivered psychological therapies. The intervention was evaluated following implementation in a feasibility study within three NHS Talking Therapies services through a qualitative research design incorporating semi-structured interviews and a focus group with key stakeholders (patients, practitioners, and service leads) (N = 15). Data were analysed using the Consolidated Framework for Implementation Research (CFIR) and the ToC was examined and modified accordingly following the findings.

RESULTS

CFIR analysis highlighted a set of challenges encountered during the implementation of our service quality improvement telephone intervention that appeared to have weakened the contribution to the change mechanisms set out by the initial ToC. Findings informed changes to the intervention and refinement of the ToC and are expected to increase the likelihood of successful future implementation in a randomised controlled trial.

CONCLUSIONS

Four key recommendations that could help to optimise implementation of a complex intervention involving different key stakeholder groups in any setting were identified. These include: 1-developing a good understanding of the intervention and its value among those receiving the intervention; 2-maximising engagement from key stakeholders; 3-ensuring clear planning and communication of implementation goals; and 4-encouraging the use of strategies to monitor implementation progress.

A prospective cluster trial to increase antibiotic prescription quality in seven non-ICU wards

Aim

To evaluate general shortcomings and faculty-specific pitfalls as well as to improve antibiotic prescription quality (ABQ) in non-ICU wards, we performed a prospective cluster trial.

Methods

An infectious-disease (ID) consulting service performed a prospective investigation consisting of three 12-week phases with point prevalence evaluation conducted once per week (=36 evaluations in total) at seven non-ICU wards, followed by assessment of sustainability (weeks 37-48). Baseline evaluation (phase 1) defined multifaceted interventions by identifying the main shortcomings. Then, to distinguish intervention from time effects, the interventions were performed in four wards, and the 3 remaining wards served as controls; after assessing effects (phase 2), the same interventions were performed in the remaining wards to test the generalizability of the interventions (phase 3). The prolonged responses after all interventions were then analyzed in phase 4. ABQ was evaluated by at least two ID specialists who assessed the indication for therapy, the adherence to the hospital guidelines for empirical therapy, and the overall antibiotic prescription quality.

Results

In phase 1, 406 of 659 (62%) patients cases were adequately treated with antibiotics; the main reason for inappropriate prescription was the lack of an indication (107/253; 42%). The antibiotic prescription quality (ABQ) significantly increased, reaching 86% in all wards after the focused interventions (502/584; nDf=3, ddf=1,697, F=6.9, p=0.0001). In phase 2 the effect was only seen in wards that already participated in interventions (248/347; 71%). No improvement was seen in wards that received interventions only after phase 2 (189/295; 64%). A given indication significantly increased from about 80% to more than 90% (p<.0001). No carryover effects were observed.

Discussion

ABQ can be improved significantly by intervention bundles with apparent sustainable effects.

The use of plain radiography in diagnosing osteoarthritis: A systematic review and time trend analysis

INTRODUCTION

The National Institute for Health and Care Excellence (NICE) suggest there is no role for routine radiography in the diagnosis of osteoarthritis (OA). It is not known how consistent this recommendation is across international guidelines, or the impact of UK guidance on domestic OA X-ray request rates.

METHODS

A systematic search identified guideline recommendations on the role of radiography in OA diagnosis. Full texts underwent dual screening and appraisal using the AGREE II tool. A narrative synthesis was performed. Consultation data were extracted from a UK primary care database: the Consultations in Primary Care Archives (CiPCA). The annual proportion of X-ray requests per 100 OA consulters from 2000 to 2012 were calculated. Joinpoint regression analysis examined if there were changes in the trend of X-ray request rates and compared these with the publication dates of UK guidelines.

RESULTS

Eighteen evidence-based OA guidelines were included in the review. Eleven recommended a clinical diagnosis of OA without radiographic confirmation. Seven recommended routine radiography; these guidelines were predominantly for radiologists. A mean of 17.3 X-rays per 100 patients were requested in patients consulting for OA per year between 2000 and 2012. A statistically significant reduction in X-ray request rates was seen in 2003.

CONCLUSION

Recommendations on the role of radiography in OA vary between medical specialty and countries. UK guidelines appear to have had a limited impact on X-ray request rates in OA.

Quality improvement strategies for diabetes care: Effects on outcomes for adults living with diabetes

BACKGROUND

There is a large body of evidence evaluating quality improvement (QI) programmes to improve care for adults living with diabetes. These programmes are often comprised of multiple QI strategies, which may be implemented in various combinations. Decision-makers planning to implement or evaluate a new QI programme, or both, need reliable evidence on the relative effectiveness of different QI strategies (individually and in combination) for different patient populations.

OBJECTIVES

To update existing systematic reviews of diabetes QI programmes and apply novel meta-analytical techniques to estimate the effectiveness of QI strategies (individually and in combination) on diabetes quality of care.

SEARCH METHODS

We searched databases (CENTRAL, MEDLINE, Embase and CINAHL) and trials registers (ClinicalTrials.gov and WHO ICTRP) to 4 June 2019. We conducted a top-up search to 23 September 2021; we screened these search results and 42 studies meeting our eligibility criteria are available in the awaiting classification section.

SELECTION CRITERIA

We included randomised trials that assessed a QI programme to improve care in outpatient settings for people living with diabetes. QI programmes needed to evaluate at least one system- or provider-targeted QI strategy alone or in combination with a patient-targeted strategy. - System-targeted: case management (CM); team changes (TC); electronic patient registry (EPR); facilitated relay of clinical information (FR); continuous quality improvement (CQI). - Provider-targeted: audit and feedback (AF); clinician education (CE); clinician reminders (CR); financial incentives (FI). - Patient-targeted: patient education (PE); promotion of self-management (PSM); patient reminders (PR). Patient-targeted QI strategies needed to occur with a minimum of one provider or system-targeted strategy.

DATA COLLECTION AND ANALYSIS

We dual-screened search results and abstracted data on study design, study population and QI strategies. We assessed the impact of the programmes on 13 measures of diabetes care, including: glycaemic control (e.g. mean glycated haemoglobin (HbA1c)); cardiovascular risk factor management (e.g. mean systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), proportion of people living with diabetes that quit smoking or receiving cardiovascular medications); and screening/prevention of microvascular complications (e.g. proportion of patients receiving retinopathy or foot screening); and harms (e.g. proportion of patients experiencing adverse hypoglycaemia or hyperglycaemia). We modelled the association of each QI strategy with outcomes using a series of hierarchical multivariable meta-regression models in a Bayesian framework. The previous version of this review identified that different strategies were more or less effective depending on baseline levels of outcomes. To explore this further, we extended the main additive model for continuous outcomes (HbA1c, SBP and LDL-C) to include an interaction term between each strategy and average baseline risk for each study (baseline thresholds were based on a data-driven approach; we used the median of all baseline values reported in the trials). Based on model diagnostics, the baseline interaction models for HbA1c, SBP and LDL-C performed better than the main model and are therefore presented as the primary analyses for these outcomes. Based on the model results, we qualitatively ordered each QI strategy within three tiers (Top, Middle, Bottom) based on its magnitude of effect relative to the other QI strategies, where 'Top' indicates that the QI strategy was likely one of the most effective strategies for that specific outcome. Secondary analyses explored the sensitivity of results to choices in model specification and priors.  Additional information about the methods and results of the review are available as Appendices in an online repository. This review will be maintained as a living systematic review; we will update our syntheses as more data become available.

MAIN RESULTS

We identified 553 trials (428 patient-randomised and 125 cluster-randomised trials), including a total of 412,161 participants. Of the included studies, 66% involved people living with type 2 diabetes only. Participants were 50% female and the median age of participants was 58.4 years. The mean duration of follow-up was 12.5 months. HbA1c was the commonest reported outcome; screening outcomes and outcomes related to cardiovascular medications, smoking and harms were reported infrequently. The most frequently evaluated QI strategies across all study arms were PE, PSM and CM, while the least frequently evaluated QI strategies included AF, FI and CQI. Our confidence in the evidence is limited due to a lack of information on how studies were conducted.  Four QI strategies (CM, TC, PE, PSM) were consistently identified as 'Top' across the majority of outcomes. All QI strategies were ranked as 'Top' for at least one key outcome. The majority of effects of individual QI strategies were modest, but when used in combination could result in meaningful population-level improvements across the majority of outcomes. The median number of QI strategies in multicomponent QI programmes was three.  Combinations of the three most effective QI strategies were estimated to lead to the below effects:  - PR + PSM + CE: decrease in HbA1c by 0.41% (credibility interval (CrI) -0.61 to -0.22) when baseline HbA1c < 8.3%; - CM + PE + EPR: decrease in HbA1c by 0.62% (CrI -0.84 to -0.39) when baseline HbA1c > 8.3%;  - PE + TC + PSM: reduction in SBP by 2.14 mmHg (CrI -3.80 to -0.52) when baseline SBP < 136 mmHg; - CM + TC + PSM: reduction in SBP by 4.39 mmHg (CrI -6.20 to -2.56) when baseline SBP > 136 mmHg;  - TC + PE + CM: LDL-C lowering of 5.73 mg/dL (CrI -7.93 to -3.61) when baseline LDL < 107 mg/dL; - TC + CM + CR: LDL-C lowering by 5.52 mg/dL (CrI -9.24 to -1.89) when baseline LDL > 107 mg/dL. Assuming a baseline screening rate of 50%, the three most effective QI strategies were estimated to lead to an absolute improvement of 33% in retinopathy screening (PE + PR + TC) and 38% absolute increase in foot screening (PE + TC + Other).

AUTHORS' CONCLUSIONS

There is a significant body of evidence about QI programmes to improve the management of diabetes. Multicomponent QI programmes for diabetes care (comprised of effective QI strategies) may achieve meaningful population-level improvements across the majority of outcomes. For health system decision-makers, the evidence summarised in this review can be used to identify strategies to include in QI programmes. For researchers, this synthesis identifies higher-priority QI strategies to examine in further research regarding how to optimise their evaluation and effects. We will maintain this as a living systematic review.

Keeping up with evidence-based recommendations - a qualitative interview study with general practitioners in Germany on information-seeking behaviour in cardiovascular care

BACKGROUND

Due to the nature of their work, general practitioners (GPs) need to be up to date with evidence in various medical domains. While much synthesised research evidence is easily accessible nowadays, in practice, the time to search for and review this evidence proposes a challenge. In German primary care, the knowledge infrastructure is rather fragmented, leaving GPs with relatively few primary care specific resources of information and many resources from other medical fields. This study aimed to explore GPs information-seeking behaviour regarding evidence-based recommendations in cardiovascular care in Germany.

METHODS

To explore views of GPs a qualitative research design was chosen. Data was collected through semi-structured interviews. In total, 27 telephone interviews with GPs were conducted between June and November 2021.Verbatim transcript interviews were then analysed using thematic analysis, deriving at themes inductively.

RESULTS

Two broad strategies of information-seeking behaviour in GP could be distinguished: (a) generic information-seeking behaviour and (b) casuistic information-seeking. The first referring to strategies GPs apply to keep up with medical developments such as new medication and the second referring to purposeful information exchange regarding individual patients, such as referral letters. The second strategy was also used to keep up with medical developments in general.

CONCLUSION

In a fragmented information landscape, GPs used information exchange on individual patients to remain informed about medical developments in general. Initiatives to implement recommended practices need to take this into account, either by using these sources of influence or by making GPs aware of possible bias and risks. The findings also emphasize the importance of systematic evidence-based sources of information for GPs.

TRAIL REGISTRATION

We registered the study prospectively on 07/11/2019 at the German Clinical Trials Register (DRKS, www.drks.de ) under ID no. DRKS00019219.

Investigating online activity in UK adolescent mental health patients: a feasibility study using a natural language processing approach for electronic health records

OBJECTIVES

To assess the feasibility of using a natural language processing (NLP) application for extraction of free-text online activity mentions in adolescent mental health patient electronic health records (EHRs).

SETTING

The Clinical Records Interactive Search system allows detailed research based on deidentified EHRs from the South London and Maudsley NHS Foundation Trust, a large south London Mental Health Trust providing secondary and tertiary mental healthcare.

PARTICIPANTS AND METHODS

We developed a gazetteer of online activity terms and annotation guidelines, from 5480 clinical notes (200 adolescents, aged 11-17 years) receiving specialist mental healthcare. The preprocessing and manual curation steps of this real-world data set allowed development of a rule-based NLP application to automate identification of online activity (internet, social media, online gaming) mentions in EHRs. The context of each mention was also recorded manually as: supportive, detrimental or neutral in a subset of data for additional analysis.

RESULTS

The NLP application performed with good precision (0.97) and recall (0.94) for identification of online activity mentions. Preliminary analyses found 34% of online activity mentions were considered to have been documented within a supportive context for the young person, 38% detrimental and 28% neutral.

CONCLUSION

Our results provide an important example of a rule-based NLP methodology to accurately identify online activity recording in EHRs, enabling researchers to now investigate associations with a range of adolescent mental health outcomes.

Evaluating an audit and feedback intervention for reducing overuse of pathology test requesting by Australian general practitioners: protocol for a factorial cluster randomised controlled trial

INTRODUCTION

Consistent evidence shows pathology services are overused worldwide and that about one-third of testing is unnecessary. Audit and feedback (AF) is effective for improving care but few trials evaluating AF to reduce pathology test requesting in primary care have been conducted. The aim of this trial is to estimate the effectiveness of AF for reducing requests for commonly overused pathology test combinations by high-requesting Australian general practitioners (GPs) compared with no intervention control. A secondary aim is to evaluate which forms of AF are most effective.

METHODS AND ANALYSIS

This is a factorial cluster randomised trial conducted in Australian general practice. It uses routinely collected Medicare Benefits Schedule data to identify the study population, apply eligibility criteria, generate the interventions and analyse outcomes. On 12 May 2022, all eligible GPs were simultaneously randomised to either no intervention control or to one of eight intervention groups. GPs allocated to an intervention group received individualised AF on their rate of requesting of pathology test combinations compared with their GP peers. Three separate elements of the AF intervention will be evaluated when outcome data become available on 11 August 2023: (1) invitation to participate in continuing professional development-accredited education on appropriate pathology requesting, (2) provision of cost information on pathology test combinations and (3) format of feedback. The primary outcome is the overall rate of requesting of any of the displayed combinations of pathology tests of GPs over 6 months following intervention delivery. With 3371 clusters, assuming no interaction and similar effects for each intervention, we anticipate over 95% power to detect a difference of 4.4 requests in the mean rate of pathology test combination requests between the control and intervention groups.

ETHICS AND DISSEMINATION

Ethics approval was received from the Bond University Human Research Ethics Committee (#JH03507; approved 30 November 2021). The results of this study will be published in a peer-reviewed journal and presented at conferences. Reporting will adhere to Consolidated Standards of Reporting Trials.

TRIAL REGISTRATION NUMBER

ACTRN12622000566730.

Engagement is a necessary condition to test audit and feedback design features: results of a pragmatic, factorial, cluster-randomized trial with an embedded process evaluation

BACKGROUND

While audit & feedback (A&F) is an effective implementation intervention, the design elements which maximize effectiveness are unclear. Partnering with a healthcare quality advisory organization already delivering feedback, we conducted a pragmatic, 2 × 2 factorial, cluster-randomized trial to test the impact of variations in two factors: (A) the benchmark used for comparison and (B) information framing. An embedded process evaluation explored hypothesized mechanisms of effect.

METHODS

Eligible physicians worked in nursing homes in Ontario, Canada, and had voluntarily signed up to receive the report. Groups of nursing homes sharing physicians were randomized to (A) physicians' individual prescribing rates compared to top-performing peers (the top quartile) or the provincial median and (B) risk-framed information (reporting the number of patients prescribed high-risk medication) or benefit-framed information (reporting the number of patients not prescribed). We hypothesized that the top quartile comparator and risk-framing would lead to greater practice improvements. The primary outcome was the mean number of central nervous system-active medications per resident per month. Primary analyses compared the four arms at 6 months post-intervention. Factorial analyses were secondary. The process evaluation comprised a follow-up questionnaire and semi-structured interviews.

RESULTS

Two hundred sixty-seven physicians (152 clusters) were randomized: 67 to arm 1 (median benchmark, benefit framing), 65 to arm 2 (top quartile benchmark, benefit framing), 75 to arm 3 (median benchmark, risk framing), and 60 to arm 4 (top quartile benchmark, risk framing). There were no significant differences in the primary outcome across arms or for each factor. However, engagement was low (27-31% of physicians across arms downloaded the report). The process evaluation indicated that both factors minimally impacted the proposed mechanisms. However, risk-framed feedback was perceived as more actionable and more compatible with current workflows, whilst a higher target might encourage behaviour change when physicians identified with the comparator.

CONCLUSIONS

Risk framing and a top quartile comparator have the potential to achieve change. Further work to establish the strategies most likely to enhance A&F engagement, particularly with physicians who may be most likely to benefit from feedback, is required to support meaningfully addressing intricate research questions concerning the design of A&F.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02979964 . Registered 29 November 2016.

Validity of patients' online reviews at direct-to-consumer teleconsultation platforms: a protocol for a cross-sectional study using unannounced standardised patients

INTRODUCTION

As direct-to-consumer teleconsultation (hereafter referred to as 'teleconsultation') has gained popularity, an increasing number of patients have been leaving online reviews of their teleconsultation experiences. These reviews can help guide patients in identifying doctors for teleconsultation. However, few studies have examined the validity of online reviews in assessing the quality of teleconsultation against a gold standard. Therefore, we aim to use unannounced standardised patients (USPs) to validate online reviews in assessing both the technical and patient-centred quality of teleconsultations. We hypothesise that online review results will be more consistent with the patient-centred quality, rather than the technical quality, as assessed by the USPs.

METHODS AND ANALYSIS

In this cross-sectional study, USPs representing 11 common primary care conditions will randomly visit 253 physicians via the three largest teleconsultation platforms in China. Each physician will receive a text-based and a voice/video-based USP visit, resulting in a total of 506 USP visits. The USP will complete a quality checklist to assess the proportion of clinical practice guideline-recommended items during teleconsultation. After each visit, the USP will also complete the Patient Perception of Patient-Centeredness Rating. The USP-assessed results will be compared with online review results using the intraclass correlation coefficient (ICC). If ICC >0.4 (p<0.05), we will assume reasonable concordance between the USP-assessed quality and online reviews. Furthermore, we will use correlation analysis, Lin's Coordinated Correlation Coefficient and Kappa as supplementary analyses.

ETHICS AND DISSEMINATION

This study has received approval from the Institutional Review Board of Southern Medical University (#Southern Medical Audit (2022) No. 013). Results will be actively disseminated through print and social media, and USP tools will be made available for other researchers.

TRIAL REGISTRATION

The study has been registered at the China Clinical Trials Registry (ChiCTR2200062975).

Feedback on clinical team performance: how does it work, in what contexts, for whom, and for what changes? A critical realist qualitative multiple case study

BACKGROUND

Feedback on clinical performance aims to provide teams in health care settings with structured results about their performance in order to improve these results. Two systematic reviews that included 147 randomized studies showed unresolved variability in professional compliance with desired clinical practices. Conventional recommendations for improving feedback on clinical team performance generally appear decontextualized and, in this regard, idealized. Feedback involves a complex and varied arrangement of human and non-human entities and interrelationships. To explore this complexity and improve feedback, we sought to explain how feedback on clinical team performance works, for whom, in what contexts, and for what changes. Our goal in this research was to present a realistic and contextualized explanation of feedback and its outcomes for clinical teams in health care settings.

METHODS

This critical realist qualitative multiple case study included three heterogeneous cases and 98 professionals from a university-affiliated tertiary care hospital. Five data collection methods were used: participant observation, document retrieval, focus groups, semi-structured interviews, and questionnaires. Intra- and inter-case analysis performed during data collection involved thematic analysis, analytical questioning, and systemic modeling. These approaches were supported by critical reflexive dialogue among the research team, collaborators, and an expert panel.

RESULTS

Despite the use of a single implementation model throughout the institution, results differed on contextual decision-making structures, responses to controversy, feedback loop practices, and use of varied technical or hybrid intermediaries. Structures and actions maintain or transform interrelationships and generate changes that are in line with expectations or the emergence of original solutions. Changes are related to the implementation of institutional and local projects or indicator results. However, they do not necessarily reflect a change in clinical practice or patient outcomes.

CONCLUSIONS

This critical realist qualitative multiple case study offers an in-depth explanation of feedback on clinical team performance as a complex and open-ended sociotechnical system in constant transformation. In doing so, it identifies reflexive questions that are levers for the improvement of team feedback.

How do healthcare providers use national audit data for improvement?

BACKGROUND

Substantial resources are invested by Health Departments worldwide in introducing National Clinical Audits (NCAs). Yet, there is variable evidence on the NCAs' effectiveness and little is known on factors underlying the successful use of NCAs to improve local practice. This study will focus on a single NCA (the National Audit of Inpatient Falls -NAIF 2017) to explore: (i) participants' perspectives on the NCA reports, local feedback characteristics and actions undertaken following the feedback underpinning the effective use of the NCA feedback to improve local practice; (ii) reported changes in local practice following the NCA feedback in England and Wales.

METHODS

Front-line staff perspectives were gathered through interviews. An inductive qualitative approach was used. Eighteen participants were purposefully sampled from 7 of the 85 participating hospitals in England and Wales. Analysis was guided by constant comparative techniques.

RESULTS

Regarding the NAIF annual report, interviewees valued performance benchmarking with other hospitals, the use of visual representations and the inclusion of case studies and recommendations. Participants stated that feedback should target front-line healthcare professionals, be straightforward and focused, and be delivered through an encouraging and honest discussion. Interviewees highlighted the value of using other relevant data sources alongside NAIF feedback and the importance of continuous data monitoring. Participants reported that engagement of front-line staff in the NAIF and following improvement activities was critical. Leadership, ownership, management support and communication at different organisational levels were perceived as enablers, while staffing level and turnover, and poor quality improvement (QI) skills, were perceived as barriers to improvement. Reported changes in practice included increased awareness and attention to patient safety issues and greater involvement of patients and staff in falls prevention activities.

CONCLUSIONS

There is scope to improve the use of NCAs by front-line staff. NCAs should not be seen as isolated interventions but should be fully embedded and integrated into the QI strategic and operational plans of NHS trusts. The use of NCAs could be optimised, but knowledge of them is poor and distributed unevenly across different disciplines. More research is needed to provide guidance on key elements to consider throughout the whole improvement process at different organisational levels.

GPs' willingness to prescribe aspirin for cancer preventive therapy in Lynch syndrome: a factorial randomised trial investigating factors influencing decisions

BACKGROUND

The National Institute for Health and Care Excellence (NICE) 2020 guidelines recommends aspirin for colorectal cancer prevention for people with Lynch syndrome. Strategies to change practice should be informed by understanding the factors influencing prescribing.

AIM

To investigate the optimal type and level of information to communicate with GPs to increase willingness to prescribe aspirin.

DESIGN AND SETTING

GPs in England and Wales (n = 672) were recruited to participate in an online survey with a 23 factorial design. GPs were randomised to one of eight vignettes describing a hypothetical patient with Lynch syndrome recommended to take aspirin by a clinical geneticist.

METHOD

Across the vignettes, the presence or absence of three types of information was manipulated: 1) existence of NICE guidance; 2) results from the CAPP2 trial; 3) information comparing risks/benefits of aspirin. The main effects and all interactions on the primary (willingness to prescribe) and secondary outcomes (comfort discussing aspirin) were estimated.

RESULTS

There were no statistically significant main effects or interactions of the three information components on willingness to prescribe aspirin or comfort discussing harms and benefits. In total, 80.4% (540/672) of GPs were willing to prescribe, with 19.7% (132/672) unwilling. GPs with prior awareness of aspirin for preventive therapy were more comfortable discussing the medication than those unaware (P = 0.031).

CONCLUSION

It is unlikely that providing information on clinical guidance, trial results, and information comparing benefits and harms will increase aspirin prescribing for Lynch syndrome in primary care. Alternative multilevel strategies to support informed prescribing may be warranted.