Audit and feedback: effects on professional practice and healthcare outcomes

A qualitative study on the facilitators and barriers to adopting the N-of-1 trial methodology as part of clinical practice: potential versus implementation challenges

PURPOSE

To investigate opinions among healthcare stakeholders whether implementation of the N-of-1 trial approach in clinical practice is a feasible way to optimize evidence-based treatment results for unique patients.

METHODS

We interviewed clinicians, researchers, and a patient advocate (n = 13) with an interest in or experience with N-of-1 trials on the following topics: experience with N-of-1, measurement, validity and reliability, informally gathered data usability, and influence on physician-patient relationship. Interviews were analysed using qualitative, thematic analysis.

RESULTS

The N-of-1 approach has the potential to shift the current healthcare system towards embracing personalized medicine. However, its application in clinical practice carries significant challenges in terms of logistics, time investment and acceptability. New skills will be required from patients and healthcare providers, which may alter the patient-physician relationship. The rise of consumer technology enabling self-measurement may leverage the uptake of N-of-1 approaches in clinical practice.

CONCLUSIONS

There is a strong belief that the N-of-1 approach has the potential to play a prominent role in transitioning the current healthcare system towards embracing personalized medicine. However, there are many barriers deeply ingrained in our healthcare system that hamper the uptake of the N-of-1 approach, making it momentarily only interesting for research purposes.

Physician perspectives of clinical performance feedback and impact on well-being: a qualitative exploration

OBJECTIVES

Providing clinical performance feedback to physicians is an established method to improve care, but the impact on physician well-being is unclear. This evaluation aimed to better understand physician perspectives on clinical feedback and its potential impact on well-being.

DESIGN

A qualitative design using semi-structured interviews was undertaken. Data were analysed via consensus coding using an inductive-deductive approach informed by Clinical Performance Feedback Intervention Theory. Findings were used to develop a novel framework describing the relationship between feedback and well-being.

SETTING

Interviews were conducted in a large academic medical centre from June-September 2021.

PARTICIPANTS

We conducted 25 semi-structured interviews with general outpatient and inpatient paediatricians and internists.

RESULTS

Physicians felt that feedback supported well-being based on its perceived purpose (intended to promote professional growth vs serving an alternative purpose), which they discerned based on feedback content (aligned with physician priorities vs not aligned), validity (accurate vs inaccurate), actionability (specific vs not, within a physician's sphere of control vs not) and delivery (supportive vs punitive). The Clinical Performance Feedback Well-Being Model is presented to understand how feedback and recipient variables impact well-being.

CONCLUSIONS

Attention to the process and content of physician clinical performance feedback may advance both the quality of care and physician well-being.

Estimating oncologist variability in prescribing systemic cancer therapies to patients in the last 30 days of life

INTRODUCTION

Clinical guidelines and quality improvement initiatives have identified reducing the use of end-of-life cancer therapies as an opportunity to improve care. We examined the extent to which oncologists differed in prescribing systemic therapies in the last 30 days of life.

METHODS

Using Surveillance, Epidemiology, and End Results-Medicare data, we identified patients who died of cancer from 2012 to 2017 (N = 17,609), their treating oncologists (N = 960), and the corresponding physician practice (N = 388). We used multilevel models to estimate oncologists' rates of providing cancer therapy for patients in their last 30 days of life, adjusted for patient characteristics and practice variation.

RESULTS

Patients' median age at the time of death was 74 years (interquartile range, 69-79); patients had lung (62%), colorectal (17%), breast (13%), and prostate (8%) cancers. We observed substantial variation across oncologists in their adjusted rate of treating patients in the last 30 days of life: oncologists in the 95th percentile exhibited a 45% adjusted rate of treatment, versus 17% among the 5th percentile. A patient treated by an oncologist with a high end-of-life prescribing behavior (top quartile), compared to an oncologist with a low prescribing behavior (bottom quartile), had more than four times greater odds of receiving end-of-life cancer therapy (OR, 4.42; 95% CI, 4.00-4.89).

CONCLUSIONS

Oncologists show substantial variation in end-of-life prescribing behavior. Future research should examine why some oncologists more often continue systemic therapy at the end of life than others, the consequences of this for patient and care outcomes, and whether interventions shaping oncologist decision-making can reduce overuse of end-of-life cancer therapies.

Current oral care practices in an acute aged care setting: An Australian metropolitan hospital perspective

PURPOSE

To evaluate current oral care practices in an acute aged care hospital setting, and staff perceptions of the barriers and enablers to delivery of evidence-based oral care practices.

METHOD

A mixed method study comprised of retrospective file audit and cross-sectional survey was conducted within a single acute aged care unit. Medical records of patients aged ≥ 65 years admitted over a 6 month period were retrospectively audited. A clinician survey was used to explore barriers to and enablers of the delivery of oral care practices using the Capability, Opportunity, Motivation, Behaviour (COM-B) questionnaire. Result were analysed using descriptive statistics.

RESULT

Patient file audits (n = 206) found 13.6% (n = 28) of patients had oral care completed, despite 23% (n = 47) of patients being recommended by a speech language pathologist to receive oral care. Staff survey respondents (n = 31) reported they do not have the physical or social opportunities to provide oral care (i.e. adequate resources, time, and social support), however, they were motivated and reported they have the required knowledge and skills to provide oral care.

CONCLUSION

There is a need for implementation strategies to enable an interprofessional response to improve the delivery of evidence-based oral care practices and optimise patient outcomes.

Identifying Barriers and Implementation Strategies to Inform TBI Screening Adoption in Behavioral Healthcare Settings

OBJECTIVE

Identify barriers to the adoption of the Ohio State University Traumatic Brain Injury Identification Method (OSU TBI-ID) in behavioral healthcare organizations and match these barriers to implementation strategies to inform future implementation efforts.

PARTICIPANTS

Twenty behavioral health providers.

DESIGN

Qualitative study involving individual, semi-structured interviews regarding barriers to adopting the OSU TBI-ID. Data were thematically analyzed around constructs from the Consolidated Framework for Implementation Research (CFIR). Results were matched to strategies using the Expert Recommendations for Implementing Change (CFIR/ERIC) matching tool.

RESULTS

Ten barriers were identified across 4 CFIR domains. Inner-Setting barriers were inadequate leadership engagement, priorities, resources, and organizational incentives. Individual-Characteristics barriers were insufficient knowledge about the connection between TBI and behavioral health and how to conduct the OSU TBI-ID with fidelity, low self-efficacy to conduct screening, and inadequate motivation and buy-in to conduct screening. Outer-Setting barriers were lack of state-level mandates and inadequate incentives to conduct screenings. The Process domain barrier was an insufficient engagement of key personnel. Strategy recommendations include: identify and prepare champions; alter incentive and allowance structures; inform local opinion leaders; build a coalition; access new funding; conduct local consensus discussions; involve executive boards; capture/share local knowledge; conduct educational meetings; assess for readiness and identify determinants; identify early adopters; fund and contract for the clinical innovation; create a learning collaborative; and conduct a local needs assessment.

CONCLUSIONS

This is the first study to examine barriers to adopting the OSU TBI-ID in real-world practice settings. Our results suggest that multilevel implementation strategies addressing mechanisms of change are necessary at the provider, organizational, and systems levels to overcome the complex barriers affecting TBI screening adoption and implementation. Future research is needed to test these strategies and their mechanisms of action on the adoption, implementation, and sustainment of TBI screening, as well as their effect on client-level outcomes.

Bridging the gap: a qualitative process evaluation from the perspectives of healthcare professionals of an audit-and-feedback-based intervention to improve transition to adult care for young people living with type 1 diabetes

BACKGROUND

The transition from pediatric to adult care is a vulnerable time for young people living with type 1 diabetes (T1D). Bridging the Gap (BTG) is an audit-and-feedback (AF) intervention aimed at improving both transitions-in-care processes and diabetes management in the year following transition. As part of BTG, we conducted a qualitative process evaluation to understand: (a) what was implemented and how; and (b) the contextual factors (micro-, meso- and macro-) that affected implementation, outcomes and study processes.

METHODS

Using qualitative descriptive methodology, interviews were conducted with 13 healthcare professionals (HCPs) delivering diabetes care to transitioning youth. Participants were asked about their experiences of BTG study processes and feedback tools, the quality improvement (QI) initiatives implemented at their site, and potential spread and scale. Interviews also explored the impacts of COVID-19 on transition care and study processes and results.

RESULTS

Five key themes were identified. Participants' reflections on the BTG study design indicated they appreciated its flexible, site-specific approach to QI, which they saw as crucial to the success of their initiatives. Engagement with feedback reports and other study resources provided comparative, site-specific data. Participants described the challenges posed by the COVID-19 pandemic and its impacts on patients, care provision and study implementation. Their site-specific QI initiatives resulted in changes to their transition practices. Finally, participants commented on how BTG and its processes fostered a community of practice (CoP) between sites, resulting in new opportunities to collaborate and share experiences.

CONCLUSIONS

BTG resulted in a CoP among practitioners delivering transition care to youth with T1D, which could be scaled up to promote a learning health system in pediatric diabetes care. Qualitative process evaluation is a useful tool for understanding how contextual factors affect the implementation and outcomes of complex QI interventions.

Generating and translating evidence for safe and effective medication management in aged care homes

Generating and translating high-quality evidence is integral to providing safe and effective medication management for residents of aged care homes. Residents are often under-represented in trials of medication effectiveness and safety. This paper reviews opportunities and challenges for generating and translating evidence for safe and effective medication management in aged care homes. There are an increasing number of randomized controlled trials (RCTs) being conducted in aged care homes. Observational studies can also help address the evidence-practice gap arising from underrepresentation of residents in RCTs. Stepped-wedge and helix counterbalanced designs may help overcome limitations of traditional RCTs for evaluating medication management interventions in the aged care setting. Strategies for generating evidence include building effective partnerships with aged care homes and organizations, using novel trial designs, leveraging existing data and knowledge sharing through international platforms. Strategies for translating evidence include using quality indicators for audit and feedback, provision of education and training, engaging internal and external stakeholders, and development of local action plans and guideline implementation tools. There is an emerging interest in the role of knowledge brokers to facilitate knowledge translation. Future directions for generating and translating evidence include strengthening international research collaboration, industry partnerships, standardizing aged care home data to support national and international comparisons, and optimizing the use of technology. Initiatives may include improving access to routinely collected administrative health and medication data for conducting high-quality observational studies. Future studies should assess outcomes prioritized by residents to ensure that medication management strategies are tailored to their needs.

Strengthening crisis resilience in German primary care by using quality indicators: findings of a process evaluation in the RESILARE project

BACKGROUND

In recent years, health systems worldwide have been confronted with several crises such as natural disasters or the COVID-19 pandemic, that affected lives and health of many people. In light of waves of infections and heat, climate change is considered to be the biggest health threat of the 21st century. Strengthening individual and organizational crisis resilience in healthcare settings thus becomes a crucial factor in maintaining care quality and protecting vulnerable patients during such crises. The RESILARE project therefore aimed to develop and evaluate quality indicators that support primary care practices in preparing for and adapting to crisis-related challenges.

METHODS

In a three-phased process, indicator development was based on systematic literature research and qualitative data, a two-stage expert panel process, and pilot testing in a maximum of n = 35 ambulatory practices during an outreach visit. Practice-individual indicator-related status and benchmarking information were provided via feedback reports to complete the audit and feedback program. A mixed-methods process evaluation used semistructured interviews with participating General practitioners and nonphysician health professionals to explore support and challenges for the implementation of the derived set of quality indicators. Two online surveys were conducted to evaluate all indicators and the two-part feedback report. Qualitative data were analyzed inductively using a thematic analysis approach. Survey data were analyzed descriptively.

RESULTS

A total of n = 32 indicators covered four domains: (1) individual resilience, (2) crisis prevention, (3) organizational resilience, and (4) climate resilience. N = 34 practices participated in the piloting and the process evaluation. Participants generally attributed a high relevance to the domains, and considered the indicator set suitable for implementation into existing quality management systems. Planning and implementation of measures that strengthen crisis resilience in practices were triggered or intensified by piloting the indicators and by the two-part feedback report. The identified challenges involved the volume of indicators and practice-individual implementation of renewable energy sources on rented premises. Participants expressed their desire for peer exchange regarding proven concepts for crisis resilience.

Association between delayed outbreak identification and SARS-CoV-2 infection and mortality among long-term care home residents, Ontario, Canada, March to November 2020: a cohort study

BackgroundLate outbreak identification is a common risk factor mentioned in case reports of large respiratory infection outbreaks in long-term care (LTC) homes.AimTo systematically measure the association between late SARS-CoV-2 outbreak identification and secondary SARS-CoV-2 infection and mortality in residents of LTC homes.MethodsWe studied SARS-CoV-2 outbreaks across LTC homes in Ontario, Canada from March to November 2020, before the COVID-19 vaccine rollout. Our exposure (late outbreak identification) was based on cumulative infection pressure (the number of infectious resident-days) on the outbreak identification date (early: ≤ 2 infectious resident-days, late: ≥ 3 infectious resident-days), where the infectious window was -2 to +8 days around onset. Our outcome consisted of 30-day incidence of secondary infection and mortality, based on the proportion of at-risk residents with a laboratory-confirmed SARS-CoV-2 infection with onset within 30 days of the outbreak identification date.ResultsWe identified 632 SARS-CoV-2 outbreaks across 623 LTC homes. Of these, 36.4% (230/632) outbreaks were identified late. Outbreaks identified late had more secondary infections (10.3%; 4,437/42,953) and higher mortality (3.2%; 1,374/42,953) compared with outbreaks identified early (infections: 3.3%; 2,015/61,714; p < 0.001, mortality: 0.9%; 579/61,714; p < 0.001). After adjustment for 12 LTC home covariates, the incidence of secondary infections in outbreaks identified late was 2.90-fold larger than that of outbreaks identified early (OR: 2.90; 95% CI: 2.04-4.13).ConclusionsThe timeliness of outbreak identification could be used to predict the trajectory of an outbreak, plan outbreak measures and retrospectively provide feedback for quality improvement, with the objective of reducing the impacts of respiratory infections in LTC home residents.

Establishing Quality Indicators and Implementation Priorities for Post-Stroke Aphasia Services Through End-User Involvement

BACKGROUND

Currently, there are no agreed quality standards for post-stroke aphasia services. Therefore, it is unknown if care reflects best practices or meets the expectations of people living with aphasia. We aimed to (1) shortlist, (2) operationalise and (3) prioritise best practice recommendations for post-stroke aphasia care.

METHODS

Three phases of research were conducted. In Phase 1, recommendations with strong evidence and/or known to be important to people with lived experience of aphasia were identified. People with lived experience and health professionals rated the importance of each recommendation through a two-round e-Delphi exercise. Recommendations were then ranked for importance and feasibility and analysed using a graph theory-based voting system. In Phase 2, shortlisted recommendations from Phase 1 were converted into quality indicators for appraisal and voting in consensus meetings. In Phase 3, priorities for implementation were established by people with lived experience and health professionals following discussion and anonymous voting.

FINDINGS

In Phase 1, 23 best practice recommendations were identified and rated by people with lived experience (n = 26) and health professionals (n = 81). Ten recommendations were shortlisted. In Phase 2, people with lived experience (n = 4) and health professionals (n = 17) reached a consensus on 11 quality indicators, relating to assessment (n = 2), information provision (n = 3), communication partner training (n = 3), goal setting (n = 1), person and family-centred care (n = 1) and provision of treatment (n = 1). In Phase 3, people with lived experience (n = 5) and health professionals (n = 7) identified three implementation priorities: assessment of aphasia, provision of aphasia-friendly information and provision of therapy.

INTERPRETATION

Our 11 quality indicators and 3 implementation priorities are the first step to enabling systematic, efficient and person-centred measurement and quality improvement in post-stroke aphasia services. Quality indicators will be embedded in routine data collection systems, and strategies will be developed to address implementation priorities.

PATIENT AND PUBLIC CONTRIBUTION

Protocol development was informed by our previous research, which explored the perspectives of 23 people living with aphasia about best practice aphasia services. Individuals with lived experience of aphasia participated as expert panel members in our three consensus meetings. We received support from consumer advisory networks associated with the Centre for Research Excellence in Aphasia Rehabilitation and Recovery and the Queensland Aphasia Research Centre.

Development of a behaviour change intervention to increase the delivery of upper limb constraint-induced movement therapy programs to people with stroke and traumatic brain injury

PURPOSE

Constraint-induced movement therapy (CIMT) is a recommended intervention for arm recovery after acquired brain injury but is underutilised in practice. The purpose of this study is to describe the development of a behaviour change intervention targeted at therapists, to increase delivery of CIMT.

METHODS

A theoretically-informed approach for designing behaviour change interventions was used including identification of which behaviours needed to change (Step 1), barriers and enablers that needed to be addressed (Step 2), and intervention components to target those barriers and enablers (Step 3). Data collection methods included file audits and therapist interviews. Quantitative data (file audits) were analysed using descriptive statistics. Qualitative data analysis (interviews) was informed by the Theoretical Domains Framework (TDF) and Behaviour Change Wheel.

RESULTS

Fifty two occupational therapists, physiotherapists and allied health assistants participated in focus groups (n = 7) or individual interviews (n = 6). Key barriers (n = 20) and enablers (n = 10) were identified across 11 domains of the TDF and perceived to influence CIMT implementation. The subsequent behaviour change intervention included training workshops, nominated team champions, community of practice meetings, three-monthly file audit feedback cycles, poster reminders and drop-in support during CIMT.

CONCLUSION

This study describes the development of a behaviour change intervention to increase CIMT delivery by clinicians.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry, Trial ID: ACTRN12617001147370.

Practice visitations in primary care to improve performance of cardiovascular risk management: an observational study

BACKGROUND

Despite programmatic protocolised care and structured support, considerable variation is observed in completeness of registration and achieving targets of cardiovascular risk management (CVRM) between individual GPs in the Netherlands.

AIM

To determine whether completeness of registration and achieved targets of cardiovascular risk factors improves with practice visitation.

DESIGN & SETTING

Observational study utilising the care group's database (2016-2019), comparing changes in registration and achieved targets in non-visited practices and visited practices.

METHOD

We compared completeness scores of registration and scores of targets achieved before visitation and 1 year after visitation. Data were analysed on patient level and GP level. Separate analyses were performed among GPs who were ranked in the lower 25% of score distributions.

RESULTS

We observed no clinically relevant improvements in completeness of registration and targets achieved in 2017, 2018, and 2019 that could be attributed to visitations in the previous year, both on individual patient level and on aggregated level per general practice. In practices ranked in the lower 25% of the distribution, improvements over time were clinically relevant and larger than the overall changes. Yet, these findings were irrespective of the number of practice visitations.

CONCLUSION

Practice visitations in our setting did not seem to lead to improvements in practice performance, nor in completeness of registration of risk factors or in reaching predefined target goals for cardiovascular risk factors.

Effects of implementation strategies on nursing practice and patient outcomes: a comprehensive systematic review and meta-analysis

BACKGROUND

Implementation strategies targeting individual healthcare professionals and teams, such as audit and feedback, educational meetings, opinion leaders, and reminders, have demonstrated potential in promoting evidence-based nursing practice. This systematic review examined the effects of the 19 Cochrane Effective Practice and Organization Care (EPOC) healthcare professional-level implementation strategies on nursing practice and patient outcomes.

METHODS

A systematic review was conducted following the Cochrane Handbook, with six databases searched up to February 2023 for randomized studies and non-randomized controlled studies evaluating the effects of EPOC implementation strategies on nursing practice. Study selection and data extraction were performed in Covidence. Random-effects meta-analyses were conducted in RevMan, while studies not eligible for meta-analysis were synthesized narratively based on the direction of effects. The quality of evidence was assessed using GRADE.

RESULTS

Out of 21,571 unique records, 204 studies (152 randomized, 52 controlled, non-randomized) enrolling 36,544 nurses and 340,320 patients were included. Common strategies (> 10% of studies) were educational meetings, educational materials, guidelines, reminders, audit and feedback, tailored interventions, educational outreach, and opinion leaders. Implementation strategies as a whole improved clinical practice outcomes compared to no active intervention, despite high heterogeneity. Group and individual education, patient-mediated interventions, reminders, tailored interventions and opinion leaders had statistically significant effects on clinical practice outcomes. Individual education improved nurses' attitude, knowledge, perceived control, and skills, while group education also influenced perceived social norms. Although meta-analyses indicate a small, non-statistically significant effect of multifaceted versus single strategies on clinical practice, the narrative synthesis of non-meta-analyzed studies shows favorable outcomes in all studies comparing multifaceted versus single strategies. Group and individual education, as well as tailored interventions, had statistically significant effects on patient outcomes.

CONCLUSIONS

Multiple types of implementation strategies may enhance evidence-based nursing practice, though effects vary due to strategy complexity, contextual factors, and variability in outcome measurement. Some evidence suggests that multifaceted strategies are more effective than single component strategies. Effects on patient outcomes are modest. Healthcare organizations and implementation practitioners may consider employing multifaceted, tailored strategies to address local barriers, expand the use of underutilized strategies, and assess the long-term impact of strategies on nursing practice and patient outcomes.

TRIAL REGISTRATION

PROSPERO CRD42019130446.

Overview of a national endoscopy database: The Trans.IT database and its impact on data registration quality

BACKGROUND

The Trans.IT database is a national gastrointestinal (GI) endoscopy database developed in 2012. It automatically collects anonymous data from GI endoscopy procedures in a centralized database. All endoscopists use a structured reporting tool for uniform data collection. In this study, we aim to provide an overview of the database and to evaluate its impact on data registration quality.

METHODS

We used all ERCPs, colonoscopies and colorectal cancer (CRC)-screening colonoscopies performed between 2016 and 2020. We excluded centers joining after 2016 and patients below age 18. Data registration quality for ERCPs included completeness of data for: intention of ERCP, Schutz score, ASA classification, papillary status (virgin or previous sphincterotomy), cannulation (success or failure to cannulate the desired duct) and procedural success. For colonoscopies: indication, ASA-classification, Boston Bowel Preparation Score (BBPS), cecal intubation, polyp detection rate (PDR). For CRC-screening colonoscopies, ASA-classification, BBPS, cecal intubation, PDR and adenoma detection rate (ADR).

RESULTS

A total of 14,156 ERCPs, 150,962 colonoscopies and 37,199 colorectal cancer screening colonoscopies were included in our analysis. For ERCPs, registration of procedural intention, Schutz score, ASA classification, papillary status, cannulation and procedural success improved from 34.9%, 32.7%, 72.6%, 36.5%, 34.6%, 27.2% in 2016, to 86.4%, 84.6%, 97.4%, 86.4%, 82.1%, 84.0%, respectively, in 2020. For non-screening colonoscopies, registration of indication, ASA classification, BBPS, cecal intubation and PDR improved from 40.4%, 60.5%, 47.6%, 69.8% and 32.3% in 2016 to 90.3%, 88.9%, 59.8%, 79.1% and 39.1%, respectively, in 2020. For CRC-cancer screening colonoscopy registration equaled outcome, PDR and ADR changed from 74.7% to 63.6% in 2016 to 66.3% and 53.8% in 2020, respectively.

CONCLUSIONS

The quality of endoscopy data registration has consistently improved over the years by using the Trans.IT database. This is most likely the result of feedback to performing endoscopists to review performance in real-time online and progressive awareness of quality of data registration.

Emergency clinicians' use of adult and paediatric sepsis pathways: An implementation redesign using the behaviour change wheel

AIMS

To identify facilitators and barriers and tailor implementation strategies to optimize emergency clinician's use of adult and paediatric sepsis pathways.

DESIGN

A qualitative descriptive study using focus group methodology.

METHODS

Twenty-two emergency nurses and ten emergency medical officers from four Australian EDs participated in eight virtual focus groups. Participants were asked about their experiences using the New South Wales Clinical Excellence Commission adult and paediatric sepsis pathways using a semi-structured interview template. Facilitators and barriers to use of the sepsis pathways were categorized using the Theoretical Domains Framework. Tailored interventions were selected to address facilitators and barriers, and a re-implementation plan was devised guided by the Behaviour Change Wheel.

RESULTS

Thirty-two facilitators and 58 barriers were identified corresponding to 11 Theoretical Domains Framework domains. Tailored strategies were selected to optimize emergency clinicians' use of the sepsis pathways including refinement of existing education and training programmes, modifications to the electronic medical record system, introduction of an audit and feedback system, staffing strategies and additional resources.

CONCLUSION

The implementation of sepsis pathways in the Emergency Department setting is complex, impacted by a multitude of factors requiring tailored strategies to address facilitators and barriers and optimize uptake.

IMPLICATIONS FOR PATIENT CARE

This study presents a theory-informed systematic approach to successfully implement and embed adult and paediatric sepsis pathways into clinical practice in the Emergency Department.

IMPACT

Optimizing uptake of sepsis pathways has the potential to improve sepsis recognition and management, subsequently improving the outcome of patients with sepsis.

REPORTING METHOD

The Consolidated Criteria for REporting Qualitative research guided the preparation of this report.

PATIENT OR PUBLIC CONTRIBUTION

Nil.

Variational Bayes machine learning for risk adjustment of general outcome indicators with examples in urology

Risk adjustment is often necessary for outcome quality indicators (QIs) to provide fair and accurate feedback to healthcare professionals. However, traditional risk adjustment models are generally oversimplified and not equipped to disentangle complex factors influencing outcomes that are out of a healthcare professional's control. We present VIRGO, a novel variational Bayes model trained on routinely collected, large administrative datasets to risk-adjust outcome QIs. VIRGO uses detailed demographics, diagnosis, and procedure codes to provide individualized risk adjustment and explanations on patient factors affecting outcomes. VIRGO achieves state-of-the-art on external datasets and features capabilities of uncertainty expression, explainable features, and counterfactual analysis capabilities. VIRGO facilitates risk adjustment by explaining how patient factors led to adverse outcomes and expresses the uncertainty of each prediction, allowing healthcare professionals to not only explore patient factors with unexplained variance that are associated with worse outcomes but also reflect on the quality of their clinical practice.

Prevalence, predictors and outcomes of self-reported feedback for EMS professionals: a mixed-methods diary study

BACKGROUND

Providing feedback to healthcare professionals and organisations on performance or patient outcomes may improve care quality and professional development, particularly in Emergency Medical Services (EMS) where professionals make autonomous, complex decisions and current feedback provision is limited. This study aimed to determine the content and outcomes of feedback in EMS by measuring feedback prevalence, identifying predictors of receiving feedback, categorising feedback outcomes and determining predictors of feedback efficacy.

METHODS

An observational mixed-methods study was used. EMS professionals delivering face-to-face patient care in the United Kingdom's National Health Service completed a baseline survey and diary entries between March-August 2022. Diary entries were event-contingent and collected when a participant identified they had received feedback. Self-reported data were collected on feedback frequency, environment, characteristics and outcomes. Feedback environment was measured using the Feedback Environment Scale. Feedback outcomes were categorised using hierarchical cluster analysis. Multilevel logistic regression was used to assess which variables predicted feedback receipt and efficacy. Qualitative data were analysed using content analysis.

RESULTS

299 participants completed baseline surveys and 105 submitted 538 diary entries. 215 (71.9%) participants had received feedback in the last 30 days, with patient outcome feedback the most frequent (n = 149, 42.8%). Feedback format was predominantly verbal (n = 157, 73.0%) and informal (n = 189, 80.4%). Significant predictors for receiving feedback were a paramedic role (aOR 3.04 [1.14, 8.00]), a workplace with a positive feedback-seeking culture (aOR 1.07 [1.04, 1.10]) and white ethnicity (aOR 5.68 [1.01, 29.73]). Feedback outcomes included: personal wellbeing (closure, confidence and job satisfaction), professional development (clinical practice and knowledge) and service outcomes (patient care and patient safety). Feedback-seeking behaviour and higher scores on the Feedback Environment Scale were statistically significant predictors of feedback efficacy. Solicited feedback improved wellbeing (aOR 3.35 [1.68, 6.60]) and professional development (aOR 2.58 [1.10, 5.56]) more than unsolicited feedback.

CONCLUSION

Feedback for EMS professionals was perceived to improve personal wellbeing, professional development and service outcomes. EMS workplaces need to develop a culture that encourages feedback-seeking to strengthen the impact of feedback for EMS professionals on clinical decision-making and staff wellbeing.

Factors Influencing Implementation of the Commission on Cancer's Breast Synoptic Operative Report (Alliance A20_Pilot9)

BACKGROUND

The technical aspects of cancer surgery have a significant impact on patient outcomes. To monitor surgical quality, in 2020, the Commission on Cancer (CoC) revised its accreditation standards for cancer surgery and introduced the synoptic operative reports (SORs). The standardization of SORs holds promise, but successful implementation requires strategies to address key implementation barriers. This study aimed to identify the barriers and facilitators to implementing breast SOR within diverse CoC-accredited programs.

METHODS

In-depth semi-structured interviews were conducted with 31 health care professionals across diverse CoC-accredited sites. The study used two comprehensive implementation frameworks to guide data collection and analysis.

RESULTS

Successful SOR implementation was impeded by disrupted workflows, surgeon resistance to change, low prioritization of resources, and poor flow of information despite CoC's positive reputation. Participants often lacked understanding of the requirements and timeline for breast SOR and were heavily influenced by prior experiences with templates and SOR champion relationships. The perceived lack of monetary benefits (to obtaining CoC accreditation) together with the significant information technology (IT) resource requirements tempered some of the enthusiasm. Additionally, resource constraints and the redirection of personnel during the COVID-19 pandemic were noted as hurdles.

CONCLUSIONS

Surgeon behavior and workflow change, IT and personnel resources, and communication and networking strategies influenced SOR implementation. During early implementation and the implementation planning phase, the primary focus was on achieving buy-in and initiating successful roll-out rather than effective use or sustainment. These findings have implications for enhancing standardization of surgical cancer care and guidance of future strategies to optimize implementation of CoC accreditation standards.

Development of a Behavior-Change Intervention toward Benzodiazepine Deprescribing in Older Adults Living in Nursing Homes

OBJECTIVE

We aimed to develop a context-specific intervention toward benzodiazepine deprescribing in nursing homes (NHs), with insights from behavior-change theories and involvement of stakeholders.

DESIGN

Selection of behavior change techniques (BCTs), through online survey and group discussion, followed by operationalization of these BCTs into intervention components.

SETTING AND PARTICIPANTS

The intervention was developed for Belgian NHs, involving various stakeholders: health care professionals (HCPs), NH administrators, and policy makers.

METHODS

Using the Theory and Techniques Tool, we preselected the BCTs linked to one of the 9 Theoretical Domain Framework domains identified as being the main barriers for benzodiazepine deprescribing in Belgian NHs. These were then presented to stakeholders. Based on the APEASE (Acceptability, Practicability, Effectiveness, Affordability, Side-effects, and Ethics) criteria, participants ranked BCTs through an online survey, and then performed final selection during a group discussion. Selected BCTs were operationalized into intervention components, with specific contents and methods of delivery validated by stakeholders.

RESULTS

Thirty-seven potential BCTs were identified. Eighteen stakeholders participated in the survey, and 7 in the group discussion. This led to the final inclusion of 9 BCTs: instruction on how to perform the behavior, information about health consequences, pros and cons, problem solving, goal setting (behavior), social comparison, restructuring physical environment, restructuring social environment, and graded tasks. These BCTs were operationalized into a 6-component intervention: process and goal setting, HCP education, physical environment adaptations, audit and feedback, NH residents' and relatives' increased awareness, and multidisciplinary work.

CONCLUSION AND IMPLICATIONS

Use of a theory-based approach toward intervention development has the potential to improve the probability of its feasibility and effectiveness in tackling barriers to benzodiazepine deprescribing. By doing so, we have developed a multifaceted approach with actions taken at the patient, HCP, and NH levels. Our novel 6-component intervention will be evaluated in a pilot cluster-randomized controlled trial to assess its feasibility.

Comparative performance of intensive care mortality prediction models based on manually curated versus automatically extracted electronic health record data

INTRODUCTION

Benchmarking intensive care units for audit and feedback is frequently based on comparing actual mortality versus predicted mortality. Traditionally, mortality prediction models rely on a limited number of input variables and significant manual data entry and curation. Using automatically extracted electronic health record data may be a promising alternative. However, adequate data on comparative performance between these approaches is currently lacking.

METHODS

The AmsterdamUMCdb intensive care database was used to construct a baseline APACHE IV in-hospital mortality model based on data typically available through manual data curation. Subsequently, new in-hospital mortality models were systematically developed and evaluated. New models differed with respect to the extent of automatic variable extraction, classification method, recalibration usage and the size of collection window.

RESULTS

A total of 13 models were developed based on data from 5,077 admissions divided into a train (80%) and test (20%) cohort. Adding variables or extending collection windows only marginally improved discrimination and calibration. An XGBoost model using only automatically extracted variables, and therefore no acute or chronic diagnoses, was the best performing automated model with an AUC of 0.89 and a Brier score of 0.10.

DISCUSSION

Performance of intensive care mortality prediction models based on manually curated versus automatically extracted electronic health record data is similar. Importantly, our results suggest that variables typically requiring manual curation, such as diagnosis at admission and comorbidities, may not be necessary for accurate mortality prediction. These proof-of-concept results require replication using multi-centre data.

Disparity in Guideline-Based Antidiabetic Drugs Prescribing for Type 2 Diabetes Patients in Primary Healthcare Facilities Across China, 2017-2019

PURPOSE

The purpose of this study is to evaluate the pattern, appropriateness, and cost of antidiabetic drugs prescribed for patients with Type 2 diabetes at primary healthcare facilities (PHFs) in China.

METHODS

We collected outpatient-visit prescriptions from 363 PHFs in 31 cities covering eastern, central, and western regions of China. The visits of adult patients with Type 2 diabetes diagnosis were collected and classified the antidiabetic medication pattern of each patient use as recommended or non-recommended according to Chinese guidelines. We then calculated the proportion of guideline-recommended patterns and the average monthly cost for each pattern, overall and by region.

RESULTS

Of 33 519 prescriptions for Type 2 diabetes, most (73.9%) were for guideline-recommended antidiabetic treatments. The proportion of guideline-recommended prescriptions varied by region (eastern [75.9%], central [87.5%], and western [59.7%]). Metformin monotherapy was the most common guideline-recommended treatment in all three regions (eastern [20.1%], central [28.0%], and western [24.6%]). The most common non-guideline-recommended treatments were monotherapy of insulin (eastern [16.5%], central [5.1%], and western [25.7%]) and traditional Chinese antidiabetic medicines (eastern [5.6%], central [5.7%], and western [11.1%]). The average monthly costs were lower for guideline-recommended treatments compared to non-recommended treatments in all regions (eastern [13.6 ± 15.4 USD vs. 28.1 ± 22.0 USD], central [9.8 ± 10.9 USD vs. 28.7 ± 19.4 USD], and western [17.9 ± 21.4 USD vs. 30.3 ± 23.6 USD]).

CONCLUSIONS

The majority of patients with Type 2 diabetes received guideline-recommended antidiabetic medications at PHFs in China, with only half of the prescriptions containing guideline-recommended metformin. Utilization of guideline-recommended therapies differed across regions. Tailored interventions to promote evidence-based antidiabetic prescribing are urgently needed, especially in the undeveloped western region.

Implementing Enhanced Recovery After Surgery for hysterectomy in a hospital network with audit and feedback: A stepped-wedge cluster randomised trial

OBJECTIVE

To evaluate the effectiveness of implementing the Enhanced Recovery After Surgery (ERAS) protocol in patients undergoing elective hysterectomy in a network of regional hospitals, supported by an intensive audit-and-feedback (A&F) approach.

DESIGN

A multi-centre, stepped-wedge cluster randomised trial (ClinicalTrials.gov NCT04063072).

SETTING

Gynaecological units in the Piemonte region, Italy.

POPULATION

Patients undergoing elective hysterectomy, either for cancer or for benign conditions.

METHODS

Twenty-three units (clusters), stratified by surgical volume, were randomised into four sequences. At baseline (first 3 months), standard care was continued in all units. Subsequently, the four sequences implemented the ERAS protocol successively every 3 months, after specific training. By the end of the study, each unit had a period in which standard care was maintained (control) and a period in which the protocol, supported by feedback, was applied (experimental).

MAIN OUTCOME MEASURES

Length of hospital stay (LOS), without outliers (>98th percentile).

RESULTS

Between September 2019 and May 2021, 2086 patients were included in the main analysis with an intention-to-treat approach: 1104 (53%) in the control period and 982 (47%) in the ERAS period. Compliance with the ERAS protocol increased from 60% in the control period to 76% in the experimental period, with an adjusted absolute difference of +13.3% (95% CI 11.6% to 15.0%). LOS, moving from 3.5 to 3.2 days, did not show a significant reduction (-0.12 days; 95% CI -0.30 to 0.07 days). No difference was observed in the occurrence of complications.

CONCLUSIONS

Implementation of the ERAS protocol for hysterectomy at the regional level, supported by an A&F approach, resulted in a substantial improvement in compliance, but without meaningful effects on LOS and complications. This study confirms the effectiveness of A&F in promoting important innovations in an entire hospital network and suggests the need of a higher compliance with the ERAS protocol to obtain valuable improvements in clinical outcomes.

Re-Purposing the Ordering of Routine Laboratory Tests in Hospitalized Medical Patients (RePORT): protocol for a multicenter stepped-wedge cluster randomised trial to evaluate the impact of a multicomponent intervention bundle to reduce laboratory test over-utilization

BACKGROUND

Laboratory test overuse in hospitals is a form of healthcare waste that also harms patients. Developing and evaluating interventions to reduce this form of healthcare waste is critical. We detail the protocol for our study which aims to implement and evaluate the impact of an evidence-based, multicomponent intervention bundle on repetitive use of routine laboratory testing in hospitalized medical patients across adult hospitals in the province of British Columbia, Canada.

METHODS

We have designed a stepped-wedge cluster randomized trial to assess the impact of a multicomponent intervention bundle across 16 hospitals in the province of British Columbia in Canada. We will use the Knowledge to Action cycle to guide implementation and the RE-AIM framework to guide evaluation of the intervention bundle. The primary outcome will be the number of routine laboratory tests ordered per patient-day in the intervention versus control periods. Secondary outcome measures will assess implementation fidelity, number of all common laboratory tests used, impact on healthcare costs, and safety outcomes. The study will include patients admitted to adult medical wards (internal medicine or family medicine) and healthcare providers working in these wards within the participating hospitals. After a baseline period of 24 weeks, we will conduct a 16-week pilot at one hospital site. A new cluster (containing approximately 2-3 hospitals) will receive the intervention every 12 weeks. We will evaluate the sustainability of implementation at 24 weeks post implementation of the final cluster. Using intention to treat, we will use generalized linear mixed models for analysis to evaluate the impact of the intervention on outcomes.

DISCUSSION

The study builds upon a multicomponent intervention bundle that has previously demonstrated effectiveness. The elements of the intervention bundle are easily adaptable to other settings, facilitating future adoption in wider contexts. The study outputs are expected to have a positive impact as they will reduce usage of repetitive laboratory tests and provide empirically supported measures and tools for accomplishing this work.

TRIAL REGISTRATION

This study was prospectively registered on April 8, 2024, via ClinicalTrials.gov Protocols Registration and Results System (NCT06359587). https://classic.

CLINICALTRIALS

gov/ct2/show/NCT06359587?term=NCT06359587&recrs=ab&draw=2&rank=1.

How can strategies based on performance measurement and feedback support changes in nursing practice? A theoretical reflection drawing on Habermas' social perspective

Strategies based on performance measurement and feedback are commonly used to support quality improvement among nurses. These strategies require practice change, which, for nurses, rely to a large extent on their capacity to coordinate with each other effectively. However, the levers for coordinated action are difficult to mobilize. This discussion paper offers a theoretical reflection on the challenges related to coordinating nurses' actions in the context of practice changes initiated by performance measurement and feedback strategies. We explore how Jürgen Habermas' theory of Communicative Action may shed light on the issues underlying nurses' collective actions and self-determination in practice change and the implications for the design of strategies based on performance measurement and feedback. Based on this theory, we propose differences between communicative and functional coordination according to the nature of the actions and the purposes involved. The domains of action underlying these coordination processes, which Habermas referred to as the lifeworld and the system, are then used to draw a parallel with aspects of nursing practice. Further exploration of these concepts allows us to consider the tensions between the demands of the system and the self-determination of nurses within their practice.

Utilizing the open-source programming language Python to create interactive Quality Assurance dashboards for diagnostic and screening performance in Cytology

INTRODUCTION

Effective feedback on cytology performance relies on navigating complex laboratory information system data, which is prone to errors and lacks flexibility. As a comprehensive solution, we used the Python programming language to create a dashboard application for screening and diagnostic quality metrics.

MATERIALS AND METHODS

Data from the 5-year period (2018-2022) were accessed. Versatile open-source Python libraries (user developed program code packages) were used from the first step of LIS data cleaning through the creation of the application. To evaluate performance, we selected 3 gynecologic metrics: the ASC/LSIL ratio, the ASC-US/ASC-H ratio, and the proportion of cytologic abnormalities in comparison to the total number of cases (abnormal rate). We also evaluated the referral rate of cytologists/cytotechnologists (CTs) and the ratio of thyroid AUS interpretations by cytopathologists (CPs). These were formed into colored graphs that showcase individual results in established, color-coded laboratory "goal," "borderline," and "attention" zones based on published reference benchmarks. A representation of the results distribution for the entire laboratory was also developed.

RESULTS

We successfully created a web-based test application that presents interactive dashboards with different interfaces for the CT, CP, and laboratory management (https://drkvcsstvn-dashboards.hf.space/app). The user can choose to view the desired quality metric, year, and the anonymized CT or CP, with an additional automatically generated written report of results.

CONCLUSIONS

Python programming proved to be an effective toolkit to ensure high-level data processing in a modular and reproducible way to create a personalized, laboratory specific cytology dashboard.

Evaluating a novel model of hepatitis B care, Hep B PAST, in the Northern Territory of Australia: results from a prospective, population-based study

Background

The Northern Territory (NT) has the highest prevalence of chronic hepatitis B (CHB) in Australia. The Hep B PAST program aims to improve health outcomes for people living with CHB.

Methods

This mixed methods study involves First Nations peoples living in the NT. We used participatory action research principles across three steps: 1. Foundation step: establishing hepatitis B virus (HBV) status and linkage to care; 2. Capacity building: training the health workforce; 3. Supported transition to primary healthcare: implementation of the "Hub and Spoke" model and in-language resources. Analysis occurred at three time points: 1. Pre-Hep B PAST (2018); 2. Foundation step (2020); and 3. Completion of Hep B PAST (2023). Evaluation focuses on four key indicators, the number of people: 1) with documented HBV status; 2) diagnosed with CHB; 3) receiving care; and 4) receiving treatment.

Findings

Hep B PAST (2018-23) reached 40,555 people. HBV status was documented in 11% (1192/10,853), 79.2% (26,075/32,915) and 90.8% (28,675/31,588) of people at pre-Hep B PAST, foundation step, and completion respectively. An estimated 99.9% (821/822) of people were diagnosed, 86.3% (709/822) engaged in care, and 24.1% (198/822) on antiviral treatment at completion. CHB prevalence in the study population is 2.6%, decreasing from 6.1% to 0.4% in the pre- and post-vaccination cohorts.

Interpretation

Hep B PAST is an effective model of care. Partner health services are exceeding elimination targets. This model could enable other countries to enhance the cascade of care and work towards eliminating HBV.

Funding

National Health and Medical Research Council.

How to Design Effective Audit and Feedback Interventions With Nurses: A Set of Hypotheses Based on Qualitative and Quantitative Evidence

OBJECTIVE

To propose practical hypotheses on audit and feedback that support the effectiveness with nurses.

BACKGROUND

Audit and feedback interventions have been mainly studied with physicians; however, the processes have been practiced by nurses for years. Nurses' response may differ from that of physicians and other healthcare disciplines because of their roles, power, and the configuration of nursing activities.

METHODS

A comparative analysis of the Clinical Performance Feedback Intervention Theory was conducted using nursing-specific empirical data from: 1) a mixed-methods systematic review and 2) a pilot study of audit and feedback with a team of primary care nurses.

RESULTS

Researchers hypothesize that audit and feedback interventions are more effective when: 1) feedback emphasizes how it relates to the relational aspect of nursing; 2) indicators are measured and reported at team level; and 3) feedback is provided in a way that highlights benefits to nurses' practice, such as the potential to reduce workload.

CONCLUSION

These proposed hypotheses provide concrete guidance to researchers and managers for an effective use of audit and feedback as a quality improvement strategy with nurses.

Deploying an asthma dashboard to support quality improvement across a nationally representative sentinel network of 7.6 million people in England

Every year, there are ~100,000 hospital admissions for asthma in the UK, many of which are potentially preventable. Evidence suggests that carefully conceptualised and implemented audit and feedback (A&F) cycles have the potential to improve clinical outcomes for those with chronic conditions. We wanted to investigate the technical feasibility of developing a near-real time asthma dashboard to support A&F interventions for asthma management in primary care. We extracted cross-sectional data on asthma from 756 participating GP practices in the Oxford-Royal College of General Practitioners Research and Surveillance Centre (RCGP RSC) database in England comprising 7.6 million registered people. Summary indicators for a GP practice were compared to all participating RCGP RSC practices using practice-level data, for the week 6-12th-Mar-2023. A weekly, automated asthma dashboard with features that can support electronic-A&F cycles that compared key asthma indicators for a GP practice to RCGP RSC could be created ( https://tinyurl.com/3ydtrt85 ): 12-weeks-incidence 0.4% vs 0.4%, annual prevalence 6.1% vs 6.7%, inhaled relievers to preventer 1.2 vs 1.1, self-management plan given 83.4% vs 60.8%, annual reviews 36.8% vs 57.3%, prednisolone prescriptions 2.0% vs 3.2%, influenza vaccination 56.6% vs 55.5%, pneumococcal vaccination ever (aged ≥65 years) 90.2% vs 84.1% and current smokers 14.9% vs 14.8%. Across the RCGP RSC, the rate of hospitalisations was 0.024%; comparative data had to be suppressed for the study practice because of small numbers. We have successfully created an automated near real-time asthma dashboard that can be used to support A&F initiatives to improve asthma care and outcomes in primary care.

Tailored vs. General COVID-19 prevention for adults with mental disabilities residing in group homes: a randomized controlled effectiveness-implementation trial

BACKGROUND

People with serious mental illness (SMI) and people with intellectual disabilities/developmental disabilities (ID/DD) are at higher risk for COVID-19 and more severe outcomes. We compare a tailored versus general best practice COVID-19 prevention program in group homes (GHs) for people with SMI or ID/DD in Massachusetts (MA).

METHODS

A hybrid effectiveness-implementation cluster randomized control trial compared a four-component implementation strategy (Tailored Best Practices: TBP) to dissemination of standard prevention guidelines (General Best-Practices: GBP) in GHs across six MA behavioral health agencies. GBP consisted of standard best practices for preventing COVID-19. TBP included GBP plus four components including: (1) trusted-messenger peer testimonials on benefits of vaccination; (2) motivational interviewing; (3) interactive education on preventive practices; and (4) fidelity feedback dashboards for GHs. Primary implementation outcomes were full COVID-19 vaccination rates (baseline: 1/1/2021-3/31/2021) and fidelity scores (baseline: 5/1/21-7/30/21), at 3-month intervals to 15-month follow-up until October 2022. The primary effectiveness outcome was COVID-19 infection (baseline: 1/1/2021-3/31/2021), measured every 3 months to 15-month follow-up. Cumulative incidence of vaccinations were estimated using Kaplan-Meier curves. Cox frailty models evaluate differences in vaccination uptake and secondary outcomes. Linear mixed models (LMMs) and Poisson generalized linear mixed models (GLMMs) were used to evaluate differences in fidelity scores and incidence of COVID-19 infections.

RESULTS

GHs (n=415) were randomized to TBP (n=208) and GBP (n=207) including 3,836 residents (1,041 ID/DD; 2,795 SMI) and 5,538 staff. No differences were found in fidelity scores or COVID-19 incidence rates between TBP and GBP, however TBP had greater acceptability, appropriateness, and feasibility. No overall differences in vaccination rates were found between TBP and GBP. However, among unvaccinated group home residents with mental disabilities, non-White residents achieved full vaccination status at double the rate for TBP (28.6%) compared to GBP (14.4%) at 15 months. Additionally, the impact of TBP on vaccine uptake was over two-times greater for non-White residents compared to non-Hispanic White residents (ratio of HR for TBP between non-White and non-Hispanic White: 2.28, p = 0.03).

CONCLUSION

Tailored COVID-19 prevention strategies are beneficial as a feasible and acceptable implementation strategy with the potential to reduce disparities in vaccine acceptance among the subgroup of non-White individuals with mental disabilities.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04726371, 27/01/2021. https://clinicaltrials.gov/study/NCT04726371 .

Optimising a clinical decision support tool to improve chronic kidney disease management in general practice

BACKGROUND

Early identification and treatment of chronic disease is associated with better clinical outcomes, lower costs, and reduced hospitalisation. Primary care is ideally placed to identify patients at risk of, or in the early stages of, chronic disease and to implement prevention and early intervention measures. This paper evaluates the implementation of a technological intervention called Future Health Today that integrates with general practice EMRs to (1) identify patients at-risk of, or with undiagnosed or untreated, chronic kidney disease (CKD), and (2) provide guideline concordant recommendations for patient care. The evaluation aimed to identify the barriers and facilitators to successful implementation.

METHODS

Future Health Today was implemented in 12 general practices in Victoria, Australia. Fifty-two interviews with 30 practice staff were undertaken between July 2020 and April 2021. Practice characteristics were collected directly from practices via survey. Data were analysed using inductive and deductive qualitative analysis strategies, using Clinical Performance - Feedback Intervention Theory (CP-FIT) for theoretical guidance.

RESULTS

Future Health Today was acceptable, user friendly and useful to general practice staff, and supported clinical performance improvement in the identification and management of chronic kidney disease. CP-FIT variables supporting use of FHT included the simplicity of design and delivery of actionable feedback via FHT, good fit within existing workflow, strong engagement with practices and positive attitudes toward FHT. Context variables provided the main barriers to use and were largely situated in the external context of practices (including pressures arising from the COVID-19 pandemic) and technical glitches impacting installation and early use. Participants primarily utilised the point of care prompt rather than the patient management dashboard due to its continued presence, and immediacy and relevance of the recommendations on the prompt, suggesting mechanisms of compatibility, complexity, actionability and credibility influenced use. Most practices continued using FHT after the evaluation phase was complete.

CONCLUSIONS

This study demonstrates that FHT is a useful and acceptable software platform that provides direct support to general practice in identifying and managing patients with CKD. Further research is underway to explore the effectiveness of FHT, and to expand the conditions on the platform.

Exploring Anesthesia Provider Preferences for Precision Feedback: Preference Elicitation Study

Background

Health care professionals must learn continuously as a core part of their work. As the rate of knowledge production in biomedicine increases, better support for health care professionals' continuous learning is needed. In health systems, feedback is pervasive and is widely considered to be essential for learning that drives improvement. Clinical quality dashboards are one widely deployed approach to delivering feedback, but engagement with these systems is commonly low, reflecting a limited understanding of how to improve the effectiveness of feedback about health care. When coaches and facilitators deliver feedback for improving performance, they aim to be responsive to the recipient's motivations, information needs, and preferences. However, such functionality is largely missing from dashboards and feedback reports. Precision feedback is the delivery of high-value, motivating performance information that is prioritized based on its motivational potential for a specific recipient, including their needs and preferences. Anesthesia care offers a clinical domain with high-quality performance data and an abundance of evidence-based quality metrics.

Objective

The objective of this study is to explore anesthesia provider preferences for precision feedback.

Methods

We developed a test set of precision feedback messages with balanced characteristics across 4 performance scenarios. We created an experimental design to expose participants to contrasting message versions. We recruited anesthesia providers and elicited their preferences through analysis of the content of preferred messages. Participants additionally rated their perceived benefit of preferred messages to clinical practice on a 5-point Likert scale.

Results

We elicited preferences and feedback message benefit ratings from 35 participants. Preferences were diverse across participants but largely consistent within participants. Participants' preferences were consistent for message temporality (α=.85) and display format (α=.80). Ratings of participants' perceived benefit to clinical practice of preferred messages were high (mean rating 4.27, SD 0.77).

Conclusions

Health care professionals exhibited diverse yet internally consistent preferences for precision feedback across a set of performance scenarios, while also giving messages high ratings of perceived benefit. A "one-size-fits-most approach" to performance feedback delivery would not appear to satisfy these preferences. Precision feedback systems may hold potential to improve support for health care professionals' continuous learning by accommodating feedback preferences.

Gastroenterologist and surgeon perceptions of recommendations for optimal endoscopic localization of colorectal neoplasms

National consensus recommendations have recently been developed to standardize colorectal tumour localization and documentation during colonoscopy. In this qualitative semi-structured interview study, we identified and contrast the perceived barriers and facilitators to using these new recommendations according to gastroenterologists and surgeons in a large central Canadian city. Interviews were analyzed according to the Consolidated Framework for Implementation Research (CFIR) through directed content analysis. Solutions were categorized using the Expert Recommendations for Implementing Change (ERIC) framework. Eleven gastroenterologists and ten surgeons participated. Both specialty groups felt that the new recommendations were clearly written, adequately addressed current care practice tensions, and offered a relative advantage versus existing practices. The new recommendations appeared appropriately complex, applicable to most participants, and could be trialed and adapted prior to full implementation. Major barriers included a lack of relevant external or internal organizational incentives, non-existing formal feedback processes, and a lack of individual familiarity with the evidence behind some recommendations. With application of the ERIC framework, common barriers could be addressed through accessing new funding, altering incentive structures, changing record systems, educational interventions, identifying champions, promoting adaptability, and employing audit/feedback processes. Future research is needed to test strategies for feasibility and effectiveness.

Mailed feedback to primary care physicians on antibiotic prescribing for patients aged 65 years and older: pragmatic, factorial randomised controlled trial

OBJECTIVES

To evaluate whether providing family physicians with feedback on their antibiotic prescribing compared with that of their peers reduces antibiotic prescriptions. To also identify effects on antibiotic prescribing from case-mix adjusted feedback reports and messages emphasising antibiotic associated harms.

DESIGN

Pragmatic, factorial randomised controlled trial.

SETTING

Primary care physicians in Ontario, Canada PARTICIPANTS: All primary care physicians were randomly assigned a group if they were eligible and actively prescribing antibiotics to patients 65 years or older. Physicians were excluded if had already volunteered to receive antibiotic prescribing feedback from another agency, or had opted out of the trial.

INTERVENTION

A letter was mailed in January 2022 to physicians with peer comparison antibiotic prescribing feedback compared with the control group who did not receive a letter (4:1 allocation). The intervention group was further randomised in a 2x2 factorial trial to evaluate case-mix adjusted versus unadjusted comparators, and emphasis, or not, on harms of antibiotics.

MAIN OUTCOME MEASURES

Antibiotic prescribing rate per 1000 patient visits for patients 65 years or older six months after intervention. Analysis was in the modified intention-to-treat population using Poisson regression.

RESULTS

5046 physicians were included and analysed: 1005 in control group and 4041 in intervention group (1016 case-mix adjusted data and harms messaging, 1006 with case-mix adjusted data and no harms messaging, 1006 unadjusted data and harms messaging, and 1013 unadjusted data and no harms messaging). At six months, mean antibiotic prescribing rate was 59.4 (standard deviation 42.0) in the control group and 56.0 (39.2) in the intervention group (relative rate 0.95 (95% confidence interval 0.94 to 0.96). Unnecessary antibiotic prescribing (0.89 (0.86 to 0.92)), prolonged duration prescriptions defined as more than seven days (0.85 (0.83 to 0.87)), and broad spectrum prescribing (0.94 (0.92 to 0.95)) were also significantly lower in the intervention group compared with the control group. Results were consistent at 12 months post intervention. No significant effect was seen for including emphasis on harms messaging. A small increase in antibiotic prescribing with case-mix adjusted reports was noted (1.01 (1.00 to 1.03)).

CONCLUSIONS

Peer comparison audit and feedback letters significantly reduced overall antibiotic prescribing with no benefit of case-mix adjustment or harms messaging. Antibiotic prescribing audit and feedback is a scalable and effective intervention and should be a routine quality improvement initiative in primary care.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04594200.

Introducing Virtual Reality in a STEMI Coronary Syndrome Course: Qualitative Evaluation with Nurses and Doctors

In the increasing number of medical education topics taught with virtual reality (VR), the prehospital management of ST-segment elevation myocardial infarction (STEMI) had not been considered. This article proposes an implemented VR system for STEMI training and introduces it in an institutional course addressed to emergency nurses and case manager (CM) doctors. The system comprises three different applications to, respectively, allow (a) the course instructor to control the conditions of the virtual patient, (b) the CM to communicate with the nurse in the virtual field and receive from him/her the patient's parameters and electrocardiogram, and (c) the nurse to interact with the patient in the immersive VR scenario. We enrolled 17 course participants to collect their perceptions and opinions through a semistructured interview. The thematic analysis showed the system was appreciated (n = 17) and described as engaging (n = 4), challenging (n = 5), useful to improve self-confidence (n = 4), innovative (n = 5), and promising for training courses (n = 10). Realism was also appreciated (n = 13), although with some drawbacks (e.g., oversimplification; n = 5). Overall, participants described the course as an opportunity to share opinions (n = 8) and highlight issues (n = 4) and found it useful for novices (n = 5) and, as a refresh, for experienced personnel (n = 6). Some participants suggested improvements in the scenarios' type (n = 5) and variability (n = 5). Although most participants did not report usage difficulties with the VR system (n = 13), many described the need to get familiar with it (n = 13) and the specific gestures it requires (n = 10). Three suffered from cybersickness.

Does higher performance in a national licensing examination predict better quality of care? A longitudinal observational study of Ethiopian anesthetists

BACKGROUND

Ethiopia made a national licensing examination (NLE) for associate clinician anesthetists a requirement for entry into the practice workforce. However, there is limited empirical evidence on whether the NLE scores of associate clinicians predict the quality of health care they provide in low-income countries. This study aimed to assess the association between anesthetists' NLE scores and three selected quality of patient care indicators.

METHODS

A multicenter longitudinal observational study was conducted between January 8 and February 7, 2023, to collect quality of care (QoC) data on surgical patients attended by anesthetists (n = 56) who had taken the Ethiopian anesthetist NLE since 2019. The three QoC indicators were standards for safe anesthesia practice, critical incidents, and patient satisfaction. The medical records of 991 patients were reviewed to determine the standards for safe anesthesia practice and critical incidents. A total of 400 patients responded to the patient satisfaction survey. Multivariable regressions were employed to determine whether the anesthetist NLE score predicted QoC indicators.

RESULTS

The mean percentage of safe anesthesia practice standards met was 69.14%, and the mean satisfaction score was 85.22%. There were 1,120 critical incidents among 911 patients, with three out of five experiencing at least one. After controlling for patient, anesthetist, facility, and clinical care-related confounding variables, the NLE score predicted the occurrence of critical incidents. For every 1% point increase in the total NLE score, the odds of developing one or more critical incidents decreased by 18% (aOR = 0.82; 95% CI = 0.70 = 0.96; p = 0.016). No statistically significant associations existed between the other two QoC indicators and NLE scores.

CONCLUSION

The NLE score had an inverse relationship with the occurrence of critical incidents, supporting the validity of the examination in assessing graduates' ability to provide safe and effective care. The lack of an association with the other two QoC indicators requires further investigation. Our findings may help improve education quality and the impact of NLEs in Ethiopia and beyond.

Paediatric oncologists' perspectives on Strategic solutions to develop Integrated Cancer Palliative Care: feedback intervention theory as an explanatory Framework

BACKGROUND

Globally, children with cancer often experience delays in palliative care referral or are infrequently referred. Therefore, we conducted a qualitative study to gain insight from paediatric oncologists into what enables or deters palliative care referral. Strategic solutions to develop integrated palliative care was a critical study theme. In this paper, we have explained and interpreted these strategic solutions through the lens of feedback intervention theory.

METHODOLOGY

The study findings were interpreted using Kumar's six-step approach that enabled systematic evaluation of a theory's appropriateness and alignment with the researcher's paradigm, methodology, and study findings. It also explained how theory informed analysis and elucidated challenges or the development of new models. The feedback intervention theory appraises the discrepancy between actual and desired goals and provides feedback to improve it.

RESULTS

Strategic solutions generated from the study findings were coherent with the aspects elucidated in theory, like coping mechanisms, levels of feedback hierarchy, and factors determining the effect of the feedback intervention on performance. Paediatric oncologists suggested integrating palliative care providers in the team innocuously, improving communication between teams, relabelling palliative care as symptom control, and working with a skilled and accessible palliative care team. The paper proposes an infinite loop model developed from the study, which has the potential to foster integrated palliative care through excellent collaboration and continuous feedback.

CONCLUSION

Applying feedback intervention theory can bridge the gap between actual and desired practice for integrated cancer palliative care in paediatric oncology.

Determinants of appropriate antibiotic and NSAID prescribing in unscheduled outpatient settings in the veterans health administration

BACKGROUND

Despite efforts to enhance the quality of medication prescribing in outpatient settings, potentially inappropriate prescribing remains common, particularly in unscheduled settings where patients can present with infectious and pain-related complaints. Two of the most commonly prescribed medication classes in outpatient settings with frequent rates of potentially inappropriate prescribing include antibiotics and nonsteroidal anti-inflammatory drugs (NSAIDs). In the setting of persistent inappropriate prescribing, we sought to understand a diverse set of perspectives on the determinants of inappropriate prescribing of antibiotics and NSAIDs in the Veterans Health Administration.

METHODS

We conducted a qualitative study guided by the Consolidated Framework for Implementation Research and Theory of Planned Behavior. Semi-structured interviews were conducted with clinicians, stakeholders, and Veterans from March 1, 2021 through December 31, 2021 within the Veteran Affairs Health System in unscheduled outpatient settings at the Tennessee Valley Healthcare System. Stakeholders included clinical operations leadership and methodological experts. Audio-recorded interviews were transcribed and de-identified. Data coding and analysis were conducted by experienced qualitative methodologists adhering to the Consolidated Criteria for Reporting Qualitative Studies guidelines. Analysis was conducted using an iterative inductive/deductive process.

RESULTS

We conducted semi-structured interviews with 66 participants: clinicians (N = 25), stakeholders (N = 24), and Veterans (N = 17). We identified six themes contributing to potentially inappropriate prescribing of antibiotics and NSAIDs: 1) Perceived versus actual Veterans expectations about prescribing; 2) the influence of a time-pressured clinical environment on prescribing stewardship; 3) Limited clinician knowledge, awareness, and willingness to use evidence-based care; 4) Prescriber uncertainties about the Veteran condition at the time of the clinical encounter; 5) Limited communication; and 6) Technology barriers of the electronic health record and patient portal.

CONCLUSIONS

The diverse perspectives on prescribing underscore the need for interventions that recognize the detrimental impact of high workload on prescribing stewardship and the need to design interventions with the end-user in mind. This study revealed actionable themes that could be addressed to improve guideline concordant prescribing to enhance the quality of prescribing and to reduce patient harm.

Implementation of an enhanced recovery after surgery protocol for colorectal cancer in a regional hospital network supported by audit and feedback: a stepped wedge, cluster randomised trial

BACKGROUND

Enhanced recovery after surgery (ERAS) protocols are known to potentially improve the management and outcomes of patients undergoing colorectal surgery, with limited evidence of their implementation in hospital networks and in a large population. We aimed to assess the impact of the implementation of an ERAS protocol in colorectal cancer surgery in the entire region of Piemonte, Italy, supported by an audit and feedback (A&F) intervention.

METHODS

A large, stepped wedge, cluster randomised trial enrolled patients scheduled for elective surgery at 29 general surgery units (clusters). At baseline (first 3 months), standard care was continued in all units. Thereafter, four groups of clusters began to adopt the ERAS protocol successively. By the end of the study, each cluster had a period in which standard care was maintained (control) and a period in which the protocol was applied (experimental). ERAS implementation was supported by initial training and A&F initiatives. The primary endpoint was length of stay (LOS) without outliers (>94th percentile), and the secondary endpoints were outliers for LOS, postoperative medical and surgical complications, quality of recovery and compliance with ERAS items.

RESULTS

Of 2626 randomised patients, 2397 were included in the LOS analysis (1060 in the control period and 1337 in the experimental period). The mean LOS without outliers was 8.5 days during the control period (SD 3.9) and 7.5 (SD 3.5) during the experimental one. The adjusted difference between the two periods was a reduction of -0.58 days (95% CI -1.07, -0.09; p=0.021). The compliance with ERAS items increased from 52.4% to 67.3% (estimated absolute difference +13%; 95% CI 11.4%, 14.7%). No difference in the occurrence of complications was evidenced (OR 1.22; 95% CI 0.89, 1.68).

CONCLUSION

Implementation of the ERAS protocol for colorectal cancer, supported by A&F approach, led to a substantial improvement in compliance and a reduction in LOS, without meaningful effects on complications. Trial registration number NCT04037787.

Learning together for better health using an evidence-based Learning Health System framework: a case study in stroke

BACKGROUND

In the context of expanding digital health tools, the health system is ready for Learning Health System (LHS) models. These models, with proper governance and stakeholder engagement, enable the integration of digital infrastructure to provide feedback to all relevant parties including clinicians and consumers on performance against best practice standards, as well as fostering innovation and aligning healthcare with patient needs. The LHS literature primarily includes opinion or consensus-based frameworks and lacks validation or evidence of benefit. Our aim was to outline a rigorously codesigned, evidence-based LHS framework and present a national case study of an LHS-aligned national stroke program that has delivered clinical benefit.

MAIN TEXT

Current core components of a LHS involve capturing evidence from communities and stakeholders (quadrant 1), integrating evidence from research findings (quadrant 2), leveraging evidence from data and practice (quadrant 3), and generating evidence from implementation (quadrant 4) for iterative system-level improvement. The Australian Stroke program was selected as the case study as it provides an exemplar of how an iterative LHS works in practice at a national level encompassing and integrating evidence from all four LHS quadrants. Using this case study, we demonstrate how to apply evidence-based processes to healthcare improvement and embed real-world research for optimising healthcare improvement. We emphasize the transition from research as an endpoint, to research as an enabler and a solution for impact in healthcare improvement.

CONCLUSIONS

The Australian Stroke program has nationally improved stroke care since 2007, showcasing the value of integrated LHS-aligned approaches for tangible impact on outcomes. This LHS case study is a practical example for other health conditions and settings to follow suit.

Disparities in Access to Deep Brain Stimulation for Parkinson's Disease and Proposed Interventions: A Literature Review

BACKGROUND

Deep brain stimulation (DBS) is an effective therapy for Parkinson's disease (PD), but disparities exist in access to DBS along gender, racial, and socioeconomic lines.

SUMMARY

Women are underrepresented in clinical trials and less likely to undergo DBS compared to their male counterparts. Racial and ethnic minorities are also less likely to undergo DBS procedures, even when controlling for disease severity and other demographic factors. These disparities can have significant impacts on patients' access to care, quality of life, and ability to manage their debilitating movement disorders.

KEY MESSAGES

Addressing these disparities requires increasing patient awareness and education, minimizing barriers to equitable access, and implementing diversity and inclusion initiatives within the healthcare system. In this systematic review, we first review literature discussing gender, racial, and socioeconomic disparities in DBS access and then propose several patient, provider, community, and national-level interventions to improve DBS access for all populations.

Evaluating a Physician Audit and Feedback Intervention to Increase Clinical Trial Enrollment in Radiation Oncology in a Multisite Tertiary Cancer Center: A Randomized Study

PURPOSE

Clinical trial participation continues to be low, slowing new cancer therapy development. Few strategies have been prospectively tested to address barriers to enrollment. We investigated the effectiveness of a physician audit and feedback report to improve clinical trial enrollment.

METHODS AND MATERIALS

We conducted a randomized quality improvement study among radiation oncologists at a multisite tertiary cancer network. Physicians in the intervention group received quarterly audit and feedback reports comparing the physician's trial enrollments with those of their peers. The primary outcome was trial enrollments.

RESULTS

Among physicians randomized to receive the feedback report (n = 30), the median proportion of patients enrolled during the study period increased to 6.1% (IQR, 2.6%-9.3%) from 3.2% (IQR, 1.1%-10%) at baseline. Among those not receiving the feedback report (n = 29), the median proportion of patients enrolled increased to 4.1% (IQR, 1.3%-7.6%) from 1.6% (IQR, 0%-4.1%) at baseline. There was a nonsignificant change in the proportion of enrollments associated with receiving the feedback report (-0.6%; 95% CI, -3.0% to 1.8%; P = .6). Notably, there was an interaction between baseline trial accrual and receipt of feedback reports (P = .005), with enrollment declining among high accruers. There was an increase in enrollment throughout the study, regardless of study group (P = .001).

CONCLUSIONS

In this study, a positive effect of physician audit and feedback on clinical trial enrollment was not observed. Future efforts should avoid disincentivizing high accruers and might consider pairing feedback with other patient- or physician-level strategies. The increase in trial enrollment in both groups over time highlights the importance of including a comparison group in quality improvement studies to reduce confounding from secular trends.

Evaluating feedback reports to support documentation of veterans' care preferences in home based primary care

BACKGROUND

To evaluate the effectiveness of delivering feedback reports to increase completion of LST notes among VA Home Based Primary Care (HBPC) teams. The Life Sustaining Treatment Decisions Initiative (LSTDI) was implemented throughout the Veterans Health Administration (VHA) in the United States in 2017 to ensure that seriously ill Veterans have care goals and LST decisions elicited and documented.

METHODS

We distributed monthly feedback reports summarizing LST template completion rates to 13 HBPC intervention sites between October 2018 and February 2020 as the sole implementation strategy. We used principal component analyses to match intervention to 26 comparison sites and used interrupted time series/segmented regression analyses to evaluate the differences in LST template completion rates between intervention and comparison sites. Data were extracted from national databases for VA HBPC in addition to interviews and surveys in a mixed methods process evaluation.

RESULTS

LST template completion rose from 6.3 to 41.9% across both intervention and comparison HBPC teams between March 1, 2018, and February 26, 2020. There were no statistically significant differences for intervention sites that received feedback reports.

CONCLUSIONS

Feedback reports did not increase documentation of LST preferences for Veterans at intervention compared with comparison sites. Observed increases in completion rates across intervention and comparison sites can likely be attributed to implementation strategies used nationally as part of the national roll-out of the LSTDI. Our results suggest that feedback reports alone were not an effective implementation strategy to augment national implementation strategies in HBPC teams.

Implementation Strategies to Promote Short-Course Radiation for Bone Metastases

Importance

For patients with nonspine bone metastases, short-course radiotherapy (RT) can reduce patient burden without sacrificing clinical benefit. However, there is great variation in uptake of short-course RT across practice settings.

Objective

To evaluate whether a set of 3 implementation strategies facilitates increased adoption of a consensus recommendation to treat nonspine bone metastases with short-course RT (ie, ≤5 fractions).

Design, Setting, and Participants

This prospective, stepped-wedge, cluster randomized quality improvement study was conducted at 3 community-based cancer centers within an existing academic-community partnership. Rollout was initiated in 3-month increments between October 2021 and May 2022. Participants included treating physicians and patients receiving RT for nonspine bone metastases. Data analysis was performed from October 2022 to May 2023.

Exposures

Three implementation strategies-(1) dissemination of published consensus guidelines, (2) personalized audit-and-feedback reports, and (3) an email-based electronic consultation platform (eConsult)-were rolled out to physicians.

Main Outcomes and Measures

The primary outcome was adherence to the consensus recommendation of short-course RT for nonspine bone metastases. Mixed-effects logistic regression at the bone metastasis level was used to model associations between the exposure of physicians to the set of strategies (preimplementation vs postimplementation) and short-course RT, while accounting for patient and physician characteristics and calendar time, with a random effect for physician. Physician surveys were administered before implementation and after implementation to assess feasibility, acceptability, and appropriateness of each strategy.

Results

Forty-five physicians treated 714 patients (median [IQR] age at treatment start, 67 [59-75] years; 343 women [48%]) with 838 unique nonspine bone metastases during the study period. Implementing the set of strategies was not associated with use of short-course RT (odds ratio, 0.78; 95% CI, 0.45-1.34; P = .40), with unadjusted adherence rates of 53% (444 lesions) preimplementation vs 56% (469 lesions) postimplementation; however, the adjusted odds of adherence increased with calendar time (odds ratio, 1.68; 95% CI, 1.20-2.36; P = .003). All 3 implementation strategies were perceived as being feasible, acceptable, and appropriate; only the perception of audit-and-feedback appropriateness changed before vs after implementation (19 of 29 physicians [66%] vs 27 of 30 physicians [90%]; P = .03, Fisher exact test), with 20 physicians (67%) preferring reports quarterly.

Conclusions and Relevance

In this quality improvement study, a multicomponent set of implementation strategies was not associated with increased use of short-course RT within an academic-community partnership. However, practice improved with time, perhaps owing to secular trends or physician awareness of the study. Audit-and-feedback was more appropriate than anticipated. Findings support the need to investigate optimal approaches for promoting evidence-based radiation practice across settings.

Intervention for reducing the overuse of upper endoscopy in patients <45 years: a protocol for a stepwise intervention programme

Utilisation rates for healthcare services vary widely both within and between nations. Moreover, healthcare providers with insurance-based reimbursement systems observe an effect of social determinants of health on healthcare utilisation rates and outcomes. Even in countries with publicly funded universal healthcare such as Norway, utilisation rates for medical and surgical interventions vary between and within health regions and hospitals.Most interventions targeting overuse and high utilisation rates are based on the assumption that knowledge of areas of unwarranted variation in healthcare automatically will lead to a reduction in unwarranted variation. Recommendations regarding how to reduce this variation are often not very detailed or prominent.This paper describes a protocol for reducing the overuse of upper endoscopy in a Norwegian health region. The protocol uses a combination of digital tools and psychological methods targeting behavioural change in order to alter healthcare workers' approach to patient care.The aim of the planned intervention is to evaluate the effectiveness of a multifaceted set of interventions to reduce the overuse of upper endoscopy in patients under 45 years. A secondary aim is to evaluate the specific effect of the various parts of the intervention.

Feasibility of a quality-improvement program based on routinely collected health outcomes in Dutch primary care physical therapist practice: a mixed-methods study

BACKGROUND

This study evaluates the feasibility of a nine-month advanced quality-improvement program aimed at enhancing the quality of care provided by primary care physical therapists in the Netherlands. The evaluation is based on routinely collected health outcomes of patients with nonspecific low back pain, assessing three feasibility domains: (1) appropriateness, feasibility, and acceptability for quality-improvement purposes; (2) impact on clinical performance; and (3) impact on learning and behavioral change.

METHODS

A mixed-methods quality-improvement study using a concurrent triangulation design was conducted in primary care physical therapist practice. Feedback reports on the processes and outcomes of care, peer assessment, and self-assessment were used in a Plan-Do-Study-Act cycle based on self-selected goals. The program's appropriateness, feasibility, and acceptability, as well as the impact on clinical performance, were evaluated using the Intervention Appropriate Measure, Feasibility Intervention Measure, Acceptability Intervention Measure (for these three measure, possible scores range from 4 to 20), and with a self-assessment of clinical performance (scored 0-10), respectively. The impact on learning and behavioral change was evaluated qualitatively with a directed content analysis.

RESULTS

Ten physical therapists from two practices participated in this study. They rated the program with a mean of 16.5 (SD 1.9) for appropriateness, 17.1 (SD 2.2) for feasibility, and 16.4 (SD 1.5) for acceptability. Participants gave their development in clinical performance a mean score of 6.7 (SD 1.8). Participants became aware of the potential value of using outcome data and gained insight into their own routines and motivations. They changed their data collection routines, implemented data in their routine practice, and explored the impact on their clinical behavior.

CONCLUSIONS

This explorative study demonstrated that a quality-improvement program, using health outcomes from a national registry, is judged to be feasible.

IMPACT STATEMENT

This study provides preliminary evidence on how physical therapists may use health outcomes to improve their quality, which can be further used in initiatives to improve outcome-based care in primary physical therapy.

Using the WHO individual near miss case review (NMCR) cycle to improve quality of emergency obstetric care and maternal outcome in Keren hospital, Eritrea: an interrupted time series analysis

BACKGROUND

In 2016, the WHO regional office for Europe prepared a manual for conducting routine facility based individual near miss case review cycle. This study evaluates the effectiveness of the individual near miss case review (NMCR) cycle in improving quality of emergency obstetric care and maternal outcome in Keren hospital.

METHODS

An interrupted time series design was used to achieve the objectives of this study. Monthly data on women with potentially life-threatening conditions (PLTCs) admitted between April 2018 and October 2022 (i.e. 33 months pre-implementation and 22 months post-implementation) were collected from medical records. Segmented regression analysis was used to assess the intervention's effect on three process and outcome measures, namely, SMO, delayed care, and substandard care. The intervention was expected a priori to show immediate improvements without time-lag followed by gradual increment in slope. Segmented regression analyses were performed using the "itsa' command in STATA.

RESULTS

During the entire study period, 4365 women with potentially life threatening conditions were identified. There was a significant reduction in the post-implementation period in the proportion of mothers with PLTC who experienced SMO (- 8.86; p <  0.001), delayed care (- 8.76; p <  0.001) and substandard care (- 5.58; p <  0.001) compared to pre-implementation period. Results from the segmented regression analysis revealed that the percentage of women with SMO showed a significant 4.75% (95% CI: - 6.95 to - 2.54, p <  0.001) reduction in level followed by 0.28 percentage points monthly (95% CI: - 0.37 to - 0.14, p <  0.001) drop in trend. Similarly, a significant drop of 3.50% (95% CI: - 4.74 to - 2.26, p <  0.001) in the level of substandard care along with a significant decrease of 0.21 percentage points (95% CI: - 0.28 to - 0.14, p < 0.001) in the slope of the regression line was observed. The proportion of women who received delayed care also showed a significant 7% (95% CI: - 9.28 to - 4.68, p < 0.001) reduction in post-implementation level without significant change in slope.

CONCLUSIONS

Our findings suggest that the WHO individual NMCR cycle was associated with substantial improvements in quality of emergency obstetric care and maternal outcome. The intervention also bears a great potential for scaling-up following the guidance provided in the WHO NMCR manual.

Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation

BACKGROUND

Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients' experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM.

OBJECTIVE

This study examined the usability of an electronic real-time measurement system to monitor surgical patients' experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction.

METHODS

We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients' experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction).

RESULTS

A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access.

CONCLUSIONS

A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients' experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2023-079155.

Developing a questionnaire to evaluate an automated audit & feedback intervention: a Rand-modified Delphi method

BACKGROUND

Audit and feedback (A&F) is a widely used implementation strategy to evaluate and improve medical practice. The optimal design of an A&F system is uncertain and structured process evaluations are currently lacking. This study aimed to develop and validate a questionnaire to evaluate the use of automated A&F systems.

METHODS

Based on the Clinical Performance Feedback Intervention Theory (CP-FIT) and the REFLECT-52 (REassessing audit & Feedback interventions: a tooL for Evaluating Compliance with suggested besT practices) evaluation tool a questionnaire was designed for the purpose of evaluating automated A&F systems. A Rand-modified Delphi method was used to develop the process evaluation and obtain validation. Fourteen experts from different domains in primary care consented to participate and individually scored the questions on a 9-point Likert scale. Afterwards, the questions were discussed in a consensus meeting. After approval, the final questionnaire was compiled.

RESULTS

A 34-question questionnaire composed of 57 items was developed and presented to the expert panel. The consensus meeting resulted in a selection of 31 questions, subdivided into 43 items. A final list of 30 questions consisting of 42 items was obtained.

CONCLUSION

A questionnaire consisting of 30 questions was drawn up for the assessment and improvement of automated A&F systems, based on CP-FIT and REFLECT-52 theory and approved by experts. Next steps will be piloting and implementation of the questionnaire.