Audit and feedback: effects on professional practice and health care outcomes

Using audit and feedback to increase clinician adherence to clinical practice guidelines in brain injury rehabilitation: A before and after study

OBJECTIVE

This study evaluated whether frequent (fortnightly) audit and feedback cycles over a sustained period of time (>12 months) increased clinician adherence to recommended guidelines in acquired brain injury rehabilitation.

DESIGN

A before and after study design.

SETTING

A metropolitan inpatient brain injury rehabilitation unit.

PARTICIPANTS

Clinicians; medical, nursing and allied health staff.

INTERVENTIONS

Fortnightly cycles of audit and feedback for 14 months. Each fortnight, medical file and observational audits were completed against 114 clinical indicators.

MAIN OUTCOME MEASURE

Adherence to guideline indicators before and after intervention, calculated by proportions, Mann-Whitney U and Chi square analysis.

RESULTS

Clinical and statistical significant improvements in median clinical indicator adherence were found immediately following the audit and feedback program from 38.8% (95% CI 34.3 to 44.4) to 83.6% (95% CI 81.8 to 88.5). Three months after cessation of the intervention, median adherence had decreased from 82.3% to 76.6% (95% CI 72.7 to 83.3, p<0.01). Findings suggest that there are individual indicators which are more amenable to change using an audit and feedback program.

CONCLUSION

A fortnightly audit and feedback program increased clinicians' adherence to guideline recommendations in an inpatient acquired brain injury rehabilitation setting. We propose future studies build on the evidence-based method used in the present study to determine effectiveness and develop an implementation toolkit for scale-up.

Improving perioperative pain management: a preintervention and postintervention study in 7 developing countries

Supplemental Digital Content is Available in the Text.

Introduction:

The burden of untreated postoperative pain is high.

Objective:

This study assessed feasibility of using quality improvement (QI) tools to improve management of perioperative pain in hospitals in multiple developing countries.

Methods:

The International Pain Registry and Developing Countries working groups, from the International Association for the Study of Pain (IASP), sponsored the project and PAIN OUT, a QI and research network, coordinated it, and provided the research tools. The IASP published a call about the project on its website. Principal investigators (PIs) were responsible for implementing a preintervention and postintervention study in 1 to 2 surgical wards in their hospitals, and they were free to choose the QI intervention. Trained surveyors used standardized and validated web-based tools for collecting findings about perioperative pain management and patient reported outcomes (PROs). Four processes and PROs, independent of surgery type, assessed effectiveness of the interventions.

Results:

Forty-three providers responded to the call; 13 applications were selected; and PIs from 8 hospitals, in 14 wards, in 7 countries, completed the study. Interventions focused on teaching providers about pain management. Processes improved in 35% and PROs in 37.5% of wards.

Conclusions:

The project proved useful on multiple levels. It offered PIs a framework and tools to perform QI work and findings to present to colleagues and administration. Management practices and PROs improved on some wards. Interpretation of change proved complex, site-dependent, and related to multiple factors. PAIN OUT gained experience coordinating a multicentre, international QI project. The IASP promoted research, education, and QI work.

Reducing inappropriate antibiotic prescribing in upper respiratory tract infection in a primary care setting in Kolkata, India

Inappropriate antibiotic use is a key factor in the emergence of antibiotic resistance. The majority of antibiotics are prescribed in primary care, where upper respiratory tract infection (URTI) is a common presentation. Inappropriate antibiotic prescribing in URTI is common globally and has increased markedly in developing and transitional countries. Antibiotic stewardship is crucial to prevent the emergence and spread of resistant microbes. This project aimed to reduce inappropriate antibiotic prescribing in URTI in a non-governmental organisation’s primary care outreach clinics in Kolkata, India, from 62.6% to 30% over 4 months. A multifaceted intervention to reduce inappropriate antibiotic use in non-specific URTI was implemented. This consisted of a repeated process of audit and feedback, interactive training sessions, one-to-one case-based discussion, antibiotic guideline development and coding updates. The primary outcome measure was antibiotic prescribing rates. A baseline audit of all patients presenting with non-specific URTI over 8 weeks in November and December 2016 (n=222) found that 62.6% were prescribed antibiotics. Postintervention audit over 4 weeks in April 2017 (n=69) showed a marked reduction in antibiotic prescribing to 7.2%. An increase in documentation of examination findings was also observed, from 52.7% to 95.6%. This multifaceted intervention was successful at reducing inappropriate antibiotic prescribing, with sustained reductions demonstrated over the 4 months of the project. This suggests that approaches previously used in Europe can successfully be applied to different settings.

Implementation of multimodal infection control and hand hygiene strategies in acute-care hospitals in Greece: A cross-sectional benchmarking survey

BACKGROUND

In this first attempt to suggest achievable standards for improvement in hospital infection prevention and control (IPC) in Greece, we assessed main IPC structure and process indicators emphasizing hand hygiene.

METHODS

Acute-care hospitals across the country participated in a cross-sectional survey by completing the World Health Organization Hand Hygiene Self-assessment Framework (HHSAF) and by providing hospital-level IPC indicators.

RESULTS

Seventeen hospitals completed the survey, comprising 14% of the country's public hospitals. Median IPC staffing levels were 0.8 nurses and 0.5 doctors per 250 beds. Few hospitals implemented full multimodal IPC programs. The HHSAF indicated that appropriate hand hygiene practices and promotion strategies were in place in most hospitals, but the mean HHSAF score of 289 was lower compared with studies in Italy (mean, 332; P = .040) and the United States (mean, 373; P < .001). Presence of 1 additional IPC nurse was independently associated with increases of 53% in the HHSAF median score for training-education (P = .035) and by 38% in the lower 30th percentile HHSAF score for safety climate (P = .049).

CONCLUSIONS

Surveyed hospitals are, on average, at an intermediate level in hand hygiene practice but require improvements on training-education, evaluation-feedback, and safety climate. Ensuring adequate IPC nurse staffing levels and systematically implementing multimodal IPC programs may lead to substantial improvements.

Basic Accountability to Stop Ill-Treatment (BASI); Study Protocol for a Cluster Randomized Controlled Trial in Rural Tanzania

Background: Poor health system experiences negatively affect the lives of poor people throughout the world. In East Africa, there is a growing body of evidence of poor quality care that in some cases is so poor that it is disrespectful or abusive. This study will assess whether community feedback through report cards (with and without non-financial rewards) can improve patient experience, which includes aspects of patient dignity, autonomy, confidentiality, communication, timely attention, quality of basic amenities, and social support.

Methods/Design: This cluster-randomized controlled study will randomize 75 primary health care facilities in rural Pwani Region, Tanzania to one of three arms: private feedback (intervention), social recognition reward through public reporting (intervention), or no feedback (control). Within both intervention arms, we will give the providers at the study facilities feedback on the quality of patient experience the facility provides (aggregate results from all providers) using data from patient surveys. The quality indicators that we report will address specific experiences, be observable by patients, fall into well-identified domains of patient experience, and be within the realm of action by healthcare providers. For example, we will measure the proportion of patients who report that providers definitely “explained things in a way that was easy to understand.” This feedback will be delivered by a medical doctor to all the providers at the facility in a small group session. A formal discussion guide will be used. Facilities randomized to the social recognition intervention reward arm will have two additional opportunities for social recognition. First, a poster that displays their achieved level of patient experience will be publicly posted at the health facility and village government offices. Second, recognition from senior officials at the local NGO and/or the Ministry of Health will be given to the facility with the best or most-improved patient experience ratings at endline. We will use surveys with parents/guardians of sick children to measure patient experience, and surveys with healthcare providers to assess potential mechanisms of effect.

Conclusion: Results from this study will provide evidence for whether, and through what mechanisms, patient reported feedback can affect interpersonal quality of care.

Pan African Clinical Trials Registry (PACTR): 201710002649121 Protocol version 7, November 8, 2017

Statistical analysis plan for the Healthy Hands Project; single centre cluster-randomised clinical trial of a skin care program for the prevention of contact dermatitis in health care workers

BACKGROUND

The Healthy Hands Project (HHP) is a randomised clinical trial aiming to determine the effectiveness of an intervention program in the prevention of hand dermatitis in healthcare workers (HCWs). The intervention is comprised of placing dispensers with hand creams on wards combined with continuous electronic monitoring of cream consumption and regular feedback to HCWs. The clinical severity (HECSI score) was used as the primary outcome and natural moisturising factor (NMF) levels as the secondary outcome. The study protocol for the cluster-randomised controlled trial of HHP was published in Trials in 2017. This article describes the detailed statistical analysis plan for the HHP trial.

METHODS/DESIGN

The HHP is a single-centre, cluster-randomised controlled trial with two parallel groups and blinded outcome assessment. This update article presents (1) the descriptive statistics of the primary and secondary outcomes, (2) the statistical models used for the analysis of the main outcomes, (3) sensitivity analyses on the effect of observed exposure to wet work, (4) handling of missing data including sensitivity analysis and (5) an updated power calculation. This statistical analysis plan was written prior to unblinding of the study.

DISCUSSION

This paper presents a comprehensive statistical analysis plan for the data resulting from the HHP trial. It supports transparency in reporting by clarifying differences between the previously published protocol and the proposed actual statistical analyses.

TRIAL REGISTRATION

Netherlands Trial Register (NTR), identification number NTR5564 . Registered on 2 November 2015.

The impact of a prescription review and prescriber feedback system on prescribing practices in primary care clinics: a cluster randomised trial

BACKGROUND

To evaluate the effectiveness of a structured prescription review and prescriber feedback program in reducing prescribing errors in government primary care clinics within an administrative region in Malaysia.

METHODS

This was a three group, pragmatic, cluster randomised trial. In phase 1, we randomised 51 clinics to a full intervention group (prescription review and league tables plus authorised feedback letter), a partial intervention group (prescription review and league tables), and a control group (prescription review only). Prescribers in these clinics were the target of our intervention. Prescription reviews were performed by pharmacists; 20 handwritten prescriptions per prescriber were consecutively screened on a random day each month, and errors identified were recorded in a standardised data collection form. Prescribing performance feedback was conducted at the completion of each prescription review cycle. League tables benchmark prescribing errors across clinics and individual prescribers, while the authorised feedback letter detailed prescribing performance based on a rating scale. In phase 2, all clinics received the full intervention. Pharmacists were trained on data collection, and all data were audited by researchers as an implementation fidelity strategy. The primary outcome, percentage of prescriptions with at least one error, was displayed in p-charts to enable group comparison.

RESULTS

A total of 32,200 prescriptions were reviewed. In the full intervention group, error reduction occurred gradually and was sustained throughout the 8-month study period. The process mean error rate of 40.7% (95% CI 27.4, 29.5%) in phase 1 reduced to 28.4% (95% CI 27.4, 29.5%) in phase 2. In the partial intervention group, error reduction was not well sustained and showed a seasonal pattern with larger process variability. The phase 1 error rate averaging 57.9% (95% CI 56.5, 59.3%) reduced to 44.8% (95% CI 43.3, 46.4%) in phase 2. There was no evidence of improvement in the control group, with phase 1 and phase 2 error rates averaging 41.1% (95% CI 39.6, 42.6%) and 39.3% (95% CI 37.8, 40.9%) respectively.

CONCLUSIONS

The rate of prescribing errors in primary care settings is high, and routine prescriber feedback comprising league tables and a feedback letter can effectively reduce prescribing errors.

TRIAL REGISTRATION

National Medical Research Register: NMRR-12-108-11,289 (5th March 2012).

Pay-for-performance as a cost-effective implementation strategy: results from a cluster randomized trial

BACKGROUND

Pay-for-performance (P4P) has been recommended as a promising strategy to improve implementation of high-quality care. This study examined the incremental cost-effectiveness of a P4P strategy found to be highly effective in improving the implementation and effectiveness of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment (EBT) for adolescent substance use disorders (SUDs).

METHODS

Building on a $30 million national initiative to implement A-CRA in SUD treatment settings, urn randomization was used to assign 29 organizations and their 105 therapists and 1173 patients to one of two conditions (implementation-as-usual (IAU) control condition or IAU+P4P experimental condition). It was not possible to blind organizations, therapists, or all research staff to condition assignment. All treatment organizations and their therapists received a multifaceted implementation strategy. In addition to those IAU strategies, therapists in the IAU+P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions found to be associated with significantly improved patient outcomes (target A-CRA). Incremental cost-effectiveness ratios (ICERs), which represent the difference between the two conditions in average cost per treatment organization divided by the corresponding average difference in effectiveness per organization, and quality-adjusted life years (QALYs) were the primary outcomes.

RESULTS

At trial completion, 15 organizations were randomized to the IAU condition and 14 organizations were randomized to the IAU+P4P condition. Data from all 29 organizations were analyzed. Cluster-level analyses suggested the P4P strategy led to significantly higher average total costs compared to the IAU control condition, yet this average increase of 5% resulted in a 116% increase in the average number of months therapists demonstrated competence in treatment delivery (ICER = $333), a 325% increase in the average number of patients who received the targeted dosage of treatment (ICER = $453), and a 325% increase in the number of days of abstinence per patient in treatment (ICER = $8.134). Further supporting P4P as a cost-effective implementation strategy, the cost per QALY was only $8681 (95% confidence interval $1191-$16,171).

CONCLUSION

This study provides experimental evidence supporting P4P as a cost-effective implementation strategy.

TRIAL REGISTRATION

NCT01016704 .

Disseminating, implementing, and evaluating patient-centered outcomes to improve cardiovascular care using a stepped-wedge design: healthy hearts for Oklahoma

Background

Cardiovascular disease (CVD) is the leading cause of death in the US and incurs high health care costs. While many initiatives promote the implementation of ABCS (aspirin therapy, blood pressure control, cholesterol management, and smoking cessation) measures, most primary care practices (PCPs) lack quality improvement (QI) support and resources to achieve meaningful targets. The Healthy Hearts for Oklahoma (H2O) Study proposes to build a QI infrastructure by (1) constructing a sustainable Oklahoma Primary Healthcare Improvement Collaborative (OPHIC) to support dissemination and implementation (D&I) of QI methods; (2) providing QI support in PCPs to better manage patients at risk for CVD events. Parallel to infrastructure building, H2O aims to conduct a comprehensive evaluation of the QI support D&I in primary care and assess the relationship between QI support uptake and changes in ABCS measures.

Methods

H2O has partnered with public health agencies and communities to build OPHIC and facilitate QI. H2O has 263 small primary care practices across Oklahoma that receive the bundled QI intervention to improve ABCS performance. A stepped-wedge designed is used to evaluate D&I of QI support. Changes in ABCS measures will be estimated as a function of various components of the QI support and capacity and readiness of PCPs to change. Notes from academic detailing and practice facilitation sessions will be analyzed to help interpret findings on ABCS performance.

Discussion

H2O program is designed to improve cardiovascular health and outcomes for more than 1.25 million Oklahomans. The infrastructure established as a result of this funding will help reach medically underserved Oklahomans, particularly among rural and tribal populations. Lessons learned from this project will guide future strategies for D&I of evidence-based practices in PCPs. Trained practice facilitators will continue to serve as critical resource to assists small, rural PCPs in adapting to the ever-changing health environment and continue to deliver quality care to their communities.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3189-4) contains supplementary material, which is available to authorized users.

Prevalence, outcome and quality of care among children hospitalized with severe acute malnutrition in Kenyan hospitals: A multi-site observational study

Background

Severe acute malnutrition (SAM) remains a major cause of admission and inpatient mortality worldwide in children aged less than 5 years. In this study, we explored SAM prevalence and outcomes in children admitted in 13 Kenyan hospitals participating in a Clinical Information Network (CIN). We also describe their immediate in-patient management.

Methods

We analyzed data for children aged 1–59 months collected retrospectively from medical records after discharge. Mean, median and ranges were used to summarize pooled and age-specific prevalence and mortality associated with SAM. Documentation of key signs and symptoms (S/S) and performance of indicators of quality of care for selected aspects of the WHO management steps were assessed. Logistic regression models were used to evaluate associations between documented S/S and mortality among SAM patients aged 6–59 months. Loess curves were used to explore performance change over time for indicators of selected SAM management steps.

Results

5306/54140 (9.8%) children aged 1–59 months admitted with medical conditions in CIN hospitals between December 2013 and November 2016 had SAM. SAM prevalence identified by clinicians and case fatality varied widely across hospitals with median proportion (range) of 10.1% (4.6–18.2%) and 14.8% (6.0–28.6%) respectively. Seventeen variables were associated with increased mortality. Performance change over time of management steps varied across hospitals and across selected indicators but suggests some effect of regular audit and feedback.

Conclusion

Identification of SAM patients, their mortality and adherence to in-patient management recommendations varied across hospitals. An important group of SAM patients are aged less than 6 months. Continued efforts are required to improve management of SAM in routine settings as part of efforts to reduce inpatient mortality.

Practice Facilitator Strategies for Addressing Electronic Health Record Data Challenges for Quality Improvement: EvidenceNOW

PURPOSE

Practice facilitators ("facilitators") can play an important role in supporting primary care practices in performing quality improvement (QI), but they need complete and accurate clinical performance data from practices' electronic health records (EHR) to help them set improvement priorities, guide clinical change, and monitor progress. Here, we describe the strategies facilitators use to help practices perform QI when complete or accurate performance data are not available.

METHODS

Seven regional cooperatives enrolled approximately 1500 small-to-medium-sized primary care practices and 136 facilitators in EvidenceNOW, the Agency for Healthcare Research and Quality's initiative to improve cardiovascular preventive services. The national evaluation team analyzed qualitative data from online diaries, site visit field notes, and interviews to discover how facilitators worked with practices on EHR data challenges to obtain and use data for QI.

RESULTS

We found facilitators faced practice-level EHR data challenges, such as a lack of clinical performance data, partial or incomplete clinical performance data, and inaccurate clinical performance data. We found that facilitators responded to these challenges, respectively, by using other data sources or tools to fill in for missing data, approximating performance reports and generating patient lists, and teaching practices how to document care and confirm performance measures. In addition, facilitators helped practices communicate with EHR vendors or health systems in requesting data they needed. Overall, facilitators tailored strategies to fit the individual practice and helped build data skills and trust.

CONCLUSION

Facilitators can use a range of strategies to help practices perform data-driven QI when performance data are inaccurate, incomplete, or missing. Support is necessary to help practices, particularly those with EHR data challenges, build their capacity for conducting data-driven QI that is required of them for participating in practice transformation and performance-based payment programs. It is questionable how practices with data challenges will perform in programs without this kind of support.

Systematic review of interventions to increase the provision of care for chronic disease risk behaviours in mental health settings: review protocol

BACKGROUND

People with a mental illness experience a higher morbidity and mortality from chronic diseases relative to the general population. A higher prevalence of risk behaviours, including tobacco smoking, poor nutrition, harmful alcohol consumption and physical inactivity, is a substantial contributor to this health inequity. Clinical practice guidelines recommend that mental health services routinely provide care to their clients to address these risk behaviours. Such care may include the following elements: ask, assess, advise, assist and arrange (the '5As'), which has been demonstrated to be effective in reducing risk behaviours. Despite this potential, the provision of such care is reported to be low internationally and in Australia, and there is a need to identify effective strategies to increase care provision. The proposed review will examine the effectiveness of interventions which aimed to increase care provision (i.e. increase the proportion of clients receiving or clinicians providing the 5As) for the chronic disease risk behaviours of clients within the context of mental health service delivery.

METHODS

Eligible studies will be any quantitative study designs with a comparison group and which report on the effectiveness of an intervention strategy (including delivery arrangements, financial arrangements, governance arrangements and implementation strategies) to increase care provision specifically for chronic disease risk behaviours (tobacco smoking, poor nutrition, harmful alcohol consumption and physical inactivity). Screening for studies will be conducted across seven electronic databases: PsycINFO, MEDLINE, Excerpta Medica database (EMBASE), Psychology and Behavioural Sciences Collection, Scopus, Cochrane Central Register of Controlled Trials (CENTRAL) and Cumulative Index to Nursing and Allied Health Literature (CINAHL). Two authors will independently screen studies for eligibility and extract data from included studies. Where studies are sufficiently homogenous, meta-analysis will be performed. Where considerable heterogeneity exists (I 2  ≥ 75), narrative synthesis will be used.

DISCUSSION

This review will be the first to synthesise evidence for the effectiveness of intervention approaches to facilitate care provision for chronic disease risk behaviours in the context of mental health service delivery. The results have the potential to inform the development of evidenced-based approaches to address the health inequities experienced by this population group.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42017074360 .

Characteristics of GPs responding to an educational intervention to minimise inappropriate prescriptions: subgroup analyses of the Rx-PAD study

Background

Interventions aimed at improving GPs’ prescribing practice usually apply a 'one size fits all' when analysing intervention effects. Few studies explore intervention effects by variables related to the GPs’ age, sex, specialist status, practice type (single-handed versus group), practice setting (urban versus rural), and baseline performance regarding the target of an intervention.

Aim

To explore the characteristics of the GPs responding to a comprehensive educational intervention.

Design & setting

A secondary analysis of a cluster, randomised educational intervention in Norwegian general practice. Pre-intervention data were captured from January 2005 to December 2005, and post-intervention data from June 2006 to June 2007. The intervention was carried out from January to June 2006.

Method

Eighty continuing medical education (CME) groups, including 449 GPs aged 27–68 years, were randomly allocated to either an education intervention arm (41 groups, 250 GPs) or a control arm (39 groups, 199 GPs). The primary outcome was GPs' change in potentially inappropriate prescriptions (PIPs) per 100 prescriptions issued to patients aged ≥70 years. The interaction between intervention outcome and variables related to the GPs and their practices were tested.

Results

Improvements in prescribing were highest among GPs aged 57–68 years (incidence rate ratio [IRR] = 0.77 [95% confidence interval {CI} = 0.73 to 0.81]), those who were specialists (IRR = 0.80 [95% CI = 0.78 to 0.82]), and those who worked in single-handed practices (IRR = 0.75 [95% CI = 0.68 to 0.83]), among GPs with 2.4 to 2.9 PIPs per 100 prescriptions at baseline (IRR = 0.74 [95% CI = 0.70 to 0.78]), and GPs with ≥15 prescriptions per patient per year at baseline (IRR = 0.77 [95% CI = 0.73 to 0.80]).

Conclusion

The GPs with the lowest adherence to recommended practice at baseline improved their practice most.

Doctors on the move: a European case study on the key characteristics of national recertification systems

OBJECTIVES

With increased cross-border movement, ensuring safe and high-quality healthcare has gained primacy. The purpose of recertification is to ensure quality of care through periodically attesting doctors' professional proficiency in their field. Professional migration and facilitated cross-border recognition of qualifications, however, make us question the fitness of national policies for safeguarding patient care and the international accountability of doctors.

DESIGN AND SETTING

We performed document analyses and conducted 19 semistructured interviews to identify and describe key characteristics and effective components of 10 different European recertification systems, each representing one case (collective case study). We subsequently compared these systems to explore similarities and differences in terms of assessment criteria used to determine process quality.

RESULTS

Great variety existed between countries in terms and assessment formats used, targeting cognition, competence and performance (Miller's assessment pyramid). Recertification procedures and requirements also varied significantly, ranging from voluntary participation in professional development modules to the mandatory collection of multiple performance data in a competency-based portfolio. Knowledge assessment was fundamental to recertification in most countries. Another difference concerned the stakeholders involved in the recertification process: while some systems exclusively relied on doctors' self-assessment, others involved multiple stakeholders but rarely included patients in assessment of doctors' professional competence. Differences between systems partly reflected different goals and primary purposes of recertification.

CONCLUSION

Recertification systems differ substantially internationally with regard to the criteria they apply to assess doctors' competence, their aims, requirements, assessment formats and patient involvement. In the light of professional mobility and associated demands for accountability, we recommend that competence assessment includes patients' perspectives, and recertification practices be shared internationally to enhance transparency. This can help facilitate cross-border movement, while guaranteeing high-quality patient care.

Informal social accountability in maternal health service delivery: A study in Northern Malawi

Despite the expansion of literature on social accountability in low-and middle-income countries, little is known about how health providers experience daily social pressure and citizen feedback. This study used a narrative inquiry approach to explore the function of daily social accountability relations among maternal health care workers in rural Malawi. Through semi-structured interviews with 32 nurses and 19 clinicians, we collected 155 feedback cases allowing the identification of four main strategies social actors use to express their opinion and concerns about maternal health services. We found that women who used delivery care express their appreciation for successful deliveries directly to the health worker but complaints, such as on absenteeism and poor interpersonal behaviour, follow an indirect route via intermediaries such as the health workers' spouse, co-workers or the health committee who forward some cases of misbehaviour to district authorities. The findings suggest that citizen feedback is important for the socialization, motivation and retention of maternal healthcare workers in under resourced rural settings. Practitioners and external development programmes should understand and recognize the value of already existing accountability mechanisms and foster social accountability approaches that allow communities as well as health workers to challenge the systemic obstacles to quality and respectful service delivery.

A methodology to extract outcomes from routine healthcare data for patients with locally advanced non-small cell lung cancer

BACKGROUND

Outcomes for patients in UK with locally advanced non-small cell lung cancer (LA NSCLC) are amongst the worst in Europe. Assessing outcomes is important for analysing the effectiveness of current practice. However, data quality is inconsistent and regular large scale analysis is challenging. This project investigates the use of routine healthcare datasets to determine progression free survival (PFS) and overall survival (OS) of patients treated with primary radical radiotherapy for LA NSCLC.

METHODS

All LA NSCLC patients treated with primary radical radiotherapy in a 2 year period were identified and paired manual and routine data generated for an initial pilot study. Manual data was extracted information from hospital records and considered the gold standard. Key time points were date of diagnosis, recurrence, death or last clinical encounter. Routine data was collected from various data sources including, Hospital Episode Statistics, Personal Demographic Service, chemotherapy data, and radiotherapy datasets. Relevant event dates were defined by proxy time points and refined using backdating and time interval optimization. Dataset correlations were then tested on key clinical outcome indicators to establish if routine data could be used as a reliable proxy measure for manual data.

RESULTS

Forty-three patients were identified for the pilot study. The manual data showed a median age of 67 years (range 46- 89 years) and all patients had stage IIIA/B disease. Using the manual data, the median PFS was 10.78 months (range 1.58-37.49 months) and median OS was 16.36 months (range 2.69-37.49 months). Based on routine data, using proxy measures, the estimated median PFS was 10.68 months (range 1.61-31.93 months) and estimated median OS was 15.38 months (range 2.14-33.71 months). Overall, the routine data underestimated the PFS and OS of the manual data but there was good correlation with a Pearson correlation coefficient of 0.94 for PFS and 0.97 for OS.

CONCLUSIONS

This is a novel approach to use routine datasets to determine outcome indicators in patients with LA NSCLC that will be a surrogate to analysing manual data. The ability to enable efficient and large scale analysis of current lung cancer strategies has a huge potential impact on the healthcare system.

Giving and promising gifts: Experimental evidence on reciprocity from the field

We test the value of unconditional non-monetary gifts as a way to improve health worker performance in a low income country health setting. We randomly assigned health workers to different gift treatments within a program that visited health workers, measured performance and encouraged them to provide high quality care for their patients. We show that unconditional non-monetary gifts improve performance by 20 percent over a six-week period, compared to the control group. We compare the impact of the unconditional gift to one in which a gift is offered conditional on meeting a performance target and show that only the unconditional gift results in a statistically significant improvement. This demonstrates that organizations can improve the performance of health workers in the medium term without using financial incentives.

Interventions to improve antimicrobial prescribing of doctors in training (IMPACT): a realist review

Background

Interventions to improve the antimicrobial prescribing practices of doctors have been implemented widely to curtail the emergence and spread of antimicrobial resistance, but have been met with varying levels of success.

Objectives

This study aimed to generate an in-depth understanding of how antimicrobial prescribing interventions ‘work’ (or do not work) for doctors in training by taking into account the wider context in which prescribing decisions are enacted.

Design

The review followed a realist approach to evidence synthesis, which uses an interpretive, theory-driven analysis of qualitative, quantitative and mixed-methods data from relevant studies.

Setting

Primary and secondary care.

Participants

Not applicable.

Interventions

Studies related to antimicrobial prescribing for doctors in training.

Main outcome measures

Not applicable.

Data sources

EMBASE (via Ovid), MEDLINE (via Ovid), MEDLINE In-Process & Other Non-Indexed Citations (via Ovid), PsycINFO (via Ovid), Web of Science core collection limited to Science Citation Index Expanded (SCIE) and Conference Proceedings Citation Index – Science (CPCI-S) (via Thomson Reuters), Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Database of Systematic Reviews, the Health Technology Assessment (HTA) database (all via The Cochrane Library), Applied Social Sciences Index and Abstracts (ASSIA) (via ProQuest), Google Scholar (Google Inc., Mountain View, CA, USA) and expert recommendations.

Review methods

Clearly bounded searches of electronic databases were supplemented by citation tracking and grey literature. Following quality standards for realist reviews, the retrieved articles were systematically screened and iteratively analysed to develop theoretically driven explanations. A programme theory was produced with input from a stakeholder group consisting of practitioners and patient representatives.

Results

A total of 131 articles were included. The overarching programme theory developed from the analysis of these articles explains how and why doctors in training decide to passively comply with or actively follow (1) seniors’ prescribing habits, (2) the way seniors take into account prescribing aids and seek the views of other health professionals and (3) the way seniors negotiate patient expectations. The programme theory also explains what drives willingness or reluctance to ask questions about antimicrobial prescribing or to challenge the decisions made by seniors. The review outlines how these outcomes result from complex inter-relationships between the contexts of practice doctors in training are embedded in (hierarchical relationships, powerful prescribing norms, unclear roles and responsibilities, implicit expectations about knowledge levels and application in practice) and the mechanisms triggered in these contexts (fear of criticism and individual responsibility, reputation management, position in the clinical team and appearing competent). Drawing on these findings, we set out explicit recommendations for optimal tailoring, design and implementation of antimicrobial prescribing interventions targeted at doctors in training.

Limitations

Most articles included in the review discussed hospital-based, rather than primary, care. In cases when few data were available to fully capture all the nuances between context, mechanisms and outcomes, we have been explicit about the strength of our arguments.

Conclusions

This review contributes to our understanding of how antimicrobial prescribing interventions for doctors in training can be better embedded in the hierarchical and interprofessional dynamics of different health-care settings.

Future work

More work is required to understand how interprofessional support for doctors in training can contribute to appropriate prescribing in the context of hierarchical dynamics.

Study registration

This study is registered as PROSPERO CRD42015017802.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Risk assessment of psychiatric in-patients: audit of completion of a risk assessment tool

Aims and Method

Two complete audit cycles were used to assess the completion of a bespoke risk assessment tool and whether an educational intervention, and subsequently the introduction of a standardised admission pack, led to improvements in completion rates.

Results

The total rate of completion of forms improved from 60% to 81% following a brief educational intervention in the form of a lecture and email about the audit. The subsequent introduction of a standardised admission pack containing the tool maintained completion rates.

Clinical Implications

Audit coupled with a simple educational intervention can improve the completion of risk assessment forms by medical and nursing staff.

Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: study protocol for a cluster randomized trial

BACKGROUND

Improving the extent to which evidence-based practices (EBPs)-treatments that have been empirically shown to be efficacious or effective-are integrated within routine practice is a well-documented challenge across numerous areas of health. In 2014, the National Institute on Drug Abuse funded a type 2 effectiveness-implementation hybrid trial titled the substance abuse treatment to HIV Care (SAT2HIV) Project. Aim 1 of the SAT2HIV Project tests the effectiveness of a motivational interviewing-based brief intervention (MIBI) for substance use as an adjunct to usual care within AIDS service organizations (ASOs) as part of its MIBI Experiment. Aim 2 of the SAT2HIV Project tests the effectiveness of implementation and sustainment facilitation (ISF) as an adjunct to the Addiction Technology Transfer Center (ATTC) model for training staff in motivational interviewing as part of its ISF Experiment. The current paper describes the study protocol for the ISF Experiment.

METHODS

Using a cluster randomized design, case management and leadership staff from 39 ASOs across the United States were randomized to receive either the ATTC strategy (control condition) or the ATTC + ISF strategy (experimental condition). The ATTC strategy is staff-focused and includes 10 discrete strategies (e.g., provide centralized technical assistance, conduct educational meetings, provide ongoing consultation). The ISF strategy is organization-focused and includes seven discrete strategies (e.g., use an implementation advisor, organize implementation team meetings, conduct cyclical small tests of change). Building upon the exploration-preparation-implementation-sustainment (EPIS) framework, the effectiveness of the ISF strategy is examined via three staff-level measures: (1) time-to-proficiency (i.e., preparation phase outcome), (2) implementation effectiveness (i.e., implementation phase outcome), and (3) level of sustainment (i.e., sustainment phase outcome).

DISCUSSION

Although not without limitations, the ISF experiment has several strengths: a highly rigorous design (randomized, hypothesis-driven), high-need setting (ASOs), large sample size (39 ASOs), large geographic representation (23 states and the District of Columbia), and testing along multiple phases of the EPIS continuum (preparation, implementation, and sustainment). Thus, study findings will significantly improve generalizable knowledge regarding the best preparation, implementation, and sustainment strategies for advancing EBPs along the EPIS continuum. Moreover, increasing ASO's capacity to address substance use may improve the HIV Care Continuum. Trial registration ClinicalTrials.gov: NCT03120598.

It does matter where you come from: mothers' experiences of childbirth in midwife obstetric units, Tshwane, South Africa

Background

Health professionals are striving to improve respectful care for women, but they fall short in the domains of effective communication, respectful and dignified care and emotional support during labour. This study aimed to determine women’s experiences of childbirth with a view to improving respectful clinical care practices in low-risk, midwife-led obstetric units in the Tshwane District Health District, South Africa.

Methods

A survey covering all midwife-led units in the district was conducted among 653 new mothers. An anonymous questionnaire was administered to mothers returning for a three-days-to-six-weeks postnatal follow-up visit. Mothers were asked about their experiences regarding communication, labour, clinical care and respectful care during confinement. An ANCOVA was performed to identify the socio-demographic variables that significantly predicted disrespectful care. Six items representing the different areas of experience were used in the analysis.

Results

Age, language, educational level and length of residence in the district were significantly associated with disrespectful care (p ≤ 0.01). Overall, the following groups of mothers reported more negative care experiences during labour: women between the ages of 17 and 24 years; women with limited formal education; and women from another province or a neighbouring country. Items which attracted fewer positive responses from participants were the following: 46% of mothers had been welcomed by name on arrival; 47% had been asked to give consent to a physical examination; and 39% had been offered food or water during labour. With regard to items related to respectful care, 54% of mothers indicated that all staff members had spoken courteously to them, 48% said they had been treated with a lot of respect, and 55% were completely satisfied with their treatment.

Conclusion

There is a need to improve respectful care through interventions that are integrated into routine care practices in labour wards. To stop the spiral of abusive obstetric care, the care provided should be culturally sensitive and should address equity for the most vulnerable and underserved groups. All levels of the health care system should employ respectful obstetric care practices, matched with support for midwives and improved clinical governance in maternity facilities.

Electronic supplementary material

The online version of this article (dio: 10.1186/s12978-017-0411-5) contains supplementary material, which is available to authorized users.

Use of audit, feedback and education increased guideline implementation in a multidisciplinary stroke unit

BACKGROUND

The audit-feedback cycle is a behaviour change intervention used to reduce evidence-practice gaps. In this study, repeat audits, feedback, education and training were used to change practice and increase compliance with Australian guideline recommendations for stroke rehabilitation.

OBJECTIVE

To increase the proportion of patients with stroke receiving best practice screening, assessment and treatment.

METHODS

A before-and-after study design was used. Data were collected from medical records (n=15 files per audit). Four audits were conducted between 2009 and 2013. Consecutive files of patients with stroke admitted to the stroke unit were selected and audited retrospectively. Staff behaviour change interventions included four cycles of audit feedback, and education to assist staff with change. The primary outcome measure was the proportion of eligible patients receiving best practice against target behaviours, based on audit data.

RESULTS

Between the first and fourth audit (2009 and 2013), 20 of the 27 areas targeted (74%) met or exceeded the minimum target of 10% change. Practice areas that showed the most change included sensation screening (+75%) and rehabilitation (+100%); neglect screening (+92%) and assessment (100%). Some target behaviours showed a drop in compliance such as anxiety and depression screening (-27%) or little or no overall improvement such as patient education about stroke (6% change).

CONCLUSIONS

Audit feedback and education increased the proportion of inpatients with stroke receiving best practice rehabilitation in some, but not all practice areas. An ongoing process of quality improvement is needed to help sustain these improvements.

Does audit and feedback improve the adoption of recommended practices? Evidence from a longitudinal observational study of an emerging clinical network in Kenya

Background

Audit and feedback (A&F) is widely used in healthcare but there are few examples of how to deploy it at scale in low-income countries. Establishing the Clinical Information Network (CIN) in Kenya provided an opportunity to examine the effect of A&F delivered as part of a wider set of activities to promote paediatric guideline adherence.

Methods

We analysed data collected from medical records on discharge for children aged 2–59 months from 14 Kenyan hospitals in the CIN. Hospitals joined CIN in phases and for each we analysed their initial 25 months of participation that occurred between December 2013 and March 2016. A total of 34 indicators of adherence to recommendations were selected for evaluation each classified by form of feedback (passive, active and none) and type of task (simple or difficult documentation and those requiring cognitive work). Performance change was explored graphically and using generalised linear mixed models with attention given to the effects of time and use of a standardised paediatric admission record (PAR) form.

Results

Data from 60 214 admissions were eligible for analysis. Adherence to recommendations across hospitals significantly improved for 24/34 indicators. Improvements were not obviously related to nature of feedback, may be related to task type and were related to PAR use in the case of documentation indicators. There was, however, marked variability in adoption and adherence to recommended practices across sites and indicators. Hospital-specific factors, low baseline performance and specific contextual changes appeared to influence the magnitude of change in specific cases.

Conclusion

Our observational data suggest some change in multiple indicators of adherence to recommendations (aspects of quality of care) can be achieved in low-resource hospitals using A&F and simple job aides in the context of a wider network approach.

Survey of Primary Care and Mental Health Prescribers' Perspectives on Reducing Opioid and Benzodiazepine Co-Prescribing Among Veterans

Background

Due to the involvement of opioids and benzodiazepines in rising pharmaceutical overdoses, a reduction in coprescribing of these medications is a national priority, particularly among patients with substance use disorders and other high-risk conditions. However, little is known about primary care (PC) and mental health (MH) prescribers' perspectives on these medications and efforts being implemented to reduce coprescribing.

Design

An anonymous survey.

Setting

One multisite VA health care system.

Subjects

Participants were 55 PC and 31 MH prescribers.

Methods

Survey development was guided by the Promoting Action on Research Implementation in Health Services (PARIHS) conceptual framework. PC and MH prescribers of opioids or benzodiazepines were invited to complete an anonymous electronic survey. Responses were collapsed to highlight agreement, disagreement, and neutrality and summarized with means and percentages.

Results

Over 80% of both prescriber groups reported concern about concurrent use and > 75% strongly agreed with clinical practice guidelines (CPG) that recommend caution in coprescribing among patients with high-risk conditions. More than 40% of both prescriber groups indicated that coprescribing continues because of beliefs that patients appear stable without adverse events and tapering/discontinuation is too difficult. Over 70% of prescribers rated strategies for addressing patients who refuse to discontinue, more time with patients, and identification of high-risk patients as helpful in reducing coprescribing.

Conclusion

Despite strong agreement with CPGs, prescribers reported several barriers that contribute to coprescribing of opioids and benzodiazepines and challenge their ability to taper these medications. Multiple interventions are likely needed to reduce opioid and benzodiazepine coprescribing.

Distance-Learning, ADHD Quality Improvement in Primary Care: A Cluster-Randomized Trial

OBJECTIVE

To evaluate a distance-learning, quality improvement intervention to improve pediatric primary care provider use of attention-deficit/hyperactivity disorder (ADHD) rating scales.

METHODS

Primary care practices were cluster randomized to a 3-part distance-learning, quality improvement intervention (web-based education, collaborative consultation with ADHD experts, and performance feedback reports/calls), qualifying for Maintenance of Certification (MOC) Part IV credit, or wait-list control. We compared changes relative to a baseline period in rating scale use by study arm using logistic regression clustered by practice (primary analysis) and examined effect modification by level of clinician participation. An electronic health record-linked system for gathering ADHD rating scales from parents and teachers was implemented before the intervention period at all sites. Rating scale use was ascertained by manual chart review.

RESULTS

One hundred five clinicians at 19 sites participated. Differences between arms were not significant. From the baseline to intervention period and after implementation of the electronic system, clinicians in both study arms were significantly more likely to administer and receive parent and teacher rating scales. Among intervention clinicians, those who participated in at least 1 feedback call or qualified for MOC credit were more likely to give parents rating scales with differences of 14.2 (95% confidence interval [CI], 0.6-27.7) and 18.8 (95% CI, 1.9-35.7) percentage points, respectively.

CONCLUSION

A 3-part clinician-focused distance-learning, quality improvement intervention did not improve rating scale use. Complementary strategies that support workflows and more fully engage clinicians may be needed to bolster care. Electronic systems that gather rating scales may help achieve this goal. Index terms: ADHD, primary care, quality improvement, clinical decision support.

Improving Hepatitis C Identification: Technology Alone Is Not the Answer

An estimated 3 to 5 million Americans are chronically infected with hepatitis C virus (HCV), and approximately 75% of those persons were born between 1945 and 1965 (the so-called baby boomer generation). Because of the largely asymptomatic nature of HCV, up to 50% of those infected are unaware of their disease. Risk-based testing has been largely ineffective. Based on prevalence data, the Centers for Disease Control and Prevention and other organizations recommend a onetime HCV antibody test for all baby boomers. However, uptake of this recommendation requires significant changes in clinical practice for already busy primary care clinicians. We studied the effectiveness of a quality improvement initiative based on continuous audit and feedback combined with education for improving testing in alignment with guidelines; the control group was a cohort of clinicians whose only reminder was an institution-wide electronic health record prompt. Our data show improved testing rates among all clinician groups, but more significant improvement occurred among providers who received continuous feedback about their clinical performance coupled with education.

Internal Medicine Resident Engagement with a Laboratory Utilization Dashboard: Mixed Methods Study

The objective of this study was to measure internal medicine resident engagement with an electronic medical record-based dashboard providing feedback on their use of routine laboratory tests relative to service averages. From January 2016 to June 2016, residents were e-mailed a snapshot of their personalized dashboard, a link to the online dashboard, and text summarizing the resident and service utilization averages. We measured resident engagement using e-mail read-receipts and web-based tracking. We also conducted 3 hour-long focus groups with residents. Using grounded theory approach, the transcripts were analyzed for common themes focusing on barriers and facilitators of dashboard use. Among 80 residents, 74% opened the e-mail containing a link to the dashboard and 21% accessed the dashboard itself. We did not observe a statistically significant difference in routine laboratory ordering by dashboard use, although residents who opened the link to the dashboard ordered 0.26 fewer labs per doctor-patient-day than those who did not (95% confidence interval, -0.77 to 0.25; 𝑃 = 0 .31). While they raised several concerns, focus group participants had positive attitudes toward receiving individualized feedback delivered in real time.

[Master trainer concept "structured specialist further education" : A joint project of the German Professional Associations of Internal Medicine, Surgeons and Orthopedic/Trauma Surgeons]

BACKGROUND

The quality requirements in the practice of postgradual medical further education below the normal level of the further education regulations is a barely developed scientific field in Germany. A systematic use of internationally accepted scientific evidence barely exists.

AIM

This research and development project was initiated in 2001 in order to be able to implement a practical but evidence-based model compatible with the existing structure of postgradual medical education. This project has been supported since 2013 by the Professional Associations of Internal Medicine (BDI), Surgeons (BDC) and Orthopedic and Trauma surgeons (BVOU).

METHODS

The development phase of this complex intervention was based on three stages involving stakeholder interviews from relevant groups, the identification of a theoretical model for the construction and systematic literature reviews to identify the relevant evidence.

RESULTS

The basic model for structured specialist further education developed included the creation and implementation of a simple core curriculum for every department, a tool for systematic feedback within the framework of the annual further education interviews and a simple clinical assessment to evaluate the actual clinical performance of physicians in further education. A pilot test of this model was carried out in 150 specialist departments in Germany and continually developed.

DISCUSSION

The project shows that such a program can be systematically developed and pilot studies can be carried out. The central problems in implementation involve the traditional informal further education culture, which as a rule does not implement a systematic elicitation of the state of learning continuously distributed over the whole period of further education and the practical testing of competence development.

Desarrollo e implementación de un modelo de auditoría médica basado en el aseguramiento de la calidad y la supervisión participativa en Ecuador

Objetivos: Este estudio es una descripción del desarrollo de una estrategia de Auditoría Médica basada en el Aseguramiento de la Calidad de la prestación utilizando herramientas de supervisión participativa en un intento de generar cooperación entre el auditor y el auditado en servicios de salud del primer nivel de atención del Ministerio de Salud Pública de Ecuador. Métodos: Se desarrolló y se implementó una metodología la cual se probó en el terreno, basados en una descripción de los resultados (corte transversal). Resultados: Al inicio del proceso, las puntuaciones de pertinencia clínica, de manera global, no superaban el 45% y respecto al riesgo legal no superan el 65%. Progresivamente se observa un aumento de la puntuación, adicionalmente se obtuvieron resultados propios de la percepción de este proceso por parte de los auditados, teniendo resistencia en menos del 5% de los casos, quizás debido al carácter participativo del proceso. Conclusión: El proceso de auditoría Médica es indispensable para la identificación de problemas, pero también es necesario que sea un proceso activo con intervención y resolución de los mismos. Auditoría Médica identifica problemas ocultos para los tomadores de decisiones y disminuye la resistencia en la inclusión de estrategias de mejoramiento de la calidad.

Feedback preferences of patients, professionals and health insurers in integrated head and neck cancer care

Background

Audit and feedback on professional practice and health care outcomes are the most often used interventions to change behaviour of professionals and improve quality of health care. However, limited information is available regarding preferred feedback for patients, professionals and health insurers.

Objective

Investigate the (differences in) preferences of receiving feedback between stakeholders, using the Dutch Head and Neck Audit as an example.

Methods

A total of 37 patients, medical specialists, allied health professionals and health insurers were interviewed using semi‐structured interviews. Questions focussed on: “Why,” “On what aspects” and “How” do you prefer to receive feedback on professional practice and health care outcomes?

Results

All stakeholders mentioned that feedback can improve health care by creating awareness, enabling self‐reflection and reflection on peers or colleagues, and by benchmarking to others. Patients prefer feedback on the actual professional practice that matches the health care received, whereas medical specialists and health insurers are interested mainly in health care outcomes. All stakeholders largely prefer a bar graph. Patients prefer a pie chart for patient‐reported outcomes and experiences, while Kaplan‐Meier survival curves are preferred by medical specialists. Feedback should be simple with firstly an overview, and 1‐4 times a year sent by e‐mail. Finally, patients and health professionals are cautious with regard to transparency of audit data.

Conclusions

This exploratory study shows how feedback preferences differ between stakeholders. Therefore, tailored reports are recommended. Using this information, effects of audit and feedback can be improved by adapting the feedback format and contents to the preferences of stakeholders.

Using Feedback to Promote Physical Activity: The Role of the Feedback Sign

Background

Providing feedback is a technique to promote health behavior that is emphasized by behavior change theories. However, these theories make contradicting predictions regarding the effect of the feedback sign—that is, whether the feedback signals success or failure. Thus, it is unclear whether positive or negative feedback leads to more favorable behavior change in a health behavior intervention.

Objective

The aim of this study was to examine the effect of the feedback sign in a health behavior change intervention.

Methods

Data from participants (N=1623) of a 6-month physical activity intervention was used. Participants received a feedback email at the beginning of each month. Feedback was either positive or negative depending on the participants’ physical activity in the previous month. In an exploratory analysis, change in monthly step count averages was used to evaluate the feedback effect.

Results

The feedback sign did not predict the change in monthly step count averages over the course of the intervention (b=−84.28, P=.28). Descriptive differences between positive and negative feedback can be explained by regression to the mean.

Conclusions

The feedback sign might not influence the effect of monthly feedback emails sent out to participants of a large-scale physical activity intervention. However, randomized studies are needed to further support this conclusion. Limitations as well as opportunities for future research are discussed.

Data for Improvement and Clinical Excellence: a report of an interrupted time series trial of feedback in home care

Background

There is substantial evidence about the effectiveness of audit with feedback, but none that we know have been conducted in home care settings. The primary purpose of the Data for Improvement and Clinical Excellence – Home Care (DICE-HC) project was to evaluate the effects of an audit and feedback delivered to care providers on home care client outcomes. The objective of this paper is to report the effects of feedback on four specific quality indicators: pain, falls, delirium, and hospital visits.

Methods

A 10-month audit with feedback intervention study was conducted with care providers in seven home care offices in Alberta, Canada, which involved delivery of four quarterly feedback reports consisting of data derived from the Resident Assessment Instrument – Home Care (RAI-HC). The primary evaluation employed an interrupted time series design using segmented regression analysis to assess the effects of feedback reporting on the four quality indicators: pain, falls, delirium, and hospitalization. Changes in level and trend of the quality indicators were measured before, during, and after the implementation of feedback reports. Pressure ulcer reporting was analyzed as a comparator condition not included in the feedback report. Care providers were surveyed on responses to feedback reporting which informed a process evaluation.

Results

At initiation of feedback report implementation, the percentage of clients reporting pain and falls significantly increased. Though the percentage of clients reporting pain and falls tended to increase and reporting of delirium and hospital visits tended to decrease relative to the pre-intervention period, there was no significant effect of feedback reporting on quality indicators during the 10-month intervention. The percentage of clients reporting falls, delirium, and hospital visits significantly increased in the 6-month period following feedback reporting relative to the intervention period. About 50% of the care providers that read and understand the feedback reports found the reports useful to make changes to the way clients are cared for.

Conclusions

Routinely collected data used over time for feedback is feasible in home care settings. A high proportion of care providers find feedback reports useful for informing how they care for clients. Since reporting on the frequency of quality indicators increased in the post-intervention period, this study suggests that ongoing use of audit with feedback to enhance health outcomes in home care may promote improved reporting on standardized instruments.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-017-0600-1) contains supplementary material, which is available to authorized users.

A systematic review and evidence synthesis of qualitative studies to identify primary care clinicians' barriers and enablers to the management of osteoarthritis

OBJECTIVE

Primary care management of osteoarthritis (OA) is variable and often inconsistent with clinical practice guidelines (CPGs). This study aimed to identify and synthesize available qualitative evidence on primary care clinicians' views on providing recommended management of OA.

DESIGN

Eligibility criteria included full reports published in peer-reviewed journals, with data collected directly from primary care clinicians using qualitative methods for collection and analysis. Five electronic databases (MEDLINE, Cochrane Central Register, EMBASE, CINAHL and PsychInfo) were searched to August 2016. Two independent reviewers identified eligible reports, conducted critical appraisal (based on Critical Appraisal Skills Programme (CASP) criteria), and extracted data. Three reviewers independently, then collaboratively, synthesized and interpreted data through an inductive and iterative process to derive new themes. The Confidence in Evidence from Reviews of Qualitative research (CERQual) approach was used to determine a confidence profile for each finding.

RESULTS

Eight studies involving approximately 83 general practitioners (GPs), 24 practice nurses, 12 pharmacists and 10 physical therapists, from Australia, France, United Kingdom, Germany and Mexico were included. Four barriers were identified as themes 1) OA is not that serious, 2) Clinicians are, or perceive they are, under-prepared, 3) Personal beliefs at odds with providing recommended practice, and 4) Dissonant patient expectations. No themes were enablers. Confidence ratings were moderate or low.

CONCLUSIONS

Synthesising available data revealed barriers that collectively point towards a need to address clinician knowledge gaps, and enhance clinician communication and behaviour change skills to facilitate patient adherence, enable effective conversations and manage dissonant patient expectations.

REGISTRATION

PROSPERO (http://www.crd.york.ac.uk/PROSPERO) [4/11/2015, CRD42015027543].

Evaluation of Helping Babies Breathe Quality Improvement Cycle (HBB-QIC) on retention of neonatal resuscitation skills six months after training in Nepal

Background

Each year 700,000 infants die due to intrapartum-related complications. Implementation of Helping Babies Breathe (HBB)-a simplified neonatal resuscitation protocol in low-resource clinical settings has shown to reduce intrapartum stillbirths and first-day neonatal mortality. However, there is a lack of evidence on the effect of different HBB implementation strategies to improve and sustain the clinical competency of health workers on bag-and-mask ventilation. This study was conducted to evaluate the impact of multi-faceted implementation strategy for HBB, as a quality improvement cycle (HBB-QIC), on the retention of neonatal resuscitation skills in a tertiary hospital of Nepal.

Methods

A time-series design was applied. The multi-faceted intervention for HBB-QIC included training, daily bag-and-mask skill checks, preparation for resuscitation before every birth, self-evaluation and peer review on neonatal resuscitation skills, and weekly review meetings. Knowledge and skills were assessed through questionnaires, skill checklists, and Objective Structured Clinical Examinations (OSCE) before implementation of the HBB-QIC, immediately after HBB training, and again at 6 months. Means were compared using paired t-tests, and associations between skill retention and HBB-QIC components were analyzed using logistic regression analysis.

Results

One hundred thirty seven health workers were enrolled in the study. Knowledge scores were higher immediately following the HBB training, 16.4 ± 1.4 compared to 12.8 ± 1.6 before (out of 17), and the knowledge was retained 6 months after the training (16.5 ± 1.1). Bag-and-mask skills improved immediately after the training and were retained 6 months after the training. The retention of bag-and-mask skills was associated with daily bag-and-mask skill checks, preparation for resuscitation before every birth, use of a self-evaluation checklist, and attendance at weekly review meetings. The implementation strategies with the highest association to skill retention were daily bag-and-mask skill checks (RR-5.1, 95% CI 1.9–13.5) and use of self-evaluation checklists after every delivery (RR-3.8, 95% CI 1.4–9.7).

Conclusions

Health workers who practiced bag-and-mask skills, prepared for resuscitation before every birth, used self-evaluation checklists, and attended weekly review meetings were more likely to retain their neonatal resuscitation skills. Further studies are required to evaluate HBB-QIC in primary care settings, where the number of deliveries is gradually increasing.

Trial registration

ISRCTN97846009. Date of Registration- 15 August 2012.

Exploring Systems That Support Good Clinical Care in Indigenous Primary Health-care Services: A Retrospective Analysis of Longitudinal Systems Assessment Tool Data from High-Improving Services

BACKGROUND

Continuous Quality Improvement is a process for raising the quality of primary health care (PHC) across Indigenous PHC services. In addition to clinical auditing using plan, do, study, and act cycles, engaging staff in a process of reflecting on systems to support quality care is vital. The One21seventy Systems Assessment Tool (SAT) supports staff to assess systems performance in terms of five key components. This study examines quantitative and qualitative SAT data from five high-improving Indigenous PHC services in northern Australia to understand the systems used to support quality care.

METHODS

High-improving services selected for the study were determined by calculating quality of care indices for Indigenous health services participating in the Audit and Best Practice in Chronic Disease National Research Partnership. Services that reported continuing high improvement in quality of care delivered across two or more audit tools in three or more audits were selected for the study. Precollected SAT data (from annual team SAT meetings) are presented longitudinally using radar plots for quantitative scores for each component, and content analysis is used to describe strengths and weaknesses of performance in each systems' component.

RESULTS

High-improving services were able to demonstrate strong processes for assessing system performance and consistent improvement in systems to support quality care across components. Key strengths in the quality support systems included adequate and orientated workforce, appropriate health system supports, and engagement with other organizations and community, while the weaknesses included lack of service infrastructure, recruitment, retention, and support for staff and additional costs. Qualitative data revealed clear voices from health service staff expressing concerns with performance, and subsequent SAT data provided evidence of changes made to address concerns.

CONCLUSION

Learning from the processes and strengths of high-improving services may be useful as we work with services striving to improve the quality of care provided in other areas.

Moving From Discovery to System-Wide Change: The Role of Research in a Learning Health Care System: Experience from Three Decades of Health Systems Research in the Veterans Health Administration

The Veterans Health Administration is unique, functioning as an integrated health care system that provides care to more than six million veterans annually and as a home to an established scientific enterprise that conducts more than $1 billion of research each year. The presence of research, spanning the continuum from basic health services to translational research, has helped the Department of Veterans Affairs (VA) realize the potential of a learning health care system and has contributed to significant improvements in clinical quality over the past two decades. It has also illustrated distinct pathways by which research influences clinical care and policy and has provided lessons on challenges in translating research into practice on a national scale. These lessons are increasingly relevant to other health care systems, as the issues confronting the VA—the need to provide timely access, coordination of care, and consistent high quality across a diverse system—mirror those of the larger US health care system.

Carbapenem-Resistant Enterobacteriaceae: A Strategic Roadmap for Infection Control

The incidence of carbapenem-resistant Enterobacteriaceae (CRE) has increased worldwide with great regional variability. Infections caused by these organisms are associated with crude mortality rates of up to 70%. The spread of CRE in healthcare settings is both an important medical problem and a major global public health threat. All countries are at risk of falling victim to the emergence of CRE; therefore, a preparedness plan is required to avoid the catastrophic natural course of this epidemic. Proactive and adequate preventive measures locally, regionally, and nationally are required to contain the spread of these bacteria. The keys to success in preventing the establishment of CRE endemicity in a region are early detection through targeted laboratory protocols and containment of spread through comprehensive infection control measures. This guideline provides a strategic roadmap for infection control measures based on the best available evidence and expert opinion, to enable preparation of a multifaceted preparedness plan to abort epidemics of CRE. Infect Control Hosp Epidemiol 2017;38:580-594.

The effectiveness of a skin care program for the prevention of contact dermatitis in health care workers (the Healthy Hands Project): study protocol for a cluster randomized controlled trial

Background

Health care workers (HCW) are at high risk for developing occupational hand dermatitis (HD) due to frequent exposure to ‘wet work’. Amongst HCWs, nurses are at highest risk, with an estimated point prevalence of HD ranging between 12 and 30%. The burden of disease is high with chronicity, sick leave, risk of unemployment and impaired quality of life. Despite evidence from the medical literature on the risk factors and the importance of skin care in the prevention of HD, in practice, compliance to skin care protocols are below 30%. New preventive strategies are obviously needed.

Methods/design

This is a cluster randomized controlled trial, focusing on nurses performing wet work. In total, 20 wards are recruited to include 504 participating nurses in the study at baseline. The wards will be randomized to an intervention or a control group and followed up for 18 months.

The intervention consists of the facilitation of creams being available at the wards combined with the continuous electronic monitoring of their consumption with regular feedback on skin care performance in teams of HCWs. Both the intervention and the control group receive basic education on skin protection (as ‘care as usual’). Every 6 months, participants of both groups will fill in the questionnaires regarding exposure to wet work and skin protective behavior. Furthermore, skin condition will be assessed and samples of the stratum corneum collected. The effect of the intervention will be measured by comparing the change in Hand Eczema Severity Index (HECSI score) from baseline to 12 months. The Natural Moisturizing Factor (NMF) levels, measured in the stratum corneum as an early biomarker of skin barrier damage, and the total consumption of creams per ward will be assessed as a secondary outcome.

Discussion

This trial will assess the clinical effectiveness of an intervention program to prevent hand dermatitis among health care workers

Trial registration

Netherlands Trial Register (NTR), identification number NTR5564. Registered on 2 November 2015.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-1803-0) contains supplementary material, which is available to authorized users.

The International College of Neuropsychopharmacology (CINP) Treatment Guidelines for Bipolar Disorder in Adults (CINP-BD-2017), Part 1: Background and Methods of the Development of Guidelines

BACKGROUND

This paper includes a short description of the important clinical aspects of Bipolar Disorder with emphasis on issues that are important for the therapeutic considerations, including mixed and psychotic features, predominant polarity, and rapid cycling as well as comorbidity.

METHODS

The workgroup performed a review and critical analysis of the literature concerning grading methods and methods for the development of guidelines.

RESULTS

The workgroup arrived at a consensus to base the development of the guideline on randomized controlled trials and related meta-analyses alone in order to follow a strict evidence-based approach. A critical analysis of the existing methods for the grading of treatment options was followed by the development of a new grading method to arrive at efficacy and recommendation levels after the analysis of 32 distinct scenarios of available data for a given treatment option.

CONCLUSION

The current paper reports details on the design, method, and process for the development of CINP guidelines for the treatment of Bipolar Disorder. The rationale and the method with which all data and opinions are combined in order to produce an evidence-based operationalized but also user-friendly guideline and a specific algorithm are described in detail in this paper.

Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care

Background

The feedback of patient-reported outcome measures (PROMs) data is intended to support the care of individual patients and to act as a quality improvement (QI) strategy.

Objectives

To (1) identify the ideas and assumptions underlying how individual and aggregated PROMs data are intended to improve patient care, and (2) review the evidence to examine the circumstances in which and processes through which PROMs feedback improves patient care.

Design

Two separate but related realist syntheses: (1) feedback of aggregate PROMs and performance data to improve patient care, and (2) feedback of individual PROMs data to improve patient care.

Interventions

Aggregate – feedback and public reporting of PROMs, patient experience data and performance data to hospital providers and primary care organisations. Individual – feedback of PROMs in oncology, palliative care and the care of people with mental health problems in primary and secondary care settings.

Main outcome measures

Aggregate – providers’ responses, attitudes and experiences of using PROMs and performance data to improve patient care. Individual – providers’ and patients’ experiences of using PROMs data to raise issues with clinicians, change clinicians’ communication practices, change patient management and improve patient well-being.

Data sources

Searches of electronic databases and forwards and backwards citation tracking.

Review methods

Realist synthesis to identify, test and refine programme theories about when, how and why PROMs feedback leads to improvements in patient care.

Results

Providers were more likely to take steps to improve patient care in response to the feedback and public reporting of aggregate PROMs and performance data if they perceived that these data were credible, were aimed at improving patient care, and were timely and provided a clear indication of the source of the problem. However, implementing substantial and sustainable improvement to patient care required system-wide approaches. In the care of individual patients, PROMs function more as a tool to support patients in raising issues with clinicians than they do in substantially changing clinicians’ communication practices with patients. Patients valued both standardised and individualised PROMs as a tool to raise issues, but thought is required as to which patients may benefit and which may not. In settings such as palliative care and psychotherapy, clinicians viewed individualised PROMs as useful to build rapport and support the therapeutic process. PROMs feedback did not substantially shift clinicians’ communication practices or focus discussion on psychosocial issues; this required a shift in clinicians’ perceptions of their remit.

Strengths and limitations

There was a paucity of research examining the feedback of aggregate PROMs data to providers, and we drew on evidence from interventions with similar programme theories (other forms of performance data) to test our theories.

Conclusions

PROMs data act as ‘tin openers’ rather than ‘dials’. Providers need more support and guidance on how to collect their own internal data, how to rule out alternative explanations for their outlier status and how to explore the possible causes of their outlier status. There is also tension between PROMs as a QI strategy versus their use in the care of individual patients; PROMs that clinicians find useful in assessing patients, such as individualised measures, are not useful as indicators of service quality.

Future work

Future research should (1) explore how differently performing providers have responded to aggregate PROMs feedback, and how organisations have collected PROMs data both for individual patient care and to improve service quality; and (2) explore whether or not and how incorporating PROMs into patients’ electronic records allows multiple different clinicians to receive PROMs feedback, discuss it with patients and act on the data to improve patient care.

Study registration

This study is registered as PROSPERO CRD42013005938.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Public reporting as a prescriptions quality improvement measure in primary care settings in China: variations in effects associated with diagnoses

The overprovision and irrational use of antibiotics and injections are a major public health concern. Public reporting has been adopted as a strategy to encourage good prescribing practices. This study evaluated the effects of public reporting on antibiotic and injection prescriptions in urban and rural primary care settings in Hubei province, China. A randomized control trial was conducted, with 10 primary care institutions being subject to public reporting and another 10 serving as controls. Prescription indicators were publicly reported monthly over a one-year period. Prescriptions for bronchitis, gastritis and hypertension before and after the intervention were collected. Difference-in-difference tests were performed to estimate the effect size of the intervention on five prescription indicators: percentage of prescriptions containing antibiotics; percentage of prescriptions containing two or more antibiotics; percentage of prescriptions containing injections; percentage of prescriptions containing antibiotic injections; and average prescription cost. Public reporting had varied effects on prescriptions for different diagnoses. It reduced antibiotic prescribing for gastritis. Prescriptions containing injections, especially antibiotic injections, also declined, but only for gastritis. A reduction of prescription costs was noted for bronchitis and gastritis. Public reporting has the potential to encourage good prescribing practices. Its effects vary with different disease conditions.

Using feedback to change primary care physician behavior

Recognizing the gap between high-quality care and the care actually provided, health care providers across the country are under increasing institutional and payer pressures to move toward more high-quality care. This pressure is often leveraged through data feedback on provider performance; however, feedback has been shown to have only a variable effect on provider behavior. This study examines the cognitive behavioral factors that influence providers to participate in feedback interventions, and how feedback interventions should be implemented to encourage more provider engagement and participation.

External inspection of compliance with standards for improved healthcare outcomes

BACKGROUND

Inspection systems are used in healthcare to promote quality improvements (i.e. to achieve changes in organisational structures or processes, healthcare provider behaviour and patient outcomes). These systems are based on the assumption that externally promoted adherence to evidence-based standards (through inspection/assessment) will result in higher quality of healthcare. However, the benefits of external inspection in terms of organisational-, provider- and patient-level outcomes are not clear. This is the first update of the original Cochrane review, published in 2011.

OBJECTIVES

To evaluate the effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour and patient outcomes.

SEARCH METHODS

We searched the following electronic databases for studies up to 1 June 2015: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, Database of Abstracts of Reviews of Effectiveness, HMIC, ClinicalTrials.gov and the World Health Organization International Clinical Trials Registry Platform. There was no language restriction and we included studies regardless of publication status. We also searched the reference lists of included studies and contacted authors of relevant papers, accreditation bodies and the International Organization for Standardization (ISO), regarding any further published or unpublished work. We also searched an online database of systematic reviews (PDQ-evidence.org).

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised trials (NRCTs), interrupted time series (ITSs) and controlled before-after studies (CBAs) evaluating the effect of external inspection against external standards on healthcare organisation change, healthcare professional behaviour or patient outcomes in hospitals, primary healthcare organisations and other community-based healthcare organisations.

DATA COLLECTION AND ANALYSIS

Two review authors independently applied eligibility criteria, extracted data and assessed the risk of bias of each included study. Since meta-analysis was not possible, we produced a narrative results summary. We used the GRADE tool to assess the certainty of the evidence.

MAIN RESULTS

We did not identify any new eligible studies in this update. One cluster RCT involving 20 South African public hospitals and one ITS involving all acute hospital trusts in England, met the inclusion criteria. A trust is a National Health Service hospital which has opted to withdraw from local authority control and be managed by a trust instead.The cluster RCT reported mixed effects of external inspection on compliance with COHSASA (Council for Health Services Accreditation for South Africa) accreditation standards and eight indicators of hospital quality. Improved total compliance score with COHSASA accreditation standards was reported for 21/28 service elements: mean intervention effect was 30% (95% confidence interval (CI) 23% to 37%) (P < 0.001). The score increased from 48% to 78% in intervention hospitals, while remaining the same in control hospitals (43%). The median intervention effect for the indicators of hospital quality of care was 2.4% (range -1.9% to +11.8%).The ITS study evaluated compliance with policies to address healthcare-acquired infections and reported a mean reduction in MRSA (methicillin-resistant Staphylococcus aureus) infection rates of 100 cases per quarter (95% CI -221.0 to 21.5, P = 0.096) at three months' follow-up and an increase of 70 cases per quarter (95% CI -250.5 to 391.0; P = 0.632) at 24 months' follow-up. Regression analysis showed similar MRSA rates before and after the external inspection (difference in slope 24.27, 95% CI -10.4 to 58.9; P = 0.147).Neither included study reported data on unanticipated/adverse consequences or economic outcomes. The cluster RCT reported mainly outcomes related to healthcare organisation change, and no patient reported outcomes other than patient satisfaction.The certainty of the included evidence from both studies was very low. It is uncertain whether external inspection accreditation programmes lead to improved compliance with accreditation standards. It is also uncertain if external inspection infection programmes lead to improved compliance with standards, and if this in turn influences healthcare-acquired MRSA infection rates.

AUTHORS' CONCLUSIONS

The review highlights the paucity of high-quality controlled evaluations of the effectiveness and the cost-effectiveness of external inspection systems. If policy makers wish to understand the effectiveness of this type of intervention better, there needs to be further studies across a range of settings and contexts and studies reporting outcomes important to patients.