Could clinical audit improve the diagnosis of pulmonary tuberculosis in Cuba, Peru and Bolivia?

Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research

BACKGROUND

Providing health professionals with quantitative summaries of their clinical performance when treating specific groups of patients ("feedback") is a widely used quality improvement strategy, yet systematic reviews show it has varying success. Theory could help explain what factors influence feedback success, and guide approaches to enhance effectiveness. However, existing theories lack comprehensiveness and specificity to health care. To address this problem, we conducted the first systematic review and synthesis of qualitative evaluations of feedback interventions, using findings to develop a comprehensive new health care-specific feedback theory.

METHODS

We searched MEDLINE, EMBASE, CINAHL, Web of Science, and Google Scholar from inception until 2016 inclusive. Data were synthesised by coding individual papers, building on pre-existing theories to formulate hypotheses, iteratively testing and improving hypotheses, assessing confidence in hypotheses using the GRADE-CERQual method, and summarising high-confidence hypotheses into a set of propositions.

RESULTS

We synthesised 65 papers evaluating 73 feedback interventions from countries spanning five continents. From our synthesis we developed Clinical Performance Feedback Intervention Theory (CP-FIT), which builds on 30 pre-existing theories and has 42 high-confidence hypotheses. CP-FIT states that effective feedback works in a cycle of sequential processes; it becomes less effective if any individual process fails, thus halting progress round the cycle. Feedback's success is influenced by several factors operating via a set of common explanatory mechanisms: the feedback method used, health professional receiving feedback, and context in which feedback takes place. CP-FIT summarises these effects in three propositions: (1) health care professionals and organisations have a finite capacity to engage with feedback, (2) these parties have strong beliefs regarding how patient care should be provided that influence their interactions with feedback, and (3) feedback that directly supports clinical behaviours is most effective.

CONCLUSIONS

This is the first qualitative meta-synthesis of feedback interventions, and the first comprehensive theory of feedback designed specifically for health care. Our findings contribute new knowledge about how feedback works and factors that influence its effectiveness. Internationally, practitioners, researchers, and policy-makers can use CP-FIT to design, implement, and evaluate feedback. Doing so could improve care for large numbers of patients, reduce opportunity costs, and improve returns on financial investments.

TRIAL REGISTRATION

PROSPERO, CRD42015017541.

Clinical performance comparators in audit and feedback: a review of theory and evidence

BACKGROUND

Audit and feedback (A&F) is a common quality improvement strategy with highly variable effects on patient care. It is unclear how A&F effectiveness can be maximised. Since the core mechanism of action of A&F depends on drawing attention to a discrepancy between actual and desired performance, we aimed to understand current and best practices in the choice of performance comparator.

METHODS

We described current choices for performance comparators by conducting a secondary review of randomised trials of A&F interventions and identifying the associated mechanisms that might have implications for effective A&F by reviewing theories and empirical studies from a recent qualitative evidence synthesis.

RESULTS

We found across 146 trials that feedback recipients' performance was most frequently compared against the performance of others (benchmarks; 60.3%). Other comparators included recipients' own performance over time (trends; 9.6%) and target standards (explicit targets; 11.0%), and 13% of trials used a combination of these options. In studies featuring benchmarks, 42% compared against mean performance. Eight (5.5%) trials provided a rationale for using a specific comparator. We distilled mechanisms of each comparator from 12 behavioural theories, 5 randomised trials, and 42 qualitative A&F studies.

CONCLUSION

Clinical performance comparators in published literature were poorly informed by theory and did not explicitly account for mechanisms reported in qualitative studies. Based on our review, we argue that there is considerable opportunity to improve the design of performance comparators by (1) providing tailored comparisons rather than benchmarking everyone against the mean, (2) limiting the amount of comparators being displayed while providing more comparative information upon request to balance the feedback's credibility and actionability, (3) providing performance trends but not trends alone, and (4) encouraging feedback recipients to set personal, explicit targets guided by relevant information.

Tuberculosis screening in patients with HIV: use of audit and feedback to improve quality of care in Ghana

BACKGROUND

Tuberculosis screening of people living with HIV (PLHIV) can contribute to early tuberculosis diagnosis and improved patient outcomes. Evidence-based guidelines for tuberculosis screening are available, but literature assessing their implementation and the quality of clinical practice is scarce.

OBJECTIVES

To assess tuberculosis screening practices and the effectiveness of audit and performance feedback to improve quality of tuberculosis screening at HIV care clinics in Ghana.

DESIGN

Healthcare providers at 10 large HIV care clinics prospectively registered patient consultations during May and October 2014, before and after a performance feedback intervention in August 2014. The outcomes of interest were overall tuberculosis suspicion rate during consultations and provider adherence to the International Standards for Tuberculosis Care and the World Health Organizations' guidelines for symptom-based tuberculosis screening among PLHIV.

RESULTS

Twenty-one healthcare providers registered a total of 2,666 consultations; 1,368 consultations before and 1,298 consultations after the feedback intervention. Tuberculosis suspicion rate during consultation increased from 12.6 to 20.9% after feedback (odds ratio, OR 1.83; 95% confidence interval, CI: 1.09-3.09). Before feedback, sputum smear microscopy was requested for 58.7% of patients with suspected tuberculosis, for 47.2% of patients with cough ≥2 weeks, and for 27.5% of patients with a positive World Health Organization (WHO) symptom screen (any of current cough, fever, weight loss or night sweats). After feedback, patients with a positive WHO symptom screen were more likely to be suspected of tuberculosis (OR 2.21; 95% CI: 1.19-4.09) and referred for microscopy (OR 2.71; 95% CI: 1.25-5.86).

CONCLUSIONS

A simple prospective audit tool identified flaws in clinical practices for tuberculosis screening of PLHIV. There was no systematic identification of people with suspected active tuberculosis. We found low initial tuberculosis suspicion rate compounded by low referral rates of relevant patients for sputum smear microscopy. Adherence to recommended standards and guidelines for tuberculosis screening improved after performance feedback.

Auditing chronic disease care: Does it make a difference?

Background

An integrated audit tool was developed for five chronic diseases, namely diabetes, hypertension, asthma, chronic obstructive pulmonary disease and epilepsy. Annual audits have been done in the Western Cape Metro district since 2009. The year 2012 was the first year that all six districts in South Africa's Western Cape Province participated in the audit process.

Aim

To determine whether clinical audits improve chronic disease care in health districts over time.

Setting

Western Cape Province, South Africa.

Methods

Internal audits were conducted of primary healthcare facility processes and equipment availability as well as a folder review of 10 folders per chronic condition per facility. Random systematic sampling was used to select the 10 folders for the folder review. Combined data for all facilities gave a provincial overview and allowed for comparison between districts. Analysis was done comparing districts that have been participating in the audit process from 2009 to 2010 (‘2012 old’) to districts that started auditing recently (‘2012 new’).

Results

The number of facilities audited has steadily increased from 29 in 2009 to 129 in 2012. Improvements between different years have been modest, and the overall provincial average seemed worse in 2012 compared to 2011. However, there was an improvement in the ‘2012 old’ districts compared to the ‘2012 new’ districts for both the facility audit and the folder review, including for eight clinical indicators, with ‘2012 new’ districts being less likely to record clinical processes (OR 0.25, 95% CI 0.21–0.31).

Conclusion

These findings are an indication of the value of audits to improve care processes over the long term. It is hoped that this improvement will lead to improved patient outcomes.

Effecting change in primary care management of respiratory conditions: a global scoping exercise and literature review of educational interventions to inform the IPCRG's E-Quality initiative

This discussion paper describes a scoping exercise and literature review commissioned by the International Primary Care Respiratory Group (IPCRG) to inform their E-Quality programme which seeks to support small-scale educational projects to improve respiratory management in primary care. Our narrative review synthesises information from three sources: publications concerning the global context and health systems development; a literature search of Medline, CINAHL and Cochrane databases; and a series of eight interviews conducted with members of the IPCRG faculty. Educational interventions sit within complex healthcare, economic, and policy contexts. It is essential that any development project considers the local circumstances in terms of economic resources, political circumstances, organisation and administrative capacities, as well as the specific quality issue to be addressed. There is limited evidence (in terms of changed clinician behaviour and/or improved health outcomes) regarding the merits of different educational and quality improvement approaches. Features of educational interventions that were most likely to show some evidence of effectiveness included being carefully designed, multifaceted, engaged health professionals in their learning, provided ongoing support, were sensitive to local circumstances, and delivered in combination with other quality improvement strategies. To be effective, educational interventions must consider the complex healthcare systems within which they operate. The criteria for the IPCRG E-Quality awards thus require applicants not only to describe their proposed educational initiative but also to consider the practical and local barriers to successful implementation, and to propose a robust evaluation in terms of changed clinician behaviour or improved health outcomes.

Clinical audit of diabetes management can improve the quality of care in a resource-limited primary care setting

OBJECTIVE

To determine whether clinical audit improved the performance of diabetic clinical processes in the health district in which it was implemented.

DESIGN

Patient folders were systematically sampled annually for review.

SETTING

Primary health-care facilities in the Metro health district of the Western Cape Province in South Africa.

PARTICIPANTS

Health-care workers involved in diabetes management.

INTERVENTION

Clinical audit and feedback.

MAIN OUTCOME MEASURE

The Skillings-Mack test was applied to median values of pooled audit results for nine diabetic clinical processes to measure whether there were statistically significant differences between annual audits performed in 2005, 2007, 2008 and 2009. Descriptive statistics were used to illustrate the order of values per process.

RESULTS

A total of 40 community health centres participated in the baseline audit of 2005 that decreased to 30 in 2009. Except for two routine processes, baseline medians for six out of nine processes were below 50%. Pooled audit results showed statistically significant improvements in seven out of nine clinical processes.

CONCLUSIONS

The findings indicate an association between the application of clinical audit and quality improvement in resource-limited settings. Co-interventions introduced after the baseline audit are likely to have contributed to improved outcomes. In addition, support from the relevant government health programmes and commitment of managers and frontline staff contributed to the audit's success.

Putting theory into practice: the introduction of obstetric near-miss case reviews in the Republic of Moldova

QUALITY ISSUE

The quality of obstetric services remains a major issue in the Republic of Moldova. Services are well staffed and intensively used but do not deliver the expected outputs.

INITIAL ASSESSMENT

Providers have limited experience with clinical audits and perceive them as a way to punish individuals.

CHOICE OF SOLUTION

Near-miss case reviews were introduced. Discussing near-miss cases might be less threatening to providers than discussing maternal deaths because the women survived.

IMPLEMENTATION

The quality of audits was evaluated against explicit criteria in three pilot maternities.

EVALUATION

On average one case was discussed every 5-6 weeks. Information from women's interviews was presented at all meetings, although the quality of the women's interviews was low. The weakest aspect of care was monitoring and follow-up treatment; the majority of proposed actions concerned the availability or compliance to protocols (52-69%). Proposed actions were consistent with prior analysis (95-100%), formulated in a clear and measurable way (58-90%), but the rate of failure to identify important actions was quite high in one facility (33%). Actions were more likely to be implemented when they concerned organization and management, drugs and supplies and least likely when they concerned staff.

LESSONS LEARNED

It is relatively easy to build capacity in organizing obstetric 'near-miss' audits, but more difficult to ensure that discussions are transposed into actions. In settings with no tradition of patients' involvement, increased attention should be given to providers' capacity to tackle patient-related factors.

Missed opportunity for standardized diagnosis and treatment among adult tuberculosis patients in hospitals involved in Public-Private Mix for Directly Observed Treatment Short-Course strategy in Indonesia: a cross-sectional study

Background

The engagement of hospitals in Public-Private Mix (PPM) for Directly Observed Treatment Short-Course (DOTS) strategy has increased rapidly internationally - including in Indonesia. In view of the rapid global scaling-up of hospital engagement, we aimed to estimate the proportion of outpatient adult Tuberculosis patients who received standardized diagnosis and treatment at outpatients units of hospitals involved in the PPM-DOTS strategy.

Methods

A cross-sectional study using morbidity reports for outpatients, laboratory registers and Tuberculosis patient registers from 1 January 2005 to 31 December 2005. By quota sampling, 62 hospitals were selected. Post-stratification analysis was conducted to estimate the proportion of Tuberculosis cases receiving standardized management according to the DOTS strategy.

Result

Nineteen to 53% of Tuberculosis cases and 4-18% of sputum smear positive Tuberculosis cases in hospitals that participated in the PPM-DOTS strategy were not treated with standardized diagnosis and treatment as in DOTS.

Conclusion

This study found that a substantial proportion of TB patients cared for at PPM-DOTS hospitals are not managed under the DOTS strategy. This represents a missed opportunity for standardized diagnoses and treatment. A combination of strong individual commitment of health professionals, organizational supports, leadership, and relevant policy in hospital and National Tuberculosis Programme may be required to strengthen DOTS implementation in hospitals.