Effectiveness of feedback for improving case management of malaria, diarrhoea and pneumonia--a randomized controlled trial at provincial hospitals in Lao PDR

Exploring the content and delivery of feedback facilitation co-interventions: a systematic review

BACKGROUND

Policymakers and researchers recommend supporting the capabilities of feedback recipients to increase the quality of care. There are different ways to support capabilities. We aimed to describe the content and delivery of feedback facilitation interventions delivered alongside audit and feedback within randomised controlled trials.

METHODS

We included papers describing feedback facilitation identified by the latest Cochrane review of audit and feedback. The piloted extraction proforma was based upon a framework to describe intervention content, with additional prompts relating to the identification of influences, selection of improvement actions and consideration of priorities and implications. We describe the content and delivery graphically, statistically and narratively.

RESULTS

We reviewed 146 papers describing 104 feedback facilitation interventions. Across included studies, feedback facilitation contained 26 different implementation strategies. There was a median of three implementation strategies per intervention and evidence that the number of strategies per intervention is increasing. Theory was used in 35 trials, although the precise role of theory was poorly described. Ten studies provided a logic model and six of these described their mechanisms of action. Both the exploration of influences and the selection of improvement actions were described in 46 of the feedback facilitation interventions; we describe who undertook this tailoring work. Exploring dose, there was large variation in duration (15-1800 min), frequency (1 to 42 times) and number of recipients per site (1 to 135). There were important gaps in reporting, but some evidence that reporting is improving over time.

CONCLUSIONS

Heterogeneity in the design of feedback facilitation needs to be considered when assessing the intervention's effectiveness. We describe explicit feedback facilitation choices for future intervention developers based upon choices made to date. We found the Expert Recommendations for Implementing Change to be valuable when describing intervention components, with the potential for some minor clarifications in terms and for greater specificity by intervention providers. Reporting demonstrated extensive gaps which hinder both replication and learning. Feedback facilitation providers are recommended to close reporting gaps that hinder replication. Future work should seek to address the 'opportunity' for improvement activity, defined as factors that lie outside the individual that make care or improvement behaviour possible.

REVIEW REGISTRATION

The study protocol was published at: https://www.protocols.io/private/4DA5DE33B68E11ED9EF70A58A9FEAC02 .

Barriers and facilitators of implementing interventions to improve appropriate antibiotic use in low- and middle-income countries: a systematic review based on the Consolidated Framework for Implementation Research

Background

Behavior change interventions that aim to improve rational antibiotic use in prescribers and users have been widely conducted in both high- and LMICs. However, currently, no review has systematically examined challenges unique to LMICs and offered insights into the underlying contextual factors that influence these interventions. We adopted an implementation research perspective to systematically synthesize the implementation barriers and facilitators in LMICs.

Methods

We conducted literature searches in five electronic databases and identified studies that involved the implementation of behavior change interventions to improve appropriate antibiotic use in prescribers and users in LMICs and reported implementation barriers and facilitators. Behavior change interventions were defined using the behavior change wheel, and the coding and synthesis of barriers and facilitators were guided by the Consolidated Framework for Implementation Research (CFIR).

Results

We identified 52 eligible studies, with the majority targeting prescribers practicing at tertiary facilities (N=39, 75%). The most commonly reported factors influencing implementation were found in the inner setting domain of the CFIR framework, particularly related to constraints in resources and the infrastructure of the facilities where interventions were implemented. Barriers related to the external policy environment (e.g., lack of national initiatives and policies on antibiotic use), and individual characteristics of target populations (e.g., reluctance to change prescribing behaviors) were also common, as well as facilitators related to intervention characteristics (e.g., embedding interventions in routine practice) and process (e.g., stakeholder engagement). We also provided insights into the interrelationships between these factors and the underlying causes contributing to the implementation challenges in LMICs.

Conclusion

We presented a comprehensive overview of the barriers and facilitators of implementing behavior change interventions to promote rational antibiotic use in LMICs. Our findings suggest that facilitating the implementation of interventions to improve rational antibiotic use needs comprehensive efforts to address challenges at policy, organizational, and implementation levels. Specific strategies include (1) strengthening political commitment to prompt mobilization of domestic resources and formulation of a sustainable national strategy on AMR, (2) improving the infrastructure of health facilities that allow prescribers to make evidence-based clinical decisions, and (3) engaging local stakeholders to improve their buy-in and facilitate contextualizing interventions.

Trial registration

PROSPERO: CRD42021252715.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01209-4.

Strategies Used for Implementing and Promoting Adherence to Antibiotic Guidelines in Low- and Lower-Middle-Income Countries: A Systematic Review

Containing antimicrobial resistance and reducing high levels of antibiotic consumption in low- and lower middle-income countries are a major challenge. Clinical guidelines targeting antibiotic prescribing can reduce consumption, however, the degrees to which clinical guidelines are adopted and adhered to are challenging for developers, policy makers and users. The aim of this study was to review the strategies used for implementing and promoting antibiotic guideline adherence in low- and lower middle-income countries. A review of published literature was conducted using PubMed, Cochrane Library, SCOPUS and the information systems of the World Health Organization and the Australian National University according to PRISMA guidelines and our PROSPERO protocol. The strategies were grouped into five broad categories based on the Cochrane Effective Practice and Organization of Care taxonomy. The 33 selected studies, representing 16 countries varied widely in design, setting, disease focus, methods, intervention components, outcomes and effects. The majority of interventions were multifaceted and resulted in a positive direction of effect. The nature of the interventions and study variability made it impossible to tease out which strategies had the greatest impact on improving CG compliance. Audit and feedback coupled with either workshops and/or focus group discussions were the most frequently used intervention components. All the reported strategies are established practices used in antimicrobial stewardship programs in high-income countries. We recommend interrupted time series studies be used as an alternative design to pre- and post-intervention studies, information about the clinical guidelines be made more transparent, and prescriber confidence be investigated.

Improving antibiotic use through behaviour change: a systematic review of interventions evaluated in low- and middle-income countries

Antibiotic resistance (ABR) has been identified as a critical threat to global health at the highest policy fora. A leading cause of ABR is the inappropriate use of antibiotics by both patients and healthcare providers. Although countries around the world have committed to developing and implementing national action plans to tackle ABR, there is a considerable gap in evidence about effective behaviour change interventions addressing inappropriate use of antibiotics in low- and middle-income countries (LMICs), where ABR is growing at an alarming rate. We conducted a systematic review to synthesize evidence about the effectiveness and cost-effectiveness of behaviour change interventions to reduce inappropriate use of antibiotics in LMICs. Three databases were searched using a set of predefined search terms and exclusion criteria. The search identified 43 relevant articles. A narrative synthesis of results was conducted using the Behaviour Change Wheel framework to categorize intervention components. The majority of the reviewed studies were set in lower-middle-income or low-income countries located in Sub-Saharan Africa or East Asia and the Pacific. Twenty-four articles evaluated multi-faceted interventions over a period of 12 months or less. Despite the widespread use of antibiotics in the community, interventions were primarily implemented in public health facilities, targeting health professionals such as doctors, nurses, and other allied medical staff. Although education for providers was the most widely used strategy for influencing antibiotic use, it was shown to be most effective when used in conjunction with training or other enabling and supportive measures to nudge behaviour. Six articles included an evaluation of costs of interventions and found a reduction in costs in inpatient and outpatient settings, and one article found a training and guidelines implementation-based intervention to be highly cost-effective. However, the small number of articles conducting an economic evaluation highlights the need for such analyses to be conducted more frequently to support priority setting in resource-constrained environments.

How effective and cost-effective are behaviour change interventions in improving the prescription and use of antibiotics in low-income and middle-income countries? A protocol for a systematic review

INTRODUCTION

Antibiotic resistance endangers effective prevention and treatment of infections, and places significant burden on patients, families, communities and healthcare systems. Low-income and middle-income countries (LMICs) are especially vulnerable to antibiotic resistance, owing to high infectious disease burden, and limited resources for treatment. High prevalence of antibiotic prescription and use due to lack of provider's knowledge, prescriber's habits and perceived patient needs further exacerbate the situation. Interventions implemented to address the inappropriate prescription and use of antibiotics in LMICs must address different determinants of antibiotic resistance through sustainable and scalable interventions. The aim of this protocol is to provide a comprehensive overview of the methods that will be used to identify and appraise evidence on the effectiveness and cost-effectiveness of behaviour change interventions implemented in LMICs to improve the prescription and use of antibiotics.

METHODS AND ANALYSIS

Two databases (Web of Science and PubMed) will be searched based on a strategy developed in consultation with an essential medicines and health systems researcher. Additional studies will be identified using the same search strategy in Google Scholar. To be included, a study must describe a behaviour change intervention and use an experimental design to estimate effectiveness and/or cost-effectiveness in an LMIC. Following systematic screening of titles, abstracts and keywords, and full-text appraisal, data will be extracted using a customised extraction form. Studies will be categorised by type of behaviour change intervention and experimental design. A meta-analysis or narrative synthesis will be conducted as appropriate, along with an appraisal of quality of studies using the Grading of Recommendation, Assessment, Development and Evaluation (GRADE) checklist.

ETHICS AND DISSEMINATION

No individual patient data are used, so ethical approval is not required. The systematic review will be disseminated in a peer-reviewed journal and presented at a relevant international conference.

PROSPERO REGISTRATION NUMBER

CRD42017075596.

Interventions to improve antibiotic prescribing practices for hospital inpatients

BACKGROUND

Antibiotic resistance is a major public health problem. Infections caused by multidrug-resistant bacteria are associated with prolonged hospital stay and death compared with infections caused by susceptible bacteria. Appropriate antibiotic use in hospitals should ensure effective treatment of patients with infection and reduce unnecessary prescriptions. We updated this systematic review to evaluate the impact of interventions to improve antibiotic prescribing to hospital inpatients.

OBJECTIVES

To estimate the effectiveness and safety of interventions to improve antibiotic prescribing to hospital inpatients and to investigate the effect of two intervention functions: restriction and enablement.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) (the Cochrane Library), MEDLINE, and Embase. We searched for additional studies using the bibliographies of included articles and personal files. The last search from which records were evaluated and any studies identified incorporated into the review was January 2015.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and non-randomised studies (NRS). We included three non-randomised study designs to measure behavioural and clinical outcomes and analyse variation in the effects: non- randomised trials (NRT), controlled before-after (CBA) studies and interrupted time series (ITS) studies. For this update we also included three additional NRS designs (case control, cohort, and qualitative studies) to identify unintended consequences. Interventions included any professional or structural interventions as defined by the Cochrane Effective Practice and Organisation of Care Group. We defined restriction as 'using rules to reduce the opportunity to engage in the target behaviour (or increase the target behaviour by reducing the opportunity to engage in competing behaviours)'. We defined enablement as 'increasing means/reducing barriers to increase capability or opportunity'. The main comparison was between intervention and no intervention.

DATA COLLECTION AND ANALYSIS

Two review authors extracted data and assessed study risk of bias. We performed meta-analysis and meta-regression of RCTs and meta-regression of ITS studies. We classified behaviour change functions for all interventions in the review, including those studies in the previously published versions. We analysed dichotomous data with a risk difference (RD). We assessed certainty of evidence with GRADE criteria.

MAIN RESULTS

This review includes 221 studies (58 RCTs, and 163 NRS). Most studies were from North America (96) or Europe (87). The remaining studies were from Asia (19), South America (8), Australia (8), and the East Asia (3). Although 62% of RCTs were at a high risk of bias, the results for the main review outcomes were similar when we restricted the analysis to studies at low risk of bias.More hospital inpatients were treated according to antibiotic prescribing policy with the intervention compared with no intervention based on 29 RCTs of predominantly enablement interventions (RD 15%, 95% confidence interval (CI) 14% to 16%; 23,394 participants; high-certainty evidence). This represents an increase from 43% to 58% .There were high levels of heterogeneity of effect size but the direction consistently favoured intervention.The duration of antibiotic treatment decreased by 1.95 days (95% CI 2.22 to 1.67; 14 RCTs; 3318 participants; high-certainty evidence) from 11.0 days. Information from non-randomised studies showed interventions to be associated with improvement in prescribing according to antibiotic policy in routine clinical practice, with 70% of interventions being hospital-wide compared with 31% for RCTs. The risk of death was similar between intervention and control groups (11% in both arms), indicating that antibiotic use can likely be reduced without adversely affecting mortality (RD 0%, 95% CI -1% to 0%; 28 RCTs; 15,827 participants; moderate-certainty evidence). Antibiotic stewardship interventions probably reduce length of stay by 1.12 days (95% CI 0.7 to 1.54 days; 15 RCTs; 3834 participants; moderate-certainty evidence). One RCT and six NRS raised concerns that restrictive interventions may lead to delay in treatment and negative professional culture because of breakdown in communication and trust between infection specialists and clinical teams (low-certainty evidence).Both enablement and restriction were independently associated with increased compliance with antibiotic policies, and enablement enhanced the effect of restrictive interventions (high-certainty evidence). Enabling interventions that included feedback were probably more effective than those that did not (moderate-certainty evidence).There was very low-certainty evidence about the effect of the interventions on reducing Clostridium difficile infections (median -48.6%, interquartile range -80.7% to -19.2%; 7 studies). This was also the case for resistant gram-negative bacteria (median -12.9%, interquartile range -35.3% to 25.2%; 11 studies) and resistant gram-positive bacteria (median -19.3%, interquartile range -50.1% to +23.1%; 9 studies). There was too much variance in microbial outcomes to reliably assess the effect of change in antibiotic use. Heterogeneity of intervention effect on prescribing outcomesWe analysed effect modifiers in 29 RCTs and 91 ITS studies. Enablement and restriction were independently associated with a larger effect size (high-certainty evidence). Feedback was included in 4 (17%) of 23 RCTs and 20 (47%) of 43 ITS studies of enabling interventions and was associated with greater intervention effect. Enablement was included in 13 (45%) of 29 ITS studies with restrictive interventions and enhanced intervention effect.

AUTHORS' CONCLUSIONS

We found high-certainty evidence that interventions are effective in increasing compliance with antibiotic policy and reducing duration of antibiotic treatment. Lower use of antibiotics probably does not increase mortality and likely reduces length of stay. Additional trials comparing antibiotic stewardship with no intervention are unlikely to change our conclusions. Enablement consistently increased the effect of interventions, including those with a restrictive component. Although feedback further increased intervention effect, it was used in only a minority of enabling interventions. Interventions were successful in safely reducing unnecessary antibiotic use in hospitals, despite the fact that the majority did not use the most effective behaviour change techniques. Consequently, effective dissemination of our findings could have considerable health service and policy impact. Future research should instead focus on targeting treatment and assessing other measures of patient safety, assess different stewardship interventions, and explore the barriers and facilitators to implementation. More research is required on unintended consequences of restrictive interventions.

Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation

BACKGROUND

The objective of this study was to assess the effect of a web-based audit and feedback (A&F) intervention with outreach visits to support decision-making by multidisciplinary teams.

METHODS

We performed a multicentre cluster-randomized trial within the field of comprehensive cardiac rehabilitation (CR) in the Netherlands. Our participants were multidisciplinary teams in Dutch CR centres who were enrolled in the study between July 2012 and December 2013 and received the intervention for at least 1 year. The intervention included web-based A&F with feedback on clinical performance, facilities for goal setting and action planning, and educational outreach visits. Teams were randomized either to receive feedback that was limited to psychosocial rehabilitation (study group A) or to physical rehabilitation (study group B). The main outcome measure was the difference in performance between study groups in 11 care processes and six patient outcomes, measured at patient level. Secondary outcomes included effects on guideline concordance for the four main CR therapies.

RESULTS

Data from 18 centres (14,847 patients) were analysed, of which 12 centres (9353 patients) were assigned to group A and six (5494 patients) to group B. During the intervention, a total of 233 quality improvement goals was identified by participating teams, of which 49 (21%) were achieved during the study period. Except for a modest improvement in data completeness (4.5% improvement per year; 95% CI 0.65 to 8.36), we found no effect of our intervention on any of our primary or secondary outcome measures.

CONCLUSIONS

Within a multidisciplinary setting, our web-based A&F intervention engaged teams to define local performance improvement goals but failed to support them in actually completing the improvement actions that were needed to achieve those goals. Future research should focus on improving the actionability of feedback on clinical performance and on addressing the socio-technical perspective of the implementation process.

TRIAL REGISTRATION

NTR3251.

Implementing WHO hospital guidelines improves quality of paediatric care in central hospitals in Lao PDR

OBJECTIVES

To evaluate the impact of implementing a multifaceted intervention based on the WHO Pocketbook of Hospital Care for Children on the quality of case management of common childhood illnesses in hospitals in Lao PDR.

METHODS

The quality of case management of four sentinel conditions was assessed in three central hospitals before and after the implementation of the WHO Pocketbook as part of a broader mixed-methods study. Data on performance of key steps in case management in more than 600 admissions were collected by medical record abstraction pre- and post-intervention, and change was measured according to the proportion of cases which key steps were performed as well as an overall score of case management for each condition.

RESULTS

Improvements in mean case management scores were observed post-intervention for three of the four conditions, with the greatest change in pneumonia (53-91%), followed by diarrhoea and low birthweight. Rational drug prescribing, appropriate use of IV fluids and appropriate monitoring all occurred more frequently post-intervention. Non-recommended practices such as prescription of antitussives became less frequent.

CONCLUSIONS

A multifaceted intervention based on the WHO Pocketbook of Hospital Care for children led to better paediatric care in central Lao hospitals. The degree of improvement was dependent on the condition assessed.

Beyond Accreditation: A Multi-Track Quality-Enhancing Strategy for Primary Health Care in Low-and Middle-Income Countries

Many define an equitable health care system as one that provides logistical and financial access to “quality” care to the population. Realizing that fact, many low- and middle-income countries started investing in enhancing the quality of care in their health care systems, recently in primary health care. Unfortunately, in many instance, these investments have been exclusively focused on accreditation due to available guidelines and existing accrediting structures. A multi-track quality-enhancing strategy (MTQES) is proposed that includes, in addition to promoting resource-sensitive accreditation, other quality initiatives such as clinical guidelines, performance indicators, benchmarking activities, annual quality-enhancing projects, and annual quality summit/meeting. These complementary approaches are presented to synergistically enhance a continuous quality improvement culture in the primary health care sector, taking into consideration limited resources available, especially in low- and middle-income countries. In addition, an implementation framework depicting MTQES in three-phase interlinked packages is presented; each matches existing resources and quality infrastructure. Health care policymakers and managers need to think about accreditation as a beginning rather than an end to their quest for quality. Improvements in the structure of a health delivery organization or in the processes of care have little value if they do not translate to reduced disparities in access to “quality” care, and not merely access to care.

Interventions to improve antibiotic prescribing practices for hospital inpatients

BACKGROUND

The first publication of this review in Issue 3, 2005 included studies up to November 2003. This update adds studies to December 2006 and focuses on application of a new method for meta-analysis of interrupted time series studies and application of new Cochrane Effective Practice and Organisation of Care (EPOC) Risk of Bias criteria to all studies in the review, including those studies in the previously published version. The aim of the review is to evaluate the impact of interventions from the perspective of antibiotic stewardship. The two objectives of antibiotic stewardship are first to ensure effective treatment for patients with bacterial infection and second support professionals and patients to reduce unnecessary use and minimize collateral damage.

OBJECTIVES

To estimate the effectiveness of professional interventions that, alone or in combination, are effective in antibiotic stewardship for hospital inpatients, to evaluate the impact of these interventions on reducing the incidence of antimicrobial-resistant pathogens or Clostridium difficile infection and their impact on clinical outcome.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE from 1980 to December 2006 and the EPOC specialized register in July 2007 and February 2009 and bibliographies of retrieved articles. The main comparison is between interventions that had a restrictive element and those that were purely persuasive. Restrictive interventions were implemented through restriction of the freedom of prescribers to select some antibiotics. Persuasive interventions used one or more of the following methods for changing professional behaviour: dissemination of educational resources, reminders, audit and feedback, or educational outreach. Restrictive interventions could contain persuasive elements.

SELECTION CRITERIA

We included randomized clinical trials (RCTs), controlled clinical trials (CCT), controlled before-after (CBA) and interrupted time series studies (ITS). Interventions included any professional or structural interventions as defined by EPOC. The intervention had to include a component that aimed to improve antibiotic prescribing to hospital inpatients, either by increasing effective treatment or by reducing unnecessary treatment. The results had to include interpretable data about the effect of the intervention on antibiotic prescribing or microbial outcomes or relevant clinical outcomes.

DATA COLLECTION AND ANALYSIS

Two authors extracted data and assessed quality. We performed meta-regression of ITS studies to compare the results of persuasive and restrictive interventions. Persuasive interventions advised physicians about how to prescribe or gave them feedback about how they prescribed. Restrictive interventions put a limit on how they prescribed; for example, physicians had to have approval from an infection specialist in order to prescribe an antibiotic. We standardized the results of some ITS studies so that they are on the same scale (percent change in outcome), thereby facilitating comparisons of different interventions. To do this, we used the change in level and change in slope to estimate the effect size with increasing time after the intervention (one month, six months, one year, etc) as the percent change in level at each time point. We did not extrapolate beyond the end of data collection after the intervention. The meta-regression was performed using standard weighted linear regression with the standard errors of the coefficients adjusted where necessary.

MAIN RESULTS

For this update we included 89 studies that reported 95 interventions. Of the 89 studies, 56 were ITSs (of which 4 were controlled ITSs), 25 were RCT (of which 5 were cluster-RCTs), 5 were CBAs and 3 were CCTs (of which 1 was a cluster-CCT).Most (80/95, 84%) of the interventions targeted the antibiotic prescribed (choice of antibiotic, timing of first dose and route of administration). The remaining 15 interventions aimed to change exposure of patients to antibiotics by targeting the decision to treat or the duration of treatment. Reliable data about impact on antibiotic prescribing data were available for 76 interventions (44 persuasive, 24 restrictive and 8 structural). For the persuasive interventions, the median change in antibiotic prescribing was 42.3% for the ITSs, 31.6% for the controlled ITSs, 17.7% for the CBAs, 3.5% for the cluster-RCTs and 24.7% for the RCTs. The restrictive interventions had a median effect size of 34.7% for the ITSs, 17.1% for the CBAs and 40.5% for the RCTs. The structural interventions had a median effect of 13.3% for the RCTs and 23.6% for the cluster-RCTs. Data about impact on microbial outcomes were available for 21 interventions but only 6 of these also had reliable data about impact on antibiotic prescribing.Meta-analysis of 52 ITS studies was used to compare restrictive versus purely persuasive interventions. Restrictive interventions had significantly greater impact on prescribing outcomes at one month (32%, 95% confidence interval (CI) 2% to 61%, P = 0.03) and on microbial outcomes at 6 months (53%, 95% CI 31% to 75%, P = 0.001) but there were no significant differences at 12 or 24 months. Interventions intended to decrease excessive prescribing were associated with reduction in Clostridium difficile infections and colonization or infection with aminoglycoside- or cephalosporin-resistant gram-negative bacteria, methicillin-resistant Staphylococcus aureus and vancomycin-resistant Enterococcus faecalis. Meta-analysis of clinical outcomes showed that four interventions intended to increase effective prescribing for pneumonia were associated with significant reduction in mortality (risk ratio 0.89, 95% CI 0.82 to 0.97), whereas nine interventions intended to decrease excessive prescribing were not associated with significant increase in mortality (risk ratio 0.92, 95% CI 0.81 to 1.06).

AUTHORS' CONCLUSIONS

The results show that interventions to reduce excessive antibiotic prescribing to hospital inpatients can reduce antimicrobial resistance or hospital-acquired infections, and interventions to increase effective prescribing can improve clinical outcome. This update provides more evidence about unintended clinical consequences of interventions and about the effect of interventions to reduce exposure of patients to antibiotics. The meta-analysis supports the use of restrictive interventions when the need is urgent, but suggests that persuasive and restrictive interventions are equally effective after six months.

Quality of antenatal and childbirth care in selected rural health facilities in Burkina Faso, Ghana and Tanzania: similar finding

OBJECTIVES

To measure pre-intervention quality of routine antenatal and childbirth care in rural districts of Burkina Faso, Ghana and Tanzania and to identify shortcomings.

METHODS

In each country, we selected two adjoining rural districts. Within each district, we randomly sampled 6 primary healthcare facilities. Quality of care was assessed through health facility surveys, direct observation of antenatal and childbirth care, exit interviews and review of patient records.

RESULTS

By and large, quality of antenatal and childbirth care in the six districts was satisfactory, but we did identify some critical gaps common to the study sites in all three countries. Counselling and health education practices are poor; laboratory investigations are often not performed; examination and monitoring of mother and newborn during childbirth are inadequate; partographs are not used. Equipment required to provide assisted vaginal deliveries (vacuum extractor or forceps) was absent in all surveyed facilities.

CONCLUSION

Quality of care in the three study sites can be improved with the available human resources and without major investments. This improvement could reduce maternal and neonatal mortality and morbidity.

Private sector delivery of health services in developing countries: a mixed-methods study on quality assurance in social franchises

Background

Across the developing world health care services are most often delivered in the private sector and social franchising has emerged, over the past decade, as an increasingly popular method of private sector health care delivery. Social franchising aims to strengthen business practices through economies of scale: branding clinics and purchasing drugs in bulk at wholesale prices. While quality is one of the established goals of social franchising, there is no published documentation of how quality levels might be set in the context of franchised private providers, nor what quality assurance measures can or should exist within social franchises. The aim of this study was to better understand the quality assurance systems currently utilized in social franchises, and to determine if there are shared standards for practice or quality outcomes that exist across programs.

Methods

The study included three data sources and levels of investigation: 1) Self-reported program data; 2) Scoping telephone interviews; and 3) In-depth field interviews and clinic visits.

Results

Social Franchises conceive of quality assurance not as an independent activity, but rather as a goal that is incorporated into all areas of franchise operations, including recruitment, training, monitoring of provider performance, monitoring of client experience and the provision of feedback.

Conclusions

These findings are the first evidence to support the 2002 conceptual model of social franchising which proposed that the assurance of quality was one of the three core goals of all social franchises. However, while quality is important to franchise programs, quality assurance systems overall are not reflective of the evidence to-date on quality measurement or quality improvement best practices. Future research in this area is needed to better understand the details of quality assurance systems as applied in social franchise programs, the process by which quality assurance becomes a part of the organizational culture, and the components of a quality assurance system that are most correlated with improved quality of clinical care for patients.

Clinical audit of diabetes management can improve the quality of care in a resource-limited primary care setting

OBJECTIVE

To determine whether clinical audit improved the performance of diabetic clinical processes in the health district in which it was implemented.

DESIGN

Patient folders were systematically sampled annually for review.

SETTING

Primary health-care facilities in the Metro health district of the Western Cape Province in South Africa.

PARTICIPANTS

Health-care workers involved in diabetes management.

INTERVENTION

Clinical audit and feedback.

MAIN OUTCOME MEASURE

The Skillings-Mack test was applied to median values of pooled audit results for nine diabetic clinical processes to measure whether there were statistically significant differences between annual audits performed in 2005, 2007, 2008 and 2009. Descriptive statistics were used to illustrate the order of values per process.

RESULTS

A total of 40 community health centres participated in the baseline audit of 2005 that decreased to 30 in 2009. Except for two routine processes, baseline medians for six out of nine processes were below 50%. Pooled audit results showed statistically significant improvements in seven out of nine clinical processes.

CONCLUSIONS

The findings indicate an association between the application of clinical audit and quality improvement in resource-limited settings. Co-interventions introduced after the baseline audit are likely to have contributed to improved outcomes. In addition, support from the relevant government health programmes and commitment of managers and frontline staff contributed to the audit's success.

Indicators of quality use of medicines in South-East Asian countries: a systematic review

OBJECTIVES

To identify indicators of quality use of medicines used in South-East Asian region.

METHODS

A systematic review was conducted searching MEDLINE, Embase and The International Network for Rational Use of Drugs (INRUD) and The World Health Organization (WHO) website. Original studies or reports carried out in the South-East Asian region, explicitly using indicators to measure quality use of medicines, and published between January 2000 and July 2011 were included.

RESULTS

A total of 17 studies conducted in 7 of 11 countries in South-East Asia were included. WHO indicators focusing on general medication use in health facilities were most widely used (10 studies). Twelve studies used non-WHO indicators for measuring quality use of medicines in clinical areas (geriatrics and obstetrics) or specific diseases, such as diarrhoea and pneumonia. In five studies, WHO indicators were used along with non-WHO indicators. There was little information available about validity, reliability and feasibility of the non-WHO indicators. The majority of indicators measured process rather than structure or outcome. There were very few indicators addressing non-communicable diseases.

CONCLUSIONS

A limited number of studies have been published explicitly using indicators of quality use of medicines across South-East Asia. Importantly, existing indicators need to be complemented with valid, reliable and feasible indicators related to non-communicable diseases, particularly those with a high financial burden to meet the current medical challenges in the region.

Poor quality of antenatal care services--is lack of competence and support the reason? An observational and interview study in rural areas of Lao PDR

OBJECTIVE

to explore the health-care providers' performance and their own perceptions of the ANC services they provide.

DESIGN, SETTING AND PARTICIPANTS

this cross-sectional exploratory survey was carried out in 2009 at four district hospitals and 18 health centres in Khammouane and Champasack provinces in rural areas of Laos.

MEASUREMENTS AND FINDINGS

combinations of quantitative and qualitative methods were used: (i) 59 observations of ANC sessions (components performed and equipment used); (ii) 26 semi-structured interviews with health-care providers engaged in ANC services, interpreted through content analysis. The findings indicated an overall poor quality and performance of ANC services in rural health facilities with lack of routines, scarce or insufficient equipment and limited skills among providers. The health-care providers gave an often pessimistic picture of their competence and motivation to work with ANC. Some articulated a resignation due to lack of feedback from the patients and they expressed a need for support from health-care superiors. Compared to the district hospitals, the health centres were less well-equipped and supplied, and the providers had a heavier workload, because all activities including ANC were carried out by the same provider. The average consultation time for each woman was 5mins.

CONCLUSIONS

the quality of ANC services in rural health facilities in Laos was poor due to lack of resources, the providers' limited skills concurrent with inadequate routines and insufficient backup from superiors.

IMPLICATIONS FOR PRACTICE

to comply with national and international recommendations for ANC services, our suggestion is to improve the quality of the rural health facilities in Laos by providing basic equipment, support from experienced superiors and in-service training.

Audit and feedback: effects on professional practice and healthcare outcomes

BACKGROUND

Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectiveness of audit and feedback in improving healthcare practice and the characteristics of audit and feedback that lead to greater impact.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes and to examine factors that may explain variation in the effectiveness of audit and feedback.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 4, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 December 2010); MEDLINE, Ovid (1950 to November Week 3 2010) (searched 09 December 2010); EMBASE, Ovid (1980 to 2010 Week 48) (searched 09 December 2010); CINAHL, Ebsco (1981 to present) (searched 10 December 2010); Science Citation Index and Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 12-15 September 2011).

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as a summary of clinical performance over a specified period of time) that reported objectively measured health professional practice or patient outcomes. In the case of multifaceted interventions, only trials in which audit and feedback was considered the core, essential aspect of at least one intervention arm were included.

DATA COLLECTION AND ANALYSIS

All data were abstracted by two independent review authors. For the primary outcome(s) in each study, we calculated the median absolute risk difference (RD) (adjusted for baseline performance) of compliance with desired practice compliance for dichotomous outcomes and the median percent change relative to the control group for continuous outcomes. Across studies the median effect size was weighted by number of health professionals involved in each study. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient, and risk of bias within the trial itself. We also conducted exploratory analyses to assess the role of context and the targeted clinical behaviour. Quantitative (meta-regression), visual, and qualitative analyses were undertaken to examine variation in effect size related to these factors.

MAIN RESULTS

We included and analysed 140 studies for this review. In the main analyses, a total of 108 comparisons from 70 studies compared any intervention in which audit and feedback was a core, essential component to usual care and evaluated effects on professional practice. After excluding studies at high risk of bias, there were 82 comparisons from 49 studies featuring dichotomous outcomes, and the weighted median adjusted RD was a 4.3% (interquartile range (IQR) 0.5% to 16%) absolute increase in healthcare professionals' compliance with desired practice. Across 26 comparisons from 21 studies with continuous outcomes, the weighted median adjusted percent change relative to control was 1.3% (IQR = 1.3% to 28.9%). For patient outcomes, the weighted median RD was -0.4% (IQR -1.3% to 1.6%) for 12 comparisons from six studies reporting dichotomous outcomes and the weighted median percentage change was 17% (IQR 1.5% to 17%) for eight comparisons from five studies reporting continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats, and when it includes both explicit targets and an action plan. In addition, the effect size varied based on the clinical behaviour targeted by the intervention.

AUTHORS' CONCLUSIONS

Audit and feedback generally leads to small but potentially important improvements in professional practice. The effectiveness of audit and feedback seems to depend on baseline performance and how the feedback is provided. Future studies of audit and feedback should directly compare different ways of providing feedback.

An audit of inpatient management of community-acquired pneumonia in Oman: a comparison with regional clinical guidelines

OBJECTIVE

Community-acquired pneumonia (CAP) is a major cause of morbidity and mortality worldwide. Herein, we present the findings from an audit of CAP management at a tertiary hospital in Oman. The main objective was to evaluate the quality of care given to patients and compare it with the standards in the Gulf Cooperation Council (GCC) CAP guidelines.

METHODS

A retrospective case study of all patients admitted with CAP from June 2006 to September 2008 examined the adherence to standards for the diagnosis, investigation, and management of CAP, including the documentation of illness severity.

RESULTS

The case notes of 342 patients were reviewed. Of these, 170 patients were excluded from the study, and 172 patients met the diagnostic criteria for inclusion. A CURB-65 severity score was documented for only 4 (2.3%) patients, and a smoking history was documented for 56 (32.6%) patients. Although 17 different antibiotic regimens were used, 115 (67%) patients received co-amoxiclav and clarithromycin, which is the standard of care. Additionally, 139 (81%) patients received their first dose of antibiotics within four hours of hospital admission. There was no documentation of offering influenza or pneumococcal vaccine to high risk patients.

CONCLUSION

The clinical coding of CAP diagnosis was poor. There was very poor adherence to the CAP severity assessment and the provision of preventive measures upon hospital discharge. The development and implementation of a local hospital-based integrated care pathway may lead to more successful implementation of the guidelines.

The feasibility of automating audit and feedback for ART guideline adherence in Malawi

OBJECTIVE

To determine the feasibility of using electronic medical record (EMR) data to provide audit and feedback of antiretroviral therapy (ART) clinical guideline adherence to healthcare workers (HCWs) in Malawi.

MATERIALS AND METHODS

We evaluated recommendations from Malawi's ART guidelines using GuideLine Implementability Appraisal criteria. Recommendations that passed selected criteria were converted into ratio-based performance measures. We queried representative EMR data to determine the feasibility of generating feedback for each performance measure, summed clinical encounters representing each performance measure's denominator, and then measured the distribution of encounter frequency for individual HCWs across nurse and clinical officer groups.

RESULTS

We analyzed 423,831 encounters in the EMR data and generated automated feedback for 21 recommendations (12%) from Malawi's ART guidelines. We identified 11 nurse recommendations and eight clinical officer recommendations. Individual nurses and clinical officers had an average of 45 and 59 encounters per month, per recommendation, respectively. Another 37 recommendations (21%) would support audit and feedback if additional routine EMR data are captured and temporal constraints are modeled.

DISCUSSION

It appears feasible to implement automated guideline adherence feedback that could potentially improve HCW performance and supervision. Feedback reports may support workplace learning by increasing HCWs' opportunities to reflect on their performance.

CONCLUSION

A moderate number of recommendations from Malawi's ART guidelines can be used to generate automated guideline adherence feedback using existing EMR data. Further study is needed to determine the receptivity of HCWs to peer comparison feedback and barriers to implementation of automated audit and feedback in low-resource settings.

Provider performance in treating poor patients--factors influencing prescribing practices in lao PDR: a cross-sectional study

Background

Out-of-pocket payments make up about 80% of medical care spending at hospitals in Laos, thereby putting poor households at risk of catastrophic health expenditure. Social security schemes in the form of community-based health insurance and health equity funds have been introduced in some parts of the country. Drug and Therapeutics Committees (DTCs) have been established to ensure rational use of drugs and improve quality of care. The objective was to assess the appropriateness and expenditure for treatment for poor patients by health care providers at hospitals in three selected provinces of Laos and to explore associated factors.

Methods

Cross-sectional study using four tracer conditions. Structured interviews with 828 in-patients at twelve provincial and district hospitals on the subject of insurance protection, income and expenditures for treatment, including informal payment. Evaluation of each patient's medical record for appropriateness of drug use using a checklist of treatment guidelines (maximum score = 10).

Results

No significant difference in appropriateness of care for patients at different income levels, but higher expenditures for patients with the highest income level. The score for appropriate drug use in insured patients was significantly higher than uninsured patients (5.9 vs. 4.9), and the length of stay in days significantly shorter (2.7 vs. 3.7). Insured patients paid significantly less than uninsured patients, both for medicines (USD 14.8 vs. 43.9) and diagnostic tests (USD 5.9 vs. 9.2). On the contrary the score for appropriateness of drug use in patients making informal payments was significantly lower than patients not making informal payments (3.5 vs. 5.1), and the length of stay significantly longer (6.8 vs. 3.2), while expenditures were significantly higher both for medicines (USD 124.5 vs. 28.8) and diagnostic tests (USD 14.1 vs. 7.7).

Conclusions

The lower expenditure for insured patients can help reduce the number of households experiencing catastrophic health expenditure. The positive effects of insurance schemes on expenditure and appropriate use of medicines may be associated with the long-term effects of promoting rational use of drugs, including support to active DTC work.

Effect of mailed feedback on drug prescribing profiles in general practice: a seven-year longitudinal study in Storstrøm County, Denmark

BACKGROUND

Whether written feedback on drug prescribing in general practice affects prescribing habits is controversial. Most short-term studies showed no effect. However, the issue has not been tested in long-term studies involving the local general practitioner community.

AIMS OF THE STUDY

To assess whether prescribing levels in general practice are affected by long-term, unsolicited, systematically repeated, mailed feedback.

METHODS

Each of the 94 general practices in Storstrøm County, Denmark, received semi-annual, mailed feedback about their prescribing volumes and costs within 13 major drug groups, in relation to the levels for all the other 93 practices over a 7-year period in a project initiated by the local general practitioner association. Data on the number of defined daily doses (DDDs) prescribed per 1000 listed patients in each practice per 6-months, and practice characteristics, were obtained from the Pharmaceutical Database at the County Health Department.

RESULTS

There was a large variation in drug prescribing volume between practices, but little within-practice variation over time. After adjustments for the influence of practice size and other potential outcome-affecting variables, there was no evidence of a general change of prescribing volume over time, no change among practices with a high or a low prescribing level, and no significant change within the various drug groups.

CONCLUSIONS

We found no significant effects on prescribing levels of mailed feedback, even when repeated semi-annually during 7 years and initiated by the local general practitioner community.

Meta-analysis: audit and feedback features impact effectiveness on care quality

BACKGROUND

Audit and feedback (A&F) has long been used to improve quality of care, albeit with variable results. This meta-analytic study tested whether Feedback Intervention Theory, a framework from industrial/organizational psychology, explains the observed variability in health care A&F research.

METHOD

DATA SOURCE

studies cited by Jamtvedt's 2006 Cochrane systematic review of A&F, followed by database searches using the Cochrane review's search strategy to identify more recent studies.

INCLUSION CRITERIA

Cochrane review criteria, plus: presence of a treatment group receiving only A & F; a control group receiving no intervention; a quantitatively measurable outcome; minimum n of 10 per arm; sufficient statistics for effect size calculations. Moderators: presence of discouragement and praise; correct solution, attainment level, velocity, frequency, and normative information; feedback format (verbal, textual, graphic, public, computerized, group vs. individual); goal setting activity.

PROCEDURE

meta-analytic procedures using the Hedges-Olkin method.

RESULTS

Of 519 studies initially identified, 19 met all inclusion criteria. Studies were most often excluded due to the lack of a feedback-only arm. A&F has a modest, though significant positive effect on quality outcomes (d = 0.40, 95% confidence interval = +/-0.20); providing specific suggestions for improvement, written, and more frequent feedback strengthened this effect, whereas graphical and verbal feedback attenuated this effect.

CONCLUSIONS

A&F effectiveness is improved when feedback is delivered with specific suggestions for improvement, in writing, and frequently. Other feedback characteristics could also potentially improve effectiveness; however, research with stricter experimental controls is needed to identify the specific feedback characteristics that maximize its effectiveness.

The methodological quality of cluster randomised controlled trials for managing tropical parasitic disease: a review of trials published from 1998 to 2007

The aim of this review was to assess the methodological quality of cluster randomised controlled trials (CRCT) for the management of tropical parasitic disease published between 1998 and 2007. A literature survey was conducted using Medline for CRCTs of interventions aimed at managing any one of the six major tropical parasitic diseases: malaria, leishmaniasis, lymphatic filariasis, onchocerciasis, schistosomiasis and trypanosomiasis (Chagas disease). Information was extracted from the published articles in order that, for each trial, categorical responses could be made to a pre-specified list of 12 questions concerning issues relating to the methodological quality of the trial, including choice of design, generalisability, baseline assessment, blinding, use or non-use of a matched design, and accounting for the intraclass correlation in both design and analysis. The literature survey found 38 CRCTs. Of the 35 CRCTs that reported at least one human outcome, 27 were for interventions in the management of malaria whilst the rest were for managing leishmaniasis (4 trials), lymphatic filariasis (2 trials) and schistosomiasis (2 trials). For every one of the pre-specified questions that concerned an issue associated with methodological quality, the responses were consistent with the practice of trialists in relation to the given issue being generally poor.

Using quality indicators to improve hospital care: a review of the literature

PURPOSE

To review the literature concerning strategies for implementing quality indicators in hospital care, and their effectiveness in improving the quality of care.

DATA SOURCES

A systematic literature study was carried out using MEDLINE and the Cochrane Library (January 1994 to January 2008).

STUDY SELECTION

Hospital-based trials studying the effects of using quality indicators as a tool to improve quality of care.

DATA EXTRACTION

Two reviewers independently assessed studies for inclusion, and extracted information from the studies included regarding the health care setting, type of implementation strategy and their effectiveness as a tool to improve quality of hospital care.

RESULTS

A total of 21 studies were included. The most frequently used implementation strategies were audit and feedback. The majority of these studies focused on care processes rather than patient outcomes. Six studies evaluated the effects of the implementation of quality indicators on patient outcomes. In four studies, quality indicator implementation was found to be ineffective, in one partially effective and in one it was found to be effective. Twenty studies focused on care processes, and most reported significant improvement with respect to part of the measured process indicators. The implementation of quality indicators in hospitals is most effective if feedback reports are given in combination with an educational implementation strategy and/or the development of a quality improvement plan.

CONCLUSION

Effective strategies to implement quality indicators in daily practice in order to improve hospital care do exist, but there is considerable variation in the methods used and the level of change achieved. Feedback reports combined with another implementation strategy seem to be most effective.

Strategies for improving the quality of health care in maternal and child health in low- and middle-income countries: an overview of systematic reviews

There are many systematic reviews of continuing education programmes and educational strategies for quality improvement in health care. Most of the reviewed studies are one-off evaluations rather than impact evaluations with long-term follow-up. There are few systematic reviews of organisational, financial and regulatory interventions, and few high-quality studies. These interventions are probably as or more important than educational strategies, although they are less well evaluated. Few studies have been undertaken in low- and middle-income countries (LMIC) or that address maternal and child health (MCH). Thus, the results of the available studies and reviews need to be interpreted cautiously when applied to LMIC. Interactive workshops, reminders and multifaceted interventions can improve professional practice, and they generally have moderate effects. Educational outreach visits consistently improve prescribing but have variable effects on other behaviours. Audit and feedback interventions have variable effects on professional practice, but most often these are small to moderate effects. Mass-media and patient-mediated interventions may change professional practice. Multifaceted interventions that combine several quality-improvement strategies are also effective but may not be more so than single interventions. While all of these strategies are applicable to MCH in LMIC, the applicability of the results to rural settings, in particular, may be limited. Use of these strategies could exacerbate inequalities, and this should be taken into consideration when planning implementation. Scaling up and sustainability may be difficult to achieve in LMIC contexts and need careful consideration. The use of financial interventions has not been well studied; financial incentives and disincentives may be difficult to use effectively and efficiently, although their impact on practice needs to be considered. Organisational interventions are likely to be important, given that there are often underlying organisational or system problems. Regulatory interventions have not been well evaluated, but may sometimes be both inexpensive and effective. There are no 'magic bullets' or simple solutions for ensuring the quality of health care services. Interventions should be selected or tailored to address the underlying reasons for a failure to deliver effective services. Decision-makers should select the most appropriate interventions for specific problems. This requires a governance structure that clearly assigns responsibility for quality-improvement activities, priority setting, selection and design of interventions, and evaluation.

Health systems research in Lao PDR: capacity development for getting research into policy and practice

BACKGROUND

Lao PDR is a low-income country with an urgent need for evidence-informed policymaking in the healthcare sector. During the last decade a number of Health Systems Research (HSR) projects have been conducted in order to meet this need. However, although knowledge about research is increasing among policymakers, the use of research in policymaking is still limited.

METHODS

This article investigates the relationship between research and policymaking from the perspective of those participating in HSR projects. The study is based on 28 interviews, two group discussions and the responses from 56 questionnaires.

RESULTS

The interviewees and questionnaire respondents were aware of the barriers to getting research into policy and practice. But while some were optimistic, claiming that there had been a change of attitudes among policymakers in the last two years, others were more pessimistic and did not expect any real changes until years from now. The major barriers to feeding research results into policy and practice included an inability to influence the policy process and to get policymakers and practitioners interested in research results. Another barrier was the lack of continuous capacity development and high-quality research, both of which are related to funding and international support. Many of the interviewees and questionnaire respondents also pointed out that communication between those conducting research and policymakers must be improved.

CONCLUSION

The results show that in the case of Lao PDR, research capacity development is at a crucial stage for implementing research into policy and practice. If research is going to make a consistent impact on policymaking in the Lao health care sector, the attitude towards research will need to be changed in order to get research prioritised, both among those conducting research, and among policymakers and practitioners. Our findings indicate that there is awareness about the barriers in this process.

Malaria deaths as sentinel events to monitor healthcare delivery and antimalarial drug safety

OBJECTIVES

To identify case management, health system and antimalarial drug factors contributing to malaria deaths.

METHOD

We investigated malaria-related deaths in South Africa's three malaria endemic provinces from January 2002 to July 2004. Data from healthcare facility records and a semi-structured interview with patients' contacts were reviewed by an expert panel, which sought to reach consensus on factors contributing to the death. This included possible health system failures, adverse reactions to antimalarials, inappropriate medicine use and failing to respond to treatment.

RESULTS

Approximately 177 of 197 cases met inclusion criteria for the study. Delay in seeking formal health care was significantly longer for patients who sought traditional health care [median 4; inter-quartile range (IQR) 3-7 days] than for patients who did not (median 3; IQR 1-5 days; P = 0.033). Patients with confirmed or suspected HIV/AIDS were significantly more likely to use traditional approaches (25%) than those with other comorbidities (0%; P = 0.002). Malaria was neither suspected nor tested for at a primary care facility in 23% of cases with adequate records. Initial hospital assessment was considered inadequate in 74% of cases admitted to hospital and in-patient monitoring and management was adequate in only 27%. There were 32 suspected adverse reactions to antimalarial therapy.

CONCLUSION

A confidential enquiry into malaria-related deaths is a useful tool for identifying preventable factors, health system failures and adverse events affecting malaria case management.

Evidence-based strategies for reducing cesarean section rates: a meta-analysis

BACKGROUND

Canada's cesarean section rate reached an all-time high of 22.5 percent of in-hospital deliveries in 2002 and was associated with potential maternal and neonatal complications. Clinical practice guidelines represent an appropriate mean for reducing cesarean section rates. The challenge now lies in implementing these guidelines. Objectives of this meta-analysis were to assess the effectiveness of interventions for reducing the cesarean section rate and to assess the impact of this reduction on maternal and perinatal mortality and morbidity.

METHODS

The Cochrane Library, EMBASE, and MEDLINE were consulted from January 1990 to June 2005. Additional studies were identified by screening reference lists from identified studies and expert suggestions. Studies involving rigorous evaluation of a strategy for reducing overall cesarean section rates were identified. Randomized controlled trials, controlled before-and-after studies, and interrupted time series studies were evaluated according to Effective Practice and Organisation of Care Group criteria.

RESULTS

Among the 10 included studies, a significant reduction of cesarean section rate was found by random meta-analysis (pooled RR = 0.81 [0.75, 0.87]). No evidence of publication bias was identified. Audit and feedback (pooled RR = 0.87 [0.81, 0.93]), quality improvement (pooled RR = 0.74 [0.70, 0.77]), and multifaceted strategies (pooled RR=0.73 [0.68, 0.79]) were effective for reducing the cesarean section rate. However, quality improvement based on active management of labor showed mixed effects. Design of studies showed a higher effect for noncontrolled studies than for controlled studies (pooled RR = 0.76 [0.72, 0.81] vs 0.92 [0.88, 0.96]). Studies including an identification of barriers to change were more effective than other interventions for reducing the cesarean section rate (pooled RR = 0.74 [0.71, 0.78] vs 0.88 [0.82, 0.94]). Among included studies, no significant differences were found for perinatal and neonatal mortality and perinatal and maternal morbidity with respect to the mode of delivery. Only 1 study showed a significant reduction of neonatal and perinatal mortality (p < 0.001).

CONCLUSIONS

The cesarean section rate can be safely reduced by interventions that involve health workers in analyzing and modifying their practice. Our results suggest that multifaceted strategies, based on audit and detailed feedback, are advised to improve clinical practice and effectively reduce cesarean section rates. Moreover, these findings support the assumption that identification of barriers to change is a major key to success.

Quality of interaction between primary health-care providers and patients with type 2 diabetes in Muscat, Oman: an observational study

Background

A good patient-physician interaction is particularly important in chronic diseases like diabetes. There are so far no published data regarding the interaction between the primary health-care providers and patients with type 2 diabetes in Oman, where diabetes is a major and growing health problem. This study aimed at exploring how health-care providers interact with patients with type 2 diabetes at primary health-care level in Muscat, Oman, focusing on the consultation environment, and some aspects of care and information.

Methods

Direct observations of 90 consultations between 23 doctors and 13 diabetes nurses concerned with diabetes management during their consultations with type 2 diabetes patients in six primary health-care centres in the Muscat region, using checklists developed from the National Diabetes Guidelines. Consultations were assessed as optimal if more than 75% of observed aspects were fulfilled and sub-optimal if less than 50% were fulfilled.

Results

Overall 52% of the doctors' consultations were not optimal. Some important aspects for a positive consultation environment were fulfilled in only about half of the doctors' consultations: ensuring privacy of consultation (49%), eye contact (49%), good attention (52%), encouraging asking questions (47%), and emphasizing on the patients' understanding of the provided information (52%). The doctors enquired about adverse effects of anti-diabetes drugs in less than 10% of consultations. The quality of the nurses' consultations was sub-optimal in about 75% of 85 consultations regarding aspects of consultation environment, care and information.

Conclusion

The performance of the primary health-care doctors and diabetes nurses needs to be improved. The role of the diabetes nurses and the teamwork should be enhanced. We suggest a multidisciplinary team approach, training and education to the providers to upgrade their skills regarding communication and care. Barriers to compliance with the guidelines need to be further explored. Improving the work situation mainly for the diabetes nurses and further improvement in the organizational efficiency of diabetes services such as lowering the number of patients in diabetes clinic, are suggested.

Audit and feedback: effects on professional practice and health care outcomes

BACKGROUND

Audit and feedback continues to be widely used as a strategy to improve professional practice. It appears logical that healthcare professionals would be prompted to modify their practice if given feedback that their clinical practice was inconsistent with that of their peers or accepted guidelines. Yet, audit and feedback has not consistently been found to be effective.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes.

SEARCH STRATEGY

We searched the Cochrane Effective Practice and Organisation of Care Group's register and pending file up to January 2004.

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as any summary of clinical performance over a specified period of time) that reported objectively measured professional practice in a healthcare setting or healthcare outcomes.

DATA COLLECTION AND ANALYSIS

Two reviewers independently extracted data and assessed study quality. Quantitative (meta-regression), visual and qualitative analyses were undertaken. For each comparison we calculated the risk difference (RD) and risk ratio (RR), adjusted for baseline compliance when possible, for dichotomous outcomes and the percentage and the percent change relative to the control group average after the intervention, adjusted for baseline performance when possible, for continuous outcomes. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: the type of intervention (audit and feedback alone, audit and feedback with educational meetings, or multifaceted interventions that included audit and feedback), the intensity of the audit and feedback, the complexity of the targeted behaviour, the seriousness of the outcome, baseline compliance and study quality.

MAIN RESULTS

Thirty new studies were added to this update, and a total of 118 studies are included. In the primary analysis 88 comparisons from 72 studies were included that compared any intervention in which audit and feedback is a component compared to no intervention. For dichotomous outcomes the adjusted risk difference of compliance with desired practice varied from - 0.16 (a 16 % absolute decrease in compliance) to 0.70 (a 70% increase in compliance) (median = 0.05, inter-quartile range = 0.03 to 0.11) and the adjusted risk ratio varied from 0.71 to 18.3 (median = 1.08, inter-quartile range = 0.99 to 1.30). For continuous outcomes the adjusted percent change relative to control varied from -0.10 (a 10 % absolute decrease in compliance) to 0.68 (a 68% increase in compliance) (median = 0.16, inter-quartile range = 0.05 to 0.37). Low baseline compliance with recommended practice and higher intensity of audit and feedback were associated with larger adjusted risk ratios (greater effectiveness) across studies.

AUTHORS' CONCLUSIONS

Audit and feedback can be effective in improving professional practice. When it is effective, the effects are generally small to moderate. The relative effectiveness of audit and feedback is likely to be greater when baseline adherence to recommended practice is low and when feedback is delivered more intensively.

Improving the performance of Drug and Therapeutics Committees in hospitals – a quasi-experimental study in Laos

BACKGROUND AND OBJECTIVES

Drug and Therapeutics Committees (DTCs), which are essential for ensuring the rational use of drugs (RUD) in hospitals, have recently been established in Laos. Sub-optimal performance had been reported. The aims of this study were to determine those factors in the working environment that relate to DTC performance in Lao hospitals and evaluate whether DTC performance could be improved through an educational intervention utilizing auditing and feedback targeted towards DTC members.

METHODS

This was a quasi-experimental (before and after) study. Two central and seven provincial hospitals and the DTC members from these hospitals participated in the study. Performance of the DTCs was assessed by means of specifically developed indicators on structure and process combined with indicators for RUD and adherence to Standard Treatment Guidelines (STG). Data were collected for a 3-month period at baseline and for three consecutive periods thereafter. The results of the first three data collections were shared and discussed with the DTC members during feedback sessions. The DTC members were also interviewed in order to identify factors they thought may have an impact on DTC performance.

RESULTS

Following the intervention, there was a significant improvement in the overall score for DTC performance (p<0.001) and, in particular, in general activity and feedback and drug information to staff. The STG scores also improved (p<0.01). Interviews indicated that one negative factor was the experience of the DTC members being overloaded with other work, resulting in DTC meetings being held irregularly and drawing poor attendance.

CONCLUSION

Continuous self-monitoring of performance by means of indicators, followed by feedback discussions, is suggested the means of improving the work of the DTC.

Decision-makers and the usefulness of research evidence in policy implementation--a case study from Lao PDR

The involvement of researchers in the policy process and policy-makers in research is little studied, particularly in developing countries. In 1993, the Lao National Drug Policy (NDP) was endorsed in a consultative process involving many stakeholders. Lao People's Democratic Republic is a poor country in South East Asia. Five pilot provinces were selected for implementation of the policy, which had a health system research (HSR) component. This case study explores decision-makers' knowledge and attitudes regarding the usefulness of HSR in the NDP implementation process. Ninety decision-makers from different health institutions including hospitals, medical schools and main drug suppliers were surveyed using a self-administrated structured questionnaire, filled in during a NDP conference in 2001. Results from six HSR projects related to the NDP implementation had been presented during the conference, but also 6 months previously and through written reports. There were 75 respondents (83% of attendees, 90% of whom were men), 39% with medical, 50% with pharmacy and 11% with other background. Ninety-eight percent of the participants found operational research useful, and 87% supported it to be an element of the NDP. Two-thirds knew the objectives of the NDP. There was no significant difference in knowledge and attitudes between pilot and non-pilot provinces and between professions. Ninety-two percent were aware of the Essential Drug List, and 88% found it adequate to drug need. Ninety-seven percent agreed with generic drug prescribing. Seventy percent reported to have heard about Good Pharmacy Practice (GPP), but only a few could explain it. Although most participants agreed that HSR should be one main component of the NDP and found HSR results useful, few had heard about them before the conference, and research was not well understood. The paper discusses various factors influencing decision-makers' perceptions of usefulness of research in this case during the NDP implementation process. It is concluded that the acceptance of research and major NDP concepts probably is a result of close interaction between researchers and policy-makers and that the interface between research and policy-making needs further studies.

Effectiveness of a multi-component intervention on dispensing practices at private pharmacies in Vietnam and Thailand--a randomized controlled trial

Private pharmacies are the first line of health care in many communities, commonly selling antibiotics in small doses and prescription-only drugs such as steroids without medical supervision. The aim was to study the effectiveness of a multi-faceted intervention on the dispensing practices of drug sellers in Hanoi and Bangkok. The study was a randomized, controlled trial with 68 Hanoi and 78 Bangkok pharmacies, randomly selected and assigned for intervention and control. Behaviour was assessed by five simulated client visits per pharmacy per dispensing practice, at baseline and a month or more after each intervention. Three three-month interventions were implemented sequentially with four months in between: enforcement of regulations with local inspectors visiting to emphasize the importance of prescription-only medicine legislation; education, performed face-to-face in Hanoi and by a large group in Bangkok; and peer review, voluntary in Bangkok and compulsory in Hanoi. The intervention resulted in significant improvements in Hanoi, reducing the dispensing of illegal steroids (29% vs. 62%) and low dose antibiotics (69% vs. 90%), sustained by means of the peer review (17% vs. 57% steroids and 71% vs. 95% antibiotics), and in fewer dispensers asking no questions and giving no advice (11% vs. 30% steroids and 51% vs. 81% antibiotics). The only significant improvement in Bangkok was the reduction in illegally dispensing steroids (25% vs. 44%) after the regulatory intervention. In Bangkok, fewer of those in the group who volunteered for the peer review asked no questions and gave no advice for low-dose antibiotics requests after the peer review (58% vs. 81%). A multi-component intervention can have a profound effect in changing dispensers' behaviour, but the effect is dependant on the context and the method of implementation. Possible reasons for differences are discussed.