Implementation strategies for health systems in low-income countries: an overview of systematic reviews

Implementation strategies for health systems in low-income countries: an overview of systematic reviews

BACKGROUND

A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.

OBJECTIVES

To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.

METHODS

We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.

MAIN RESULTS

We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories - strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.

AUTHORS' CONCLUSIONS

Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.

Governance arrangements for health systems in low-income countries: an overview of systematic reviews

BACKGROUND

Governance arrangements include changes in rules or processes that determine authority and accountability for health policies, organisations, commercial products and health professionals, as well as the involvement of stakeholders in decision-making. Changes in governance arrangements can affect health and related goals in numerous ways, generally through changes in authority, accountability, openness, participation and coherence. A broad overview of the findings of systematic reviews can help policymakers, their technical support staff and other stakeholders to identify strategies for addressing problems and improving the governance of their health systems.

OBJECTIVES

To provide an overview of the available evidence from up-to-date systematic reviews about the effects of governance arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on governance arrangements and informing refinements of the framework for governance arrangements outlined in the overview.

METHODS

We searched Health Systems Evidence in November 2010 and PDQ Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of governance arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use (health expenditures, healthcare provider costs, out-of-pocket payments, cost-effectiveness), healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment) and that were published after April 2005. We excluded reviews with limitations that were important enough to compromise the reliability of the findings of the review. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.

MAIN RESULTS

We identified 7272 systematic reviews and included 21 of them in this overview (19 primary reviews and 2 supplementary reviews). We focus here on the results of the 19 primary reviews, one of which had important methodological limitations. The other 18 were reliable (with only minor limitations).We grouped the governance arrangements addressed in the reviews into five categories: authority and accountability for health policies (three reviews); authority and accountability for organisations (two reviews); authority and accountability for commercial products (three reviews); authority and accountability for health professionals (seven reviews); and stakeholder involvement (four reviews).Overall, we found desirable effects for the following interventions on at least one outcome, with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects. Decision-making about what is covered by health insurance- Placing restrictions on the medicines reimbursed by health insurance systems probably decreases the use of and spending on these medicines (moderate-certainty evidence). Stakeholder participation in policy and organisational decisions- Participatory learning and action groups for women probably improve newborn survival (moderate-certainty evidence).- Consumer involvement in preparing patient information probably improves the quality of the information and patient knowledge (moderate-certainty evidence). Disclosing performance information to patients and the public- Disclosing performance data on hospital quality to the public probably encourages hospitals to implement quality improvement activities (moderate-certainty evidence).- Disclosing performance data on individual healthcare providers to the public probably leads people to select providers that have better quality ratings (moderate-certainty evidence).

AUTHORS' CONCLUSIONS

Investigators have evaluated a wide range of governance arrangements that are relevant for low-income countries using sound systematic review methods. These strategies have been targeted at different levels in health systems, and studies have assessed a range of outcomes. Moderate-certainty evidence shows desirable effects (with no undesirable effects) for some interventions. However, there are important gaps in the availability of systematic reviews and primary studies for the all of the main categories of governance arrangements.

Financial arrangements for health systems in low-income countries: an overview of systematic reviews

BACKGROUND

One target of the Sustainable Development Goals is to achieve "universal health coverage, including financial risk protection, access to quality essential health-care services and access to safe, effective, quality and affordable essential medicines and vaccines for all". A fundamental concern of governments in striving for this goal is how to finance such a health system. This concern is very relevant for low-income countries.

OBJECTIVES

To provide an overview of the evidence from up-to-date systematic reviews about the effects of financial arrangements for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on financial arrangements, and informing refinements in the framework for financial arrangements presented in the overview.

METHODS

We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to 17 December 2016 for systematic reviews. We did not apply any date, language, or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of financial arrangements on patient outcomes (health and health behaviours), the quality or utilisation of healthcare services, resource use, healthcare provider outcomes (such as sick leave), or social outcomes (such as poverty, employment, or financial burden of patients, e.g. out-of-pocket payment, catastrophic disease expenditure) and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the findings. Two overview authors independently screened reviews, extracted data, and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence), and assessments of the relevance of findings to low-income countries.

MAIN RESULTS

We identified 7272 reviews and included 15 in this overview, on: collection of funds (2 reviews), insurance schemes (1 review), purchasing of services (1 review), recipient incentives (6 reviews), and provider incentives (5 reviews). The reviews were published between 2008 and 2015; focused on 13 subcategories; and reported results from 276 studies: 115 (42%) randomised trials, 11 (4%) non-randomised trials, 23 (8%) controlled before-after studies, 51 (19%) interrupted time series, 9 (3%) repeated measures, and 67 (24%) other non-randomised studies. Forty-three per cent (119/276) of the studies included in the reviews took place in low- and middle-income countries. Collection of funds: the effects of changes in user fees on utilisation and equity are uncertain (very low-certainty evidence). It is also uncertain whether aid delivered under the Paris Principles (ownership, alignment, harmonisation, managing for results, and mutual accountability) improves health outcomes compared to aid delivered without conforming to those principles (very low-certainty evidence). Insurance schemes: community-based health insurance may increase service utilisation (low-certainty evidence), but the effects on health outcomes are uncertain (very low-certainty evidence). It is uncertain whether social health insurance improves utilisation of health services or health outcomes (very low-certainty evidence). Purchasing of services: it is uncertain whether increasing salaries of public sector healthcare workers improves the quantity or quality of their work (very low-certainty evidence). Recipient incentives: recipient incentives may improve adherence to long-term treatments (low-certainty evidence), but it is uncertain whether they improve patient outcomes. One-time recipient incentives probably improve patient return for start or continuation of treatment (moderate-certainty evidence) and may improve return for tuberculosis test readings (low-certainty evidence). However, incentives may not improve completion of tuberculosis prophylaxis, and it is uncertain whether they improve completion of treatment for active tuberculosis. Conditional cash transfer programmes probably lead to an increase in service utilisation (moderate-certainty evidence), but their effects on health outcomes are uncertain. Vouchers may improve health service utilisation (low-certainty evidence), but the effects on health outcomes are uncertain (very low-certainty evidence). Introducing a restrictive cap may decrease use of medicines for symptomatic conditions and overall use of medicines, may decrease insurers' expenditures on medicines (low-certainty evidence), and has uncertain effects on emergency department use, hospitalisations, and use of outpatient care (very low-certainty evidence). Reference pricing, maximum pricing, and index pricing for drugs have mixed effects on drug expenditures by patients and insurers as well as the use of brand and generic drugs. Provider incentives: the effects of provider incentives are uncertain (very low-certainty evidence), including: the effects of provider incentives on the quality of care provided by primary care physicians or outpatient referrals from primary to secondary care, incentives for recruiting and retaining health professionals to serve in remote areas, and the effects of pay-for-performance on provider performance, the utilisation of services, patient outcomes, or resource use in low-income countries.

AUTHORS' CONCLUSIONS

Research based on sound systematic review methods has evaluated numerous financial arrangements relevant to low-income countries, targeting different levels of the health systems and assessing diverse outcomes. However, included reviews rarely reported social outcomes, resource use, equity impacts, or undesirable effects. We also identified gaps in primary research because of uncertainty about applicability of the evidence to low-income countries. Financial arrangements for which the effects are uncertain include external funding (aid), caps and co-payments, pay-for-performance, and provider incentives. Further studies evaluating the effects of these arrangements are needed in low-income countries. Systematic reviews should include all outcomes that are relevant to decision-makers and to people affected by changes in financial arrangements.

Implementation of effective practices in health facilities: a systematic review of cluster randomised trials

Background

The capacity for health systems to support the translation of research in to clinical practice may be limited. The cluster randomised controlled trial (cluster RCT) design is often employed in evaluating the effectiveness of implementation of evidence-based practices. We aimed to systematically review available evidence to identify and evaluate the components in the implementation process at the facility level using cluster RCT designs.

Methods

All cluster RCTs where the healthcare facility was the unit of randomisation, published or written from 1990 to 2014, were assessed. Included studies were analysed for the components of implementation interventions employed in each. Through iterative mapping and analysis, we synthesised a master list of components used and summarised the effects of different combinations of interventions on practices.

Results

Forty-six studies met the inclusion criteria and covered the specialty groups of obstetrics and gynaecology (n=9), paediatrics and neonatology (n=4), intensive care (n=4), internal medicine (n=20), and anaesthetics and surgery (n=3). Six studies included interventions that were delivered across specialties. Nine components of multifaceted implementation interventions were identified: leadership, barrier identification, tailoring to the context, patient involvement, communication, education, supportive supervision, provision of resources, and audit and feedback. The four main components that were most commonly used were education (n=42, 91%), audit and feedback (n=26, 57%), provision of resources (n=23, 50%) and leadership (n=21, 46%).

Conclusions

Future implementation research should focus on better reporting of multifaceted approaches, incorporating sets of components that facilitate the translation of research into practice, and should employ rigorous monitoring and evaluation.