Strengthening scaling up through learning from implementation: comparing experiences from Afghanistan, Bangladesh and Uganda

What Underlies State Government Performance in Scaling Family Planning Programming? A Study of The Challenge Initiative State Partnerships in Nigeria

INTRODUCTION

Relatively few studies rigorously examine the factors associated with health systems strengthening and scaling of interventions at subnational government levels. We aim to examine how The Challenge Initiative (TCI) coaches subnational (state government) actors to scale proven family planning and adolescent and youth sexual and reproductive health approaches rapidly and sustainably through public health systems to respond to unmet need among the urban poor.

METHODS

This mixed-methods comparative case study draws on 32 semistructured interviews with subnational government leaders and managers, nongovernmental organization leaders, and TCI Nigeria staff, triangulated with project records and government health management information system (HMIS) data. Adapting the Consolidated Framework for Implementation Research (CFIR), we contrast experience across 2 higher-performing states and 1 lower-performing state (identified through HMIS data and selected health systems strengthening criteria from 13 states) to identify modifiable factors linked with successful adoption and implementation of interventions and note lessons for supporting scale-up.

RESULTS

Informants reported that several TCI strategies overlapping with CFIR were critical to states' successful adoption and sustainment of interventions, most prominently external champions' contributions and strengthened state planning and coordination, especially in higher-performing states. Government stakeholders institutionalized new interventions through their annual operational plans. Higher-performing states incorporated mutually reinforcing interventions (including service delivery, demand generation, and advocacy). Although informants generally expressed confidence that newly introduced service delivery interventions would be sustained beyond donor support, they had concerns about government financing of demand-side social and behavior change work.

CONCLUSION

As political and managerial factors, even more than technical factors, were most linked with successful adoption and scale-up, these processes and systems should be assessed and prioritized from the start. Government leaders, TCI coaches, and other stakeholders can use these findings to shape similar initiatives to sustainably scale social service interventions.

Cost-effectiveness analysis of adding tuberculosis household contact investigation on passive case-finding strategy in Southwestern Uganda

INTRODUCTION

The standard passive case-finding strategy implemented by most developing countries is inadequate to detect new cases of Tuberculosis. A household contact investigation is an alternative approach. However, there is limited cost-effectiveness data to support planning and implementation in low and middle-income countries. The study aimed to evaluate the cost-effectiveness of adding household contact investigation (HCI) to the passive case-finding (PCF) strategy in the Tuberculosis control program in Southwestern Uganda.

METHODS

We conducted an economic evaluation using a retrospective study approach and bottom-up costing (ingredients) techniques. It was a synthesis-based evaluation of existing data extracted from the District Health Information System (DHIS 2), TB registers, and a primary cost survey. The study compared two methods of Tuberculosis (TB) case finding (PCF and HCI) strategies. Regarding PCF, patients either self-reported their signs and symptoms or were prompted by healthcare workers. At the same time, HCI was done by home visiting and screening contacts of TB patients. Patients and household contacts presumed to have Tuberculosis were requested to produce samples for analysis. We applied a static decision-analytic modeling framework to examine both strategies' costs and effectiveness. The study relied on cost and probability estimates from National Tuberculosis (TB) program data, activity costs, and published literature. It was performed from the societal and provider perspectives over 1.5 years across 12 facilities in Ntungamo, Sheema, and Rwampara Districts. The primary effectiveness measure was the number of TB cases detected (yield) and the number needed to screen (NNS). The TB yield was calculated from the number of patients screened during the period under study. The incremental cost-effectiveness ratio (ICER) was expressed as cost in 2021 US$ per additional TB case detected. We did not apply a discount rate because of the short analytic time horizon.

RESULTS

The unit costs of detecting a Tuberculosis case were US$ (United States dollar) 204.22 for PCF and US$ 315.07 for HCI. Patient and caregiver costs are five times more in PCF than in HCI [US$26.37 Vs. US$ 5.42]. The ICER was US$ 3,596.94 per additional TB case detected. The TB screening yields were 0.52% (1496/289140) for passive case finding and 5.8% (197/3414) for household contact investigation. Household contact investigation yield among children 0-14 Vs. 15+ years [6.2% Vs.5.4%] P = 0.04. The Yield among People living with HIV (PLHIV) Vs. HIV-negative [15.8% Vs.5.3%] P = 0.03 in HHCI. The PCF yield in men Vs. Women [1.12% Vs.0.28%] P<0.01. The NNS in PCF was 193 [95% CI: 186-294] and 17 [95% CI: 14-22] in HCI.

CONCLUSION

Our baseline assumptions and the specific implementations of adding HCI to existing PCF programs in the context of rural African settings prove to be not cost-effective, rather than HCI as a strategy. HCI effectively identifies children and PLHIV with TB and should be prioritized. Meanwhile, the Passive case-finding strategy effectively finds men with TB and costs lower than household contact investigation.

Contents of antenatal care services in Afghanistan: findings from the national health survey 2018

BACKGROUND

Maternal and newborn mortality is a public health concern in low- and middle-income countries (LMICs), including Afghanistan, where the evolving socio-political circumstances have added new complexities to healthcare service delivery. Birth outcomes for both pregnant women and their newborns are improved if women receive benefits of quality antenatal care (ANC).

OBJECTIVES

This study aimed to assess the contents of ANC services and identify predictors of utilization of services by pregnant women during ANC visits to health facilities in Afghanistan.

METHODS

In this cross-sectional study, we used data from the Afghanistan Health Survey 2018 (AHS2018). We included a total of 6,627 ever-married women, aged 14-49 years, who had given birth in the past 2 years or were pregnant at the time of survey and had consulted a health worker for ANC services in a health facility. The outcome was defined as 1-4 services and 5-8 services that a pregnant woman received during an ANC visit. The services were (i) taking a pregnant woman's blood pressure, (ii) weighing her, (iii) testing her blood, (iv) testing her urine, (v) providing advice on nutrition, (vi) advising about complicated pregnancy, (vii) advising about the availability of health services, and (viii) giving her at least one dose of Tetanus Toxoid (TT) vaccine. The binary outcome (1-4 services versus 5-8 services) was used in a multivariable logistic regression model.

RESULTS

Of all 6,627 women, 31.4% (2,083) received 5-8 services during ANC visits. Only 1.3% (86) received all 8 services, with 98.7% (6,541) receiving between 1 and 7 services, and 71.6% (4,745) women had their blood pressure measured during ANC visits. The likelihood (adOR = Adjusted Odds Ratio) of receiving 5-8 services was higher in women who could read and write (adOR = 1.33: 1.15-1.54), in women whose husbands could read and write (adOR = 1.14: 1.00-1.28), in primipara women (adOR = 1.42: 1.02-1.98), in women who knew one danger sign (adOR = 5.38: 4.50-6.45), those who knew 2 danger signs (adOR = 8.51: 7.12-10.19) and those who knew ≥ 3 danger signs (adOR = 13.19: 10.67-16.29) of complicated pregnancy, and in women who had almost daily access to TV (adOR = 1.16: 1.01-1.33). However, the likelihood of receiving 5-8 services was lower in women who used private clinics (adOR = 0.64: 0.55-0.74) and who received services from nurses (adOR = 0.27 (0.08-0.88).

CONCLUSION

Our findings have the potential to influence the design and implementation of ANC services of health interventions to improve the delivery of services to pregnant women during ANC visits.

How is the implementation of empirical research results documented in conflict-affected settings? Findings from a scoping review of peer-reviewed literature

Implementation science scholars argue that knowing 'what works' in public health is insufficient to change practices, without understanding 'how', 'where' and 'why' something works. In the peer reviewed literature on conflict-affected settings, challenges to produce research, make decisions informed by evidence, or deliver services are documented, but what about the understanding of 'how', 'where' and 'why' changes occur? We explored these questions through a scoping review of peer-reviewed literature based on core dimensions of the Extended Normalization Process Theory. We selected papers that provided data on how something might work (who is involved and how?), where (in what organizational arrangements or contexts?) and why (what was done?). We searched the Global Health, Medline, Embase databases. We screened 2054 abstracts and 128 full texts. We included 22 papers (of which 15 related to mental health interventions) and analysed them thematically. We had the results revised critically by co-authors experienced in operational research in conflict-affected settings. Using an implementation science lens, we found that: (a) implementing actors are often engaged after research is produced to discuss feasibility; (b) new interventions or delivery modalities need to be flexible; (c) disruptions affect how research findings can lead to sustained practices; (d) strong leadership and stable resources are crucial for frontline actors; (e) creating a safe learning space to discuss challenges is difficult; (f) feasibility in such settings needs to be balanced. Lastly, communities and frontline actors need to be engaged as early as possible in the research process. We used our findings to adapt the Extended Normalization Process Theory for operational research in settings affected by conflicts. Other theories used by researchers to document the implementation processes need to be studied further.

Do we really want to know? The journey to implement empirical research recommendations in the ICRC's responses in Myanmar and Lebanon

Efforts to reduce the gap between the research evidence base and humanitarian responses have focused on producing quality evidence and ensuring its use in decision-making. Yet, how evidence translates into field-level implementation is not well understood in humanitarian contexts. This study analysed how recommendations produced through academic research partnerships were implemented by the International Committee of the Red Cross (ICRC) in Lebanon and Myanmar. The methodology included: social network analysis to represent collective dynamics; document reviews to assess implementation; qualitative interviews to comprehend why actors engaged; and a critical appraisal of these combined results. The application of Extended Normalization Process Theory provided information on 'anticipation of constraints' (access to information, staff turnover, context specificity, and the need to engage as a cohesive group). Future research efforts should concentrate explicitly on identifying and tackling implementation barriers such as power imbalances and ethical dilemmas related to service delivery by humanitarian actors.

Scaling-up citizen workshops in public libraries to disseminate and discuss primary care research results: a quasi-experimental study

Background

Little is known about engaging patients and stakeholders in the process of scaling up effective knowledge translation interventions targeting the public.

Objective

Using an integrated knowledge translation approach, we aimed to scale up and evaluate an effective pilot program to disseminate research results in public libraries.

Methods

We conducted a scaling-up study targeting the public. On the basis of our successful pilot project, we codeveloped and implemented a large-scale program of free citizen workshops in public libraries, in a close research partnership with stakeholders and patient representatives. Citizen workshops, each facilitated by 1 participating physician and 1 science communicator, consisted of a 45-minute computer-assisted presentation and a 45-minute open exchange. The intervention outcome was knowledge gained. The scale-up outcomes were satisfaction, appropriateness, coverage, and costs. An evaluation questionnaire was used to collect data of interest. Both quantitative and qualitative analyses were performed.

Results

The workshop theme chosen by the patient and stakeholder representatives was the high prevalence of medication overuse among people aged ≥65 years. From April to May 2019, 26 workshops were conducted in 25 public libraries reaching 362 people. The mean age of participants was 64.8 (SD 12.5) years. In total, 18 participating physicians and 6 science communicators facilitated the workshops. Participants reported significant knowledge gain (mean difference 2.1, 95% CI 2.0-2.2; P<.001). The median score for overall public satisfaction was 9 out of 10 (IQR 8-10). The public participants globally rated the workshops as having a high level of appropriateness. Coverage was 92% (25/27) of the total number of public libraries targeted. Costs were CAD $6051.84 (US $4519.69) for workshop design and CAD $22,935.41 (US $17,128.85) for scaling them up.

Conclusions

This project successfully established a large-scale and successful implementation science or knowledge translation bridge among researchers, clinicians, and citizens via public libraries. This study provides a model for a dissemination practice that benefits the public by both engaging them in the dissemination process and targeting them directly.

Strategies to promote evidence use for health programme improvement: learning from the experiences of embedded implementation research teams in Latin America and the Caribbean

Background

To achieve global health targets, innovative approaches are needed to strengthen the implementation of efficacious interventions. New approaches in implementation research that bring together health system decision-makers alongside researchers to collaboratively design, produce and apply research evidence are gaining traction. Embedded implementation research (EIR) approaches led by decision-maker principal investigators (DM PIs) appear promising in this regard. Our aim is to describe the strategies study teams employ in the post-research phase of EIR to promote evidence-informed programme or policy improvement.

Methods

We conducted a prospective, comparative case study of an EIR initiative in Bolivia, Colombia and Dominican Republic. Guided by a conceptual framework on EIR, we used semi-structured key informant interviews (n = 51) and document reviews (n = 20) to examine three decision-maker-led study teams (“cases”). Focusing on three processes (communication/dissemination, stakeholder engagement with evidence, integrating evidence in decision-making) and the main outcome (enacting improvements), we used thematic analysis to identify associated strategies and enabling or hindering factors.

Results

Across cases, we observed diverse strategies, shaped substantially by whether the DM PI was positioned to lead the response to study findings within their sphere of work. We found two primary change pathways: (1) DM PIs implement remedial measures directly, and (2) DM PIs seek to influence other stakeholders to respond to study findings. Throughout the post-research phase, EIR teams adapted research use strategies based on the evolving context.

Conclusions

EIR led by well-positioned DM PIs can facilitate impactful research translation efforts. We draw lessons around the importance of (1) understanding DM PI positionality, (2) ongoing assessment of the evolving context and stakeholders and (3) iterative adaptation to dynamic, uncertain circumstances. Findings may guide EIR practitioners in planning and conducting fit-for-purpose and context-sensitive strategies to advance the use of evidence for programme improvement.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00834-1.

Tools for assessing the scalability of innovations in health: a systematic review

BACKGROUND

The last decade has seen growing interest in scaling up of innovations to strengthen healthcare systems. However, the lack of appropriate methods for determining their potential for scale-up is an unfortunate global handicap. Thus, we aimed to review tools proposed for assessing the scalability of innovations in health.

METHODS

We conducted a systematic review following the COSMIN methodology. We included any empirical research which aimed to investigate the creation, validation or interpretability of a scalability assessment tool in health. We searched Embase, MEDLINE, CINAHL, Web of Science, PsycINFO, Cochrane Library and ERIC from their inception to 20 March 2019. We also searched relevant websites, screened the reference lists of relevant reports and consulted experts in the field. Two reviewers independently selected and extracted eligible reports and assessed the methodological quality of tools. We summarized data using a narrative approach involving thematic syntheses and descriptive statistics.

RESULTS

We identified 31 reports describing 21 tools. Types of tools included criteria (47.6%), scales (33.3%) and checklists (19.0%). Most tools were published from 2010 onwards (90.5%), in open-access sources (85.7%) and funded by governmental or nongovernmental organizations (76.2%). All tools were in English; four were translated into French or Spanish (19.0%). Tool creation involved single (23.8%) or multiple (19.0%) types of stakeholders, or stakeholder involvement was not reported (57.1%). No studies reported involving patients or the public, or reported the sex of tool creators. Tools were created for use in high-income countries (28.6%), low- or middle-income countries (19.0%), or both (9.5%), or for transferring innovations from low- or middle-income countries to high-income countries (4.8%). Healthcare levels included public or population health (47.6%), primary healthcare (33.3%) and home care (4.8%). Most tools provided limited information on content validity (85.7%), and none reported on other measurement properties. The methodological quality of tools was deemed inadequate (61.9%) or doubtful (38.1%).

CONCLUSIONS

We inventoried tools for assessing the scalability of innovations in health. Existing tools are as yet of limited utility for assessing scalability in health. More work needs to be done to establish key psychometric properties of these tools. Trial registration We registered this review with PROSPERO (identifier: CRD42019107095).

Estimating the costs for implementing a maternity leave cash transfer program for women employed in the informal sector in Brazil and Ghana

Background

Maternity leave policies are designed to protect gender equality and the health of mothers in the workforce and their children. However, maternity leave schemes are often linked to jobs in the formal sector economy. In low- and middle-income countries a large share of women work in the informal sector, and are not eligible to such benefit. This is worrisome from a social justice and a policy perspective and suggests the need for intervening. Costing the implementation of potential interventions is needed for facilitating informed decisions by policy makers.

Methods

We developed and applied a costing methodology to assess the cost of a maternity leave cash transfer to be operated in the informal sector of the economy in Brazil and Ghana, two countries with very different employment structures and socioeconomic contexts. We conducted sensitivity analysis by modeling different numbers of weeks covered.

Results

In Brazil, the cost of the maternity cash transfer would be between 0.004% and 0.02% of the GDP, while in Ghana it would range between 0.076% and 0.28% of the GDP. The relative cost of rolling out a maternity intervention in Brazil is between 2.2 to 3.2 times the cost in Ghana depending on the benchmark used to assess the welfare measure. The differences in costs between countries was related to differences in labor market structure as well as demographic characteristics.

Conclusions

Findings show how a standard methodology that relies on routinely available information is feasible and could assist policymakers in estimating the costs of supporting a maternity cash transfer for women employed in the informal sector, such intervention is expected to contribute to social justice, gender equity, and health trajectories.

A guide to systems-level, participatory, theory-informed implementation research in global health

Implementation research is a multidisciplinary field that addresses the complex phenomenon of how context influences our ability to deliver evidence-informed healthcare. There is increasing realisation of the importance of applying robust implementation research to scale-up life-saving interventions that meet health-related sustainable development goals. However, the lack of high-quality implementation research is impeding our ability to meet these targets, globally. Within implementation research, theory refers to the proposed hypothesis and/or explanation of how an intervention is expected to interact with the local context and actors to bring about change. Although there is increasing interest in applying theory to understand how and why implementation programmes work in real-world settings, global health actors still tend to favour impact evaluations conducted in controlled environments. This may, in part, be due to the relative novelty as well as methodological complexity of implementation research and the need to draw on divergent disciplines, including epidemiology, implementation science and social sciences. Because of this, implementation research is faced with a particular set of challenges about how to reconcile different ways of thinking and constructing knowledge about healthcare interventions. To help translate some of the ambiguity surrounding how divergent theoretical approaches and methods contribute to implementation research, we draw on our multidisciplinary expertise in the field, particularly in global health. We offer an overview of the different theoretical approaches and describe how they are applied to continuously select, monitor and evaluate implementation strategies throughout the different phases of implementation research. In doing so, we offer a relatively brief, user-focused guide to help global health actors implement and report on evaluation of evidence-based and scalable interventions, programmes and practices.

Scaling up public health interventions: case study of the polio immunization program in Indonesia

BACKGROUND

The scaling up of public health interventions has received greater attention in recent years; however, there remains paucity of systematic investigations of the scaling up processes. We aim to investigate the overall process, actors and contexts of polio immunization scaling up in Indonesia from 1988 until 2018.

METHODS

A mixed method study with sequential explanatory design was conducted. We carried out a quantitative survey of 323 actors involved in the polio program at national and sub-national levels, followed by Key Informant Interviews (KII)s. Document review was also carried out to construct a timeline of the polio eradication program with milestones. We carried out descriptive statistical analysis of quantitative data and thematic analysis of qualitative data.

RESULTS

The scaling up of polio immunization in Indonesia started as a vertical expansion approach led by the Ministry of Health within a centralized health system. The coverage of immunization increased dramatically from 5% in the earlier 80s to 67.5% in 1987; incremental increases followed until achieving Universal Child Immunization (UCI) in 1990 and subsequently 95% coverage in 1995. Engagement of stakeholders and funding made the scaling up of polio immunization a priority. There was also substantial multisector involvement, including institutions and communities. Local area monitoring (LAM) and integrated health posts (Posyandu) were key to the polio immunization implementation strategy. Challenges for scaling up during this centralized period included cold chain infrastructure and limited experience in carrying out mass campaigns. Scaling up during the decentralized era was slower due to expansion in the number of provinces and districts. Moreover, there were challenges such as the negative perception of immunization side-effects, staff turnover, and the unsmooth transition of centralization towards decentralization.

CONCLUSION

Vertical scaling up of polio immunization program intervention was successful during the centralized era, with involvement of the president as a role model and the engine of multi sector actors. Posyandu (integrated health posts) played an important role, yet its revitalization after the reform-decentralization era has not been optimum.

Mechanisms of scaling up: combining a realist perspective and systems analysis to understand successfully scaled interventions

Background

Sustainable shifts in population behaviours require system-level implementation and embeddedness of large-scale health interventions. This paper aims to understand how different contexts of scaling up interventions affect mechanisms to produce intended and unintended scale up outcomes.

Methods

A mixed method study combining a realist perspective and systems analysis (causal loop diagrams) of scaled-up physical activity and/or nutrition interventions implemented at a state/national level in Australia (2010–18). The study involved four distinct phases: Phase 1 expert consultation, database and grey literature searches to identify scaled-up interventions; Phase 2 generating initial Context-Mechanism-Outcome configurations (CMOs) from the WHO ExpandNet framework for scaling up; Phase 3 testing and refining CMOs via online surveys and realist interviews with academics, government and non-government organisations (NGOs) involved in scale up of selected interventions (Phase 1); and Phase 4 generating cross-case mid-range theories represented in systems models of scaling up; validated by member checking. Descriptive statistics were reported for online survey data and realist analysis for interview data.

Results

Seven interventions were analysed, targeting nutrition (n = 1), physical activity (n = 1), or a combination (n = 5). Twenty-six participants completed surveys; 19 completed interviews. Sixty-three CMO pathways underpinned successful scale up, reflecting 36 scale up contexts, 8 key outcomes; linked via 53 commonly occurring mechanisms. All five WHO framework domains were represented in the systems models. Most CMO pathways included ‘intervention attributes’ and led to outcomes ‘community sustainability/embeddedness’ and ‘stakeholder buy-in/perceived value’. Irrespective of interventions being scaled in similar contexts (e.g., having political favourability); mechanisms still led to both intended and unintended scale up outcomes (e.g., increased or reduced sustainability).

Conclusion

This paper provides the first evidence for mechanisms underpinning outcomes required for successful scale up of state or nationally delivered interventions. Our findings challenge current prerequisites for effective scaling suggesting other conditions may be necessary. Future scale up approaches that plan for complexity and encourage iterative adaptation throughout, may enhance scale up outcomes. Current linear, context-to-outcome depictions of scale up oversimplify what is a clearly a complex interaction between perceptions, worldviews and goals of those involved. Mechanisms identified in this study could potentially be leveraged during future scale up efforts, to positively influence intervention scalability and sustainability.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01103-0.

Designing for Scale and taking scale to account: lessons from a community score card project in Uganda

BACKGROUND

Planning for the implementation of community scorecards (CSC) is an important, though seldom documented process. Makerere University School of Public Health (MakSPH) and Future Health Systems Consortium set out to develop and test a sustainable and scalable CSC model. This paper documents the process of planning and adapting the design of the CSC, incorporating key domains of the scalable model such as embeddedness, legitimacy, feasibility and ownership, challenges encountered in this process and how they were mitigated.

METHODS

The CSC intervention comprised of five rounds of scoring in five sub counties and one town council of Kibuku district. Data was drawn from ten focus group discussions, seven key informant interviews with local and sub national leaders, and one reflection meeting with the project team from MakSPH. More data was abstracted from notes of six quarterly stakeholder meetings and six quarterly project meetings. Data was analyzed using a thematic approach, drawing constructs outlined in the project's theory of change.

RESULTS

Embeddedness, legitimacy and ownership were promoted through aligning the model with existing processes and systems as well as the meaningful and strategic involvement of stakeholders and leaders at local and sub national level. The challenges encountered included limited technical capacity of stakeholders facilitating the CSC, poor functionality of existing community engagement platforms, and difficulty in promoting community participation without financial incentives. However, these challenges were mitigated through adjustments to the intervention design based on the feedback received.

CONCLUSION

Governments seeking to scale up CSCs and to take scale to account should keenly adapt existing models to the local implementation context with strategic and meaningful involvement of key legitimate local and sub national leaders in decision making during the design and implementation process. However, they should watch out for elite capture and develop mitigating strategies. Social accountability practitioners should document their planning and adaptive design efforts to share good practices and lessons learned. Enhancing local capacity to implement CSCs should be ensured through use of existing local structures and provision of technical support by external or local partners familiar with the skill until the local partners are competent.

Estimating the cost of implementing a facility and community score card for maternal and newborn care service delivery in a rural district in Uganda

INTRODUCTION

This paper aimed at estimating the resources required to implement a community Score Card by a typical rural district health team in Uganda, as a mechanism for fostering accountability, utilization and quality of maternal and child healthcare service.

METHODS

This costing analysis was done from the payer's perspective using the ingredients approach over five quarterly rounds of scoring between 2017 and 2018. Expenditure data was obtained from project records, entered and analyzed in Microsoft excel. Two scale-up scenarios, scenario one (considered cost inputs by the MakSPH research teams) and scenario two (considering cost inputs based on contextual knowledge from district implementing teams), were simulated to better understand the cost implications of integrating the Community Score Card (CSC) into a district health system.

RESULTS

The total and average cost of implementing CSC for five quarterly rounds over a period of 18 months were USD 59,962 and USD 11,992 per round of scoring, respectively. Considering the six sub-counties (including one Town Council) in Kibuku district that were included in this analysis, the average cost of implementating the CSC in each sub-county was USD 1998 per scoring round. Scaling-up of the intervention across the entire district (included 22 sub-counties) under the first scenario would cost a total of USD 19,003 per scoring round. Under the second scaleup scenario, the cost would be lower at USD 7116. The total annual cost of scaling CSC in the entire district would be USD 76,012 under scenario one compared to USD 28,465 under scenario two. The main cost drivers identified were transportation costs, coordination and supervision costs, and technical support to supplement local implementers.

CONCLUSION

Our analysis suggests that it is financially feasible to implement and scale-up the CSC initiative, as an accountability tool for enhancing service delivery. However, the CSC design and approach needs to be embedded within local systems and implemented in collaboration with existing stakeholders so as to optimise costs. A comprehensive economic analysis of the costs associated with transportation, involvement of the district teams in coordination, supervision as well as provision of technical support is necessary to determine the cost-effectiveness of the CSC approach.

<p>Implementation of Health Policy on Establishment of Provincial Center of Diseases Control (CDC) in Vietnam</p>

Purpose

Methods

Results

Conclusion

Key Stakeholders' Perspectives on Implementation and Scale up of HIV Self-Testing in Rwanda

INTRODUCTION

The World Health Organisation recommends HIV self-testing as an alternative testing method to help reach underserved populations, such as men in sub-Saharan Africa. Successful implementation and scale-up of HIV self-testing (HIVST) in Rwanda relies heavily on relevant stakeholders' involvement. We sought to explore HIVST key stakeholders' perceptions of the implementation and scale-up of HIVST in Rwanda.

METHOD

We conducted in-depth interviews with personnel involved in HIV response projects in Rwanda between September and November 2019. We purposively sampled and interviewed 13 national-level key stakeholders from the Ministry of Health, Rwanda Biomedical Center, non-governmental organizations and HIV clinics at tertiary health facilities in Kigali. We used a thematic approach to analysis with a coding framework guided by Consolidated Framework for Implementation Research (intervention characteristics, inner setting, outer setting, characteristics of individuals involved in the implementation and the implementation process).

RESULTS

Key stakeholders perceived HIVST as a potentially effective initiative, which can be used in order to ensure that there is an improvement in uptake of testing services, especially for underserved populations in Rwanda. The following challenges for implementation and scale-up of HIVST were revealed: lack of awareness of the kits, high cost of the self-test kits, and concerns on results interpretation. Key stakeholders identified the following as prerequisites to the successful implementation and scale-up of HIVST in Rwanda; creation of awareness, training those involved in the implementation process, regulation of the selling of the self-test kits, reduction of the costs of acquiring the self-test kits through the provision of subsidies, and ensuring consistent availability of the self-test kits.

CONCLUSIONS

Key stakeholders expressed confidence in HIVST's ability to improve the uptake of HIV testing services. However, they reported challenges, which need to be addressed to ensure successful implementation and scale-up of the HIVST. There is a need for further research incorporating lower level stakeholders to fully understand HIVST implementation and scale-up challenges and strategies to inform policy.

What do the implementation outcome variables tell us about the scaling-up of the antiretroviral treatment adherence clubs in South Africa? A document review

Background

The successful initiation of people living with HIV on antiretroviral treatment (ART) in South Africa fomented challenges of poor retention in care and suboptimal adherence to medication. Following evidence of the potential of adherence clubs (ACs) to improve patient retention in ART and adherence to medication, the South African National Department of Health drafted a policy in 2016 encouraging the rollout of ACs nationwide. However, little guidance on the rollout strategy has been provided to date, and the national adoption status of the AC programme is unclear. To this end, we aimed to review the effectiveness of the rollout of the antiretroviral AC intervention in South Africa to date through an implementation research framework.

Methods

We utilised a deductive thematic analysis of documents of the AC programme in South Africa obtained from searching various databases from December 2017 to July 2018. The implementation outcome variables (acceptability, appropriateness, adoption, feasibility, fidelity, implementation cost, coverage and sustainability) were applied to frame and describe the effectiveness of the national rollout of the AC programme in South Africa.

Results

We identified 32 eligible documents that were included for analysis. Our analysis showed that ACs were highly acceptable by patients and health stakeholders given the observed benefits, including decongestion of clinics, increased social support for patients and the low cost of implementation. Evidence suggests that the AC model proved to be effective in improving adherence to ART and retention in care. Based on the success of ACs in the Western Cape, ACs are currently being implemented in all of the other South African provinces.

Conclusion

The inherent adaptability of the AC model should allow innovative strategies to maximise the use of existing resources. Therefore, the challenge is not limited to acquiring additional resources and support, but also includes the efficient use of available resources. Emerging challenges with AC programmes need to be addressed by increasing communication between stakeholders and fostering a culture of learning between facilities. As the AC programme expands and adapts to accommodate more people living with HIV and different population groups, policies should be designed to overcome present and anticipated challenges to enable its success.

Implementation Research to Strengthen Health Care Financing Reforms Toward Universal Health Coverage in Indonesia: A Mixed-Methods Approach to Real-World Monitoring

Implementation research enabled stakeholders to formulate questions, assess implications of research results that informed changes in regulations and payment at the primary care level, and strengthen monitoring capacity. While the national health insurance system had some impact on performance of primary care facilities, individual providers remained unsatisfied because payment was largely based on factors outside of their control such as tenure and position, rather than their contributions to improved performance.

Universal health coverage reforms are complex and impact numerous processes, institutions, and individuals. To know whether reforms are being implemented as planned and working as envisioned, policy makers and managers need information and insights on bottlenecks. The United States Agency for International Development (USAID) provided support to build implementation research (IR) capacity and to conduct cycles of research to help Indonesia understand how its single-payer national insurance reform, Jaminan Kesehatan Nasional (JKN), was affecting primary care. Two cycles of IR in Indonesia focused on effects of JKN financing on primary care, as determined through a consultative process with stakeholders at national and district levels. This process generated questions relevant for implementers and policy makers and strengthened government interest in findings. Research was conducted in 5 diverse districts, and methods included key informant interviews, focus groups, document review, health worker surveys, and analysis of service delivery data. Cycle 1 findings showed an uneven understanding of JKN regulations, unequal implementation readiness, and limited evidence of improved productivity. JKN capitation payments did not increase health worker satisfaction or motivate additional effort. Informed by these findings, regulations were rewritten and the capitation payment formula was redesigned to include payment conditional on performance. Cycle 2 found that health workers experienced increased workloads because of increased enrollment in JKN and the requirement that people access primary care before being referred to higher levels of care. In addition, health workers indicated they did not experience the payment system to be fair. Instead of payment being conditional on performance, they indicated it was primarily determined by education and tenure, with only some districts incorporating a small payment component based on behaviors, such as attendance, and performance. The health workers said they preferred to be paid based on achieving primary care targets. Conducting IR so that questions are relevant and the process of finding and sharing answers is timely and cost-effective requires high-level skills, but support to build IR capacity has potential to make a lasting impact.

Elements for harnessing participatory action research to strengthen health managers' capacity: a critical interpretative synthesis

BACKGROUND

Health managers play a key role in ensuring that health services are responsive to the needs of the population. Participatory action research (PAR) is one of the approaches that have been used to strengthen managers' capacity. However, collated knowledge on elements for harnessing PAR to strengthen managers' capacity is missing. This paper bridges this gap by reviewing existing literature on the subject matter.

METHODS

A critical interpretive synthesis method was used to interrogate eight selected articles. These articles reported the use of PAR to strengthen health managers' capacity. The critical interpretive synthesis method's approach to analysis guided the synthesis. Here, the authors interpretively made connections and linkages between different elements identified in the literature. Finally, the Atun et al. (Heal Pol Plann, 25:104-111, 2010) framework on integration was used to model the elements synthesised in the literature into five main domains.

RESULTS

Five elements with intricate bi-directional interactions were identified in the literature reviewed. These included a shared purpose, skilled facilitation and psychological safety, activity integration into organisational procedures, organisational support, and external supportive monitoring. A shared purpose of the managers' capacity strengthening initiative created commitment and motivation to learn. This purpose was built upon a set of facilitation skills that included promoting participation, self-efficacy and reflection, thereby creating a safe psychological space within which the managers interacted and learnt from each other and their actions. Additionally, an integrated intervention strengthened local capacity and harnessed organisational support for learning. Finally, supportive monitoring from external partners, such as researchers, ensured quality, building of local capacity and professional safety networks essential for continued learning.

CONCLUSIONS

The five elements identified in this synthesis provide a basis upon which the use of PAR can be harnessed, not only to strengthen health managers' capacity, but also to foster other health systems strengthening initiatives involving implementation research. In addition, the findings demonstrated the intricate and complex relations between the elements, which further affirms the need for a systems thinking approach to tackling health systems challenges.