Designing and evaluating provider results-based financing for tuberculosis care in Georgia: a realist evaluation protocol

Geographic Barriers to Indexing: Examining Appalachia

The objective of this study was to examine the accuracy of indexing for "Appalachian Region"[Mesh]. Researchers performed a search in PubMed for articles published in 2019 using "Appalachian Region"[Mesh] or "Appalachia" or "Appalachian" in the title or abstract. Only 17.88% of the articles retrieved by the search were about Appalachia according to the ARC definition. Most articles retrieved appeared because they were indexed with state terms that were included as part of the mesh term. Database indexing and searching transparency is of growing importance as indexers rely increasingly on automated systems to catalog information and publications.

Capacity building of district health management teams in the era of provincial health administration reform in the Democratic Republic of Congo: a realist evaluation protocol

INTRODUCTION

In 2006, the Congolese Ministry of Health developed a health system strengthening strategy focusing on health district development. This strategy called for reforming the provincial health administration in order to better support the health district development through leadership and management capacity building of district health management teams. The implementation is currently underway, yet, more evidence on how, for whom and under what conditions this capacity building works is needed. The proposed research aims to address this gap using a realist evaluation approach.

METHODS AND ANALYSIS

We will follow the cycle of the realist evaluation. First, we will elicit the initial programme theory through a scoping review (completed in December 2022, using MEDLINE, Health Systems Evidence, Wiley Online Library, Cochrane Library, Google Scholar and grey literature), a review of health policy documents (completed in March 2023), and interviews with key stakeholders (by June 2023). Second, we will empirically test the initial programme theory using a multiple-embedded case study design in two provincial health administrations and four health districts (by March 2024). Data will be collected through document reviews, in-depth interviews, non-participant observations, a questionnaire, routine data from the health information management system and a context mapping tool. We will analyse data using the Intervention-Context-Actor-Mechanism-Outcome configuration heuristic. Last, we will refine the initial programme theory based on the results of the empirical studies and develop recommendations for policymakers (by June 2024).

ETHICS AND DISSEMINATION

The Institutional Review Board of the Institute of Tropical Medicine and the Medical Ethics Committee of the University of Lubumbashi approved this study. We will also seek approvals from provincial-level and district-level health authorities before data collection in their jurisdictions. We will disseminate the study findings through the publication of articles in peer-reviewed academic journals, policy briefs for national policymakers and presentations at national and international conferences.

Unpacking economic programme theory for supervision training: Preliminary steps towards realist economic evaluation

INTRODUCTION

Cost studies are increasingly popular given resource constraints. While scholars stress the context-dependent nature of cost, and the importance of theory, cost studies remain context-blind and atheoretical. However, realist economic evaluation (REE) privileges context and the testing/refinement of economic programme theory. This preliminary REE serves to test and refine economic programme theory for supervision training programmes of different durations to better inform future programme design/implementation.

METHODS

Our preliminary REE unpacked how short (half-day) and extended (12 week) supervision training programmes in Victoria, Australia, produced costs and outcomes. We employed mixed methods: qualitative realist and quantitative cost methods. Economically optimised programme models were developed guided by identified cost-sensitive mechanisms and contexts.

RESULTS

As part of identified context-mechanism-outcome configurations (CMOCs) for both training programmes, we found a wider diversity of positive outcomes but greater costs for the extended programme (11 outcomes; AU$3069/learner) compared with the short programme (7 outcomes; $385/learner). We identified four shared cost-sensitive mechanisms for both programmes (training duration, learner protected time, learner engagement, and facilitator competence) and one shared cost-sensitive context (learners' supervisory experience). We developed two economically optimised programme models: (1) short programme for experienced supervisors facilitated by senior educators ($406/learner); and (2) extended programme for inexperienced supervisors facilitated by junior educators ($2104/learner).

DISCUSSION

Our initial economic programme theory was somewhat supported, refuted and refined. Results were partly consistent with previous research, but also extended it through unpacking cost-sensitive mechanisms and contexts. Although our preliminary REE fills a pressing gap in the methodology literature, conducting REE was challenging given our desire to integrate economic and realist analyses fully, and remain faithful to realist principles. Attention to training duration and experience levels of the facilitator-learner dyad may help to balance the cost and outcomes of training programmes.

How do participatory methods shape policy? Applying a realist approach to the formulation of a new tuberculosis policy in Georgia

OBJECTIVES

This paper presents the iterative process of participatory multistakeholder engagement that informed the development of a new national tuberculosis (TB) policy in Georgia, and the lessons learnt.

METHODS

Guided by realist evaluation methods, a multistakeholder dialogue was organised to elicit stakeholders' assumptions on challenges and possible solutions for better TB control. Two participatory workshops were conducted with key actors, interspersed by reflection meetings within the research team and discussions with policymakers. Using concept mapping and causal mapping techniques, and drawing causal loop diagrams, we visualised how actors understood TB service provision challenges and the potential means by which a results-based financing (RBF) policy could address these.

SETTING

The study was conducted in Tbilisi, Georgia.

PARTICIPANTS

A total of 64 key actors from the Ministry of Labour, Health and Social Affairs, staff of the Global Fund to Fight AIDS, TB and Malaria Georgia Project, the National Centre for Disease Control and Public Health, the National TB programme, TB service providers and members of the research team were involved in the workshops.

RESULTS

Findings showed that beyond provider incentives, additional policy components were necessary. These included broadening the incentive package to include institutional and organisational incentives, retraining service providers, clear redistribution of roles to support an integrated care model, and refinement of monitoring tools. Health system elements, such as effective referral systems and health information systems were highlighted as necessary for service improvement.

CONCLUSIONS

Developing policies that address complex issues requires methods that facilitate linkages between multiple stakeholders and between theory and practice. Such participatory approaches can be informed by realist evaluation principles and visually facilitated by causal loop diagrams. This approach allowed us leverage stakeholders' knowledge and expertise on TB service delivery and RBF to codesign a new policy.

Applying the Realist Evaluation Approach to the Complex Process of Policy Implementation-The Case of the User Fee Exemption Policy for Cesarean Section in Benin

Realist evaluation is making inroads in the field of health policy and systems research to a large extent because of its good fit with complex issues. Until now, most realist studies focused on evaluating interventions or projects related to health care delivery, organization of health services, education, management, and leadership of health workers in high income countries. With this paper, we apply the realist approach to the study of national health policy implementation in a low resource country. We use the case of the user fee exemption policy for cesarean section in Benin, which we followed up from 2009 to 2018. We report on how realist evaluation can be applied for policy implementation research. We illustrate how we developed the initial programme theory-the starting point of any realist evaluation -, how we designed the study and data collection tools, and how we analyzed the data. For each step, we present current good practices, how we adapted them when needed, the challenges and the lessons learned. We report also on how the dynamic interactions between the central level (the national implementing agency) and the peripheral level (an implementing hospital) shaped the policy implementation. We found that at central level, availability of resources for a given policy is constantly challenged in the competitive national resource allocation arena. Key factors include the political power and the legitimacy of the group supporting the policy. These are influenced by the policy implementation structure, how the actual outputs of the implementation align with promises of the group supporting the policy and consequently how these outputs, the policy and its promoters are perceived by the community. We found that the service providers are key to the implementation, and that they are constrained or influenced by the dependability of the funding, their autonomy, their personal background, and the accountability arrangements. This study can inform the design and implementation of national health policies that involve interactions between central and operational level in other low-income countries.

Programme theory and realist evaluation of the 'Smoke-Free Vocational Schools' research and intervention project: a study protocol

INTRODUCTION

Smoke-free school hours (SFSHs) entails a smoking ban during school hours and might be an effective intervention to reduce the high smoking prevalence in vocational schools. For SFSH to be effective, the policy must be adequately implemented and enforced; this challenge for schools constitutes a research gap. The 'Smoke-Free Vocational Schools' research and intervention project has been developed to facilitate schools' implementation of SFSH. It is scheduled to run from 2018 to 2022, with SFSH being implemented in 11 Danish vocational schools. This study protocol describes the intervention project and evaluation design of the research and intervention project.

METHODS AND ANALYSIS

The intervention project aims to develop an evidence-based model for implementing SFSH in vocational schools and similar settings. The project is developed in a collaboration between research and practice. Two public health NGOs are responsible for delivering the intervention activities in schools, while the research partner evaluates what works, for whom, and under what circumstances. The intervention lasts one year per school, targeting different socioecological levels. During the first 6 months, activities are delivered to stimulate organisational readiness to implement SFSH. Then, SFSH is established, and during the next 6 months, activities are delivered to stimulate implementation of SFSH into routine practice. The epistemological foundation is realistic evaluation. The evaluation focuses on both implementation and outcomes. Process evaluation will determine the level of implementation and explore what hinders or enables SFSH becoming part of routine practice using qualitative and quantitative methods. Outcomes evaluation will quantitively assess the intervention's effectiveness, with the primary outcome measure being changes in smoking during school hours.

ETHICS AND DISSEMINATION

Informed consent will be obtained from study participants according to the General Data Protection Regulation (GDPR) and Danish data protection law. The study adheres to Danish ethics procedures. Study findings will be disseminated at conferences and further published in open-access peer-reviewed journals.