Using Theories of Change to inform implementation of health systems research and innovation: experiences of Future Health Systems consortium partners in Bangladesh, India and Uganda

Implementation of peer support for people with severe mental health conditions in high-, middle- and low-income-countries: a theory of change approach

BACKGROUND

Stakeholder engagement is essential to the design, implementation and evaluation of complex mental health interventions like peer support. Theory of Change (ToC) is commonly used in global health research to help structure and promote stakeholder engagement throughout the project cycle. Stakeholder insights are especially important in the context of a multi-site trial, in which an intervention may need to be adapted for implementation across very different settings while maintaining fidelity to a core model. This paper describes the development of a ToC for a peer support intervention to be delivered to people with severe mental health conditions in five countries as part of the UPSIDES trial.

METHODS

One hundred thirty-four stakeholders from diverse backgrounds participated in a total of 17 workshops carried out at six UPSIDES implementing sites across high-, middle- and low-income settings (one site each in India, Israel, Uganda and Tanzania; two sites in Germany). The initial ToC maps created by stakeholders at each site were integrated into a cross-site ToC map, which was then revised to incorporate additional insights from the academic literature and updated iteratively through multiple rounds of feedback provided by the implementers.

RESULTS

The final ToC map divides the implementation of the UPSIDES peer support intervention into three main stages: preparation, implementation, and sustainability. The map also identifies three levels of actors involved in peer support: individuals (service users and peer support workers), organisations (and their staff members), and the public. In the UPSIDES trial, the ToC map proved especially helpful in characterising and distinguishing between (a) common features of peer support, (b) shared approaches to implementation and (c) informing adaptations to peer support or implementation to account for contextual differences.

CONCLUSIONS

UPSIDES is the first project to develop a multi-national ToC for a mental health peer support intervention. Stakeholder engagement in the ToC process helped to improve the cultural and contextual appropriateness of a complex intervention and ensure equivalence across sites for the purposes of a multi-site trial. It may serve as a blueprint for implementing similar interventions with a focus on recovery and social inclusion among people with mental ill-health across diverse settings.

TRIAL REGISTRATION

ISRCTN26008944 (Registration Date: 30/10/2019).

How is the implementation of empirical research results documented in conflict-affected settings? Findings from a scoping review of peer-reviewed literature

Implementation science scholars argue that knowing 'what works' in public health is insufficient to change practices, without understanding 'how', 'where' and 'why' something works. In the peer reviewed literature on conflict-affected settings, challenges to produce research, make decisions informed by evidence, or deliver services are documented, but what about the understanding of 'how', 'where' and 'why' changes occur? We explored these questions through a scoping review of peer-reviewed literature based on core dimensions of the Extended Normalization Process Theory. We selected papers that provided data on how something might work (who is involved and how?), where (in what organizational arrangements or contexts?) and why (what was done?). We searched the Global Health, Medline, Embase databases. We screened 2054 abstracts and 128 full texts. We included 22 papers (of which 15 related to mental health interventions) and analysed them thematically. We had the results revised critically by co-authors experienced in operational research in conflict-affected settings. Using an implementation science lens, we found that: (a) implementing actors are often engaged after research is produced to discuss feasibility; (b) new interventions or delivery modalities need to be flexible; (c) disruptions affect how research findings can lead to sustained practices; (d) strong leadership and stable resources are crucial for frontline actors; (e) creating a safe learning space to discuss challenges is difficult; (f) feasibility in such settings needs to be balanced. Lastly, communities and frontline actors need to be engaged as early as possible in the research process. We used our findings to adapt the Extended Normalization Process Theory for operational research in settings affected by conflicts. Other theories used by researchers to document the implementation processes need to be studied further.

Evaluation of the Ghana Heart Initiative - Design and Rationale of a Pragmatic Mixed-Methods Study from Diverse Perspectives: A Study Protocol

Background

Rigorous evaluations of health system interventions to strengthen hypertension and cardiovascular disease (CVD) care remain scarce in sub-Saharan Africa. This study aims to evaluate the reach, effectiveness, adoption / acceptability, implementation fidelity, cost, and sustainability of the Ghana Heart Initiative (GHI), a multicomponent supply-side intervention to improve cardiovascular health in Ghana.

Methods

This study adopts a mixed- and multi-methods design comparing the effects of the GHI in 42 intervention health facilities (i.e. primary, secondary and tertiary) in the Greater Accra Region versus 56 control health facilities in the Central and Western Regions. The evaluation design is guided by the RE-AIM framework underpinned by the WHO health systems building blocks framework, integrated by the Institute of Medicine's six dimensions of health care quality: safe, effective, patient-centered, timely, effi cient, equitable. The assessment tools include: (i) a health facility survey, (ii) a healthcare provider survey assessing the knowledge, attitudes, and practices on hypertension and CVD management, (iii) a patient exit survey, (iv) an outpatient and in-patient medical record review and (v) qualitative interviews with patients and various health system stakeholders to understand the barriers and facilitators around the implementation of the GHI. In addition to primary data collection, the study also relies on secondary routine health system data, i.e., the District Health Information Management System to conduct an interrupted time series analysis using monthly counts for relevant hypertension and CVD specific indicators as outcomes. The primary outcome measures are performance of health service delivery indicators, input, process and outcome of care indicators (including screening of hypertension, newly diagnosed hypertension, prescription of guideline directed medical therapy, and satisfaction with service received and acceptability) between the intervention and control facilities. Lastly, an economic evaluation and budget impact analysis is planned to inform the nationwide scale-up of the GHI.

Discussion

This study will generate policy-relevant data on the reach, effectiveness, implementation fidelity, adoption / acceptability, and sustainability of the GHI, and provide insights on the costs and budget-impacts to inform nation-wide scale-up to expand the GHI to other regions across Ghana and offer lessons to other low- and middle-income countries settings as well.

RIDIE Registration Number

RIDIE-STUDY-ID-6375e5614fd49 (https://ridie.3ieimpact.org/index.php).

[Successful Implementation of Peer Support for People with Severe Mental Illness in Germany: a Theory of Change Approach]

OBJECTIVE

Peer support is an established intervention in which people with mental illness receive support by trained peer support workers who have already overcome a mental health crisis. The implementation of peer support is complex due to interacting factors and can be achieved through the participatory Theory of Change method. Aim of this study is to develop a cross-site Theory of Change for the sustainable implementation of UPSIDES peer support in Germany.

METHODS

Based on site-specific Theories of Change workshops from Ulm and Hamburg in which 47 participants took part, a cross-site Theory of Change was designed and verified in three follow-up workshops with 12 participants. Participants' professional and experiential backgrounds were diverse, including peer support workers, hospital directors and managers, mental health professionals (psychiatrists, psychotherapists, nurses), and researchers.

RESULTS

The first pathway of the cross-site Theory of Change focuses on the training of peer support workers, whereas the second pathway emphasizes recognition and integration by mental health institutions and professionals. The third pathway specifies the building of a cross-professional care network to integrate various peer support services. Procedures to approach prospective peer clients are depicted in the fourth pathway. The fifth path addresses the clarification of the role description of peer support workers and the implementation in other institutions through cooperation.

DISCUSSION

Many of the identified implementation steps have been validated in comparable studies. The development of this Theory of Change by bringing together multiple perspectives of key stakeholders is an important basis for the sustainable implementation of UPSIDES peer support. Furthermore, it may serve as a blueprint for the implementation of similar interventions to advance scaling-up of evidence-based user-led and recovery-oriented interventions.

CONCLUSION

The Theory of Change approach is a well-accepted and feasible method, which can be recommended for the implementation of complex interventions such as UPSIDES peer support.

Improving child health service interventions through a Theory of Change: A scoping review

Background

The objective of this scoping review was to map how child health service interventions develop, utilise, and refine theories of change. A Theory of Change (ToC) is a tool for designing, implementing, and evaluating interventions that is being increasingly used by child health practitioners who are aiming to enact change in health services.

Methods

A published protocol guided this scoping review. Relevant publications were identified through selected electronic databases and grey literature via a search strategy. The main inclusion criteria were any child health service intervention globally that described their ToC or ToC development process. These were applied by two independent reviewers. Data relevant to the research sub-questions were extracted, charted and discussed.

Findings

38 studies were included in the analysis. This scoping review highlights the disparate and inconsistent use, and reporting of ToCs in the child health service intervention literature.

Conclusion

A ToC may be a helpful tool to enact change in a child health service but careful consideration must be undertaken by the child health service regarding how to maximise the benefits of doing a ToC, and how to accurately report it.

Applying learning health systems thinking in codeveloping integrated tuberculosis interventions in the contexts of COVID-19

The COVID-19 pandemic reversed much of global progress made in combatting tuberculosis, with South Africa experiencing one of the largest impacts on tuberculosis detection. The aim of this paper is to share our experiences in applying learning health systems (LHS) thinking to the codevelopment of an intervention improving an integrated response to COVID-19 and tuberculosis in a South African district. A sequential partially mixed-methods study was undertaken between 2018 and 2021 in the district of Amajuba in KwaZulu-Natal. Here, we report on the formulation of a Theory of Change, codesigning and refining proposed interventions, and piloting and evaluating codesigned interventions in primary healthcare facilities, through an LHS lens. Following the establishment and formalisation of a district Learning Community, diagnostic work and a codevelopment of a theory of change, intervention packages tailored according to pandemic lockdowns were developed, piloted and scaled up. This process illustrates how a community of learning can generate more responsive, localised interventions, and suggests that the establishment of a shared space of research governance can provide a degree of resilience to facilitate adaption to external shocks. Four main lessons have been gleaned from our experience in adopting an LHS approach in a South African district, which are (1) the importance of building and sustaining relationships, (2) the utility of colearning, coproduction and adaptive capacity, (3) the centrality of theory-driven systems strengthening and (4) reflections on LHS as a framework.

Theoretical Frameworks in Medical Education: Using a Systematic Review of Ophthalmology Education Research to Create a Theory of Change Model

BACKGROUND

Theoretical frameworks provide a lens to examine questions and interpret results; however, they are underutilized in medical education.

OBJECTIVE

To systematically evaluate the use of theoretical frameworks in ophthalmic medical education and present a theory of change model to guide educational initiatives.

METHODS

Six electronic databases were searched for peer-reviewed, English-language studies published between 2016 and 2021 on ophthalmic educational initiatives employing a theoretical framework. Quality of studies was assessed using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach; risk of bias was evaluated using the Medical Education Research Study Quality Instrument (MERSQI) and the Accreditation Council for Graduate Medical Education (ACGME) guidelines for evaluation of assessment methods. Abstracted components of the included studies were used to develop a theory of change model.

RESULTS

The literature search yielded 1661 studies: 666 were duplicates, 834 studies were excluded after abstract review, and 132 after full-text review; 29 studies (19.2%) employing a theoretical framework were included. The theories used most frequently were the Dreyfus model of skill acquisition and Messick's contemporary validity framework. GRADE ratings were predominantly "low," the average MERSQI score was 10.04, and the ACGME recommendation for all assessment development studies was the lowest recommendation. The theory of change model outlined how educators can select, apply, and evaluate theory-based interventions.

CONCLUSIONS

Few ophthalmic medical education studies employed a theoretical framework; their overall rigor was low as assessed by GRADE, MERSQI, and ACGME guidelines. A theory of change model can guide integration of theoretical frameworks into educational initiatives.

The role of integrated community case management projects in strengthening health systems: case study analysis in Ethiopia, Malawi and Mozambique

Integrated community case management (iCCM) has now been implemented at scale globally. Literature to-date has focused primarily on the effectiveness of iCCM and the systems conditions required to sustain iCCM. In this study, we sought to explore opportunities taken and lost for strengthening health systems through successive iCCM programmes. We employed a systematic, embedded, multiple case study design for three countries-Ethiopia, Malawi and Mozambique-where Save the Children implemented iCCM programmes between 2009 and 2017. We used textual analysis to code 62 project documents on nine categories of functions of health systems using NVivo 11.0. The document review was supplemented by four key informant interviews. This study makes important contributions to the theoretical understanding of the role of projects in health systems strengthening by not only documenting evidence of systems strengthening in multi-year iCCM projects, but also emphasizing important deficiencies in systems strengthening efforts. Projects operated on a spectrum, ranging from gap-filling interventions, to support, to actual strengthening. While there were natural limits to the influence of a project on the health system, all successive projects found constructive opportunities to try to strengthen systems. Alignment with the Ministry of Health was not always static and simple, and ministries themselves have shown pluralism in their perspectives and orientations. We conclude that systems strengthening remains 'everybody's business' and places demands for realism and transparency on government and the development architecture. While mid-size projects have limited decision space, there is value in better defining where systems strengthening contributions can actually be made. Furthermore, systems strengthening is not solely about macro-level changes, as operational and efficiency gains at meso and micro levels can have value to the system. Claims of 'systems strengthening' are, however, bounded within the quality of evaluation and learning investments.

Identifying knowledge needed to improve surgical care in Southern Africa using a theory of change approach

Surgical healthcare has been prioritised in the Southern African Development Community (SADC), a regional intergovernmental entity promoting equitable and sustainable economic growth and socioeconomic development. However, challenges remain in translating political prioritisation into effective and equitable surgical healthcare. The AfroSurg Collaborative (AfroSurg) includes clinicians, public health professionals and social scientists from six SADC countries; it was created to identify context-specific, critical areas where research is needed to inform evidence-grounded policy and implementation. In January 2020, 38 AfroSurg members participated in a theory of change (ToC) workshop to agree on a vision: ‘An African-led, regional network to enable evidence-based, context-specific, safe surgical care, which is accessible, timely, and affordable for all, capturing the spirit of Ubuntu[1]’ and to identify necessary policy and service-delivery knowledge needs to achieve this vision. A unified ToC map was created, and a Delphi survey was conducted to rank the top five priority knowledge needs. In total, 45 knowledge needs were identified; the top five priority areas included (1) mapping of available surgical services, resources and providers; (2) quantifying the burden of surgical disease; (3) identifying the appropriate number of trainees; (4) identifying the type of information that should be collected to inform service planning; and (5) identifying effective strategies that encourage geographical retention of practitioners. Of the top five knowledge needs, four were policy-related, suggesting a dearth of much-needed information to develop regional, evidenced-based surgical policies. The findings from this workshop provide a roadmap to drive locally led research and create a collaborative network for implementing research and interventions. This process could inform discussions in other low-resource settings and enable more evidenced-based surgical policy and service delivery across the SADC countries and beyond.

Peer-led HIV care and the UNAIDS 90-90-90 treatment targets in Tigrai, Ethiopia: a cluster randomised trial and economic evaluation of teach-test-link-trace model (TTLT) trial protocol

INTRODUCTION

This study will evaluate the acceptability and effectiveness of a new intervention programme called teach-test-link-trace (TTLT) model in Tigrai, Ethiopia, where peer educators counsel about HIV (teach), perform house-to-house HIV testing (test) through pinprick HIV testing (H2H) or OraQuick HIV self-testing (HIVST), link HIV-positive patients to HIV care (link) and trace lost patients house-to-house (trace).

METHODS AND ANALYSIS

The four-arm cluster randomised trial will be conducted in five phases: Phase 1 will assess the acceptability of the TTLT model using a cross-sectional survey among adults aged 18 years irrespective of HIV status in 6909 households from 40 villages (kebeles). Phase 2 will assess effectiveness of the TTLT model through comparing intervention and control groups among HIV negative or unknown HIV status. The intervention groups will receive one of the three home-based interventions provided by peer educators: (1) demonstrate and distribute OraQuick HIV self-testing kits (HIVST), (2) perform pinprick HIV testing (H2H) and (3) offer a choice to either receive HIVST or H2H. The control group will receive the standard care in which nurses counsel and refer eligible household members to nearby health facilities to access existing HIV testing services. The primary outcomes of the interventions are proportion of individuals who know of their HIV status (first 90), link to HIV care and treatment (second 90) and meet virological suppression (third 90). We will perform process evaluation through qualitative interviews in phase 3, economic evaluation for cost-effectiveness analysis in phase 4 and a sustainability exit strategy using nominal group technique in phase 5. We will apply descriptive and inferential statistics for quantitative studies, and thematic framework analysis for qualitative studies.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the Southern Adelaide Clinical Health Research Ethics Committee (SAC HREC), South Australia, and findings will be disseminated through publications, conference presentations, media release and policy briefs.

TRIAL REGISTRATION NUMBER

ACTRN12620000570987p.

A country-level national needs assessment of the Indonesian pharmacy workforce

BACKGROUND

Conducting a systematic country-level workforce needs-assessment is a way to develop coherent strategic and justifiable workforce planning.

OBJECTIVE(S)

This article describes a country-level needs-assessment process using a systematic approach (via the FIP Development Goals (FIP DGs) workforce element) as an analytical framework. The needs-assessment aimed to prioritise gaps toward transforming the pharmacy workforce as a prelude to practice and pharmaceutical services reform in Indonesia.

METHODS

The needs assessment consisted of three stages: needs identification, needs analysis, and needs prioritisation. The needs (workforce development gaps) were defined as the discrepancies between the perceived workforce challenges and the existing national workforce development projects. Interviews or group discussions were conducted to gather the workforce challenges of individual pharmacists. A structured workshop was conducted to identify workforce challenges and existing organisations' projects, with main stakeholders contributing to pharmacists' development in Indonesia. Perceived challenges findings and identified national workforce projects were mapped to the FIP DGs workforce element. The needs prioritisation was conducted by comparing the proportional mapping to the FIP DGs workforce element.

RESULTS

There were forty-three individual pharmacists and 7 principal stakeholder categories that provided information related to perceived workforce challenges; thirty national projects were identified from stakeholders. While this study identified perceived challenges with workforce "competency development" and "pharmacy workforce intelligence," there were no active ongoing national projects mapped to those goals. The framework mapping analysis showed there are workforce development gaps centred on "competency development" initiatives, "advanced and specialist development" initiatives, and strategic pharmacy workforce intelligence data gathering. Additionally, there were policy gaps with initiatives for strengthening "working with others" and a lack of clarity on infrastructure for early-career training strategies and workforce impact.

CONCLUSIONS

This study prioritises the gaps in developing pharmacists in Indonesia. This process could be used in conducting needs assessment of pharmacy workforce development in other Low and Middle-Income Countries (LMICs).

Modernizing health information technology: lessons from healthcare delivery systems

Objective

To identify recurrent themes, insights, and process recommendations from stakeholders in US organizations during the health information technology (HIT) modernization of an existing electronic health record (EHR) to a commercial-off-the-shelf product in both resource-plentiful settings and in a resource-constrained environment, the US Indian Health Service.

Materials and Methods

Thirteen qualitative interviews with stakeholders in various organizations were conducted about HIT modernization efforts. Using a Theory of Change framework, recurring themes were identified and analyzed.

Results

The interviewees emphasized the importance of organizational and process revision during modernization, converting historical data, and clinical and leadership involvement. HIT implementation required technological and infrastructure redesign, additional training, and workflow reconfiguration. Motivations for modernization included EHR usability dissatisfaction, revenue enhancements, and improved clinical operations. Decision-making strategies, primarily during HIT selection, included meetings with stakeholders. Successful modernization resulted in improvements in clinical operations, patient experience, and financial outlay.

Discussion

Existing implementation frameworks fail to provide experiential feedback, such as implementation challenges, like data conversion, regulatory, functionality, and interoperability requirements. Regardless of the healthcare environment, HIT modernization requires the engagement of leadership and end-users during HIT selection and through all stages of the implementation to prepare people, processes, and technology. Organizations must iteratively define the technological, infrastructure, organizational, and workflow changes required for a successful HIT modernization effort.

Conclusions

HIT modernization is an opportunity for organizational and technological change. Successful modernization requires a comprehensive, intentional, well-communicated, and multidisciplinary approach. Resource-constrained environments have the additional challenges of financial burdens, limited staffing, and unstable infrastructure.

Digital Health and Inequalities in Access to Health Services in Bangladesh: Mixed Methods Study

Background

Globally, the rapid growth of technology and its use as a development solution has generated much interest in digital health. In line with global trends, Bangladesh is also integrating technology into its health system to address disparities. Strong political endorsement and uptake of digital platforms by the government has influenced the rapid proliferation of such initiatives in the country. This paper aims to examine the implications of digital health on access to health care in Bangladesh, considering who uses electronic devices to access health information and services and why.

Objective

This study aims to understand how access to health care and related information through electronic means (digital health) is affected by sociodemographic determinants (ie, age, gender, education, socioeconomic status, and personal and household ownership of mobile phones) in a semiurban community in Bangladesh.

Methods

A cross-sectional survey of 854 households (between October 2013 and February 2014) and 20 focus group discussions (between February 2017 and March 2017) were conducted to understand (1) who owns electronic devices; (2) who, among the owners, uses these to access health information and services and why; (3) the awareness of electronic sources of health information; and (4) the role of intermediaries (family members or peers who helped to look for health information using electronic devices).

Results

A total of 90.3% (771/854) of households (471/854, 55.2% of respondents) owned electronic devices, mostly mobile phones. Among these, 7.2% (34/471) used them to access health information or services. Middle-aged (35-54 years), female, less (or not) educated, and poorer people used these devices the least (α=.05, α is the level of significance). The lack of awareness, discomfort, differences with regular care-seeking habits, lack of understanding and skills, and proximity to a health facility were the main reasons for not using devices to access digital health.

Conclusions

Although influenced by sociodemographic traits, access to digital health is not merely related to device ownership and technical skill. Rather, it is a combination of general health literacy, phone ownership, material resources, and technical skill as well as social recognition of health needs and inequity. This study’s findings should serve as a basis for better integrating technology within the health system and ensuring equitable access to health care.

Characterising innovations in maternal and newborn health based on a common theory of change: lessons from developing and applying a characterisation framework in Nigeria, Ethiopia and India

Government leadership is key to enhancing maternal and newborn survival. In low/middle-income countries, donor support is extensive and multiple actors add complexity. For policymakers and others interested in harmonising diverse maternal and newborn health efforts, a coherent description of project components and their intended outcomes, based on a common theory of change, can be a valuable tool. We outline an approach to developing such a tool to describe the work and the intended effect of a portfolio of nine large-scale maternal and newborn health projects in north-east Nigeria, Ethiopia and Uttar Pradesh in India. Teams from these projects developed a framework, the 'characterisation framework', based on a common theory of change. They used this framework to describe their innovations and their intended outcomes. Individual project characterisations were then collated in each geography, to identify what innovations were implemented where, when and at what scale, as well as the expected health benefit of the joint efforts of all projects. Our study had some limitations. It would have been enhanced by a more detailed description and analysis of context and, by framing our work in terms of discrete innovations, we may have missed some synergistic aspects of the combination of those innovations. Our approach can be valuable for building a programme according to a commonly agreed theory of change, as well as for researchers examining the effectiveness of the combined work of a range of actors. The exercise enables policymakers and funders, both within and between countries, to enhance coordination of efforts and to inform decision-making about what to fund, when and where.

Evidence map of knowledge translation strategies, outcomes, facilitators and barriers in African health systems

BACKGROUND

The need for research-based knowledge to inform health policy formulation and implementation is a chronic global concern impacting health systems functioning and impeding the provision of quality healthcare for all. This paper provides a systematic overview of the literature on knowledge translation (KT) strategies employed by health system researchers and policy-makers in African countries.

METHODS

Evidence mapping methodology was adapted from the social and health sciences literature and used to generate a schema of KT strategies, outcomes, facilitators and barriers. Four reference databases were searched using defined criteria. Studies were screened and a searchable database containing 62 eligible studies was compiled using Microsoft Access. Frequency and thematic analysis were used to report study characteristics and to establish the final evidence map. Focus was placed on KT in policy formulation processes in order to better manage the diversity of available literature.

RESULTS

The KT literature in African countries is widely distributed, problematically diverse and growing. Significant disparities exist between reports on KT in different countries, and there are many settings without published evidence of local KT characteristics. Commonly reported KT strategies include policy briefs, capacity-building workshops and policy dialogues. Barriers affecting researchers and policy-makers include insufficient skills and capacity to conduct KT activities, time constraints and a lack of resources. Availability of quality locally relevant research was the most reported facilitator. Limited KT outcomes reflect persisting difficulties in outcome identification and reporting.

CONCLUSION

This study has identified substantial geographical gaps in knowledge and evidenced the need to boost local research capacities on KT practices in low- and middle-income countries. Evidence mapping is also shown to be a useful approach that can assist local decision-making to enhance KT in policy and practice.

Using a cross-contextual reciprocal learning approach in a multisite implementation research project to improve self-management for type 2 diabetes

This paper reports on the use of reciprocal learning for identifying, adopting and adapting a type 2 diabetes self-management support intervention in a multisite implementation trial conducted in a rural setting in a low-income country (Uganda), a periurban township in a middle-income country (South Africa) and socioeconomically disadvantaged suburbs in a high-income country (Sweden). The learning process was guided by a framework for knowledge translation and structured into three learning cycles, allowing for a balance between evidence, stakeholder interaction and contextual adaptation. Key factors included commitment, common goals, leadership and partnerships. Synergistic outcomes were the cocreation of knowledge, interventions and implementation methods, including reverse innovations such as adaption of community-linked models of care. Contextualisation was achieved by cross-site exchanges and local stakeholder interaction to balance intervention fidelity with local adaptation. Interdisciplinary and cross-site collaboration resulted in the establishment of learning networks. Limitations of reciprocal learning relate to the complexity of the process with unpredictable outcomes and the limited generalisability of results.

Participatory monitoring and evaluation approaches that influence decision-making: lessons from a maternal and newborn study in Eastern Uganda

Background

The use of participatory monitoring and evaluation (M&E) approaches is important for guiding local decision-making, promoting the implementation of effective interventions and addressing emerging issues in the course of implementation. In this article, we explore how participatory M&E approaches helped to identify key design and implementation issues and how they influenced stakeholders’ decision-making in eastern Uganda.

Method

The data for this paper is drawn from a retrospective reflection of various M&E approaches used in a maternal and newborn health project that was implemented in three districts in eastern Uganda. The methods included qualitative and quantitative M&E techniques such as  key informant interviews, formal surveys and supportive supervision, as well as participatory approaches, notably participatory impact pathway analysis.

Results

At the design stage, the M&E approaches were useful for identifying key local problems and feasible local solutions and informing the activities that were subsequently implemented. During the implementation phase, the M&E approaches provided evidence that informed decision-making and helped identify emerging issues, such as weak implementation by some village health teams, health facility constraints such as poor use of standard guidelines, lack of placenta disposal pits, inadequate fuel for the ambulance at some facilities, and poor care for low birth weight infants. Sharing this information with key stakeholders prompted them to take appropriate actions. For example, the sub-county leadership constructed placenta disposal pits, the district health officer provided fuel for ambulances, and health workers received refresher training and mentorship on how to care for newborns.

Conclusion

Diverse sources of information and perspectives can help researchers and decision-makers understand and adapt evidence to contexts for more effective interventions. Supporting districts to have crosscutting, routine information generating and sharing platforms that bring together stakeholders from different sectors is therefore crucial for the successful implementation of complex development interventions.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-017-0274-9) contains supplementary material, which is available to authorized users.

Strengthening scaling up through learning from implementation: comparing experiences from Afghanistan, Bangladesh and Uganda

Background

Many effective innovations and interventions are never effectively scaled up. Implementation research (IR) has the promise of supporting scale-up through enabling rapid learning about the intervention and its fit with the context in which it is implemented. We integrate conceptual frameworks addressing different dimensions of scaling up (specifically, the attributes of the service or innovation being scaled, the actors involved, the context, and the scale-up strategy) and questions commonly addressed by IR (concerning acceptability, appropriateness, adoption, feasibility, fidelity to original design, implementation costs, coverage and sustainability) to explore how IR can support scale-up.

Methods

We draw upon three IR studies conducted by Future Health Systems (FHS) in Afghanistan, Bangladesh and Uganda. We reviewed project documents from the period 2011–2016 to identify information related to the dimensions of scaling up. Further, for each country, we developed rich descriptions of how the research teams approached scaling up, and how IR contributed to scale-up. The rich descriptions were checked by FHS research teams. We identified common patterns and differences across the three cases.

Results

The three cases planned quite different innovations/interventions and had very different types of scale-up strategies. In all three cases, the research teams had extensive prior experience within the study communities, and little explicit attention was paid to contextual factors. All three cases involved complex interactions between the research teams and other stakeholders, among stakeholders, and between stakeholders and the intervention. The IR planned by the research teams focussed primarily on feasibility and effectiveness, but in practice, the research teams also had critical insights into other factors such as sustainability, acceptability, cost-effectiveness and appropriateness. Stakeholder analyses and other project management tools further complemented IR.

Conclusions

IR can provide significant insights into how best to scale-up a particular intervention. To take advantage of insights from IR, scale-up strategies require flexibility and IR must also be sufficiently flexible to respond to new emerging questions. While commonly used conceptual frameworks for scale-up clearly delineate actors, such as implementers, target communities and the support team, in our experience, IR blurred the links between these groups.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-017-0270-0) contains supplementary material, which is available to authorized users.