How does embedded implementation research work? Examining core features through qualitative case studies in Latin America and the Caribbean

Positioning implementation science in national immunization programmes to improve coverage equity and advance progress toward Immunization Agenda 2030: An urgent global health imperative

Despite the availability of effective vaccines for preventing common childhood infectious diseases, there is still significant disparities in access and utilization across many low- and middle-income countries (LMIC). The factors that drive these disparities are often multilevel, originating from individuals, health facilities, health systems and communities, and also multifaceted. Implementation science has emerged as a field to help address "know-do" gaps in health systems, and can play a significant role in strengthening immunization systems to understand and solve implementation barriers that limit access and uptake within their contexts. This article presents a reflexive perspective on how to position implementation research in immunization programmes to improve coverage equity. Furthermore, key points of synergy between implementation research and vaccination are highlighted, and some potential practice changes that can be applied within specific contexts were proposed. Using a human rights lens, it was concluded that the cost that is associated with implementation failure in immunization programmes is significant and unjust, and future directions for implementation research to optimize its application in practice settings have been recommended.

"They don't have the luxury of time": interviews exploring the determinants of public health research activity that contextualise embedded researcher roles in local government

BACKGROUND

Embedded researchers are a novel intervention to improve the translation of research evidence into policy and practice settings, including public health. These roles are being implemented with increasing popularity, but they often lack clear evaluative frameworks. Understanding initial levels of research activity, including associated barriers and opportunities, is essential to developing theories of change and thus shaping the roles and defining expectations. We aimed to identify the principal determinants of research activity in public health that contextualise embedded researcher roles, including attributes of the embedded researcher themselves.

METHODS

We undertook seventeen semi-structured interviews with embedded researchers in diverse public health settings in English local government. Interviews were analysed using thematic analysis.

RESULTS

We identified thirteen interlinked determinants of research activity within local government public health settings. Research and interpersonal skills, as well as pre-existing connections and knowledge within local government, were highly valued individual attributes for embedded researchers. Resource deficiencies (funding, time, and infrastructure) were primary barriers to research activity, whereas a strong local appetite for evidence informed decision making presented a valuable opportunity. However, there was inconsistencies across public health teams relating to perceptions of what constituted "research" and the resources that would be required.

CONCLUSIONS

Our results suggest that successful embedded researchers will have equally strong research and communication skills and should be offered mentorship and clear career progression pathways. Perceptions of research within local government are closely linked to resource deficiencies and senior endorsement. Embedded researchers could benefit from taking the time to develop locally contextualised knowledge of this research culture. Theories of change for embedded researchers should conceptualise the interconnections across individual, interpersonal, and organisational barriers and opportunities underlying local government research activity. Further research is needed to identify methods for exploring the influence of embedded researchers as well as to unpack the stages of research activity within local government and the associated behaviours.

Co-implementation: collaborative and concurrent approaches to advance embedded implementation in the health sciences

There is a global movement towards stakeholder engagement in healthcare research. This movement has been catalyzed by a need to create context relevant evidence of maximal utility to health service provision and policy. The concept of "co-implementation" has potential to inform and extend these discussions of partnership and to complement the growing literature on collaborative implementation. Attending to this concept may preempt conceptual confusion and provide opportunities for sustainable and context-responsive embedded research necessary for the strengthening of health systems. In this perspective article, I seek to advance the discussion of co-implementation through an examination of the concept and through consideration of it merits to the health sciences.

Connecting the science and practice of implementation - applying the lens of context to inform study design in implementation research

The saying "horses for courses" refers to the idea that different people and things possess different skills or qualities that are appropriate in different situations. In this paper, we apply the analogy of "horses for courses" to stimulate a debate about how and why we need to get better at selecting appropriate implementation research methods that take account of the context in which implementation occurs. To ensure that implementation research achieves its intended purpose of enhancing the uptake of research-informed evidence in policy and practice, we start from a position that implementation research should be explicitly connected to implementation practice. Building on our collective experience as implementation researchers, implementation practitioners (users of implementation research), implementation facilitators and implementation educators and subsequent deliberations with an international, inter-disciplinary group involved in practising and studying implementation, we present a discussion paper with practical suggestions that aim to inform more practice-relevant implementation research.

Strengthening Kampala's Urban Referral System for Maternal and Newborn Care Through Establishment of an Emergency Call and Dispatch Center

INTRODUCTION

Most pregnant women living in urban slum communities in Uganda deliver at public health centers that are not equipped to provide emergency obstetric and newborn care. When obstetric emergencies occur, pregnant women are referred to a higher-level facility and are responsible for arranging and paying for their own transport. The Kampala Slum Maternal Newborn (MaNe) project developed and tested an emergency call and ambulance dispatch center and a mobile application to request, deploy, and track ambulances. We describe the development of these 2 interventions and findings on the feasibility, acceptability, and sustainability of the interventions.

METHODS

MaNe conducted a mixed-method feasibility study that included an assessment of the acceptability and demand of the interventions. In-depth interviews (N=26) were conducted with facility proprietors, health providers, ambulance drivers, Kampala Capital City Authority officers, and community members to understand the successes and challenges of establishing the call center and developing the mobile application. Thematic content analysis was done. Quantitative data from the call center dispatch logs were analyzed descriptively to complement the qualitative findings.

FINDINGS

Between April 2020 and June 2021, 10,183 calls were made to the emergency call and dispatch center. Of these, 25% were related to maternal and newborn health emergencies and 14% were COVID-19 related. An ambulance was dispatched to transfer or evacuate a patient in 35% of the calls. Participants acknowledged that the call center and mobile application allowed for efficient communication, coordination, and information flow between health facilities. Supportive district leadership facilitated the establishment of the call center and has taken over the operating costs of the center.

CONCLUSION

The call center and referral application improved the coordination of drivers and ambulances and allowed facilities to prepare for and treat cases more efficiently.

Replacement of core team members on embedded implementation research teams: experiences from Latin America and the Caribbean

Objective

To understand how replacement of decision-makers (DMs) serving as principal investigators (PI) or co-PIs on research teams may affect the feasibility and value of embedded implementation research (EIR) used to improve health policies, programs, and services in Latin America and the Caribbean.

Methods

This was a descriptive qualitative study based on 39 semistructured interviews with 13 embedded research teams selected by financing agencies to explore team composition, interaction among members, and research results. Interviews were conducted at three points during the study period from September 2018 to November 2019; data were analyzed from 2020 to 2021.

Results

Research teams were found to be operating in one of three situations: (i) permanent core team (no change) with either active DM or inactive DM participation; (ii) replacement of DM-PI or co-PI that did not affect EIR research; and (iii) replacement of DM-PI that affected EIR.

Conclusions

To ensure EIR continuity and stability, research teams should include high-level DMs together with more technical staff performing essential implementation activities. This structure could improve collaboration among professional researchers and ensure greater embeddedness of EIR to strengthen the health system.

Relevance and quality of implementation research proposals to face the challenges of public health in Latin-America and the Caribbean

OBJECTIVES

To analyse the relevance and quality of the research proposals submitted to the 2016 call for proposals for the initiative Improving Programme Implementation through Embedded Research (iPIER-2016) to address current public health challenges in Latin America and the Caribbean.

METHODS

We performed a cross-sectional study using information from 108 research proposals using quantitative and qualitative methods. We used three frameworks to analyse the relevance of the proposals: The Global Burden of Disease, the WHO Health Systems Conceptual Framework and the Sustainable Development Goals proposed in 2015 by the United Nations. We performed an index to analyse the relevance and quality of the proposals.

RESULTS

Twenty seven percent of the proposals have very good relevance, one third of the proposals have quality flaws. This means their research questions are not related to implementation research or their methods are insufficient or inadequate to respond to the objective.

CONCLUSIONS

The response to this call is proof of health authorities' interest in research as a tool to improve the implementation of health programs in the region. However, proposals show important variations in terms of relevance and quality among countries and training health staff in programme implementation seems a central requirement.

Embedding Research on Implementation of Primary Health Care Systems Strengthening: A Commentary on Collaborative Experiences in Ethiopia, Ghana, and Mozambique

Achieving universal health care coverage requires the adoption of primary health care policies and delivery strategies that are evidence based. Although this has been confronted by manifold challenges, particularly in the health systems of sub-Saharan Africa, there are promising approaches for accomplishing this objective. Salient among these is embedding implementation research (i.e., the study of methods to promote the systematic uptake of evidence-based interventions (EBIs) into routine practice) into policy making and implementation processes. Since 2007, the African Health Initiative of the Doris Duke Charitable Foundation supported partnerships that strengthened primary health systems and policy implementation in 7 countries in sub-Saharan Africa using the embedded implementation research as a core strategy. This programmatic review and analysis aims to identify the core features and processes that characterized how the partnerships operationalized the embedded implementation research approach and understand the factors that helped and constrained partnerships' effective use of this approach. For this, we drew upon findings from a desk review that consisted of 30 examples of embedded implementation research conducted by 3 African Health Initiative partnerships between 2016 and 2021 in Ethiopia, Ghana, and Mozambique. In addition, we conducted and analyzed 13 in-depth interviews with embedded implementation research stakeholders of the 3 projects. Core features and processes of embedded implementation research were: (1) the leadership role of policy decision makers and implementation leaders; (2) positioning research with program implementation at multiple levels of health systems; (3) multidisciplinary and multisectoral partnerships; (4) focus on research capacity building; and (5) real-time feedback loops and knowledge translation. Factors influencing the effectiveness of the embedded implementation research experiences involved: (1) the implementation climate and leadership; (2) opportunities and capacities to circulate and absorb new information; and (3) stakeholders' baseline knowledge and embedded scientists' identification within their organizations.

Using Health Systems and Policy Research to Achieve Universal Health Coverage in Ghana

Ghana is positioned to become the first country in sub-Saharan Africa to implement universal health coverage based on nationwide expansion of geographic access through the Community-based Health Planning and Services initiative. This achievement is the outcome of 3 decades of implementation research that health authorities have used for guiding the development of its primary health care program. This implementation research process has comprised Ghana's official endorsement of the 1978 Alma Ata Declaration, leading to the institutionalization of evidence relevant to the strategic design of primary health care and national health insurance policies and services. Rather than relying solely upon the dissemination of project results, Ghana has embraced a continuous and systemic process of knowledge capture, curation, and utilization of evidence in expanding geographic access by a massive expansion in the number of community health service points that has taken decades. A multisectoral approach has been pursued that has involved the creation of systematic partnerships that included all levels of the political system, local development officials, community groups and social networks, multiple university-based disciplines, external development partners, and donors. However, efforts to achieve high levels of financial access through the roll-out of the National Health Insurance Scheme have proceeded at a less consistent pace and been fraught with many challenges. As a result, financial access has been less comprehensive than geographical access despite sequential reforms having been made to both programs. The legacy of activities and current research on primary health care and national health insurance are reviewed together with unaddressed priorities that merit attention in the future. Factors that have facilitated or impeded progress with research utilization are reviewed and implications for health systems strengthening in Ghana and elsewhere in Africa and globally are discussed.

Strategies to promote evidence use for health programme improvement: learning from the experiences of embedded implementation research teams in Latin America and the Caribbean

Background

To achieve global health targets, innovative approaches are needed to strengthen the implementation of efficacious interventions. New approaches in implementation research that bring together health system decision-makers alongside researchers to collaboratively design, produce and apply research evidence are gaining traction. Embedded implementation research (EIR) approaches led by decision-maker principal investigators (DM PIs) appear promising in this regard. Our aim is to describe the strategies study teams employ in the post-research phase of EIR to promote evidence-informed programme or policy improvement.

Methods

We conducted a prospective, comparative case study of an EIR initiative in Bolivia, Colombia and Dominican Republic. Guided by a conceptual framework on EIR, we used semi-structured key informant interviews (n = 51) and document reviews (n = 20) to examine three decision-maker-led study teams (“cases”). Focusing on three processes (communication/dissemination, stakeholder engagement with evidence, integrating evidence in decision-making) and the main outcome (enacting improvements), we used thematic analysis to identify associated strategies and enabling or hindering factors.

Results

Across cases, we observed diverse strategies, shaped substantially by whether the DM PI was positioned to lead the response to study findings within their sphere of work. We found two primary change pathways: (1) DM PIs implement remedial measures directly, and (2) DM PIs seek to influence other stakeholders to respond to study findings. Throughout the post-research phase, EIR teams adapted research use strategies based on the evolving context.

Conclusions

EIR led by well-positioned DM PIs can facilitate impactful research translation efforts. We draw lessons around the importance of (1) understanding DM PI positionality, (2) ongoing assessment of the evolving context and stakeholders and (3) iterative adaptation to dynamic, uncertain circumstances. Findings may guide EIR practitioners in planning and conducting fit-for-purpose and context-sensitive strategies to advance the use of evidence for programme improvement.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00834-1.

Developing organizational learning for scaling-up community-based primary health care in Ghana

INTRODUCTION

Achieving effective community-based primary health care requires evidence for guiding strategic decisions that must be made. However, research processes often limit data collection to particular organizational levels or disseminate results to specific audiences. Decision-making that emerges can fail to account for the contrasting perspectives and needs of managers at each organizational level. The Ghana Health Service (GHS) addressed this problem with a multilevel and sequential research and action approach that has provided two decades of implementation learning for guiding community-based primary health care development.

METHOD

The GHS implementation research initiatives progressed from (i) a participatory pilot investigation to (ii) an experimental trial of strategies that emerged to (iii) replication research for testing scale-up, culminating in (iv) evidence-based scale-up of a national community-based primary health care program. A reform process subsequently repeated this sequence in a manner that involved stakeholders at the community, sub-district, district, and regional levels of the system. The conduct, interpretation, and dissemination of results that emerged comprised a strategy for achieving systems learning by conducting investigations in phases in conjunction with bottom-up knowledge capture, lateral exchanges for fostering peer learning at each system level, and top-down processes for communicating results as policy. Continuous accumulation of qualitative data on stakeholder reactions to operations at each organizational level was conducted in conjunction with quantitative monitoring of field operations.

RESULTS

Implementation policies were enhanced by results associated with each phase. A quasi-experiment for testing the reform process showed that scale-up of community-based primary health care was accelerated, leading to improvements in childhood survival and reduced fertility.

CONCLUSION

Challenges to system learning were overcome despite severe resource constraints. The integration of knowledge generation with ongoing management processes institutionalized learning for achieving evidence-driven program action.

General orders for the embedded researcher: Moorings for a developing profession

Learning health systems increasingly welcome embedded researchers as stakeholders poised to inform evidence-based practice. While care systems are potentially familiar with the embedded researcher tools and techniques, care systems may less frequently consider embedded research as a vocation. This insensitivity potentially reduces embedded researchers merely to instruments, as opposed to professional partners in transdisciplinary research. This discussion outlines "general orders" for embedded researchers. The general orders outline embedded researchers' fundamental identity and guide conduct as a means to encourage a shared identity among embedded researchers and clarify embedded researchers' roles in learning health system teams. Students and embedded researchers newly engaging learning health systems may particularly benefit from this rudimentary order list.

Bugs in the Bed: Addressing the Contradictions of Embedded Science with Agile Implementation Research

Implementation research often fails to have its intended impact on what programs actually do. Embedding research within target organizational systems represents an effective response to this problem. However, contradictions associated with the approach often prevent its application. We present case studies of the application of embedded implementation research in Bangladesh, Ghana, and Tanzania where initiatives to strengthen community-based health systems were conducted using the embedded science model. In 2 of the cases, implementation research standards that are typically embraced without question were abandoned to ensure pursuit of embedded science. In the third example, statistical rigor was sustained, but this feature of the design was inconsistent with embedded science. In general, rigorous statistical designs employ units of observation that are inconsistent with organizational units that managers can control. Structural contradictions impede host institution ownership of research processes and utilization of results. Moreover, principles of scientific protocol leadership are inconsistent with managerial leadership. These and other embedded implementation science attributes are reviewed together with contradictions that challenged their pursuit in each case. Based on strategies that were effectively applied to offsetting challenges, a process of merging research with management is proposed that is derived from computer science. Known as "agile science," this paradigm combines scientific rigor with management decision making. This agile embedded research approach is designed to sustain scientific rigor while optimizing the integration of learning into managerial decision making.