How is implementation research applied to advance health in low-income and middle-income countries?

Adapting and testing measures of organizational context in primary care clinics in KwaZulu-Natal, South Africa

BACKGROUND

Implementation science frameworks situate intervention implementation and sustainment within the context of the implementing organization and system. Aspects of organizational context such as leadership have been defined and measured largely within US health care settings characterized by decentralization and individual autonomy. The relevance of these constructs in other settings may be limited by differences like collectivist orientation, resource constraints, and hierarchical power structures. We aimed to adapt measures of organizational context in South African primary care clinics.

METHODS

We convened a panel of South African experts in social science and HIV care delivery and presented implementation domains informed by existing frameworks and prior work in South Africa. Based on panel input, we selected contextual domains and adapted candidate items. We conducted cognitive interviews with 25 providers in KwaZulu-Natal Province to refine measures. We then conducted a cross-sectional survey of 16 clinics with 5-20 providers per clinic (N = 186). We assessed reliability using Cronbach's alpha and calculated interrater agreement (awg) and intraclass correlation coefficient (ICC) at the clinic level. Within clinics with moderate agreement, we calculated correlation of clinic-level measures with each other and with hypothesized predictors - staff continuity and infrastructure - and a clinical outcome, patient retention on antiretroviral therapy.

RESULTS

Panelists emphasized contextual factors; we therefore focused on elements of clinic leadership, stress, cohesion, and collective problem solving (critical consciousness). Cognitive interviews confirmed salience of the domains and improved item clarity. After excluding items related to leaders' coordination abilities due to missingness and low agreement, all other scales demonstrated individual-level reliability and at least moderate interrater agreement in most facilities. ICC was low for most leadership measures and moderate for others. Measures tended to correlate within facility, and higher stress was significantly correlated with lower staff continuity. Organizational context was generally more positively rated in facilities that showed consistent agreement.

CONCLUSIONS

As theorized, organizational context is important in understanding program implementation within the South African health system. Most adapted measures show good reliability at individual and clinic levels. Additional revision of existing frameworks to suit this context and further testing in high and low performing clinics is warranted.

Sexual and reproductive health implementation research in humanitarian contexts: a scoping review

BACKGROUND

Meeting the health needs of crisis-affected populations is a growing challenge, with 339 million people globally in need of humanitarian assistance in 2023. Given one in four people living in humanitarian contexts are women and girls of reproductive age, sexual and reproductive health care is considered as essential health service and minimum standard for humanitarian response. Despite growing calls for increased investment in implementation research in humanitarian settings, guidance on appropriate methods and analytical frameworks is limited.

METHODS

A scoping review was conducted to examine the extent to which implementation research frameworks have been used to evaluate sexual and reproductive health interventions in humanitarian settings. Peer-reviewed papers published from 2013 to 2022 were identified through relevant systematic reviews and a literature search of Pubmed, Embase, PsycInfo, CINAHL and Global Health databases. Papers that presented primary quantitative or qualitative data pertaining to a sexual and reproductive health intervention in a humanitarian setting were included.

RESULTS

Seven thousand thirty-six unique records were screened for inclusion, and 69 papers met inclusion criteria. Of these, six papers explicitly described the use of an implementation research framework, three citing use of the Consolidated Framework for Implementation Research. Three additional papers referenced other types of frameworks used in their evaluation. Factors cited across all included studies as helping the intervention in their presence or hindering in their absence were synthesized into the following Consolidated Framework for Implementation Research domains: Characteristics of Systems, Outer Setting, Inner Setting, Characteristics of Individuals, Intervention Characteristics, and Process.

CONCLUSION

This review found a wide range of methodologies and only six of 69 studies using an implementation research framework, highlighting an opportunity for standardization to better inform the evidence for and delivery of sexual and reproductive health interventions in humanitarian settings. Increased use of implementation research frameworks such as a modified Consolidated Framework for Implementation Research could work toward both expanding the evidence base and increasing standardization. Three hundred thirty-nine million people globally were in need of humanitarian assistance in 2023, and meeting the health needs of crisis-affected populations is a growing challenge. One in four people living in humanitarian contexts are women and girls of reproductive age, and provision of sexual and reproductive health care is considered to be essential within a humanitarian response. Implementation research can help to better understand how real-world contexts affect health improvement efforts. Despite growing calls for increased investment in implementation research in humanitarian settings, guidance on how best to do so is limited. This scoping review was conducted to examine the extent to which implementation research frameworks have been used to evaluate sexual and reproductive health interventions in humanitarian settings. Of 69 papers that met inclusion criteria for the review, six of them explicitly described the use of an implementation research framework. Three used the Consolidated Framework for Implementation Research, a theory-based framework that can guide implementation research. Three additional papers referenced other types of frameworks used in their evaluation. This review summarizes how factors relevant to different aspects of implementation within the included papers could have been organized using the Consolidated Framework for Implementation Research. The findings from this review highlight an opportunity for standardization to better inform the evidence for and delivery of sexual and reproductive health interventions in humanitarian settings. Increased use of implementation research frameworks such as a modified Consolidated Framework for Implementation Research could work toward both expanding the evidence base and increasing standardization.

Assessing quality of critical care during an ongoing health emergency-a novel approach to evaluate quality of care at Lebanese public ICUs during COVID-19

BACKGROUND

Quality of care has been systematically monitored in hospitals in high-income countries to ensure adequate care. However, in low- and middle-income countries, quality indicators are not readily measured. The primary aim of this study was to assess to what extent it was feasible to monitor the quality of intensive care in an ongoing health emergency, and the secondary aim was to assess a quality of care intervention (twinning project) focused on Intensive Care Unit (ICU) quality of care in public hospitals in Lebanon.

METHODS

We conducted a retrospective cohort study nested within an intervention implemented by the World Health Organization (WHO) together with partners. To assess the quality of care throughout the project, a monitoring system framed in the Donabedian model and included structure, process, and outcome indicators was developed and implemented. Data collection consisted of a checklist performed by external healthcare workers (HCWs) as well as collection of data from all admitted patients performed by each unit. The association between the number of activities within the interventional project and ICU mortality was evaluated.

RESULTS

A total of 1679 patients were admitted to five COVID-19 ICUs during the study period. The project was conducted fully across four out of five hospitals. In these hospitals, a significant reduction in ICU mortality was found (OR: 0.83, P < 0.05, CI: 0.72-0.96).

CONCLUSION

We present a feasible way to assess quality of care in ICUs and how it can be used in assessing a quality improvement project during ongoing crises in resource-limited settings. By implementing a quality of care intervention in Lebanon's public hospitals, we have shown that such initiatives might contribute to improvement of ICU care. The observed association between increased numbers of project activities and reduced ICU mortality underscores the potential of quality assurance interventions to improve outcomes for critically ill patients in resource-limited settings. Future research is needed to expand this model to be applicable in similar settings.

Quality improvement in public-private partnerships in low- and middle-income countries: a systematic review

BACKGROUND

Public-private partnerships (PPP) are often how health improvement programs are implemented in low-and-middle-income countries (LMICs). We therefore aimed to systematically review the literature about the aim and impacts of quality improvement (QI) approaches in PPP in LMICs.

METHODS

We searched SCOPUS and grey literature for studies published before March 2022. One reviewer screened abstracts and full-text studies for inclusion. The study characteristics, setting, design, outcomes, and lessons learned were abstracted using a standard tool and reviewed in detail by a second author.

RESULTS

We identified 9,457 citations, of which 144 met the inclusion criteria and underwent full-text abstraction. We identified five key themes for successful QI projects in LMICs: 1) leadership support and alignment with overarching priorities, 2) local ownership and engagement of frontline teams, 3) shared authentic learning across teams, 4) resilience in managing external challenges, and 5) robust data and data visualization to track progress. We found great heterogeneity in QI tools, study designs, participants, and outcome measures. Most studies had diffuse aims and poor descriptions of the intervention components and their follow-up. Few papers formally reported on actual deployment of private-sector capital, and either provided insufficient information or did not follow the formal PPP model, which involves capital investment for a explicit return on investment. Few studies discussed the response to their findings and the organizational willingness to change.

CONCLUSIONS

Many of the same factors that impact the success of QI in healthcare in high-income countries are relevant for PPP in LMICs. Vague descriptions of the structure and financial arrangements of the PPPs, and the roles of public and private entities made it difficult to draw meaningful conclusions about the impacts of the organizational governance on the outcomes of QI programs in LMICs. While we found many articles in the published literature on PPP-funded QI partnerships in LMICs, there is a dire need for research that more clearly describes the intervention details, implementation challenges, contextual factors, leadership and organizational structures. These details are needed to better align incentives to support the kinds of collaboration needed for guiding accountability in advancing global health. More ownership and power needs to be shifted to local leaders and researchers to improve research equity and sustainability.

Reducing the equity gap in under-5 mortality through an innovative community health program in Ethiopia: an implementation research study

BACKGROUND

The Ethiopian government implemented a national community health program, the Health Extension Program (HEP), to provide community-based health services to address persisting access-related barriers to care using health extension workers (HEWs). We used implementation research to understand how Ethiopia leveraged the HEP to widely implement evidence-based interventions (EBIs) known to reduce under-5 mortality (U5M) and address health inequities.

METHODS

This study was part of a six-country case study series using implementation research to understand how countries implemented EBIs between 2000-2015. Our mixed-methods research was informed by a hybrid implementation science framework using desk review of published and gray literature, analysis of existing data sources, and 11 key informant interviews. We used implementation of pneumococcal conjugate vaccine (PCV-10) and integrated community case management (iCCM) to illustrate Ethiopia's ability to rapidly integrate interventions into existing systems at a national level through leveraging the HEP and other implementation strategies and contextual factors which influenced implementation outcomes.

RESULTS

Ethiopia implemented numerous EBIs known to address leading causes of U5M, leveraging the HEP as a platform for delivery to successfully introduce and scale new EBIs nationally. By 2014/15, estimated coverage of three doses of PCV-10 was at 76%, with high acceptability (nearly 100%) of vaccines in the community. Between 2000 and 2015, we found evidence of improved care-seeking; coverage of oral rehydration solution for treatment of diarrhea, a service included in iCCM, doubled over this period. HEWs made health services more accessible to rural and pastoralist communities, which account for over 80% of the population, with previously low access, a contextual factor that had been a barrier to high coverage of interventions.

CONCLUSIONS

Leveraging the HEP as a platform for service delivery allowed Ethiopia to successfully introduce and scale existing and new EBIs nationally, improving feasibility and reach of introduction and scale-up of interventions. Additional efforts are required to reduce the equity gap in coverage of EBIs including PCV-10 and iCCM among pastoralist and rural communities. As other countries continue to work towards reducing U5M, Ethiopia's experience provides important lessons in effectively delivering key EBIs in the presence of challenging contextual factors.

Understanding rapid implementation from discovery to scale: Rwanda's implementation of rotavirus vaccines and PMTCT in the quest to reduce under-5 mortality

BACKGROUND

Over the last eight decades, many evidence-based interventions (EBIs) have been developed to reduce amenable under-5 mortality (U5M). Implementation research can help reduce the lag between discovery and delivery, including as new EBIs emerge, or as existing ones are adapted based on new research. Rwanda was the first low-income African country to implement the rotavirus vaccine (RTV) and also adopted Option B+ for effective prevention of mother-to-child transmission (PMTCT) before the World Health Organization's (WHO) recommendation. We use implementation research to identify contextual factors and strategies associated with Rwanda's rapid uptake of these two EBIs developed or adapted during the study period.

METHODS

We conducted a mixed methods case study informed by a hybrid implementation research framework to understand how Rwanda outperformed regional and economic peers in reducing U5M, focusing on the implementation of health system-delivered EBIs. The research included review of existing literature and data, and key informant interviews to identify implementation strategies and contextual factors that influenced implementation outcomes. We extracted relevant results from the broader case study and used convergent methods to understand successes and challenges of implementation of RTV, a newly introduced EBI, and PMTCT, an adapted EBI reflecting new research.

RESULTS

We found several cross-cutting strategies that supported the rapid uptake and implementation of PMTCT, RTV, and leveraging facilitating contextual factors and identifying and addressing challenging ones. Key implementation strategies included community and stakeholder involvement and education, leveraging of in-country research capacity to drive adoption and adaptation, coordination of donors and implementing partners, data audit and feedback of coverage, a focus on equity, and integration into pre-existing systems, including community health workers and primary care. The availability of donor funding, culture of evidence-based decision-making, preexisting accountability systems, and rapid adoption of innovation were facilitating contextual factors.

CONCLUSION

Implementation strategies which are generalizable to other settings were key to success in rapidly achieving high acceptability and coverage of both a new and an evolving EBI. Choosing strategies which leverage their facilitating factors and address barriers are important for other countries working to accelerate uptake of new EBIs and implement needed adaptations based on emerging evidence.

Process evaluation of a parent-child communication intervention for adolescent sexual and reproductive health in Uganda

BACKGROUND

Previous initiatives concerning adolescent sexual and reproductive health (SRH) education in Low-or-Middle Income Countries (LMICs) have been limited by cultural norms and misinformation perpetuated within families. Responding to the paucity of research on the implementation of SRH interventions in LMICs and limited knowledge regarding their mechanisms, this study undertakes a process evaluation of a parent-focused intervention to promote parent-adolescent communication about SRH in Uganda.

METHODS

This paper explores the implementation, contextual factors and mechanisms of impact of the intervention, using the Medical Research Council (MRC) guidelines for process evaluations. Implementation was evaluated through indicators of dose, fidelity and adaptations, acceptability and feasibility. The contextual factors and mechanisms of impact were evaluated to refine the intervention's causal assumptions. Data was collected during April - October 2021 in South-Western Uganda using a mixed-methods approach, including document analysis, intervention observations, interviews, focus group discussions and most significant change stories.

RESULTS

The acceptability of the intervention was related to its community engagement, the strong rapport with delivery agents, and individual characteristics of participants. Five contextual factors influencing implementation were highlighted; (i) cultural norms, (ii) perceptions about youth SRH, (iii) poverty, (iv) Covid-19 pandemic, and (v) prior research projects in the community. When considering the intervention's mechanisms of impact, four causal pathways were identified; (i) Awareness of SRH needs helped parents overcome stigma, (ii) Parenting skills training improved SRH communication, (iii) Group learning stimulated shared parenting, and (iv) Group learning improved co-parenting.

CONCLUSION

The paper presented three key learnings and corresponding recommendations for future research. Firstly, implementation success was credited to meaningful community engagement which improved acceptability and uptake. Secondly, the complex influences of contextual factors highlighted the need for contextual analysis in research studies to inform intervention design. Finally, this evaluation recognised the interplay between mechanisms of impact and suggested further research consider such combined impacts when designing intervention content.

Scaling a group intervention to promote caregiver mental health in Uttarakhand, India: A mixed-methods implementation study

Caregivers are integral to health and social care systems in South Asian countries yet are themselves at higher risk of mental illness. Interventions to support caregiver mental health developed in high-income contexts may be contextually inappropriate in the Global South. In this mixed-methods study, we evaluated the implementation and scaling of a locally developed mental health group intervention for caregivers and others in Uttarakhand, India. We describe factors influencing implementation using the updated Consolidated Framework for Implementation Research, and selected implementation outcomes. Key influencing factors we found in common with other programs included: an intervention that was relevant and adaptable; family support and stigma operating in the outer setting; training and support for lay health worker providers, shared goals, and relationships with the community and the process of engaging with organisational leaders and service users within the inner setting. We identified further factors including the group delivery format, competing responsibilities for caregivers and opportunities associated with the partnership delivery model as influencing outcomes. Implementation successfully reached target communities however attrition of 20% of participants highlights the potential for improving outcomes by harnessing enablers and addressing barriers. Findings will inform others implementing group mental health and caregiver interventions in South Asia.

Implementation matters: assessing the effectiveness and sustainment of an obstetric triage program at a high-volume facility in Ghana

BACKGROUND

Maternal mortality remains stubbornly high in Ghana. Current national efforts are focused on improving the quality of care offered in health facilities. Obstetric triage is one intervention that has been proposed to improve the timeliness and appropriateness of care, two key elements of quality. In this study, we describe and evaluate a theory-based implementation approach to introduce obstetric triage into Tema General Hospital, a high-volume maternity hospital in Greater Accra, that blends concepts from implementation science and quality improvement. This implementation project was a first attempt to scale this intervention into a new facility, following initial development in the Greater Accra Regional Hospital (formerly Ridge Hospital) in Accra.

METHODS

This was a retrospective mixed-methods evaluation of two stages of implementation: active implementation and sustainment. We triangulated monitoring data captured during active implementation with clinical outcome data (timeliness of first assessment, accuracy of diagnosis, and appropriateness of care plan) from direct observation or patient obstetric triage assessment forms at baseline, at the completion of the active implementation stage, and following a 12-month "washout" period with no contact between hospital staff and the purveyor organization. Finally, we assessed embeddedness of the new triage procedures using the NoMad, a quantitative assessment of constructs from normalization process theory (NPT).

RESULTS

Patient waiting time decreased substantially during the study. At baseline, the median arrival-to-assessment waiting time was 70.5 min (IQR: 30.0-443.0 min). Waiting time decreased to 6.0 min (IQR: 3.0-15.0 min) following active implementation and to 5.0 min (IQR: 2.0-10.0 min) during the sustainment period. Accuracy of diagnosis was high at the end of active implementation (75.7% correct) and improved during the sustainment period (to 77.9%). The appropriateness of care plans also improved during the sustainment period (from 66.0 to 78.9%). Per NoMad data, hospital staff generally perceive obstetric triage to be well integrated into the facility.

CONCLUSIONS

This theory-based implementation approach proved to be successful in introducing a novel obstetric triage concept to a busy high-volume hospital, despite resource constraints and a short implementation window. Results proved long-lasting, suggesting this approach has high potential for engendering sustainability in other facilities as well. Our approach will be useful to other initiatives that aim to utilize program data to create and test implementation theories.

Reduction in mortality from HIV-related CNS infections in routine care in Africa (DREAMM): a before-and-after, implementation study

BACKGROUND

Four decades into the HIV epidemic, CNS infection remains a leading cause of preventable HIV-related deaths in routine care. The Driving Reduced AIDS-associated Meningo-encephalitis Mortality (DREAMM) project aimed to develop, implement, and evaluate pragmatic implementation interventions and strategies to reduce mortality from HIV-related CNS infection.

METHODS

DREAMM took place in five public hospitals in Cameroon, Malawi, and Tanzania. The main intervention was a stepwise algorithm for HIV-related CNS infections including bedside rapid diagnostic testing and implementation of WHO cryptococcal meningitis guidelines. A health system strengthening approach for hospitals was adopted to deliver quality care through a co-designed education programme, optimised clinical and laboratory pathways, and communities of practice. DREAMM was led and driven by local leadership and divided into three phases: observation (including situational analyses of routine care), training, and implementation. Consecutive adults (aged ≥18 years) living with HIV presenting with a first episode of suspected CNS infection were eligible for recruitment. The primary endpoint was the comparison of 2-week all-cause mortality between observation and implementation phases. This study completed follow-up in September, 2021. The project was registered on ClinicalTrials.gov, NCT03226379.

FINDINGS

From November, 2016 to April, 2019, 139 eligible participants were enrolled in the observation phase. From Jan 9, 2018, to March 25, 2021, 362 participants were enrolled into the implementation phase. 216 (76%) of 286 participants had advanced HIV disease (209 participants had missing CD4 cell count), and 340 (69%) of 494 participants had exposure to antiretroviral therapy (ART; one participant had missing ART data). In the implementation phase 269 (76%) of 356 participants had a probable CNS infection, 203 (76%) of whom received a confirmed microbiological or radiological diagnosis of CNS infection using existing diagnostic tests and medicines. 63 (49%) of 129 participants died at 2 weeks in the observation phase compared with 63 (24%) of 266 in the implementation phase; and all-cause mortality was lower in the implementation phase when adjusted for site, sex, age, ART exposure (adjusted risk difference -23%, 95% CI -33 to -13; p<0·001). At 10 weeks, 71 (55%) died in the observation phase compared with 103 (39%) in the implementation phase (-13%, -24 to -3; p=0·01).

INTERPRETATION

DREAMM substantially reduced mortality from HIV-associated CNS infection in resource-limited settings in Africa. DREAMM scale-up is urgently required to reduce deaths in public hospitals and help meet Sustainable Development Goals.

FUNDING

European and Developing Countries Clinical Trials Partnership, French Agency for Research on AIDS and Viral Hepatitis.

TRANSLATIONS

For the French and Portuguese translations of the abstract see Supplementary Materials section.

Measurement of and training for NCD guideline implementation in LMICs: a scoping review protocol

INTRODUCTION

Globally, non-communicable diseases (NCDs) are the leading causes of morbidity and mortality with an estimated 41 million deaths (74% of all global deaths) annually. Despite the WHO's Global Action Plan for the Prevention and Control of NCDs since 2013, progress on implementation of the guidelines has been slow. Although research has shown success of some NCD prevention and treatment interventions, there is a dearth of research on NCD care delivery approaches, cost-effectiveness and larger implementation research, especially in low/middle-income countries (LMICs). The objective of this scoping review is to identify the existing variation in how, why and by whom implementation of NCD guidelines is measured as part of implementation research or non-research programme improvement.

METHODS AND ANALYSIS

Using the methods established by Arksey and O'Malley, the search strategy was developed in consultation with a research librarian together with stakeholder feedback from content experts. We will apply the search to multiple electronic databases and grey literature sources. Two reviewers will independently screen title and abstract for inclusion followed by a full-text screening and all included records will be abstracted using a standardised tool that will be piloted with a sample of articles before application to all records. We will conduct a narrative synthesis of abstracted data and simple quantitative descriptive statistics.

DISSEMINATION

The results will enable stakeholders in LMICs to leverage existing tools and resources for implementation and ongoing evaluation of NCD guidelines, to improve education and capacity building, and ultimately NCD care across the lifespan.

A new measure for multi-professional medical team communication: design and methodology for multilingual measurement development

Background

As implementation science in global health continues to evolve, there is a need for valid and reliable measures that consider diverse linguistic and cultural contexts. A standardized, reproducible process for multilingual measure development may improve accessibility and validity by participants in global health settings. To address this need, we propose a rigorous methodology for multilingual measurement development. We use the example of a novel measure of multi-professional team communication quality, a determinant of implementation efforts.

Methods

The development and translation of this novel bilingual measure is comprised of seven steps. In this paper, we describe a measure developed in English and Spanish, however, this approach is not language specific. Participants are engaged throughout the process: first, an interprofessional panel of experts and second, through cognitive interviewing for measure refinement. The steps of measure development included: (1) literature review to identify previous measures of team communication; (2) development of an initial measure by the expert panel; (3) cognitive interviewing in a phased approach with the first language (English); (4): formal, forward-backward translation process with attention to colloquialisms and regional differences in languages; (5) cognitive interviewing repeated in the second language (Spanish); (6) language synthesis to refine both instruments and unify feedback; and (7) final review of the refined measure by the expert panel.

Results

A draft measure to assess quality of multi-professional team communication was developed in Spanish and English, consisting of 52 questions in 7 domains. This measure is now ready for psychometric testing.

Conclusions

This seven-step, rigorous process of multilingual measure development can be used in a variety of linguistic and resource settings. This method ensures development of valid and reliable tools to collect data from a wide range of participants, including those who have historically been excluded due to language barriers. Use of this method will increase both rigor and accessibility of measurement in implementation science and advance equity in research and practice.

Reducing inequities in maternal and child health in rural Guatemala through the CBIO+ approach of Curamericas: 2. Study site, design, and methods

BACKGROUND

The Curamericas/Guatemala Maternal and Child Health Project, 2011-2015, included implementation research designed to assess the effectiveness of an approach referred to as CBIO+ , composed of: (1) the Census-Based, Impact-Oriented (CBIO) Approach, (2) the Care Group Approach, and (3) the Community Birthing Center Approach. This is the second paper in a supplement of 10 articles describing the implementation research and its findings. Paper 1 describes CBIO+ , the Project Area, and how the Project was implemented.

OBJECTIVE

This paper describes the implementation research design and details of how it was carried out.

METHODS

We reviewed the original implementation research protocol and the methods used for all data collection related to this Project. The protocol and methods used for the implementation research related to this Project were all standard approaches to the monitoring and evaluation of child survival projects as developed by the United States Agency for International Development Child Survival and Health Grants Program (CSHGP) and the CORE Group. They underwent independent peer review supervised by the CSHGP before the implementation research began.

RESULTS

The study area was divided into two sets of communities with a total population of 98,000 people. Project interventions were implemented in Area A from 2011 until the end of the project in 2015 (44 months) and in Area B from late 2013 until 2015 (20 months). Thus, Area B served as a quasi-comparison area during the first two years of Project implementation. The overarching study question was whether the CBIO+ Approach improved the health and well-being of children and mothers. The outcome indicators included (1) changes in population coverage of evidence-based interventions, (2) changes in childhood nutritional status, (3) changes in the mortality of children and mothers, (4) quality of care provided at Community Birthing Centers, (5) the impact of the Project on women's empowerment and social capital, (6) stakeholder assessment of the effectiveness of the CBIO+ Approach, and (7) the potential of wider adoption of the CBIO+ Approach.

CONCLUSION

The implementation research protocol guided the assessment of the effectiveness of the CBIO+ Approach in improving the health and well-being of children, mothers, and their communities.

Addressing the Gap in Research Methodologies Education in Pediatric Oncology in the Eastern Mediterranean Region

PURPOSE

Formal training in clinical research methodologies is limited in limited-resource countries. Through collaboration among high- and middle-resource settings and in response to an identified need verbalized by regional pediatric oncology practitioners, Pediatric Oncology East & Mediterranean Group and St Jude Global developed a workshop focused on capacity building in research skills. Here, we describe its structure, implementation, and early results.

METHODS

Leveraging virtual capabilities, the format included lectures and small group breakout exercise sessions, for 3 hours per day on 2 consecutive days per week for 2 consecutive weeks. Topics included basics of study design, introduction to health care statistics, research ethics, data registries, and scientific writing. Applicants were required to submit an abstract for a potential research project. Each breakout group selected one abstract for further development and presented the final version in a groupwide session. The participants' experience was evaluated through an online survey.

RESULTS

Attendance included 29 registrants from 12 countries and six disciplines. Each breakout group was assigned a themed category: cohort studies, clinical trials, or registries. Critical feedback from the breakout sessions helped strengthen the selected projects, which included a retrospective study, a prospective observational study, a prospective interventional study, and a registry proposal. After the workshop, participants were invited to further develop their original abstracts, and three proposals received additional mentoring, one of which was a multi-institutional prospective study that was subsequently submitted through the Pediatric Oncology East & Mediterranean Group network for implementation. The postworkshop survey revealed an overall highly positive experience, and feedback provided potential themes for future workshops.

CONCLUSION

This workshop demonstrated the potential for collaborative network partnerships in targeting research training gaps in pediatric oncology. Lessons learned will be applied to future workshops to strengthen research in limited-resource settings.

Collaboration between health system decision makers and professional researchers to coproduce knowledge, a scoping review

BACKGROUND

Recent literature uses different terms and approaches to the collaboration between researchers and health system decision-makers in the research process. In 2012, the World Health Organisation proposed to "Embed research within decision-making processes". Yet, important contributions use other terms and perspectives for the same issue. This scoping review aimed to identify these terms, approaches, their application and eventual influence on the utilization of evidence.

METHODS

We searched papers published between January 2000 and February 2019 in English, Spanish, French and Portuguese in the databases of PubMed, Scielo, Google Scholar and EBSCOhost, thus accessing MedicLatina, MEDLINE Complete and eBook Collection. Our main inclusion criterion was the participation of health personnel in non-clinical research activities. We considered three domains for in depth analysis: Definition, name and description of the participation of decision makers and health staff; Forms of collaboration and actual/effective participation of health staff in research; Eventual influence on the utilization of research results.

RESULTS

We identified 607 articles and selected 74 for full text analysis. Nineteen different terms are currently used in twelve countries to describe the participation of health decision-makers and staff in research activities. Most publications refer to Integrated Knowledge Translation or Embedded Research, and were published in Canada and the United Kingdom. Forty-five papers discuss the participation of health staff in research activities; 20 leading the whole process and 21 as collaborators.

CONCLUSIONS

The identification of the different terms and approaches to the close collaboration of health staff and decision-makers with professional researchers is essential to promote its effective application and influence on the utilization of evidence. Yet, it is also necessary to insist in their co-participation throughout the whole investigation process as a relevant way to improve research results uptake, strengthen health systems and advance towards universal health coverage.

Health system strengthening using a Maximizing Engagement for Readiness and Impact (MERI) Approach: A community case study

Introduction

Health system strengthening initiatives in low and middle-income countries are commonly hampered by limited implementation readiness. The Maximizing Engagement for Readiness and Impact (MERI) Approach uses a system "readiness" theory of change to address implementation obstacles. MERI is documented based on field experiences, incorporating best practices, and lessons learned from two decades of maternal, newborn, and child health (MNCH) programming in East Africa.

Context

The MERI Approach is informed by four sequential and progressively larger MNCH interventions in Uganda and Tanzania. Intervention evaluations incorporating qualitative and quantitative data sources assessed health and process outcomes. Implementer, technical leader, stakeholder, and policymaker reflections on sequential experiences have enabled MERI Approach adaptation and documentation, using an implementation lens and an implementation science readiness theory of change.

Key programmatic elements

The MERI Approach comprises three core components. MERI Change Strategies (meetings, equipping, training, mentoring) describe key activity types that build general and intervention-specific capacity to maximize and sustain intervention effectiveness. The SOPETAR Process Model (Scan, Orient, Plan, Equip, Train, Act, Reflect) is a series of purposeful steps that, in sequence, drive each implementation level (district, health facility, community). A MERI Motivational Framework identifies foundational factors (self-reliance, collective-action, embeddedness, comprehensiveness, transparency) that motivate participants and enhance intervention adoption. Components aim to enhance implementer and system readiness while engaging broad stakeholders in capacity building activities toward health outcome goals. Activities align with government policy and programming and are embedded within existing district, health facility, and community structures.

Discussion

This case study demonstrates feasibility of the MERI Approach to support district wide MNCH programming in two low-income countries, supportive of health outcome and health system improvements. The MERI Approach has potential to engage districts, health facilities, and communities toward sustainable health outcomes, addressing intervention implementation gaps for current and emerging health needs within and beyond East Africa.

Design and feasibility of an implementation strategy to address Chagas guidelines engagement focused on attending women of childbearing age and children at the primary healthcare level in Argentina: a pilot study

Background

Chagas is a public health problem, especially in Latin America, exacerbated by migratory movements and increasing urbanization. Argentina is among the countries with the highest estimated prevalence in the region, with 1,500,000 people infected, with mother to child as the main mode of transmission. Vertical transmission has been significantly reduced by treating women of childbearing age; several guidelines in the region recommend treatment as a primary prevention strategy for the child and a secondary prevention strategy for women and their families. Despite recommendations, women of childbearing age are not always treated, and children do not receive timely diagnosis and treatment. The objective of this research was to design an implementation strategy to improve using Chagas guidelines focused on attending women of childbearing age and children at the primary healthcare level and pilot it in three primary health care centers in Argentina.

Methods

We conducted a pilot feasibility study using the Consolidated Framework for Implementation Research. A qualitative process evaluation was conducted using semi-structured interviews with health care providers and observations in primary health care centers.

Results

We developed a multifaceted implementation strategy including training, flowcharts and reminders, a register of suspected and confirmed cases, and the selection of a management facilitator. The pilot study took place between September 2019 and May 2020. The implementation level was heterogeneous and varied depending on the components, being the facilitating factors, the simplicity of the intervention, professionals’ willingness to expand the indication of serologic tests, and staff commitment to the adoption of intervention components. The main barriers found were the change of authorities at the local level, some professionals´ reluctance to administer etiological treatment, staff shortages, lack of diagnostic supplies, and the health emergency caused by the COVID-19 pandemic.

Conclusions

Behavioral change strategies should be applied to improve implementation to address some of the main barriers, including support actions offered by opinion leaders, medical experts, and local health authorities. Rapid diagnostic tests should be readily available to maintain behavior changes. We suggest further refinement of the strategy and its implementation in more centers to assess outcomes prospectively with a hybrid implementation research design.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12875-022-01886-6.

Improving quality of surgical and anaesthesia care in sub-Saharan Africa: a systematic review of hospital-based quality improvement interventions

OBJECTIVES

To systematically review existing literature on hospital-based quality improvement studies in sub-Saharan Africa that aim to improve surgical and anaesthesia care, capturing clinical, process and implementation outcomes in order to evaluate the impact of the intervention and implementation learning.

DESIGN

We conducted a systematic literature review and narrative synthesis.

SETTING

Literature on hospital-based quality improvement studies in sub-Saharan Africa reviewed until 31 December 2021.

PARTICIPANTS

MEDLINE, EMBASE, Global Health, CINAHL, Web of Science databases and grey literature were searched.

INTERVENTION

We extracted data on intervention characteristics and how the intervention was delivered and evaluated.

PRIMARY AND SECONDARY OUTCOME MEASURES

Importantly, we assessed whether clinical, process and implementation outcomes were collected and separately categorised the outcomes under the Institute of Medicine quality domains. Risk of bias was not assessed.

RESULTS

Of 1573 articles identified, 49 were included from 17/48 sub-Saharan African countries, 16 of which were low-income or lower middle-income countries. Almost two-thirds of the studies took place in East Africa (31/49, 63.2%). The most common intervention focus was reduction of surgical site infection (12/49, 24.5%) and use of a surgical safety checklist (14/49, 28.6%). Use of implementation and quality improvement science methods were rare. Over half the studies measured clinical outcomes (29/49, 59.2%), with the most commonly reported ones being perioperative mortality (13/29, 44.8%) and surgical site infection rate (14/29, 48.3%). Process and implementation outcomes were reported in over two thirds of the studies (34/49, 69.4% and 35, 71.4%, respectively). The most studied quality domain was safety (44/49, 89.8%), with efficiency (4/49, 8.2%) and equitability (2/49, 4.1%) the least studied domains.

CONCLUSIONS

There are few hospital-based studies that focus on improving the quality of surgical and anaesthesia care in sub-Saharan Africa. Use of implementation and quality improvement methodologies remain low, and some quality domains are neglected.

PROSPERO REGISTRATION NUMBER

CRD42019125570.

Healthy cities initiative in China: Progress, challenges, and the way forward

China implemented the first phase of its National Healthy Cities pilot program from 2016-20. Along with related urban health governmental initiatives, the program has helped put health on the agenda of local governments while raising public awareness. Healthy City actions taken at the municipal scale also prepared cities to deal with the COVID-19 pandemic. However, after intermittent trials spanning the past two decades, the Healthy Cities initiative in China has reached a crucial juncture. It risks becoming inconsequential given its overlap with other health promotion efforts, changing public health priorities in response to the pandemic, and the partial adoption of the Healthy Cities approach advanced by the World Health Organization (WHO). We recommend aligning the Healthy Cities initiative in China with strategic national and global level agendas such as Healthy China 2030 and the Sustainable Development Goals (SDGs) by providing an integrative governance framework to facilitate a coherent intersectoral program to systemically improve population health. Achieving this alignment will require leveraging the full spectrum of best practices in Healthy Cities actions and expanding assessment efforts.

FUNDING

Tsinghua-Toyota Joint Research Fund "Healthy city systems for smart cities" program.

Embedding Research on Implementation of Primary Health Care Systems Strengthening: A Commentary on Collaborative Experiences in Ethiopia, Ghana, and Mozambique

Achieving universal health care coverage requires the adoption of primary health care policies and delivery strategies that are evidence based. Although this has been confronted by manifold challenges, particularly in the health systems of sub-Saharan Africa, there are promising approaches for accomplishing this objective. Salient among these is embedding implementation research (i.e., the study of methods to promote the systematic uptake of evidence-based interventions (EBIs) into routine practice) into policy making and implementation processes. Since 2007, the African Health Initiative of the Doris Duke Charitable Foundation supported partnerships that strengthened primary health systems and policy implementation in 7 countries in sub-Saharan Africa using the embedded implementation research as a core strategy. This programmatic review and analysis aims to identify the core features and processes that characterized how the partnerships operationalized the embedded implementation research approach and understand the factors that helped and constrained partnerships' effective use of this approach. For this, we drew upon findings from a desk review that consisted of 30 examples of embedded implementation research conducted by 3 African Health Initiative partnerships between 2016 and 2021 in Ethiopia, Ghana, and Mozambique. In addition, we conducted and analyzed 13 in-depth interviews with embedded implementation research stakeholders of the 3 projects. Core features and processes of embedded implementation research were: (1) the leadership role of policy decision makers and implementation leaders; (2) positioning research with program implementation at multiple levels of health systems; (3) multidisciplinary and multisectoral partnerships; (4) focus on research capacity building; and (5) real-time feedback loops and knowledge translation. Factors influencing the effectiveness of the embedded implementation research experiences involved: (1) the implementation climate and leadership; (2) opportunities and capacities to circulate and absorb new information; and (3) stakeholders' baseline knowledge and embedded scientists' identification within their organizations.

Understanding maternity waiting home uptake and scale-up within low-income and middle-income countries: a programme theory from a realist review and synthesis

Introduction

Maternity waiting homes (MWHs) link pregnant women to skilled birth attendance at health facilities. Research suggests that some MWH-facility birth interventions are more success at meeting the needs and expectations of their intended users than others. We aimed to develop theory regarding what resources work to support uptake and scale-up of MHW-facility birth interventions, how, for whom, in what contexts and why.

Methods

A four-step realist review was conducted which included development of an initial programme theory; searches for evidence; selection, appraisal and extraction of data; and analysis and data synthesis.

Results

A programme theory was developed from 106 secondary sources and 12 primary interviews with MWH implementers. The theory demonstrated that uptake and scale-up of the MWH-facility birth intervention depends on complex interactions between three adopter groups: health system stakeholders, community gatekeepers and pregnant women and their families. It describes relationships between 19 contexts, 11 mechanisms and 31 outcomes accross nine context-mechanism-outcome configurations (CMOCs) which were grouped into 3 themes: (1) Engaging stakeholders to develop, integrate, and sustain MWH-facility birth interventions, (2) Promoting and enabling MWH-facility birth utilisation and (3) Creating positive and memorable MWH-facility birth user experiences. Belief, trust, empowerment, health literacy and perceptions of safety, comfort and dignity were mechanisms that supported diffusion and adoption of the intervention within communities and health systems. Examples of resources provided by implementers to trigger mechanisms associated with each CMOC were identified.

Conclusions

Implementers of MWHs cannot merely assume that communities will collectively value an MWH-facility birth experience over delivery at home. We posit that MWH-facility birth interventions become vulnerable to under-utilisation when implementers fail to: (1) remove barriers that hinder women’s access to MWH and (2) ensure that conditions and interactions experienced within the MWH and its affiliated health facility support women to feel treated with compassion, dignity and respect.

PROSPERO registration number

CRD42020173595.

Diversifying Implementation Science: A Global Perspective

We present a joint global perspective about the urgent need to diversify the loci of knowledge creation and sharing in global implementation science. We underscore the imperative of addressing implementation research questions relevant to practitioners, policy makers, and researchers from low- and middle-income countries.

Deconstructing design thinking as a tool for the implementation of a population health initiative

Background

The translation of evidence-based practices and rapid uptake of innovations into global health practice is challenging. Design thinking is a consultative process involving multiple stakeholders and has been identified as a promising solution to create and apply implementation strategies in complex environments like health systems.

Methods

We conducted a process evaluation of a real-world example, namely an initiative to innovate hypertension screening, diagnosis and care in São Paulo, Brazil. The parameters of the evaluation were informed by a specification rubric and categorization system, recommended for the investigation of implementation strategies, and the double-diamond conceptual framework to describe and examine the strategic architecture and nature of the design thinking approach, with particular emphasis on identifying potential areas of “value-add” particular to the approach. The retrospective evaluation was performed by an independent partner who had not been involved in the setting up and implementation of the design thinking process.

Results

The evaluation unveiled a dense catalogue of strategically driven, mostly theoretically based, activities involving all identified health system stakeholders including patients. Narrative reconstruction illuminated the systematic and coherent nature of this approach, with different resulting actions progressively accounting for all relevant layers of the health system to engineer a broad selection of specific implementation solutions. The relevance of the identified features and the mechanics used to promote more successful implementation practices was manifested in several distinct ways: design thinking offered a clear direction on which innovations really mattered and when, as well as several new dimensions for consideration in the development of an innovation mindset amongst stakeholders. It thereby promoted relationship quality in terms of familiarity and trust, and commitment to evidence-based enquiry and action. Design thinking was also able to navigate the territory between the need for intervention “fidelity” versus “adaptation” and provide the operational know-how to face familiar implementation hurdles. Lastly, it brought a new kind of skill set to the public health stakeholders that incorporated diplomacy, multidisciplinary approaches and management sciences—skills that are considered necessary but not yet widely taught as part of public health training.

Conclusions

Design thinking is a sound and viable tool to use as part of an implementation strategy for engaging with health system stakeholders and successfully translating evidence-based practices and new innovations into routine practice, thereby addressing an important knowledge—practice gap and, more broadly, contributing to the strategic repertoire available to implementation science.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00892-5.

Role of Local Evidence in Transferring Evidence-Based Interventions to Low- and Middle-Income Country Settings: Application to Global Cancer Prevention and Control

PURPOSE

Although the global burden of cancer falls increasingly on low- and middle-income countries (LMICs), much of the evidence for cancer prevention and control comes from high-income countries and may not be directly applicable to LMIC settings. In this paper, we focus on the following question: When the majority of the evidence supporting an evidence-based intervention or implementation strategy comes from high-income countries, what local, contextual evidence is needed when transferring and adapting an intervention or strategy to a specific LMIC setting?

METHODS

We draw on an existing framework (the Population, Intervention, Environment, Transfer-T process model) for assessing transferability of interventions between distinct settings and apply the model to two case studies as learning examples involving implementation of tobacco use treatment guidelines and self sampling for human papillomavirus DNA in cervical cancer screening.

RESULTS

These two case studies illustrate how researchers, policymakers, practitioners, and consumers may approach the need for local evidence from different perspectives and with different priorities. As uses and expectations around local evidence may be different for different groups, aligning these priorities through multistakeholder engagement in which all parties participate in defining the questions and cocreating the solutions is critical, along with promoting standardized reporting of contextual factors.

CONCLUSION

Local, contextual evidence can be important for both researchers and practitioners, and its absence may hinder translation of research and implementation efforts across different settings. However, it is essential for researchers, practitioners, and other stakeholders to be able to clearly articulate the type of data needed and why it is important. In particular, where resources are limited, evidence generation should be prioritized to address real needs and gaps in knowledge.

Context Matters in Evidence Implementation Globally Comment on "Stakeholder Perspectives of Attributes and Features of Context Relevant to Knowledge Translation in Health Settings: A Multi-Country Analysis"

Context influences the effectiveness of healthcare interventions and should be considered to inform their implementation. However, context remains poorly defined in the knowledge translation (KT) literature. The paper by Squires and colleagues constitutes a valuable contribution to the field of KT as it provides the basis for a comprehensive framework to assess the influence of context on implementation success. In their study, Squires et al identified 66 context features, grouped into 16 attributes. Their findings highlight a great convergence in the context features mentioned by stakeholders across countries, experience levels and roles in KT. Thus, the proposed framework could eventually transfer to several implementation settings. However, all study participants were from high-income countries. It would therefore be important to replicate this research in low- and middle-income countries (LMICs). A common understanding of what context means is essential to assessing its influence on the implementation of healthcare interventions globally.

Implementation research on noncommunicable disease prevention and control interventions in low- and middle-income countries: A systematic review

BACKGROUND

While the evidence for the clinical effectiveness of most noncommunicable disease (NCD) prevention and treatment interventions is well established, care delivery models and means of scaling these up in a variety of resource-constrained health systems are not. The objective of this review was to synthesize evidence on the current state of implementation research on priority NCD prevention and control interventions provided by health systems in low- and middle-income countries (LMICs).

METHODS AND FINDINGS

On January 20, 2021, we searched MEDLINE and EMBASE databases from 1990 through 2020 to identify implementation research studies that focused on the World Health Organization (WHO) priority NCD prevention and control interventions targeting cardiovascular disease, cancer, diabetes, and chronic respiratory disease and provided within health systems in LMICs. Any empirical and peer-reviewed studies that focused on these interventions and reported implementation outcomes were eligible for inclusion. Given the focus on this review and the heterogeneity in aims and methodologies of included studies, risk of bias assessment to understand how effect size may have been compromised by bias is not applicable. We instead commented on the distribution of research designs and discussed about stronger/weaker designs. We synthesized extracted data using descriptive statistics and following the review protocol registered in PROSPERO (CRD42021252969). Of 9,683 potential studies and 7,419 unique records screened for inclusion, 222 eligible studies evaluated 265 priority NCD prevention and control interventions implemented in 62 countries (6% in low-income countries and 90% in middle-income countries). The number of studies published has been increasing over time. Nearly 40% of all the studies were on cervical cancer. With regards to intervention type, screening accounted for 49%, treatment for 39%, while prevention for 12% (with 80% of the latter focusing on prevention of the NCD behavior risk factors). Feasibility (38%) was the most studied implementation outcome followed by adoption (23%); few studies addressed sustainability. The implementation strategies were not specified well enough. Most studies used quantitative methods (86%). The weakest study design, preexperimental, and the strongest study design, experimental, were respectively employed in 25% and 24% of included studies. Approximately 72% of studies reported funding, with international funding being the predominant source. The majority of studies were proof of concept or pilot (88%) and targeted the micro level of health system (79%). Less than 5% of studies report using implementation research framework.

CONCLUSIONS

Despite growth in implementation research on NCDs in LMICs, we found major gaps in the science. Future studies should prioritize implementation at scale, target higher levels health systems (meso and macro levels), and test sustainability of NCD programs. They should employ designs with stronger internal validity, be more conceptually driven, and use mixed methods to understand mechanisms. To maximize impact of the research under limited resources, adding implementation science outcomes to effectiveness research and regional collaborations are promising.

Process evaluations of mental health and psychosocial support interventions for populations affected by humanitarian crises

BACKGROUND

Randomised controlled trials (RCTs) have been increasingly used to test the effectiveness of mental health and psychosocial support(MHPSS) interventions for populations affected by humanitarian crises. Process evaluations are often integrated within RCTs of psychological interventions to investigate the implementation of the intervention, the impact of context, and possible mechanisms of action. We aimed to explore limitations and strengths of how process evaluations are currently conceptualised and implemented within MHPSS RCTs specifically.

METHODS

In April-June 2021 we conducted semi-structured interviews with 24 researchers involved in RCTs of MHPSS interventions in 23 different countries. Participants were selected based on systematic reviews of MHPSS interventions, funders' databases, and personal networks. Data were analysed using codebook thematic analysis.

RESULTS

The conduct of process evaluations was characterized by high heterogeneity in perceived function, implementation outcomes assessed, and methods used. While process evaluations were overwhelmingly considered as an important component of an RCT, there were different opinions on their perceived quality. This could be explained by the varying prioritization of effectiveness data over implementation data, confusion around the nature of process evaluations, and challenges in the collection and analysis of process data in humanitarian settings. Various practical recommendations were made by participants to improve future process evaluations in relation to: (i) study design (e.g., embedding process evaluations in study protocol and overall study objectives); (ii) methods (e.g., use of mixed methods); and (iii) increased financial and human resources dedicated to process evaluations.

CONCLUSION

The current state of process evaluations in MHPSS RCTs is heterogeneous. The quality of process evaluations should be improved to strengthen implementation science of the growing number of evidence-informed MHPSS interventions.

Evaluating results of the implementation research MOOC using Kirkpatrick's four-level model: a cross-sectional mixed-methods study

INTRODUCTION

An implementation research (IR) massive open online course (MOOC) was developed by the Special Programme for Research and Training in Tropical Diseases, to address the scarcity of training in low-income and middle-income countries in the field of IR. The Kirkpatrick model was used to evaluate the IR MOOC as it is widely applied for evaluation of training and educational programmes. The Kirkpatrick model evaluates training programmes on four levels: reaction, learning, behaviour and results. This paper addresses the impact of the IR MOOC on participants' professional practice.

METHODS

Findings are based on analysis of survey and interview data collected 1.5-2 years after the conclusion of the two 2018 IR MOOC offerings. Of the 3858 MOC participants, 748 responded to the anonymous online survey and seven of these respondents were interviewed. All data are self-reported.

RESULTS

The IR MOOC was successful in enhancing the professional practice of participants and for their organisations. Over 40% reported modifying or implementing changes in their professional work. Respondents reported that participation in the MOOC had improved their ability to conduct IR, enhanced their professional profiles and increased their opportunities for collaboration, research and job promotion. Respondents stated that the MOOC had improved their work quality and productivity, and allowed them to contribute to research, initiate and develop professional collaborations and train others in IR. Respondents reported an increase in applying for grants and scholarships and presenting and publishing work on IR after participating in the MOOC. Barriers applying the knowledge gained from the IR MOOC were experienced, for example, due to a lack of funding and lack of support from colleagues, managers and organisations.

CONCLUSION

Participants perceived that the IR MOOC was successful in its aims of delivering medium-term and long-term results in relation to their own and their organisations' professional outcomes.

Funders' Perspectives on Supporting Implementation Research in Low- and Middle-Income Countries

We identify and discuss 7 approaches for funders to contemplate when considering support for implementation research in low- and middle-income countries.

Priorities for cancer research in low- and middle-income countries: a global perspective

Cancer research currently is heavily skewed toward high-income countries (HICs), with little research conducted in, and relevant to, the problems of low- and middle-income countries (LMICs). This regional discordance in cancer knowledge generation and application needs to be rebalanced. Several gaps in the research enterprise of LMICs need to be addressed to promote regionally relevant research, and radical rethinking is needed to address the burning issues in cancer care in these regions. We identified five top priorities in cancer research in LMICs based on current and projected needs: reducing the burden of patients with advanced disease; improving access and affordability, and outcomes of cancer treatment; value-based care and health economics; quality improvement and implementation research; and leveraging technology to improve cancer control. LMICs have an excellent opportunity to address important questions in cancer research that could impact cancer control globally. Success will require collaboration and commitment from governments, policy makers, funding agencies, health care organizations and leaders, researchers and the public.

International perspectives on the development, application, and evaluation of a multicancer early detection strategy

The development and implementation of a multicancer early detection (MCED) test that is effective and affordable has the potential to change cancer care systems around the world. However, careful consideration is needed within the context of different health care settings (both low- and middle-income countries and high-income countries) to roll out an MCED test and promote equity in access.

Operationalizing Implementation Science in Nutrition: The Implementation Science Initiative in Kenya and Uganda

BACKGROUND

Implementation science (IS) has the potential to improve the implementation and impact of policies, programs, and interventions. Most of the training, guidance, and experience has focused on implementation research, which is only 1 part of the broader field of IS. In 2018, the Society for Implementation Science in Nutrition borrowed concepts from IS in health to develop a broader and more integrated conceptual framework, adapted to the particular case of nutrition and with language and concepts more familiar to the nutrition community: it is called the IS in Nutrition (ISN) framework.

OBJECTIVE

The purpose of this research was to generate knowledge concerning challenges and strategies in operationalizing the ISN framework in low- and middle-income country (LMIC) settings.

METHODS

The ISN framework was operationalized in partnership with country teams in Kenya and Uganda over a 3-y period as part of the Implementation Science Initiative. An action research methodology (developmental evaluation) was used to provide timely feedback to the country teams, facilitate adaptations and adjustments, and generate the data presented in this article concerning challenges and strategies.

RESULTS

Operationalization of the ISN framework proceeded by first articulating a set of guiding principles as touchstones for the country teams and further articulating 6 components of an IS system to facilitate development of work streams. Challenges and strategies in implementing these 6 components were then documented. The knowledge gained through this experience led to the development of an IS system operational model to assist the application of IS in other LMIC settings.

CONCLUSIONS

Future investments in IS should prioritize a system- and capacity-building approach in order to realize its full potential and become institutionalized at country level. The operational model can guide others to improve the implementation of IS within a broad range of programs.

Development and application of a hybrid implementation research framework to understand success in reducing under-5 mortality in Rwanda

Background: We describe the development and testing of a hybrid implementation research (IR) framework to understand the pathways, successes, and challenges in addressing amenable under-5 mortality (U5M) - deaths preventable through health system-delivered evidence-based interventions (EBIs) - in low- and middle-income countries (LMICs). Methods: We reviewed existing IR frameworks to develop a hybrid framework designed to better understand U5M reduction in LMICs from identification of leading causes of amenable U5M, to EBI choice, identification, and testing of strategies, work to achieve sustainability at scale, and key contextual factors. We then conducted a mixed-methods case study of Rwanda using the framework to explore its utility in understanding the steps the country took in EBI-related decision-making and implementation between 2000-2015, key contextual factors which hindered or facilitated success, and to extract actionable knowledge for other countries working to reduce U5M. Results: While relevant frameworks were identified, none individually covered the scope needed to understand Rwanda's actions and success. Building on these frameworks, we combined and adapted relevant frameworks to capture exploration, planning, implementation, contextual factors in LMICs such as Rwanda, and outcomes beyond effectiveness and coverage. Utilizing our hybrid framework in Rwanda, we studied multiple EBIs and identified a common pathway and cross-cutting strategies and contextual factors that supported the country's success in reducing U5M through the health system EBIs. Using these findings, we identified transferable lessons for other countries working to accelerate reduction in U5M. Conclusions: We found that a hybrid framework building on and adapting existing frameworks was successful in guiding data collection and interpretation of results, emerging new insights into how and why Rwanda achieved equitable introduction and implementation of health system EBIs that contributed to the decline in U5M, and generated lessons for countries working to drop U5M.

Identified needs of peripartum adolescents in Sub-Saharan Africa from 2013 to 2021: a mapping of domains for strengthening psychosocial interventions

Adolescent pregnancy and early motherhood pose significant socioeconomic and health risks in Sub-Saharan Africa, leading to considerable morbidity and mortality. To learn more about the needs of this population, we reviewed 24 articles featuring 21 samples covering 12,490 adolescents from 14 countries. Our coding revealed that adolescent mothers were studied more (85.7% of samples) than pregnant adolescents (61.9%). We summarized needs as per six categories. Resource needs were most prevalent, reported by 100% of samples, followed by ecology (85.7%), mental health (76.2%), medical (61.9%), other (61.9%), and education (33.3%). The most frequently reported resource needs were low income and unemployment. Low social support, low family functioning, and exposure to negative cultural norms were ecological needs prevalent in most samples. Among mental health concerns, depression was the most commonly reported problem, whereas other problems, such as anxiety, substance use, and suicidality, were reported much less frequently. HIV-positive status was the most frequently reported medical concern. Intervention developers should consider the range of challenges when designing psychosocial services for this population.

Role of trust in sustaining provision and uptake of maternal and child healthcare: Evidence from a national programme in Nigeria

Despite increasing attention to implementation research in global health, evidence from low- and middle-income countries (LMICs) using realist evaluations, in understanding how complex health programmes work remains limited. This paper contributes to bridging this knowledge gap by reporting how, why and in what circumstances, the implementation and subsequent termination of a maternal and child health programme affected the trust of service users and healthcare providers in Nigeria. Key documents were reviewed, and initial programme theories of how context triggers mechanisms to produce intended and unintended outcomes were developed. These were tested, consolidated and refined through iterative cycles of data collection and analysis. Testing and validation of the trust theory utilized eight in-depth interviews with health workers, four focus group discussions with service users and a household survey of 713 pregnant women and analysed retroductively. The conceptual framework adopted Hurley's perspective on 'decision to trust' and Straten et al.'s framework on public trust and social capital theory. Incentives offered by the programme triggered confidence and satisfaction among service users, contributing to their trust in healthcare providers, increased service uptake, motivated healthcare providers to have a positive attitude to work, and facilitated their trust in the health system. Termination of the programme led to most service users' dissatisfaction, and distrust reflected in the reduction in utilization of MCH services, increased staff workloads leading to their decreased performance although residual trust remained. Understanding the role of trust in a programme's short and long-term outcomes can help policymakers and other key actors in the planning and implementation of sustainable and effective health programmes. We call for more theory-driven approaches such as realist evaluation to advance understanding of the implementation of health programmes in LMICs.

Next Step for Global Adolescent and Young Adult Oncology: A Core Patient-Centered Outcome Set

The relatively small number of cancers in the adolescent and young adult (AYA) age group, those aged 15-39 years, does not appropriately reflect the personal and societal costs of cancer in this population, as reflected in the potential years of life lost or saved; the decreased productivity and health-related quality of life due to the impact of the disease during formative years and long-term complications or disabilities. Improvements in care and outcomes for AYAs with cancer require collaboration among different stakeholders at different levels (patients, caregivers, healthcare professionals, researchers, industry, and policymakers). Development of a Core Outcome Set (COS), an agreed minimum set of outcomes that should be measured globally in research, routine clinical practice, specifically for AYAs with cancer, with outcomes that are well defined based on the perspective of those who are affected and assessed with validated measures is highly required. A globally implemented COS for AYAs with cancer will facilitate better pooling of research data and the implementation of high-quality healthcare registries, which by benchmarking not only nationally, but also internationally, may ultimately improve the value of the care given to these underserved young cancer patients. We reflect on the need to develop a COS for AYA with cancer, the arenas of application and the challenges of implementing an age-specific COS in research and clinical practice.

A guide to systems-level, participatory, theory-informed implementation research in global health

Implementation research is a multidisciplinary field that addresses the complex phenomenon of how context influences our ability to deliver evidence-informed healthcare. There is increasing realisation of the importance of applying robust implementation research to scale-up life-saving interventions that meet health-related sustainable development goals. However, the lack of high-quality implementation research is impeding our ability to meet these targets, globally. Within implementation research, theory refers to the proposed hypothesis and/or explanation of how an intervention is expected to interact with the local context and actors to bring about change. Although there is increasing interest in applying theory to understand how and why implementation programmes work in real-world settings, global health actors still tend to favour impact evaluations conducted in controlled environments. This may, in part, be due to the relative novelty as well as methodological complexity of implementation research and the need to draw on divergent disciplines, including epidemiology, implementation science and social sciences. Because of this, implementation research is faced with a particular set of challenges about how to reconcile different ways of thinking and constructing knowledge about healthcare interventions. To help translate some of the ambiguity surrounding how divergent theoretical approaches and methods contribute to implementation research, we draw on our multidisciplinary expertise in the field, particularly in global health. We offer an overview of the different theoretical approaches and describe how they are applied to continuously select, monitor and evaluate implementation strategies throughout the different phases of implementation research. In doing so, we offer a relatively brief, user-focused guide to help global health actors implement and report on evaluation of evidence-based and scalable interventions, programmes and practices.

Development and application of a hybrid implementation research framework to understand success in reducing under-5 mortality in Rwanda

Background: We describe the development and testing of a hybrid implementation research (IR) framework to understand the pathways, successes, and challenges in addressing amenable under-5 mortality (U5M) - deaths preventable through health system-delivered evidence-based interventions (EBIs) - in low- and middle-income countries (LMICs). Methods: We reviewed existing IR frameworks to develop a hybrid framework designed to better understand U5M reduction in LMICs from identification of leading causes of amenable U5M, to EBI choice, identification, and testing of strategies, work to achieve sustainability at scale, and key contextual factors. We then conducted a mixed-methods case study of Rwanda using the framework to explore its utility in understanding the steps the country took in EBI-related decision-making and implementation between 2000-2015, key contextual factors which hindered or facilitated success, and to extract actionable knowledge for other countries working to reduce U5M. Results: While relevant frameworks were identified, none individually covered the scope needed to understand Rwanda's actions and success. Building on these frameworks, we combined and adapted relevant frameworks to capture exploration, planning, implementation, contextual factors in LMICs such as Rwanda, and outcomes beyond effectiveness and coverage. Utilizing our hybrid framework in Rwanda, we studied multiple EBIs and identified a common pathway and cross-cutting strategies and contextual factors that supported the country's success in reducing U5M through the health system EBIs. Using these findings, we identified transferable lessons for other countries working to accelerate reduction in U5M. Conclusions: We found that a hybrid framework building on and adapting existing frameworks was successful in guiding data collection and interpretation of results, emerging new insights into how and why Rwanda achieved equitable introduction and implementation of health system EBIs that contributed to the decline in U5M, and generated lessons for countries working to drop U5M.

Closing the know-do gap for child health: UNICEF's experiences from embedding implementation research in child health and nutrition programming

UNICEF operates in 190 countries and territories, where it advocates for the protection of children’s rights and helps meet children’s basic needs to reach their full potential. Embedded implementation research (IR) is an approach to health systems strengthening in which (a) generation and use of research is led by decision-makers and implementers; (b) local context, priorities, and system complexity are taken into account; and (c) research is an integrated and systematic part of decision-making and implementation. By addressing research questions of direct relevance to programs, embedded IR increases the likelihood of evidence-informed policies and programs, with the ultimate goal of improving child health and nutrition.

This paper presents UNICEF’s embedded IR approach, describes its application to challenges and lessons learned, and considers implications for future work.

From 2015, UNICEF has collaborated with global development partners (e.g. WHO, USAID), governments and research institutions to conduct embedded IR studies in over 25 high burden countries. These studies focused on a variety of programs, including immunization, prevention of mother-to-child transmission of HIV, birth registration, nutrition, and newborn and child health services in emergency settings. The studies also used a variety of methods, including quantitative, qualitative and mixed-methods.

UNICEF has found that this systematically embedding research in programs to identify implementation barriers can address concerns of implementers in country programs and support action to improve implementation. In addition, it can be used to test innovations, in particular applicability of approaches for introduction and scaling of programs across different contexts (e.g., geographic, political, physical environment, social, economic, etc.). UNICEF aims to generate evidence as to what implementation strategies will lead to more effective programs and better outcomes for children, accounting for local context and complexity, and as prioritized by local service providers. The adaptation of implementation research theory and practice within a large, multi-sectoral program has shown positive results in UNICEF-supported programs for children and taking them to scale.

Process evaluation of complex interventions in chronic and neglected tropical diseases in low- and middle-income countries-a scoping review protocol

BACKGROUND

The use of process evaluations is a growing area of interest in research groups working on complex interventions. This methodology tries to understand how the intervention was implemented to inform policy and practice. A recent systematic review by Liu et al. on process evaluations of complex interventions addressing non-communicable diseases found few studies in low- and middle- income countries (LMIC) because it was restricted to randomized controlled trials, primary healthcare level and non-communicable diseases. Yet, LMICs face different barriers to implement interventions in comparison to high-income countries such as limited human resources, access to health care and skills of health workers to treat chronic conditions especially at primary health care level. Therefore, understanding the challenges of interventions for non-communicable diseases and neglected tropical diseases (diseases that affect poor populations and have chronic sequelae) will be important to improve how process evaluation is designed, conducted and used in research projects in LMICs. For these reasons, in comparison to the study of Liu et al., the current study will expand the search strategy to include different study designs, languages and settings.

OBJECTIVE

Map research using process evaluation in the areas of non-communicable diseases and neglected tropical diseases to inform the gaps in the design and conduct of this type of research in LMICs.

METHODS

Scoping review of process evaluation studies of randomized controlled trials (RCTs) and non-RCTs of complex interventions implemented in LMICs including participants with non-communicable diseases or neglected tropical diseases and their health care providers (physicians, nurses, technicians and others) related to achieve better health for all through reforms in universal coverage, public policy, service delivery and leadership. The aspects that will be evaluated are as follows: (i) available evidence of process evaluation in the areas of non-communicable diseases and neglected tropical diseases such as frameworks and theories, (ii) methods applied to conduct process evaluations and (iii) gaps between the design of the intervention and its implementation that were identified through the process evaluation. Studies published from January 2008. Exclusion criteria are as follows: not peer reviewed articles, not a report based on empirical research, not reported in English or Spanish or Portuguese or French, reviews and non-human research.

DISCUSSION

This scoping review will map the evidence of process evaluations conducted in LMICs. It will also identify the methods they used to collect and interpret data, how different theories and frameworks were used and lessons from the implementation of complex interventions. This information will allow researchers to conduct better process evaluations considering special characteristics from countries with limited human resources, scarce data available and limited access to health care.

Saving babies' lives (SBL) - a programme to reduce neonatal mortality in rural Cambodia: study protocol for a stepped-wedge cluster-randomised trial

BACKGROUND

Neonatal mortality remains unacceptably high. Many studies successful at reducing neonatal mortality have failed to realise similar gains at scale. Effective implementation and scale-up of interventions designed to tackle neonatal mortality is a global health priority. Multifaceted programmes targeting the continuum of neonatal care, with sustainability and scalability built into the design, can provide practical insights to solve this challenge. Cambodia has amongst the highest neonatal mortality rates in South-East Asia, with rural areas particularly affected. The primary objective of this study is the design, implementation, and assessment of the Saving Babies' Lives programme, a package of interventions designed to reduce neonatal mortality in rural Cambodia.

METHODS

This study is a five-year stepped-wedge cluster-randomised trial conducted in a rural Cambodian province with an estimated annual delivery rate of 6615. The study is designed to implement and evaluate the Saving Babies' Lives programme, which is the intervention. The Saving Babies' Lives programme is an iterative package of neonatal interventions spanning the continuum of care and integrating into the existing health system. The Saving Babies' Lives programme comprises two major components: participatory learning and action with community health workers, and capacity building of primary care facilities involving facility-based mentorship. Standard government service continues in control arms. Data collection covering the whole study area includes surveillance of all pregnancies, verbal and social autopsies, and quality of care surveys. Mixed methods data collection supports iteration of the complex intervention, and facilitates impact, outcome, process and economic evaluation.

DISCUSSION

Our study uses a robust study design to evaluate and develop a holistic, innovative, contextually relevant and sustainable programme that can be scaled-up to reduce neonatal mortality.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT04663620 . Registered on 11th December 2020, retrospectively registered.

Implementation science protocol for a participatory, theory-informed implementation research programme in the context of health system strengthening in sub-Saharan Africa (ASSET-ImplementER)

OBJECTIVES

ASSET (Health System Strengthening in sub-Saharan Africa) is a health system strengthening (HSS) programme involving eight work-packages (ie, a research study that addresses a specific need for HSS) that aims to develop solutions that support high-quality care. Here we present the protocol for the implementation science (IS) theme within ASSET (ASSET-ImplmentER) that aims to understand what HSS interventions work, for whom and how, and how IS methodologies can be adapted to improve the HSS interventions within resource-poor contexts.

SETTINGS

Publicly funded health facilities in rural and urban areas in in Ethiopia, South Africa, Sierra Leone, and Zimbabwe.

PARTICIPANTS

Research staff including principal investigators, coinvestigators, field staff, PhD students, and research assistants.

INTERVENTIONS

Work-packages use a mixed-methods effectiveness-effectiveness hybrid designs. At the end of the pre-implementation phase, a workshop is held whereby the IS theme, jointly with ASSET work-packages apply IS determinant frameworks to research findings to identify factors that influence the effectiveness of delivering evidence-informed care. Determinants are used to select a set of HSS interventions for further evaluation, where work-packages also theorise selective mechanisms.In the piloting and rolling implementation phase, work-packages pilot the HSS interventions. An iterative process then begins involving evaluation, reflection and adaptation. Throughout this phase, IS determinant frameworks are applied to monitor and identify barriers/enablers to implementation. Selective mechanisms of action are also investigated. Implementation outcomes are evaluated using qualitative and quantitative methods. The psychometric properties of outcome measures including acceptability, appropriateness and feasibility are also evaluated. In a final workshop, work-packages come together, to reflect and explore the utility of the selected IS methods and provide suggestions for future use.Structured templates are used to organise and analyse common and heterogeneous patterns across work-packages. Qualitative data are analysed using thematic analysis and quantitative data are analysed using means and proportions.

CONCLUSIONS

We use a novel combination of IS methods at a programmatic level to facilitate comparisons of determinants and mechanisms that influence the effectiveness of HSS interventions in achieving implementation outcomes across different contexts. The study also contributes conceptual development and clarification at the underdeveloped interface of IS, HSS and global health.The ASSET-ImplementER theme is considered minimal risk as we only interview researchers involved in the different work-packages. To this effect we have received approval from King's College London Ethics Committee for research that is considered minimal risk (Reference number: MRA-20/21-21772).

The Applications of Implementation Science in Water, Sanitation, and Hygiene (WASH) Research and Practice

BACKGROUND

Delivery of high quality, at-scale, and sustained services is a major challenge in the water, sanitation, and hygiene (WASH) sector, made more challenging by a dearth of evidence-based models for adaption across contexts in low- and middle-income countries.

OBJECTIVE

We aim to describe the value of implementation science (IS) for the WASH sector and provide recommendations for its application.

METHODS

We review concepts from the growing field of IS-defined as the "scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and hence, to improve the quality and effectiveness of health services"-and we translate their relevance to WASH research, learning, and delivery.

DISCUSSION

IS provides a suite of methods and theories to systematically develop, evaluate, and scale evidence-based interventions. Though IS thinking has been applied most notably in health services delivery in high-income countries, there have been applications in low-income settings in fields such as HIV/AIDS and nutrition. Expanding the application of IS to environmental health, specifically WASH interventions, would respond to the complexity of sustainable service delivery. WASH researchers may want to consider applying IS guidelines to their work, including adapting pragmatic research models, using established IS frameworks, and cocreating knowledge with local stakeholders. https://doi.org/10.1289/EHP7762.