Need for more and better implementation science in global health

Navigating process evaluation in co-creation: a Health CASCADE scoping review of used frameworks and assessed components

BACKGROUND

Co-creation is seen as a way to ensure all relevant needs and perspectives are included and to increase its potential for beneficial effects and uptake process evaluation is crucial. However, existing process evaluation frameworks have been built on practices characterised by top-down developed and implemented interventions and may be limited in capturing essential elements of co-creation. This study aims to provide a review of studies planning and/or conducting a process evaluation of public health interventions adopting a co-creation approach and aims to derive assessed process evaluation components, used frameworks and insights into formative and/or participatory evaluation.

METHODS

We searched for studies on Scopus and the Health CASCADE Co-Creation Database. Co-authors performed a concept-mapping exercise to create a set of overarching dimensions for clustering the identified process evaluation components.

RESULTS

54 studies were included. Conceptualisation of process evaluation included in studies concerned intervention implementation, outcome evaluation, mechanisms of impact, context and the co-creation process. 22 studies (40%) referenced ten existing process evaluation or evaluation frameworks and most referenced were the frameworks developed by Moore et al (14%), Saunders et al (5%), Steckler and Linnan (5%) and Nielsen and Randall (5%).38 process evaluation components were identified, with a focus on participation (48%), context (40%), the experience of co-creators (29%), impact (29%), satisfaction (25%) and fidelity (24%).13 studies (24%) conducted formative evaluation, 37 (68%) conducted summative evaluation and 2 studies (3%) conducted participatory evaluation.

CONCLUSION

The broad spectrum of process evaluation components addressed in co-creation studies, covering both the evaluation of the co-creation process and the intervention implementation, highlights the need for a process evaluation tailored to co-creation studies. This work provides an overview of process evaluation components, clustered in dimensions and reflections which researchers and practitioners can use to plan a process evaluation of a co-creation process and intervention.

Interventions for improving critical care in low- and middle-income countries: a systematic review

PURPOSE

To systematically review the typology, impact, quality of evidence, barriers, and facilitators to implementation of Quality Improvement (QI) interventions for adult critical care in low- and middle-income countries (LMICs).

METHODS

MEDLINE, EMBASE, Cochrane Library and ClinicalTrials.gov were searched on 1st September 2022. The studies were included if they described the implementation of QI interventions for adult critical care in LMICs, available as full text, in English and published after 2000. The risks of bias were assessed using the ROB 2.0/ROBINS-I tools. Intervention strategies were categorised according to a Knowledge Translation framework. Interventions' effectiveness were synthesised by vote counting and assessed with a binomial test. Barriers and facilitators to implementation were narratively synthesised using the Consolidated Framework for Implementation Research.

RESULTS

78 studies were included. Risk of bias was high. The most common intervention strategies were Education, Audit & Feedback (A&F) and Protocols/Guidelines/Bundles/Checklists (PGBC). Two multifaceted strategies improved both process and outcome measures: Education and A&F (p = 0.008); and PGBC with Education and A&F (p = 0.001, p < 0.001). Facilitators to implementation were stakeholder engagement, organisational readiness for implementation, and adaptability of interventions. Barriers were lack of resources and incompatibility with clinical workflows.

CONCLUSIONS

The evidence for QI in critical care in LMICs is sparse and at high risk of bias but suggests that multifaceted interventions are most effective. Co-designing interventions with and engaging stakeholders, communicating relative advantages, employing local champions and adapting to feedback can improve implementation. Hybrid study designs, process evaluations and adherence to reporting guidelines would improve the evidence base.

Challenges and Opportunities for Paving the Road to Global Health Equity Through Implementation Science

Implementation science focuses on enhancing the widespread uptake of evidence-based interventions into routine practice to improve population health. However, optimizing implementation science to promote health equity in domestic and global resource-limited settings requires considering historical and sociopolitical processes (e.g., colonization, structural racism) and centering in local sociocultural and indigenous cultures and values. This review weaves together principles of decolonization and antiracism to inform critical and reflexive perspectives on partnerships that incorporate a focus on implementation science, with the goal of making progress toward global health equity. From an implementation science perspective, wesynthesize examples of public health evidence-based interventions, strategies, and outcomes applied in global settings that are promising for health equity, alongside a critical examination of partnerships, context, and frameworks operationalized in these studies. We conclude with key future directions to optimize the application of implementation science with a justice orientation to promote global health equity.

Co-creation process of an intervention to implement a multiparameter point-of-care testing device in a primary healthcare setting for non-communicable diseases in Peru

BACKGROUND

Point-of-care testing (POCT) devices are diagnostic tools that can provide quick and accurate results within minutes, making them suitable for diagnosing non-communicable diseases (NCDs). However, these devices are not widely implemented in healthcare systems and for this reason is relevant to understand the implementation process.

AIM

To describe the process and define a strategy to implement a multiparameter POCT device for diagnosing and managing NCDs in one region of Peru.

METHODS

A descriptive and non-experimental study, using the participatory methodologies of co-creation process. It was conducted in one region of Peru (Tumbes) to design an intervention for implementing a multiparameter POCT device. Two co-creation sessions were conducted involving five groups: community members, primary healthcare workers, these groups in both rural and urban settings, and regional decision-makers. These sessions included activities to understand patient journeys in receiving care for NCDs, identify facilitators and barriers to POCT devices usage, and define an implementation strategy for POCT devices in both rural and urban settings of Tumbes. The research team analysed the data and summarized key topics for discussion after each session.

RESULTS

A total of 78 participants were enrolled across the five groups. Among community members: 22.2% had only diabetes, 24.1% had only hypertension, and 18.5% had both diagnoses. In the patient journey, community members mentioned that it took at least three days to receive a diagnosis and treatment for an NCD. Most of the participants agreed that the POCT devices would be beneficial for their communities, but they also identified some concerns. The strategy for POCT devices implementation included healthcare workers training, POCT devices must be placed in the laboratory area and must be able to perform tests for glucose, glycated haemoglobin, cholesterol, and creatinine. Advertising about POCT devices should be displayed at the healthcare centres and the municipality using billboards and flyers.

CONCLUSIONS

The co-creation process was useful to develop strategies for the implementation of multiparameter POCT devices for NCDs, involving the participation of different groups of stakeholders guided by moderators in both, rural and urban, settings in Peru.

A health-social service partnership programme for improving the health self-management of community-dwelling older adults: a hybrid effectiveness-implementation pilot study protocol

BACKGROUND

The ageing population requires seamless, integrated health and social care services in the community to promote the health of older adults. However, inadequate financial resources, a lack of clear operational guidelines, and various organisational work cultures may affect the implementation quality and sustainability of these services. As a unique approach, this study seeks to examine the preliminary effects of a health-social partnership programme on the health self-management of community-dwelling older adults in Hong Kong. Additionally, the study seeks to ascertain key insights into the mechanisms and processes required to implement and sustain a self-care management programme in broader practice in community settings.

METHODS

This study will use a hybrid effectiveness-implementation design. During the 3-month programme, subjects in the intervention group will receive four Zoom video conference sessions and four telephone calls conducted by a health-social service team that will include a nurse case manager, community workers, general practitioners, a Chinese medicine practitioner, and social workers. Subjects in the control group will receive a monthly social telephone call from a trained research assistant to rule out the possible social effect of the intervention. The reach, effectiveness, adoption, implementation, and maintenance framework (i.e. RE-AIM framework) will be used to evaluate the implementation and effectiveness outcomes. Of the five dimensions included in the RE-AIM framework, only effectiveness and maintenance outcomes will be collected from both the intervention and control groups. The outcomes of the other three dimensions-reach, adoption, and implementation-will only be collected from subjects in the intervention group. Data will be collected pre-intervention, immediately post-intervention, and 3 months after the intervention is completed to evaluate the maintenance effect of the programme.

DISCUSSION

This programme will aim to enhance health-promoting self-care management behaviours in older adults dwelling in the community. This will be the first study in Hong Kong to use the hybrid effectiveness-implementation design and involve key stakeholders in the evaluation and implementation of a health self-management programme using a health-social service partnership approach. The programme, which will be rooted in the community, may be used as a model, if proven successful, for similar types of services.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT04442867. Submitted 19 June 2020.

The impact and implementation of an mHealth intervention to improve infant and young child feeding in Senegal: IIMAANJE protocol for a cluster randomized control trial

Behavior change communication (BCC) strategies have the potential to improve infant feeding and nutrition outcomes among infants and young children in low- and middle-income countries. More recently, there has been a shift toward the adoption of mHealth interventions-the use of mobile phones to transmit health-related information or direct care-to promote recommended BCC strategies among the caregivers of infants and young children. In Senegal, most infants and young children are not fed according to recommended practices leading to a high prevalence of undernutrition and micronutrient deficiencies. The aims of this cluster randomized control trial, using an effectiveness-implementation (type 1) hybrid design, were to: (1) determine the impact of an mHealth IYCF intervention on IYCF practices and nutrition outcomes; and (2) examine the implementation, costs, and opportunities for scaling up the mHealth messaging intervention. The trial was conducted in three regions in Senegal (Thies, Fatick, Diourbel) with 488 mother, father and children (6-23 months) triads. The intervention included 8 scripted messages, that underwent cognitive testing prior to the intervention implementation, and 8 unscripted messages from positive deviants. One voice message and one text message were sent each week to members of our experimental group for a 16-week period. The impact of the intervention was assessed through a household survey, 24-h dietary recall, and hemoglobin measurements before and after the intervention implementation. The primary outcomes were minimal acceptable diet (MAD) and anemia. We also included a total of 54 participants in nine focus groups held with mothers and fathers and semi-structured interviews with Badienou Gox (i.e., community health workers) (n = 6) and national partners and program implementers (n = 6) to examine the intervention implementation process. The study was registered prior to data collection on Clinicaltrials.gov (Identifier: NCT05374837).

Implementation of PM-JAY in India: a qualitative study exploring the role of competency, organizational and leadership drivers shaping early roll-out of publicly funded health insurance in three Indian states

BACKGROUND

The Pradhan Mantri Jan Arogya Yojana (PM-JAY), a publicly funded health insurance scheme, was launched in India in September 2018 to provide financial access to health services for poor Indians. PM-JAY design enables state-level program adaptations to facilitate implementation in a decentralized health implementation space. This study examines the competency, organizational, and leadership approaches affecting PM-JAY implementation in three contextually different Indian states.

METHODS

We used a framework on implementation drivers (competency, organizational, and leadership) to understand factors facilitating or hampering implementation experiences in three PM-JAY models: third-party administrator in Uttar Pradesh, insurance in Chhattisgarh, and hybrid in Tamil Nadu. We adopted a qualitative exploratory approach and conducted 92 interviews with national, state, district, and hospital stakeholders involved in program design and implementation in Delhi, three state capitals, and two anonymized districts in each state, between February and April 2019. We used a deductive approach to content analysis and interpreted coded material to identify linkages between organizational features, drivers, and contextual elements affecting implementation.

RESULTS AND CONCLUSION

PM-JAY guideline flexibilities enabled implementation in very different states through state-adapted implementation models. These models utilized contextually relevant adaptations for staff and facility competencies and organizational and facilitative administration, which had considerable scope for improvement in terms of recruitment, competency development, programmatic implementation support, and rationalizing the joint needs of the program and implementers. Adaptations also created structural barriers in staff interactions and challenged implicit power asymmetries and organizational culture, indicating a need for aligning staff hierarchies and incentive structures. At the same time, specific adaptations such as decentralizing staff selection and task shifting (all models); sharing of claims processing between the insurer and state agency (insurance and hybrid model); and using stringent empanelment, accreditation, monitoring, and benchmarking criteria for performance assessment, and reserving secondary care benefit packages for public hospitals (both in the hybrid model) contributed to successful implementation. Contextual elements such as institutional memory of previous schemes and underlying state capacities influenced all aspects of implementation, including leadership styles and autonomy. These variations make comparisons across models difficult, yet highlight constraints and opportunities for cross-learning and optimizing implementation to achieve universal health coverage in decentralized contexts.

mHealth to improve implementation of TB contact investigation: a case study from Uganda

BACKGROUND

Implementation science offers a systematic approach to adapting innovations and delivery strategies to new contexts but has yet to be widely applied in low- and middle-income countries. The Fogarty Center for Global Health Studies is sponsoring a special series, "Global Implementation Science Case Studies," to address this gap.

METHODS

We developed a case study for this series describing our approach and lessons learned while conducting a prospective, multi-modal study to design, implement, and evaluate an implementation strategy for TB contact investigation in Kampala, Uganda. The study included formative, evaluative, and summative phases that allowed us to develop and test an adapted contact investigation intervention involving home-based sample collection for TB and HIV testing. We concurrently developed a multi-component mHealth implementation strategy involving fingerprint scanning, electronic decision support, and automated reporting of test results via text message. We then conducted a household-randomized, hybrid implementation-effectiveness trial comparing the adapted intervention and implementation strategy to usual care. Our assessment included nested quantitative and qualitative studies to understand the strategy's acceptability, appropriateness, feasibility, fidelity, and costs. Reflecting on this process with a multi-disciplinary team of implementing researchers and local public health partners, we provide commentary on the previously published studies and how the results influenced the adaptation of international TB contact investigation guidelines to fit the local context.

RESULTS

While the trial did not show improvements in contact investigation delivery or public health outcomes, our multi-modal evaluation strategy helped us identify which elements of home-based, mHealth-facilitated contact investigation were feasible, acceptable, and appropriate and which elements reduced its fidelity and sustainability, including high costs. We identified a need for better tools for measuring implementation that are simple, quantitative, and repeatable and for greater attention to ethical issues in implementation science.

CONCLUSIONS

Overall, a theory-informed, community-engaged approach to implementation offered many learnings and actionable insights for delivering TB contact investigation and using implementation science in low-income countries. Future implementation trials, especially those incorporating mHealth strategies, should apply the learnings from this case study to enhance the rigor, equity, and impact of implementation research in global health settings.

Community partner perspectives on the implementation of a novel safer supply program in Canada: a qualitative study of the MySafe Project

BACKGROUND

The adulteration of the illicit drug supply with fentanyl and its analogues is driving the ongoing overdose crisis in North America. While various harm reduction interventions address overdose-related risks, there is growing interest in safer supply programs, including the MySafe Project which utilizes a biometric dispensing machine that provides pharmaceutical opioid alternatives to the toxic drug supply. However, the experiences and perspectives of professional community partners on program implementation remain unexplored. This study aims to examine professional community partner perspectives on the feasibility, as well as barriers and facilitators to the implementation of the MySafe program.

METHODS

Semi-structured qualitative interviews were conducted with 17 professional community partners involved in program implementation across four pilot locations in Canada. Thematic analysis of interviews focused on perspectives on safer supply, barriers and facilitators faced during program implementation, and recommendations to inform future scale-up of low-barrier safer supply models across Canada.

RESULTS

Participants identified a variety of barriers, including the dependence on clinician buy-in, coupled with regulatory and logistical constraints. In addition, some participants perceived hydromorphone to be an inadequate substitute to the increasingly toxic street opioid supply. Lastly, technical difficulties were described as barriers to service uptake and delivery. Conversely, having political and community buy-in, availability of wrap-around services, and collaborative communication from the MySafe team served as facilitators to program implementation. Though community partners preferred establishing MySafe machines into existing community organizations, they also discussed benefits of housing-based MySafe programs. The potential role of this program in mid-sized to rural cities was also emphasized.

CONCLUSIONS

To address the overdose crisis, there is an urgent need to implement and evaluate novel solutions that address supply drivers of crisis. Community partner-informed research plays an integral role in ensuring program acceptability and proper implementation. Our findings identify current gaps and facilitators underlying the efficacy of one such model, together with future directions for improvement. Participant recommendations included a diversification of medications offered and types of locations for MySafe programs, a streamlined national approach to prescribing guidelines coupled with more robust training for healthcare professionals, and an emphasis on service delivery within an integrated services model. Our findings underscore a potential gap between the goals of healthcare providers in ensuring comprehensive care and the necessity for low-barrier models such as MySafe that can function both within and outside of integrated service models.

Framing Commercial Determinants of Health: An Assessment of Potential for Guiding More Effective Responses to the Public Health Crises of the 21st Century

Policy Points The commercial determinants of health (CDH) framework can inform public health policy, practice, and research in ways that contribute to overcoming the world's most serious public health challenges. By documenting the pathways by which commercial actors shape health, the CDH framework can provide a unifying focus for collective action to prevent and ameliorate global health crises. To realize these opportunities, CDH proponents need to find synergies in the multiple emerging streams of research, practice, and advocacy and create a body of scientific evidence, methodologies, and ideas that can inform a public health practice for the 21st century.

A scoping review of qualitative research on barriers and facilitators to the use of supervised consumption services

A substantial body of evidence demonstrates that supervised consumption services (SCS) mitigate a variety of drug-related harms, including decreasing overdose deaths, infectious disease transmission, and connecting people who use drugs (PWUD) to various health and social services. Research on SCS has predominantly been quantitative, though qualitative research on these services has increased substantially over the last decade. Qualitative methods provide a framework for developing a richer and more nuanced understanding of meanings and contexts associated with drug use, health service implementation, and experience. We present findings from a scoping review of qualitative studies on experiences of PWUD with SCS published between 1997 and 2022. In total, forty-two papers were included in this analysis. Four primary themes emerged from our analysis: 1) Influence of SCS on health and wellbeing among PWUD, 2) the physical environment of SCS can be both a facilitator and barrier to use, 3) social resources can shape and reshape the context within which PWUD benefit from SCS, and 4) various intersecting forces at play both support and harm PWUD in relation to their experiences with SCS. We discuss the primary facilitators and barriers of SCS use and conclude with suggestions to inform future qualitative research, SCS implementation, and PWUD-centered approaches to drug policy.

Application of consolidated framework for implementation research to improve Clostridioides difficile infection management in district hospitals

BACKGROUND

Clostridioides difficile infection (CDI) contributes the global threats of drug resistant infections, healthcare acquired infections and antimicrobial resistance. Yet CDI knowledge among healthcare providers in low-resource settings is limited and CDI testing, treatment, and infection prevention measures are often delayed.

OBJECTIVES

to develop a CDI intervention informed by the local context within South African public district level hospitals, and analyze the CDI intervention and implementation process.

METHODS

A CDI checklist intervention was designed and implemented at three district level hospitals in the Western Cape, South Africa that volunteered to participate. Data collection included a retrospective medical records review of patients hospitalized with C. difficile test orders during the 90 days post-implementation. Patient outcomes and checklist components (e.g. antibiotics) were collected. Qualitative interviews (n = 14) and focus groups (n = 6) were conducted with healthcare providers on-site. The Consolidated Framework for Implementation Research (CFIR) and the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) were applied to collected data and observations in order to identify drivers and barriers to implementation and understand differences in uptake.

RESULTS

One of the three hospitals displayed high intervention uptake. Highly relevant CFIR constructs linked to intervention uptake included tension for change, strong peer intervention champions, champions in influential leadership positions, and the intervention's simplicity (CFIR construct: complexity). Tension for change, a recognized need to improve CDI identification and treatment, at the high uptake hospital was also supported by an academic partnership for antimicrobial stewardship.

CONCLUSIONS

This research provides a straight-forward health systems strengthening intervention for CDI that is both needed and uncomplicated, in an understudied low resource setting. Intervention uptake was highest in the hospital with tension for change, influential champions, and existing academic partnerships. Implementation in settings with fewer academic connections requires further testing of collaborative implementation strategies and proactive adaptations.

Developing Capacity in Dissemination and Implementation Research in the Eastern Mediterranean Region: Evaluation of a Training Workshop

As the demand for dissemination and implementation (D&I) research grows globally, there is a need for D&I capacity building in regions where D&I science is underrepresented. The Workshop on Dissemination and Implementation Research in Health (WONDIRH) was aimed for participants in the Eastern Mediterranean region to (1) appreciate the complex process of bridging research and practice in a variety of real-world settings, and (2) develop research that balances rigor with relevance and employs study designs and methods appropriate for the complex processes involved in D&I. The present exploratory study investigates participants' satisfaction with the workshop, the enhancement of their self-rated confidence in D&I skills, as well as their intention to apply the learned content into practice. The workshop included four weekly 90-min virtual interactive training sessions in conjunction with open access content from the National Cancer Institute Training Institute in Implementation and Dissemination Research in Cancer (TIDIRC). We applied a one-group pre-post design for the evaluation of workshop. Participants were invited to self-rate their confidence in D&I competencies (15 items, pre and post workshop). At the end of the workshop, participants additionally were asked to rate their satisfaction (5 items, 1-5 scales), and their intention to apply the learned content into practice (4 items, 1-5 scales). Of the 77 workshop participants, 34 completed the evaluation. Confidence improved between pre- and post-workshop assessments in all 15 self-rated D&I competencies. Respondents were generally satisfied with the workshop (mean satisfaction range 3.82-4.26 across the 5 items) and endorsed intentions to apply workshop topics (mean intention range 4.03-4.35 across the 4 items). This initial workshop demonstrated the ability to attract and engage participants to enhance their confidence in D&I research competencies and skills and to build capacity in D&I research. Future efforts should consider offering targeted training for researchers at different stages and to clearly articulate learning objectives.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-022-00067-y.

Improving quality of surgical and anaesthesia care in sub-Saharan Africa: a systematic review of hospital-based quality improvement interventions

OBJECTIVES

To systematically review existing literature on hospital-based quality improvement studies in sub-Saharan Africa that aim to improve surgical and anaesthesia care, capturing clinical, process and implementation outcomes in order to evaluate the impact of the intervention and implementation learning.

DESIGN

We conducted a systematic literature review and narrative synthesis.

SETTING

Literature on hospital-based quality improvement studies in sub-Saharan Africa reviewed until 31 December 2021.

PARTICIPANTS

MEDLINE, EMBASE, Global Health, CINAHL, Web of Science databases and grey literature were searched.

INTERVENTION

We extracted data on intervention characteristics and how the intervention was delivered and evaluated.

PRIMARY AND SECONDARY OUTCOME MEASURES

Importantly, we assessed whether clinical, process and implementation outcomes were collected and separately categorised the outcomes under the Institute of Medicine quality domains. Risk of bias was not assessed.

RESULTS

Of 1573 articles identified, 49 were included from 17/48 sub-Saharan African countries, 16 of which were low-income or lower middle-income countries. Almost two-thirds of the studies took place in East Africa (31/49, 63.2%). The most common intervention focus was reduction of surgical site infection (12/49, 24.5%) and use of a surgical safety checklist (14/49, 28.6%). Use of implementation and quality improvement science methods were rare. Over half the studies measured clinical outcomes (29/49, 59.2%), with the most commonly reported ones being perioperative mortality (13/29, 44.8%) and surgical site infection rate (14/29, 48.3%). Process and implementation outcomes were reported in over two thirds of the studies (34/49, 69.4% and 35, 71.4%, respectively). The most studied quality domain was safety (44/49, 89.8%), with efficiency (4/49, 8.2%) and equitability (2/49, 4.1%) the least studied domains.

CONCLUSIONS

There are few hospital-based studies that focus on improving the quality of surgical and anaesthesia care in sub-Saharan Africa. Use of implementation and quality improvement methodologies remain low, and some quality domains are neglected.

PROSPERO REGISTRATION NUMBER

CRD42019125570.

Learning Health Systems to Bridge the Evidence-Policy-Practice Gap in Primary Health Care: Lessons From the African Health Initiative

The compilation of lessons in this supplement on the Doris Duke Charitable Foundation’s African Health Initiative’s work in the application of implementation research in primary health care in sub-Saharan Africa reflects the evolution of the discipline that is now increasingly recognized as integral to health systems strengthening.

Diversifying Implementation Science: A Global Perspective

We present a joint global perspective about the urgent need to diversify the loci of knowledge creation and sharing in global implementation science. We underscore the imperative of addressing implementation research questions relevant to practitioners, policy makers, and researchers from low- and middle-income countries.

[Describing and disseminating organizational innovation in public health DINOSP ; guide (Description of Organizational Innovations in Public Health)]

OBJECTIVES

The transition from experimentation to the scaling up of organizational innovations in public health is arduous. The innovation process requires back-up in view of enhancing the chances of success and generalization. The aim of this article is to present the development of a guide to support the description and analysis of organizational innovations in public health.

METHOD

The mobilization of two analysis and description tools, ASTAIRE and TIDIeR, made it possible to select the innovation criteria to be considered for generalization. Collective discussions between actors, decision-makers and researchers and individual interviews with the latter refined and completed the proposed guide, which was reread by experts and tested by project leaders, thereby improving its accuracy and usability.

RESULTS

The guide puts forward a two-step approach: i) to describe innovation at two levels: on the one hand, intervention methods, and on the other hand, interventional, population or contextual components corresponding to 27 criteria and ii) to assess the transferability of the innovation by distinguishing its key functions, its formal elements and the margins of maneuver to be maintained.

DISCUSSION

The guide presents a modular vision of innovations and leaves room for reflection on its mechanisms. It favors the synchronization of innovations with the existing system and their mutualization.

CONCLUSIONS

By putting forward a standardised description of organizational innovations in health and analyzing their effectiveness, the tool can effectively contribute to the development of effective, adaptable and generalizable projects, and thereby contribute to progress in public health.

Analyzing implementation of public health interventions : a need for rigor, and the challenges of stakeholder involvement

OBJECTIVES

This article shows how conceptual models can help to develop and evaluate public health interventions. It also reports on the challenges of getting stakeholders involved.

METHOD

The analysis is based on the reflexive approach applied by the authors during their participation in two public health intervention research (PHIR) projects, in France and in Burkina Faso.

RESULTS

In Paris, PHIR aimed to enable sub-Saharan immigrants to appropriate the existing means of prevention and sexual health care and to strengthen their empowerment in view of preserving their health. Evaluation was carried out using mixed methods. The intervention process theory is based on Ninacs' conceptual model of individual empowerment. The Consolidated Framework For Implementation Research (CFIR) was mobilized a posteriori to analyze the process. PHIR stemmed from collaboration between a research team and two associations. The different stakeholders were involved in the evaluation process, as were, at certain times, persons in highly precarious situations. In Ouagadougou, a community-based dengue vector control intervention was deployed to address an essential but neglected need. As regards evaluation, we opted for a holistic, mixed method approach (effectiveness and process). The contents of the intervention were determined based on tacit knowledge, a community preference survey and solid evidence. The theoretical framework of the intervention consisted in an eco-biological model of vector control. The implementation analysis combined an internal assessment of implementation fidelity with an external CFIR process analysis. All stakeholders were involved in the evaluation process.

DISCUSSION

Analysis confirmed not only the value of process evaluations in PHIR, but also the primordial importance of a rigorous approach. Stakeholder involvement is a major challenge to be addressed early in the planning of RISPs; with this in mind, effective and ethically sound assessment mechanisms need to be drawn up. Interdisciplinary evaluative approaches should be preferred, and the use of justified, relevant, and flexible frameworks is highly recommended.

CONCLUSION

Lessons learned for those wishing to engage in the process evaluation of a public health intervention are hereby presented.

Defining optimal implementation packages for delivering community-wide mass drug administration for soil-transmitted helminths with high coverage

Background

Recent evidence suggests that community-wide mass drug administration (MDA) may interrupt the transmission of soil-transmitted helminths (STH), a group of intestinal worms that infect 1.5 billion individuals globally. Although current operational guidelines provide best practices for effective MDA delivery, they do not describe which activities are most essential for achieving high coverage or how they work together to produce effective intervention delivery. We aimed to identify the various packages of influential intervention delivery activities that result in high coverage of community-wide MDA for STH in Benin, India, and Malawi.

Methods

We applied coincidence analysis (CNA), a novel cross-case analytical method, to process mapping data as part of the implementation science research of the DeWorm3 Project, a Hybrid Type 1 cluster randomized controlled trial assessing the feasibility of interrupting the transmission of STH using bi-annual community-wide MDA in Benin, India, and Malawi. Our analysis aimed to identify any necessary and/or sufficient combinations of intervention delivery activities (i.e., implementation pathways) that resulted in high MDA coverage. Activities were related to drug supply chain, implementer training, community sensitization strategy, intervention duration, and implementation context. We used pooled implementation data from three sites and six intervention rounds, with study clusters serving as analytical cases (N = 360). Secondary analyses assessed differences in pathways across sites and over intervention rounds.

Results

Across all three sites and six intervention rounds, efficient duration of MDA delivery (within ten days) singularly emerged as a common and fundamental component for achieving high MDA coverage when combined with other particular activities, including a conducive implementation context, early arrival of albendazole before the planned start of MDA, or a flexible community sensitization strategy. No individual activity proved sufficient by itself for producing high MDA coverage. We observed four possible overall models that could explain effective MDA delivery strategies, all which included efficient duration of MDA delivery as an integral component.

Conclusion

Efficient duration of MDA delivery uniquely stood out as a highly influential implementation activity for producing high coverage of community-wide MDA for STH. Effective MDA delivery can be achieved with flexible implementation strategies that include various combinations of influential intervention components.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08080-5.

Implementation challenges to patient safety in Guatemala: a mixed methods evaluation

BACKGROUND

Little is known about factors affecting implementation of patient safety programmes in low and middle-income countries. The goal of our study was to evaluate the implementation of a patient safety programme for paediatric care in Guatemala.

METHODS

We used a mixed methods design to examine the implementation of a patient safety programme across 11 paediatric units at the Roosevelt Hospital in Guatemala. The safety programme included: (1) tools to measure and foster safety culture, (2) education of patient safety, (3) local leadership engagement, (4) safety event reporting systems, and (5) quality improvement interventions. Key informant staff (n=82) participated in qualitative interviews and quantitative surveys to identify implementation challenges early during programme deployment from May to July 2018, with follow-up focus group discussions in two units 1 year later to identify opportunities for programme modification. Data were analysed using thematic analysis, and integrated using triangulation, complementarity and expansion to identify emerging themes using the Consolidated Framework for Implementation Research. Salience levels were reported according to coding frequency, with valence levels measured to characterise the degree to which each construct impacted implementation.

RESULTS

We found several facilitators to safety programme implementation, including high staff receptivity, orientation towards patient-centredness and a desire for protocols. Key barriers included competing clinical demands, lack of knowledge about patient safety, limited governance, human factors and poor organisational incentives. Modifications included use of tools for staff recognition, integration of education into error reporting mechanisms and designation of trained champions to lead unit-based safety interventions.

CONCLUSION

Implementation of safety programmes in low-resource settings requires recognition of facilitators such as staff receptivity and patient-centredness as well as barriers such as lack of training in patient safety and poor organisational incentives. Embedding an implementation analysis during programme deployment allows for programme modification to enhance successful implementation.

Beliefs, Perceptions, and Behaviors Regarding Chronic Respiratory Diseases of Roma in Crete, Greece: A Qualitative FRESH AIR Study

Background

The global burden of chronic respiratory diseases (CRDs) disproportionally affects Roma populations. Health interventions addressing CRD among Roma or other vulnerable groups often fail to be effective, as their implementation strategy misaligns with the local context. To design context-driven strategies, we studied CRD-related beliefs, perceptions, and behaviors among a Greek Roma population, focussing on asthma and COPD.

Methods

For this qualitative study in Crete, Greece, we used a Rapid Assessment Process. We conducted interviews and focus groups with purposively selected Roma community members (CMs), key informants (KIs) and healthcare professionals (HPs) serving the population. Data were triangulated using observations of households and clinical consultations. Key themes were identified using Thematic Content Analysis. The Health Belief Model, the Explanatory Model of Illness, and the Theory of Planned Behavior that are complementary is some aspects, guided our methodology with the several variables from them to be integrated to better understand CRD risk preventative behavior.

Results

We conducted six focus groups, seven interviews and 13 observations among 15 CMs, four KIs, and three HPs. Five themes emerged: (1) Poor CRD-awareness (smoking and household air pollution were perceived as harmful, but almost exclusively associated with acute rather than chronic symptoms); (2) Low perceived susceptibility to CRD (and CMs tended to ignore respiratory symptoms); (3) High risk exposure (smoking was common, and air pollution was perceived inevitable due to financial constraints); (4) Healthcare seeking (healthcare was sought only for persistent, severe symptoms, daily needs were a priority); (5) Perceived barriers/facilitators to care (health illiteracy, perceived discrimination and financial constraints were main barriers; established trust the main facilitator).

Conclusion

These five themes highlight that strategies to tackle CRD in the studied Roma setting require a multilevel approach: bridging awareness gaps at the population level, providing resources to enhance the adoption of healthy behaviors, and fighting discrimination at the societal level, whilst establishing trusted relationships at the local level. Similar methodologies to address local context may strengthen the implementation of effective interventions for similarly vulnerable and/or low-resource populations.

Participants perceptions of Essential Coaching for Every Mother, a Canadian text-message postpartum program: Process evaluation of a randomized controlled trial (Preprint)

Background

“Essential Coaching for Every Mother” is a Canadian text message–based program that sends daily messages to mothers for 6 weeks after they give birth. There is a need to explore the program’s effectiveness in terms of the participants’ experience to guide refinement and modification.

Objective

This study aimed to describe the process evaluation of the Essential Coaching for Every Mother randomized controlled trial through an evaluation of the research implementation extent and quality.

Methods

Participants were recruited from Nova Scotia, Canada, between January 5 and August 1, 2021. Enrolled participants were randomized into the intervention or control group. Participants randomized to the intervention group received standard care along with the Essential Coaching for Every Mother program’s text messages related to newborn and maternal care for the first 6 weeks after giving birth, while the control group received standard care. Usage data were collected from the SMS text message program used, and participants completed web-based questionnaires at 6 weeks after birth. Quantitative data and qualitative responses to open-ended questions were used to triangulate findings. Quantitative data were summarized using means, SDs, and percentages, as appropriate, while qualitative data were analyzed using thematic analysis.

Results

Of the 295 unique initial contacts, 150 mothers were eligible and completed the baseline survey to be enrolled in the study (intervention, n=78; control, n=72). Of those randomized into the intervention group, 75 (96%) completed the 6-week follow-up survey to provide feedback on the program. In total, 48 (62%) intervention participants received all messages as designed in the Essential Coaching for Every Mother program, with participants who enrolled late missing on average 4.7 (range 1-12) messages. Intervention participants reported an 89% satisfaction rate with the program, and 100% of participants would recommend the program to other new mothers. Participants liked how the program made them feel, the format, appropriate timing of messages, and content while disliking the frequency of messages and gaps in content. Participants also provided suggestions for future improvement.

Conclusions

Our process evaluation has provided a comprehensive understanding of interest in the program as well as identified preference for program components. The findings of this study will be used to update future iterations of the Essential Coaching for Every Mother program.

Trial Registration

ClincalTrials.gov NCT04730570; https://clinicaltrials.gov/ct2/show/NCT04730570

Operationalizing Implementation Science in Nutrition: The Implementation Science Initiative in Kenya and Uganda

BACKGROUND

Implementation science (IS) has the potential to improve the implementation and impact of policies, programs, and interventions. Most of the training, guidance, and experience has focused on implementation research, which is only 1 part of the broader field of IS. In 2018, the Society for Implementation Science in Nutrition borrowed concepts from IS in health to develop a broader and more integrated conceptual framework, adapted to the particular case of nutrition and with language and concepts more familiar to the nutrition community: it is called the IS in Nutrition (ISN) framework.

OBJECTIVE

The purpose of this research was to generate knowledge concerning challenges and strategies in operationalizing the ISN framework in low- and middle-income country (LMIC) settings.

METHODS

The ISN framework was operationalized in partnership with country teams in Kenya and Uganda over a 3-y period as part of the Implementation Science Initiative. An action research methodology (developmental evaluation) was used to provide timely feedback to the country teams, facilitate adaptations and adjustments, and generate the data presented in this article concerning challenges and strategies.

RESULTS

Operationalization of the ISN framework proceeded by first articulating a set of guiding principles as touchstones for the country teams and further articulating 6 components of an IS system to facilitate development of work streams. Challenges and strategies in implementing these 6 components were then documented. The knowledge gained through this experience led to the development of an IS system operational model to assist the application of IS in other LMIC settings.

CONCLUSIONS

Future investments in IS should prioritize a system- and capacity-building approach in order to realize its full potential and become institutionalized at country level. The operational model can guide others to improve the implementation of IS within a broad range of programs.

Impact of conditional and unconditional cash transfers on health outcomes and use of health services in humanitarian settings: a mixed-methods systematic review

BACKGROUND

Cash transfers, payments provided by formal or informal institutions to recipients, are increasingly used in emergencies. While increasing autonomy and being supportive of local economies, cash transfers are a cost-effective method in some settings to cover basic needs and extend benefits of limited humanitarian aid budgets. Yet, the extent to which cash transfers impact health in humanitarian settings remains largely unexplored. This systematic review evaluates the evidence on the effect of cash transfers on health outcomes and health service utilisation in humanitarian contexts.

METHODS

Studies eligible for inclusion were peer reviewed (quantitative,qualitative and mixed-methods). Nine databases (PubMed, EMBAS, Medline, CINAHL, Global Health, Scopus, Web of Science Core Collection, SciELO and LiLACS) were searched without language and without a lower bound time restriction through 24 February 2021. The search was updated to include articles published through 8 December 2021. Data were extracted using a piloted extraction tool and quality was assessed using The Joanna Briggs Critical Appraisal Tool. Due to heterogeneity in study designs and outcomes, results were synthesised narratively and no meta-analysis was performed.

RESULTS

30 673 records were identified. After removing duplicates, 17 715 were double screened by abstract and title, and 201 in full text. Twenty-three articles from 16 countries were included reporting on nutrition outcomes, psychosocial and mental health, general/subjective health and well-being, acute illness (eg, diarrhoea, respiratory infection), diabetes control (eg, blood glucose self-monitoring, haemoglobin A1C levels) and gender-based violence. Nineteen studies reported some positive impacts on various health outcomes and use of health services, 11 reported no statistically significant impact on outcomes assessed and 4 reported potential negative impacts on health outcomes.

DISCUSSION

Although there is evidence to suggest a positive relationship between cash transfers and health outcomes in humanitarian settings, high-quality empirical evidence, that is methodologically robust, investigates a range of humanitarian settings and is conducted over longer time periods is needed. This should consider factors influencing programme implementation and the differential impact of cash transfers designed to improve health versus multipurpose cash transfers.

PROSPERO REGISTRATION NUMBER

CRD42021237275.

Learning needs assessment for multi-stakeholder implementation science training in LMIC settings: findings and recommendations

Background

Despite significant progress in the field of implementation science (IS), current training programs are inadequate to meet the global need, especially in low-and middle-income countries (LMICs). Even when training opportunities exist, there is a “knowledge-practice gap,” where implementation research findings are not useful to practitioners in a field designed to bridge that gap. This is a critical challenge in LMICs where complex public health issues must be addressed. This paper describes results from a formal assessment of learning needs, priority topics, and delivery methods for LMIC stakeholders.

Methods

We first reviewed a sample of articles published recently in Implementation Science to identify IS stakeholders and assigned labels and definitions for groups with similar roles. We then employed a multi-step sampling approach and a random sampling strategy to recruit participants (n = 39) for a semi-structured interview that lasted 30–60 min. Stakeholders with inputs critical to developing training curricula were prioritized and selected for interviews. We created memos from audio-recorded interviews and used a deductively created codebook to conduct thematic analysis. We calculated kappa coefficients for each memo and used validation techniques to establish rigor including incorporating feedback from reviewers and member checking.

Results

Participants included program managers, researchers, and physicians working in over 20 countries, primarily LMICs. The majority had over 10 years of implementation experience but fewer than 5 years of IS experience. Three main themes emerged from the data, pertaining to past experience with IS, future IS training needs, and contextual issues. Most respondents (even with formal training) described their IS knowledge as basic or minimal. Preferences for future training were heterogeneous, but findings suggest that curricula must encompass a broader set of competencies than just IS, include mentorship/apprenticeship, and center the LMIC context.

Conclusion

While this work is the first systematic assessment of IS learning needs among LMIC stakeholders, findings reflect existing research in that current training opportunities may not meet the demand, trainings are too narrowly focused to meet the heterogeneous needs of stakeholders, and there is a need for a broader set of competencies that moves beyond only IS. Our research also demonstrates the timely and unique needs of developing appropriately scoped, accessible training and mentorship support within LMIC settings. Therefore, we propose the novel approach of intelligent swarming as a solution to help build IS capacity in LMICs through the lens of sustainability and equity.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00238-2.

We go farther together: practical steps towards conducting a collaborative autoethnographic study

ABSTRACT

Autoethnography is an underused qualitative research method in implementation science. Autoethnography can be used to reflect on and archive personal experiences, which can yield useful information to advance our knowledge. In particular, collaborative autoethnography is an important method towards providing greater insights on the experiences of multidisciplinary teams conducting research amidst complexity and intersectionality. In conducting a collaborative autoethnography, all authors are participants who narrate, analyze and theorize about their individual and or collective experiences. This article provides an overview of collaborative autoethnography for health research teams and implementation scientists embarking on autoethnographic studies.

Impact of a Multifaceted Intervention to Improve Emergency Care on Newborn and Child Health Outcomes in Rwanda

Implementing context-appropriate neonatal and pediatric advanced life support management interventions has increasingly been recommended as one of the approaches to reduce under-five mortality in resource-constrained settings like Rwanda. One such intervention is ETAT+, which stands for Emergency Triage, Assessment and Treatment plus Admission care for severely ill newborns and children. In 2013, ETAT+ was implemented in Rwandan district hospitals. We evaluated the impact of the ETAT+ intervention on newborn and child health outcomes. We used monthly time series data from the DHIS2-enabled Rwanda Health Management Information System from 2012 to 2016 to examine neonatal and pediatric hospital mortality rate. Each hospital contributed data for 12 and 36 months before and after ETAT+ implementation, respectively. Using controlled interrupted time series analysis and segmented regression model, we estimated longitudinal changes in neonatal and pediatric hospital mortality rate in intervention hospitals relative to matched concurrent control hospitals. We also studied changes in case fatality rate specifically for ETAT+ targeted conditions. Our study cohort consisted of seven intervention hospitals and fourteen matched control hospitals contributing 142,424 neonatal and pediatric hospital admissions. After controlling for secular trends and autocorrelation, we found that the ETAT+ implementation had no statistically significant impact on the rate of all-cause neonatal and pediatric hospital mortality in intervention hospitals relative to control hospitals. However, the case fatality rate for ETAT+ targeted neonatal conditions decreased immediately following implementation by 5% (95% CI: -9.25, -0.77) and over time by 0.8% monthly (95% CI: -1.36, -0.25), in intervention hospitals compared with control hospitals. Case fatality rate for ETAT+ targeted pediatric conditions did not decrease following the ETAT+ implementation. While ETAT+ focuses on improving quality of hospital care for both newborns and children, we only found an impact on neonatal hospital mortality for ETAT+ targeted conditions that should be interpreted with caution given the relatively short pre-intervention period and potential regression to the mean.

Advancing health equity through a theoretically critical implementation science

While implementation science is driven by theory, most implementation science theories, models, and frameworks (TMF) do not address issues of power, inequality, and reflexivity that are pivotal to achieving health equity. Theories used in anthropology address these issues effectively and could complement prevailing implementation science theories and constructs. We propose three broad areas of theory that complement and extend existing TMF in implementation science to advance health equity. First, theories of postcoloniality and reflexivity foreground attention to the role of power in knowledge production and to the ways that researchers and interventionists may perpetuate the inequalities shaping health. Second, theories of structural violence and intersectionality can help us to better understand the unequal burden of health disparities in the population, thereby encouraging researchers to think beyond single interventions to initiate partnerships that can impact overlapping health vulnerabilities and influence the upstream causes of vulnerability. Finally, theories of policy and governance encourage us to examine the social-political forces of the "outer context" crucial for implementation and sustainability. The incorporation of critical theories could enhance implementation science and foster necessary reflexivity among implementation scientists. We contend that a theoretically critical implementation science will promote better science and, more importantly, support progress toward health equity.

Making programmes worth their salt: Assessing the context, fidelity and outcomes of implementation of the double fortified salt programme in Uttar Pradesh, India

Double fortified salt (DFS) has proven efficacy in addressing iron deficiency and anaemia, thus improving maternal and child nutrition outcomes. However, DFS delivery in large‐scale settings is less understood, with limited documentation of its fidelity of implementation (FOI). We assessed the FOI of the DFS intervention in Uttar Pradesh, India, to improve the design and implementation of such programmes that aim to reduce the anaemia burden, especially in women of reproductive age (WRA). We conducted in‐depth interviews with DFS programme staff (n = 25) and end‐user WRAs (23), guided by a programme impact pathway. We transcribed and thematically analysed the interviews and used an adapted analytic framework to document FOI across four domains—objects of intervention, implementation staff, implementation context and target of implementation. DFS utilisation remained low due to a combination of factors including poor product quality, distribution challenges, ineffective promotion and low awareness amongst end‐user WRAs. Motivation levels were higher amongst district‐level staff compared to frontline staff, who lacked supervisory support and effective incentives to promote DFS. Three typologies of DFS users emerged—‘believers’, ‘thrifters’ and ‘naysayers’—who indicated differing reasons for DFS purchase and its use or nonuse. The implementation of the DFS programme varied significantly from its theorised programme impact pathway. The adapted analytic framework helped document FOI and assess the programme's readiness for impact assessments and subsequent scale‐up. The programme needs product quality improvements, incentivised distribution and stronger promotion to effectively deliver and improve the realisation of its potential as an anaemia prevention strategy.

Implementation science protocol for a participatory, theory-informed implementation research programme in the context of health system strengthening in sub-Saharan Africa (ASSET-ImplementER)

OBJECTIVES

ASSET (Health System Strengthening in sub-Saharan Africa) is a health system strengthening (HSS) programme involving eight work-packages (ie, a research study that addresses a specific need for HSS) that aims to develop solutions that support high-quality care. Here we present the protocol for the implementation science (IS) theme within ASSET (ASSET-ImplmentER) that aims to understand what HSS interventions work, for whom and how, and how IS methodologies can be adapted to improve the HSS interventions within resource-poor contexts.

SETTINGS

Publicly funded health facilities in rural and urban areas in in Ethiopia, South Africa, Sierra Leone, and Zimbabwe.

PARTICIPANTS

Research staff including principal investigators, coinvestigators, field staff, PhD students, and research assistants.

INTERVENTIONS

Work-packages use a mixed-methods effectiveness-effectiveness hybrid designs. At the end of the pre-implementation phase, a workshop is held whereby the IS theme, jointly with ASSET work-packages apply IS determinant frameworks to research findings to identify factors that influence the effectiveness of delivering evidence-informed care. Determinants are used to select a set of HSS interventions for further evaluation, where work-packages also theorise selective mechanisms.In the piloting and rolling implementation phase, work-packages pilot the HSS interventions. An iterative process then begins involving evaluation, reflection and adaptation. Throughout this phase, IS determinant frameworks are applied to monitor and identify barriers/enablers to implementation. Selective mechanisms of action are also investigated. Implementation outcomes are evaluated using qualitative and quantitative methods. The psychometric properties of outcome measures including acceptability, appropriateness and feasibility are also evaluated. In a final workshop, work-packages come together, to reflect and explore the utility of the selected IS methods and provide suggestions for future use.Structured templates are used to organise and analyse common and heterogeneous patterns across work-packages. Qualitative data are analysed using thematic analysis and quantitative data are analysed using means and proportions.

CONCLUSIONS

We use a novel combination of IS methods at a programmatic level to facilitate comparisons of determinants and mechanisms that influence the effectiveness of HSS interventions in achieving implementation outcomes across different contexts. The study also contributes conceptual development and clarification at the underdeveloped interface of IS, HSS and global health.The ASSET-ImplementER theme is considered minimal risk as we only interview researchers involved in the different work-packages. To this effect we have received approval from King's College London Ethics Committee for research that is considered minimal risk (Reference number: MRA-20/21-21772).

Defining global health: findings from a systematic review and thematic analysis of the literature

INTRODUCTION

Debate around a common definition of global health has seen extensive scholarly interest within the last two decades; however, consensus around a precise definition remains elusive. The objective of this study was to systematically review definitions of global health in the literature and offer grounded theoretical insights into what might be seen as relevant for establishing a common definition of global health.

METHOD

A systematic review was conducted with qualitative synthesis of findings using peer-reviewed literature from key databases. Publications were identified by the keywords of 'global health' and 'define' or 'definition' or 'defining'. Coding methods were used for qualitative analysis to identify recurring themes in definitions of global health published between 2009 and 2019.

RESULTS

The search resulted in 1363 publications, of which 78 were included. Qualitative analysis of the data generated four theoretical categories and associated subthemes delineating key aspects of global health. These included: (1) global health is a multiplex approach to worldwide health improvement taught and pursued at research institutions; (2) global health is an ethically oriented initiative that is guided by justice principles; (3) global health is a mode of governance that yields influence through problem identification, political decision-making, as well as the allocation and exchange of resources across borders and (4) global health is a vague yet versatile concept with multiple meanings, historical antecedents and an emergent future.

CONCLUSION

Extant definitions of global health can be categorised thematically to designate areas of importance for stakeholders and to organise future debates on its definition. Future contributions to this debate may consider shifting from questioning the abstract 'what' of global health towards more pragmatic and reflexive questions about 'who' defines global health and towards what ends.

A systematic approach to context-mapping to prepare for health interventions: development and validation of the SETTING-tool in four countries

Effectiveness of health interventions can be substantially impaired by implementation failure. Context-driven implementation strategies are critical for successful implementation. However, there is no practical, evidence-based guidance on how to map the context in order to design context-driven strategies. Therefore, this practice paper describes the development and validation of a systematic context-mapping tool. The tool was cocreated with local end-users through a multistage approach. As proof of concept, the tool was used to map beliefs and behaviour related to chronic respiratory disease within the FRESH AIR project in Uganda, Kyrgyzstan, Vietnam and Greece. Feasibility and acceptability were evaluated using the modified Conceptual Framework for Implementation Fidelity. Effectiveness was assessed by the degree to which context-driven adjustments were made to implementation strategies of FRESH AIR health interventions. The resulting Setting-Exploration-Treasure-Trail-to-Inform-implementatioN-strateGies (SETTING-tool) consisted of six steps: (1) Coset study priorities with local stakeholders, (2) Combine a qualitative rapid assessment with a quantitative survey (a mixed-method design), (3) Use context-sensitive materials, (4) Collect data involving community researchers, (5) Analyse pragmatically and/or in-depth to ensure timely communication of findings and (6) Continuously disseminate findings to relevant stakeholders. Use of the tool proved highly feasible, acceptable and effective in each setting. To conclude, the SETTING-tool is validated to systematically map local contexts for (lung) health interventions in diverse low-resource settings. It can support policy-makers, non-governmental organisations and health workers in the design of context-driven implementation strategies. This can reduce the risk of implementation failure and the waste of resource potential. Ultimately, this could improve health outcomes.

Theories Informing eHealth Implementation: Systematic Review and Typology Classification

Background

Theory-guided approaches to implementation science have informed translation efforts and the acceptance of eHealth (digital health) interventions in clinical care. However, there is scarce evidence on which theories are best suited to addressing the inherent complexity of eHealth implementation.

Objective

The objectives of this systematic review are to identify theories that inform and explain eHealth implementation and to classify these theories using the typology by Sovacool and Hess for theories of sociotechnical change.

Methods

An electronic search was conducted in the PsycINFO, MEDLINE, Embase, CINAHL, Scopus, Sociological Source Ultimate, Web of Science, ABI/INFORM, EBSCO, and ProQuest databases in June 2019. Studies were included if they were published between 2009 and June 2019; were written in English; reported on empirical research, regardless of study or publication type; reported on one or more theories in the context of eHealth implementation; and were published in a peer-reviewed journal. A total of 2 reviewers independently assessed the titles, abstracts, and full texts. Theories identified were classified using a typology for theories of sociotechnical change, which was considered a useful tool for ordering and analyzing the diverse theoretical approaches as a basis for future theory building.

Results

Of the 13,101 potentially relevant titles, 119 studies were included. The review identified 36 theories used to explain implementation approaches in eHealth. The most commonly used approaches were the Technology Acceptance Model (TAM) (n=33) and the Unified Theory of Acceptance and Use of Technology (UTAUT) (n=32). These theories were primarily concerned with individual and interpersonal elements of eHealth acceptance. Less common were theories that reflect the various disorderly social processes and structural dimensions of implementation, such as the normalization process theory (n=17) and the structuration theory (n=6).

Conclusions

Theories currently informing the implementation of eHealth interventions predominantly focus on predicting or explaining end-user acceptance. Theoretical perspectives that capture the dense and intricate relationships and structures required to enact sustainable change are less well represented in the eHealth literature. Given the growing acknowledgment of the inherent complexity of eHealth implementation, future research should develop and test models that recognize and reflect the multidimensional, dynamic, and relational nature of this process.

Contextual equipoise: a novel concept to inform ethical implications for implementation research in low-income and middle-income countries

The call for universal health coverage requires the urgent implementation and scale-up of interventions that are known to be effective, in resource-poor settings. Achieving this objective requires high-quality implementation research (IR) that evaluates the complex phenomenon of the influence of context on the ability to effectively deliver evidence-based practice. Nevertheless, IR for global health is failing to apply a robust, theoretically driven approach, leading to ethical concerns associated with research that is not methodologically sound.

Inappropriate methods are often used in IR to address and report on context. This may result in a lack in understanding of how to effectively adapt the intervention to the new setting and a lack of clarity in conceptualising whether there is sufficient evidence to generalise findings from previous IR to a new setting, or if a randomised controlled trial (RCT) is needed. Some of the ethical issues arising from this shortcoming include poor-quality research that may needlessly expose vulnerable participants to research that has not been adapted to suit local needs and priorities, and the inappropriate use of RCTs that denies participants in the control arm access to treatment that is effective within the local context.

To address these concerns, we propose a complementary approach to clinical equipoise for IR, known as contextual equipoise. We discuss challenges in the evaluation of context and also with assessing the certainty of evidence to justify an RCT. Finally, we describe methods that can be applied to improve the evaluation and reporting of context and to help understand if contextual equipoise can be justified or if significant adaptations are required. We hope our analysis offers helpful insight to better understand and ensure that the ethical principle of beneficence is upheld in the real-world contexts of IR in low-resource settings.

Learning from intersectoral action beyond health: a meta-narrative review

Intersectoral action (ISA) is considered pivotal for achieving health and societal goals but remains difficult to achieve as it requires complex efforts, resources and coordinated responses from multiple sectors and organizations. While ISA in health is often desired, its potential can be better informed by the advanced theory-building and empirical application in real-world contexts from political science, public administration and environmental sciences. Considering the importance and the associated challenges in achieving ISA, we have conducted a meta-narrative review, in the research domains of political science, public administration, environmental and health. The review aims to identify theory, theoretical concepts and empirical applications of ISA in these identified research traditions and draw learning for health. Using the multidisciplinary database of SCOPUS from 1996 to 2017, 5535 records were identified, 155 full-text articles were reviewed and 57 papers met our final inclusion criteria. In our findings, we trace the theoretical roots of ISA across all research domains, describing the main focus and motivation to pursue collaborative work. The literature synthesis is organized around the following: implementation instruments, formal mechanisms and informal networks, enabling institutional environments involving the interplay of hardware (i.e. resources, management systems, structures) and software (more specifically the realms of ideas, values, power); and the important role of leaders who can work across boundaries in promoting ISA, political mobilization and the essential role of hybrid accountability mechanisms. Overall, our review reaffirms affirms that ISA has both technical and political dimensions. In addition to technical concerns for strengthening capacities and providing support instruments and mechanisms, future research must carefully consider power and inter-organizational dynamics in order to develop a more fulsome understanding and improve the implementation of intersectoral initiatives, as well as to ensure their sustainability. This also shows the need for continued attention to emergent knowledge bases across different research domains including health.

Protocol for a caregiver psychosocial support intervention for populations affected by displacement in Uganda

BACKGROUND

Child psychological distress in refugee settings is a significant public health concern, which is exacerbated by poor caregiver mental health and functioning. However, there are limited studies about effective interventions to improve caregiver mental health in support of child wellbeing. The objective of the current study is to evaluate the effectiveness and implementation of the Journey of Life (JoL) intervention to improve caregiver mental health in a refugee camp in Western Uganda.

METHODS

A waitlist-control quasi-experimental design is being implemented in the Kiryandongo refugee settlement (intervention n = 600, control n = 600). Caregiver mental distress, measured using the Kessler-6, was selected as the primary outcome. Secondary outcomes include (a) functioning measured by the World Health Organization Disability Assessment Schedule, (b) social support measured by the Medical Outcomes Study Social Support Survey, and (c) caregiving behaviors according to the Parental Acceptance and Rejection Questionnaire and the Child Protection Index. The study aims to examine the implementation of the JoL intervention through qualitative assessments of intervention feasibility, adaptations, and reach.

DISCUSSION

This trial will add much-needed evidence for the implementation of caregiver psychosocial programming within the humanitarian community. Findings will be disseminated amongst local, regional, and global actors in order to guide potential scale up within humanitarian settings.

TRIAL REGISTRATION

Clinical Trials NCT04817098 (Registered: 3/24/21).

The implementation of pharmaceutical services in public hospitals in Mexico: an analysis of the legal framework and organizational practice

BACKGROUND

The implementation of pharmaceutical services in hospitals contributes to the appropriate use of medicines and patient safety. However, the relationship of implementation with the legal framework and organizational practice has not been studied in depth. The objective of this research is to determine the role of these two factors (the legal framework and organizational practice) in the implementation of pharmaceutical services in public hospitals of the Ministry of Health of Mexico.

METHODS

Semi-structured interviews were conducted with four groups of actors involved. The analysis focused on the legal framework, defined as the rules, laws and regulations, and on organizational practice, defined as the implementation of the legal framework by related individuals, that is, how they put it into practice.

RESULTS

The main problems identified were the lack of alignment between the rules and the incentives for compliance. Decision-makers identified the lack of managerial capacity in hospitals as the main implementation barrier, while hospital pharmacists pointed to poor regulation and the lack of clarity of the legal framework as the problems to consider.

CONCLUSIONS

Although the legal framework related to hospital pharmaceutical services in Mexico is inadequate, organizational factors (such as adequate skills of professional pharmacists and the support of the hospital director) have facilitated gradual implementation. To improve implementation, priority should be given to evaluation and modification of the current legislation along with the development of an official minimum standard for activities and services in hospital pharmacies.

A Realist Synthesis of Community-Based Interventions in Vector-Borne Diseases

Randomized control trials have provided evidence that some community-based interventions (CBIs) work in vector-borne diseases (VBDs). Conversely, there is limited evidence on how well those CBIs succeed in producing specific outcomes in different contexts. To conduct a realist synthesis for knowledge translation on this topic, we examined the extent to which realist concepts (context, mechanisms, and outcomes) and their relationships are present in the existing literature on CBIs for VBDs. Articles on CBIs were identified from prior scoping reviews of health interventions for VBDs. Content of the articles was extracted verbatim if it referred either to realist concepts or CBI features. The number of articles and the average number of words extracted per category per CBI were quantified. Content of the articles was scrutinized to inductively gather qualitative evidence on the interactions between realist concepts. We reviewed 41 articles on 17 CBIs from 12 countries. The average number of words used for mechanisms was much lower than those used for outcomes and context (309,474, and 836, respectively). The average number of words used for mechanisms increased when a CBI was described in three or more articles. There were more extensive accounts on CBI features than on mechanisms. It was difficult to gather evidence on the interactions among realist concepts from the content of the articles. Scarce reporting on mechanisms in published articles limits conducting a realist synthesis of CBIs in VBDs. More transdisciplinary research that goes beyond the biomedical paradigm is needed to boost the development of intervention mechanisms in this field.

Have Policies Tackled Gender Inequalities in Health? A Scoping Review

Gender is recognized as one of the most relevant determinants of health inequalities. This scoping review sought to identify and analyse policies, either implemented or formulated as proposals, which aimed to reduce gender inequalities in health. We searched Medline, Web of Science, and Scielo. Of 2895 records, 91 full text articles were analysed, and 33 papers were included. Of these papers, 22 described the process of formulation, implementation, or evaluation of policies whose aim was to reduce gender inequalities in health; six focused on recommendations, and the remaining five dealt with both issues. Our review showed that the policies aimed at reducing gender inequalities in health, either implemented or formulated as proposals, are scarce. Moreover, despite some success, overall progress has been slow. The studies show failures in design and particularly in the implementation process. We found a lack of awareness and capacity in the policy-making progress, under-financing, bureaucratization, shortage of relevant data, and absence of women’s participation in decision-making. Therefore, an emphasis on the design and implementation of gender-sensitive policies seems essential to advance gender equality in health. This scoping review gathers evidence to support the design of such policies and recommendations that can facilitate their implementation.

Factors critical to implementation success of cleaner cooking interventions in low-income and middle-income countries: protocol for an umbrella review

INTRODUCTION

Over a third of the world's population relies on solid fuels as their primary energy source. These fuels have damaging effects on health, air quality and forest resources. Interventions to promote access to cleaner solid fuel cookstoves and clean fuels have existed for decades. However, the adoption by local communities has largely failed, which led to a waste of resources and suboptimal outcomes. Therefore, the objective of this umbrella review is to identify factors that determine implementation success for cleaner cooking interventions in low-resource settings and weigh their level of confidence in the evidence.

METHODS AND ANALYSIS

We identified systematic and narrative reviews examining factors that influence the acquisition, initial adoption or sustained use of cleaner solid fuel cookstoves and clean fuels at any scale by a literature search in PubMed, Embase, Global Health Database, Cochrane, PsycINFO, Emcare, Web of Science and CINAHL, without date or language restrictions. The search was conducted on 23 October 2017 and updated on 10 July 2019. Reviews based on qualitative, quantitative or mixed-methods studies were included and will be appraised using the Meta Quality Appraisal Tool combined with the Assessment of Multiple Systematic Reviews. Data will be extracted and factors affecting implementation will be coded using the Consolidated Framework for Implementation Research. The Grading of Recommendations Assessment, Development and Evaluation-Confidence in the Evidence from Reviews of Qualitative Research tool will be used to determine the level of confidence in the coded factors. Two researchers will independently conduct these steps.

ETHICS AND DISSEMINATION

This umbrella review does not require the approval of an ethical review board. Study results will be published in an international peer-reviewed journal. The outcomes will be converted into two practical tools: one for cleaner solid fuel cookstoves and one for clean fuels. These tools can guide the development of evidence-based implementation strategies for cleaner cooking interventions in low-income and middle-income countries to improve implementation success. These tools should be pilot-tested and promoted among regional and global initiatives.

PROSPERO REGISTRATION NUMBER

CRD42018088687.

Bringing a health systems modelling approach to complex evaluations: multicountry applications in HIV, TB and malaria

INTRODUCTION

Understanding how to deliver interventions more effectively is a growing emphasis in Global Health. Simultaneously, health system strengthening is a key component to improving delivery. As a result, it is challenging to evaluate programme implementation while reflecting real-world complexity. We present our experience in using a health systems modelling approach as part of a mixed-methods evaluation and describe applications of these models.

METHODS

We developed a framework for how health systems translate financial inputs into health outcomes, with in-country and international experts. We collated available data to measure framework indicators and developed models for malaria in Democratic Republic of the Congo (DRC), and tuberculosis in Guatemala and Senegal using Bayesian structural equation modelling. We conducted several postmodelling analyses: measuring efficiency, assessing bottlenecks, understanding mediation, analysing the cascade of care and measuring subnational effectiveness.

RESULTS

The DRC model indicated a strong relationship between shipment of commodities and utilisation thereof. In Guatemala, the strongest model coefficients were more evenly distributed. Results in Senegal varied most, but pathways related to community care had the strongest relationships. In DRC, we used model results to estimate the end-to-end cost of delivering commodities. In Guatemala, we used model results to identify potential bottlenecks and understand mediation. In Senegal, we used model results to identify potential weak links in the cascade of care, and explore subnationally.

CONCLUSION

This study demonstrates a complementary modelling approach to traditional evaluation methods. Although these models have limitations, they can be applied in a variety of ways to gain greater insight into implementation and functioning of health service delivery.

Tailored training for physiotherapists on the use of clinical practice guidelines: A mixed methods study

INTRODUCTION

Clinical practice guidelines (CPG) are vehicles for translating evidence into practice, but effective CPG-uptake requires targeted training. This mixed methods research project took a staged evidence-based approach to develop and test a tailored training programme (TTP) that addressed organisational and individual factors influencing CPG-uptake by South African physiotherapists treating patients with low back pain in primary healthcare settings.

METHODS

This multi-stage mixed methods study reports the development, contextualisation and expert content validation of a TTP to improve CPG-uptake. Finally, the TTP was evaluated for its feasibility and acceptability in its current format.

RESULTS

The TTP (delivered online and face-to-face) contained minimal theory, and focussing on practical activities, clinical scenarios and discussions. Pre-TTP, physiotherapists expressed skepticism about the relevance of CPG in daily practice. However, post-TTP they demonstrated improved knowledge, confidence, and commitment to CPG-uptake.

DISCUSSION

The phased-construction of the TTP addressed South African primary healthcare physiotherapists' needs and concerns, using validated evidence-based educational approaches. The TTP content, delivered by podcasts and face-to-face contact, was feasible and acceptable in terms of physiotherapists' time constraints, and it appeared to be effective in improving all outcome domains. This TTP is now ready for intervention to a wider audience.

Feasibility of using an Early Warning Score for preterm or low birthweight infants in a low-resource setting: results of a mixed-methods study at a national referral hospital in Kenya

INTRODUCTION

Fifteen million babies are born prematurely, before 37 weeks gestational age, globally. More than 80% of these are in sub-Saharan Africa and Asia. 35% of all deaths in the first month of life are due to prematurity and the neonatal mortality rate is eight times higher in low-income and middle-income countries (LMICs) than in Europe. Early Warning Scores (EWS) are a way of recording vital signs using standardised charts to easily identify adverse clinical signs and escalate care appropriately. A range of EWS have been developed for neonates, though none in LMICs. This paper reports the findings of early work to examine if the use of EWS is feasible in LMICs.

METHODS

We conducted an observational study to understand current practices for monitoring of preterm infants at a large national referral hospital in Nairobi, Kenya. Using hospital records, data were collected over an 8-week period in 2019 on all live born infants born at <37 weeks and/or <2500 g (n=294, 255 mothers) in the first week of life. Using a chart adopted from the EWS developed by the British Association of Perinatal Medicine, we plotted infants' vital signs. In addition, we held group discussions with stakeholders in Kenya to examine opinions on use of EWS.

RESULTS

Recording of vital signs was variable; only 63% of infants had at least one temperature recorded and 53% had at least one heart rate and respiratory rate recorded. Stakeholders liked the traffic-light system and simplicity of the chart, though recognised challenges, such as staffing levels and ability to print in colour, to its adoption.

CONCLUSION

EWS may standardise documentation and identify infants who are at higher risk of an adverse outcome. However, human and non-human resource issues would need to be explored further before development of an EWS for LMICs.

A pharmacist-led prospective antibiotic stewardship intervention improves compliance to community-acquired pneumonia guidelines in 39 public and private hospitals across South Africa

INTRODUCTION

Pharmacists in low-middle-income countries (LMIC) are few and lack antibiotic stewardship (AS) training. The ability was assessed of non-specialised pharmacists to implement stewardship interventions and improve adherence to the South African community-acquired pneumonia (CAP) guideline in public and private hospitals.

METHODS

This was a multicentre, prospective cohort study of adult CAP patients hospitalised between July 2017 and July 2018. A CAP bundle was developed of seven process measures (diagnostic and AS) that pharmacists used to audit compliance and provide feedback. CAP bundle compliance rates and change in outcome measures [mortality, length of stay (LOS) and infection-related (IR)-LOS] during pre- and post-implementation periods were compared.

RESULTS

In total, 2464 patients in 39 hospitals were included in the final analysis. Post-implementation, overall CAP bundle compliance improved from 47·8% to 53·6% (confidence interval [CI] 4·1-7·5, p<0·0001), diagnostic stewardship compliance improved from 49·1% to 54·6% (CI 3·3-7·7, p<0·0001) and compliance with AS process measures from 45·3% to 51·6% (CI 4·0-8·6, p<0·0001). Improved compliance with process measures was significant for five (2 diagnostic, 3 AS) of seven components: radiology, laboratory, antibiotic choice, duration and intravenous to oral switch. There was no difference in mortality between the two phases, [4·4%(55/1247) vs. 3·9%(47/1217); p=0·54], median LOS or IR LOS 6·0 vs. 6·0 days (p=0·20) and 5·0 vs. 5·0 days (p=0·40).

CONCLUSION

Non-specialised pharmacists in public and private hospitals implemented stewardship interventions and improved compliance to SA CAP guidelines. The methodology of upskilling and a shared learning stewardship model may benefit LMIC countries.

Institutionalising global health: a call for ethical reflection

We describe a global health course and pedagogy that highlights the moral ambiguity and many ethical compromises that have emerged as the discipline has increasingly become institutionalised. We encourage students to reflect on how the oft-declared aspiration for global health equity still remains seriously contested as a normative and political matter, especially in settings like the USA. We further encourage students to reflect on how authentic concern for social justice, health equity and human rights are consistently undermined by unconscious and/or intentional fealty to standard operating procedures within hierarchical structures and systems. Lastly, we encourage students to openly question and critique the dominant socioeconomic and institutional paradigms that influence practitioner ways of thinking about global health. Our aim is to provide a learning space for students to at least imagine, if not demand, more daring modes of engagement. We also encourage our colleagues in the global health education community to be forthright that the process of institutionalising global health reliably favours our own interests more than those we claim to be most concerned about. If the ideal of global health is to build a bridge to human solidarity, we see substantial risk that current popularised approaches might never yield a structural tipping point.

Building Implementation Science in Nutrition

The field of nutrition has been investing in the development of many nutrition-specific and -sensitive policies and programs aimed at improving population-level malnutrition in all its forms. When there is a need to learn about a new system, programmatic context, or target population to understand how to effectively deploy an intervention to help improve nutrition, it is important to be able to ask a broad range of questions, both in topic and in scope. Our aim is to provide a simple and conceptually clear definition and principles to elaborate the science of implementation for nutrition to distinguish it from other ways of knowing and learning and to serve as a guide to the articulation of implementation science questions and methods. Implementation science is a body of systematized knowledge about how to improve implementation that 1) is distinguished by its aims to learn about the process of implementation, 2) uses methods that derive from and fit with the aims, and 3) is built with tacit (as well as expert) knowledge and experiential learning. Implementation science aims to generate the learning needed to improve implementation through facilitating collaboration among stakeholders to articulate and pursue the aims; capturing and using tacit knowledge and experiential learning from stakeholders, systems, providers, and recipients; and applying a mix of methods suited to the aims. This elaboration of the science provides a simple way to help those who already do, or want to do, implementation science understand and communicate how this science is unique and the value that it adds to the current landscape of nutrition priorities, innovations, and the attendant complex learning needs that follow. Implementation science encompasses both discovery- and mission-oriented research, and centers implementation as the object of study for the purposes of broad-based learning.

Evaluation of a Ten-Year Team-Based Collaborative Capacity-Building Program for Pediatric Cardiac Surgery in Uzbekistan: Lessons and Implications

Background

Most children who have congenital heart disease in low- and middle-income countries (LMICs), including Uzbekistan, do not receive adequate and timely pediatric cardiac surgical care. To strengthen the surgical capacity of a local pediatric cardiac surgery team in Tashkent, Uzbekistan, the JW LEE Center for Global Medicine at Seoul National University College of Medicine has developed a team-based training program and has been collaboratively conducting surgeries and care in order to transfer on-site knowledge and skills from 2009 to 2019.

Objectives

To evaluate the long-term effects of the collaborative program on the cardiac surgical capacity of medical staff (teamwork, surgical complexity, and patients' pre-surgical weights) as well as changes in the lives of the patients and their families. To derive lessons and challenges for other pediatric cardiac surgical programs in LMICs.

Methods

To assess the effects of this ten-year long program, a mixed-methods design was developed to examine the trend of surgical complexity measured by Risk Adjustment for Congenital Heart Surgery 1 score (RACHS-1) and patients' pre-surgical weights via medical record review (surgical cases: n = 107) during the decade. Qualitative data was analyzed from in-depth interviews (n = 31) with Uzbek and Korean medical staff (n = 10; n = 4) and caregivers (n = 17).

Findings

During the decade, the average RACHS-1 of the cases increased from 1.9 in 2010 to 2.78 in 2019. The average weight of patients decreased by 2.8 kg from 13 kg to 10.2 kg during the decade. Qualitative findings show that the surgical capacity, as well as attitudes toward patients and colleagues of the Uzbek medical staff, improved through the effective collaboration between the Uzbek and Korean teams. Changes in the lives of patients and their families were also found following successful surgery.

Conclusions

Team-based training of the workforce in Uzbekistan was effective in improving the surgical skills, teamwork, and attitudes of medical staff, in addition, a positive impact on the life of patients and their families was demonstrated. It can be an effective solution to facilitate improvements in pediatric cardiovascular disease in LMICs if training is sustained over a long period.