A modified theoretical framework to assess implementation fidelity of adaptive public health interventions

To Adapt or Not to Adapt: The Association between Implementation Fidelity and the Effectiveness of Diabetes Self-Management Education

Self-management education (SME) is a key determinant of diabetes treatment outcomes. While SME programs are often adapted for implementation, the impact of adaptations on diabetes SME effectiveness is not well documented. This study evaluated the impact of the implementation fidelity of diabetes SME programs on program effectiveness, exploring which factors influence implementation fidelity. Data from 33 type 2 diabetes SME program providers and 166 patients were collected in 8 countries (Austria, Belgium, Germany, Ireland, UK, Israel, Taiwan and USA). Program providers completed a questionnaire assessing their adherence to the program protocol and factors that influenced the implementation. Patients answered a pre–post questionnaire assessing their diabetes-related health literacy, self-care behavior, general health and well-being. Associations between implementation fidelity and outcomes were estimated through logistic regressions and repeated measures MANOVA, controlling for potential confounders. Adaptations of the program protocol regarding content, duration, frequency and/or coverage were reported by 39% of the providers and were associated with better, not worse, outcomes than strict adherence. None of the factors related to the participants, facilitating strategies, provider or context systematically influenced the implementation fidelity. Future research should focus on individual and contextual factors that may influence decisions to adapt SME programs for diabetes.

Fidelity and factors influencing implementation of Healthy Me, Healthy: process evaluation of a social marketing campaign for diet and physical activity behaviors of children in childcare

The effectiveness of interventions targeting children's eating and physical activity behaviors through childcare settings is inconsistent. To enhance public health impact, it is imperative to evaluate fidelity of implementing complex interventions in real-world settings. This study evaluated fidelity and contextual factors influencing implementation of Healthy Me, Healthy We (HMHW). HMHW was an 8-month social marketing campaign delivered through childcare to support children's healthy eating and physical activity. HMHW required two levels of implementation support (research team and childcare providers) and two levels of campaign delivery (childcare providers and parents). Process evaluation was conducted among childcare centers in the intervention group (n=48) of the cluster-randomized control trial. Measures included attendance logs, self-report surveys, observation checklists, field notes, and semi-structured interviews. A 35-item fidelity index was created to assess fidelity of implementation support and campaign delivery. The fidelity with which HMHW was implemented by childcare providers and parents was low (mean 17.4 out of 35) and decreased between childcare providers and parents. Childcare providers had high acceptability of the program and individual components (80 - 93%). Only half of parents felt intervention components were acceptable. Frequently cited barriers to implementation by childcare providers included time constraints, parent engagement, staff turnover, and restrictive policies. The lack of observable effect of HMHW on children's dietary or physical activity behaviors may be due to inadequate implementation at multiple levels. Different or additional strategies are necessary to support implementation of multilevel interventions, particularly when individuals are expected to deliver intervention components and support others in doing so.

Professionals' management of the fidelity-adaptation dilemma in the use of evidence-based interventions-an intervention study

Background

Evidence-based interventions (EBIs) can be effective tools for the prevention of disease and health promotion. However, their implementation often requires a delicate balance between the need to adjust the intervention to the context in which it is implemented and the need to keep the core components that make the intervention effective. This so-called dilemma between fidelity and adaptation is often handled by health professionals in the sustainment phase of an implementation (i.e., once the intervention has been adopted and institutionalized in an organization), but not much is known about how and to what extent health professionals are affected by this dilemma. Focusing on the sustainment phase, this project aims to study (1) how fidelity and adaptation are managed by professionals using an EBI, (2) how the fidelity–adaptation dilemma affects professionals’ psychosocial working conditions, and (3) how a structured decision support influences professionals’ management of the dilemma and their psychosocial working conditions.

Methods

The study is set in Sweden, and the EBI in focus is a parental program (All Children in Focus). A longitudinal within-person intervention design is used, combined with a cross-sectional survey design. Data sources include web-based questionnaires, brief interviews, fidelity ratings, paper-and-pen questionnaires, and written documentation, collected at multiple time points with both group leaders and parents as respondents.

Discussion

This project approaches fidelity and adaptation from the perspective of the professionals that manage EBIs during the sustainment phase of implementation. Although it is well known that EBIs continue to change over time, it remains to be understood how the fidelity–adaptation dilemma can be managed so that the effectiveness of interventions is retained or improved, not diluted. Moreover, the project adds to the literature by presenting an occupational health perspective on the fidelity–adaptation dilemma. It is acknowledged that fidelity and adaptation may have consequences for not only clients but also the occupational wellbeing of the professionals managing the dilemma, and subsequently, their willingness and ability to deliver EBIs in a sustainable way.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00131-y.

Adapting evidence-informed population health interventions for new contexts: a scoping review of current practice

BACKGROUND

Implementing evidence-informed population health interventions in new contexts often requires adaptations. While the need to adapt interventions to better fit new contexts is recognised, uncertainties remain regarding why and when to adapt (or not), and how to assess the benefits (or not) of adaptation. The ADAPT Study aims to develop comprehensive guidance on adaptation. This scoping review informs guidance development by mapping and exploring how adaptation has been undertaken in practice, in public health and health services research.

METHODS

We searched seven databases from January 2000 and October 2018 to identify eligible studies for this scoping review and a related systematic review of adaptation guidance. We mapped the studies of adaptation by coding data from all eligible studies describing the methods, contexts, and interventions considered for adaptation. From this map, we selected a sample of studies for in-depth examination. Two reviewers extracted data independently into seven categories: description, key concepts, types, rationale, processes, evaluation methods, evaluation justification, and accounts of failures and successes.

RESULTS

We retrieved 6694 unique records. From 429 records screened at full text, we identified 298 eligible studies for mapping and selected 28 studies for in-depth examination. The majority of studies in our map focused on micro- (i.e., individual-) level interventions (84%), related to transferring an intervention to a new population group within the same country (62%) and did not report using guidance (73%). Studies covered a range of topic areas, including health behaviour (24%), mental health (19%), sexual health (16%), and parenting and family-centred interventions (15%). Our in-depth analysis showed that adaptation is seen to save costs and time relative to developing a new intervention, and to enhance contextual relevance and cultural compatibility. It commonly follows a structured process and involves stakeholders to help with decisions on what to adapt, when, and how.

CONCLUSIONS

Adaptation has been undertaken on a range of health topics and largely in line with existing guidance. Significant gaps relate to adaptation of macro- (e.g., national-) level interventions, consideration of programme theories, mechanisms and contexts (i.e., a functional view of interventions), nuances around stakeholder involvement, and evaluation of the adapted interventions. Registration Open Science Framework, 2019, osf.io/udzma.

Evaluating the design and implementation fidelity of an adapted Plan-Do-Study-Act approach to improve health system performance in a Nigerian state

BACKGROUND

The Plan-Do-Study-Act (PDSA) cycle is fundamental to many quality improvement (QI) models. For the approach to be effective in the real-world, variants must align with standard elements of the PDSA. This study evaluates the alignment between theory, design and implementation fidelity of a PDSA variant adapted for Nigeria's health system performance improvement.

METHODS

An iterative consensus building approach was used to develop a scorecard evaluating new conceptual indices of design and implementation fidelity of QI interventions (design and implementation index, defects and gaps) based on Taylor's theoretical framework.

RESULTS

Design (adaptation) scores were optimal across all standard features indicating that design was well adapted to the typical PDSA. Conversely, implementation fidelity scores were only optimal with two standard features: prediction-based test of change and the use of data over time. The other features, use of multiple iterative cycles and documentation had implementation gaps of 17 % and 50 % respectively.

CONCLUSION

This study demonstrates how both adaptation and implementation fidelity are important for success of QI interventions. It also presents an approach for evaluating other QI models using Taylor's PDSA assessment framework as a guide, which might serve to strengthen the theory behind future QI models and provide guidance on their appropriate use.

Acceptability and appropriateness of a novel parent-staff co-leadership model for childhood obesity prevention in Head Start: a qualitative interview study

Background

Peer leadership can be an effective strategy for implementing health programs, benefiting both program participants and peer leaders. To realize such benefits, the peer leader role must be appropriate for the community context. Also, peer leaders must find their role acceptable (i.e., satisfactory) to ensure their successful recruitment and retention. To date, parent peer leaders have seldom been part of early childhood obesity prevention efforts. Moreover, parents at Head Start preschools have rarely been engaged as peer leaders. The aim of this study is to evaluate the appropriateness and acceptability of an innovative model for engaging parents as peer leaders for this novel content area (early childhood obesity prevention) and setting (Head Start).

Methods

Parents Connect for Healthy Living (PConnect) is a 10-session parent program being implemented in Head Start preschools as part of the Communities for Healthy Living early childhood obesity prevention trial. PConnect is co-led by a parent peer facilitator who is paired with a Head Start staff facilitator. In the spring of 2019, 10 PConnect facilitators participated in a semi-structured interview about their experience. Interview transcripts were analyzed by two coders using an inductive-deductive hybrid analysis. Themes were identified and member-checked with two interviewees.

Results

Themes identified applied equally to parent and staff facilitators. Acceptability was high because PConnect facilitators were able to learn and teach, establish meaningful relationships, and positively impact the parents participating in their groups, although facilitators did express frustration when low attendance limited their reach. Appropriateness was also high, as PConnect provided adequate structure and support without being overly rigid, and facilitators were able to overcome most challenges they encountered.

Conclusions

The PConnect co-facilitation model was highly acceptable and appropriate for both the parent facilitators (peer leaders) and the staff facilitators. Including parents as peer leaders aligns to Head Start’s emphasis on parent engagement, making it a strong candidate for sustained implementation in Head Start. The insights gained about the drivers of peer leadership appropriateness and acceptability in this particular context may be used to inform the design and implementation of peer-led health programs elsewhere.

Trial registration

clinicaltrials.gov, NCT03334669 (7–11-17).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-10159-3.

Factors influencing variation in implementation outcomes of the redesigned community health fund in the Dodoma region of Tanzania: a mixed-methods study

Introduction

Micro-health insurance (MHI) has been identified as a possible interim solution to foster progress towards Universal Health Coverage (UHC) in low- and middle- income countries (LMICs). Still, MHI schemes suffer from chronically low penetration rates, especially in sub-Saharan Africa. Initiatives to promote and sustain enrolment have yielded limited effect, yet little effort has been channelled towards understanding how such initiatives are implemented. We aimed to fill this gap in knowledge by examining heterogeneity in implementation outcomes and their moderating factors within the context of the Redesigned Community Health Fund in the Dodoma region in Tanzania.

Methods

We adopted a mixed-methods design to examine implementation outcomes, defined as adoption and fidelity of implementation (FOI) as well as their moderating factors. A survey questionnaire collected individual level data and a document review checklist and in-depth interview guide collected district level data. We relied on descriptive statistics, a chi square test and thematic analysis to analyse our data.

Results

A review of district level data revealed high adoption (78%) and FOI (77%) supported also by qualitative interviews. In contrast, survey participants reported relatively low adoption (55%) and FOI (58%). Heterogeneity in adoption and FOI was observed across the districts and was attributed to organisational weakness or strengths, communication and facilitation strategies, resource availability (fiscal capacity, human resources and materials), reward systems, the number of stakeholders, leadership engagement, and implementer’s skills.

At an individual level, heterogeneity in adoption and FOI of scheme components was explained by the survey participant’s level of education, occupation, years of stay in the district and duration of working in the scheme. For example, the adoption of job description was statistically associated with occupation (p = 0.001) and wworking in the scheme for more than 20 months had marginal significant association with FOI (p = 0.04).

Conclusion

The study demonstrates that assessing the implementation processes helps to detect implementation weaknesses and therefore address such weaknesses as the interventions are implemented or rolled out to other settings. Attention to contextual and individual implementer elements should be paid in advance to adjust implementation strategies and ensure greater adoption and fidelity of implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-020-10013-y.

Influence of organizational and social contexts on the implementation of culturally adapted hypertension control programs in Asian American-serving grocery stores, restaurants, and faith-based community sites: a qualitative study

Hypertension affects a third of U.S. adults and is especially high among Asian American groups. The Racial and Ethnic Approaches to Community Health for Asian AmeRicans (REACH FAR) project delivers culturally adapted, evidence-based hypertension-related programs to Bangladeshi, Filipino, Korean, and Asian Indian communities in New York and New Jersey through 26 sites: ethnic grocery stores, restaurants, and Muslim, Christian, and Sikh faith-based organizations. Knowledge of the implementation mechanisms of culturally adapted programs is limited and is critical to inform the design and execution of such programs by and in community sites. We applied four categories of the Consolidated Framework for Implementation Research-intervention and individuals' characteristics, inner and outer setting-to analyze factors influencing implementation outcomes, that is, site leaders' perceptions about adopting, adapting, and sustaining REACH FAR. We conducted semistructured interviews with 15 leaders, coded them for implementation outcomes, and recoded them to identify contextual factors. Our findings show that REACH FAR resonated in sites where leaders perceived unhealthy diet and lifestyles in their communities (intervention characteristics), sites had historically engaged in health programs as a public-service mission (inner setting), and leaders identified with this mission (individuals' characteristics). Site leaders strived to adapt programs to respond to community preferences (outer setting) without compromising core objectives (inner setting). Leaders noted that program sustainability could be impeded by staff and volunteer turnover (inner setting) but enhanced by reinforcing programs through community networks (outer setting). The findings suggest that to facilitate implementation of culturally adapted health behavior programs through community sites, interventions should reinforce sites' organizational commitments and social ties.

Evidence for action: a One Health learning platform on interventions to tackle antimicrobial resistance

Improving evidence for action is crucial to tackle antimicrobial resistance. The number of interventions for antimicrobial resistance is increasing but current research has major limitations in terms of efforts, methods, scope, quality, and reporting. Moving the agenda forwards requires an improved understanding of the diversity of interventions, their feasibility and cost-benefit, the implementation factors that shape and underpin their effectiveness, and the ways in which individual interventions might interact synergistically or antagonistically to influence actions against antimicrobial resistance in different contexts. Within the efforts to strengthen the global governance of antimicrobial resistance, we advocate for the creation of an international One Health platform for online learning. The platform will synthesise the evidence for actions on antimicrobial resistance into a fully accessible database; generate new scientific insights into the design, implementation, evaluation, and reporting of the broad range of interventions relevant to addressing antimicrobial resistance; and ultimately contribute to the goal of building societal resilience to this central challenge of the 21st century.

Guidance for conducting feasibility and pilot studies for implementation trials

BACKGROUND

Implementation trials aim to test the effects of implementation strategies on the adoption, integration or uptake of an evidence-based intervention within organisations or settings. Feasibility and pilot studies can assist with building and testing effective implementation strategies by helping to address uncertainties around design and methods, assessing potential implementation strategy effects and identifying potential causal mechanisms. This paper aims to provide broad guidance for the conduct of feasibility and pilot studies for implementation trials.

METHODS

We convened a group with a mutual interest in the use of feasibility and pilot trials in implementation science including implementation and behavioural science experts and public health researchers. We conducted a literature review to identify existing recommendations for feasibility and pilot studies, as well as publications describing formative processes for implementation trials. In the absence of previous explicit guidance for the conduct of feasibility or pilot implementation trials specifically, we used the effectiveness-implementation hybrid trial design typology proposed by Curran and colleagues as a framework for conceptualising the application of feasibility and pilot testing of implementation interventions. We discuss and offer guidance regarding the aims, methods, design, measures, progression criteria and reporting for implementation feasibility and pilot studies.

CONCLUSIONS

This paper provides a resource for those undertaking preliminary work to enrich and inform larger scale implementation trials.

Low theoretical fidelity hinders the research on health coaching for opioid reduction: A systematic review of randomized controlled trials

Purpose

To systematically review the literature in order to evaluate the effects of health coaching on patients’ reduction of opioid usage and opioid discontinuation. In addition, this systematic review investigated the effects of health coaching on pain intensity, physical function, and quality of life.

Methods

Four electronic databases (PubMed, Embase, Scopus, and PsychINFO) were searched from inception to December 2019. Randomized controlled trials assessing the effects of health coaching interventions in adult patients currently using opioids were included. We considered trials if they included any of the four defined key constructs of health coaching adopted in this review: motivational interviewing, positive psychology, the transtheoretical model, and self-determination theory Independent reviewers screened and selected studies, extracted data, and assessed risk of bias using Revised Cochrane risk-of-bias tool for randomized trials (RoB2) and quality of evidence using Grading, Recommendation, Assessment, Development, and Evaluation (GRADE). The review is registered in the International Prospective Register of Systematic Reviews (PROSPERO) databased as CRD42019136201. It was not possible to perform a meta-analysis due to heterogeneity between included trials.

Results

Eleven studies met our inclusion criteria (n = 4,516 participants). No study assessed all four constructs of health coaching. All eleven studies utilized only one of the constructs, brief motivational interviewing. Thus, we reported our results in terms of motivational interviewing. There is conflicting and very low quality of evidence that brief motivational interviewing may or may not be more effective than education to reduce opioid usage. There is very low quality of evidence that brief motivational interviewing is more effective than educational monthly diaries to reduce opioid use. There is very low to low quality of evidence that brief motivational interviewing is not more effective than no behavioral intervention to reduce opioid use at 6 months follow-up, treatment as usual (TAU) to improve overdose risk behaviors, and TAU to improve physical and psychological health.

Conclusion

There is no direct evidence related to the effect of health coaching on opioid reduction. There is limited, low quality evidence to conclude brief motivational interviewing reduces opioid usage in opioid-dependent patients. Future research should focus on the impact of high theoretical health coaching interventions on opioid usage.

Intervention planning for Antibiotic Review Kit (ARK): a digital and behavioural intervention to safely review and reduce antibiotic prescriptions in acute and general medicine

Background

Hospital antimicrobial stewardship strategies, such as ‘Start Smart, Then Focus’ in the UK, balance the need for prompt, effective antibiotic treatment with the need to limit antibiotic overuse using ‘review and revise’. However, only a minority of review decisions are to stop antibiotics. Research suggests that this is due to both behavioural and organizational factors.

Objectives

To develop and optimize the Antibiotic Review Kit (ARK) intervention. ARK is a complex digital, organizational and behavioural intervention that supports implementation of ‘review and revise’ to help healthcare professionals safely stop unnecessary antibiotics.

Methods

A theory-, evidence- and person-based approach was used to develop and optimize ARK and its implementation. This was done through iterative stakeholder consultation and in-depth qualitative research with doctors, nurses and pharmacists in UK hospitals. Barriers to and facilitators of the intervention and its implementation, and ways to address them, were identified and then used to inform the intervention’s development.

Results

A key barrier to stopping antibiotics was reportedly a lack of information about the original prescriber’s rationale for and their degree of certainty about the need for antibiotics. An integral component of ARK was the development and optimization of a Decision Aid and its implementation to increase transparency around initial prescribing decisions.

Conclusions

The key output of this research is a digital and behavioural intervention targeting important barriers to stopping antibiotics at review (see http://bsac-vle.com/ark-the-antibiotic-review-kit/ and http://antibioticreviewkit.org.uk/). ARK will be evaluated in a feasibility study and, if successful, a stepped-wedge cluster-randomized controlled trial at acute hospitals across the NHS.

The Development and Process Evaluation of a 3-Day Acceptance and Commitment Therapy Group Program for Adolescent Cancer Survivors

Background

Adolescents diagnosed with cancer experience unique psychosocial concerns that persist beyond treatment completion into longer-term survivorship. Camp-based, group Acceptance and Commitment Therapy (ACT) programs are a potential model for providing evidence-informed psychological and peer support to adolescent cancer survivors.

Objective

This paper describes the development and exploration of the feasibility and acceptability of such a program, Places You’ll Go. This manualised program incorporates five 90-min group ACT sessions within a 3-day camp, teaching ACT strategies in the context of psychosocial impacts of cancer.

Method

Eight facilitators and twenty-eight Australian adolescent cancer survivors (68% female; age range 12–17 years, M = 15.4 years) participated in the program and evaluation. Feasibility was assessed using facilitator-reported session duration, attendance, quality and content fidelity; facilitators also completed interviews after program completion. Young people completed surveys on program acceptability at the end of each session and at program completion.

Results

All planned sessions were delivered, with 97% attendance and high fidelity in manualised program delivery. All young people were mostly or very satisfied and would recommend the program to another cancer survivor. Opportunities for peer connection and skill development contributed to perceived program acceptability.

Conclusions

The Places You’ll Go program was acceptable and feasible to deliver. It is a promising community-based model for promoting peer support and well-being in adolescent cancer survivors, indicating the potential of ACT-based approaches for this population. Further work is underway to evaluate whether the program improves psychosocial wellbeing among participants, and if this is linked to the therapeutic mechanisms underpinning ACT.

Towards a better integration of social sciences in arbovirus research and decision-making: an experience from scientific collaboration between Cuban and Quebec institutions

In 2017, the Institute of Tropical Medicine Pedro Kourí, University of Montreal Public Health Research Institute, and McGill University joined efforts to provide scenarios for scientific exchange and knowledge dissemination about the social science contribution on arboviral research. This commentary describes the scientific collaboration between Cuban and Canadian (Quebec) institutions, illustrating the need and opportunities to facilitate research and effective decision-making processes for arboviral prevention and control, going beyond traditional biomedical aspects. We organized a set of scientific activities within three international events conducted in Cuba between 2017 and 2018. Given the collaborating institutions' expertise and the knowledge gaps in arboviral research, we selected three main thematic areas: social determinants and equity, community-based interventions and use of evidence for decision-making. The partnership shows that interdisciplinary collaboration and the use and integration of quantitative and qualitative methods from the social sciences is essential to face the current challenges in arbovirus research.

Design of a cluster-randomized trial of the effectiveness and cost-effectiveness of metformin on prevention of type 2 diabetes among prediabetic Mexican adults (the PRuDENTE initiative of Mexico City)

INTRODUCTION

Type 2 diabetes (T2D) is a global epidemic, and nations are struggling to implement effective healthcare strategies to reduce the burden. While efficacy studies demonstrate that metformin can reduce incident T2D by half among younger, obese adults with prediabetes, its real-world effectiveness are understudied, and its use for T2D prevention in primary care is low. We describe the design of a pragmatic trial to evaluate the incremental effectiveness of metformin, as an adjunct to a simple lifestyle counseling.

METHODS

The "Prevención de la Diabetes con Ejercicio, Nutrición y Tratamiento" [Diabetes Prevention with Exercise, Nutrition and Treatment; PRuDENTE, (Spanish acronym)] is a cluster-randomized trial in Mexico City's public primary healthcare system. The study randomly assigns 51 clinics to deliver one of two interventions for 36 months: 1) lifestyle only; 2) lifestyle plus metformin, to 3060 patients ages 30-65 with impaired fasting glucose and obesity. The primary endpoint is incident T2D (fasting glucose ≥126 mg/dL, or HbA1c ≥6.5%). We will also measure a range of implementation-related process outcomes at the clinic-, clinician- and patient-levels to inform interpretations of effectiveness and enable efforts to refine, adapt, adopt and disseminate the model. We will also estimate the cost-effectiveness of metformin as an adjunct to lifestyle counseling in Mexico.

DISCUSSION

Findings from this pragmatic trial will generate new translational knowledge in Mexico and beyond, both with respect to metformin's real-world effectiveness among an 'at-risk' population, and uncovering facilitators and barriers to the reach, adoption and implementation of metformin preventive therapy in public primary care settings.

TRIAL REGISTRATION

This trial is registered at Clinicaltrials.gov (NCT03194009).

Communities for Healthy Living (CHL) A Community-based Intervention to Prevent Obesity in Low-Income Preschool Children: Process Evaluation Protocol

BACKGROUND

Process evaluation can illuminate barriers and facilitators to intervention implementation as well as the drivers of intervention outcomes. However, few obesity intervention studies have documented process evaluation methods and results. Community-based participatory research (CBPR) requires that process evaluation methods be developed to (a) prioritize community members' power to adapt the program to local needs over strict adherence to intervention protocols, (b) share process evaluation data with implementers to maximize benefit to participants, and (c) ensure partner organizations are not overburdened. Co-designed with low-income parents using CBPR, Communities for Healthy Living (CHL) is a family-centered intervention implemented within Head Start to prevent childhood obesity and promote family well-being. We are currently undertaking a randomized controlled trial to test the effectiveness of CHL in 23 Head Start centers in the greater Boston area. In this protocol paper, we outline an embedded process evaluation designed to monitor intervention adherence and adaptation, support ongoing quality improvement, and examine contextual factors that may moderate intervention implementation and/or effectiveness.

METHODS

This mixed methods process evaluation was developed using the Pérez et al. framework for evaluating adaptive interventions and is reported following guidelines outlined by Grant et al. Trained research assistants will conduct structured observations of intervention sessions. Intervention facilitators and recipients, along with Head Start staff, will complete surveys and semi-structured interviews. De-identified data for all eligible children and families will be extracted from Head Start administrative records. Qualitative data will be analyzed thematically. Quantitative and qualitative data will be integrated using triangulation methods to assess intervention adherence, monitor adaptations, and identify moderators of intervention implementation and effectiveness.

DISCUSSION

A diverse set of quantitative and qualitative data sources are employed to fully characterize CHL implementation. Simultaneously, CHL's process evaluation will provide a case study on strategies to address the challenges of process evaluation for CBPR interventions. Results from this process evaluation will help to explain variation in intervention implementation and outcomes across Head Start programs, support CHL sustainability and future scale-up, and provide guidance for future complex interventions developed using CBPR.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03334669 . Registered on October 10, 2017.

Implementing mHealth Interventions in a Resource-Constrained Setting: Case Study From Uganda

Background

Mobile health (mHealth) interventions are becoming more common in low-income countries. Existing research often overlooks implementation challenges associated with the design and technology requirements of mHealth interventions.

Objective

We aimed to characterize the challenges that we encountered in the implementation of a complex mHealth intervention in Uganda.

Methods

We customized a commercial mobile survey app to facilitate a two-arm household-randomized, controlled trial of home-based tuberculosis (TB) contact investigation. We incorporated digital fingerprinting for patient identification in both study arms and automated SMS messages in the intervention arm only. A local research team systematically documented challenges to implementation in biweekly site visit reports, project management reports, and minutes from biweekly conference calls. We then classified these challenges using the Consolidated Framework for Implementation Research (CFIR).

Results

We identified challenges in three principal CFIR domains: (1) intervention characteristics, (2) inner setting, and (3) characteristics of implementers. The adaptability of the app to the local setting was limited by software and hardware requirements. The complexity and logistics of implementing the intervention further hindered its adaptability. Study staff reported that community health workers (CHWs) were enthusiastic regarding the use of technology to enhance TB contact investigation during training and the initial phase of implementation. After experiencing technological failures, their trust in the technology declined along with their use of it. Finally, complex data structures impeded the development and execution of a data management plan that would allow for articulation of goals and provide timely feedback to study staff, CHWs, and participants.

Conclusions

mHealth technologies have the potential to make delivery of public health interventions more direct and efficient, but we found that a lack of adaptability, excessive complexity, loss of trust among end users, and a lack of effective feedback systems can undermine implementation, especially in low-resource settings where digital services have not yet proliferated. Implementers should anticipate and strive to avoid these barriers by investing in and adapting to local human and material resources, prioritizing feedback from end users, and optimizing data management and quality assurance procedures.

Trial Registration

Pan-African Clinical Trials Registration PACTR201509000877140; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=877

Primary Palliative Care for Emergency Medicine (PRIM-ER): Applying form and function to a theory-based complex intervention

Background

Emergency departments are seeing an increase in acute exacerbations of chronic disease in the older-adult population. The delivery of palliative care in the emergency department can increase goal-concordant care at the end-of-life for this population. New interventions in palliative care for emergency medicine require large, pragmatic, complex health interventions due to the heterogeneous and dynamic environment of emergency departments. These complex interventions must balance fidelity with adaptability, while being rooted in theory, to produce an intervention that can be applied in a variety of contexts.

Methods

Primary Palliative Care for Emergency Medicine (PRIM-ER) is a large, pragmatic, complex health intervention. This paper outlines the conceptual theory-based design as well as the study form and functions of PRIM-ER to exemplify how this complex intervention has balanced fidelity with adaptability.

Results

A form and function matrix was created to highlight the key objectives and tailored intervention components of PRIM-ER. Each intervention component was also linked to one or more elements of the Theory of Planned Behavior to support provider behavior change and the delivery of palliative care services and referrals.

Conclusion

The application of theory and delineation of forms and functions, as well prospective adaptation monitoring of large complex interventions can support the balance of fidelity with adaptability to encourage successful interventions among a variety of clinical environments.

•

PRIM-ER is a quality improvement complex intervention to enhance goal-concordant care in the emergency department.

•

Complex interventions must balance fidelity with adaptability to enable transferability across various contexts..

•

Applying form and function in a theory-based conceptual model supports fidelity and adaptability in complex interventions.

Using implementation science theories and frameworks in global health

In global health, researchers and decision makers, many of whom have medical, epidemiology or biostatistics background, are increasingly interested in evaluating the implementation of health interventions. Implementation science, particularly for the study of public policies, has existed since at least the 1930s. This science makes compelling use of explicit theories and analytic frameworks that ensure research quality and rigour. Our objective is to inform researchers and decision makers who are not familiar with this research branch about these theories and analytic frameworks. We define four models of causation used in implementation science: intervention theory, frameworks, middle-range theory and grand theory. We then explain how scientists apply these models for three main implementation studies: fidelity assessment, process evaluation and complex evaluation. For each study, we provide concrete examples from research in Cuba and Africa to better understand the implementation of health interventions in global health context. Global health researchers and decision makers with a quantitative background will not become implementation scientists after reading this article. However, we believe they will be more aware of the need for rigorous implementation evaluations of global health interventions, alongside impact evaluations, and in collaboration with social scientists.

Developing a conceptual framework for implementation science to evaluate a nutrition intervention scaled-up in a real-world setting

Objective:

The aim of this paper is to identify and develop a comprehensive conceptual framework using implementation science that can be applied to assess a nutrition intervention in a real-world setting.

Design:

We conducted a narrative review using electronic databases and a manual search to identify implementation science frameworks, models and theories published in peer-reviewed journals. We performed a qualitative thematic analysis of these publications to generate a framework that could be applied to nutrition implementation science.

Results:

Based on this review, we developed a comprehensive framework which we have conceptualised as an implementation science process that describes the transition from the use of scientific evidence through to scaling-up with the aim of making an intervention sustainable. The framework consisted of three domains: Domain i – efficacy to effectiveness trials, Domain ii – scaling-up and Domain iii – sustainability. These three domains encompass five components: identifying an ‘effective’ intervention; scaling-up and implementation fidelity; course corrections during implementation; promoting sustainability of interventions and consideration of a comprehensive methodological paradigm to identify ‘effective’ interventions and to assess the process and outcome indicators of implementation. The framework was successfully applied to a nutrition implementation program in Bangladesh.

Conclusions:

Our conceptual framework built from an implantation science perspective offers a comprehensive approach supported by a foundational and holistic understanding of its key components. This framework provides guidance for implementation researchers, policy-makers and programme managers to identify and review an effective intervention, to scale it up and to sustain it over time.

Sustainable, healthy cities: protocol of a mixed methods evaluation of a cluster randomized controlled trial for Aedes control in Brazil using a community mobilization approach

Background

Dengue is increasing in its global presence with an estimated 4 billion people at-risk of infection in at least 128 countries. Despite the promising results of EcoHealth and community mobilization approaches to Aedes reduction, more evidence of their efficacy on reducing dengue risk is needed. The principal research question is to determine if interventions based upon community mobilization reduce the risk of dengue virus infection among children 3 to 9 years old compared to usual dengue control practice in Fortaleza, Brazil.

Methods

The present study will follow a pragmatic cluster randomized controlled trial (cRCT) design with randomization at the census tract level with equal allocation to the two arms. In each arm, there will be 34 clusters of 86 children between 3 to 9 years old for an expected total of 5848 children enrolled in the study, assuming a risk reduction of 29.5% based upon findings from a previous multi-site cRCT. The primary outcomes are rates of anti-dengue Immunoglobulin G (IgG) seroconversion and adult female Aedes density. The intervention is based upon a participatory health research approach, Socializing Evidence for Participatory Action (SEPA), where the research evidence is used to foster community engagement and ownership of the health issue and solution. Following allocation, intervention communities will develop and implement their own solutions that will likely include a wide variety of collective events and media approaches. Data collection activities over a period of 3 years include household visits for blood collection, household surveys, and entomological surveys; and qualitative activities including focus groups, in-depth interviews, and document analysis to evaluate the process, acceptability, fidelity, and sustainability of the intervention. Study participants will be aware of their assignment and all research staff will be blinded although the intervention assignment will likely be revealed to field staff through interaction with participants.

Discussion

The results of our study will provide evidence on community mobilization as an intervention for dengue control. We anticipate that if community mobilization is effective in Fortaleza, the results of this study will help develop evidence-based vector control programs in Brazil, and also in other countries struggling with Aedes-transmitted diseases.

Trial registration

ISRCTN66131315, registration date: 1 October 2018.

Peer-support to increase uptake of screening for diabetic retinopathy: process evaluation of the DURE cluster randomized trial

BACKGROUND

There is limited evidence on how implementation of peer support interventions influences effectiveness, particularly for individuals with diabetes. We conducted a cluster randomized controlled trial to compare the effectiveness of a peer-led health education package versus usual care to increase uptake of screening for diabetic retinopathy (DR).

METHODS

Our process evaluation used a mixed-method design to investigate the recruitment and retention, reach, dose, fidelity, acceptability, and context of implementation, and was guided by the Consolidated Framework for Implementation Research (CFIR). We reviewed trial documents, conducted semi-structured interviews with key informants (n = 10) and conducted four focus group discussions with participants in both arms of the trial. Three analysts undertook CFIR theory-driven content analysis of the qualitative data. Quantitative data was analyzed to provide descriptive statistics relevant to the objectives of the process evaluation.

RESULTS

The trial had positive implementation outcomes, 100% retention of clusters and 96% retention for participants, 83% adherence to delivery of content of group talks (fidelity), and 78% attendance (reach) to at least 50% (3/6) of the group talks (dose). The data revealed that intervention characteristics, outer setting, inner setting, individual characteristics, and process (all the constructs of CFIR) influenced the implementation. There were more facilitators than barriers to the implementation. Facilitators included the relative advantage of the intervention compared with current practice (intervention characteristics); awareness of the growing prioritization of diabetes in the national health policy framework (outer setting); tension for change due to the realization of the vulnerability to vision loss from DR (inner setting); a strong collective sense of accountability of peer supporters to implement the intervention (individual characteristics); and regular feedback on the progress with implementation (process). Potential barriers included the need to queue at the eye clinic (intervention characteristic), travel inconveniences (inner setting), and socio-political disruption (outer setting).

CONCLUSIONS

The intervention was implemented with high retention, reach, fidelity, and dose. The CFIR provided a valuable framework for evaluating contextual factors that influenced implementation and helped to understand what adaptations may be needed during scale up.

TRIAL REGISTRATION

Pan African Clinical Trials Registry: PACTR201707002430195 registered 15 July 2017.

Adapting evidence-informed complex population health interventions for new contexts: a systematic review of guidance

BACKGROUND

Adapting interventions that have worked elsewhere can save resources associated with developing new interventions for each specific context. While a developing body of evidence shows benefits of adapted interventions compared with interventions transported without adaptation, there are also examples of interventions which have been extensively adapted, yet have not worked in the new context. Decisions on when, to what extent, and how to adapt interventions therefore are not straightforward, particularly when conceptualising intervention effects as contingent upon contextual interactions in complex systems. No guidance currently addresses these questions comprehensively. To inform development of an overarching guidance on adaptation of complex population health interventions, this systematic review synthesises the content of the existing guidance papers.

METHODS

We searched for papers published between January 2000 and October 2018 in 7 bibliographic databases. We used citation tracking and contacted authors and experts to locate further papers. We double screened all the identified records. We extracted data into the following categories: descriptive information, key concepts and definitions, rationale for adaptation, aspects of adaptation, process of adaptation, evaluating and reporting adapted interventions. Data extraction was conducted independently by two reviewers, and retrieved data were synthesised thematically within pre-specified and emergent categories.

RESULTS

We retrieved 6694 unique records. Thirty-eight papers were included in the review representing 35 sources of guidance. Most papers were developed in the USA in the context of implementing evidence-informed interventions among different population groups within the country, such as minority populations. We found much agreement on how the papers defined key concepts, aims, and procedures of adaptation, including involvement of key stakeholders, but also identified gaps in scope, conceptualisation, and operationalisation in several categories.

CONCLUSIONS

Our review found limitations that should be addressed in future guidance on adaptation. Specifically, future guidance needs to be reflective of adaptations in the context of transferring interventions across countries, including macro- (e.g. national-) level interventions, better theorise the role of intervention mechanisms and contextual interactions in the replicability of effects and accordingly conceptualise key concepts, such as fidelity to intervention functions, and finally, suggest evidence-informed strategies for adaptation re-evaluation and reporting.

TRIAL REGISTRATION

PROSPERO 2018, CRD42018112714.

The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation

BACKGROUND

There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed.

DISCUSSION

There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

Implementation of a group-based diabetes prevention program within a healthcare delivery system

BACKGROUND

Group-based Diabetes Prevention Programs (DPP), aligned with recommendations from the Centers for Disease Control and Prevention, promote clinically significant weight loss and reduce cardio-metabolic risks. Studies have examined implementation of the DPP in community settings, but less is known about its integration in healthcare systems. In 2010, a group-based DPP known as the Group Lifestyle Balance (GLB) was implemented within a large healthcare delivery system in Northern California, across three geographically distinct regional administration divisions of the organization within 12 state counties, with varying underlying socio-demographics. The regional divisions implemented the program independently, allowing for natural variation in its real-world integration. We leveraged this natural experiment to qualitatively assess the implementation of a DPP in this healthcare system and, especially, its fidelity to the original GLB curriculum and potential heterogeneity in implementation across clinics and regional divisions.

METHODS

Using purposive sampling, we conducted semi-structured interviews with DPP lifestyle coaches. Data were analyzed using mixed-method techniques, guided by an implementation outcomes framework consisting of eight constructs: acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, and sustainability.

RESULTS

We conducted 33 interviews at 20 clinics across the three regional administrative divisions. Consistencies in implementation of the program were found across regions in terms of satisfaction with the evidence base (acceptability), referral methods (adoption), eligibility criteria (fidelity), and strategies to increase retention and effectiveness (sustainability). Heterogeneity in implementation across regions were found in all categories, including: the number and frequency of sessions (fidelity); program branding (adoption); lifestyle coach training (adoption), and patient-facing cost (cost). Lifestyle coaches expressed differing attitudes about curriculum content (acceptability) and suitability of educational level (appropriateness). While difficulties with recruitment were common across regions (feasibility), strategies used to address these challenges differed (sustainability).

CONCLUSIONS

Variation exists in the implementation of the DPP within a large multi-site healthcare system, revealing a dynamic and important tension between retaining fidelity to the original program and tailoring the program to meet the local needs. Moreover, certain challenges across sites may represent opportunities for considering alternative implementation to anticipate these barriers. Further research is needed to explore how differences in implementation domains impact program effectiveness.

Response to the commentary "to the bone"

•

Presenting process data - even in the absence of outcome data - supports a timely understanding of new, complex programs.

•

Seminal frameworks guided this research, but our emphasis on moderators was guided by data rather than frameworks.

•

Complexity here refers to a gap between what seemed feasible (early on) vs. what ultimately was feasible (mid-intervention).

Is quality affordable for community health systems? Costs of integrating quality improvement into close-to-community health programmes in five low-income and middle-income countries

Introduction

Countries aspiring to universal health coverage view close-to-community (CTC) providers as a low-cost means of increasing coverage. However, due to lack of coordination and unreliable funding, the quality of large-scale CTC healthcare provision is highly variable and routine data about service quality are not trustworthy. Quality improvement (QI) approaches are a means of addressing these issues, yet neither the costs nor the budget impact of integrating QI approaches into CTC programme costs have been assessed.

Methods

This paper examines the costs and budget impact of integrating QI into existing CTC health programmes in five countries (Ethiopia, Indonesia, Kenya, Malawi, Mozambique) between 2015 and 2017. The intervention involved: (1) QI team formation; (2) Phased training interspersed with supportive supervision; which resulted in (3) QI teams independently collecting and analysing data to conduct QI interventions. Project costs were collected using an ingredients approach from a health systems perspective. Based on project costs, costs of local adoption of the intervention were modelled under three implementation scenarios.

Results

Annualised economic unit costs ranged from $62 in Mozambique to $254 in Ethiopia per CTC provider supervised, driven by the context, type of community health model and the intensity of the intervention. The budget impact of Ministry-led QI for community health is estimated at 0.53% or less of the general government expenditure on health in all countries (and below 0.03% in three of the five countries).

Conclusion

CTC provision is a key component of healthcare delivery in many settings, so QI has huge potential impact. The impact is difficult to establish conclusively, but as a first step we have provided evidence to assess affordability of QI for community health. Further research is needed to assess whether QI can achieve the level of benefits that would justify the required investment.

Explaining variation of implementation outcomes of centralized waiting lists for unattached patients

Purpose

Centralized waiting lists (CWLs) for patient attachment to a primary care provider have been implemented across Canada, including Quebec. Little is known about the implementation of CWLs and the factors that influence implementation outcomes of such primary care innovations. The purpose of this paper is to explain variations in the outcomes of implementation by analyzing the characteristics of CWLs and contextual factors that influence their implementation.

Design/methodology/approach

A multiple qualitative case study was conducted. Four contrasting CWLs were purposefully selected: two relatively high-performing and two relatively low-performing cases with regard to process indicators. Data collected between 2015 and 2016 drew on three sources: 26 semi-structured interviews with key stakeholders, 22 documents and field notes. The Consolidated Framework for Implementation Research was used to identify, through a cross-case comparison of ratings, constructs that distinguish high from low-performing cases.

Findings

Five constructs distinguished high from low-performing cases: three related to the inner setting: network and communications; leadership engagement; available resources; one from innovation characteristics: adaptability with regard to registration, evaluation of priority and attachment to a family physician; and, one associated with process domain: engaging. Other constructs exerted influence on implementation (e.g. outer setting, individual characteristics), but did not distinguish high and low-performing cases.

Originality/value

This is the first in-depth analysis of CWL implementation. Results suggest important factors that might be useful in efforts to continuously improve implementation performance of CWLs and similar innovations.

The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions

BACKGROUND

This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.

DISCUSSION

We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.'s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.

CONCLUSION

The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.

Do the key functions of an intervention designed from the same specifications vary according to context? Investigating the transferability of a public health intervention in France

Background

The processes at play in the implementation of one program in different contexts are complex and not yet well understood. In order to facilitate both the analysis and transfer of interventions, a “key functions/implementation/context” (FIC) model was developed to structure the description of public health interventions by distinguishing their potentially transferable dimensions (their “key functions”) from those associated with their translation within a specific context (their “form”). It was used to describe and compare preschool preventative nutrition interventions routinely implemented across three territories, in accordance with same national specifications.

Methods

The interventions were independently described by researchers and intervention’s implementers using the FIC model, during several workshops. Their key functions were then classified into 12 themes and compared to assess the extent to which the three interventions were similar.

Results

Despite being produced from the same set of specifications and having similar objectives, the key functions of the interventions in the three departments mostly reflected the same major themes, they did not overlap and were in some cases very different. In one of the three departments, the intervention was markedly different from those of the other two departments. The historical context of the interventions and the specificities of the local actors appear highly determinant of the key functions described.

Conclusions

For the interventions that we studied, some of the key functions varied greatly and translated different concepts of health education and modes of intervention to the population. It now seems vital to improve the description of interventions on the ground in order to highlight the key functions on which they are based, which still often remain implicit. The FIC model could be used to complement other models and theories focusing on the description of the implementation process, its determinants or its evaluation. Its interest is to provide a structure for joint reflection by various actors on the transferable aspects of an intervention, its form and its interactions with the context, in order ultimately to analyse or to improve its potential transferability.

Do the key functions of an intervention designed from the same specifications vary according to context? Investigating the transferability of a public health intervention in France

BACKGROUND

The processes at play in the implementation of one program in different contexts are complex and not yet well understood. In order to facilitate both the analysis and transfer of interventions, a "key functions/implementation/context" (FIC) model was developed to structure the description of public health interventions by distinguishing their potentially transferable dimensions (their "key functions") from those associated with their translation within a specific context (their "form"). It was used to describe and compare preschool preventative nutrition interventions routinely implemented across three territories, in accordance with same national specifications.

METHODS

The interventions were independently described by researchers and intervention's implementers using the FIC model, during several workshops. Their key functions were then classified into 12 themes and compared to assess the extent to which the three interventions were similar.

RESULTS

Despite being produced from the same set of specifications and having similar objectives, the key functions of the interventions in the three departments mostly reflected the same major themes, they did not overlap and were in some cases very different. In one of the three departments, the intervention was markedly different from those of the other two departments. The historical context of the interventions and the specificities of the local actors appear highly determinant of the key functions described.

CONCLUSIONS

For the interventions that we studied, some of the key functions varied greatly and translated different concepts of health education and modes of intervention to the population. It now seems vital to improve the description of interventions on the ground in order to highlight the key functions on which they are based, which still often remain implicit. The FIC model could be used to complement other models and theories focusing on the description of the implementation process, its determinants or its evaluation. Its interest is to provide a structure for joint reflection by various actors on the transferable aspects of an intervention, its form and its interactions with the context, in order ultimately to analyse or to improve its potential transferability.

To the bone: Comment on "I wanted a skeleton … they brought a prince": A qualitative investigation of factors mediating the implementation of a Performance Based Incentive program in Malawi

Recently, McMahon and colleagues set out to build on a widely-used fidelity framework, assessing the role of moderating factors during the implementation of performance-based financing programs in Malawi. Their attempt draws again the attention to the importance of approaching real word implementation issues from a theoretical perspective. It also highlights the importance of fidelity assessment within process evaluation of health programs. In this comment we argue that theoretical developments in the field of implementation science in global health would benefit from an accurate understanding of existing conceptual frameworks as well as from taking into account all contemporary contributions.

Implementation fidelity in a complex intervention promoting psychosocial well-being following stroke: an explanatory sequential mixed methods study

BACKGROUND

Evaluation of complex interventions should include a process evaluation to give evaluators, researchers, and policy makers greater confidence in the outcomes reported from RCTs. Implementation fidelity can be part of a process evaluation and refers to the degree to which an intervention is delivered according to protocol. The aim of this implementation fidelity study was to evaluate to what extent a dialogue-based psychosocial intervention was delivered according to protocol. A modified conceptual framework for implementation fidelity was used to guide the analysis.

METHODS

This study has an explanatory, sequential two-phase mixed methods design. Quantitative process data were collected longitudinally along with data collection in the RCT. Qualitative process data were collected after the last data collection point of the RCT. Descriptive statistical analyses were conducted to describe the sample, the intervention trajectories, and the adherence measures. A scoring system to clarify quantitative measurement of the levels of implementation was constructed. The qualitative data sources were analyzed separately with a theory-driven content analysis using categories of adherence and potential moderating factors identified in the conceptual framework of implementation fidelity. The quantitative adherence results were extended with the results from the qualitative analysis to assess which potential moderators may have influenced implementation fidelity and in what way.

RESULTS

The results show that the core components of the intervention were delivered although the intervention trajectories were individualized. Based on the composite score of adherence, results show that 80.1% of the interventions in the RCT were implemented with high fidelity. Although it is challenging to assess the importance of each of the moderating factors in relation to the other factors and to their influence on the adherence measures, participant responsiveness, comprehensiveness of policy description, context, and recruitment appeared to be the most prominent moderating factors of implementation fidelity in this study.

CONCLUSIONS

This evaluation of implementation fidelity and the discussion of what constitutes high fidelity implementation of this intervention are crucial in understanding the factors influencing the trial outcome. The study also highlights important methodological considerations for researchers planning process evaluations and studies of implementation fidelity.

TRIAL REGISTRATION

ClinicalTrials.gov , NCT02338869; registered 10/04/2014.

Communities for healthy living (CHL) - A family-centered childhood obesity prevention program integrated into Head Start services: Study protocol for a pragmatic cluster randomized trial

BACKGROUND

Childhood obesity is highly prevalent and carries substantial health consequences. Childhood obesity interventions have had mixed results, which may be partially explained by the absence of theory that incorporates broader family context and methods that address implementation challenges in low-resource settings. Communities for Healthy Living (CHL) is an obesity prevention program for Head Start preschools designed with careful focus on theory and implementation. This protocol paper outlines the design, content, implementation, and evaluation of CHL.

METHODS/DESIGN

CHL integrates a parenting program co-led by Head Start staff and parents, enhanced nutrition support, and a media campaign. CHL content and implementation are informed by the Family Ecological Model, Psychological Empowerment Theory, and Organizational Empowerment Theory. The intervention is directed by community-based participatory research and implementation science principles, such as co‑leadership with parents and staff, and implementation in a real world context. CHL is evaluated in a three-year pragmatic cluster-randomized trial with a stepped wedge design. The primary outcome is change in child Body Mass Index z-score. Secondary outcomes include children's weight-related behaviors (i.e., diet, physical activity, screen use, and sleep), parenting practices targeted at these behaviors (e.g., food parenting), and parent empowerment. The evaluation capitalizes on routine health data collected by Head Start (e.g., child height and weight, diet) coupled with parent surveys completed by subsamples of families.

DISCUSSION

CHL is an innovative childhood obesity prevention program grounded in theory and implementation science principles. If successful, CHL is positioned for sustained implementation and nationwide Head Start scale-up.

Diffusion Of Innovations Theory, Principles, And Practice

Aspects of the research and practice paradigm known as the diffusion of innovations are applicable to the complex context of health care, for both explanatory and interventionist purposes. This article answers the question, "What is diffusion?" by identifying the parameters of diffusion processes: what they are, how they operate, and why worthy innovations in health care do not spread more rapidly. We clarify how the diffusion of innovations is related to processes of dissemination and implementation, sustainability, improvement activity, and scale-up, and we suggest the diffusion principles that can be readily used in the design of interventions.

Adapting health interventions for local fit when scaling-up: a realist review protocol

INTRODUCTION

Scaling-up is essential to ensure universal access of effective health interventions. Scaling-up is a complex process, which occurs across diverse systems and contexts with no one-size-fits-all approach. To date, little attention has been paid to the process of scaling-up in how to make adaptations for local fit. The aim of this research is to develop theory on what actions can be used to make adaptations to health interventions for local fit when scaling-up across diverse contexts that will have practical application for implementers involved in scaling-up.

METHODS AND ANALYSIS

Given the complexity of this subject, a realist review methodology was selected. Specifically, realist review emphasises an iterative, non-linear process, whereby the review is refined as it progresses. The identification of how the context may activate mechanisms to achieve outcomes is used to generate theories on what works for whom in what circumstances. This protocol will describe the first completed stage of development of an initial programme theory framework, which identified potential actions, contexts, mechanisms and outcomes that could be used to make adaptations when scaling-up. It will then outline the methods for future stages of the review which will focus on identifying case examples of scale-up and adaptation in practice. This realist review consists of six stages: (i) clarifying scope and development of a theoretical framework, (ii) developing a search strategy, (iii) selection and appraisal, (iv) data extraction, (v) data synthesis and analysis and (vi) further theory refinement with stakeholders.

ETHICS AND DISSEMINATION

This review will develop theory on how adaptations can be made when scaling-up. Findings will be disseminated in a peer-reviewed journal and through stakeholder engagement as part of the research process. Ethical approval has been received through Health Policy and Management/Centre for Global Health Research Ethics Committee of Trinity College Dublin.

Bringing research to the bedside: Knowledge translation in the mental health care of burns patients

Advances in surgical techniques and wound management have improved outcomes for burn patients; however, the psychological impacts on burn survivors have had less attention. There is a higher rate of mental health disorders amongst burns victims, with those with pre-existing mental health conditions likely to have worse outcomes. To implement effective burns care and rehabilitation, knowledge and understanding of mental health issues is required. This position paper discusses the extent to which clinicians currently translate knowledge around mental health and burns into practice to identify enables and inhibitors. Successful knowledge translation requires dissemination and accessibility of information with the capacity and readiness for change. Clinicians and researchers need to identify how translating research to practice can meet the needs of burn survivors. There is a gap in the utilization of evidence concerning mental health and the needs of burns survivors, and we need to understand what we know as compared to what we do. Clinicians are well placed to determine how and why knowledge does not necessarily translate to practice and how they can better accommodate the needs of burn survivors.

Intervention Fidelity and Facilitator Training

Intervention fidelity is an ongoing concern for rigorous research, from the initial stages of planning and study design to the maintenance of internal validity. An added concern is the balance between fidelity and design accommodation to better suit varied populations and individuals. In this article, we describe our process for monitoring intervention fidelity during an individualized, yet standardized, strengths-based intervention with homeless youths, in which we include periodic training of our professional intervention facilitators. In our ongoing study, which is based on a Solomon four-group design with repeated measures, monitoring and training are essential to ensure intervention fidelity. Despite a rich literature about intervention fidelity, little guidance is available to help researchers and practitioners implement fidelity strategies in the real world with vulnerable populations. This article addresses this gap.

Text Messages Sent to Household Tuberculosis Contacts in Kampala, Uganda: Process Evaluation

Background

Previous studies have reported the inconsistent effectiveness of text messaging (short message service, SMS) for improving health outcomes, but few have examined to what degree the quality, or “fidelity,” of implementation may explain study results.

Objective

The aim of this study was to determine the fidelity of a one-time text messaging (SMS) intervention to promote the uptake of tuberculosis evaluation services among household contacts of index patients with tuberculosis.

Methods

From February to June 2017, we nested a process evaluation of text message (SMS) delivery within the intervention arm of a randomized controlled trial of tuberculosis contact investigation in Kampala, Uganda. Because mobile service providers in Uganda do not provide delivery confirmations, we asked household tuberculosis contacts to confirm the receipt of a one-time tuberculosis-related text message (SMS) by sending a text message (SMS) reply through a toll-free “short code.” Two weeks later, a research officer followed up by telephone to confirm the receipt of the one-time text message (SMS) and administer a survey. We considered participants lost to follow-up after 3 unsuccessful call attempts on 3 separate days over a 1-week period.

Results

Of 206 consecutive household contacts, 119 had a text message (SMS) initiated from the server. While 33% (39/119) were children aged 5-14 years, including 20% (24/119) girls and 13% (15/119) boys, 18 % (21/119) were adolescents or young adults, including 12% (14/119) young women and 6% (7/119) young men. 50% (59/119) were adults, including 26% (31/119) women and 24% (28/119) men. Of 107 (90%) participants for whom we could ascertain text message (SMS) receipt status, 67% (72/107) confirmed text message (SMS) receipt, including 22% (24/107) by reply text message (SMS) and 45% (48/107) during the follow-up telephone survey. No significant clinical or demographic differences were observed between those who did and did not report receiving the text message (SMS). Furthermore, 52% (56/107) reported ever reading the SMS. The cumulative likelihood of a text message (SMS) reaching its target and being read and retained by a participant was 19%.

Conclusions

The fidelity of a one-time text message (SMS) intervention to increase the uptake of household tuberculosis contact investigation and linkage to care was extremely low, a fact only discoverable through detailed process evaluation. This study suggests the need for systematic process monitoring and reporting of implementation fidelity in both research studies and programmatic interventions using mobile communications to improve health.

A process evaluation of how the routine vaccination programme is implemented at GP practices in England

BACKGROUND

In recent years, the incidence of several pathogens of public health importance (measles, mumps, pertussis and rubella) has increased in Europe, leading to outbreaks. This has included England, where GP practices implement the vaccination programme based on government guidance. However, there has been no study of how implementation takes place, which makes it difficult to identify organisational variation and thus limits the ability to recommend interventions to improve coverage. The aim of this study is to undertake a comparative process evaluation of the implementation of the routine vaccination programme at GP practices in England.

METHODS

We recruited a sample of geographically and demographically diverse GP practices through a national research network and collected quantitative and qualitative data as part of a Time-Driven Activity-Based Costing analysis between May 2017 and February 2018. We conducted semi-structured interviews with practice staff involved in vaccination, who then completed an activity log for 2 weeks. Interviews were transcribed and coded using a framework method.

RESULTS

Nine practices completed data collection from diverse geographic and socio-economic contexts, and 52 clinical and non-clinical staff participated in 26 interviews. Information relating to 372 vaccination appointments (233 childhood and 139 adult appointments) was captured using activity logs. We have defined a 14-stage care delivery value chain and detailed process map for vaccination. Areas of greatest variation include the method of reminder and recall activities, structure of vaccination appointments and task allocation between staff groups. For childhood vaccination, mean appointment length was 15.9 min (range 9.0-22.0 min) and 10.9 min for adults (range 6.8-14.1 min). Non-clinical administrative activities comprised 59.7% total activity (range 48.4-67.0%). Appointment length and total time were not related to coverage, whereas capacity in terms of appointments per eligible patient may improve coverage. Administrative tasks had lower fidelity of implementation.

CONCLUSIONS

There is variation in how GP practices in England implement the delivery of the routine vaccination programme. Further work is required to evaluate capacity factors in a wider range of practices, alongside other contextual factors, including the working culture within practices.

The unintended consequences of combining equity measures with performance-based financing in Burkina Faso

BACKGROUND

User fees and poor quality of care contribute to low use of healthcare services in Burkina Faso. The government implemented an innovative intervention that combines equity measures with performance-based financing (PBF). These health equity measures included a community-based selection of indigents to receive user fee exemptions and paying healthcare centres higher purchase prices for services provided to indigents. Research suggests complex interventions can trigger changes not targeted by program planners. To date, however, there is a knowledge gap regarding the unintended consequences that can emerge from combining PBF with health equity measures. Our objective is to document unintended consequences of the equity measures in this complex intervention.

METHODS

We developed a conceptual framework using the diffusion of innovations theory. For the design, we conducted a multiple case study. The cases were four healthcare facilities in one district. We collected data through 93 semi-structured interviews, informal discussions, observation, as well as intervention documents. We conducted thematic analysis using a hybrid deductive-inductive approach. We also used secondary data to describe the monthly evolution of services provided to indigent and non-indigent patients before and after indigent cards were distributed. Time series graphs were used to validate some results.

RESULTS

Local actors, including members of indigent selection committees and healthcare workers, re-invented elements of the PBF equity measures over which they had control to increase their relative advantage or to adapt to implementation challenges and context. Some individuals who did not meet the local conceptualization of indigents were selected to the detriment of others who did. Healthcare providers believed that distributing free medications led to financial difficulties and drug shortages, especially given the low purchase prices and long payment delays. Healthcare workers adopted measures to limit free services delivered to indigents, which led to conflicts between indigents and providers. Ultimately, selected indigents received uncertain and unequal coverage.

CONCLUSIONS

The severity of unintended consequences undermined the effectiveness and equity of the intervention. If the intervention is prolonged and expanded, decision-makers and implementers will have to address these unintended consequences to reduce inequities in accessing care.

Containment measures for emerging and re-emerging vector-borne and other infectious diseases of poverty in urban settings: a scoping review

BACKGROUND

The emergence and re-emergence of vector-borne and other infectious diseases of poverty pose a threat to the health of populations living in urban and low-income settings. A detailed understanding of intervention strategies, including effectiveness of past outbreak containment, is necessary to improve future practices. The objective was to determine what is known about the effectiveness of containment measures for emerging and re-emerging vector-borne and other infectious diseases of poverty in urban settings and identify research gaps and implications for public health practice.

MAIN BODY

We conducted a scoping review and systematically searched peer-reviewed and grey literature published between 2000 and 2016. Different data extraction tools were used for data coding and extraction, and data on implementation process and transferability were extracted from all studies. A quality assessment was conducted for each included study. We screened 205 full-text articles and reports for a total of 31 articles included in the review. The quality of the studies was generally low to moderate. The largest body of evidence concerned control activities for Ebola virus and dengue fever. The majority of interventions (87%) relied on multiple types of measures, which were grouped into four categories: 1) healthcare provision; 2) epidemiological investigation and/or surveillance; 3) environmental or sanitary interventions; and 4) community-based interventions. The quality of the majority of studies (90%) was poor or moderate, and one-third of the studies did not provide a clear description of the outcomes and of the procedures and/or tools used for the intervention.

CONCLUSIONS

Our results highlight the difficulty of establishing causation when assessing the effect of containment measures. Studies that extend beyond solely reporting on effectiveness and take into account the complexity of real-world settings are urgently needed. We recommend the allocation of research efforts to the evaluation of the implementation processes of interventions as well as their comprehensive and systematic description using validated checklists.

Community-based dengue control intervention in Ouagadougou: intervention theory and implementation fidelity

Background

While malaria control is the primary health focus in Burkina Faso, the recent dengue epidemic calls for new interventions. This paper examines the implementation fidelity of an innovative intervention to control dengue in the capital Ouagadougou.

Methods

First we describe the content of the intervention and its theory. We then assess the fidelity of the implementation. This step is essential as preparation for subsequent evaluation of the intervention’s effectiveness. Observations (n = 62), analysis of documents related to the intervention (n = 8), and semi-structured interviews with stakeholders (n = 18) were conducted. The collected data were organized and analyzed using QDA Miner. The theory of the intervention, grounded in reported good practices of community-based interventions, was developed and discussed with key stakeholders.

Results

The theory of the intervention included four components: mobilization and organization, operational planning, community action, and monitoring/evaluation. The interactions among these components were intended to improve people’s knowledge about dengue and enhance the community’s capacity for vector control, which in turn would reduce the burden of the disease. The majority of the planned activities were conducted according to the intervention’s original theory. Adaptations pertained to implementation and monitoring of activities.

Conclusions

Despite certain difficulties, some of which were foreseeable and others not, this experience showed the feasibility of developing community-based interventions for vector-borne diseases in Africa.

Comparison of registered and published intervention fidelity assessment in cluster randomised trials of public health interventions in low- and middle-income countries: systematic review

BACKGROUND

Cluster randomised trials (CRTs) are a key instrument to evaluate public health interventions. Fidelity assessment examines study processes to gauge whether an intervention was delivered as initially planned. Evaluation of implementation fidelity (IF) is required to establish whether the measured effects of a trial are due to the intervention itself and may be particularly important for CRTs of complex interventions conducted in low- and middle-income countries (LMICs). However, current CRT reporting guidelines offer no guidance on IF assessment. The objective of this review was to study current practices concerning the assessment of IF in CRTs of public health interventions in LMICs.

METHODS

CRTs of public health interventions in LMICs that planned or reported IF assessment in either the trial protocol or the main trial report were included. The MEDLINE/PubMed, CINAHL and EMBASE databases were queried from January 2012 to May 2016. To ensure availability of a study protocol, CRTs reporting a registration number in the abstract were included. Relevant data were extracted from each study protocol and trial report by two researchers using a predefined screening sheet. Risk of bias for individual studies was assessed.

RESULTS

We identified 90 CRTs of public health interventions in LMICs with a study protocol in a publicly available trial registry published from January 2012 to May 2016. Among these 90 studies, 25 (28%) did not plan or report assessing IF; the remaining 65 studies (72%) addressed at least one IF dimension. IF assessment was planned in 40% (36/90) of trial protocols and reported in 71.1% (64/90) of trial reports. The proportion of overall agreement between the trial protocol and trial report concerning occurrence of IF assessment was 66.7% (60/90). Most studies had low to moderate risk of bias.

CONCLUSIONS

IF assessment is not currently a systematic practice in CRTs of public health interventions carried out in LMICs. In the absence of IF assessment, it may be difficult to determine if CRT results are due to the intervention design, to its implementation, or to unknown or external factors that may influence results. CRT reporting guidelines should promote IF assessment.

TRIAL REGISTRATION

Protocol published and available at: https://doi.org/10.1186/s13643-016-0351-0.

Adaptations of the evidence-based Transitional Care Model in the U.S

Despite a growing body of evidence that adaptations of evidence-based interventions (EBI) are ubiquitous, few studies have examined the nature and rationale for modifications to the components of these interventions. The primary aim of this study was to describe and classify common local adaptations of the Transitional Care Model (TCM), an EBI comprised of 10 components that has been proven in multiple clinical trials to improve the care and outcomes of chronically ill older adults transitioning from hospitals to home. Guided by Stirman's System of Classifying Adaptations, 582 transitional care clinicians in health systems and community-based organizations throughout the U.S. completed a survey between September 2014 and January 2015; interviews were then conducted with a subset of survey respondents (N = 24) between April and December 2015. A total of 342 survey respondents (59%) reported implementation of the TCM in distinct organizations. Of this group, 96% reported a mean of 4.4 adaptations to the 10 TCM components (40%, one to three; 43%, four to six; and 17%, seven to nine). Nine of ten respondents (94%) reported contextual adaptations while content adaptations were less frequently reported (58%). The top three reported adaptations all related to context (i.e., delivering services from hospital to home, relying on advance practice nurses, and fostering care continuity); interviews clarified a diverse set of reasons for such modifications. Findings reinforce the need for investment in adaptation science and suggest hypotheses to guide rigorous examination of the association between adaptations of TCM components and desired outcomes.

"I had to somehow still be flexible": exploring adaptations during implementation of brief cognitive behavioral therapy in primary care

BACKGROUND

Primary care clinics present challenges to implementing evidence-based psychotherapies (EBPs) for depression and anxiety, and frontline providers infrequently adopt these treatments. The current study explored providers' perspectives on fidelity to a manualized brief cognitive behavioral therapy (CBT) as delivered in primary care clinics as part of a pragmatic randomized trial. Data from the primary study demonstrated the clinical effectiveness of the treatment and indicated that providers delivered brief CBT with high fidelity, as evaluated by experts using a standardized rating form. Data presented here explore challenges providers faced during implementation and how they adapted nonessential intervention components to make the protocol "fit" into their clinical practice.

METHODS

A multiprofessional group of providers (n = 18) completed a one-time semi-structured interview documenting their experiences using brief CBT in the primary care setting. Data were analyzed via directed content analysis, followed by inductive sorting of interview excerpts to identify key themes agreed upon by consensus. The Dynamic Adaptation Process model provided an overarching framework to allow better understanding and contextualization of emergent themes.

RESULTS

Providers described a variety of adaptations to the brief CBT to better enable its implementation. Adaptations were driven by provider skills and abilities (i.e., using flexible content and delivery options to promote treatment engagement), patient-emergent issues (i.e., addressing patients' broader life and clinical concerns), and system-level resources (i.e., maximizing the time available to provide treatment).

CONCLUSIONS

The therapeutic relationship, individual patient factors, and system-level factors were critical drivers guiding how providers adapted EBP delivery to improve the "fit" into their clinical practice. Adaptations were generally informed by tensions between the EBP protocol and patient and system needs and were largely not addressed in the EBP protocol itself. Adaptations were generally viewed as acceptable by study fidelity experts and helped to more clearly define delivery procedures to improve future implementation efforts. It is recommended that future EBP implementation efforts examine the concept of fidelity on a continuum rather than dichotomized as adherent/not adherent with focused efforts to understand the context of EBP delivery.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT01149772.

Understanding the dynamics of sustainable change: A 20-year case study of integrated health and social care

BACKGROUND

Change initiatives face many challenges, and only a few lead to long-term sustainability. One area in which the challenge of achieving long-term sustainability is particularly noticeable is integrated health and social care. Service integration is crucial for a wide range of patients including people with complex mental health and social care needs. However, previous research has focused on the initiation, resistance and implementation of change, while longitudinal studies remain sparse. The objective of this study was therefore to gain insight into the dynamics of sustainable changes in integrated health and social care through an analysis of local actions that were triggered by a national policy.

METHODS

A retrospective and qualitative case-study research design was used, and data from the model organisation's steering-committee minutes covering 1995-2015 were gathered and analysed. The analysis generated a narrative case description, which was mirrored to the key elements of the Dynamic Sustainability Framework (DSF).

RESULTS

The development of inter-sectoral cooperation was characterized by a participatory approach in which a shared structure was created to support cooperation and on-going quality improvement and learning based on the needs of the service user. A key management principle was cooperation, not only on all organisational levels, but also with service users, stakeholder associations and other partner organisations. It was shown that all these parts were interrelated and collectively contributed to the creation of a structure and a culture which supported the development of a dynamic sustainable health and social care.

CONCLUSION

This study provides valuable insights into the dynamics of organizational sustainability and understanding of key managerial actions taken to establish, develop and support integration of health and social care for people with complex mental health needs. The service user involvement and regular reviews of service users' needs were essential in order to tailor services to the needs. Another major finding was the importance of continuously adapting the content of the change to suit its context. Hence, continuous refinement of the change content was found to be more important than designing the change at the pre-implementation stage.

Implementation of individual placement and support (IPS) into community forensic mental health settings: Lessons learned

Introduction

Assessment of the effectiveness of individual placement and support in forensic mental health settings is a relatively new field of research despite evidence demonstrating its effectiveness in generic mental health settings.

Method

IPS was implemented into a community forensic mental health setting within a large National Health Service trust in the United Kingdom over 6 months. Using the Consolidated Framework for Implementation Research this paper describes the lessons learned from implementing individual placement and support into such settings.

Results

Our findings suggest that implementation of individual placement and support in forensic mental health settings is complex and requires robust planning and collaboration with internal and external agencies. Barriers to implementation included staff attitudes, difficulty engaging employers and lack of employment related performance indicators, and facilitators included the support of service managers and outside groups. Adaptations to the IPS model were made to address challenges encountered, including difficulty starting rapid job searches, concerns about stigma, lack of confidence, uncertainty around employment opportunities, offence restrictions and lack of interest from potential employers.

Conclusion

This paper adds to the limited literature in the field. Findings are relevant to practitioners and service providers who wish to implement individual placement and support services for people with mental disorder and offending histories.

A lifestyle intervention study targeting individuals with low socioeconomic status of different ethnic origins: important aspects for successful implementation

Background

Evaluation of the implementation process of trials is important, because the way a study is implemented modifies its outcomes. Furthermore, lessons learned during implementation can inform other researchers on factors that play a role when implementing interventions described in research. This study evaluates the implementation of the MetSLIM study, targeting individuals with low socioeconomic status of different ethnic origins. The MetSLIM study was set up to evaluate the effectiveness of a lifestyle programme on waist circumference and other cardio-metabolic risk factors. The objective of this evaluation was to identify components that were essential for the implementation of the MetSLIM study and to inform other researchers on methodological aspects when working with inadequately reached populations in health research.

Methods

In this evaluation study the experiences of health professionals, study assistants, a community worker and regional research coordinators involved in the MetSLIM study were explored using semi-structured interviews. Questionnaires were used to evaluate participants’ satisfaction with the lifestyle intervention.

Results

Our analyses show that a flexible recruitment protocol eventually leads to recruitment of sufficient participants; that trust in the recruiter is an important factor in the recruitment of individuals with low socioeconomic status of different ethnic origins; and that health professionals will unavoidably shape the form of intervention activities. Furthermore, our evaluation shows that daily practice and research mutually influence each other and that the results of an intervention are a product of this interaction.

Conclusions

Health promotion research would benefit from a perspective that sees intervention activities not as fixed entities but rather as social interaction that can take on numerous forms. Analysing and reporting the implementation process of studies, like in this evaluation, will allow readers to get a detailed view on the appropriateness of the (intended) study design and intervention for the targeted population. Evaluation studies that shed light on the reasons for adaptations, rather than describing them as deviation from the original plan, would point out methodological aspects important for a study’s replication. Furthermore, they would show how various factors can influence the implementation, and therewith initiate a learning cycle for the development of future intervention studies.

Trial registration

Netherlands Trial Register NTR3721 (since November 27, 2012).

Travelling models and the challenge of pragmatic contexts and practical norms: the case of maternal health

As in other areas of international development, we are witnessing the proliferation of ‘traveling models’ developed by international experts and introduced in an almost identical format across numerous countries to improve some aspect of maternal health systems in low- and middle-income countries. These policies and protocols are based on ‘miracle mechanisms’ that have been taken out of their original context but are believed to be intrinsically effective in light of their operational devices.

In reality, standardised interventions are, in Africa and elsewhere, confronted with pragmatic implementation contexts that are always varied and specific, and which lead to drifts, distortions, dismemberments and bypasses. The partogram, focused antenatal care, the prevention of mother-to-child transmission of HIV or performance-based payment all illustrate these implementation gaps, often caused by the routine behaviour of health personnel who follow practical norms (and a professional culture) that are often distinct from official norms – as is the case with midwives.

Experiences in maternal and child health in Africa suggest that an alternative approach would be to start with the daily reality of social and practical norms instead of relying on models, and to promote innovations that emerge from within local health systems.