A systematic review of adaptations of evidence-based public health interventions globally

Exploring determinants and strategies for implementing self-management support text messaging interventions in safety net clinics

Background

Text message-delivered interventions for chronic disease self-management have potential to reduce health disparities, yet limited research has explored implementing these interventions into clinical care. We partnered with safety net clinics to evaluate a texting intervention for type 2 diabetes called REACH (Rapid Encouragement/Education And Communications for Health) in a randomized controlled trial. Following evaluation, we explored potential implementation determinants and recommended implementation strategies.

Methods

We interviewed clinic staff (n = 14) and a subset of intervention participants (n = 36) to ask about REACH's implementation potential. Using the Consolidated Framework for Implementation Research (CFIR) as an organizing framework, we coded transcripts and used thematic analysis to derive implementation barriers and facilitators. We integrated the CFIR-ERIC (Expert Recommendations for Implementing Change) Matching Tool, interview feedback, and the literature to recommend implementation strategies.

Results

Implementation facilitators included low complexity, strong evidence and quality, available clinic resources, the need for a program to support diabetes self-management, and strong fit between REACH and both the clinics' existing workflows and patients' needs and resources. The barriers included REACH only being available in English, a lack of interoperability with electronic health record systems, patients' concerns about diabetes stigma, limited funding, and high staff turnover. Categories of recommended implementation strategies included training and education, offering flexibility and adaptation, evaluating key processes, and securing funding.

Conclusion

Text message-delivered interventions have strong potential for integration in low-resource settings as a supplement to care. Pursuing implementation can ensure patients benefit from these innovations and help close the research to practice gap.

Revisão sistemática sobre o efeito do programa escolar de prevenção ao uso de drogas Keepin’ it REAL: traduzido e implementado no Brasil pelo PROERD

Resumo O Programa Educacional de Resistência às Drogas (PROERD) é o programa escolar de prevenção mais disseminado no Brasil, seu atual currículo é baseado no programa norte-americano Keepin’it REAL (kiR). Não há na literatura evidência de efetividade do PROERD na prevenção ao uso de drogas, sendo necessários estudos complementares que auxiliem a compreensão desses achados. O objetivo do presente estudo é realizar uma síntese das evidências do efeito do currículo que deu origem ao PROERD: o kiR. Através de revisão sistemática encontrou-se 17 estudos que reportaram resultados de efeito de diferentes versões do kiR no uso de drogas e/ou violência. Com exceção do estudo brasileiro, não foram encontrados estudos que avaliassem o efeito no uso de drogas da versão aplicada por policiais (DARE-kiR), a mesma implementada pelo PROERD. Foram encontradas evidências favoráveis do kiR na prevenção ao uso de drogas para o currículo do 7º ano, que contrariam os resultados de efeito nulo do PROERD. Não foram encontradas evidências internacionais do efeito do kiR no currículo do 5º ano, assim como o estudo do PROERD. Sugere-se que revisões no currículo do 7º ano do PROERD para que ele possa refletir os resultados internacionais e que o currículo do 5º ano posso ser repensado considerando as evidências negativas internacionais.

A systematic review of the effect of the school-based drug prevention program Keepin’ it REAL: translated and implemented in Brazil by PROERD

Abstract The Drug Resistance Educational Program (PROERD) is Brazil’s most widespread school-based prevention program; its current curriculum is based on the North American Keepin’ it REAL (kiR) program. There is no evidence of the effectiveness of PROERD in preventing drug use, pointing to the need for further studies to understand these findings. The aim of the study was to synthesis the evidence of the effect of the kiR curriculum (PROERD) through a systematic review. We found 17 studies that reported the effects of different versions of kiR on drug use and/or violence. Except for the Brazilian study, no studies were found that assessed the effect on drug use of the version applied by police officers (DARE-kiR), the same one implemented by PROERD. Favorable evidence of kiR in drug use prevention was found for the 7th-grade curriculum, which contradicts the PROERD’s null-effect results. No international evidence of the effect of kiR was found in the 5th-grade curriculum, in the same line as the PROERD’s study. It is suggested that PROERD’s 7th-grade curriculum should be revised to reflect international results and that the 5th-grade curriculum should be reconsidered in light of the negative international evidence.

Are Training and Experience Adapting Evidence-Based Interventions Associated With Self-Efficacy and Attitudes? A Cross-Sectional Survey of Students and Practitioners With Varying Levels of Adaptation Experience

Increasing use of evidence-based interventions (EBIs) in local settings will help reduce the research-practice gap and improve health equity. Because adaptation to new settings and populations is essential to effective EBI use, frameworks to guide practice are receiving more attention; most, however, only provide broad guidelines without instructions for making adaptations in practice. Therefore, practitioners may need additional training or technical assistance (TA) to implement and adapt EBIs. This study explores whether practitioners' and students' general EBI training or TA and level of adaptation experience are associated with self-efficacy in adapting EBIs and with attitudes toward EBI use. We analyzed baseline survey data of participants in an evaluation of IM-Adapt Online, a newly developed decision support tool. We asked about previous training on EBIs, general and specific adaptation behaviors, and attitudes toward EBIs and found an association between previous training or TA in using EBIs with higher self-efficacy for using and adapting EBIs. Respondents with prior EBI training were significantly more likely to have higher self-efficacy in EBI behaviors across subdomains and in total than those without training. Respondents reported lowest self-efficacy for planning adaptations (M = 3.35) and assessing fit of EBIs to their local context (M = 3.41). This study suggests the importance of EBI adaptation training and TA to increase adoption and adaptation of EBIs, subsequently. More adaptation-specific training is warranted to assist students, practitioners, and researchers undertaking the adaptation process and implement EBIs. Future training on EBI adaptation can help practitioners tailor EBIs to meet the specific needs of their populations.

Adapting population health interventions for new contexts: qualitative interviews understanding the experiences, practices and challenges of researchers, funders and journal editors

OBJECTIVES

Research on the adaptation of population health interventions for implementation in new contexts is rapidly expanding. This has been accompanied by a recent increase in the number of frameworks and guidance to support adaptation processes. Nevertheless, there remains limited exploration of the real-world experiences of undertaking intervention adaptation, notably the challenges encountered by different groups of stakeholders, and how these are managed. Understanding experiences is imperative in ensuring that guidance to support adaptation has practical utility. This qualitative study examines researcher and stakeholder experiences of funding, conducting and reporting adaptation research.

SETTING

Adaptation studies.

PARTICIPANTS

Participants/cases were purposefully sampled to represent a range of adapted interventions, types of evaluations, expertise and countries. Semistructured interviews were conducted with a sample of researchers (n=23), representatives from research funding panels (n=6), journal editors (n=5) and practitioners (n=3).

MEASURES

A case study research design was used. Data were analysed using the framework approach. Overarching themes were discussed within the study team, with further iterative refinement of subthemes.

RESULTS

The results generated four central themes. The first three relate to the experience of intervention adaptation (1) involving stakeholders throughout the adaptation process and how to integrate the evidence base with experience; (2) selecting the intervention and negotiating the mismatch between the original and the new context; and (3) the complexity and uncertainty when deciding the re-evaluation process. The final theme (4) reflects on participants' experiences of using adaptation frameworks in practice, considering recommendations for future guidance development and refinement.

CONCLUSION

This study highlights the range of complexities and challenges experienced in funding, conducting and reporting research on intervention adaptation. Moving forward, guidance can be helpful in systematising processes, provided that it remains responsive to local contexts and encourage innovative practice.

Adaptations of evidence-based trauma-focused interventions for children and adolescents: a systematic review

BACKGROUND

Rates of potentially traumatic events (PTEs) and other forms of adversity among children are high globally, resulting in the development of a number of evidence-based interventions (EBIs) to address the adverse outcomes stemming from these experiences. Though EBIs are intended to be delivered according to set parameters, these EBIs are frequently adapted. However, little is known about existing adaptations of EBIs for children who experienced PTEs or other adversities. As such, this review aimed to determine: (1) why existing EBIs designed to address PTEs and other adversities experienced by children are adapted, (2) what processes are used to determine what elements should be adapted, and (3) what components of the intervention are adapted.

METHODS

Nine academic databases and publicly available search engines were used to identify academic and grey literature. Initial screening, full-text review, data extraction, and quality determinations were completed by two members of the research team. Data were synthesized narratively for each adapted EBI by research question.

RESULTS

Forty-two studies examining the adaptations of nine different EBIs were located, with Trauma-Focused Cognitive Behavioral Therapy and Cognitive Behavioral Intervention for Trauma in Schools being the most commonly adapted EBIs. Most frequently, EBIs were adapted to improve fit with a new population and to address cultural factors. Most commonly, researchers in combination with others made decisions about adapting interventions, though frequently who was involved in these decisions was not described. Common content adaptations included the addition of intervention elements and the tailoring/tweaking/refining of intervention materials. Common contextual adaptations included changes to the intended population, changes to the channel of treatment delivery, and changes to who administered the intervention.

CONCLUSIONS

Most published studies of EBI adaptions have been developed to improve fit and address cultural factors, but little research is available about adaptations made by clinicians in day-to-day practice. Efforts should be made to evaluate the various types of adaptations and especially whether adaptations improve access to services or improve child outcomes in order to ensure that all children exposed to trauma can access effective treatment.

TRIAL REGISTRATION

The protocol for this systematic review was published with PROSPERO (CRD42020149536).

Monitoring unplanned sexual health curricula adaptations: Using results to improve fidelity and support implementation

Maintaining fidelity to an evidence-based curriculum is important, yet educators may need to adapt to unexpected situations or particular contexts. The purpose of this study is to identify the reasons for unplanned adaptations during implementation of an evidence-based sexual health education program in California. Evaluators reviewed fidelity checklists from the implementation of 571 cohorts for activities with reported unplanned adaptations. Reasons were qualitatively coded and compared across two phases of implementation and by setting. Educators reported 319 unplanned adaptations, affecting 21.5% of the 571 cohorts and 2.9% of 13,782 activities. The most common reasons for unplanned adaptations were due to time management issues, site logistic issues, and to increase participant engagement. Over time, health educators reported fewer unplanned adaptations, particularly those due to time management, resulting in a decrease in the cohorts and activities affected. Adaptations to evidence-based curricula are necessary and often occur during implementation to fit local conditions and populations. Ongoing review of adaptation data provides an opportunity to refine training and technical assistance efforts. Guidance about the types of permitted adaptations and how to anticipate and plan for adaptations for future implementation can ensure fidelity to the core curriculum components and responsiveness to youth participants.

Exploring contextual adaptations in caregiver interventions for families raising children with developmental disabilities

There are increasing efforts to scale up services globally for families raising children with developmental disabilities (DDs). Existing interventions, often developed in high income, Western settings, need substantial adaptation before they can be implemented in different contexts. The aim of this study was to explore perspectives on the role that context plays in the adaptation and implementation of interventions targeting caregivers of children with DDs across settings. The study question was applied to the Caregiver Skills Training (CST) programme of the World Health Organization specifically, as well as to stakeholder experiences with caregiver interventions more broadly. Two focus group discussions (FGDs; n = 15 participants) and 25 individual semi-structured interviews were conducted. Participants were caregivers of children with DDs and professionals involved in adapting or implementing the CST across five continents and different income settings. Data were analysed thematically. Four main themes were developed: 1) Setting the scene for adaptations; 2) Integrating an intervention into local public services; 3) Understanding the reality of caregivers; 4) Challenges of sustaining an intervention. Informants thought that contextual adaptations were key for the intervention to fit in locally, even more so than cultural factors. The socio-economic context of caregivers, including poverty, was highlighted as heavily affecting service access and engagement with the intervention. Competing health priorities other than DDs, financial constraints, and management of long-term collaborations were identified as barriers. This study validates the notion that attention to contextual factors is an essential part of the adaptation of caregiver interventions for children with DDs, by providing perspectives from different geographical regions. We recommend a stronger policy and research focus on contextual adaptations of interventions and addressing unmet socio-economic needs of caregivers.

The economics of adaptations to evidence-based practices

Background

Evidence-based practices (EBPs) are frequently adapted in response to the dynamic contexts in which they are implemented. Adaptation is defined as the degree to which an EBP is altered to fit the setting or to improve fit to local context and can be planned or unplanned. Although adaptations are common and necessary to maximizing the marginal impact of EBPs, little attention has been given to the economic consequences and how adaptations affect marginal costs.

Discussion

In assessing the economic consequences of adaptation, one should consider its impact on core components, the planned adaptive periphery, and the unplanned adaptive periphery. Guided by implementation science frameworks, we examine how various economic evaluation approaches accommodate the influence of adaptations and discuss the pros and cons of these approaches. Using the Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME), mixed methods can elucidate the economic reasons driving the adaptations. Micro-costing approaches are applied in research that integrates the adaptation of EBPs at the planning stage using innovative, adaptive study designs. In contrast, evaluation of unplanned adaptation is subject to confounding and requires sensitivity analysis to address unobservable measures and other uncertainties. A case study is presented using the RE-AIM framework to illustrate the costing of adaptations. In addition to empirical approaches to evaluating adaptation, simulation modeling approaches can be used to overcome limited follow-up in implementation studies.

Conclusions

As implementation science evolves to improve our understanding of the mechanisms and implications of adaptations, it is increasingly important to understand the economic implications of such adaptations, in addition to their impact on clinical effectiveness. Therefore, explicit consideration is warranted of how costs can be evaluated as outcomes of adaptations to the delivery of EBPs.

Program adaptation by health departments

Introduction

The dissemination of evidence-based interventions (i.e., programs, practices, and policies) is a core function of US state health departments (SHDs). However, interventions are originally designed and tested with a specific population and context. Hence, adapting the intervention to meet the real-world circumstances and population's needs can increase the likelihood of achieving the expected health outcomes for the target population from the implemented intervention. This study identified how SHD employees decide to adapt public health programs and what influences decisions on how to adapt them.

Materials and methods

SHD employees (n = 45) were interviewed using a qualitative semi-structured interview guide. Telephone interviews were audio-recorded and transcribed verbatim. The transcripts were consensus-coded and themes were identified using thematic analysis. Several themes aligned with the Model for Adaptation Design and Impact.

Results

Data, outcomes, and health department evaluations influenced decisions to adapt a program (pre-adaptation), and reasons to adapt a program included organizational and sociopolitical contextual factors. SHD middle-level managers, program managers and staff, and local agencies were involved in the decisions to adapt the programs. Finally, the goals for adapting a program included enhancing effectiveness/outcomes, reach and satisfaction with the program; funding; and partner engagement. After SHD employees decided to adapt a program, data and evidence guided the changes. Program staff and evaluators were engaged in the adaptation process. Program managers consulted partners to gather ideas on how best to adapt a program based on partners' experiences implementing the program and obtaining community input. Lastly, program managers also received input on adapting content and context from coalition meetings and periodic technical assistance calls.

Discussion

The findings related to decisions to adapt public health programs provide practitioners with considerations for adapting them. Findings reaffirm the importance of promoting public health competencies in program evaluation and adaptation, as well as systematically documenting and evaluating the adaptation processes. In addition, the themes could be studied in future research as mechanisms, mediators, and moderators to implementation outcomes.

Evaluating the implementation of the active life improving health behavior change program "BCP-VAMOS" in primary health care: Protocol of a pragmatic randomized controlled trial using the RE-AIM and CFIR frameworks

Introduction

The effective translation of evidence-based interventions has contributed to implementing actions that impact public policies and the population's health. However, there is a gap in the literature regarding the factors associated with the successful implementation of these interventions. The Active Life Improving Health Behavior Change Program (BCP-VAMOS) uses behavioral strategies to promote an active and healthy lifestyle in the community. Characterized as a health innovation, it also provides health professionals with online training to implement the program in Primary Health Care (PHC). Our study describes a pragmatic trial that aims to evaluate the implementation of BCP-VAMOS, version 3.0, in PHC in southern Brazil.

Methods and analysis

A pragmatic randomized controlled trial (PRCT) of two arms comparing a group of PHC professionals who will participate in a traditional didactic approach (control group) vs. a group that will receive ongoing support (intervention group) for the implementation of BCP-VAMOS. The intervention will be available to adults (≥18 years old) registered at PHC. Program recipient's will be assessed at baseline and post-intervention (9 months after) to measure markers of physical activity and eating behavior (primary outcomes). Program's implementation process will be monitored for 12 months and will be evaluated using the RE-AIM and Consolidated Framework for Implementation Research (CFIR) frameworks.

Discussions

The survey findings can be used widely throughout Brazil, guiding the work of health professionals, service planners and policy-makers. Also, the results may help to inform the national health promotion policy to plan interventions and improve the implementation of programs in PHC. This research results will provide practical guidance for researchers to develop similar protocols to implement and adapt public health interventions.

Ethics and dissemination

Ethics approval has been granted by the Human Research Ethics Committee of the Federal University of Santa Catarina (UFSC), Brazil, under no. 1394492. Results will be published in full as open access in the UFSC library and main trial results and associated papers in high-impact peer-reviewed journals.

Trial registration number

RBR-2vw77q-Brazilian Registry of Clinical Trials - ReBEC (http://www.ensaiosclinicos.gov.br).

Michigan Model for HealthTM Learning to Enhance and Adapt for Prevention (Mi-LEAP): protocol of a pilot randomized trial comparing Enhanced Replicating Effective Programs versus standard implementation to deliver an evidence-based drug use prevention curriculum

BACKGROUND

School-based drug use prevention programs have demonstrated notable potential to reduce the onset and escalation of drug use, including among youth at risk of poor outcomes such as those exposed to trauma. Researchers have found a robust relationship between intervention fidelity and participant (i.e., student) outcomes. Effective implementation of evidence-based interventions, such as the Michigan Model for HealthTM (MMH), is critical to achieving desired public health objectives. Yet, a persistent gap remains in what we know works and how to effectively translate these findings into routine practice. The objective of this study is to design and test a multi-component implementation strategy to tailor MMH to meet population needs (i.e., students exposed to trauma), and improve the population-context fit to enhance fidelity and effectiveness.

METHODS

Using a 2-group, mixed-method randomized controlled trial design, this study will compare standard implementation versus Enhanced Replicating Effective Programs (REP) to deliver MMH. REP is a theoretically based implementation strategy that promotes evidence-based intervention (EBI) fidelity through a combination of EBI curriculum packaging, training, and as-needed technical assistance and is consistent with standard MMH implementation. Enhanced REP will tailor the intervention and training to integrate trauma-informed approaches and deploy customized implementation support (i.e., facilitation). The research will address the following specific aims: (1) design and test an implementation strategy (Enhanced REP) to deliver the MMH versus standard implementation and evaluate feasibility, acceptability, and appropriateness using mixed methods, (2) estimate the costs and cost-effectiveness of Enhanced REP to deliver MMH versus standard implementation.

DISCUSSION

This research will design and test a multi-component implementation strategy focused on enhancing the fit between the intervention and population needs while maintaining fidelity to MMH core functions. We focus on the feasibility of deploying the implementation strategy bundle and costing methods and preliminary information on cost input distributions. The substantive focus on youth at heightened risk of drug use and its consequences due to trauma exposure is significant because of the public health impact of prevention. Pilot studies of implementation strategies are underutilized and can provide vital information on designing and testing effective strategies by addressing potential design and methods uncertainties and the effects of the implementation strategy on implementation and student outcomes.

TRIAL REGISTRATION

NCT04752189-registered on 8 February 2021 on ClinicalTrials.gov PRS.

Cultural Adaptation and Social Media Promotion of Healthy Eating Guides for Spanish Speakers

OBJECTIVE

The internet is a primary source of nutrition information in the US. Minorities and non-English speakers face a digital divide when accessing such information. We aimed to report on the reach of social media dissemination of the cultural adaptation of the evidence-based Kid's Healthy Eating Plate to Spanish-speaking Latinos and of previous versions.

METHODS

The adaptation was based on the Framework for Reporting Adaptations and Modifications-Expanded and was disseminated through social media platforms (116 days). Outcomes were impressions, shares, website link clicks, number of viewers, and access country.

RESULTS

The kids' culturally adapted version had 288,773 impressions and 1,227 shares on social media; the website was linked 9,763 times, predominantly through Facebook (Meta Platforms, Inc). User engagement and pageviews were mostly from Spain, Latin American countries, and the US.

CONCLUSIONS AND IMPLICATIONS

The cultural adaptation of healthy eating guidelines for Spanish-speaking children was accessed in the US and worldwide. Promotion through social media had a significant impact on its reach. Cultural adaptation and paid dissemination of evidence-based materials may help close the digital divide and promote health literacy in diverse populations.

Advancing rapid adaptation for urgent public health crises: Using implementation science to facilitate effective and efficient responses

Responding rapidly to emerging public health crises is vital to reducing their escalation, spread, and impact on population health. These responses, however, are challenging and disparate processes for researchers and practitioners. Researchers often develop new interventions that take significant time and resources, with little exportability. In contrast, community-serving systems are often poorly equipped to properly adopt new interventions or adapt existing ones in a data-driven way during crises' onset and escalation. This results in significant delays in deploying evidence-based interventions (EBIs) with notable public health consequences. This prolonged timeline for EBI development and implementation results in significant morbidity and mortality that is costly and preventable. As public health emergencies have demonstrated (e.g., COVID-19 pandemic), the negative consequences often exacerbate existing health disparities. Implementation science has the potential to bridge the extant gap between research and practice, and enhance equity in rapid public health responses, but is underutilized. For the field to have a greater "real-world" impact, it needs to be more rapid, iterative, participatory, and work within the timeframes of community-serving systems. This paper focuses on rapid adaptation as a developing implementation science area to facilitate system responses during public health crises. We highlight frameworks to guide rapid adaptation for optimizing existing EBIs when responding to urgent public health issues. We also explore the economic implications of rapid adaptation. Resource limitations are frequently a central reason for implementation failure; thus, we consider the economic impacts of rapid adaptation. Finally, we provide examples and propose directions for future research and application.

Prevention of Cardiovascular Diseases in Community Settings and Primary Health Care: A Pre-Implementation Contextual Analysis Using the Consolidated Framework for Implementation Research

Cardiovascular diseases are the world’s leading cause of mortality, with a high burden especially among vulnerable populations. Interventions for primary prevention need to be further implemented in community and primary health care settings. Context is critically important to understand potential implementation determinants. Therefore, we explored stakeholders’ views on the evidence-based SPICES program (EBSP); a multicomponent intervention for the primary prevention of cardiovascular disease, to inform its implementation. In this qualitative study, we conducted interviews and focus groups with 24 key stakeholders, 10 general practitioners, 9 practice nurses, and 13 lay community partners. We used adaptive framework analysis. The Consolidated Framework for Implementation Research guided our data collection, analysis, and reporting. The EBSP was valued as an opportunity to improve risk awareness and health behavior, especially in vulnerable populations. Its relative advantage, evidence-based design, adaptability to the needs and resources of target communities, and the alignment with policy evolutions and local mission and vision, were seen as important facilitators for its implementation. Concerns remain around legal and structural characteristics and intervention complexity. Our results highlight context dimensions that need to be considered and tailored to primary care and community needs and capacities when planning EBSP implementation in real life settings.

Adaptation of a Problem-solving Program (Friendship Bench) to Treat Common Mental Disorders Among People Living With HIV and AIDS and on Methadone Maintenance Treatment in Vietnam: Formative Study

BACKGROUND

The prevalence of common mental disorders (CMDs) among people living with HIV and people who inject drugs is high worldwide and in Vietnam. However, few evidence-informed CMD programs for people living with HIV who inject drugs have been adapted for use in Vietnam. We adapted the Friendship Bench (FB), a problem-solving therapy (PST)-based program that was successfully implemented among patients with CMDs in primary health settings in Zimbabwe and Malawi for use among people living with HIV on methadone maintenance treatment (MMT) with CMDs in Hanoi, Vietnam.

OBJECTIVE

This study aimed to describe the adaptation process with a detailed presentation of 4 phases from the third (adaptation) to the sixth (integration) of the Assessment-Decision-Adaptation-Production-Topical Experts-Integration-Training-Testing (ADAPT-ITT) framework.

METHODS

The adaptation phase followed a qualitative study design to explore symptoms of CMDs, facilitators, and barriers to conducting FB for people living with HIV on MMT in Vietnam, and patient, provider, and caretaker concerns about FB. In the production phase, we revised the original program manual and developed illustrated PST cases. In the topical expert and integration phases, 2 investigators (BNG and BWP) and 3 subject matter experts (RV, DC, and GML) reviewed the manual, with reviewer comments incorporated in the final, revised manual to be used in the training. The draft program will be used in the training and testing phases.

RESULTS

The study was methodologically aligned with the ADAPT-ITT goals as we chose a proven, effective program for adaptation. Insights from the adaptation phase addressed the who, where, when, and how of FB program implementation in the MMT clinics. The ADAPT-ITT framework guided the appropriate adaptation of the program manual while maintaining the core components of the PST of the original program throughout counseling techniques in all program sessions. The deliverable of this study was an adapted FB manual to be used for training and piloting to make a final program manual.

CONCLUSIONS

This study successfully illustrated the process of operationalizing the ADAPT-ITT framework to adapt a mental health program in Vietnam. This study selected and culturally adapted an evidence-informed PST program to improve CMDs among people living with HIV on MMT in Vietnam. This adapted program has the potential to effectively address CMDs among people living with HIV on MMT in Vietnam.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04790201; https://clinicaltrials.gov/ct2/show/NCT04790201.

Evidence-Based Intervention (EBI) Mapping: a systematic approach to understanding the components and logic of EBIs

BACKGROUND

Despite the development of numerous evidence-based interventions (EBIs), many go unused in practice. Hesitations to use existing EBIs may be due to a lack of understanding about EBI components and what it would take to adapt it or implement it as designed. To improve the use of EBIs, program planners need to understand their goals, core components, and mechanisms of action. This paper presents EBI Mapping, a systematic approach based on Intervention Mapping, that can be used to understand and clearly describe EBIs, and help planners put them into practice.

METHODS

We describe EBI Mapping tasks and provide an example of the process. EBI Mapping uses principles from Intervention Mapping, a systematic framework for planning multilevel health promotion interventions. EBI Mapping applies the Intervention Mapping steps retrospectively to help planners understand an existing EBI (rather than plan a new one). We explain each EBI Mapping task and demonstrate the process using the VERB Summer Scorecard (VSS), a multi-level community-based intervention to improve youth physical activity.

RESULTS

EBI Mapping tasks are: 1) document EBI materials and activities, and their audiences, 2) identify the EBI goals, content, and mechanisms of action, 3) identify the theoretical change methods and practical applications of those methods, 4) describe design features and delivery channels, and 5) describe the implementers and their tasks, implementation strategies, and needed resources. By applying the EBI Mapping tasks, we created a logic model for the VSS intervention. The VSS logic model specifies the links between behavior change methods, practical applications, and determinants for both the at-risk population and environmental change agents. The logic model also links the respective determinants to the desired outcomes including the health behavior and environmental conditions to improve the health outcome in the at-risk population.

CONCLUSIONS

EBI Mapping helps program planners understand the components and logic of an EBI. This information is important for selecting, adapting, and scaling-up EBIs. Accelerating and improving the use of existing EBIs can reduce the research-to-practice gap and improve population health.

Applying a User Centred Design Approach to Optimise a Workplace Initiative for Wide-Scale Implementation

Translation of an effective research intervention into a program able to be implemented in practice typically requires adaptations to ensure the outcomes can be achieved within the applied setting. User centred design (UCD) methodologies can support these iterative adaptations, with this approach being particularly well suited to peer-led interventions, due to a focus on usability. We describe and reflect on the UCD approach that was applied to optimise an online, peer-led workplace health promotion initiative (BeUpstanding: ACTRN12617000682347) to be suitable for wide-scale implementation and evaluation. Optimisation was aligned against the indicators of the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework, with UCD methodologies (discovery interviews, persona and scenario mapping, facilitated workshops, surveys and prototyping) employed to enhance the program according to all RE-AIM dimensions. The core team (content experts, implementation scientist, interaction designer, software developer, business developer) worked closely with policy and practice partners and end users (workplace champions, management and staff) to iteratively develop and test across the RE-AIM indicators. This description and reflection of the process of applying UCD and the RE-AIM framework to the optimisation of BeUpstanding is intended to provide guidance for other behaviour change research adaptations into practice.

Implementation of Electronic Psychosocial Screening Among Caregivers in Pediatric Oncology

PURPOSE:

This study aimed to evaluate the reach and implementation of an electronic psychosocial screening program among caregivers of pediatric oncology patients, as well as characterize caregiver distress.

METHODS:

Participants (N = 2,013) included caregivers of patients age 0-17.99 years presenting across 9,280 outpatient oncology visits (median = 2; range = 1-52) from September 2018 to June 2019. At check-ins, caregivers electronically completed the pediatric distress thermometer via a patient-facing electronic health record (EHR) application. Caregiver distress ratings ≥ 8 triggered electronic alerts to medical teams to refer for social work support at point of care. Patient clinical and demographic differences in reach and fidelity were evaluated using univariate chi-square and t-tests. Caregivers reporting high distress were compared with caregivers without reports of high distress using univariate and multivariable logistic regression.

RESULTS:

The e-screening program was able to reach a caregiver for nearly all children seen during the study period, with 95.5% (1,923/2,013) of patients having a caregiver-completed pediatric distress thermometer. On screeners where caregivers reported high distress, medical teams made appropriate referrals to social work 95.5% (471/493) of the time. Overall, 16.9% (325/1,923) of caregivers ever indicated high distress (score ≥ 8), with caregivers of newly diagnosed (odds ratio = 3.16; 95% CI, 2.12 to 4.71) and on-therapy (odds ratio = 2.81; 95% CI, 2.11 to 3.76) patients being more likely to report high distress, compared with those who were off-treatment for the entire study.

CONCLUSION:

Leveraging EHR technology to provide evidence-based psychosocial screening can aid in successfully reaching a significant proportion of caregivers of pediatric oncology patients to identify and respond to ongoing psychosocial distress.

Colliding Epidemics: Research Gaps and Implementation Science Opportunities for Tobacco Use and HIV/AIDS in Low- and Middle-Income Countries

Introduction

Tobacco use is a leading cause of cancer death among people living with HIV (PLWH) worldwide, and smoking prevalence tends to be higher among PLWH. The burden of both HIV/AIDS and tobacco use is increasingly concentrated in low- and middle-income countries (LMICs), where resources to address these challenges are often limited. However, there has been limited effort to date to integrate tobacco cessation into HIV programs in LMICs.

Methods

We searched the literature (searching was conducted between October 1 and December 31, 2020) using PubMed including search terms "tobacco" and "HIV" and "cessation" over the past ten years (searching for articles published between December 1, 2010, and December 1, 2020) to identify original research studies on tobacco cessation interventions conducted in LMICs for PLWH. We also conducted an analysis of NCI-funded research grants on tobacco cessation and HIV awarded during fiscal years 2010 to 2020. Results and Discussion. Existing evidence suggests that conventional tobacco cessation treatments may be less effective among PLWH. Moreover, while substantial evidence exists to support a range of cessation interventions, most of this evidence comes from HICs and is only partly applicable to the evolving social, economic, and cultural climate of many LMICs. There is an urgent need to develop, adapt, and implement effective tobacco control and cessation interventions targeted to PLWH in LMICs, as well as to generate evidence from these settings. Implementation science provides tools develop and test strategies to overcome barriers and to integrate and scale up cessation services within existing HIV treatment settings.

Conclusion

There is a unique opportunity to address HIV and tobacco use in a coordinated way in LMICs by integrating evidence-based tobacco cessation into HIV programs.

A pragmatic effectiveness-implementation study comparing trial evidence with routinely collected outcome data for patients receiving the REACH-HF home-based cardiac rehabilitation programme

BACKGROUND

Cardiac rehabilitation for heart failure continues to be greatly underused worldwide despite being a Class I recommendation in international clinical guidelines and uptake is low in women and patients with mental health comorbidities.

METHODS

Rehabilitation EnAblement in CHronic Heart Failure (REACH-HF) programme was implemented in four UK National Health Service early adopter sites ('Beacon Sites') between June 2019 and June 2020. Implementation and patient-reported outcome data were collected across sites as part of the National Audit of Cardiac Rehabilitation. The change in key outcomes before and after the supervised period of REACH-HF intervention across the Beacon Sites was assessed and compared to those of the intervention arm of the REACH-HF multicentre trial.

RESULTS

Compared to the REACH-HF multicentre trial, patients treated at the Beacon Site were more likely to be female (33.8% vs 22.9%), older (75.6 vs 70.1), had a more severe classification of heart failure (26.5% vs 17.7%), had poorer baseline health-related quality of life (MLHFQ score 36.1 vs 31.4), were more depressed (HADS score 6.4 vs 4.1) and anxious (HADS score 7.2 vs 4.7), and had lower exercise capacity (ISWT distance 190 m vs 274.7 m). There appeared to be a substantial heterogeneity in the implementation process across the four Beacon Sites as evidenced by the variation in levels of patient recruitment, operationalisation of the REACH-HF intervention and patient outcomes. Overall lower improvements in patient-reported outcomes at the Beacon Sites compared to the trial may reflect differences in the population studied (having higher morbidity at baseline) as well as the marked challenges in intervention delivery during the COVID-19 pandemic.

CONCLUSION

The results of this study illustrate the challenges in consistently implementing an intervention (shown to be clinically effective and cost-effective in a multicentre trial) into real-world practice, especially in the midst of a global pandemic. Further research is needed to establish the real-world effectiveness of the REACH-HF intervention in different populations.

Implementation and modification of an organizational-level intervention: a prospective analysis

Background

Modifications to interventions can jeopardize intervention outcomes. Pre-existing perceived barriers and facilitators to the intervention arising in the implementation preparation phase may help explain why modifications to the intervention may occur during the implementation phase. This two-site comparative case study describes modifications made to a complex organizational-level intervention and examines how known implementation science factors may have enabled such changes to occur.

Methods

Northwestern Medicine’s^TM Hispanic Kidney Transplant Program (HKTP) is a culturally competent transplant center-based intervention designed to reduce disparities in living donor kidney transplantation among Hispanics. In-depth qualitative interviews and discussions were longitudinally conducted with transplant stakeholders (i.e., physicians, administrators, clinicians) at two kidney transplant programs with large Hispanic populations during implementation preparation and implementation phases. The Consolidated Framework for Implementation Research (CFIR) guided interview design and qualitative analysis, and Stirman’s Framework for Reporting Adaptations and Modifications-Expanded (FRAME) guided modification classification.

Results

Across sites, 57 stakeholders participated in an interview, group discussion, and/or learning collaborative discussion. Site-B made more modifications than Site-A (n = 29 versus n = 18). Sites differed in the proportions of delaying/skipping (Site-A 50% versus Site-B 28%) and adding (Site-A 11% versus Site-B 28%) but had comparable substituting (Site-A 17% versus Site-B 17%) and tweaking (Site-A 17% versus Site-B 14%) modification types. Across sites, the transplant team consistently initiated the most modifications (Site-A 66%; Site-B 62%). While individuals initiated slightly more modifications at Site-B (21% versus Site-A 17%), institutions instigated proportionately slightly more modifications at Site-A (17% versus Site-B 10%). CFIR inner setting factors (i.e., structural characteristics, culture, available resources, implementation climate) that prominently emerged during the implementation preparation phase explained similarities and differences in sites’ modification numbers, types, and agents in the implementation phase.

Conclusion

Organizations implementing a culturally competent care intervention made modifications. CFIR inner setting factors emerging in the implementation preparation phase largely explained similarities and differences in study sites’ modifications. Identifying factors contributing to modifications may help institutions become better prepared to implement an intervention by addressing known factors in advance, which may foster greater fidelity leading to desired outcomes.

Trial registration

ClinicalTrials.govNCT03276390. We registered the study retrospectively on 9-7-17.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00296-0.

How is the NHS Low-Calorie Diet Programme expected to produce behavioural change to support diabetes remission: An examination of underpinning theory

Background

In 2020, the National Health Service Low-Calorie Diet Programme (NHS-LCD) was launched, piloting a total diet (TDR) replacement intervention with behaviour change support for people living with Type 2 Diabetes (T2D) and excess weight. Four independent service providers were commissioned to design and deliver theoretically grounded programmes in localities across England.

Aims

1) to develop a logic model detailing how the NHS-LCD programme is expected to produce changes in health behaviour, and (2) to analyse and evaluate the use of behaviour change theory in providers' NHS-LCD Programme designs.

Methods

A documentary review was conducted. Information was extracted from the NHS-LCD service specification documents on how the programme expected to produce outcomes. The Theory Coding Scheme (TCS) was used to analyse theory use in providers' programme design documents.

Results

The NHS-LCD logic model included techniques aimed at enhancing positive outcome expectations of programme participation and beliefs about social approval of behaviour change, to facilitate programme uptake and behaviour change intentions. This was followed by techniques aimed at shaping knowledge and enhancing the ability of participants to self-regulate their health behaviours, alongside a supportive social environment and person-centred approach.Application and type of behaviour change theory within service providers' programme designs varied. One provider explicitly linked theory to programme content; two providers linked 63% and 70% of intervention techniques to theory; and there was limited underpinning theory identified in the programme design documents for one of the providers.

Conclusion

The nature and extent of theory use underpinning the NHS-LCD varied greatly amongst service providers, with some but not all intervention techniques explicitly linked to theory. How this relates to outcomes across providers should be evaluated. It is recommended that explicit theory use in programme design and evidence of its implementation becomes a requirement of future NHS commissioning processes.

Preventing Adverse Childhood Experiences: The Role of Etiological, Evaluation, and Implementation Research

Research on adverse childhood experiences is a vital part of the data-to-action link and the development of evidence-based public health and violence prevention practice. Etiological research helps to elucidate the key risk and protective factors for adverse childhood experiences and outcome research examines the consequences of exposure to them. Evaluation research is critical to building the evidence base for strategies that are likely to have a significant impact on preventing and reducing adverse experiences during childhood. Implementation research efforts inform the movement and scale-up of evidence-based findings to public health practice. The Centers for Disease Control and Prevention's Division of Violence Prevention located in the National Center for Injury Prevention and Control is investing in a number of research initiatives that are designed to advance what is known about the causes and consequences of adverse childhood experiences (i.e., etiological research), the strategies that are effective at reducing and preventing them (i.e., evaluation research), and how to best adapt and scale effective strategies (i.e., implementation research). This article complements the other articles in this Special Supplement by briefly providing a review of reviews for each of these areas and highlighting recent research investments and strategic directions by the Centers for Disease Control and Prevention in the area of child abuse and neglect and adverse childhood experience prevention. Research investments are critical to advancing the evidence base on the prevention of adverse childhood experiences and to ensure safe, stable, and nurturing relationships and environments so that all children can live to their fullest potential.

A study protocol of the adaptation and evaluation by means of a cluster-RCT of an integrated workplace health promotion program based on a European good practice

Background

An integrated workplace health promotion program (WHPP) which targets multiple lifestyle factors at different levels (individual and organizational) is potentially more effective than a single component WHPP. The aim of this study is to describe the protocol of a study to tailor a European good practice of such an integral approach to the Dutch context and to evaluate its effectiveness and implementation.

Methods

This study consists of two components. First, the five steps of the Map of Adaptation Process (MAP) will be followed to tailor the Lombardy WHP to the Dutch context. Both the employers and employees will be actively involved in this process. Second, the effectiveness of the integrated Dutch WHPP will be evaluated in a clustered randomized controlled trial (C-RCT) with measurements at baseline, 6 months and 12 months. Clusters will be composed based on working locations or units - dependent on the organization’s structure and randomization within each organization takes place after baseline measurements. Primary outcome will be a combined lifestyle score. Secondary outcomes will be the separate lifestyle behaviors targeted, stress, work-life balance, need for recovery, general health, and well-being. Simultaneously, a process evaluation will be conducted. The study population will consist of employees from multiple organizations in different industry sectors. Organizations in the intervention condition will receive the integrated Dutch WHPP during 12 months, consisting of an implementation plan and a catalogue with activities for multiple lifestyle themes on various domains: 1) screening and support; 2) information and education; 3) adjustments in the social, digital or physical environment; and 4) policy.

Discussion

The MAP approach provides an appropriate framework to systematically adapt an existing WHPP to the Dutch context, involving both employers and employees and retaining the core elements, i.e. the catalogue with evidence-based activities on multiple lifestyle themes and domains enabling an integrated approach. The following process and effect evaluation will contribute to further insight in the actual implementation and effectiveness of the integrated WHP approach.

Trial registration

NTR (trialregister.nl), NL9526. Registered on 3 June 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13352-0.

Promoting Self-Determination in Parents With Mental Illness in Adult Mental Health Settings

This article reports a strengths-based intervention to support parents with mental illness and their children in adult mental health settings: "Let's Talk About Children" (LTC) intervention. A qualitative methodology was adopted with parent participants receiving LTC in adult mental health and family services. The benefits for parents receiving LTC were described through in-depth interviews with 25 parents following the delivery of the program. Interview data identified an impact on parental self-regulation-mainly through a change in a sense of agency as a parent-and skill building, once a clearer picture of their child's everyday life was understood. This study outlines the benefits of talking with parents about the strengths and vulnerabilities of their children during routine mental health treatment. The role for self-determination of parents in preventive interventions for children is an important consideration for mental health recovery, and it also helps to break the cycle of transgenerational mental illness within families.

Extending analytic methods for economic evaluation in implementation science

Background

Economic evaluations of the implementation of health-related evidence-based interventions (EBIs) are conducted infrequently and, when performed, often use a limited set of quantitative methods to estimate the cost and effectiveness of EBIs. These studies often underestimate the resources required to implement and sustain EBIs in diverse populations and settings, in part due to inadequate scoping of EBI boundaries and underutilization of methods designed to understand the local context. We call for increased use of diverse methods, especially the integration of quantitative and qualitative approaches, for conducting and better using economic evaluations and related insights across all phases of implementation.

Main body

We describe methodological opportunities by implementation phase to develop more comprehensive and context-specific estimates of implementation costs and downstream impacts of EBI implementation, using the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. We focus specifically on the implementation of complex interventions, which are often multi-level, resource-intensive, multicomponent, heterogeneous across sites and populations, involve many stakeholders and implementation agents, and change over time with respect to costs and outcomes. Using colorectal cancer (CRC) screening EBIs as examples, we outline several approaches to specifying the “boundaries” of EBI implementation and analyzing implementation costs by phase of implementation. We describe how systems mapping and stakeholder engagement methods can be used to clarify EBI implementation costs and guide data collection—particularly important when EBIs are complex. In addition, we discuss the use of simulation modeling with sensitivity/uncertainty analyses within implementation studies for projecting the health and economic impacts of investment in EBIs. Finally, we describe how these results, enhanced by careful data visualization, can inform selection, adoption, adaptation, and sustainment of EBIs.

Conclusion

Health economists and implementation scientists alike should draw from a larger menu of methods for estimating the costs and outcomes associated with complex EBI implementation and employ these methods across the EPIS phases. Our prior experiences using qualitative and systems approaches in addition to traditional quantitative methods provided rich data for informing decision-making about the value of investing in CRC screening EBIs and long-term planning for these health programs. Future work should consider additional opportunities for mixed-method approaches to economic evaluations.

Revisiting concepts of evidence in implementation science

BACKGROUND

Evidence, in multiple forms, is a foundation of implementation science. For public health and clinical practice, evidence includes the following: type 1 evidence on etiology and burden; type 2 evidence on effectiveness of interventions; and type 3: evidence on dissemination and implementation (D&I) within context. To support a vision for development and use of evidence in D&I science that is more comprehensive and equitable (particularly for type 3 evidence), this article aims to clarify concepts of evidence, summarize ongoing debates about evidence, and provide a set of recommendations and tools/resources for addressing the "how-to" in filling evidence gaps most critical to advancing implementation science.

MAIN TEXT

Because current conceptualizations of evidence have been relatively narrow and insufficiently characterized in our opinion, we identify and discuss challenges and debates about the uses, usefulness, and gaps in evidence for implementation science. A set of questions is proposed to assist in determining when evidence is sufficient for dissemination and implementation. Intersecting gaps include the need to (1) reconsider how the evidence base is determined, (2) improve understanding of contextual effects on implementation, (3) sharpen the focus on health equity in how we approach and build the evidence-base, (4) conduct more policy implementation research and evaluation, and (5) learn from audience and stakeholder perspectives. We offer 15 recommendations to assist in filling these gaps and describe a set of tools for enhancing the evidence most needed in implementation science.

CONCLUSIONS

To address our recommendations, we see capacity as a necessary ingredient to shift the field's approach to evidence. Capacity includes the "push" for implementation science where researchers are trained to develop and evaluate evidence which should be useful and feasible for implementers and reflect community or stakeholder priorities. Equally important, there has been inadequate training and too little emphasis on the "pull" for implementation science (e.g., training implementers, practice-based research). We suggest that funders and reviewers of research should adopt and support a more robust definition of evidence. By critically examining the evolving nature of evidence, implementation science can better fulfill its vision of facilitating widespread and equitable adoption, delivery, and sustainment of scientific advances.

Feasibility and implementation fidelity of a co-designed intervention to promote in-hospital mobility among older medical patients-the WALK-Copenhagen project (WALK-Cph)

BACKGROUND

Mobility interventions can prevent functional decline among older patients, but implementation of such interventions may be complicated by barriers in the clinical setting. The WALK-Copenhagen project (WALK-Cph) is aimed at promoting a 24-h mobility among older medical patients during hospitalization. The WALK-Cph intervention was co-designed by researchers and stakeholders to tailor the intervention to the clinical context. The aim of this study was to investigate the feasibility and implementation fidelity of the WALK-Cph intervention before evaluating clinical effectiveness in a randomized controlled trial (ClinicalTrials.gov NCT03825497).

METHODS

The WALK-Cph intervention consisted of six components: a welcome folder explaining the importance of in-hospital activity, a WALK-plan prescribing up to three daily walking sessions during and after hospitalization, a WALK-path in the hallway that patients were motivated to use daily, exercise posters in the hallways and bedrooms, self-service on beverages and clothes, and discharge with a WALK-plan. The present study reports on phase 2 of WALK-Cph and consists of a feasibility and a fidelity component. The study was conducted at the two WALK-Cph intervention departments after the initiation of the WALK-Cph intervention. A cohort of older medical patients (+65) was recruited for the feasibility study to assess recruitment and data collection procedures and the method for assessment of activity. Simultaneously, implementation fidelity was assessed by observing clinical practice and intervention delivery at the intervention departments.

RESULTS

A feasibility cohort of 48 patients was included. Inclusion was considered feasible with recruitment rates between 62% and 70% of all eligible patients. Also, data collection was conducted without obstacles, and all patients accepted to wear activity monitors. The fidelity observations showed that three of the six intervention components were partially implemented as planned whereas three components were not implemented as planned.

CONCLUSION

The WALK-Cph intervention was found feasible, and although the intervention was not implemented with fidelity, the level of fidelity was considered sufficient to continue with further testing of the WALK-Cph intervention in a large-scale trial.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03825497 (retrospectively registered). Protocol PubMed ID (PMID): 29523569.

Reimagining Rural: Shifting Paradigms About Health and Well-Being in the Rural United States

Rural health disparities have attracted increased national attention, compelling an expanded focus on rural health research. In this article, we deconstruct the definitions and narratives of "rural" communities and suggest that a paradigm shift is needed that centers the complexity and strength of rural places. We discuss the relevance of health equity frameworks, implementation science, and community-engaged approaches to promote rural well-being. Focusing on rural in its own right will lead to intervention innovations and reinvention with implications beyond rural areas. We conclude with suggestions for research and practice to inspire renewed interest in partnering with rural communities to promote health equity.

Designing for Dissemination and Sustainability to Promote Equitable Impacts on Health

Designing for dissemination and sustainability (D4DS) refers to principles and methods for enhancing the fit between a health program, policy, or practice and the context in which it is intended to be adopted. In this article we first summarize the historical context of D4DS and justify the need to shift traditional health research and dissemination practices. We present a diverse literature according to a D4DS organizing schema and describe a variety of dissemination products, design processes and outcomes, and approaches to messaging, packaging, and distribution. D4DS design processes include stakeholder engagement, participatory codesign, and context and situation analysis, and leverage methods and frameworks from dissemination and implementation science, marketing and business, communications and visualarts, and systems science. Finally, we present eight recommendations to adopt a D4DS paradigm, reflecting shifts in ways of thinking, skills and approaches, and infrastructure and systems for training and evaluation.

Adaptation in rural water, sanitation, and hygiene programs: A qualitative study in Nepal

Adaptations are modifications made to programming to improve effectiveness or contextual fit, and are important for program improvement. However, adaptations can be detrimental if they do not preserve an intervention's underlying theory of change. We present a case study of 45 adaptations made to rural WaSH programming in Nepal, identified through qualitative interviews with implementers conducted in June through August 2019. For each adaptation, we characterized its target outcomes and implementers' motivations for making the adaptation, and we assessed the adaptation's intended and unintended effects on program quality. Participants described adaptations to both interventions (e.g., changes to hygiene promotion messages) and implementation strategies (e.g., sanctions to enforce toilet construction, such as denying work permits to households without a toilet). Adoption was the most common target outcome, specifically increasing toilet construction. Other target outcomes included feasibility of program delivery, acceptability of messages or WaSH products, reach of program activities in the community, and sustainability. Implementers were commonly motivated by intense pressure to meet national open defecation free targets. Most adaptations achieved their target outcomes. However, sanctions adaptations had substantial unintended negative effects. Implementers reported that sanctions were unpopular with communities and had poor sustainability. In contrast, non-sanctions adaptations that targeted outcomes of feasibility, acceptability, and sustainability had few unintended negative consequences. Our findings suggest that adaptations to promote rapid adoption of toilet construction do not consistently achieve sustained behavior change. Furthermore, adaptations to improve feasibility of program delivery or cost and acceptability of WaSH products can indirectly improve adoption even when it is not an explicit target outcome.

The ParentingWell Learning Collaborative Feasibility Study: Training Adult Mental Health Service Practitioners in a Family-Focused Practice Approach

This study investigates the feasibility and impact of the ParentingWell Learning Collaborative (PWLC) model in supporting mental health practitioners in implementing the family-focused ParentingWell practice approach with adults with mental illness. An exploratory design and qualitative methods were employed. Practitioners (n = 29) participated in in-person orientation, training and debriefing sessions; virtual coaching sessions; and via an interactive online hub. Researchers obtained data on participant engagement and satisfaction, and participants' reports of use, helpfulness, intention to use and impact. Participants were engaged in and highly satisfied with the PWLC. They deployed PWLC skills, tools and resources with parents. Evidence of impact was provided at the personal, practice and organizational levels. This study provides preliminary support for the feasibility and impact of the PWLC. Clear specification of a theoretically-based training model for practitioners is an essential step in adapting, implementing and testing interventions in new contexts .

Implementation of the Wolverine Mental Health Program, Part 2: Implementation Phase

To enhance mental health care for youth in a midwestern residential treatment facility, Wolverine Human Services partnered with the Beck Institute (an intermediary) and an implementation research team to implement cognitive-behavioral therapy (CBT). CBT has strong evidence supporting effectiveness for treating youth internalizing and externalizing problems, but it is a complex psychosocial intervention that demands a thoughtful implementation approach. This study outlines the implementation phase (2.5 years) of a 5-year collaborative effort. The implementation phase focused on (a) adapting CBT to fit the complex youth needs and the roles of the multidisciplinary team members resulting in a new comprehensive and coordinated care model, and (b) the strategies utilized to support its competent integration by all team members. Six blended implementation strategies were deployed in this phase: forging implementation teams, installing progress monitoring, adapting CBT, training, providing supervision and consultation, and training the trainers. A components-based approach to CBT yielded six core skills: active listening, problem solving, mood monitoring and intervention mapping, activity scheduling, distress tolerance, and cognitive restructuring. By the end of this phase, all staff had robust exposure to and experience with the adapted form of CBT. The work of our academic-community partnership has both research and clinical implications, with respect to integrating an adapted version of CBT for residential environments (CBT-RE).

"It's good to feel like you're doing something": a qualitative study examining state health department employees' views on why ineffective programs continue to be implemented in the USA

Background

Mis-implementation, the inappropriate continuation of programs or policies that are not evidence-based or the inappropriate termination of evidence-based programs and policies, can lead to the inefficient use of scarce resources in public health agencies and decrease the ability of these agencies to deliver effective programs and improve population health. Little is known about why mis-implementation occurs, which is needed to understand how to address it. This study sought to understand the state health department practitioners’ perspectives about what makes programs ineffective and the reasons why ineffective programs continue.

Methods

Eight state health departments (SHDs) were selected to participate in telephone-administered qualitative interviews about decision-making around ending or continuing programs. States were selected based on geographic representation and on their level of mis-implementation (low and high) categorized from our previous national survey. Forty-four SHD chronic disease staff participated in interviews, which were audio-recorded and transcribed verbatim. Transcripts were consensus coded, and themes were identified and summarized. This paper presents two sets of themes, related to (1) what makes a program ineffective and (2) why ineffective programs continue to be implemented according to SHD staff.

Results

Participants considered programs ineffective if they were not evidence-based or if they did not fit well within the population; could not be implemented well due to program restraints or a lack of staff time and resources; did not reach those who could most benefit from the program; or did not show the expected program outcomes through evaluation. Practitioners described several reasons why ineffective programs continued to be implemented, including concerns about damaging the relationships with partner organizations, the presence of program champions, agency capacity, and funding restrictions.

Conclusions

The continued implementation of ineffective programs occurs due to a number of interrelated organizational, relational, human resources, and economic factors. Efforts should focus on preventing mis-implementation since it limits public health agencies’ ability to conduct evidence-based public health, implement evidence-based programs effectively, and reduce the high burden of chronic diseases. The use of evidence-based decision-making in public health agencies and supporting adaptation of programs to improve their fit may prevent mis-implementation. Future work should identify effective strategies to reduce mis-implementation, which can optimize public health practice and improve population health.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00252-4.

Cultural Adaptation of the Reducing Disability in Alzheimer's Disease (RDAD) Protocol for an Intervention to Reduce Behavioral and Psychological Symptoms of Dementia in Thailand

BACKGROUND

The Reducing Disability in Alzheimer's Disease (RDAD) program is an evidence-based intervention found to be feasible for implementation in community settings in the United States, and effective in reducing depression, one of the major behavioral and psychological symptoms of dementia (BPSD).

OBJECTIVE

The goal of the study is to culturally adapt the RDAD for persons with dementia living in community settings of Thailand.

METHODS

Key adaptation steps included: 1) assess the community, 2) understand/select the intervention, 3) consult with experts/stakeholders, 4) decide what needs to be adapted, 5) adapt the original program, 6) train staff, and 7) pilot test the adapted materials.

RESULTS

Modifications to the original RDAD protocol included changes in number of sessions, mode of delivery, and the specific pleasant activities targeted. The pilot test demonstrated the feasibility and acceptance of the adapted RDAD intervention protocol. Implementers were able to comprehend and implement the core components of the intervention, while family members demonstrated ability to follow instructions, gain knowledge about dementia, and improve skills for setting up realistic goals.

CONCLUSION

Following the key adaptation steps outlined above, we were able to successfully modify the RDAD for the Thai cultural context, maintaining core components of the original protocol. Program implementers demonstrated their ability to supervise family caregivers and help them gain the knowledge and skills needed to provide care for older adults with dementia. Findings from the pilot studies were incorporated into final training and intervention protocols currently being implemented and evaluated in a randomized implementation trial in Thailand.

Telehealth-delivered caregiver training for autism: Recent innovations

Providing treatment to children with autism is a global health priority, and research demonstrates that caregivers can be trained in techniques to promote their child's social interaction, communication, play, positive behavior and skills. These caregiver-mediated interventions have been shown to promote a number of positive outcomes in children with autism, as well as their caregivers. When provided by telehealth, data indicate that caregiver training is acceptable and feasible, and associated with similar positive outcomes as live face-to-face training. Telehealth innovations, which have accelerated during the COVID-19 era, have demonstrated advantages over in-person delivery of services in terms of cost effectiveness and increased accessibility, however, more research is needed on feasibility, acceptability and effectiveness for different populations in different contexts. This brief review will highlight recent caregiver skills training interventions for autism that have been successfully adapted or designed for telehealth delivery. Telehealth interventions that are scalable, adaptable, caregiver-mediated, open-access, and delivered as part of a stepped care model, have the potential to address the global treatment gap for families of children with autism and other neurodevelopmental disabilities. Considerations relevant to the global scale-up of caregiver-mediated interventions will also be discussed.

Context-specific adaptation of an eHealth-facilitated, integrated care model and tailoring its implementation strategies-A mixed-methods study as a part of the SMILe implementation science project

Background

Contextually adapting complex interventions and tailoring their implementation strategies is key to a successful and sustainable implementation. While reporting guidelines for adaptations and tailoring exist, less is known about how to conduct context-specific adaptations of complex health care interventions.

Aims

To describe in methodological terms how the merging of contextual analysis results (step 1) with stakeholder involvement, and considering overarching regulations (step 2) informed our adaptation of an Integrated Care Model (ICM) for SteM cell transplantatIon faciLitated by eHealth (SMILe) and the tailoring of its implementation strategies (step 3).

Methods

Step 1: We used a mixed-methods design at University Hospital Basel, guided by the Basel Approach for coNtextual ANAlysis (BANANA). Step 2: Adaptations of the SMILe-ICM and tailoring of implementation strategies were discussed with an interdisciplinary team (n = 28) by considering setting specific and higher-level regulatory scenarios. Usability tests were conducted with patients (n = 5) and clinicians (n = 4). Step 3: Adaptations were conducted by merging our results from steps 1 and 2 using the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME). We tailored implementation strategies according to the Expert Recommendations for Implementing Change (ERIC) compilation.

Results

Step 1: Current clinical practice was mostly acute-care-driven. Patients and clinicians valued eHealth-facilitated ICMs to support trustful patient-clinician relationships and the fitting of eHealth components to context-specific needs. Step 2: Based on information from project group meetings, adaptations were necessary on the organizational level (e.g., delivery of self-management information). Regulations informed the tailoring of SMILe-ICM`s visit timepoints and content; data protection management was adapted following Swiss regulations; and steering group meetings supported infrastructure access. The usability tests informed further adaptation of technology components. Step 3: Following FRAME and ERIC, SMILe-ICM and its implementation strategies were contextually adapted and tailored to setting-specific needs.

Discussion

This study provides a context-driven methodological approach on how to conduct intervention adaptation including the tailoring of its implementation strategies. The revealed meso-, and macro-level differences of the contextual analysis suggest a more targeted approach to enable an in-depth adaptation process. A theory-guided adaptation phase is an important first step and should be sufficiently incorporated and budgeted in implementation science projects.

Adaptation of Water, Sanitation, and Hygiene Interventions: A Model and Scoping Review of Key Concepts and Tools

Background

Safe water, sanitation, and hygiene (WaSH) is important for health, livelihoods, and economic development, but WaSH programs have often underdelivered on expected health benefits. Underperformance has been attributed partly to poor ability to retain effectiveness following adaptation to facilitate WaSH programs' implementation in diverse contexts. Adaptation of WaSH interventions is common but often not done systematically, leading to poor outcomes. Models and frameworks from the adaptation literature have potential to improve WaSH adaptation to facilitate implementation and retain effectiveness. However, these models and frameworks were designed in a healthcare context, and WaSH interventions are typically implemented outside traditional health system channels. The purpose of our work was to develop an adaptation model tailored specifically to the context of WaSH interventions.

Methods

We conducted a scoping review to identify key adaptation steps and identify tools to support systematic adaptation. To identify relevant literature, we conducted a citation search based on three recently published reviews on adaptation. We also conducted a systematic database search for examples of WaSH adaptation. We developed a preliminary model based on steps commonly identified across models in adaptation literature, and then tailored the model to the WaSH context using studies yielded by our systematic search. We compiled a list of tools to support systematic data collection and decision-making throughout adaptation from all included studies.

Results and Conclusions

Our model presents adaptation steps in five phases: intervention selection, assessment, preparation, implementation, and sustainment. Phases for assessment through sustainment are depicted as iterative, reflecting that once an intervention is selected, adaptation is a continual process. Our model reflects the specific context of WaSH by including steps to engage non-health and lay implementers and to build consensus among diverse stakeholders with potentially competing priorities. We build on prior adaptation literature by compiling tools to support systematic data collection and decision-making, and we describe how they can be used throughout adaptation steps. Our model is intended to improve program outcomes by systematizing adaptation processes and provides an example of how systematic adaptation can occur for interventions with health goals but that are implemented outside conventional health system channels.

Rapid adaptation during the COVID crisis: Challenges experienced in delivering service to those with Opioid Use Disorders

Background

Adaptation is an accepted part of implementing evidence-based practices. COVID-19 presented a unique opportunity to examine adaptation in evolving contexts. Delivering service to people with opioid use disorder during the pandemic required significant adaptation due to revised regulations and limited service access. This report evaluated changes to addiction medication services caused by the pandemic, challenges encountered in rapidly adapting service delivery, and initial impressions of which changes might be sustainable over time.

Methods

Qualitatively-evaluated structured interviews (N  =  20) were conducted in late 2020 with key informants in Pinellas County (FL) to assess the pandemic's impact. Interviewees represented a cross-section of the professional groups including direct SUD/HIV service providers, and sheriff's office, Department of Health, and regional clinical program administrative staff. The interview questions examined significant changes necessitated by the pandemic, challenges encountered in adapting to this evolving context, and considerations for sustained change.

Results

The most significant changes to service delivery identified were rapid adaptation to a telehealth format, and modifying service consistent with SAMHSA guidance, to allow for 'take-home' doses of methadone. Limitations imposed by access to technology, and the retraining of staff and patients to give and receive service differently were the most common themes identified as challenging adaptation efforts. Respondents saw shifts towards telehealth as most likely to being sustained.

Conclusions

COVID-19 provided an unprecedented opportunity to examine adaptation in a fast-paced, dynamic, and evolving context. Adaptations identified will only be sustained through multisystem collaboration and validation. Results suggest that additional components could be added to implementation frameworks to assess rapid adaptation during unplanned events, such as access to additional resources or local decision-making that impacts service delivery. Findings will also be integrated with quantitative data to help inform local policy decisions.

Plain Language Summary

Adaptation is an accepted part of implementing evidencebased practices. COVID-19 presented a unique opportunity to examine rapid adaptation necessitated within evolving contexts. Delivering services to people with opioid use disorder required significant adaptation due to changing regulations and limited access to lifesaving services. This study examined changes in service delivery due to the pandemic, challenges encountered in rapid adaptation, and initial impressions of which changes might be sustainable over time. Qualitatively-evaluated structured interviews were conducted with a cross-section of professional groups (direct substance use disorder (SUD) and human immunodeficiency virus (HIV) service providers, and sheriff's office, Department of Health, and clinical program administrative staff) in Pinellas County (FL). The most significant changes to service delivery were rapid adaptation to a telehealth format and increased allowance for 'takehome' doses of methadone medication. Limitations imposed by access to technology, as well as the education of and staff and patients were the most common themes identified as challenges. Respondents saw shifts towards telehealth as most likely to be sustained. COVID-19 provided an unprecedented opportunity to examine adaptation in a fast-paced, dynamic, and evolving context. Adaptations will only be sustained through multisystem collaboration and validation. Findings suggest that additional components could be added to implementation frameworks to assess rapid adaptation during unplanned events, such as access to additional resources or local decision-making that impacts service delivery.

Interventions to change clinicians' behavior related to suicide-prevention care in the emergency department: a scoping review

OBJECTIVE

The objective of this scoping review was to explore, characterize, and map the literature on interventions and intervention components implemented to change emergency department clinicians' behavior related to suicide prevention using the Behaviour Change Wheel as a guiding theoretical framework.

INTRODUCTION

An emergency department is a critical place for suicide prevention, yet patients are often discharged without proper suicide risk assessments and/or referrals. In response, we must support emergency department clinicians' behavior change to follow evidence-based suicide prevention strategies. However, reviews to date have yet to systematically and theoretically examine interventions' functional characteristics and how they can influence emergency department clinicians' behaviors related to suicide-prevention care.

INCLUSION CRITERIA

This review considered interventions that targeted emergency department clinicians' behavior change related to suicide prevention. Behavior change referred to observable practice changes as well as proxy measures of behavior change, including changes in knowledge and attitude.

METHODS

This review followed JBI methodology for scoping reviews. Searches included PubMed, PsycINFO, CINAHL, Embase, and gray literature, including targeted Google searches for relevant organizations/websites, ProQuest Dissertations and Theses Global, and Scopus conference papers (using a specific filter). This review did not apply any date limits, but our search was limited to the English language. Data extraction was undertaken using a charting table developed specifically for the review objective. Narrative descriptions of interventions were coded using the Behavior Change Wheel's intervention functions. Reported outcome measures were categorized. Findings are tabulated and synthesized narratively.

RESULTS

Forty-one studies were included from the database searches, representing a mixture of experimental (n = 2), quasi-experimental (n = 24), non-experimental (n = 12), qualitative (n = 1), and mixed methods (n = 2) approaches. An additional 29 citations were included from gray literature searches. One was a pilot mixed methods study, and the rest were interventions. In summary, this review included a total of 70 citations, describing 66 different interventions. Identified interventions comprised a wide range of Behaviour Change Wheel intervention functions to change clinicians' behavior: education (n = 48), training (n = 40), enablement (n = 36), persuasion (n = 21), environmental restructuring (n = 18), modeling (n = 7), and incentivisation (n = 2). Based on the Behaviour Change Wheel analysis, many interventions targeted more than one determinant of behavior change, often employing education and training to improve clinicians' knowledge and skills simultaneously. Among the 42 studies that reported outcome measures, effectiveness was measured at clinician (n = 38), patient (n = 4), and/or organization levels (n = 6). Few studies reported implementation outcomes, such as measures of reach (n = 4), adoption (n = 5), or fidelity (n = 1). There were no evaluation data reported on the interventions identified through Google searches.

CONCLUSIONS

Interventions included in this review were diverse and leveraged a range of mechanisms to change emergency department clinicians' behavior. However, most interventions relied solely on education and/or training to improve clinicians' knowledge and/or skills. Future research should consider diverse intervention functions to target both individual- and/or organization-level barriers for a given context. Secondly, the ultimate goal for changing emergency department clinicians' behavior is to improve patient health outcomes related to suicide-related thoughts and behaviors, but current research has most commonly evaluated clinicians' behavior in isolation of patient outcomes. Future studies should consider reporting patient-level outcomes alongside clinician-level outcomes.

Extent, Type and Reasons for Adaptation and Modification When Scaling-Up an Effective Physical Activity Program: Physical Activity 4 Everyone (PA4E1)

Background: Few studies have described the extent, type and reasons for making changes to a program prior to and during its delivery using a consistent taxonomy. Physical Activity 4 Everyone (PA4E1) is a secondary school physical activity program that was scaled-up for delivery to a greater number of schools. We aimed to describe the extent, type and reasons for changes to the PA4E1 program (the evidence-based physical activity practices, implementation support strategies and evaluation methods) made before its delivery at scale (adaptations) and during its delivery in a scale-up trial (modifications). Methods: The Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) was used to describe adaptations (planned and made prior to the scale-up trial) and modifications (made during the conduct of the trial). A list of adaptations was generated from a comparison of the efficacy and scale-up trials via published PA4E1 protocols, trial registrations and information provided by trial investigators. Monthly trial team meetings tracked and coded modifications in "real-time" during the conduct of the scale-up trial. The extent, type and reasons for both adaptations and modifications were summarized descriptively. Results: In total, 20 adaptations and 20 modifications were identified, these were to physical activity practices (n = 8; n = 3), implementation support strategies (n = 6; n = 16) and evaluation methods (n = 6, n = 1), respectively. Few adaptations were "fidelity inconsistent" (n = 2), made "unsystematically" (n = 1) and proposed to have a "negative" impact on the effectiveness of the program (n = 1). Reasons for the adaptations varied. Of the 20 modifications, all were "fidelity consistent" and the majority were made "proactively" (n = 12), though most were "unsystematic" (n = 18). Fifteen of the modifications were thought to have a "positive" impact on program effectiveness. The main reason for modification was the "available resources" (n = 14) of the PA4E1 Implementation Team. Conclusions: Adaptations and modifications to public health programs are common. Modifications have the potential to impact the implementation and effectiveness of programs. Our findings underscore the importance of comprehensive reporting of the extent, type and reasons for modifications as part of process evaluations, as this data may be important to the interpretation of trial findings. Clinical Trial Registration: https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372870, Identifier ACTRN12617000681358.

Evidence-based policymaking when evidence is incomplete: The case of HIV programme integration

Jan Hontelez and co-authors discuss the use of different types of evidence to inform HIV program integration.

Community-based interventions for chronic musculoskeletal health conditions in rural and remote populations: A systematic review

Chronic musculoskeletal health conditions are highly prevalent in rural and remote areas, globally. It is unknown, however, whether interventions shown to be effective for urban populations are also effective for rural and remote populations. The purpose of the review was to evaluate the effectiveness of community-based interventions for management of chronic musculoskeletal health conditions in rural and remote populations. A systematic review was undertaken of the major databases: Medline, Scopus, Web of Science, Rural and Remote Health, Embase and PEDro to April 2020 with no restrictions on language or publication date. Odds Ratios were calculated to report differences between intervention and control groups. Risk of bias was assessed using the PEDro scale. Meta-analysis was not conducted, given the high heterogeneity among studies. From a total of 3,219 articles identified from the title search, five studies were eligible, with a total of 2,831 participants. Interventions evaluated included education alone, exercise with education and ergonomic modifications. Community-based education and exercise led to significantly reduced chronic musculoskeletal pain [OR = 1.85 (95% CI 1.22, 2.82)] compared with controls. Ergonomic stove installation significantly reduced average prevalence of back pain (0.25% reduction in pain prevalence; p < .05); however, no significant effect [OR = 1.02 (0.63, 1.65)] was found when transformed to Odds Ratio. There were divergent findings for education programmes alone: one study reported a positive effect [OR = 1.78 (1.27, 2.49)], while another reported no significant effect [delivered either in home [OR: 1.21 (0.78, 1.86)] or in small groups [OR = 0.95 (0.60, 1.51)]. A significant improvement in knowledge was found with community-based education delivered in participants' homes [SMD: 1.27 (1.01, 1.54)], in small groups [SMD: 0.79 (0.53, 1.06)], using traditional puppetry [SMD: 4.79 (4.51, 5.06)], and with education and exercise [SMD: 0.29 (0.06, 0.52)]. There is low quality evidence that education and/or exercise improves knowledge of arthritis, and the effectiveness of ergonomic interventions on pain was unclear.

A RE-AIM evaluation in early adopters to iteratively improve the online BeUpstanding™ program supporting workers to sit less and move more

Background

The web-based BeUpstanding program supports desk workers to sit less and move more. Successfully translated from a research-delivered intervention, BeUpstanding has gone through iterative development and evaluation phases in preparation for wide-scale implementation. In the third planned “early-adopters” phase (01/09/2017–11/06/2019), the program was made freely-available online. An integrated delivery and evaluation platform was also developed to enable workplace champions to run and evaluate the intervention within their work team independent of researcher support. Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, this study reports on the extent to which the program and processes were “fit-for-purpose” for a national implementation trial across the indicators of uptake (reach and adoption), implementation and engagement, and effectiveness for behaviour change.

Methods

Data were collected via the online surveys embedded in the program and through program access analytics. Descriptive data (with linearized variance for the clustered staff-level data) and results from mixed models (repeated data and clustering for pre-post changes) are reported.

Results

Despite purposeful limited promotion, uptake was good, with 182 Australian users initially registering (208 total) and 135 (from 113 organisations) then completing the sign-up process. Recruitment reached users across Australia and in 16 of 19 Australian industries. Implementation was inconsistent and limited, with signed-up users completing 0 to 14 of the program’s 14 steps and only 7 (5.2%) completing all seven core steps. Many champions (n = 69, 51.1%) had low engagement (1 day toolkit usage) and few (n = 30, 22%) were highly engaged (> 1 day toolkit usage and surveyed staff). Although only 18 users (7 organisations) performed the pre- and post-program staff evaluations (337 and 167 staff, respectively), pre-post changes showed the program effectively reduced workplace sitting by − 9.0% (95% CI -12.0, − 5.9%).

Discussion

The program had uptake across industries and across Australia, but implementation and engagement varied widely. Few workplaces completed the evaluation components. In those that did, the program was effective for the primary outcome (workplace sitting). Conducting a planned early adopters phase and a comprehensive evaluation according to RE-AIM helped highlight necessary program improvements to make it more suitable for wide-scale implementation and evaluation.

Trial registration

Australian and New Zealand Clinic Trials Registry ACTRN12617000682347. Date registered: 12/05/2017.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-11993-1.

Adaptations and modifications to a co-designed intervention and its clinical implementation: a qualitative study in Denmark

BACKGROUND

There is a long-standing debate in implementation research on whether adaptations to evidence-based interventions (EBIs) are desirable in health care. If an intervention is adapted and not delivered as conceived and planned, it is said to have low fidelity. The WALK-Cph project was developed based on the assumption that involving stakeholders in co-design processes would facilitate the fidelity of an intervention to increase the mobility of acutely admitted older medical patients and its implementation in two hospitals in Denmark. The purpose of this study is to describe and analyse adaptations and modifications that were made to the co-designed WALK-Cph intervention and its implementation.

METHODS

This study used a qualitative design. An ethnographic field study was performed using participant observations, workshops and semi-structured interviews. Data were analysed twice using the Framework Method. The first analysis was based on the frameworks from Stirman, Moore and Proctor. The second analysis, a retrospective modifications analysis, was based on the Adaptation-Impact Framework.

RESULTS

Many different types of adaptations and modifications were made to the WALK-Cph intervention and its implementation plan. Most of the modifications were made on the contents of the intervention. In total, 44 adaptations and modifications were made, of which 21 were planned (adaptations) and 23 were made haphazardly (modifications). Most of the content and context adaptations and modifications made on the intervention had a mixed result regarding enhanced fidelity. The retrospective modifications analysis showed that modifications were ongoing and both situationally and contextually shaped.

CONCLUSIONS

Although an extensive co-design process was carried out to facilitate the fidelity of the WALK-Cph intervention, this study showed that many adaptations and modifications were still made to both the intervention and its implementation plan. It could indicate that the co-design process had a small effect or that adaptations and modifications are ongoing and both situationally and contextually shaped, which challenge the assumption and the desire to be able to plan and control changes.