Colliding ideals - an interview study of how intervention researchers address adherence and adaptations in replication studies

Revising primary and secondary school curricula in the Caribbean to enhance education on the risks for noncommunicable diseases

In the English-speaking Caribbean, an estimated 46% of men and 61% of women are currently overweight or obese, and 8% of children younger than 5 years are also overweight. To combat this worsening epidemic, driven by unhealthy dietary patterns, the Heads of Government of the Caribbean Community (CARICOM) issued the 2007 Port-of-Spain Declaration, which included mandates on the provision of healthy school meals, promotion of healthy dietary patterns, and reintroduction of physical education in schools. These mandates are aligned with evidence-based approaches used in childhood obesity prevention programs. School-based interventions, including curriculum revisions, are part of a multipronged approach to improve nutrition in children and are designed to complement and reinforce other interventions in schools. However, formal evaluation of the Port-of-Spain Declaration showed that most CARICOM member countries had difficulty implementing the mandates related to schools and diet. The Improving Household Nutrition Security and Public Health in the CARICOM project, in collaboration with regional institutions, the CARICOM Secretariat, and the Caribbean Examinations Council, sought to enhance nutrition education through revision of region-wide primary and secondary school curricula to increase the focus on prevention of noncommunicable diseases. This paper describes the process of revising the Caribbean Examinations Council's Human and Social Biology syllabus for secondary schools and the CARICOM Health and Family Life Education Regional Curriculum Framework for primary schools, which was achieved through multisectoral collaboration. We used the Framework for Reporting Adaptations and Modifications-Enhanced model to describe the process through which the modifications were made.

Standardizing variation: Scaling up clinical genomics in Australia

PURPOSE

Clinical genomics demands close interaction of physicians, laboratory scientists, and genetic professionals. Taking genomics to scale requires an understanding of the underlying processes from the perspective of nongenetic physicians who are new to the field. We identified components of the processes amenable to adaptation when scaling up clinical genomics.

METHODS

Semistructured interviews informed by the Theoretical Domains Framework with nongenetic physicians, who were using clinical genomics in practice, were guided by an annotated process map with 7 steps following the patient's journey. Findings from the individual maps were synthesized into an overview process map and a series of individual maps by common location and specialty. Interviews were analyzed using the Theoretical Domains Framework.

RESULTS

In total, 16 nongenetic physicians (eg, nephrologists, immunologists) participated, generating 1 overview and 10 individual process maps. Sixteen common steps were identified across clinical specialties and locations, with variations over 9 steps. We report the potential for standardization across these 9 steps.

CONCLUSION

When scaling up complex interventions, it is essential to identify steps where variation can be accommodated. With these results we show how process mapping can be used to identify steps where variation is acceptable during scale up to accommodate adaptation to local context, allowing for the inevitable evolution of factors influencing ongoing implementation and sustainability.

Adapting to CONNECT: modifying a nursing home-based team-building intervention to improve hospital care team interactions, functioning, and implementation readiness

BACKGROUND

Clinical interventions often need to be adapted from their original design when they are applied to new settings. There is a growing literature describing frameworks and approaches to deploying and documenting adaptations of evidence-based practices in healthcare. Still, intervention modifications are often limited in detail and justification, which may prevent rigorous evaluation of interventions and intervention adaptation effectiveness in new contexts. We describe our approach in a case study, combining two complementary intervention adaptation frameworks to modify CONNECT for Quality, a provider-facing team building and communication intervention designed to facilitate implementation of a new clinical program.

METHODS

This process of intervention adaptation involved the use of the Planned Adaptation Framework and the Framework for Reporting Adaptations and Modifications, for systematically identifying key drivers, core and non-core components of interventions for documenting planned and unplanned changes to intervention design.

RESULTS

The CONNECT intervention's original context and setting is first described and then compared with its new application. This lays the groundwork for the intentional modifications to intervention design, which are developed before intervention delivery to participating providers. The unpredictable nature of implementation in real-world practice required unplanned adaptations, which were also considered and documented. Attendance and participation rates were examined and qualitative assessment of reported participant experience supported the feasibility and acceptability of adaptations of the original CONNECT intervention in a new clinical context.

CONCLUSION

This approach may serve as a useful guide for intervention implementation efforts applied in diverse clinical contexts and subsequent evaluations of intervention effectiveness.

TRIAL REGISTRATION

The study was registered at ClinicalTrials.gov ( NCT03300336 ) on September 28, 2017.

Implementing School-Based Mental Health Services: A Scoping Review of the Literature Summarizing the Factors That Affect Implementation

Background: Mental illness in children and youths has become an increasing problem. School-based mental health services (SBMHS) are an attempt to increase accessibility to mental health services. The effects of these services seem positive, with some mixed results. To date, little is known about the implementation process of SBMHS. Therefore, this scoping review synthesizes the literature on factors that affect the implementation of SBMHS. Methods: A scoping review based on four stages: (a) identifying relevant studies; (b) study selection; (c) charting the data; and (d) collating, summarizing, and reporting the results was performed. From the searches (4414 citations), 360 were include in the full-text screen and 38 in the review. Results: Implementation-related factors were found in all five domains of the Consolidated Framework for Implementation Research. However, certain subfactors were mentioned more often (e.g., the adaptability of the programs, communication, or engagement of key stakeholders). Conclusions: Even though SBMHS differed in their goals and way they were conducted, certain common implementation factors were highlighted more frequently. To minimize the challenges associated with these types of interventions, learning about the implementation of SBMHS and using this knowledge in practice when introducing SBMHS is essential to achieving the best possible effects with SMBHSs.

Eleven Reasons for Adaptation of Swedish Parenting Programs

While questions about adaptation and fidelity are of great concern in many implementation projects, less attention has been paid to reasons for adaptations that remain when evidence-based interventions (EBIs) are used in clinical and community settings. This study aims to explore reasons for adaptations that can arise when using parenting programs in a community setting. Seventeen individual interviews with providers were conducted and analyzed thematically, resulting in 11 reasons for adaptations organized into four separate areas: characteristics of group leaders (supplementary skills and knowledge, preferred ways of working), characteristics of families (problem complexity, diverse or limited educational experience, non-parenting needs for support, colliding value systems), group incidents (criticism and challenges, excessive questions or discussions), and didactic challenges (lack of focus or engagement, limitations of the material, language differences). The study shows that factors triggering adaptation and fidelity decisions continuously reappear in the provision of parenting programs in community settings. Knowledge about reasons for adaptation can be used to inform decision-making during implementation planning, as well as the sustainment of implemented interventions.

What matters when exploring fidelity when using health IT to reduce disparities?

BACKGROUND

Implementation of evidence-based interventions often involves strategies to engage diverse populations while also attempting to maintain external validity. When using health IT tools to deliver patient-centered health messages, systems-level requirements are often at odds with 'on-the ground' tailoring approaches for patient-centered care or ensuring equity among linguistically diverse populations.

METHODS

We conducted a fidelity and acceptability-focused evaluation of the STAR MAMA Program, a 5-month bilingual (English and Spanish) intervention for reducing diabetes risk factors among 181 post-partum women with recent gestational diabetes. The study's purpose was to explore fidelity to pre-determined 'core' (e.g. systems integration) and 'modifiable' equity components (e.g. health coaching responsiveness, and variation by language) using an adapted implementation fidelity framework. Participant-level surveys, systems-level databases of message delivery, call completion, and coaching notes were included.

RESULTS

96.6% of participants are Latina and 80.9% were born outside the US. Among those receiving the STAR MAMA intervention; 55 received the calls in Spanish (61%) and 35 English (39%). 90% (n = 81) completed ≥ one week. Initially, systems errors were common, and increased triggers for health coach call-backs. Although Spanish speakers had more triggers over the intervention period, the difference was not statistically significant. Of the calls triggering a health coach follow-up, attempts were made for 85.4% (n = 152) of the English call triggers and for 80.0% (n = 279) of the Spanish call triggers (NS). Of attempted calls, health coaching calls were complete for 55.6% (n = 85) of English-language call triggers and for 56.6% of Spanish-language call triggers (NS). Some differences in acceptability were noted by language, with Spanish-speakers reporting higher satisfaction with prevention content (p = < 0.01) and English-speakers reporting health coaches were less considerate of their time (p = 0.03).

CONCLUSIONS

By exploring fidelity by language-specific factors, we identified important differences in some but not all equity indicators, with early systems errors quicky remedied and high overall engagement and acceptability. Practice implications include: (1) establishing criteria for languge-equity in interventions, (2) planning for systems level errors so as to reduce their impact between language groups and over time; and (3) examining the impact of engagement with language-concordant interventions on outcomes, including acceptability. Trial Registration National Clinical Trials registration number: CT02240420 Registered September 15, 2014. ClinicalTrials.gov.

Primary Palliative Care for Emergency Medicine (PRIM-ER): Applying form and function to a theory-based complex intervention

Background

Emergency departments are seeing an increase in acute exacerbations of chronic disease in the older-adult population. The delivery of palliative care in the emergency department can increase goal-concordant care at the end-of-life for this population. New interventions in palliative care for emergency medicine require large, pragmatic, complex health interventions due to the heterogeneous and dynamic environment of emergency departments. These complex interventions must balance fidelity with adaptability, while being rooted in theory, to produce an intervention that can be applied in a variety of contexts.

Methods

Primary Palliative Care for Emergency Medicine (PRIM-ER) is a large, pragmatic, complex health intervention. This paper outlines the conceptual theory-based design as well as the study form and functions of PRIM-ER to exemplify how this complex intervention has balanced fidelity with adaptability.

Results

A form and function matrix was created to highlight the key objectives and tailored intervention components of PRIM-ER. Each intervention component was also linked to one or more elements of the Theory of Planned Behavior to support provider behavior change and the delivery of palliative care services and referrals.

Conclusion

The application of theory and delineation of forms and functions, as well prospective adaptation monitoring of large complex interventions can support the balance of fidelity with adaptability to encourage successful interventions among a variety of clinical environments.

•

PRIM-ER is a quality improvement complex intervention to enhance goal-concordant care in the emergency department.

•

Complex interventions must balance fidelity with adaptability to enable transferability across various contexts..

•

Applying form and function in a theory-based conceptual model supports fidelity and adaptability in complex interventions.

The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation

BACKGROUND

There has long been debate about the balance between fidelity to evidence-based interventions (EBIs) and the need for adaptation for specific contexts or particular patients. The debate is relevant to virtually all clinical areas. This paper synthesises arguments from both fidelity and adaptation perspectives to provide a comprehensive understanding of the challenges involved, and proposes a theoretical and practical approach for how fidelity and adaptation can optimally be managed.

DISCUSSION

There are convincing arguments in support of both fidelity and adaptations, representing the perspectives of intervention developers and internal validity on the one hand and users and external validity on the other. Instead of characterizing fidelity and adaptation as mutually exclusive, we propose that they may better be conceptualized as complimentary, representing two synergistic perspectives that can increase the relevance of research, and provide a practical way to approach the goal of optimizing patient outcomes. The theoretical approach proposed, the "Value Equation," provides a method for reconciling the fidelity and adaptation debate by putting it in relation to the value (V) that is produced. The equation involves three terms: intervention (IN), context (C), and implementation strategies (IS). Fidelity and adaptation determine how these terms are balanced and, in turn, the end product - the value it produces for patients, providers, organizations, and systems. The Value Equation summarizes three central propositions: 1) The end product of implementation efforts should emphasize overall value rather than only the intervention effects, 2) implementation strategies can be construed as a method to create fit between EBIs and context, and 3) transparency is vital; not only for the intervention but for all of the four terms of the equation. There are merits to arguments for both fidelity and adaptation. We propose a theoretical approach, a Value Equation, to reconciling the fidelity and adaptation debate. Although there are complexities in the equation and the propositions, we suggest that the Value Equation be used in developing and testing hypotheses that can help implementation science move toward a more granular understanding of the roles of fidelity and adaptation in the implementation process, and ultimately sustainability of practices that provide value to stakeholders.

The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions

BACKGROUND

This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.

DISCUSSION

We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.'s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.

CONCLUSION

The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.