The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care

Predicting the Sustained Implementation of an Evidence-Based Parenting Program: A Structural Equation Modelling Approach

PURPOSE

Sustained implementation is required for evidence-based parenting programs to promote children and their families' wellbeing at the societal level. Previous literature has examined the role of a range of different factors in enhancing sustainability. However, the inter-relationship between, and the relative importance of different factors remain largely unknown. The overall aim of this study is to identify predictors of sustained program use, the relative importance of factors, and potential mediation pathways.

METHODS

We surveyed 1202 practitioners who were trained in at least one variant of the Triple P-Positive Parenting Program, at least one and half years before data collection. The present data were linked with data collected during professional training. We first examined the independent effect of each factor on sustained program use, then, developed and evaluated a structural equation model of sustained program use.

RESULTS

The structural equation model explained a considerable amount of variance in sustained program use, with seven positive predictors and one negative predictor identified. Organisational support was identified as a key facilitator, which was not only positively linked with other facilitators but also had an independent positive effect. Perceived usefulness of the program was the most important practitioner-level facilitator, which might be contributed by both research-based evidence and practice-based evidence. Practitioners' self-regulation in program delivery impacted sustained use by influencing other factors such as perceived usefulness of the program.

CONCLUSION

The findings provided insight into factors influencing the sustainability of evidence-based parenting programs which could be used to inform future implementation practice.

Facilitators and Barriers to Implementation and Sustainability of Nutrition and Physical Activity Interventions in Early Childcare Settings: a Systematic Review

A stronger understanding of the factors influencing implementation of interventions in community-based early childcare settings is needed. The purpose of this systematic review was to synthesize existing research on facilitators and barriers to implementation and sustainability of nutrition and physical activity interventions in early childcare settings targeting 2-5-year-old children, including considerations for equitable implementation. This review adhered to PRISMA 2020 guidelines. Peer-reviewed literature was searched in PubMed, EMBASE, CINAHL, ERIC, and PsycINFO databases up to September 2020. Primary research studies that examined facilitators and barriers (or related synonyms) to the implementation and sustainability of nutrition and physical activity interventions in early childcare settings were eligible for inclusion. The search yielded 8092 records that were screened by four analysts in Covidence software with a final review of 24 studies. Two independent reviewers conducted study selection, data extraction, and quality appraisal (Mixed Methods Appraisal Tool). A "best fit" framework was applied using the Consolidated Framework for Implementation Research (CFIR) constructs to code barriers and facilitators. The most salient constructs were (1) "Available Resources," which was composed of time, staffing, space, and staff trainings; (2) adaptability; and (3) compatibility, the latter two indicating that easily modifiable interventions facilitated a smoother "fit" and were more likely to be successful, given adequate site-level resources. Only nine (28%) reported the use of a theory, model, or framework to guide evaluation; six studies (24%) included factors related to sustainability; and nine studies (38%) conducted their interventions with low-income or minoritized groups. The findings point to the need for intervention evaluations examining nutrition and physical activity to more consistently consider (a) sustainability factors early on in design and adoption phases; (b) use of theory, model, or framework to guide evaluation; and (c) equity-related frameworks and considerations for how equitable implementation.

Sustainability of the Collaborative Chronic Care Model in Outpatient Mental Health Teams Three Years Post-Implementation: A Qualitative Analysis

Our goal was to investigate the sustainability of care practices that are consistent with the collaborative chronic care model (CCM) in nine outpatient mental health teams located within US Department of Veterans Affairs (VA) medical centers, three to four years after the completion of CCM implementation. We conducted qualitative interviews (N = 30) with outpatient mental health staff from each of the nine teams. We based our directed content analysis on the six elements of the CCM. We found variable sustainability of CCM-based care processes across sites. Some care processes, such as delivery of evidence-based psychotherapies (EBPs) and use of measurement-based care (MBC) to guide clinic decision-making, were robustly maintained or even expanded within participating teams. In contrast, other care processes-which had in some cases been developed with considerable effort-had not been sustained. For example, care manager roles were diminished in scope or eliminated completely in response to workload pressures, frontline care needs, or the COVID-19 pandemic. Similarly, processes for engaging Veterans more fully in decision-making had generally been scaled back. Leadership support in the form of adequate team staffing and time to conduct team meetings were seen as crucial for sustaining CCM-consistent care. Given the potential impact of leadership turnover on sustainability in mental health, future efforts to implement CCM-based mental health care should strive to involve multiple leaders in implementation and sustainment efforts, lest one key departure undo years of implementation work. Our results also suggest that implementing CCM processes may best be conceptualized as a partnership across multiple levels of medical center leadership.

Balancing Fidelity and Flexibility: Usual Care for Young Children With an Increased Likelihood of Having Autism Spectrum Disorder Within an Early Intervention System

Naturalistic developmental behavioral interventions (NDBIs) are evidence-based interventions for young children with autism spectrum disorder. There has been growing interest in implementing manualized NDBIs within the early intervention (EI) system without a clear understanding of how these programs and the broader strategies encompassed within them are already used by EI providers. This study examined the use of manualized NDBI programs and broader NDBI strategies within an EI system and factors that impacted their use. Eighty-eight EI providers completed a measure of NDBI program and strategy use. Thirty-three providers participated in a supplemental focus group or interview. Overall, providers described using broader NDBI strategies and the need to adapt manualized NDBI programs. Provider-, intervention-, and organization-level factors impacted their use of NDBI programs and strategies.

Sustaining improvement of hospital-wide initiative for patient safety and quality: a systematic scoping review

BACKGROUND

Long-term sustained improvement following implementation of hospital-wide quality and safety initiatives is not easily achieved. Comprehensive theoretical and practical understanding of how gained improvements can be sustained to benefit safe and high-quality care is needed. This review aimed to identify enabling and hindering factors and their contributions to improvement sustainability from hospital-wide change to enhance patient safety and quality.

METHODS

A systematic scoping review method was used. Searched were peer-reviewed published records on PubMed, Scopus, World of Science, CINAHL, Health Business Elite, Health Policy Reference Centre and Cochrane Library and grey literature. Review inclusion criteria included contemporary (2010 and onwards), empirical factors to improvement sustainability evaluated after the active implementation, hospital(s) based in the western Organisation for Economic Co-operation and Development countries. Numerical and thematic analyses were undertaken.

RESULTS

17 peer-reviewed papers were reviewed. Improvement and implementation approaches were predominantly adopted to guide change. Less than 6 in 10 (53%) of reviewed papers included a guiding framework/model, none with a demonstrated focus on improvement sustainability. With an evaluation time point of 4.3 years on average, 62 factors to improvement sustainability were identified and emerged into three overarching themes: People, Process and Organisational Environment. These entailed, as subthemes, actors and their roles; planning, execution and maintenance of change; and internal contexts that enabled sustainability. Well-coordinated change delivery, customised local integration and continued change effort were three most critical elements. Mechanisms between identified factors emerged in the forms of Influence and Action towards sustained improvement.

CONCLUSIONS

The findings map contemporary empirical factors and their mechanisms towards change sustainability from a hospital-wide initiative to improve patient safety and quality. The identified factors and mechanisms extend current theoretical and empirical knowledgebases of sustaining improvement particularly with those beyond the active implementation. The provided conceptual framework offers an empirically evidenced and actionable guide to assist sustainable organisational change in hospital settings.

Toward Meaningful Cultural Adaptation Across Implementation Stages: Lessons Learned From a Culturally Based HIV Stigma Intervention in Gaborone, Botswana

A culturally based stigma intervention for pregnant women living with HIV in Gaborone, Botswana highlights the importance of conceptualizing and formalizing cultural adaptation across all stages of implementation.

Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review

BACKGROUND

Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings.

METHODS

Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed.

RESULTS

A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants.

CONCLUSIONS

This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field.

TRIAL REGISTRATION

This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.

Understanding How Newly Implemented Rehabilitation Best Practices Are Sustained: A Realist Review

OBJECTIVE

We conducted a realist review to understand how (mechanism) and in what circumstances (context) evidence-based practices are sustained in rehabilitation (outcome).

DATA SOURCES

MEDLINE, Embase, reference lists, and targeted websites.

STUDY SELECTION

Two independent reviewers calibrated study selection; then 1 reviewer screened all titles and abstracts, while the second reviewer screened a random 20%. We repeated this process for full texts. We included 115 documents representing 61 implementation projects (8.9% of identified documents). Included documents described implementation projects in which physical therapists, occupational therapists, and/or speech-language pathologists were the target users of an evidence-based practice.

DATA EXTRACTION

Two reviewers repeated the independent process described in study selection to extract basic study and sustainability characteristics as well as context, mechanism, outcome, and strategy text.

DATA SYNTHESIS

Using basic numerical analyses, we found that only 54% of evidence-based practices in rehabilitation are sustained. Furthermore, while authors who reported sustainability planning sustained the practice 94% of the time, sustainability planning in rehabilitation is rare (only reported 26% of the time). Extracted text was synthesized using the realist technique of inductive and deductive retroduction in which context, mechanism, outcome, and strategy text are combined into narrative explanations of how sustainability works. To inform these explanations, we applied normalization process theory and the theory of planned behavior. Collectively, the 52 identified narratives provide evidence for 3 patterns: (1) implementation and sustainability phases are interconnected, (2) continued use of the evidence-based practice can be interpreted as the ultimate sustainability outcome, and (3) intermediate sustainability outcomes (ie, fit/alignment, financial support, benefits, expertise) can become contextual features influencing other sustainability outcomes.

CONCLUSIONS

Implementation teams can use the narrative explanations generated in this review to optimize sustainability planning. This can sustain practice changes and improve quality of care and patient outcomes. Future research should seek to iteratively refine the proposed narrative explanations.

Quality, safety, and implementation science in acute kidney care

PURPOSE OF REVIEW

Quality and safety are important themes in acute kidney care (AKC). There have been many recent initiatives highlighting these aspects. However, for these to become part of clinical practice, a rigorous implementation science methodology must be followed. This review will present these practices and will highlight recent initiatives in acute kidney injury (AKI), kidney replacement therapy (KRT) and recovery from AKI.

RECENT FINDINGS

The 22nd Acute Disease Quality Initiative (ADQI) focused on achieving a framework for improving AKI care. This has led to various quality improvement (QI) initiatives that have been implemented following a robust implementation science methodology. In AKI, QI initiatives have been focused on implementing care bundles and early detection systems for patients at risk or with AKI. KRT initiatives have focused on measuring and reporting key performance indicators (KPIs), and providing targeted feedback and education to improve delivery of KRT. Finally, it has been recognized that post-AKI care is vitally important, and ongoing work has been focused on implementing pathways to ensure continuing kidney-focused care.

SUMMARY

Quality and safety continue to be important focuses in AKC. Although recent work have focused on initiatives to improve these themes, additional work is necessary to further develop these items as we strive to improve the care to patients with AKI.

Mechanisms of change for a family intervention in Kenya: An Integrated Clinical and Implementation Mapping approach

To increase cultural relevance and maximize access for historically underserved populations, there is a need to explore mechanisms underlying treatment outcomes during piloting. We developed a mixed-method approach, Integrated Clinical and Implementation Mapping (ICIM), to explore clinical and implementation mechanisms to inform improvements in content and delivery. We applied ICIM in a pilot of Tuko Pamoja, a lay counselor-delivered family intervention in Kenya (10 families with adolescents ages 12-17). ICIM is a 3-phase process to triangulate data sources to analyze how and why change occurs within individual cases and across cases. We synthesized data from session and supervision transcripts, fidelity and clinical skills ratings, surveys, and interviews. Outputs included a comprehensive narrative and visual map depicting how content and implementation factors influenced change. For Tuko Pamoja, ICIM results showed common presenting problems, including financial strain and caregivers' distress, triggering negative interactions and adolescent distress. ICIM demonstrated that active treatment ingredients included communication skills and facilitated, prescribed time together. Families improved communication, empathy, and hope, facilitated improved family functioning and mental health. Key implementation mechanisms included provider clinical competencies, alliance-building, treatment-aligned adaptations, and consistent attendance. Results guided manual and training refinements and generated hypotheses about mechanisms to test in larger trials.

"Never waste a good crisis": A qualitative study of the impact of COVID-19 on palliative care in seven hospitals using the Dynamic Sustainability Framework

BACKGROUND

The COVID-19 pandemic led to rapid adaptations among palliative care services, but it is unclear how these adaptations vary in relation to their unique organizational contexts.

AIM

Understand how the pandemic impacted the implementation of new and existing palliative care programs in diverse hospital systems using the Dynamic Sustainability Framework.

DESIGN

Twelve in-depth interviews with 15 key informants representing palliative care programs from seven hospital systems between April and June 2020.

SETTING

Public, not-for-profit private, community, and academic teaching hospitals in the San Francisco Bay Area with existing palliative care programs that were expanding services to new clinical areas (e.g. new outpatient clinic or community-based care).

RESULTS

Six themes characterized how palliative care programs were impacted and adapted during the early stages of the COVID-19 pandemic: palliative care involvement in preparing for surge, increased emphasis on advance care planning, advocating for visitors for dying patients, providing emotional support to clinicians, adopting virtual approaches to care, and gaps in chaplaincy support. There was variation in how new and existing programs were able to adapt to early pandemic stresses; systems with new outpatient programs struggled to utilize their programs effectively during the crisis onset.

CONCLUSIONS

The fit between palliative care programs and practice setting was critical to program resiliency during the early stages of the pandemic. Reconceptualizing the Dynamic Sustainability Framework to reflect a bidirectional relationship between ecological system, practice setting, and intervention levels might better guide implementers and researchers in understanding how ecological/macro changes can influence interventions on the ground.

School-level factors associated with the sustainment of weekly physical activity scheduled in Australian elementary schools: an observational study

Background

We aimed to: (1) identify school-level factors associated with the sustainment of weekly physical activity (PA) scheduled in elementary schools following withdrawal of effective implementation support; and (2) determine teacher’s perceived usefulness of suggested strategies for sustaining the scheduling of weekly PA.

Methods

A secondary exploratory analysis was employed of data from the intervention arm (n = 31 schools) of a randomised controlled trial. Self-report survey data from 134 classroom teachers in New South Wales, Australia, collected following withdrawal of initial implementation support (follow-up T1) and six-months following completion of support (follow-up T2) were used. The outcomes of sustainment of weekly overall PA and energisers (short classroom PA breaks) scheduled were measured via teachers’ completion of a daily activity logbook, with results presented as the difference in mean minutes of PA and energisers scheduled at T1 and T2. An adapted version of the Program Sustainability Assessment Tool (PSAT) was used to measure capacity for program sustainability across seven key domains at follow-up T2. Linear mixed regressions were conducted to evaluate associations between school-level sociodemographic characteristics (e.g., school size, remoteness, and type), teacher-reported school factors (i.e., seven adapted PSAT domains) and the sustainment of PA and energisers scheduled across the school week. Perceived usefulness of 14 proposed sustainability strategies was measured via the teacher survey at follow-up T2 and reported descriptively.

Results

No school-level factor was statistically associated with the sustainment of overall weekly PA or energisers scheduled. Teacher-reported factors in two PSAT domains – ‘strategic planning’ and ‘program evaluation’ were statistically negatively associated with the sustainment of weekly energisers scheduled (− 6.74, 95% CI: − 13.02; − 0.47, p = 0.036 and − 6.65, 95% CI: − 12.17; − 1.12, p = 0.019 respectively). The proposed support sustainability strategy – ‘provision of PA equipment packs that enable energisers or integrated lessons’ was perceived useful by the most teachers (85%).

Conclusions

Further research is required to explore additional contextual-specific, and end-user appropriate factors associated with schools’ sustainment of weekly PA scheduled. This will help accurately inform the development of strategies to address these determinants and support the sustainment and long-term benefits of school-based health interventions more broadly.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13732-6.

Assessing the sustainability capacity of evidence-based programs in community and health settings

Background

Within many public health settings, there remain large challenges to sustaining evidence-based practices. The Program Sustainability Assessment Tool has been developed and validated to measure sustainability capacity of public health, social service, and educational programs. This paper describes how this tool was utilized between January 2014 and January 2019. We describe characteristics of programs that are associated with increased capacity for sustainability and ultimately describe the utility of the PSAT in sustainability research and practice.

Methods

The PSAT is comprised of 8 subscales, measuring sustainability capacity in eight distinct conceptual domains. Each subscale is made up of five items, all assessed on a 7-point Likert scale. Data were obtained from persons who used the PSAT on the online website (https://sustaintool.org/), from 2014 to 2019. In addition to the PSAT scale, participants were asked about four program-level characteristics. The resulting dataset includes 5,706 individual assessments reporting on 2,892 programs.

Results

The mean overall PSAT score was 4.73, with the lowest and highest scoring subscales being funding stability and program adaptation, respectively. Internal consistency for each subscale was excellent (average Cronbach's alpha = 0.90, ranging from 0.85 to 0.94). Confirmatory factor analysis highlighted good to excellent fit of the PSAT measurement model (eight distinct conceptual domains) to the observed data, with a comparative fit index of 0.902, root mean square error of approximation equal to 0.054, and standardized root mean square residual of 0.054. Overall sustainability capacity was significantly related to program size (F = 25.6; p < 0.001). Specifically, smaller programs (with staff sizes of ten or below) consistently reported lower program sustainability capacity. Capacity was not associated with program age and did not vary significantly by program level.

Discussion

The PSAT maintained its excellent reliability when tested with a large and diverse sample over time. Initial criterion validity was explored through the assessment of program characteristics, including program type and program size. The data collected reinforces the ability of the PSAT to assess sustainability capacity for a wide variety of public health and social programs.

Factors contributing to the sustained implementation of an early childhood obesity prevention intervention: The INFANT Program

Background

The INFANT Program is an efficacious, group-based program for first-time parents, delivered at three-monthly intervals when INFANT are aged 3-18 months through an existing universal care service in Victoria, Australia. Many lessons have been learnt from its origins as a cluster randomized control trial to its small-scale, community-level implementation. This study aimed to describe factors contributing to its sustained implementation to inform large-scale implementation across Australia.

Methods

This study used a multi-site qualitative exploratory approach. INFANT facilitators trained between 2013 and 2017 were sent an online survey, with optional telephone interviews. The Consolidated Framework for Implementation Research (CFIR) was selected as the underpinning theoretical framework as it offered the opportunity to explore a breadth of possible barriers and enablers across patterns of implementation (never, discontinued, ongoing).

Results

All participants were female (n = 31), the majority were Maternal and Child Health Nurses (48%), representing five regional and nine metro local government areas (LGAs), across all patterns of implementation (never implemented n = 4; discontinued implementation n = 5; ongoing implementation n = 5). All consenting participants were interviewed (n = 11) representing four regional and seven metro LGAs, across all patterns of implementation (never implemented n = 3; discontinued implementation n = 4; ongoing implementation n = 4). The main reason for attending INFANT Program training was to become skilled to implement the program. Mapping identified barriers and enablers to the CFIR revealed the inner and outer settings and implementation process to be of greatest influence. Main differences between LGAs with ongoing and discontinued implementation related to funding availability, organizational management support and endorsement, organizational resourcing and capacity, integration into routine practice and establishing role clarity with partner organizations, and planning for sustained implementation from the start.

Conclusion

This study provides important insights into the barriers and enablers to the sustained implementation of an evidence-based intervention (the INFANT Program) during small scale community-level implementation. The authors therefore contend that the pre-requisite for scale-up of a population health intervention is not just proof of effectiveness but also proof of sustained implementation at the local/organizational level. Study findings have broad transferability given their similarity to those identified for health promotion interventions implemented globally, in healthcare, education and community settings.

Using implementation strategies in community settings: an introduction to the Expert Recommendations for Implementing Change (ERIC) compilation and future directions

In this commentary, we introduce public health practitioners and researchers to implementation science through an established compilation of implementation strategies. We provide terminology and examples for community settings so public health practitioners and researchers can use implementation strategies and document efforts using standard terminology. We also discuss the need for future work to determine the extent to which these implementation strategies work and are most useful in community settings, and ultimately, how health behaviors are impacted. We intend this commentary to serve as a dissemination strategy for implementation strategies and to contribute to knowledge in the growing field of implementation science in community settings.

Sustainability in pediatric hospitals: An exploration at the intersection of quality improvement and implementation science

Background

Although new evidence-based practices are frequently implemented in clinical settings, many are not sustained, limiting the intended impact. Within implementation science, there is a gap in understanding sustainability. Pediatric healthcare settings have a robust history of quality improvement (QI), which includes a focus on continuation of change efforts. QI capability and sustainability capacity, therefore, serve as a useful concept for connecting the broader fields of QI and implementation science to provide insights on improving care. This study addresses these gaps in understanding of sustainability in pediatric settings and its relationship to QI.

Methods

This is a cross-sectional observational study conducted within pediatric academic medical centers in the United States. Clinicians surveyed worked with one of three evidence-based clinical programs: perioperative antimicrobial stewardship prescribing, early mobility in the intensive care unit, and massive blood transfusion administration. Participants completed two assessments: (1) the Clinical Sustainability Assessment Tool (CSAT) and (2) a 19-question assessment that included demographics and validation questions, specifically a subset of questions from the Change Process Capability Questionnaire, a QI scale. Initial descriptive and bivariate analyses were conducted prior to building mixed-effects models relating perceived QI to clinical sustainability capacity.

Results

A total of 181 individuals from three different programs and 30 sites were included in the final analyses. QI capability scores were assessed as a single construct (5-point Likert scale), with an average response of 4.16 (higher scores indicate greater QI capability). The overall CSAT score (7-point Likert scale) was the highest for massive transfusion programs (5.51, SD = 0.91), followed by early mobility (5.25, SD = 0.92) and perioperative antibiotic prescribing (4.91, SD = 1.07). Mixed-effects modeling illustrated that after controlling for person and setting level variables, higher perceptions of QI capabilities were significantly related to overall clinical sustainability.

Conclusion

Organizations and programs with higher QI capabilities had a higher sustainability capacity, even when controlling for differences at the individual and intervention levels. Organizational factors that enable evidence-based interventions should be further studied, especially as they relate to sustainability. Issues to be considered by practitioners when planning for sustainability include bedside provider perceptions, intervention achievability, frequency of delivery, and organizational influences.

BeatPain Utah: study protocol for a pragmatic randomised trial examining telehealth strategies to provide non-pharmacologic pain care for persons with chronic low back pain receiving care in federally qualified health centers

INTRODUCTION

Although evidence-based guidelines recommend non-pharmacologic treatments as first-line care for chronic low back pain (LBP), uptake has been limited, particularly in rural, low-income and ethnically diverse communities. The BeatPain study will evaluate the implementation and compare the effectiveness of two strategies to provide non-pharmacologic treatment for chronic LBP. The study will use telehealth to overcome access barriers for persons receiving care in federally qualified health centres (FQHCs) in the state of Utah.

METHODS AND ANALYSIS

BeatPain Utah is a pragmatic randomised clinical trial with a hybrid type I design investigating different strategies to provide non-pharmacologic care for adults with chronic LBP seen in Utah FQHCs. The intervention strategies include a brief pain consult (BPC) and telehealth physical therapy (PT) component provided using either an adaptive or sequenced delivery strategy across two 12-week treatment phases. Interventions are provided via telehealth by centrally located physical therapists. The sequenced delivery strategy provides the BPC, followed by telehealth PT in the first 12 weeks for all patients. The adaptive strategy uses a stepped care approach and provides the BPC in the first 12 weeks and telehealth PT to patients who are non-responders to the BPC component. We will recruit 500 English-speaking or Spanish-speaking participants who will be individually randomised with 1:1 allocation. The primary outcome is the Pain, Enjoyment and General Activity measure of pain impact with secondary outcomes including the additional pain assessment domains specified by the National Institutes (NIH) of Health Helping to End Addiction Long Initiative and implementation measures. Analyses of primary and secondary measures of effectiveness will be performed under longitudinal mixed effect models across assessments at baseline, and at 12, 26 and 52 weeks follow-ups.

ETHICS AND DISSEMINATION

Ethics approval for the study was obtained from the University of Utah Institutional Review Board. On completion, study data will be made available in compliance with NIH data sharing policies.

TRIAL REGISTRATION NUMBER

NCT04923334.

Predictors of sustainment of two distinct nutrition and physical activity programs in early care and education

Introduction

The goal of the present study was to investigate factors associated with sustainment of two evidence-based programs for nutrition promotion in early care and education (ECE) settings - Food Friends (FF) and Together, We Inspire Smart Eating (WISE).

Materials and methods

In a cross-sectional study design, ECE directors (N = 55) from centers that had previously been trained in WISE or FF completed a survey. Program-specific measures included Steckler's Perception of Innovations, the Program Sustainability Assessment Tool (PSAT), and the Organizational Readiness for Change Assessment (ORCA). For our primary outcomes, two measures of sustainment were examined: Nutrition Continued Practice (i.e., the use of or general focus on nutrition programs) and Program Fidelity (i.e., how well centers used specific evidence-based practices of WISE or FF). Multiple regression was used to determine the association of these outcomes with program, years since last implementation, and overall scores on predictors. Follow-up correlation analyses were used to investigate outcome relationships with context submeasures due to high intercorrelations between predictor submeasures.

Results

Nutrition Continued Practice was significantly predicted by program and overall PSAT score. WISE programs had significantly higher Nutrition Continued Practice scores than FF program (p = 0.03). All subscales of the PSAT (e.g., environmental support, funding stability, organizational capacity, program adaptation, communications, and strategic planning) were significantly correlated with Nutrition Continued Practice (all rs > 0.30, all ps < 0.03). Program Fidelity was significantly predicted by PSAT and Steckler Perception of Innovation scores. All subscales of the PSAT were strongly positively correlated with Program Fidelity (all rs > 0.48, all ps < 0.001); relative advantage (r = 0.54, p < 0.001) and level of institutionalization (r = 0.61, p < 0.001) were positively correlated with Program Fidelity.

Conclusion

This study suggests that factors associated with the continued practice of program principles are partially distinct from those that are associated with the sustainment of specific practices driving program fidelity. Results suggest capacity building strategies may be important for both continued attention to nutrition and physical activity as well as sustaining fidelity to specific evidence-based practices.

Do the Expert Recommendations for Implementing Change (ERIC) strategies adequately address sustainment?

Background

Sustainability science is an emerging area within implementation science. There is limited evidence regarding strategies to best support the continued delivery and sustained impact of evidence-based interventions (EBIs). To build such evidence, clear definitions, and ways to operationalize strategies specific and/or relevant to sustainment are required. Taxonomies and compilations such as the Expert Recommendations for Implementing Change (ERIC) were developed to describe and organize implementation strategies. This study aimed to adapt, refine, and extend the ERIC compilation to incorporate an explicit focus on sustainment. We also sought to classify the specific phase(s) of implementation when the ERIC strategies could be considered and applied.

Methods

We used a two-phase iterative approach to adapt the ERIC. This involved: (1) adapting through consensus (ERIC strategies were mapped against barriers to sustainment as identified via the literature to identify if existing implementation strategies were sufficient to address sustainment, needed wording changes, or if new strategies were required) and; (2) preliminary application of this sustainment-explicit ERIC glossary (strategies described in published sustainment interventions were coded against the glossary to identify if any further amendments were needed). All team members independently reviewed changes and provided feedback for subsequent iterations until consensus was reached. Following this, and utilizing the same consensus process, the Exploration, Preparation, Implementation and Sustainment (EPIS) Framework was applied to identify when each strategy may be best employed across phases.

Results

Surface level changes were made to the definitions of 41 of the 73 ERIC strategies to explicitly address sustainment. Four additional strategies received deeper changes in their definitions. One new strategy was identified: Communicate with stakeholders the continued impact of the evidence-based practice. Application of the EPIS identified that at least three-quarters of strategies should be considered during preparation and implementation phases as they are likely to impact sustainment.

Conclusion

A sustainment-explicit ERIC glossary is provided to help researchers and practitioners develop, test, or apply strategies to improve the sustainment of EBIs in real-world settings. Whilst most ERIC strategies only needed minor changes, their impact on sustainment needs to be tested empirically which may require significant refinement or additions in the future.

Navigating Supported Employment and Education Services for Youths During COVID-19 and Severe Weather Events

In 2021, the British Columbia (BC) Interior experienced a series of unprecedented disasters, ranging from extreme heat and wildfires to catastrophic flooding and evacuations. Along with these severe weather events, BC was affected by COVID-19 outbreaks and public health restrictions. Despite these challenges, communities worked to ensure that youths who are at risk for increased mental health challenges continued to have access to services that promote well-being, such as individual placement and support programs for supported employment and education. This Open Forum presents program considerations and adaptations in Foundry Penticton, one of 12 province-wide integrated youth hubs, to ensure service delivery during acute and chronic disasters.

Sustainment of an Evidence-Based, Behavioral Health Curriculum in Schools

The development of evidence-based interventions (EBIs) for the prevention of behavioral health problems is well supported. However, limited data exist on the sustainability of EBIs once initial support has ceased. The current study assessed, at 2 years after initial start-up support: (1) What percent of schools sustained EBI implementation? (2) To what degree did sustaining schools implement the EBI with fidelity? (3) What were the primary reasons for not sustaining the EBI? (4) What theoretical and contextual factors during initial start-up support predicted sustainment of the EBI? The study used process evaluation data from the dissemination of the Botvin LifeSkills Training (LST) middle school program in 158 school districts (including 419 schools). Fifty-one percent of districts sustained the EBI and most of these sustaining districts reported following key fidelity guidelines. Primary reasons for discontinuing centered around low teacher or administrative support and turnover. Significant predictors of sustaining LST were higher ratings of LST's complexity, benefit, and compatibility by teachers; more positive perceptions of organizational support from administrators; and smaller proportions of Black students. Results show that EBI sustainment and fidelity of implementation post-initial startup support are feasible, though likely not for all schools. Findings also suggest that cultivating support for the EBI among staff during start-up support may be helpful for sustainment and that social determinants of a school have a complex relationship with EBI sustainment. Future research should explore true causes of differences due to race/ethnicity as well as COVID-19 effects.

Expert-generated standard practice elements for evidence-based home visiting programs using a Delphi process

BACKGROUND

States, territories, non-profits, and tribes are eligible to obtain federal funding to implement federally endorsed evidence-based home visiting programs. This represents a massive success in translational science, with $400 million a year allocated to these implementation efforts. This legislation also requires that 3% of this annual funding be allocated to tribal entities implementing home visiting in their communities. However, implementing stakeholders face challenges with selecting which program is best for their desired outcomes and context. Moreover, recent reviews have indicated that when implemented in practice and delivered at scale, many evidence-based home visiting programs fail to replicate the retention rates and effects achieved during clinical trials. To inform program implementers and better identify the active ingredients in home visiting programs that drive significant impacts, we aimed to develop an expert derived consensus taxonomy on the elements used in home visiting practice that are essential to priority outcome domains.

METHODS

We convened a panel of 16 experts representing researchers, model representatives, and program implementers using a Delphi approach. We first elicited standard practice elements (SPEs) using open-ended inquiry, then compared these elements to behavior change techniques (BCTs) given their general importance in the field of home visiting; and finally rated their importance to 10 outcome domains.

RESULTS

Our process identified 48 SPEs derived from the panel, with 83 additional BCTs added based on the literature. Six SPEs, mostly related to home visitor characteristics and skills, were rated essential across all outcome domains. Fifty-three of the 83 BCTs were rated unnecessary across all outcome domains.

CONCLUSIONS

This work represents the first step in a consensus-grounded taxonomy of techniques and strategies necessary for home visiting programs and provides a framework for future hypothesis testing and replication studies.

Mental Health Reform: Design and Implementation of a System to Optimize Outcomes for Veterans and Their Families

The social, health, and economic burden of mental health problems in the veteran community is heavy. Internationally, the array of services and support available to veterans and their families are extensive but vary in quality, are often disconnected, complex to navigate, and lack clear coordination. This paper describes a conceptual framework to guide the design and implementation of a system of services and supports to optimize the mental health and wellbeing of all veterans and their families. The framework recognizes the diversity of veterans across intersecting identities that uniquely shape experiences of posttraumatic mental health and wellbeing. It brings together several strands of research: the values and principles that should underpin the system; the needs of diverse veterans and their families; challenges in the current services and supports; evidence-based interventions; and principles of effective implementation. Central to the future system design is a next generation stepped model of care that organizes best and next practice interventions in a coherent system, matches service provision to level of need and addresses access and navigation. Practical guidance on implementation provides an aspirational and flexible structure for system evolution, and a template for all stakeholders-individuals, groups, agencies and organizations-to effect system change.

Review article: A primer for clinical researchers in the emergency department: Part XII. Sustainability of improvements in care: An introduction

Despite an increased focus on ways to improve implementation of evidence and de-implementation of practices with no known benefit, there is limited guidance on how to sustain these improvements. This review provides an introduction to sustainability of improvements in care and sustainability research, discussing how to support sustainability in practice and detailing a sustainability research agenda for the emergency medicine setting.

Application of a sustainability framework to enhance Australian food literacy programs in remote Western Australian communities

ISSUE ADDRESSED

Food literacy programs aim to build individuals' knowledge, skills and self-efficacy to adopt healthy food choices conducive to reducing the risk of chronic diseases, such as obesity. Foodbank WA's (FBWA) Healthy Food for All^® nutrition programs have supported the improvement of food literacy knowledge and skills among vulnerable people living in the Pilbara.

METHODS

A Sustainability Framework containing ten sustainability factors was overlaid with social ecological model (SEM) levels of influence to form a matrix. The use of this matrix facilitated sustainability strategy appraisal within three food literacy programs delivered in remote WA.

RESULTS

Programs included multiple sustainability strategies across levels of influence; all programs addressed all ten sustainability factors at community and organisational SEM levels of influence. Few sustainability strategies were employed at the public policy level of influence. No program employed formal governance structures to guide program direction, such as steering groups; however, school and parent program staff developed Memoranda of Understanding to ensure the continuation of program delivery between the FBWA teams' regional visits.

CONCLUSIONS

This study has showcased the comprehensive assessment of food literacy program sustainability across levels of influence and identified gaps for improvement by FBWA teams. SO WHAT?: The sustainability of food literacy programs aiming to increase knowledge and skills could be enhanced by conducting a similar analysis, during program planning or at program review. Using the matrix provides the opportunity to focus resources to address sustainability; supporting health promotion practitioners to transform the impacts of short-term food literacy interventions into long-term sustained outcomes.

Using structured implementation interventions to improve referral to substance use treatment among justice-involved youth: Findings from a multisite cluster randomized trial

INTRODUCTION

Youth involved in the justice system have high rates of alcohol and other drug use, but limited treatment engagement. JJ-TRIALS tested implementation activities with community supervision (CS) and behavioral health (BH) agencies to improve screening, identification of substance use service need, referral, and treatment initiation and engagement, guided by the BH Services Cascade and EPIS frameworks. This paper summarizes intervention impacts on referrals to treatment among youth on CS.

METHODS

This multisite cluster-randomized trial involved 18 matched pairs of sites in 36 counties in seven states randomly assigned to core or enhanced conditions after implementing the core intervention at all sites for six months. Enhanced sites received external facilitation for local change team activities to reduce unmet treatment needs; Core sites were encouraged to form interagency workgroups. The dependent variable was percentage referred to treatment among youth in need (N = 14,012). Two-level Bayesian regression assessed factors predicting referral across all sites and time periods. Generalized linear mixed models using logit transformation tested two hypotheses: (H1) referrals will increase from baseline to the experimental period, (H2) referral increases will be larger in enhanced sites than in core sites.

RESULTS

Although the intervention significantly increased referral, condition did not significantly predict referral across all time periods. Youth who tested drug positive, had an alcohol/other drug-related or felony charge, were placed in secure detention or assigned more intensive supervision, or who were White were more likely to be referred. H1 (p < .05) and H2 (p < .0001) were both significant in the hypothesized direction. Interaction analyses comparing site pair differences showed that findings were not consistent across sites.

CONCLUSIONS

The percentage of youth referred to treatment increased compared with baseline overall, and enhanced sites showed larger increases in referrals over time. However, variations in effects suggest that site-level differences were important. Researchers should carry out mixed methods studies to further understand reasons for the inconsistent findings within randomized site pairs, and how to further improve treatment referrals across CS and BH systems. Findings also highlight that even when CS agencies work collaboratively with BH providers to improve referrals, most justice-involved youth who need SU services are not referred.

Applying dissemination and implementation research methods to translate a school-based asthma program

Our school-based asthma program has reduced asthma exacerbations for youth with health disparities in the Denver metropolitan area, due partly to addressing social determinants of health, such as access to health care and medications. Dissemination and implementation (D&I) science approaches accelerate the translation of evidence-based programs into routine practice. D&I methods are being applied more commonly to improve health equity. The purpose of this publication was to give an overview of D&I research methods, using our school-based asthma program as an example. To successfully scale out our program across the state of Colorado, we are applying a D&I framework that guides the adaptation of our existing implementation approach to better meet our stakeholders' local context-the Exploration, Preparation, Implementation, Sustainment framework. In a pragmatic trial design, we will evaluate the outcomes of implementing the program across 5 Colorado regions, with attention to health equity, using a second commonly used D&I framework-Reach, Effectiveness, Adoption, Implementation, and Maintenance. Our central hypothesis is that our program will have broad and equitable reach to eligible students (primary outcome) and will reduce asthma attacks and symptoms. This D&I approach accelerates dissemination of our program and is an applicable process for translating other effective allergy/asthma programs to address asthma and allergy-related disparities.

Identifying and Exploring Sustainability Determinants of Mental Health Recovery-Oriented Interventions: A Mixed Methods Study Protocol

Mental health recovery is the new paradigm in the mental health service delivery system worldwide. Recovery-oriented services go beyond traditional clinical care that is centered on symptom remission, aiming to help people: restore social connections with other individuals and the community; develop hope and optimism for the future; reconstruct an identity beyond that of a “mental patient”; discover meaning in life; and feel empowered to gain control over treatment (CHIME framework). Over the last ten years, several efforts at implementation of recovery-oriented interventions have been documented in the scientific literature. However, little attention has been given to their sustainability, even though it is reported that not all health interventions can fully sustain their activities beyond the initial implementation phase. The aim of this mixed methods case study is to better understand the factors that determine the sustainability of two recovery-oriented interventions (peer support and recovery training) after their roll-out in four organizations in Canada that provide community housing for adults with mental health challenges. Qualitative and quantitative data will be collected from managers, service providers, and implementation team members that oversaw the implementation process along with organizational documents. Data collection and analysis will be guided by the Consolidated Framework for Sustainability Constructs in Healthcare, the Framework for Reporting Adaptations and Modifications, and the Program Sustainability Assessment Tool. Findings will expand our current evidence base on the intersection of sustainability and mental health recovery interventions that remains under-explored.

The Implementation of Evidence-Informed Family Nursing Practices: A Scoping Review of Strategies, Contextual Determinants, and Outcomes

There is a lack of knowledge about the successful implementation of family nursing practices. This scoping review maps current knowledge about the implementation of evidence-informed family nursing practices across settings and populations. A systematic search (CINAHL, PubMed, Medline) identified 24 publications, published between 2010 and 2020. We found nurses' implementation experience to be one of disruption, learning, and moving to new ways of practicing. The implementation resulted in benefits to families and self but was marked by fluctuation and partial integration of evidence-informed family nursing practices into care delivery. Uptake was shaped by various contextual determinants, with barriers mainly at the team and organizational levels. We identified low-quality, tentative evidence that capacity-building strategies coupled with dissemination-educational strategies may enable family nursing practice skills and increase the quality of family care. More rigorous research is needed to build further knowledge about effective implementation. Future implementation endeavors should utilize the evolving knowledge base in family nursing and tailor implementation strategies to contextual barriers.

Methods to improve the translation of evidence-based interventions: A primer on dissemination and implementation science for occupational safety and health researchers and practitioners

Objective

A limited focus on dissemination and implementation (D&I) science has hindered the uptake of evidence-based interventions (EBIs) that reduce workplace morbidity and mortality. D&I science methods can be used in the occupational safety and health (OSH) field to advance the adoption, implementation, and sustainment of EBIs for complex workplaces. These approaches should be responsive to contextual factors, including the needs of partners and beneficiaries (such as employers, employees, and intermediaries).

Methods

By synthesizing seminal literature and texts and leveraging our collective knowledge as D&I science and/or OSH researchers, we developed a D&I science primer for OSH. First, we provide an overview of common D&I terminology and concepts. Second, we describe several key and evolving issues in D&I science: balancing adaptation with intervention fidelity and specifying implementation outcomes and strategies. Next, we review D&I theories, models, and frameworks and offer examples for applying these to OSH research. We also discuss widely used D&I research designs, methods, and measures. Finally, we discuss future directions for D&I science application to OSH and provide resources for further exploration.

Results

We compiled a D&I science primer for OSH appropriate for practitioners and evaluators, especially those newer to the field.

Conclusion

This article fills a gap in the OSH research by providing an overview of D&I science to enhance understanding of key concepts, issues, models, designs, methods and measures for the translation into practice of effective OSH interventions to advance the safety, health and well-being of workers.

Public policy and parent-child aggression: Considerations for reducing and preventing physical punishment and abuse

Parent-child physical aggression, including both physical punishment and abuse, remains a prevalent problem in the United States. In this paper, we briefly review the prevalence and harms of parent-child aggression and discuss changes in social norms and policies over the past several decades. Then, we discuss broad social policies influencing risk for parent-child physical aggression, policies relevant to reducing and preventing physical abuse, and policies relevant to reducing and preventing physical punishment. We close by considering future directions to strengthen research and evaluation and accelerate progress toward ending parent-child physical aggression.

Sustainability capacity of a vegetable gardening intervention for cancer survivors

BACKGROUND

Health behavior interventions, especially those that promote improved diet and physical activity, are increasingly directed toward cancer survivors given their burgeoning numbers and high risk for comorbidity and functional decline. However, for health behavior interventions to achieve maximal public health impact, sustainability at both the individual and organizational levels is crucial. The current study aimed to assess the individual and organizational sustainability of the Harvest for Health mentored vegetable gardening intervention among cancer survivors.

METHODS

Telephone surveys were conducted among 100 cancer survivors (mean age 63 years; primarily breast cancer) completing one-of-two Harvest for Health feasibility trials. Surveys ascertained whether participants continued gardening, and if so, whether they had expanded their gardens. Additionally, surveys were emailed to 23 stakeholders (Cooperative Extension county agents, cancer support group leaders, and healthcare representatives) who were asked to rate the intervention's ability to generate sustained service and produce benefits over time using the eight-domain Program Sustainability Assessment Tool (PSAT).

RESULTS

The survey among cancer survivors (91.9% response rate) indicated that 85.7% continued gardening throughout the 12 months following intervention completion; 47.3% expanded their gardens beyond the space of the original intervention. Moreover, 5.5% of cancer survivors enrolled in the certification program to become Extension Master Gardeners. The survey among stakeholders generated a similar response rate (i.e., 91.3%) and favorable scores. Of the possible maximum of 7 points on the PSAT, the gardening intervention's "Overall Capacity for Sustainability" scored 5.7 (81.4% of the maximum score), with subscales for "Funding Stability" scoring the lowest though still favorably (5.0) and "Program Evaluation" scoring the highest (6.3).

CONCLUSIONS

Data support the sustainability capacity of the Harvest for Health vegetable gardening intervention for cancer survivors. Indeed, few interventions have proven as durable in terms of individual sustainability. Furthermore, Harvest for Health's overall organizational score of 5.7 on the PSAT is considered strong when compared to a previous review of over 250 programs, where the mean overall organizational PSAT score was 4.84. Thus, solutions for long-term funding are currently being explored to support this strong, holistic program that is directed toward this vulnerable and growing population.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02150148.

Expanding access to medications for opioid use disorder through locally-initiated implementation

Background

Despite demonstrated efficacy, medication treatment for opioid use disorder (MOUD) remain inaccessible to many patients, with barriers identified at the individual, clinic and system level. A wide array of implementation strategies have guided efforts to expand access to MOUD, with most centered around externally-facilitated approaches to practice change. While effective, such approaches may be inaccessible to those clinics and systems that lack the resources necessary to partner with an external team, suggesting a need to identify and describe change-processes that are internally developed and promoted.

Methods

Guided by the Consolidated Framework for Implementation Research (CFIR), we utilized qualitative interviews and ethnographic observation to investigate the planning, design and implementation of a locally-initiated process to expand access to MOUD within one health care system. All study documents were coded by a primary coder and secondary reviewer using a codebook designed for use with the CFIR. To analyze data, we reviewed text tagged by key codes, compared these textual excerpts both across and within documents, and organized findings into themes. Processes identified were mapped to established implementation science constructs and strategies.

Results

Interviews with clinicians and administrators (n = 9) and ethnographic observation of planning meetings (n = 3) revealed how a self-appointed local team developed, established broad support for, and successfully implemented a Primary Care-based Buprenorphine Clinic and E-Consult Service to expand access to MOUD to patients across the health care system. First, national and local policy changes—including altered clinical practice guidelines, performance pay incentives regarding opioid prescribing, and a directive from VA Central Office increased individual staff and administrators’ perception of the need for change and willingness to invest time and resources. Then, a self-appointed interdisciplinary team utilized cross-clinic meetings and information gathering to identify appropriate, and widely supported, models of care delivery and care consultation. Finally, the team increased staff investment in these change efforts by bringing them into the planning process and encouraging collaborative problem solving.

Conclusions

This study reveals how a local team developed and built widespread support for new processes of care that were tailored to local needs and well-positioned for sustainability over time.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13722-022-00312-7.

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: Cross-project Analysis

BACKGROUND

People often prefer evidence-based psychosocial interventions (EBPIs) for mental health care; however, these interventions frequently remain unavailable to people in nonspecialty or integrated settings, such as primary care and schools. Previous research has suggested that usability, a concept from human-centered design, could support an understanding of the barriers to and facilitators of the successful adoption of EBPIs and support the redesign of EBPIs and implementation strategies.

OBJECTIVE

This study aimed to identify and categorize usability issues in EBPIs and their implementation strategies.

METHODS

We adapted a usability issue analysis and reporting format from a human-centered design. A total of 13 projects supported by the National Institute of Mental Health-funded Accelerating the Reach and Impact of Treatments for Youth and Adults with Mental Illness Center at the University of Washington used this format to describe usability issues for EBPIs and implementation strategies with which they were working. Center researchers used iterative affinity diagramming and coding processes to identify usability issue categories. On the basis of these categories and the underlying issues, we propose heuristics for the design or redesign of EBPIs and implementation strategies.

RESULTS

The 13 projects reported a total of 90 usability issues, which we categorized into 12 categories, including complex and/or cognitively overwhelming, required time exceeding available time, incompatibility with interventionist preference or practice, incompatibility with existing workflow, insufficient customization to clients/recipients, intervention buy-in (value), interventionist buy-in (trust), overreliance on technology, requires unavailable infrastructure, inadequate scaffolding for client/recipient, inadequate training and scaffolding for interventionists, and lack of support for necessary communication. These issues range from minor inconveniences that affect a few interventionists or recipients to severe issues that prevent all interventionists or recipients in a setting from completing part or all of the intervention. We propose 12 corresponding heuristics to guide EBPIs and implementation strategy designers in preventing and addressing these usability issues.

CONCLUSIONS

Usability issues were prevalent in the studied EBPIs and implementation strategies. We recommend using the lens of usability evaluation to understand and address barriers to the effective use and reach of EBPIs and implementation strategies.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/14990.

Realist evaluation of the impact of the research translation process on health system sustainability: a study protocol

INTRODUCTION

Sustainability at a system level relates to the capacity of the system to be able to service the ongoing health needs of the population. It is a multifaceted concept encompassing both the affordability and efficiency of a system and the system's ability to adapt and change.To address issues that currently threaten health system sustainability, healthcare leaders, policy makers, clinicians and researchers are searching for solutions to ensure the delivery of safe, value-based care into the future. The timely translation of research evidence into sustainable interventions that can be adopted into the health system is one way of bolstering the sustainability of the system as a whole. We present a protocol for the realist evaluation of a research translation funding programme to understand how the research translation process contributes to health system sustainability and value-based healthcare.

METHODS AND ANALYSIS

Underpinned by the realist evaluation framework, we will: (1) Develop the Initial Program Theory (IPT) of the research translation process; (2) Test the program theory through case study analysis; and (3) Refine and consolidate the theory through stakeholder consultation. The evaluation uses a case example of a research translation programme, chosen for its representation of a microcosm of the broader health system and the heterogeneity of service improvement activities taking place within it. Across the three phases, analysis of data from documents about the research translation program and interviews and focus groups with stakeholders and program users will draw on the context (C), mechanism (M), outcome (O) formula that is core to realist evaluation. In addition, system dynamic methods will capture the feedback loops and complex relationships among the IPT and context-mechanism-outcome configurations. This approach to evaluation of a research translation funding programme may be adapted to similar programmes operating in other settings.

ETHICS AND DISSEMINATION

Curtin University Human Research Ethics Committee, Western Australia, approved this study (approval number: HRE2020-0464). Results will be published in scientific journals, and communicated to respondents and relevant partners.

Implementation and modification of an organizational-level intervention: a prospective analysis

Background

Modifications to interventions can jeopardize intervention outcomes. Pre-existing perceived barriers and facilitators to the intervention arising in the implementation preparation phase may help explain why modifications to the intervention may occur during the implementation phase. This two-site comparative case study describes modifications made to a complex organizational-level intervention and examines how known implementation science factors may have enabled such changes to occur.

Methods

Northwestern Medicine’s^TM Hispanic Kidney Transplant Program (HKTP) is a culturally competent transplant center-based intervention designed to reduce disparities in living donor kidney transplantation among Hispanics. In-depth qualitative interviews and discussions were longitudinally conducted with transplant stakeholders (i.e., physicians, administrators, clinicians) at two kidney transplant programs with large Hispanic populations during implementation preparation and implementation phases. The Consolidated Framework for Implementation Research (CFIR) guided interview design and qualitative analysis, and Stirman’s Framework for Reporting Adaptations and Modifications-Expanded (FRAME) guided modification classification.

Results

Across sites, 57 stakeholders participated in an interview, group discussion, and/or learning collaborative discussion. Site-B made more modifications than Site-A (n = 29 versus n = 18). Sites differed in the proportions of delaying/skipping (Site-A 50% versus Site-B 28%) and adding (Site-A 11% versus Site-B 28%) but had comparable substituting (Site-A 17% versus Site-B 17%) and tweaking (Site-A 17% versus Site-B 14%) modification types. Across sites, the transplant team consistently initiated the most modifications (Site-A 66%; Site-B 62%). While individuals initiated slightly more modifications at Site-B (21% versus Site-A 17%), institutions instigated proportionately slightly more modifications at Site-A (17% versus Site-B 10%). CFIR inner setting factors (i.e., structural characteristics, culture, available resources, implementation climate) that prominently emerged during the implementation preparation phase explained similarities and differences in sites’ modification numbers, types, and agents in the implementation phase.

Conclusion

Organizations implementing a culturally competent care intervention made modifications. CFIR inner setting factors emerging in the implementation preparation phase largely explained similarities and differences in study sites’ modifications. Identifying factors contributing to modifications may help institutions become better prepared to implement an intervention by addressing known factors in advance, which may foster greater fidelity leading to desired outcomes.

Trial registration

ClinicalTrials.govNCT03276390. We registered the study retrospectively on 9-7-17.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00296-0.

Grounding implementation science in health equity for cancer prevention and control

BACKGROUND

The past decade of research has seen theoretical and methodological advances in both implementation science and health equity research, opening a window of opportunity for facilitating and accelerating cross-disciplinary exchanges across these fields that have largely operated in siloes. In 2019 and 2020, the National Cancer Institute's Consortium for Cancer Implementation Science convened an action group focused on 'health equity and context' to identify opportunities to advance implementation science. In this paper, we present a narrative review and synthesis of the relevant literature at the intersection of health equity and implementation science, highlight identified opportunities (i.e., public goods) by the action group for advancing implementation science in cancer prevention and control, and integrate the two by providing key recommendations for future directions.

DISCUSSION

In the review and synthesis of the literature, we highlight recent advances in implementation science, relevant to promoting health equity (e.g., theories/models/frameworks, adaptations, implementation strategies, study designs, implementation determinants, and outcomes). We acknowledge the contributions from the broader field of health equity research and discuss opportunities for integration and synergy with implementation science, which include (1) articulating an explicit focus on health equity for conducting and reviewing implementation science; (2) promoting an explicit focus on health equity in the theories, models, and frameworks guiding implementation science; and (3) identifying methods for understanding and documenting influences on the context of implementation that incorporate a focus on equity. To advance the science of implementation with a focus on health equity, we reflect on the essential groundwork needed to promote bi-directional learning between the fields of implementation science and health equity research and recommend (1) building capacity among researchers and research institutions for health equity-focused and community-engaged implementation science; (2) incorporating health equity considerations across all key implementation focus areas (e.g., adaptations, implementation strategies, study design, determinants, and outcomes); and (3) continuing a focus on transdisciplinary opportunities in health equity research and implementation science. We believe that these recommendations can help advance implementation science by incorporating an explicit focus on health equity in the context of cancer prevention and control and beyond.

M.I.C.A.H. Project HEAL: Sustainability of a Faith-Based Community Health Advisor Training Program in Urban Underserved Communities in the USA

Faith-based organizations (FBOs) can play an important role in improving health outcomes. Lay community health advisors (CHAs) are integral to these efforts. This paper assesses the sustainability of a CHA training program for congregants in African-American and Latino FBOs and subsequent implementation of educational workshops. The program is unique in that a health care chaplain in an academic medical center was central to the program's development and implementation. Forty-eight CHAs in 11 FBOs were trained to teach workshops on cardiovascular health, mental health, diabetes, and smoking cessation. Two thousand four hundred and forty-four participants attended 70 workshops. This program has the potential to be a model to educate individuals and to address health inequities in underserved communities. Health care chaplains in other medical centers may use this as a model for enhancing community engagement and education.

What is needed to sustain comprehensive medication management? One health plan’s perspectives

Implementation of comprehensive medication management (CMM) in the community pharmacy setting remains sporadic despite its prevalence in other pharmacy contexts. One health plan has been investing in CMM since 2010. Their experience and perceptions in the payer-provider partnership could offer unique insights into the sustainability of CMM in community pharmacy. As part of a broader academic-payer-provider partnership, perceptions of CMM sustainability were explored with key stakeholders in the health plan through a semistructured group interview. Five themes emerged: (1) distinction between CMM and other patient care opportunities, (2) building a CMM program that delivers value requires an investment in network development, (3) payment design influences sustainability, (4) lack of push from community pharmacies to pay for CMM, and (5) the importance of an ongoing facilitated learning and action collaborative. Given previously demonstrated positive return-on-investment, CMM in community pharmacies shows promise for being a sustainable practice model. However, increased reach and performance of networks, as well as number of payers in the market, will be critical to scaling CMM in the community pharmacy setting.

Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention

Background

In order to achieve wide-scale impact in community settings, programs must be sustained. Theory and empirical evidence suggest that intervention characteristics, organizational context, capacity for program implementation, and processes related to implementation are associated with continued program delivery. However, few studies examine how combinations of these factors work together in different settings to influence program sustainment.

Methods

Using scales specified in the Program Sustainability Assessment Tool (PSAT), the current cross-sectional study aims to identify the necessary and sufficient conditions for the sustainment of the Strengthening Families Program for Parents and Youth 10-14 (SFP 10-14). Staff (n = 59) at SFP 10-14 implementation sites across Washington State completed an online survey reporting on their current level of SFP 10-14 sustainment. They also completed PSAT, with eight scales designed to assess conditions that consistently produce sustainment. Data were analyzed using qualitative comparative analysis.

Results

Environmental support was the only necessary condition for sustainment success. Four solutions sufficient to achieve sustainment were also identified. These included the combined presence of (1) environmental support, organizational capacity, and funding stability; (2) environmental support, organizational capacity, communication, and program evaluation, in the absence of strategic planning; (3) environmental support, organizational capacity, program evaluation, and partnerships, in the absence of strategic planning; and (4) environmental support, communication, partnerships, and funding stability, in the absence of program evaluation.

Conclusions

Environmental support in combination with organizational capacity appeared to most consistently produce sustainment of SFP 10-14 programs in Washington State. Program providers will benefit from a focusing on enhancing those conditions to increase program sustainment.

Clinicians' Perspectives on Barriers and Facilitators for the Adoption of Non-Invasive Liver Tests for NAFLD: A Mixed-Method Study

(1) Background: Given the high prevalence of non-alcoholic fatty liver disease (NAFLD) and the limitations of liver biopsies, multiple non-invasive tests (NITs) have been developed to identify non-alcoholic fatty liver disease (NAFLD) patients at-risk of progression. The availability of these new NITs varies from country to country, and little is known about their implementation and adoption in routine clinical practice. This study aims to explore barriers and facilitators that influence the adoption of NAFLD NITs, from healthcare professionals’ perspectives. (2) Methods: A cross-sectional study was performed using an exploratory mixed-methods approach. Twenty-seven clinicians from eight different countries with different specialties filled in our questionnaire. Of those, 16 participated in semi-structured interviews. Qualitative and quantitative data were collected and summarized using the recently published Non-adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework for new medical technologies in healthcare organizations. (3) Results: Several factors were reported as influencing the uptake of NITs for NAFLD in clinical practice. Among those: insufficient awareness of tests; lack of practical guidelines and evidence for the performance of tests in appropriate patient populations and care settings; and absence of sufficient reimbursement systems were reported as the most important barriers. Other factors, most notably ‘local champions’, proper functional payment systems, and sufficient resources in academic hospitals, were indicated as important facilitating factors. (4) Conclusions: Clinicians see the adoption of NITs for NAFLD as a complex process that is modulated by several factors, such as robust evidence, practical guidelines, a proper payment system, and local champions. Future research could explore perspectives from other stakeholders on the adoption of NITs.

Modifying a cognitive behavioral suicide prevention treatment for adults with schizophrenia spectrum disorders in community mental health

Suicide is among the leading causes of death for adults with schizophrenia spectrum disorders. Given a paucity of evidence-based interventions tailored for psychosis, we sought to modify a promising Cognitive-Behavioral Suicide Prevention for psychosis (CBSPp) treatment for adults in US community mental health (CMH) settings using community-based participatory research methods. This article presents our modification methodology, stakeholder data and scholarly expert input, and CBSPp adaptations prior to future intervention testing. Stakeholder data (n = 25) were collected from clients, providers, and peer advocates in a CMH setting in Michigan. Findings were subsequently presented to a panel of scholarly experts in the fields of suicide and psychosis research, intervention research, and implementation science for input. Emerging themes from stakeholders include logistic, perceptual, and clinical challenges in the process of introducing this treatment in a CMH setting. Consistent with literature, buy-in and support for the delivery of a new treatment emerged as important factors in modifying and implementing CBSPp. A final modification list is presented in this paper and collaborations among stakeholders, researchers, and scholarly experts are essential to navigate psychosocial treatment innovation barriers with an overall goal of improving access, feasibility, and quality of this suicide prevention treatment.

Implementation of a clinical pathway to screen and treat medical inpatients for opioid withdrawal

Background:

Opioid-related inpatient hospital stays are increasing at alarming rates. Unidentified and poorly treated opioid withdrawal may be associated with inpatients leaving against medical advice and increased health care utilization. To address these concerns, we developed and implemented a clinical pathway to screen and treat medical service inpatients for opioid withdrawal.

Methods:

The pathway process included a two-item universal screening instrument to identify opioid withdrawal risk (Opioid Withdrawal Risk Assessment [OWRA]), use of the validated Clinical Opiate Withdrawal Scale (COWS) to monitor opioid withdrawal symptoms and severity, and a 72-h buprenorphine/naloxone-based treatment protocol. Implementation outcomes including adoption, fidelity, and sustainability of this new pathway model were measured. To assess if there were changes in nursing staff acceptability, appropriateness, and adoption of the new pathway process, a cross-sectional survey was administered to pilot four hospital medical units before and after pathway implementation.

Results:

Between 2016 and 2018, 72.4% (77,483/107,071) of admitted patients received the OWRA screening tool. Of those, 3.0% (2,347/77,483) were identified at risk for opioid withdrawal. Of those 2,347 patients, 2,178 (92.8%) were assessed with the COWS and 29.6% (645/2,178) were found to be in active withdrawal. A total of 49.5% (319/645) patients were treated with buprenorphine/naloxone. Fifty-seven percent (83/145) of nurses completed both the pre- and post-pathway implementation surveys. Analysis of the pre/post survey data revealed that nurse respondents were more confident in their ability to determine which patients were at risk for withdrawal ( p  =  .01) and identify patients currently experiencing withdrawal ( p < .01). However, they cited difficulty working with the patient population and coordinating care with physicians.

Conclusions:

Our study demonstrates a process for successfully implementing and sustaining a clinical pathway to screen and treat medical service inpatients for opioid withdrawal. Standardizing care delivery for patients in opioid withdrawal can also improve nursing confidence when working with this complex population.

Plain Language Summary:

Opioid-related hospital stays are increasing at alarming rates. Unidentified and poorly treated opioid withdrawal may be associated with patients leaving the hospital against medical advice and increased health care utilization. To address the concerns surrounding an increase in admissions associated with unidentified or poorly treated opioid withdrawal, we developed and implemented a clinical pathway process to consistently screen and treat hospitalized patients for opioid withdrawal. We found that opioid withdrawal screening was successfully implemented and sustained over a 24-month evaluation period. We also found that standardizing care delivery for patients in opioid withdrawal improved nursing confidence when working with this patient population. A robust and ongoing education and training process is important for current staff to ensure knowledge does not erode over time and that training for new staff is embedded in the pathway process to maintain training consistency.

BAILA: A Randomized Controlled Trial of Latin Dancing to Increase Physical Activity in Spanish-Speaking Older Latinos

BACKGROUND

Latinos are the fastest growing minority group of the older adult population. Although physical activity (PA) has documented health benefits, older Latinos are less likely to engage in leisure time PA than older non-Latino whites. Dance, popular among Latinos, holds promise as a culturally relevant form of PA.

PURPOSE

To describe self-reported and device-assessed changes in PA as a result of a randomized controlled trial of BAILAMOS, a 4-month Latin dance program with a 4-month maintenance program, versus a health education control group.

METHODS

Adults, aged 55+, Latino/Hispanic, Spanish speaking, with low PA levels at baseline, and risk for disability were randomized to the dance program (n = 167) or health education condition (n = 166). Data were analyzed using multilevel modeling with full information maximum likelihood.

RESULTS

A series of multilevel models revealed significant time × group interaction effects for moderate-to-vigorous physical activity (MVPA), dance PA, leisure PA, and total PA. Exploring the interaction revealed the dance group to significantly increase their MVPA, dance PA, leisure PA, and total PA at months 4 and 8. Household PA and activity counts from accelerometry data did not demonstrate significant interaction effects.

CONCLUSIONS

The study supports organized Latin dance programs to be efficacious in promoting self-reported PA among older Latinos. Efforts are needed to make dancing programs available and accessible, and to find ways for older Latinos to add more PA to their daily lives.

CLINICAL TRIAL INFORMATION

NCT01988233.