The Program Sustainability Assessment Tool: a new instrument for public health programs

Empowering safety managers to champion the implementation of smoking cessation services in the construction industry: Protocol for a sequential multiple assignment randomized trial

US construction workers (CWs) have the highest cigarette smoking rate among all occupations (27.2% vs. 15%), yet the lowest coverage of workplace smoking cessation services (14% vs. 29%). This study aims to empower safety managers to implement smoking cessation services in the construction industry. Using participatory research methods, this study aims to: 1) Develop multilevel strategies (MLIs) to implement adaptive smoking cessation programs delivered by the safety manager on construction sites, and 2) conduct a cluster-randomized, hybrid type 1 effectiveness-implementation, 2-phase sequential multiple assignment randomized trial (SMART) to test the programs (ClinicalTrials.gov: NCT06098144). The MLIs include: 1) creating the outer setting (research investigators, stakeholders) and inner setting facilitation (companies' advisory committee, study champion), 2) conducting observational field assessments of workflows, 3) training safety managers to deliver the intervention, and 4) conducting implementation process evaluations. In SMART, 32 construction sites within 8 companies with 608 CWs will be enrolled. In Phase 1, sites will be randomized to A1 (referral to Tobacco Quitline -TQL) or B1 (referral to TQL + nicotine replacement treatment (NRT) + 1 group behavioral counseling session). In Phase 2, responders who quit smoking at 3 months continue with the assessment only, while non-responders will be re-randomized to C (4 counseling sessions + NRT; A1 + C, B1 + C) or an extra dose of Phase 1 treatment (A2, B2). Participants will receive 4 follow-up assessments at 3, 6, 9, and 12 months. Primary outcomes are the effectiveness (12-month biomarker-confirmed prolonged abstinence) and cost-effectiveness (cost/quit, cost/quality-adjusted life-year) of A1 + A2 vs. B1 + B2 and A1 + C vs. B1 + C. The secondary outcome is the feasibility of the program's implementation. We hypothesize that B1 + B2 will outperform A1 + A2, and B1 + C will outperform A1 + C. This project will generate novel scientific evidence on the effectiveness, cost-effectiveness, and implementation feasibility of smoking cessation programs in the construction industry.

Implementation of two transdiagnostic interventions based on emotional regulation for professionals who treat alcohol addiction in the Spanish mental health system: A multicenter mixed methods pilot study protocol

Emotional dysregulation has been considered a transdiagnostic factor and an important determinant of craving and relapse in alcohol addiction. Dialectical Behavior Therapy (DBT) and the Unified Protocol (UP) are two transdiagnostic emotional regulation programs with good efficacy in improving alcohol addiction severity. However, an important barrier encountered when implementing evidence-based interventions in drug addiction services is the inadequate training received by professionals. This study aims to evaluate the effect of a dissemination and pilot implementation initiative of DBT and UP among professionals treating alcohol addiction in the national Spanish healthcare system.

METHODS

The study will be conducted in two phases using a mixed methods design. In phase 1, two 3-day training workshops (DBT and UP; 40 hours total) will be provided by experts to at least 130 healthcare workers from three Spanish regions. Participants will be randomly assigned to receive either DBT or UP training first, followed by the other. The study will include a range of quantitative outcomes including beliefs about alcohol abuse, burnout, self-efficacy, attitudes towards evidence-based interventions, organizational variables, acceptability and intention to use the interventions, barriers to implementation, and knowledge acquisition. The appropriateness of the interventions in real community settings will be qualitatively assessed. In phase 2, at least 30 trained professionals will be randomly assigned to implement DBT or/and UP 3-month group interventions in their workplaces with alcohol addiction patients. Quantitative outcomes will include acceptability, feasibility, appropriateness, fidelity and sustainability of the interventions, barriers to implementation, as well as qualitative descriptions of barriers and facilitators during the implementation process.

DISCUSSION

To our knowledge, this is the first study to evaluate a pilot implementation of transdiagnostic psychological interventions based on emotion regulation to treat alcohol addiction. Findings of this study will inform of factors influencing the successful implementation of DBT and UP in community-based addiction services.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06366100.

Sustainability of Rideshare Programs to Promote Engagement of Underrepresented Populations in Breast Cancer Screening Trials

BACKGROUND

Transportation barriers significantly limit participation in breast cancer screening trials among Hispanic women, exacerbating disparities in breast cancer outcomes and underrepresentation in clinical research. Rideshare programs have emerged as a potential solution, but their long-term sustainability remains underexplored. Understanding sustainability capacity is critical to ensuring these programs can address structural barriers, promote health equity, and improve outcomes for underserved populations. The aim of this study is to evaluate sustainability capacity of a no-cost rideshare program and to identify potential strategies to support sustainability.

METHODS

This explanatory, sequential, mixed-methods study evaluated the sustainability capacity of a no-cost rideshare program aimed at increasing Hispanic women's participation in the Tomosynthesis Mammographic Imaging Screening Trial. Analyses and data integration were guided by the Capacity for Sustainability Framework. Average domain scores on the Program Sustainability Assessment Tool survey were calculated ranging from 1 to 7, with higher scores indicating higher levels for each domain, and structured interviews were analyzed using a rapid qualitative approach. Program Sustainability Assessment Tool and interview findings were integrated using a joint display.

RESULTS

Survey responses (n = 37) indicated strengths in environmental support (mean score: 5.4) and partnerships (6.0), but challenges in funding stability (4.2) and strategic planning (4.5). Interview findings emphasized the importance of program champions and collaborative partnerships and highlighted gaps in securing diverse funding sources and engaging institutional leadership in strategic planning. Participants identified opportunities to strengthen communication, evaluate program impact, and adapt processes to meet evolving needs.

DISCUSSION

Strong partnerships and champions supported the program's initial success, but funding instability and insufficient strategic planning threaten sustainability. Future efforts should prioritize securing diverse funding, engaging leadership, and fostering collaboration to scale rideshare programs, thereby reducing disparities and advancing equity in breast cancer screening and research participation.

Sustainability of fall prevention exercise programmes for community-dwelling older adults: a scoping review protocol

INTRODUCTION

Falls have financial, emotional and physical implications for ageing individuals and the healthcare system. Evidence-based exercise programmes have been one of the most effective ways of preventing falls in community dwellings for older adults. However, more research is needed to understand how to sustain these programmes. This scoping review protocol describes our plan to investigate the factors influencing the sustainability of community-based fall prevention exercise programmes.

METHODS AND ANALYSIS

Our scoping review will use the Joanna Briggs Institute methodology and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews framework. The studies will have no restrictions, including publication date, language or geographic location. Key search terms concerning programme sustainability and exercise falls prevention will be conducted in Medline, EMBASE, Cumulative Index to Nursing and Allied Health Literature, Academic Search Premier, APA PsycINFO and SPORTDiscus in consultation with an experienced librarian. Once duplicates have been removed, two independent reviewers will conduct title and abstract screening, full-text screening and data extraction. Data from eligible articles will be collated and charted to summarise data into three categories: (1) study description, including publication date, author(s), study location, paper's aim/purpose, study participants, study design and conclusion; (2) data regarding the type of exercise programme will be used using the 16-point checklist Consensus on Exercise Reporting Template; and (3) data regarding sustainability will be organised using domains from the Program Sustainability Assessment Tool. Our results will be charted through the use of Covidence to identify patterns across the studies. Additionally, narrative synthesis will be employed to articulate the study findings.

ETHICS AND DISSEMINATION

As this is a scoping review, we do not require ethics approval. We intend to share our report findings with scientists, healthcare professionals and decision-makers. We will publish our results in reputable scientific journals and present them at relevant conferences.

iCogCA to Promote Cognitive Health Through Digital Group Interventions for Individuals Living With a Schizophrenia Spectrum Disorder: Protocol for a Nonrandomized Concurrent Controlled Trial

BACKGROUND

Cognitive impairments are a key aspect of schizophrenia spectrum disorders (SSDs), significantly affecting clinical and functional outcomes. The COVID-19 pandemic has heightened concerns about mental health services and cognitive stimulation opportunities. Despite evidence-based interventions like action-based cognitive remediation (ABCR) and metacognitive training (MCT), a research-to-practice gap exists in their application across mental health settings.

OBJECTIVE

The iCogCA study aims to address this gap by implementing digital ABCR and MCT through a national Canadian collaborative effort using digital psychological interventions to enhance cognitive health in SSDs.

METHODS

The study involves 5 Canadian sites, with mental health care practitioners trained digitally through the E-Cog platform, which was developed by our research group. Over 2.5 years, participants with SSDs will undergo pre- and postintervention assessments for clinical symptoms, cognition, and functioning. Each site will run groups annually for both ABCR and MCT, totaling ~390 participants. A nonrandomized concurrent controlled design will assess effectiveness design, in which one intervention (eg, ABCR) acts as the active control for the other (eg, MCT) and vice versa, comparing cognitive and clinical outcomes between the interventions using generalized linear mixed effect modeling. Implementation strategy evaluation will consider the digital platform's efficacy for mental health care practitioners' training, contextual factors influencing implementation, and sustainability, using descriptive statistics for quantitative data and thematic analysis for qualitative data.

RESULTS

A pilot pragmatic trial has been conducted previously at the Montreal site, evaluating 3 early implementation outcomes: acceptability, feasibility, and engagement. Patient and therapist acceptability was deemed as high and feasible (21/28, 75% of recruited service users completed therapy, rated feasible by therapists). Technology did not appear to significantly impede program participation. Therapist-rated levels of engagement were also satisfactory. In the ongoing study, recruitment is underway (114 participants recruited as of winter 2024), and intervention groups have been conducted at all sites, with therapists receiving training via the E-Cog learning platform (32 enrolled as of winter 2024).

CONCLUSIONS

At least 3 significant innovations will stem from this project. First, this national effort represents a catalyst for the use of digital technologies to increase the adoption of evidence-based interventions and will provide important results on the effectiveness of digitally delivered ABCR and MCT. Second, the results of the implementation component of this study will generate the expertise needed to inform the implementation of similar initiatives. Third, the proposed study will introduce and validate our platform to train and supervise mental health care practitioners to deliver these interventions, which will then be made accessible to the broader mental health community.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05661448; https://clinicaltrials.gov/study/NCT05661448.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/63269.

The sustainability of health interventions implemented in Africa: an updated systematic review on evidence and future research perspectives

BACKGROUND

Sustaining evidence-based interventions in resource-limited settings is critical to optimizing gains in health outcomes. In 2015, we published a review of the sustainability of health interventions in African countries, highlighting gaps in the measurement and conceptualization of sustainability in the region. This review updates and expands upon the original review to account for developments in the past decade and recommendations for promoting sustainability.

METHODS

First, we searched five databases (PubMed, SCOPUS, Web of Science, Global Health, and Cumulated Index to Nursing and Allied Health Literature (CINAHL)) for studies published between 2015 and 2022. We repeated the search in 2023 and 2024. The review was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines. Studies were included if they reported on the sustainability of health interventions implemented in African countries. Study findings were summarized using descriptive statistics and narrative synthesis, and sustainability strategies were categorized based on the Expert Recommendations for Implementing Change (ERIC) strategies.

RESULTS

Thirty-four publications with 22 distinct interventions were included in the review. Twelve African countries were represented in this review, with Nigeria (n = 6) having the most representation of available studies examining sustainability. Compared to the 2016 review, a similar proportion of studies clearly defined sustainability (52% in the current review versus 51% in the 2015 review). Eight unique strategies to foster sustainability emerged, namely: a) multi-sectorial partnership and developing stakeholder relationships, b) tailoring strategies to enhance program fit and integration, c) active stakeholder engagement and collaboration, d) capacity building through training, e) accessing new funding, f) adaptation, g) co-creation of intervention and implementation strategies and h) providing infrastructural support. The most prevalent facilitators of sustainability were related to micro-level factors (e.g., intervention fit and community engagement). In contrast, salient barriers were related to structural-level factors (e.g., limited financial resources).

CONCLUSIONS

This review highlights some progress in the published reports on the sustainability of evidence-based intervention in Africa. The review emphasizes the importance of innovation in strategies to foster funding determinants for sustainable interventions. In addition, it underscores the need for developing contextually relevant sustainability frameworks that emphasize these salient determinants of sustainability in the region.

Beyond Survival: Harnessing Sustainability Frameworks to Assess and Support Programs Implementing Bundled Interventions for Black Women With HIV

Objectives. To evaluate the sustainability of bundled interventions aimed at expanding the delivery and utilization of HIV care and treatment services, tackling socio cultural health determinants, and improving health outcomes for Black women with HIV. Methods. We used quantitative data from the Program Sustainability Assessment Tool (PSAT) to examine sustainability capacity across sites in the United States. Qualitative data from monthly call forms completed by site staff (n = 199), annual site visit reports (n = 24), and one-on-one key informant interviews (n = 76) informed organizational and contextual factors influencing sustainability capacity. Results. A total of 59 stakeholders completed the PSAT. The initiative's overall sustainability score was high (mean = 5.1; range = 3.8-6.6), with sites reporting favorably on program adaptation (mean = 5.8; range = 4.4-6.8), program evaluation (mean = 5.6; range = 3.9-7.0), and organizational capacity (mean = 5.6; range = 3.8-7.0) domains. Adaptability and responsiveness to client needs and sociopolitical contexts were determined valuable; establishing an evaluation infrastructure, capacity to integrate Black Women First (BWF) initiative activities within organizational operations, and environmental support facilitated sustainability. Conclusions. Interventions for Black women with HIV can be sustained and should be pursued and embedded consistently in community and health service organizations. (Am J Public Health. 2025;115(S1):S28-S37. https://doi.org/10.2105/AJPH.2024.307790).

A randomized controlled trial of a family-based HIV/STI prevention program for Black girls and male caregivers in Chicago: IMAGE study protocol paper

Black girls are disproportionately impacted by HIV and STIs in the United States. Black male caregivers are underutilized in family-based HIV/STI prevention programming and offer a novel opportunity to protect Black girls. This study will evaluate the efficacy and implementation of an HIV/STI prevention program delivered to Black girls and male caregivers in community settings. IMAGE: IMARA for the Male Caregivers and Girls Empowerment was adapted from IMARA, an evidence-based mother-daughter intervention to decrease HIV/STI infection and increase communication and healthy relationships among girls and their male caregivers. Using an efficacy implementation design, we will test the effectiveness of IMAGE compared to a time-matched general health promotion program across six community-based organizations. Aim one will evaluate IMAGE in a 2-arm randomized controlled trial with 300 14-18-year-old Black girls and their male caregiver dyads in Chicago, IL. We hypothesize that girls who receive IMAGE will have lower STI incidence (primary outcome), fewer sexual partners, and more consistent condom use (secondary outcomes) at 6- and 12-months compared to girls in the health promotion program. Guided by the 3-Step Implementation Model, our second aim is to identify and describe factors (barriers, facilitators) and processes affecting implementation in community settings. HIV and STI disparities go beyond individual-level factors, and male caregivers may protect girls by being a sexual health resource. This study will facilitate rapid CBO uptake and ownership of IMAGE if effective. Trial Registration: ClinicalTrials.gov NCT06266416.

Implementation determinants of safer smoking supplies in U.S. syringe services programs

BACKGROUND

The prevalence of smoking opioids and other unregulated drugs has increased across the United States (U.S.) since 2000. Improved access to safer smoking supplies may reduce the health consequences of inhalation while helping to engage more people who use drugs in syringe services programs (SSPs); however, the landscape of safer smoking supply implementation is understudied.

METHODS

From November 2023-January 2024, we surveyed representatives of U.S. SSPs to assess safer smoking supply implementation across contextual domains of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Descriptive statistics were used to describe determinants across the phases of safer smoking supply implementation. Poisson regression identified factors associated with implementation.

RESULTS

Among 118 organizations responding to the survey, most received state funding (83%), were community-based organizations (CBOs; 74%), and served urban jurisdictions (62%). The majority (67%) were already providing safer smoking supplies; 16% were exploring implementation and 11% were not. On average, safer smoking supply implementation occurred more recently than the provision of syringes (1-2 years ago vs. > 5 years ago), with participant request being the most common motivation for implementation (84%). Additional facilitators of safer smoking supply implementation were organizational prioritization (65%) and internal leadership support (57%). Factors significantly associated with safer smoking supply implementation included being from the Northeastern or Western regions (vs. the U.S. South), serving exurban communities, being a CBO, receiving foundation funding, receiving private donations from fundraising, and offering syringes and other injection alternatives (e.g., safer snorting supplies). Receiving federal funding, fear of external community opposition, internal leadership opposition, and respondent uncertainty about changing demand for safer smoking supplies (vs. perceiving that demand has not changed) were negatively associated with implementation.

CONCLUSIONS

Determinants in the inner context, like organizational prioritization of safer smoking supplies and internal leadership support, may facilitate safer smoking supply implementation, while specific outer context factors (e.g., funding, regional policies) may inhibit implementation. Flexible policies and funding structures and further research to build and disseminate evidence on the benefits of safer smoking supplies are needed to expand the implementation and scale-up of this prevention service within U.S. SSPs.

"You need to know that you are not alone": the sustainability of community-based dance programs for people living with Parkinson's disease

PURPOSE

To identify factors contributing to the long-term sustainability of community-based dance programs for people living with Parkinson's disease in order to inform the design and development of sustainable programs.

METHODS

Multi-site ethnographic fieldwork was conducted at four different preexisting dance programs for people living with Parkinson's disease. Dancer, facilitator, and community stakeholder perspectives were gathered via semi-structured interviews in order to create a deeper understanding of how existing programs navigate challenges and maintain stability. Transcripts and field notes were analyzed via reflexive thematic analysis.

RESULTS

Interviews were conducted with 18 participants (eight dancers with Parkinson's disease, seven dance facilitators, one classroom assistant, and two community stakeholders). Four key areas for supporting program sustainability were identified: (1) finding an organizational structure that works, (2) balancing funding, fundraisers, and fees, (3) prioritizing dancer experience and satisfaction, and (4) recruiting and retaining committed, high-quality facilitators.

CONCLUSION

Cultivating multiple funding sources; forging strategic connections with local Parkinson's organizations and arts institutions; building a critical mass of facilitators and administrators with diverse skillsets; offering hybrid online delivery where possible; and ensuring that the dancer experience is low-pressure, varied, and enjoyable can support the long-term sustainability of dance programs for people living with Parkinson's disease.

Toward the sustainability of health care innovations to "transform our world": current status and the road ahead

ABSTRACT

Inadequate sustainability of health care innovations or evidence-based interventions has led to calls from policymakers, researchers, and funders for research on how sustainability can be optimized to avoid research waste. In this discussion paper, we argue that research on health care innovation sustainability needs to be advanced. We critically examine the literature on the concept of sustainability and propose that research should address the fundamental question: How can we advance knowledge on health care innovation sustainability? We provide examples of important work undertaken in the field of implementation science, including definitions and conceptualizations of sustainability. We also highlight theories, models, and frameworks that have been proposed to inform sustainability research and guide how to plan for sustainability. Our analysis of the literature reveals a growing interest in the sustainability of health care innovations but also confirms that implementation science has yet to put sustainability at the center of its research endeavors. To assist this shift, we identify priority research gaps and use the United Nations 2030 Agenda for Sustainable Development as a road map for an implementation science research agenda to drive health care innovation sustainability. We propose three new research directions that, overall, aim for "better health for all, leaving no one behind." These directions include: (1) advancing substantive research on sustainability while avoiding duplication; (2) identifying barriers, facilitators, and strategies to sustain engagement with multiple partners; and (3) advancing methods and tools to support monitoring, evaluation, and revision of strategies over time.

SPANISH ABSTRACT

http://links.lww.com/IJEBH/A323.

Evaluating the World Health Organization's Hearts Model for Hypertension and Diabetes Management: A Pilot Implementation Study in Guatemala

Background

The World Health Organization HEARTS Technical Package is a widely implemented global initiative to improve the primary care management of cardiovascular disease risk factors. The study's objective is to report outcomes from a pilot implementation trial of integrated hypertension and diabetes management based on the HEARTS model in Guatemala.

Methods

We conducted a single-arm pilot implementation trial over six months from October 2023 to May 2024 in 11 Guatemalan Ministry of Health primary care facilities in two districts. The pilot evaluated a package of five HEARTS-aligned implementation strategies to improve the pharmacological treatment of hypertension and diabetes. The primary outcomes were feasibility and acceptability, measured through 20 structured interviews with Ministry of Health employees and by examining enrolment and retention data. Secondary outcomes included a suite of implementation and clinical outcomes, including treatment rates. When baseline data were available, we analyzed secondary outcomes as the net change from baseline or using an interrupted time series approach.

Results

The study enrolled 964 patients, of whom 58.8% had hypertension only, 30.4% had diabetes only, and 10.8% had both conditions. Surveys on feasibility and acceptability among Ministry of Health staff had a median score of 5.0 (IQR: 5.0 to 5.0) and 5.0 (IQR range: 4.8 to 5.0), respectively, exceeding the prespecified benchmark of ≥3.5. Both districts achieved the prespecified benchmark of enrolling ≥25 hypertension patients and ≥25 diabetes patients. Only 36% of patients attended a follow-up visit within three months, lower than the prespecified benchmark of ≥75%. Monthly treatment rates during the pilot increased by 22.3 (95% CI: 16.2 to 28.4; P < 0.001) and 3.5 (95% CI: -1.6 to 8.7; P = 0.17) patients per month for hypertension and diabetes, respectively.

Conclusions

Implementation of an integrated hypertension and diabetes model based on HEARTS was generally feasible and acceptable in the Ministry of Health in Guatemala. Findings can refine national scale-up in Guatemala and inform HEARTS implementation projects in other settings.

Rapid Adaptation to Prevent Drug Use (RAPD): protocol of a pilot randomized trial to enhance the impact of an evidence-based intervention for youth

BACKGROUND

Drug use trends change rapidly among youth, leaving intervention experts struggling to respond promptly. Delays in responses can lead to preventable morbidity and mortality. The COVID-19 pandemic underscored the need for implementation science to facilitate rapid, equitable responses using existing treatment and prevention efforts. Existing, widely adopted evidence-based interventions (EBIs; e.g., the Michigan Model for Health™: MMH) are well suited to address emerging drug trends. We have a critical need to advance implementation strategies to optimize system responsiveness to these emerging drug issues. This research aims to design and test implementation strategies to (1) improve the responsiveness of school-based EBIs in addressing urgent issues and (2) find ways to support teachers in implementing updated EBIs, attending to unique considerations of schools serving economically disadvantaged students.

METHODS

The research aims are as follows: aim 1: identify implementation gaps and best practices using After Action Review (a reflective process used by health organizations in responding to emergent public health events) using qualitative methods. Aim 2: design and pilot test RAPD (Rapid Adaptation to Prevent Drug use) based on aim 1 findings. RAPD refers to a novel set of implementation strategies designed to enhance the capacity of an existing, widely adopted evidence-based universal prevention curriculum (MMH) to respond to emerging drug issues among youth. We will pilot test RAPD in ten middle schools serving diverse student populations using a two-group, mixed method, cluster randomized controlled trial design. Aim 3: assess the costs and benefits of RAPD from multiple partner perspectives using a mixed methods approach.

DISCUSSION

This study focuses on designing and deploying implementation strategies to reduce the detrimental impact of emerging drugs and provide an infrastructure to make future adaptations that can be applied in other contexts. After Action Review (AAR) provides a valuable opportunity to review the statewide response to past drug use events, specifically the vaping crisis, using the MMH curriculum, which can systematically guide implementation strategy selection and deployment to meet identified gaps. The rationale for the proposed research is that designing and testing RAPD will advance implementation science in responding to urgent public health events and ensure equitable responses across youth populations.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05806840 .

A cross-sectional study assessing barriers and facilitators to the sustainability of physical activity and nutrition interventions in early childhood education and care settings

BACKGROUND

Effective evidence-based physical activity and nutrition interventions to prevent overweight and obesity and support healthy child development need to be sustained within Early Childhood Education and Care (ECEC) services. Despite this, little is known about factors that influence sustainability of these programs in ECEC settings. Therefore, the aim of this study was to describe the factors related to sustainability of physical activity and nutrition interventions in ECEC settings and examine their association with ECEC service characteristics.

METHODS

A cross-sectional study was undertaken with a nationally representative sample of 473 Australian ECEC services. Factors related to the sustainability of ECEC-based physical activity and nutrition interventions were assessed using the validated Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C), measuring Outer Contextual Factors, Inner Contextual Factors, Processes and Characteristics of the Intervention domains for interventions that supervisors reported as currently implementing. Participants responded using a 5-point Likert scale, with responses ranging from 1 (completely disagree) to 5 (completely agree). Domain scores were calculated for each service by averaging item responses. Linear regression models between ECEC service characteristics and the IMPRESS-C domains were undertaken.

RESULTS

Data from 473 Australian childcare services nationally found that the domains: Processes ( x ¯ =3.78, SD = 0.64), consisting of partnership/engagement and training/support/supervision; and Outer Contextual Factors ( x ¯ =3.93, SD = 0.63), including policy and legislation, and socio-political context had the lowest mean scores indicating they may likely be barriers to sustainability. Linear regression analyses revealed no statistically significant associations between examined factors and ECEC service characteristics. There was a statistically significant association between the number of years services delivered their interventions and the Characteristics of the Intervention domain (p = 0.035) suggesting that this domain may influence sustainability of programs.

CONCLUSIONS

This study suggests that factors related to the Processes and Outer Contextual Factors domains had the lowest scores and as such, strategies to support the sustainability of physical activity and nutrition interventions implemented in ECEC settings may need to consider how to best address these factors.

What happens after the funding ends?: A qualitative sustainability investigation of emergency department-based peer support programs implemented as part of Indiana's opioid state targeted response initiative

INTRODUCTION

In 2017, funding disseminated through the US Substance Abuse and Mental Health Services Administration's Opioid State Targeted Response (STR) program accelerated the expansion of peer recovery support services across several states to engage emergency department patients presenting with opioid use disorder. While there is some literature on the initial implementation of these programs, little is known about their sustainability after the STR funding's end. Identifying what happened to these programs is a key component of understanding their ultimate impact and can inform future activities to develop, fund, or sustain similar efforts.

METHODS

We collected qualitative data from six organizations that participated in Indiana's STR-funded Recovery Coaching and Peer Support Initiative (RCPSI). The semi-structured interview guide was designed to gather data related to eight domains of sustainability (i.e., environmental support, funding stability, partnerships, organizational capacity, program evaluation, program adaptation, program evaluation, communications, and strategic planning). The analysts followed a deductive-inductive analysis approach, using the eight domains as an a priori coding structure and developing higher-level inductive themes.

RESULTS

A total of ten individuals (roles included 4 Program Supervisors, 2 Nurse Administrators, a Psychiatric Social Worker, a Mobile Treatment Manager, a Grant Coordinator, and a Vice President of Planning) participated in six interviews. Two programs did not sustain services, primarily because they lacked a sufficient volume of eligible patients to justify services. Factors identified as supporting sustainability in the other four programs included (1) identification of alternate funding sources, (2) evolving internal support for ED-based opioid use disorder treatment, and (3) investment in internal and external relationships. Furthermore, these themes operated across multiple sustainability domains.

CONCLUSIONS

The findings illustrate a dynamic interplay between program context and multiple theorized sustainability domains that impacted the viability of RCPSI programs after the end of STR funding. Results indicate a need for a better understanding of the factors influencing the sustainability of programs supported by federal funding to mitigate the opioid crisis, and such findings will likely apply to a broader range of grant-supported programs.

Sustainment and adaptation of systems navigation and psychosocial counseling across HIV testing clinics in Vietnam: A qualitative assessment

Background

Few evidence-based interventions have been successfully scaled up and sustained long-term. Within an implementation trial testing strategies for scale-up of the Systems Navigation and Psychosocial Counseling (SNaP) intervention for people who inject drugs (PWID) with HIV across HIV testing clinics in Vietnam, we sought to assess if the implementation of SNaP was sustained after study support ended and to identify factors, including adaptations, that affected SNaP sustainment.

Method

Across all 42 SNaP clinics, we surveyed clinic staff at 6-10 months post-study completion to assess SNaP sustainment. We purposively selected six high and six low-sustaining clinics and conducted 31 in-depth interviews with clinic staff (n = 23) and clinic directors (n = 8). Interviews were coded and analyzed using thematic analysis informed by the Integrated Sustainability Framework. Matrices were used to compare themes across high and low-sustaining clinics.

Results

1/12 clinics sustained all of SNaP's core components, 2/12 would continue to sustain SNaP if they had new PWID patients, and the remainder did not fully sustain SNaP but continued conducting a modified version, including shorter or fewer SNaP sessions, tailoring SNaP to participants' specific needs, and conducting SNaP-style counseling for all clients. Facilitators of sustainment included leadership directives to clinic staff around SNaP sustainment, clinicians' belief in SNaP's effectiveness, and SNaP's perceived fit with clinic activities and mission. Major barriers to SNaP sustainment included lack of funding for PWID outreach activities, time, staff, training continuity, and systemic challenges with getting PWID into care, such as poverty and lack of transportation.

Conclusions

We identified the challenge of sustaining the SNaP intervention long-term, the ubiquity of intervention adaptations, and multi-level barriers and facilitators to intervention sustainment. These findings demonstrate the need for sustainment strategies and could inform trials of strategies to improve the longevity of effective HIV interventions for populations that are disproportionately affected by this epidemic.

Supporting teams with designing for dissemination and sustainability: the design, development, and usability of a digital interactive platform

BACKGROUND

Designing for Dissemination and Sustainability (D4DS) principles and methods can support the development of research products (interventions, tools, findings) that match well with the needs and context of the intended audience and setting. D4DS principles and methods are not well-known or used during clinical and public health research; research teams would benefit from applying D4DS. This paper presents the development of a new digital platform for research teams to learn and apply a D4DS process to their work.

METHODS

A user-centered design (UCD) approach engaged users (n = 14) and an expert panel (n = 6) in an iterative design process from discovery to prototyping and testing. We led five design sessions using Zoom and Figma software over a 5-month period. Users (71% academics; 29% practitioners) participated in at least 2 sessions. Following design sessions, feedback from users was summarized and discussed to generate design decisions. A prototype was then built and heuristically tested with 11 users who were asked to complete multiple tasks within the platform while verbalizing their decision-making using the 'think aloud' procedure. The System Usability Scale (SUS) was administered at the end of each testing session. After refinements to the platform were made, usability was reassessed with 7 of 11 same users to examine changes.

RESULTS

The interactive digital platform (the D4DS Planner) has two main components: 1) the Education Hub (e.g., searchable platform with literature, videos, websites) and 2) the Action Planner. The Action Planner includes 7 interactive steps that walk users through a set of activities to generate a downloadable D4DS action plan for their project. Participants reported that the prototype tool was moderately usable (SUS = 66) but improved following refinements (SUS = 71).

CONCLUSIONS

This is a first of its kind tool that supports research teams in learning about and explicitly applying D4DS to their work. The use of this publicly available tool may increase the adoption, impact, and sustainment of a wide range of research products. The use of UCD yielded a tool that is easy to use. This tool's future use and impact will be evaluated with a broader sample of community partners and projects and the tool will continue to be refined and improved.

Implementation and sustainability of best practice guidelines: a tale of three hospitals

OBJECTIVE

This study explores factors that affect the sustainable implementation of best practice guidelines (BPGs) and provides a basis for developing corresponding action strategies to promote project sustainability.

METHODS

Using the NHS (National Health Service) questionnaire scoring system, surveys were conducted among nurses who implemented BPGs in three hospitals in China. Data were analyzed using statistical analysis. We adhered to the STROBE guidelines for cross-sectional studies.

RESULTS

The average total score was 85.18/100, while the average scores of the process dimension, staff dimension, and organization dimension were 25.85, 45.88, and 13.45, respectively. The average score of the three dimensions was 83.12%, 87.56%, and 81.52%, respectively. This means that the three dimensions of the NHS SM had high scores and the implemented BPGs had a high likelihood of being sustained. The sustainable implementation of guidelines involves three factors: project characteristics, staff dimensions, and organizational environment.

CONCLUSION

Important factors that influence project sustainability include the clinical value of the project, a supportive environment provided by human resources and project infrastructure, and the degree of cooperation between interprofessional teams.

SPANISH ABSTRACT

http://links.lww.com/IJEBH/A305.

Advancing implementation science in community settings: the implementation strategies applied in communities (ISAC) compilation

BACKGROUND

Implementation strategies have predominantly been operationalized and studied in clinical settings. Implementation strategies are also needed to improve evidence-based intervention (EBI) integration in community settings, but there is a lack of systematic characterization of their use, which limits generalizability of findings. The goals of this study were to determine which implementation strategies are most used to deliver primary prevention EBIs in community settings, develop a compilation and pragmatic strategy selection process with accompanying guidance tools, and understand practitioners' preferences for dissemination.

METHODS

Purposive and snowball sampling was used to recruit community setting researchers and practitioners delivering primary prevention EBIs (nutrition, physical activity, tobacco prevention) in community settings: education, social services, city planning and transportation, workplaces, recreation/sport, faith-based, and other public health organizations. Semi-structured interviews were conducted using a guide based on the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework. Participants were asked to describe barriers experienced and strategies used to overcome them within each RE-AIM dimension. Practitioners were also asked about preferred dissemination strategies, prompted by Diffusion of Innovations theory concepts of sources (who provides information) and channels (how information is provided). A rapid deductive approach was used to analyze findings with a coding matrix aligned with the interview guide.

RESULTS

Researchers (n = 10) and practitioners (n = 8) across all targeted settings and intervention outcomes completed interviews. Interviewees shared unique implementation strategies (N = 40) which were used to overcome barriers related to multiple RE-AIM dimensions, most commonly implementation (n = 29) and adoption (n = 27). Most frequently mentioned implementation strategies were conduct pragmatic evaluation (n = 31), provide training (n = 26), change adaptable program components (n = 26), and leverage funding sources (n = 21). Webinars (n = 6) and listservs/newsletters (n = 5) were the most mentioned dissemination channels; national public health organizations (n = 13) were the most mentioned sources.

CONCLUSIONS

Results reflect commonly used implementation strategies in community settings (e.g., training, technical assistance) and add novel strategies not reflected in current taxonomies. Dissemination preferences suggest the need to involve broad-reaching public health organizations. The resultant compilation (Implementation Strategies Applied in Communities) and strategy selection process provide resources to assist researchers and practitioners in applying strategies and improving EBI delivery in community settings.

Applying health equity implementation science frameworks to population genetic screening

Introduction

Implementation science frameworks with a focus on health equity have emerged to help guide the introduction of new interventions into healthcare and community settings while limiting health disparities. The purpose of this research was to explore the applicability of such frameworks to guide the equitable implementation of population genetic screening programs.

Methods

We searched PubMed and reference lists for relevant frameworks and examples of their use in health settings. We then assessed if and how selected frameworks provide guidance for different stages of population genetic screening: recruitment, sample collection, result return, follow-up care and long-term management, and cascade screening. Findings were synthesized into a list of health equity considerations specific to each stage.

Results

We identified 5 implementation frameworks that focus on health equity. Guidance varied by framework type: determinant (explaining what affects implementation outcomes), process (translating research into practice), or evaluation (assessing implementation). Common characteristics included focusing implementation efforts on populations who have historically experienced health inequities and adapting interventions to fit local contexts. Process models also highlighted the importance of community partnerships.

Discussion

Overall, frameworks offered broad recommendations applicable to population genetic screening program implementation. However, gaps still exist in guidance provided for later stages of population genetic screening. To improve the equitable implementation of genetic screening, future programs may benefit from utilizing one or more of these frameworks or by incorporating the health equity considerations and outcomes compiled in this analysis.

An Analysis of National Institutes of Health-Funded Dissemination and Implementation Research in Low- and Middle-Income Countries

Implementation science can inform healthcare delivery to improve outcomes in resource-constrained settings through tailored strategies. The National Institutes of Health funds implementation science largely through its Dissemination and Implementation Research in Health program. We analyzed the program's grants with collaborators in low- and middle-income countries to understand trends and gaps in National Institutes of Health-funded global implementation science research. Query-View-Report was used to identify grants awarded between fiscal years 2013-2022 with at least one collaborating institution in a low- and middle-income country. Two coders reviewed the abstract and specific aims to determine the intervention being studied, setting, implementer, implementation outcomes, strategies, frameworks, and study design. From fiscal years 2013-2022, 81 grants had collaborating institutions across 25 low- and middle-income countries in five World Bank-defined regions, funded by 11 National Institutes of Health institutes and centers. Most grants focused on cancer (n = 12), other non-communicable diseases (n = 16), and tuberculosis (n = 12). Common implementation outcomes included costs (n = 43), fidelity (n = 38), maintenance (n = 36), and adoption (n = 35). Commonly studied implementation strategies included assess for readiness and identify barriers and facilitators (n = 18), revise professional roles (n = 17), and change service sites (n = 15). Frequently reported frameworks were RE-AIM (n = 30), CFIR (n = 22), and EPIS (n = 8). Most grants tested implementation strategies using experimental study designs (n = 52) in healthcare settings (n = 56). The National Institutes of Health funds a range of implementation science grants with collaborators in low- and middle-income countries. This analysis helps identify commonly utilized implementation outcomes, strategies, and frameworks and enables exploration of gaps and opportunities for further global research.

Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT)

BACKGROUND

Although significant advances have been made in the conceptualization of sustainability, having pragmatic, psychometrically valid tools remains a need within the field. Our previous work has developed frameworks and tools to assess both program sustainability and clinical sustainability capacity. This work presents new, psychometrically tested short versions of the Program Sustainability Assessment Tool (PSAT) and the Clinical Sustainability Assessment Tool (CSAT).

METHODS

These methods were conducted in identical, parallel processes for the CSAT and PSAT. Previously collected data for these instruments was obtained across a variety of settings, contexts, and participants. We first conducted testing to determine cronbach's alpha of shortened domains (3 items each) and then conducted Confirmatory Factor Analysis to ensure that the domains were still appropriate for the tool. After, the team met to review the results and determine the final versions of the short PSAT and short CSAT.

RESULTS

The short PSAT retained cronbach's alpha's of 0.82 - 0.91 for each domain of the tool, with which maintains excellent reliability for the tool. Confirmatory factor analysis highlights that the short PSAT retains conceptual distinction across the 8 domains, with CFI scores greater than 0.90, RMSEA scores below 0.6, and SRMR scores less than 0.08. The short CSAT had cronbach's alpha of 0.84 - 0.92 for each of the domains of the tool, also suggesting excellent reliability of the domains within the measure after dropping two items/domain. Confirmatory factor analysis of the short CSAT meets the same specifications as above, again highlighting conceptual distinction across the domains.

CONCLUSION

Each tool was able to be shortened to three items per domain while maintaining strong psychometric properties. This results in a tool that takes less time to complete, meeting one of the key calls for pragmatic measures within implementation science. This advances our abilities to measure and test sustainability within implementation science.

Evaluating the World Health Organization's HEARTS Model for Hypertension and Diabetes Management: A Pilot Implementation Study in Guatemala

Background

The World Health Organization HEARTS Technical Package is a widely implemented global initiative to improve the primary care management of cardiovascular disease risk factors. The study's objective is to report outcomes from a pilot implementation trial of integrated hypertension and diabetes management based on the HEARTS model in Guatemala.

Methods

We conducted a single-arm pilot implementation trial over 6 months from October 2023 to May 2024 in 11 Guatemalan Ministry of Health primary care facilities in two districts. The pilot evaluated a package of five HEARTS-aligned implementation strategies to improve the pharmacological treatment of hypertension and diabetes. The primary outcomes were feasibility and acceptability, measured through 20 structured interviews with Ministry of Health employees and by examining enrollment and retention. Secondary outcomes included a suite of implementation and clinical outcomes, including treatment rate.

Results

The study enrolled 964 patients, of whom 58.8% had hypertension only, 30.4% had diabetes only, and 10.8% had both conditions. Surveys on feasibility and acceptability among Ministry of Health staff had a median score of 5.0 (IQR: 5.0 to 5.0) and 5.0 (IQR range: 4.8 to 5.0), respectively, exceeding the prespecified benchmark of ≥3.5. Both districts achieved the prespecified benchmark of enrolling ≥25 hypertension patients and ≥25 diabetes patients. Only 36% of patients attended a follow-up visit within three months, lower than the prespecified benchmark of ≥75%. M treatment rates during the pilot increased by 22.3 (95% CI: 16.2 to 28.4; P<0.001) and 3.5 (95% CI: -1.6 to 8.7; P=0.17) patients per month for hypertension and diabetes, respectively.

Conclusions

Implementation of an integrated hypertension and diabetes model based on HEARTS was generally feasible and acceptable in the Ministry of Health in Guatemala. Findings can refine national scale-up in Guatemala and inform HEARTS implementation projects in other settings.

Evaluating Age-Friendly Health Care Approaches in Rural Primary Care Settings: A Multi-Case, Mixed-Methods Hybrid Type 2 Effectiveness-Implementation Study

Maintaining and improving the health and well-being of older people in rural communities through integrated care is essential to address this cohort's frailty risk. The Indigo 4Ms Tool for health workers is a rural-specific approach to providing care that addresses the common conditions of ageing. With Australian government funding, five small rural health services are implementing the tool. This paper describes the protocol for a hybrid type 2 implementation-effectiveness study to evaluate the tool's impact on multidisciplinary comprehensive care planning and the implementation strategies that enhance the adoption and sustainability of the tool across diverse rural health settings.

A mixed-methods, theory-driven assessment of the sustainability of a multi-sectoral preventive intervention for South Asian Americans at risk for cardiovascular disease

BACKGROUND

South Asian Americans bear a high burden of atherosclerotic cardiovascular disease (ASCVD), but little is known about the sustainability of evidence-based interventions (EBI) to prevent ASCVD in this population. Using community-based participatory research, we previously developed and implemented the South Asian Healthy Lifestyle Intervention (SAHELI), a culturally-adapted EBI targeting diet, physical activity, and stress management. In this study, we use the Integrated Sustainability Framework to investigate multisectoral partners' perceptions of organizational factors influencing SAHELI sustainability and strategies for ensuring sustainability.

METHODS

From 2022 to 2023, we conducted a mixed-methods study (quant- > QUAL) with 17 SAHELI partners in the Chicago area. Partners' settings included: community organization, school district, public health department, and healthcare system. Descriptive statistics summarized quantitative results. Two coders used a hybrid thematic analysis approach to identify qualitative themes. Qualitative and quantitative data were integrated and analyzed using mixed methods.

RESULTS

Surveys (score range 1-5: higher scores indicate facilitators; lower scores indicate barriers) indicated SAHELI sustainability facilitators to be its "responsiveness to community values and needs" (mean = 4.9). Barriers were "financial support" (mean = 3.5), "infrastructure/capacity to support sustainment" (mean = 4.2), and "implementation leadership" (mean = 4.3). Qualitative findings confirmed quantitative findings that SAHELI provided culturally-tailored cardiovascular health education responsive to the needs of the South Asian American community, increased attention to health issues, and transformed perceptions of research among community members. Qualitative findings expanded upon quantitative findings, showing that the organizational fit of SAHELI was a facilitator to sustainability while competing priorities were barriers for partners from the public health department and health system. Partners from the public health department and health system discussed challenges in offering culturally-tailored programming exclusively for one targeted population. Sustainability strategies envisioned by partners included: transitioning SAHELI to a program delivered by community members; integrating components of SAHELI into other programs; and expanding SAHELI to other populations. Modifications made to SAHELI (i.e., virtual instead of in-person delivery) had both positive and negative implications for sustainability.

DISCUSSION

This study identifies common sustainability barriers and facilitators across different sectors, as well as those specific to certain settings. Aligning health equity interventions with community needs and values, organizational activities, and local context and resources is critical for sustainability. Challenges also arise from balancing the needs of specific populations against providing programming for broader audiences.

Evaluating the tailored implementation of a multisite care navigation service for mental health in rural and remote Australia (The Bridging Study): protocol for a community-engaged hybrid effectiveness-implementation study

BACKGROUND

A dramatic decline in mental health of people worldwide in the early COVID-19 pandemic years has not recovered. In rural and remote Australia, access to appropriate and timely mental health services has been identified as a major barrier to people seeking help for mental ill-health. From 2020 to 2021 a care navigation model, Navicare, was co-designed with rural and remote communities in the Greater Whitsunday Region of Central Queensland in Australia. The Exploration, Preparation, Implementation and Sustainment (EPIS) framework was used to design and guide multiple aspects of a multisite study, The Bridging Study, to evaluate the implementation of Navicare in Australia.

METHODS

A community-engaged hybrid effectiveness-implementation study design will focus on the tailored implementation of Navicare at three new sites as well as monitoring implementation at an existing site established since 2021. Study outcomes assessed will include sustained access as the co-primary outcome (measured using access to Navicare mental health referral services) and Proctor's Implementation Outcomes of feasibility, acceptability, appropriateness, adoption, fidelity, implementation cost, and sustainability. Data collection for the implementation evaluation will include service usage data, community consultations, interviews, and workshops; analysed using mixed methods and guided by EPIS and other implementation frameworks. Pre-post effectiveness and cost-consequence study components are embedded in the implementation and sustainment phases, with comparison to pre-implementation data and value assessed for each EPIS phase using hospital, service, and resource allocation data. A scaling up strategy will be co-developed using a national roundtable forum in the final year of the study. Qualitative exploration of other aspects of the study (e.g., mechanisms of action and stakeholder engagement) will be conducted.

DISCUSSION

Our study will use tailoring to local sites and a community-engaged approach to drive implementation of a mental health care navigation service in rural and remote Australia, with expected benefits to mental healthcare access. This approach is consistent with policy recommendations nationally and internationally as building blocks for rural health including the World Health Organization Framework for Action on Strengthening Health Systems to Improve Health Outcomes.

TRIAL REGISTRATION

Prospectively registered on April 2, 2024, on the Australian New Zealand Clinical Trials Registry, no. ACTRN12624000382572. https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=386665&isReview=true .

The Role of Implementation Climate in Moderating Educator Use of Evidence-Based Practices and Outcomes for Autistic Students

Ensuring effective use of evidence-based practice (EBP) for autism in schools is imperative due to the significantly increasing number of autistic students receiving school services each year. High-quality EBP use has proven challenging in schools. Research indicates implementation climate, or how EBP are supported, rewarded, and valued, and EBP resources are related to successful implementation. However, limited understanding of system-level contextual factors that impact EBP implementation for school-based providers makes development of appropriate implementation supports challenging. Understanding these factors is crucial for selecting and tailoring implementation strategies to support EBP scale up. In this observational study, California school-based providers (n = 1084) completed surveys related to implementation climate, leadership, autism experience and EBP implementation (use, competence, knowledge). Student outcomes included state level academic and behavioral indicators. Using an implementation science framework (Aarons et al., in Administration and Policy in Mental Health and Mental Health Services Research 38:4-23, 2011) and multilevel modeling, we examined the relationship between EBP Implementation and student outcomes and the moderation effects of provider and district level factors. Higher implementation climate predicted better EBP implementation outcomes, and proved more impactful when provider hands-on autism experience was low. Greater EBP resources predicted a higher percentage of students who met math standards only when district poverty level was high. Our findings suggested moderating effects on EBP implementation from both provider and system level factors. Implementation climate and resources may be especially key in addressing equity issues related to high poverty schools in which teachers often have less autism experience.

Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C): development and psychometric evaluation of a measure of sustainability determinants in the early childhood education and care setting

BACKGROUND

There is a need for valid and reliable measures of determinants of sustainability of public health interventions in early childhood education and care (ECEC) settings. This study aimed to develop and evaluate the psychometric and pragmatic properties of such a measure - the Integrated Measure of PRogram Element SuStainability in Childcare Settings (IMPRESS-C).

METHODS

We undertook a two-phase process guided by the COnsensus-based Standards for the selection of health status Measurement INstruments checklist (COSMIN) and Psychometric and Pragmatic Evidence Rating Scale (PAPERS). Phase 1 involved measure development; i.e., determining items and scales through an iterative process and assessment of face and content validity. Phase 2 involved the evaluation of psychometric and pragmatic properties. The 29-item measure completed by service executives (directors and nominated supervisors) was embedded in a larger survey from a national sample of Australian ECEC services assessing their implementation of nutrition and physical activity programs. Structural validity, concurrent validity, known groups validity, internal consistency, floor and ceiling effects, norms, and pragmatic qualities of the measure were assessed according to the PAPERS criteria.

RESULTS

The final measure contained 26 items, with respondents reporting how strongly they agreed or disagreed on a five-point Likert scale. Phase 1 assessments confirmed the relevance, and face and content validity of the scale. In Phase 2, we obtained 482 completed surveys, of which 84% (n = 405) completed the entire measure across 405 ECEC settings (one executive per service). Three of the four fit indices for the confirmatory factor analysis met the pre-specified criteria (SRMR = 0.056, CFI = 0.993, RMSEA = 0.067) indicating 'good' structural validity. The IMPRESS-C illustrated: 'good' internal consistency, with Cronbach's alpha values from 0.53 to 0.92; 'emerging' concurrent validity; 'poor' known groups validity; 'good' norms; and 'good' overall pragmatic qualities (cost, readability, length, and assessor burden).

CONCLUSIONS

The IMPRESS-C possesses strong psychometric and pragmatic qualities for assessing service executive-level perceptions of determinants influencing sustainment of public health interventions within ECEC settings. To achieve a full range of perspectives in this setting, future work should be directed to also develop and test measures of sustainability determinants at the implementer level (e.g., among individual educators and staff).

Incorporating implementation science principles into curricular design

Implementation science (IS) is an approach focused on increasing the application of evidence-based health interventions into practice, through purposive and thoughtful planning to maximize uptake, scalability, and sustainability. Many of these principles can be readily applied to medical education, to help augment traditional approaches to curriculum design. In this paper, we summarize key components of IS with an emphasis on application to the medical educator.

Sustaining sexual health programs: practical considerations and lessons from the President's Emergency Plan for AIDS Relief

Enhancing the sustainability of sexual health programs is important, but there are few practical tools to facilitate this process. Drawing on a sustainability conceptual framework, this Editorial proposes four ideas to increase the sustainability of sexual health programs - early planning, equitable community engagement, return on investment, and partnerships to address social determinants. Early planning during the design of a sexual health program is important for sustainability because it provides an opportunity for the team to build factors relevant to sustainability into the program itself. Equitable community engagement can expand multi-sectoral partnerships for institutionalisation, identify allies for implementation, and strengthen relationships between beneficiaries and researchers. From a financial perspective, considering the return on investment could increase the likelihood of sustainability. Finally, partnerships to address social determinants can help to identify organisations with a similar vision. Existing sustainability frameworks can be used to measure each of these key elements. Several approaches can be used to enhance the sustainability of sexual health programs. The President's Emergency Plan for AIDS Relief provides potential lessons for increasing the sustainability of sexual health programs in diverse global settings.

Supporting Teams with Designing for Dissemination and Sustainability: the Design, Development, and Usability of a Digital Interactive Platform

Background

The use of Designing for Dissemination and Sustainability (D4DS) principles and methods can support the development of research products (interventions, tools, findings) to match well with the needs and context of the intended audience and setting. D4DS principles and methods are not well-known or used during clinical and public health research; research teams would benefit from applying D4DS. This paper presents the development of a new digital platform for teams to learn and apply a D4DS process to their work.

Methods

A user-centered design (UCD) approach engaged users (n=14) and an expert panel (n=6) in an iterative design process from discovery to prototyping and testing. We led five design sessions using Zoom and Figma software over a 5-month period. Users (71% academics; 29% practitioners) participated in at least 2 sessions. Following design sessions, feedback from users were summarized and discussed to generate design decisions. A prototype was then built and heuristically tested with 11 users who were asked to complete multiple tasks within the platform while verbalizing their decision-making using the 'think aloud' procedure. The System Usability Scale (SUS) was administered at the end of each testing session. After refinements to the platform were made, usability was reassessed with 7 of 11 same users to examine changes.

Results

The interactive digital platform (the D4DS Planner) has two main components: 1) the Education Hub (e.g., searchable platform with literature, videos, websites) and 2) the Action Planner. The Action Planner includes 7 interactive steps that walk users through a set of activities to generate a downloadable D4DS action plan for their project. Participants reported that the prototype tool was moderately usable (SUS=66) but improved following refinements (SUS=71).

Conclusions

This is a first of its kind tool that supports research teams in learning about and explicitly applying D4DS to their work. The use of this publicly available tool may increase the adoption, impact, and sustainment of a wide range of research products. The use of UCD yielded a tool that is easy to use. The future use and impact of this tool will be evaluated, and the tool will continue to be refined and improved.

A systematic review to determine the effect of strategies to sustain chronic disease prevention interventions in clinical and community settings: study protocol

BACKGROUND

The primary purpose of this review is to synthesise the effect of strategies aiming to sustain the implementation of evidenced-based interventions (EBIs) targeting key health behaviours associated with chronic disease (i.e. physical inactivity, poor diet, harmful alcohol use, and tobacco smoking) in clinical and community settings. The field of implementation science is bereft of an evidence base of effective sustainment strategies, and as such, this review will provide important evidence to advance the field of sustainability research.

METHODS

This systematic review protocol is reported in accordance with the Preferred Reporting Items for Systematic review and Meta-Analysis (PRISMA) checklist. Methods will follow Cochrane gold-standard review methodology. The search will be undertaken across multiple databases, adapting filters previously developed by the research team, data screening and extraction will be performed in duplicate, strategies will be coded using an adapted sustainability-explicit taxonomy, and evidence will be synthesised using appropriate methods (i.e. meta-analytic following Cochrane or non-meta-analytic following SWiM guidelines). We will include any randomised controlled study that targets any staff or volunteers delivering interventions in clinical or community settings. Studies which report on any objective or subjective measure of the sustainment of a health prevention policy, practice, or programme within any of the eligible settings will be included. Article screening, data extraction, risk of bias, and quality assessment will be performed independently by two review authors. Risk of bias will be assessed using Version 2 of the Cochrane risk-of-bias tool for randomised trials (RoB 2). A random-effect meta-analysis will be conducted to estimate the pooled effect of sustainment strategies separately by setting (i.e. clinical and community). Sub-group analyses will be undertaken to explore possible causes of statistical heterogeneity and may include the following: time period, single or multi-strategy, type of setting, and type of intervention. Differences between sub-groups will be statistically compared.

DISCUSSION/CONCLUSION

This will be the first systematic review to determine the effect of strategies designed to support sustainment on sustaining the implementation of EBIs in clinical and community settings. The findings of this review will directly inform the design of future sustainability-focused implementation trials. Further, these findings will inform the development of a sustainability practice guide for public health practitioners.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42022352333.

Implementation characteristics that may promote sustainability of a rural physical activity initiative: examination of Play Streets through the lens of community implementers

BACKGROUND

Play Streets, which are community-based environmental initiatives where public spaces/streets are temporarily closed to create safe, low-cost physical activity opportunities, have demonstrated feasibility and physical activity benefit in rural US areas. Yet, information is needed to identify implementation characteristics that may promote sustainability. This study examined rural Play Streets implementation characteristics that could impact sustainability from local partners' perspectives.

METHODS

Sixteen Play Streets implementation team members in rural Maryland, North Carolina, Oklahoma, and Texas, USA, participated in interviews. Semi-structured in-person individual and group interviews were conducted in the fall of 2018 (after Play Streets implementation in 2017 and 2018), recorded, and transcribed verbatim. Transcripts were analyzed using iterative, content analyses. Coding frameworks were based on the Public Health Program Capacity for Sustainability Framework, and emergent themes were also identified.

RESULTS

Interviewees' perceived characteristics for facilitating Play Streets implementation aligned with the Public Health Program Capacity for Sustainability Framework: funding stability, political support, partnerships, organizational capacity, program adaption, and communication. Interviewees also noted the importance of cultural alignment/support and the reciprocal impact of community connectedness/engagement.

CONCLUSIONS

Future research should examine the reciprocal role of public health impacts, as both outcomes and factors which may influence sustainability.

Sustainability Planning for a Community Network to Increase Participation in Evidence-Based Lifestyle Change Programs: A Mixed-Methods Approach

Community-based chronic disease prevention programs can have long-term, broad public health benefits. Yet, only 40 to 60% of evidence-based health programs are sustained. Using established frameworks and evidence-based tools to characterize sustainability allows programs to develop structures and processes to leverage resources effectively to sustain effective program activities and systems. This study used a mixed-methods, partner-engaged approach to identify barriers and facilitators to sustaining a community network (the Alliance program) aimed to increase participation in evidence-based lifestyle change programs delivered in the community. Surveys and qualitative interviews were conducted with the Alliance partners based on the Program Sustainability Assessment Tool and Consolidated Framework for Implementation Research. Overall, partners felt Alliance had a high capacity for sustainability. Strategic planning, communication, and partnerships were areas partners prioritized to improve the potential for sustaining the program. Results informed the co-development of a sustainability action plan. This paper furthers our understanding of factors critical for the sustainability of community-based programs for chronic disease prevention and health equity and presents a process for developing action plans to build sustainability capacity.

A Hybrid Type 1 trial of a multi-component mHealth intervention to improve post-hospital transitions of care for patients with serious mental illness: Study protocol

BACKGROUND

The transition from acute (e.g., psychiatric hospitalization) to outpatient care is associated with increased risk for rehospitalization, treatment disengagement, and suicide among people with serious mental illness (SMI). Mobile interventions (i.e., mHealth) have the potential to increase monitoring and improve coping post-acute care for this population. This protocol paper describes a Hybrid Type 1 effectiveness-implementation study, in which a randomized controlled trial will be conducted to determine the effectiveness of a multi-component mHealth intervention (tFOCUS) for improving outcomes for adults with SMI transitioning from acute to outpatient care.

METHODS

Adults meeting criteria for schizophrenia-spectrum or major mood disorders (n = 180) will be recruited from a psychiatric hospital and randomized to treatment-as-usual (TAU) plus standard discharge planning and aftercare (CHECK-IN) or TAU plus tFOCUS. tFOCUS is a 12-week intervention, consisting of: (a) a patient-facing mHealth smartphone app with daily self-assessment prompts and targeted coping strategies; (b) a clinician-facing web dashboard; and, (c) mHealth aftercare advisors, who will conduct brief post-hospital clinical calls with patients (e.g., safety concerns, treatment engagement) and encourage app use. Follow-ups will be conducted at 6-, 12-, and 24-weeks post-discharge to assess primary and secondary outcomes, as well as target mechanisms. We also will assess barriers and facilitators to future implementation of tFOCUS via qualitative interviews of stakeholders and input from a Community Advisory Board throughout the project.

CONCLUSIONS

Information gathered during this project, in combination with successful study outcomes, will inform a potential tFOCUS intervention scale-up across a range of psychiatric hospitals and healthcare systems.

CLINICALTRIALS

govregistration: NCT05703412.

Collaborative sustainability planning for an outcome measure in outpatient stroke rehabilitation: A qualitative description study

RATIONALE

Evidence suggests that sustainability planning and the use of a collaborative approach to planning result in better sustainability outcomes and more relevant knowledge. Yet, both approaches appear to be underutilized. A detailed description of collaborative sustainability planning may encourage the use of these two impactful strategies.

AIMS AND OBJECTIVES

To explore the collaborative sustainability planning process for a single outcome measure in three rehabilitation sites.

METHODOLOGY

Within the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) implementation project, we conducted a qualitative description study. We used data from 12 core sustainability planning meetings and 108 follow-up meetings that included a total of 31 clinical and research team participants. Sustainability planning was informed by an MPAI-4-specific implementation guide, and by the results from a realist review of the sustainability of rehabilitation practices and the Clinical Sustainability Assessment Tool. We analyzed qualitative data using thematic content analysis.

RESULTS

Three themes describe the collaborative sustainability planning process: (1) "collaboration as a driver for sustainability" which captures the active collaboration underpinning sustainability planning; (2) "co-creation of a sustainability plan to achieve shared objectives" which captures the identified barriers and facilitators, and selected sustainability strategies linked to one of six collaboratively identified shared objectives; and (3) "the iterative nature of sustainability planning" which captures the necessity of an agile and responsive sustainability planning process.

CONCLUSION

Identified strategies may be useful to support (collaborative) sustainment. Future research could investigate the effect of collaborative sustainability planning on sustainability objectives, and the relationship between these objectives.

Advancing Translation of Clinical Research Into Practice and Population Health Impact Through Implementation Science

Translational and implementation sciences aim to prioritize and guide efforts to create greater efficiency and speed of scientific innovation across the translational science continuum to improve patient and population health. Key principles and practices rooted in translational and implementation science may be incorporated into clinical trials research, particularly pragmatic trials, to improve the relevance and impact of scientific innovation. This thematic review intends to raise awareness on the value of translational and implementation science in clinical research and to encourage its use in designing and implementing clinical trials across the translational research continuum. Herein, we describe the gap in translating research findings into clinical practice, introduce translational and implementation science, and describe the principles and practices from implementation science that can be used in clinical trial research across the translational continuum to inform clinical practice, to improve population health impact, and to address health care inequities.

Improving safety and preventing falls using an evidence-based, front-line staff huddling practice: protocol for a pragmatic trial to increase quality of care in State Veterans Homes

INTRODUCTION

Falls in nursing homes are a major cause for decreases in residents' quality of life and overall health. This study aims to reduce resident falls by implementing the LOCK Falls Programme, an evidence-based quality improvement intervention. The LOCK Falls Programme involves the entire front-line care team in (1) focusing on evidence of positive change, (2) collecting data through systematic observation and (3) facilitating communication and coordination of care through the practice of front-line staff huddles.

METHODS AND ANALYSIS

The study protocol describes a mixed-methods, 4-year hybrid (type 2) effectiveness-implementation study in State Veterans Homes in the USA. The study uses a pragmatic stepped-wedge randomised trial design and employs relational coordination theory and the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to guide implementation and evaluation. A total of eight State Veterans Homes will participate and data will be collected over an 18-month period. Administrative data inclusive of all clinical assessments and Minimum Data Set assessments for Veterans with a State Veterans Home admission or stay during the study period will be collected (8480 residents total). The primary outcome is a resident having any fall. The primary analysis will be a partial intention-to-treat analysis using the rate of participants experiencing any fall. A staff survey (n=1200) and qualitative interviews with residents (n=80) and staff (n=400) will also be conducted. This research seeks to systematically address known barriers to nursing home quality improvement efforts associated with reducing falls.

ETHICS AND DISSEMINATION

This study is approved by the Central Institutional Review Board (#167059-11). All participants will be recruited voluntarily and will sign informed consent as required. Collection, assessment and managing of solicited and spontaneously reported adverse events, including required protocol alterations, will be communicated and approved directly with the Central Institutional Review Board, the data safety monitoring board and the Office of Research and Development. Study results will be disseminated through peer-reviewed publications and conference presentations at the Academy Health Annual Research Meeting, the Gerontological Society of America Annual Scientific Meeting and the American Geriatrics Society Annual Meeting. Key stakeholders will also help disseminate lessons learnt.

TRIAL REGISTRATION NUMBER

NCT05906095.

Organizational readiness and implementation fidelity of an early childhood education and care-specific physical activity policy intervention: findings from the Play Active trial

BACKGROUND

Many children do not accumulate sufficient physical activity for good health and development at early childhood education and care (ECEC). This study examined the association between ECEC organizational readiness and implementation fidelity of an ECEC-specific physical activity policy intervention.

METHODS

Play Active aimed to improve the ECEC educator's physical activity practices. We investigated the implementation of Play Active using a Type 1 hybrid study (January 2021-March 2022). Associations between organizational readiness factors and service-level implementation fidelity were examined using linear regressions. Fidelity data were collected from project records, educator surveys and website analytics.

RESULTS

ECEC services with higher levels of organizational commitment and capacity at pre-implementation reported higher fidelity scores compared to services with lower organizational commitment and capacity (all Ps < 0.05). Similarly, services who perceived intervention acceptability and appropriateness at pre-implementation to be high had higher fidelity scores (P < 0.05). Perceived feasibility and organizational efficacy of Play Active were associated with higher but nonsignificant fidelity scores.

CONCLUSIONS

Results indicate that organizational readiness factors may influence the implementation of ECEC-specific physical activity policy interventions. Therefore, strategies to improve organizational readiness should be developed and tested. These findings warrant confirmation in the ECEC and other settings and with other health behavior interventions.

Sustaining the collaborative chronic care model in outpatient mental health: a matrixed multiple case study

BACKGROUND

Sustaining evidence-based practices (EBPs) is crucial to ensuring care quality and addressing health disparities. Approaches to identifying factors related to sustainability are critically needed. One such approach is Matrixed Multiple Case Study (MMCS), which identifies factors and their combinations that influence implementation. We applied MMCS to identify factors related to the sustainability of the evidence-based Collaborative Chronic Care Model (CCM) at nine Department of Veterans Affairs (VA) outpatient mental health clinics, 3-4 years after implementation support had concluded.

METHODS

We conducted a directed content analysis of 30 provider interviews, using 6 CCM elements and 4 Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) domains as codes. Based on CCM code summaries, we designated each site as high/medium/low sustainability. We used i-PARIHS code summaries to identify relevant factors for each site, the extent of their presence, and the type of influence they had on sustainability (enabling/neutral/hindering/unclear). We organized these data into a sortable matrix and assessed sustainability-related cross-site trends.

RESULTS

CCM sustainability status was distributed among the sites, with three sites each being high, medium, and low. Twenty-five factors were identified from the i-PARIHS code summaries, of which 3 exhibited strong trends by sustainability status (relevant i-PARIHS domain in square brackets): "Collaborativeness/Teamwork [Recipients]," "Staff/Leadership turnover [Recipients]," and "Having a consistent/strong internal facilitator [Facilitation]" during and after active implementation. At most high-sustainability sites only, (i) "Having a knowledgeable/helpful external facilitator [Facilitation]" was variably present and enabled sustainability when present, while (ii) "Clarity about what CCM comprises [Innovation]," "Interdisciplinary coordination [Recipients]," and "Adequate clinic space for CCM team members [Context]" were somewhat or less present with mixed influences on sustainability.

CONCLUSIONS

MMCS revealed that CCM sustainability in VA outpatient mental health clinics may be related most strongly to provider collaboration, knowledge retention during staff/leadership transitions, and availability of skilled internal facilitators. These findings have informed a subsequent CCM implementation trial that prospectively examines whether enhancing the above-mentioned factors within implementation facilitation improves sustainability. MMCS is a systematic approach to multi-site examination that can be used to investigate sustainability-related factors applicable to other EBPs and across multiple contexts.

Barriers and Facilitators to Program Sustainability Among State Tobacco Control Programs

Public health programs, particularly tobacco control programs (TCPs) in state health departments, face numerous barriers and facilitators to sustainability, which affect delivery and, consequently, health outcomes achieved. We used the Program Sustainability Framework to review and analyze qualitative interview data from states that received training and technical assistance during the Plans, Actions, and Capacity to Sustain Tobacco Control (PACT) study to better understand the barriers and facilitators to sustainability capacity that these public health programs face at the state level. The PACT study was a multiyear, randomized controlled trial to assess the effectiveness of an action planning workshop and technical assistance in improving capacity for sustainability among 11 intervention and 12 control TCPs. Technical assistance calls focused on the progress and barriers of implementing the sustainability action plan created during the in-person workshops. Calls were audio recorded and professionally transcribed. Thematic analysis focused on the codes describing barriers and facilitators faced by TCPs in increasing their capacity for sustainability. Barriers were reported in the Organization Capacity, Environmental Support, Partnerships, Communication, and Funding Stability domains of the Program Sustainability Framework. Facilitators to action planning and building capacity for program sustainability were primarily in the Strategic Planning, Program Evaluation, Program Adaptation, and Partnership domains. Our study is the first to identify barriers and facilitators to increasing the capacity of program sustainability in TCPs. This work advances the understanding of program sustainability capacity and technical assistance for public health programs.

Implementing integrated hypertension and diabetes management using the World Health Organization's HEARTS model: protocol for a pilot study in the Guatemalan national primary care system

BACKGROUND

The HEARTS technical package was developed by the World Health Organization to address the implementation gap in cardiovascular disease prevention in low- and middle-income countries. Guatemala is a middle-income country that is currently implementing HEARTS. National authorities in Guatemala are interested in exploring how hypertension and diabetes management can be integrated in HEARTS implementation. The objective of this study is to conduct a feasibility and acceptability pilot trial of integrated hypertension and diabetes management based on HEARTS in the publicly funded primary care system in Guatemala.

METHODS

A single-arm pilot trial for 6 months will be carried out in 11 Ministry of Health primary care facilities starting in September 2023. A planned sample of 100 adult patients diagnosed with diabetes (n = 45), hypertension (n = 45), or both (n = 10) will be enrolled. The intervention will consist of HEARTS-aligned components: Training health workers on healthy-lifestyle counseling and evidence-based treatment protocols, strengthening access to medications and diagnostics, training on risk-based cardiovascular disease management, team-based care and task sharing, and systems monitoring and feedback, including implementation of a facility-based electronic monitoring tool at the individual level. Co-primary outcomes of feasibility and acceptability will be assessed using an explanatory sequential mixed-methods design. Secondary outcomes include clinical effectiveness (treatment with medication, glycemic control, and blood pressure control), key implementation outcomes (adoption, fidelity, usability, and sustainability), and patient-reported outcome measures (diabetes distress, disability, and treatment burden). Using an implementation mapping approach, a Technical Advisory Committee will develop implementation strategies for subsequent scale-up planning.

DISCUSSION

This trial will produce evidence on implementing HEARTS-aligned hypertension and diabetes care in the MOH primary care system in Guatemala. Results also will inform future HEARTS projects in Guatemala and other low- and middle-income countries.

TRIAL REGISTRATION

ClinicalTrials.gov ID NCT06080451. The trial was prospectively registered on October 12, 2023.

Methods for scaling up an outreach intervention to increase colorectal cancer screening rates in rural areas

BACKGROUND

Mailed fecal immunochemical test (FIT) outreach and patient navigation are evidence-based practices shown to improve rates of colorectal cancer (CRC) and follow-up in various settings, yet these programs have not been broadly adopted by health systems and organizations that serve diverse populations. Reasons for low adoption rates are multifactorial, and little research explores approaches for scaling up a complex, multi-level CRC screening outreach intervention to advance equity in rural settings.

METHODS

SMARTER CRC, a National Cancer Institute Cancer Moonshot project, is a cluster-randomized controlled trial of a mailed FIT and patient navigation program involving 3 Medicaid health plans and 28 rural primary care practices in Oregon and Idaho followed by a national scale-up trial. The SMARTER CRC intervention combines mailed FIT outreach supported by clinics, health plans, and vendors and patient navigation for colonoscopy following an abnormal FIT result. We applied the framework from Perez and colleagues to identify the intervention's components (including functions and forms) and scale-up dissemination strategies and worked with a national advisory board to support scale-up to additional organizations. The team is recruiting health plans, primary care clinics, and regional and national organizations in the USA that serve a rural population. To teach organizations about the intervention, activities include Extension for Community Healthcare Outcomes (ECHO) tele-mentoring learning collaboratives, a facilitation guide and other materials, a patient navigation workshop, webinars, and individualized technical assistance. Our primary outcome is program adoption (by component), measured 6 months after participation in an ECHO learning collaborative. We also assess engagement and adaptations (implemented and desired) to learn how the multicomponent intervention might be modified to best support broad scale-up.

DISCUSSION

Findings may inform approaches for adapting and scaling evidence-based approaches to promote CRC screening participation in underserved populations and settings.

TRIAL REGISTRATION

Registered at ClinicalTrials.gov (NCT04890054) and at the NCI's Clinical Trials Reporting Program (CTRP no.: NCI-2021-01032) on May 11, 2021.

Examining the Sustainability of Core Capacity and Evidence-Based Interventions for FIT-Based CRC Screening: California Colorectal Cancer Control Program

OBJECTIVES

We examined the extent to which funded satellite clinics could sustain the California Colon Cancer Control Program (C4P) strategies implemented in health systems to increase uptake of the fecal immunochemical test (FIT) or immunochemical fecal occult blood test (iFOBT) for colorectal cancer (CRC) screening in the absence of future C4P funds.

INTRODUCTION

Seven health systems consisting of 38 satellite clinics participated in C4P to examine the sustainability of the program in the absence future Centers for Disease Control and Prevention (CDC) funding.

METHODS

Quantitative and qualitative methods with a close and open-ended survey approach, and a prospective cohort design were used to examine the sustainability of the C4P in health systems.

RESULTS

A total of 61% of satellite clinics could not sustain funding stability. Only 26% could sustain funding stability. About, 71%, 26%, and 21% of the satellite clinics could sustain the small media platform, patient navigation services, and community health workers (CHWs), respectively. All the satellite clinics sustained the provider reminder system and professional development. Roughly, 71% and 42% of funded satellite clinics could not sustain the patient navigators and CHWs, respectively. The satellite clinics that could sustain funding stability, sustained patient navigation services and CHWs. Health systems that could not sustain funding stability, could not sustain patient navigation services and CHWs. Qualitatively, the need to support uninsured priority populations, health educators, patient navigators, care coordination activities, outreach services, and provision of enhanced services emerged. The need to support enhanced quality measures, expansion of funding, Medi-Cal Public Hospital Redesign and Incentive coverage, health plan, community linkages, resource sharing, and best practices specifically on CRC screening emerged. Themes such as automated reminder, limited personalized care delivery and capacity, transportation barriers, staff salary, expansion of care through patient navigation, and culturally appropriate media campaign also emerged.

CONCLUSION

Overall, to address sustainability barriers, funding stability should be maintained in the health systems.

Using the project ECHO™ model to teach mental health topics in rural Guatemala: An implementation science-guided evaluation

BACKGROUND

Mental health (MH) disorders are major causes of disability in Guatemala. Unfortunately, limited academic training and funding resources make MH care inaccessible to most people in rural Guatemala. These disparities leave many indigenous populations without care. Project ECHO™ is an educational model used globally to deliver virtual training for providers in rural/ underserved communities. The aim of this project was to implement and evaluate a Project ECHO™ program bridging MH training gaps for providers who serve rural communities in Guatemala.

METHODS

The Project ECHO™ curriculum was implemented through a partnership between educational and nonprofit institutions in Guatemala City and the United States. Participants were primary care physicians and nurses working in rural Guatemala as well as medical/nursing/psychology students. Evaluation of its implementation was guided by a RE-AIM framework. Reach, effectiveness, adoption, fidelity, sustainability, acceptability, feasibility, and appropriateness were evaluated using a mixed-methods approach, using a pre-post survey and semi-structured focus groups.

RESULTS

Forty unique participants attended the five sessions. Attitudes about mental health did not change quantitatively but self-efficacy improved in four of five modules. High quality fidelity scores were noted in two of five sessions. Sustainability scores across multiple domains were highly rated. Scores on instruments measuring acceptability, feasibility, and appropriateness were high. Focus groups showed two main themes: the curriculum filled a gap in education and further adaptation of the model might help improve the experience.

CONCLUSION

Implementation of the Project ECHO™ educational model appeared to have good reach/adoption, showed improvements in self-efficacy, illuminated facilitators and barriers to sustainability, and was felt to be acceptable, feasible, and appropriate. Qualitative analysis supported these conclusions. Future directions would include ongoing evaluation and monitoring of further Project ECHO™ curricular experiences through this partnership and adaptation of this project to other learners and settings in Latin America.

Implementation measurement in global mental health: Results from a modified Delphi panel and investigator survey

Limited guidance exists to support investigators in the choice, adaptation, validation and use of implementation measures for global mental health implementation research. Our objectives were to develop consensus on best practices for implementation measurement and identify strengths and opportunities in current practice. We convened seven expert panelists. Participants rated approaches to measure adaptation and validation according to appropriateness and feasibility. Follow-up interviews were conducted and a group discussion was held. We then surveyed investigators who have used quantitative implementation measures in global mental health implementation research. Participants described their use of implementation measures, including approaches to adaptation and validation, alongside challenges and opportunities. Panelists agreed that investigators could rely on evidence of a measure's validity, reliability and dimensionality from similar contexts. Panelists did not reach consensus on whether to establish the pragmatic qualities of measures in novel settings. Survey respondents (n = 28) most commonly reported using the Consolidated Framework for Implementation Research Inner Setting Measures (n = 9) and the Program Assessment Sustainability Tool (n = 5). All reported adapting measures to their settings; only two reported validating their measures. These results will support guidance for implementation measurement in support of mental health services in diverse global settings.

Patterns of Sustainability Capacity Among Organizations That Deliver the National Diabetes Prevention Program: A Latent Profile Analysis

INTRODUCTION

Since the launch of the National Diabetes Prevention Program (DPP) in 2010, more than 3,000 organizations have registered with the Centers for Disease and Control and Prevention to deliver the program; today, however, only approximately 2,000 organizations are registered, indicating challenges with sustainability. We used the Program Sustainability Assessment Tool (PSAT) to explore patterns of sustainability capacity among National DPP delivery organizations.

METHODS

We used data from a cross-sectional online survey conducted in August and September 2021 of staff members (N = 440) at National DPP delivery organizations. We conducted a latent profile analysis to identify latent subpopulations on the basis of respondent PSAT domain scores. Regression analyses were used to estimate associations between derived latent classes, PSAT scores, and respondent characteristics.

RESULTS

The 4-class model included 4 groups of capacity for program sustainability, ranging from low to high: low (class 1) with 8.0% of the sample, medium-low (class 2) with 22.0%, medium-high (class 3) with 41.6%, and high (class 4) with 28.4%. Program evaluation (mean score = 5.1 [SD = 1.4]) and adaptation (mean score = 5.3 [SD = 1.3]) were the domains with the highest scores, while funding stability (mean score = 4.0 [SD = 1.6]) and Partnerships (mean score = 4.0 [SD = 1.7]) had the lowest scores. In our sample of National DPP delivery organizations, most reported relatively high capacity for program sustainability, and key indicators associated with sustainability capacity were virtual delivery, location of delivery, funding sources, and organization type.

DISCUSSION

Similar to sustainability capacity findings from other PSAT studies, our study found that funding stability and partnerships are areas to strengthen. This insight is useful in sustainability planning at organizational and national levels across multiple programs.

A cluster randomised controlled trial to assess the effectiveness of a multi-strategy sustainability intervention on teachers' sustained implementation of classroom physical activity breaks (energisers): study protocol

BACKGROUND

Governments internationally have invested hugely in the implementation and scale-up of school-based physical activity interventions, but have little evidence of how to best sustain these interventions once active implementation support ceases. This study will assess the effectiveness of a multi-strategy sustainability intervention on classroom teachers' sustainment of energisers (short 3-5 min physical activity breaks during class-time) scheduled across the school day from baseline to 12 and 24-month follow-up.

METHODS

A cluster randomised controlled trial will be conducted in 50 primary schools within the Hunter New England, Illawarra Shoalhaven, Murrumbidgee and Northern New South Wales (NSW) Local Health Districts of NSW Australia. Schools will be randomly allocated to receive either usual support or the multi-strategy sustainability intervention that includes: centralised technical assistance from a trained project officer; formal commitment and mandated change obtained from school principals; training in-school champions; reminders for teachers; educational materials provided to teachers; capturing and sharing local knowledge; and engagement of parents, carers and the wider school community. The primary trial outcome will be measured via a teacher logbook to determine the between-group difference in the change in mean minutes of energisers scheduled across the school day at 12 and 24-month follow-up compared to baseline. Analyses will be performed using an intention to treat framework. Linear mixed models will be used to assess intervention effects on the primary outcome at both follow-up periods.

DISCUSSION

This study will be one of the first randomised controlled trials to examine the impact of a multi-strategy sustainability intervention to support schools' sustainment of a physical activity intervention. The proposed research will generate new evidence needed for the partnering organisations to protect their considerable investments to date in physical activity promotion in this setting and will provide seminal evidence for the field globally.

TRIAL REGISTRATION

ACTRN12620000372987 version 1 registered 17th March 2020. Version 3 (current version) updated 4th August 2023.

Making the connection between health equity and sustainability

Sustainability and health inequities are key challenges in public health and healthcare. Research suggests that only about half of evidence-based interventions (EBIs) are sustained over time, and settings and populations experiencing systemic and structural barriers to health (e.g., poverty, racism, stigma, and discrimination) experience even greater challenges to sustainability. In this article, we argue that an enhanced focus on sustainability in the field of implementation science is critical in order to maximize the long-term health benefits and broader societal impacts of EBIs for all populations and settings. From an equity perspective, a focus on sustainability is particularly critical to prioritize among population sub-groups that have not historically received the benefits of health-related EBIs. We discuss how a health equity framing is essential to sustaining EBIs in under-resourced communities, and requires moving away from a deficit mindset that focuses on why EBIs are challenging to sustain, to one that focuses more on identifying and nurturing existing assets within individuals and communities to increase the likelihood that EBIs are sustained. We conclude with a discussion of future directions as well as recommendations and resources (e.g., frameworks, tools) to advance and make progress toward sustainability from a health equity mindset, including: (1) Actively planning early for sustainability alongside key partners; (2) Tracking progress toward enhancing sustainability and being accountable in doing so equitably for all settings and populations; and (3) Focusing on both equity and engagement early and often throughout the research process and all implementation phases.