The Program Sustainability Assessment Tool: a new instrument for public health programs

The iPRISM webtool: an interactive tool to pragmatically guide the iterative use of the Practical, Robust Implementation and Sustainability Model in public health and clinical settings

BACKGROUND

To increase uptake of implementation science (IS) methods by researchers and implementers, many have called for ways to make it more accessible and intuitive. The purpose of this paper is to describe the iPRISM webtool (Iterative, Practical, Robust Implementation and Sustainability Model) and how this interactive tool operationalizes PRISM to assess and guide a program's (a) alignment with context, (b) progress on pragmatic outcomes, (c) potential adaptations, and (d) future sustainability across the stages of the implementation lifecycle.

METHODS

We used an iterative human-centered design process to develop the iPRISM webtool.

RESULTS

We conducted user-testing with 28 potential individual and team-based users who were English and Spanish speaking from diverse settings in various stages of implementing different types of programs. Users provided input on all aspects of the webtool including its purpose, content, assessment items, visual feedback displays, navigation, and potential application. Participants generally expressed interest in using the webtool and high likelihood of recommending it to others. The iPRISM webtool guides English and Spanish-speaking users through the process of iteratively applying PRISM across the lifecycle of a program to facilitate systematic assessment and alignment with context. The webtool summarizes assessment responses in graphical and tabular displays and then guides users to develop feasible and impactful adaptations and corresponding action plans. Equity considerations are integrated throughout.

CONCLUSIONS

The iPRISM webtool can intuitively guide individuals and teams from diverse settings through the process of using IS methods to iteratively assess and adapt different types of programs to align with the context across the implementation lifecycle. Future research and application will continue to develop and evaluate this IS resource.

Sustainability capacity and health worker normalisation of a successful non-communicable disease (NCD) health systems intervention within primary care settings in Uganda: a quantitative approach to a qualitative question

BACKGROUND

Interventions for non-communicable diseases are increasingly implemented and evaluated in sub-Saharan Africa, but little is known about their medium- to long-term sustainability beyond the end of research funding. A cluster randomised trial conducted between 2013 and 2016 in Uganda and Tanzania showed that an intervention package to improve hypertension (HT) and type-2 diabetes mellitus (DM) care was highly effective in increasing service readiness and quality of care. The present study assesses the sustainability of the intervention 4 years after the trial in Uganda.

METHODS

The study was conducted in 2020 in 22 primary care health facilities (HFs) (3 referrals and 19 lower-level units) that had received the intervention package until trial end (2016), to assess their current capacity and practice to sustain ongoing intervention activities for HT and DM care. Through a cross-sectional survey, 4 pre-defined domains (i.e., cognitive participation, coherence, collective action, and reflexive monitoring) were examined with regard to health worker (HW) normalization and 8 pre-defined domains for intervention sustainability (i.e., organisational capacity, local environment, funding stability, partnerships, communication, evaluation, adaptation, and strategic planning), using the normalisation tool and the program sustainability tool (PSAT). Summary scores were assessed by domains and facility level.

RESULTS

Overall normalization strength was adequate at 4.0 (IQR: 3.8, 4.2) of a possible 5 with no evidence of association with HF level (p = 0.40); cognitive participation (buy-in) and reflexive monitoring (appraisal) were strongest at > 4 across all HF levels. All HF levels were weak (< 4) on collective action (teamwork) and coherence (sense-making). Only collective action differed by level (p < 0.002). Overall intervention sustainability was suboptimal at 3.1 [IQR: 1.9, 4.1] of a possible 7 with weak scores on funding stability (2.0), supportive partnerships (2.2), and strategic planning (2.6). Domain differences by HF level were significant for environmental support (p = 0.02) and capacity in organisation (p = 0.01). Adequate strength at a cut-off mean of ≥5 did not differ by HF level for any domain.

CONCLUSIONS

Four years after their introduction, practice-dependent intervention elements e.g., local organisational context, HW knowledge or dedication were sustained, but external elements e.g., new funding support or attracting new partners to sustain intervention efforts were not. Whenever new interventions are introduced into an existing health service, their long-term sustainability including the required financial support should be ensured. The quality of services should be upheld by providing routine in-service training with dedicated support supervision.

"I decided to participate….because I saw it as benefiting our community and families": a qualitative study of lay providers' experiences with delivering an evidence-based mental health intervention for families in Uganda

BACKGROUND

Children and adolescents who live in resource-limited communities in sub-Saharan Africa (SSA) experience significant mental health problems, including behavioral problems. In SSA, one of the most significant impediments to expanding services is a scarcity of mental health specialists. Task-shifting can effectively solve the mental health care gap in low-resource settings, yet it is underutilized in child and adolescent mental health. Moreover, the experiences of lay providers are understudied in global mental health, despite their potential impact on intervention effectiveness. In this study, we examined the experiences of community health workers and parent peers with the task-shifting of an evidence-based family strengthening intervention in Uganda.

METHODS

As part of a larger randomized clinical trial, semi-structured in-depth interviews were conducted with 24 facilitators selected using stratified purposive sampling. Interviews explored their decision to participate in the program; experiences with the training; and experiences with intervention delivery. All interviews were conducted in Luganda (local language) and audio recorded. They were transcribed verbatim and translated into English. Thematic analysis was used to analyze the data.

RESULTS

Despite concerns around lack of previous experience and time commitment, facilitators reported high relevance of the intervention to the families in their communities as well as their own as a motivation to participate. They also identified financial incentives as a motivating factor. These two factors also ensured their attendance at the training. They were satisfied with the content and skills provided during the training and felt prepared to deliver the intervention. During intervention delivery, they enjoyed seeing the families engaged and participating actively in the sessions as well as observing positive changes in the families. Some challenges with family attendance and engagement were noted. The facilitators reported an increased sense of self-efficacy and competence over time; and expressed high satisfaction with supervision.

CONCLUSION

Facilitators' positive experiences point to the high acceptability and appropriateness of task-shifting this intervention in low-resource settings. As the global mental health field continues to be interested in task-shifting interventions to lay providers, successful examples should be studied so that evidence-based models can be put in place to support them through the process.

The Commit to Be Fit framework: a community case study of a multi-level, holistic school-based wellness initiative in rural Virginia

Background

Public health interventions that target children's physical, mental, and emotional health will enhance their ability to learn and grow. Although more complex, school initiatives that address multiple ecological levels and take a holistic view may be more effective and likely to lead to lasting change.

Aims

This article presents the framework of Commit to Be Fit (C2BF) as an example of how schools can integrate multi-level and holistic approaches for health. This innovative school-based intervention includes activities addressing individual, home, school, and community to create a culture of wellness. We describe the implementation of C2BF and its basis in ecological models and give examples of activities across three components: cafeteria, classroom, and community. We discuss challenges and note that leadership engagement and alignment were critical elements for C2BF's success thus far.

Discussion

C2BF uses a school-based multi-level approach to creating a culture of wellness and holistic health for students, teachers, and community members. C2BF is unique compared to other school-based programming and includes activities that address all eight domains posited for program sustainability within public health. Built to be flexible and adaptive, C2BF was able to successfully pivot during the COVID pandemic and also follow new science.

Conclusion

C2BF and other multi-level holistic approaches are more likely to achieve long-term change by utilizing strategies across the multiple levels of the ecological model to improve health and wellbeing.

Emergency manual peri-crisis use six years following implementation: Sustainment of an intervention for rare crises

STUDY OBJECTIVE

Use of cognitive aids during emergencies increases key actions and decreases omissions, both known to save lives. With little known about emergency manual (EM) clinical use, we aimed to help answer "Will EMs be used peri-crisis at a meaningful frequency?" and to explore clinical sustainment.

DESIGN

Prospective, observational study.

SETTING

Operating Rooms.

PATIENTS

All patients undergoing anesthesia at a major academic medical center during the study periods; ∼75,000 cases.

INTERVENTION & MEASUREMENTS

To understand the initial and sustainment phases of EM implementation, we placed a question regarding EM use at the end of every anesthetic case to prospectively measure EM use at: implementation, one-year later, and six years post-implementation.

MAIN RESULTS

For more than twenty-four thousand cases in each approximately 6-month study period, EMs were used peri-crisis (before, during or after a perioperative crisis) in 145 cases initially (0.55%; SE 0.045%), 42 cases one-year later (0.17%; SE 0.026%), and 57 cases (0.21%; SE 0.028%) six years post-implementation. Peri-crisis EM uses dropped 0.38% (97.5% CI: 0.26%, 0.49%) from initial to one-year post-implementation. After that, peri-crisis EM uses did not differ significantly from one-year to six years post-implementation, showing sustainment [increased 0.04% (97.5% CI: -0.05%, 0.12%)]. Among cases with cardiac arrest or CPR, as a subset proxy for relevant crises, EMs were used in 7/13 such cases initially (54%, SE 13.6%), 8/20 one-year later (40%; SE 10.9%) and 7/13 six years later (54%; SE 13.6%).

CONCLUSIONS

After an initial expected drop, EM peri-crisis use six years post-implementation was: sustained without intensive additional efforts, averaged ∼10 times per month at a single institution, and was reported in more than half of cases with cardiac arrest or CPR. Peri-crisis use of EMs is appropriately rare, though for relevant crises can have substantial positive impacts as described in prior literature. The sustained use of EMs may be related to increasing cultural acceptance of EMs, as reflected in survey result trends and broader cognitive aid literature.

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

Introduction

Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation.

Methods

Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized.

Results

Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%).

Conclusion

TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice.

"Now is the time for institutions to be investing in growing exercise programs as part of standard of care": a multiple case study examining the implementation of exercise oncology interventions

BACKGROUND

Implementation science seeks to systematically identify determinants, strategies, and outcomes within a causal pathway to help explain successful implementation. This process is applied to evidence-based interventions (EBIs) to improve their adoption, implementation, and sustainment. However, this method has not been applied to exercise oncology services, meaning we lack knowledge about implementing exercise EBIs in routine practice. This study aimed to develop causal pathways from the determinants, strategies (including mechanism of change), and implementation outcomes to explain exercise EBIs implementation in routine cancer care.

METHODS

A multiple-case study was conducted across three healthcare sites in Australia. Sites selected had implemented exercise within routine care for people diagnosed with cancer and sustained the delivery of services for at least 12 months. Four data sources informed the study: semi-structured interviews with staff, document reviews, observations, and the Program Sustainability Assessment Tool (survey). Framework analysis was applied to understand the findings. The Implementation Research Logic Model was used to identify commonalities in implementation across sites and develop causal pathways.

RESULTS

Two hundred and eighteen data points informed our findings. Across sites, 18 determinants and 22 implementation strategies were consistent. Sixteen determinants and 24 implementation strategies differed across sites and results of implementation outcomes varied. We identified 11 common pathways that when combined, help explain implementation processes. The mechanisms of implementation strategies operating within the pathways included (1) knowledge, (2) skills, (3) secure resources, (4) optimism, and (5) simplified decision-making processes associated with exercise; (6) relationships (social and professional) and support for the workforce; (7) reinforcing positive outcomes; (8) capability to action plan through evaluations and (9) interactive learning; (10) aligned goals between the organisation and the EBI; and (11) consumer-responsiveness.

CONCLUSION

This study developed causal pathways that explain the how and why of successful implementation of exercise EBIs in cancer care. These findings can support future planning and optimisation activities by creating more opportunities for people with cancer to access evidence-based exercise oncology services.

IMPLICATIONS FOR CANCER SURVIVORS

Understanding how to implement exercise within routine cancer care successfully is important so cancer survivors can experience the benefits of exercise.

Positive attitudes toward adoption of a multi-component intervention strategy aimed at improving HIV outcomes among adolescents and young people in Nampula, Mozambique: perspectives of HIV care providers

BACKGROUND

Service providers' attitudes toward interventions are essential for adopting and implementing novel interventions into healthcare settings, but evidence of evaluations in the HIV context is still limited. This study is part of the CombinADO cluster randomized trial (ClinicalTrials.gov NCT04930367), which is investigating the effectiveness of a multi-component intervention package (CombinADO strategy) aimed at improving HIV outcomes among adolescents and young adults living with HIV (AYAHIV) in Mozambique. In this paper we present findings on key stakeholder attitudes toward adopting study interventions into local health services.

METHODS

Between September and December 2021, we conducted a cross-sectional survey with a purposive sample of 59 key stakeholders providing and overseeing HIV care among AYAHIV in 12 health facilities participating in the CombinADO trial, who completed a 9-item scale on attitudes towards adopting the trial intervention packages in health facilities. Data were collected in the pre-implementation phase of the study and included individual stakeholder and facility-level characteristics. We used generalized linear regression to examine the associations of stakeholder attitude scores with stakeholder and facility-level characteristics.

RESULTS

Overall, service-providing stakeholders within this setting reported positive attitudes regarding adopting intervention packages across study clinic sites; the overall mean total attitude score was 35.0 ([SD] = 2.59, Range = [30-41]). The study package assessed (control or intervention condition) and the number of healthcare workers delivering ART care in participating clinics were the only significant explanatory variables to predict higher attitude scores among stakeholders (β = 1.57, 95% CI = 0.34-2.80, p = 0.01 and β = 1.57, 95% CI = 0.06-3.08, p = 0.04 respectively).

CONCLUSIONS

This study found positive attitudes toward adopting the multi-component CombinADO study interventions among HIV care providers for AYAHIV in Nampula, Mozambique. Our findings suggest that adequate training and human resource availability may be important in promoting the adoption of novel multi-component interventions in healthcare services by influencing healthcare provider attitudes.

Aligning Organizational Priorities and System Policies to Support Implementation Scale-Up of a Tailored Classroom-Based Physical Activity Intervention in Low-Resource Schools

BACKGROUND

A mismatch between organizational priorities and system-level policies can negatively impact implementation and sustainment of classroom-based physical activity (PA) interventions. The purpose of this study was twofold: (1) present methods to systematically identify organization- and system-level implementation barriers, and (2) align organizational priorities and system policies by designing multi-level implementation strategies. This alignment will support implementation scale-up of a tailored PA intervention in one low-resource intermediate school district (ISD; 16 districts, 32 schools) in central Michigan.

METHODS

Multi-level assessments of organizational readiness were conducted using the Hexagon Discussion and Analysis Tool to assess intervention-context fit, the Wellness School Assessment Tool 3.0 to evaluate district PA policy strength and comprehensiveness, and semi-structured interviews were conducted to assess administrative support and priorities related to PA programming.

RESULTS

Our assessments revealed three implementation barriers: limited structural capacity to sustain teacher training, limited resources across districts and school buildings to support teachers, and misalignment of ISD and district PA policies and priorities.

CONCLUSIONS

Greater attention to organizational capacity and existing infrastructure should be considered a priori to support effective implementation and sustainment of PA interventions in low-resource schools.

Veterans Health Administration TeleSleep Enterprise-Wide Initiative 2017-2020: bringing sleep care to our nation's veterans

STUDY OBJECTIVES

The Veterans Health Administration cares for many veterans with sleep disorders who live in rural areas. The Veterans Health Administration's Office of Rural Health funded the TeleSleep Enterprise-Wide Initiative (EWI) to improve access to sleep care for rural veterans through creation of national telehealth networks.

METHODS

The TeleSleep EWI consists of (1) virtual synchronous care, (2) home sleep apnea testing, and (3) REVAMP (Remote Veterans Apnea Management Platform), a patient- and provider-facing web application that enabled veterans to actively engage with their sleep care and sleep care team. The TeleSleep EWI was designed as a hub-and-spoke model, where larger sites with established sleep centers care for smaller, rural sites with a shortage of providers. Structured formative evaluation for the TeleSleep EWI is supported by the Veterans Health Administration's Quality Enhancement Research Initiative and was critical in assessing outcomes and effectiveness of the program.

RESULTS

The TeleSleep EWI launched with 7 hubs and 34 spokes (2017) and rapidly expanded to 13 hubs and 63 spokes (2020). The TeleSleep EWI resulted in a significant increase in rural veterans accessing sleep care by utilizing home sleep apnea testing to establish a diagnosis of obstructive sleep apnea and virtual care for follow-up. Rates of virtual care utilization were greater in hubs and spokes participating in the TeleSleep EWI compared with non-EWI sleep programs. Additionally, veterans expressed satisfaction with their virtual care TeleSleep experiences.

CONCLUSIONS

The TeleSleep EWI successfully increased sleep care access for rural veterans, promoted adoption of virtual care services, and resulted in high patient satisfaction.

CITATION

Chun VS, Whooley MA, Williams K, et al. Veterans Health Administration TeleSleep Enterprise-Wide Initiative 2017-2020: bringing sleep care to our nation's veterans. J Clin Sleep Med. 2023;19(5):913-923.

Developing a sustainability readiness strategy for health systems: Toolkit, interactive tools, and virtual support system

While the literature strongly supports the need for sustainability of evidence-based interventions (EBIs), we present a review of the literature that indicates only three articles discuss a health-focused sustainability strategy. The aims of our sustainability readiness strategy (SRS) are to increase infrastructure capacity and EBI advocacy to impact the level of sustainability readiness. In this article, we describe the development of an evidence-informed promising practice sustainability readiness strategy (SRS) with three evidence-based components. This strategy: 1) is based on an adaptation of the Getting To Outcomes® (GTO) evidence-based implementation process, 2) includes a logic model with documented evidence of the connection between targeted readiness factors and sustainability outcomes, and 3) describes resources considered necessary to support implementation of the readiness strategy, namely a step-by-step Toolkit, Excel™ Tools, webinar coaching and evaluation guides, and a coaching and evaluation training guide. The national SRS survey results are presented. Lessons learned and future dissemination and implementation plans are described.

Effectiveness and implementation of an electronic health record-integrated digital health intervention for managing depressive symptoms in ambulatory oncology: The My Well-Being Guide study rationale and protocol

BACKGROUND

Rates of clinically elevated depressive symptoms among ambulatory oncology patients are higher than in the general population and are associated with poorer health-related quality of life. Furthermore, a reduction in depressive symptoms may be associated with improved cancer survival. Several interventions have demonstrated efficacy in reducing oncologic depressive symptoms, including cognitive-behavioral stress management (CBSM). However, more work is needed to understand how to best implement CBSM into practice, such as through stepped-care approaches and digital health interventions linked to electronic health records (EHR). This manuscript presents the protocol of the My Well-Being Guide study, a pragmatic type 1 effectiveness-implementation hybrid study. This trial will test the effectiveness of My Well-Being Guide, a seven-week structured, CBSM-based digital health intervention designed to reduce depressive symptoms. This trial will also evaluate My Well-Being Guide's implementation across two health systems.

METHODS

The final sample (N = 4561) will be oncology patients at Northwestern Medicine or University of Miami Health System who are ≥18 years of age; have a cancer diagnosis; elevated depressive symptoms on the Patient-Reported Outcomes Measurement Information System Depression; and primary language is English or Spanish. Data collection will occur at baseline, and 2-, 6-, and 12-months post baseline. Outcome domains include depressive symptoms and implementation evaluation.

DISCUSSION

This study may provide valuable data on the effectiveness of our depressive symptom management digital health intervention linked to the EHR and the scalability of digital health interventions in general.

A conceptual model for building program sustainability in public health settings: Learning from the implementation of the program sustainability action planning model and training curricula

Background

The emergence of implementation science has driven an increase in research examining the implementation of evidence-based programs and policies. However, there has been less attention through program sustainability. To achieve the full benefit of investment in program development and implementation, there must be an understanding of the factors that relate to sustainability; additionally, there is a need for a robust set of tools and trainings to support strategic long-term program sustainability. This paper presents results of our sustainability training intervention and a new conceptual model of sustainability. The proposed conceptual model builds upon the intervention design, further specifying the implementation strategy, strategy-mechanism linkages, and effect modifiers.

Methods

This research is part of the larger randomized control trial evaluating the effectiveness of the Program Sustainability Action Planning Model and Training Curricula. Specifically, this multimethod study establishes a conceptual model for program sustainability and related capacity-building interventions. The training intervention was delivered through workshops and technical assistance to 11 state tobacco control programs, principally entailing the development and implementation of a sustainability action plan. We utilize descriptive statistics and participant perspectives to evaluate the training intervention and propose an empirically-grounded conceptual model for sustainability capacity-building interventions in public health settings.

Results

Participants found intervention components (workshop, workbook, instructor and resources) to be effective. Overall, participants found the intervention improved their ability to develop sustainability action plans and assess their program and partners. Throughout the study, program managers emphasized the importance of the workshop in providing direction for their sustainability work and the value of robust, ongoing technical assistance. Program managers identified several factors that interfered with intervention reception including staff turnover, competing priorities, partnership challenges, and the COVID-19 pandemic.

Conclusion

The present study documents the development and implementation of a novel Program Sustainability Action Planning Model and Training Curricula, one of the first interventions designed to improve program sustainability. In addition, we present an empirically-grounded conceptual model for program sustainability. Considering the paucity of research in this understudied and undefined topic area, this is an important contribution that can serve as a framework for similar intervention designs and implementation efforts. Clinical Trail Registration: ClinicalTrails.gov identification number is NCT03598114.

Dissemination, Implementation, and Evaluation of an Effective School-Based Intervention to Promote Physical Activity in Adolescents: A Study Protocol

Adolescents around the world do not engage in sufficient physical activity and the Spanish context is no exception. Understanding the educational context as a complex system, school-based multi-level and multi-component interventions seem to be an effective strategy to reverse this trend. Moreover, a co-creational approach seems to facilitate the mobilization of community partnerships and the engagement of stakeholders in the intervention process. This study aims to describe the dissemination, implementation, and evaluation process of an effective school-based intervention program in another setting using the replicating effective programs framework and a co-participatory approach. This study will be conducted in two Spanish secondary schools located in the region of Aragon (experimental vs. control school) in a sample of adolescents in the second grade (13–14 years old). To evaluate the effectiveness, different health behaviors such as physical activity, sleep, sedentary time with screens, nutrition, and psychosocial variables will be quantitatively measured at baseline and after the implementation of the intervention. Qualitative methods will also be used to better understand the implementation process and the co-creation approach, as well as to provide insights into the sustainability of the intervention program. The current study has the potential to provide strong information about the dissemination, implementation, and evaluation process of school-based programs to promote healthy behaviors among adolescents.

Translating knowledge into action for child obesity treatment in partnership with Parks and Recreation: study protocol for a hybrid type II trial

BACKGROUND

Safe and effective treatment exists for childhood obesity, but treatment recommendations have largely not been translated into practice, particularly among racial and ethnic minorities and low-wealth populations. A key gap is meeting the recommended treatment of ≥26 h of lifestyle modification over 6-12 months. Fit Together is an effective treatment model that meets these recommendations by integrating healthcare and community resources. Pediatric providers screen children for obesity, deliver counseling, and treat co-morbidities, while Parks and Recreation partners provide recreation space for a community nutrition and physical activity program.

METHODS

This study will use a hybrid type II implementation-effectiveness design to evaluate the effectiveness of an online implementation platform (the Playbook) for delivering Fit Together. Clinical and community partners in two North Carolina communities will implement Fit Together, using the Playbook, an implementation package designed to facilitate new partnerships, guide training activities, and provide curricular materials needed to implement Fit Together. An interrupted time series design anchored in the Process Redesign Framework will be used to evaluate implementation and effectiveness outcomes in intervention sites. Implementation measures include semi-structured interviews with partners, before and after the implementation of Fit Together, and quantitative measures assessing several constructs within the Process Redesign Framework. The participants will be children 6-11 years old with obesity and their families (n=400). Effectiveness outcomes include a change in child body mass index and physical activity from baseline to 6 and 12 months, as compared with children receiving usual care. Findings will be used to inform the design of a dissemination strategy guided by the PCORI Dissemination Framework.

DISCUSSION

This project addresses the knowledge-to-action gap by developing evidence-based implementation tools that allow clinicians and communities to deliver effective pediatric obesity treatment recommendations. Future dissemination of these tools will allow more children who have obesity and their families to have access to effective, evidence-based care in diverse communities.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT05455190 . Registered on 13 July 2022.

Implementation of physical activity interventions in a community-based youth mental healthcare service: A case study of context, strategies, and outcomes

AIMS

Physical activity interventions are recommended for community-based youth mental health services to prevent physical health disparities. Implementation is challenging, and studies focusing on the methods to achieve change are needed. This study aims to identify the context, implementation strategies, and implementation outcomes that illustrate how physical activity interventions were implemented within an early intervention service in Australia.

METHODS

A theoretically informed case study was undertaken. Data from a community-based youth mental health service that delivers an early psychosis programme were collected between July and November 2020. Three data sources were accessed (1) interviews with service managers, mental health clinicians and exercise physiologists; (2) document review of organizational policies and procedures; and (3) survey using the Program Sustainability Assessment Tool. The implementation outcomes investigated were acceptability, fidelity, penetration, and sustainability. Framework analysis was used, and a logic model developed guided by an established template, to interpret findings.

RESULTS

Forty-three contextual factors and 43 implementation strategies were identified. The data suggests that creating a new clinical team and auditing and feedback are critical for implementation. High levels of acceptability and sustainability were described, while fidelity of implementation was difficult to establish, and penetration was low.

CONCLUSIONS

The relationship between constructs suggests several mechanisms underpinned implementation. These include changing professional beliefs, establishing new organizational norms, augmenting existing work processes, and aligning physical activity with priorities of the mental healthcare system and existing work tasks. This case study provides direction for future health service planning of physical activity interventions in community-based youth mental health service.

Sustainment of diverse evidence-informed practices disseminated in the Veterans Health Administration (VHA): initial development and piloting of a pragmatic survey tool

BACKGROUND

There are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors "Shark Tank" competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices.

METHODS

In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses.

RESULTS

A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1-4.

CONCLUSIONS

The initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field.

Planning for implementation and sustainability of a community-based suicide surveillance system in a Native American community

BACKGROUND

Native American youth, primarily living on reservations, suffer the highest burden of suicide of any racial group in the USA. Implementation and sustainability of culturally grounded, evidence-based interventions are needed to address suicide in Native American populations. For nearly 40 years, Montana has ranked at or near the top nationwide for suicide. Fort Peck Tribal leadership declared a state of emergency in 2010 after six suicides and 20 attempts that occurred over a 5-month period.

METHODS

We used a community-based participatory research approach for adapting the Celebrating Life (CL) program with a specific focus on long-term sustainability, which has demonstrated efficacy in addressing suicide with the White Mountain Apache. The aims were to (1) adapt the CL program intake forms through roundtable discussions, (2) conduct asset and resource mapping to identify community and cultural resources to leverage for the CL program within the Fort Peck context, and (3) develop a sustainability plan for CL in Fort Peck through qualitative approaches informed by the Program Sustainability Assessment Tool.

RESULTS

Roundtable discussions resulted in adapted intake forms that capture variables relevant to the Fort Peck context. Asset mapping identified 13 community assets and 10 cultural resources to incorporate within the CL implementation process. Focus group discussions yielded four key themes that were incorporated into a plan for sustainability: (1) strategic partnerships, (2) long-term funding, (3) communication planning, and (4) workforce planning and engagement.

CONCLUSIONS

This paper outlines an avenue for using culturally adapted tools to design an implementation system driven by community and cultural assets within tribal communities and for integrating program planning for sustainability early in the implementation process.

Developing a knowledge translation program for health practitioners: Allied Health Translating Research into Practice

Background

Front-line health practitioners lack confidence in knowledge translation, yet they are often required to undertake projects to bridge the knowledge-practice gap. There are few initiatives focused on building the capacity of the health practitioner workforce to undertake knowledge translation, with most programs focusing on developing the skills of researchers. This paper reports the development and evaluation of a knowledge translation capacity building program for allied health practitioners located over geographically dispersed locations in Queensland, Australia.

Methods

Allied Health Translating Research into Practice (AH-TRIP) was developed over five years with consideration of theory, research evidence and local needs assessment. AH-TRIP includes five components: training and education; support and networks (including champions and mentoring); showcase and recognition; TRIP projects and implementation; evaluation. The RE-AIM framework (Reach, Effectiveness, Adoption, Implementation Maintenance) guided the evaluation plan, with this paper reporting on the reach (number, discipline, geographical location), adoption by health services, and participant satisfaction between 2019 and 2021.

Results

A total of 986 allied health practitioners participated in at least one component of AH-TRIP, with a quarter of participants located in regional areas of Queensland. Online training materials received an average of 944 unique page views each month. A total of 148 allied health practitioners have received mentoring to undertake their project, including a range of allied health disciplines and clinical areas. Very high satisfaction was reported by those receiving mentoring and attending the annual showcase event. Nine of sixteen public hospital and health service districts have adopted AH-TRIP.

Conclusion

AH-TRIP is a low-cost knowledge translation capacity building initiative which can be delivered at scale to support allied health practitioners across geographically dispersed locations. Higher adoption in metropolitan areas suggests that further investment and targeted strategies are needed to reach health practitioners working in regional areas. Future evaluation should focus on exploring the impact on individual participants and the health service.

Evaluation of measures of sustainability and sustainability determinants for use in community, public health, and clinical settings: a systematic review

BACKGROUND

Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings.

METHODS

Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed.

RESULTS

A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants.

CONCLUSIONS

This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field.

TRIAL REGISTRATION

This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.

Understanding How Newly Implemented Rehabilitation Best Practices Are Sustained: A Realist Review

OBJECTIVE

We conducted a realist review to understand how (mechanism) and in what circumstances (context) evidence-based practices are sustained in rehabilitation (outcome).

DATA SOURCES

MEDLINE, Embase, reference lists, and targeted websites.

STUDY SELECTION

Two independent reviewers calibrated study selection; then 1 reviewer screened all titles and abstracts, while the second reviewer screened a random 20%. We repeated this process for full texts. We included 115 documents representing 61 implementation projects (8.9% of identified documents). Included documents described implementation projects in which physical therapists, occupational therapists, and/or speech-language pathologists were the target users of an evidence-based practice.

DATA EXTRACTION

Two reviewers repeated the independent process described in study selection to extract basic study and sustainability characteristics as well as context, mechanism, outcome, and strategy text.

DATA SYNTHESIS

Using basic numerical analyses, we found that only 54% of evidence-based practices in rehabilitation are sustained. Furthermore, while authors who reported sustainability planning sustained the practice 94% of the time, sustainability planning in rehabilitation is rare (only reported 26% of the time). Extracted text was synthesized using the realist technique of inductive and deductive retroduction in which context, mechanism, outcome, and strategy text are combined into narrative explanations of how sustainability works. To inform these explanations, we applied normalization process theory and the theory of planned behavior. Collectively, the 52 identified narratives provide evidence for 3 patterns: (1) implementation and sustainability phases are interconnected, (2) continued use of the evidence-based practice can be interpreted as the ultimate sustainability outcome, and (3) intermediate sustainability outcomes (ie, fit/alignment, financial support, benefits, expertise) can become contextual features influencing other sustainability outcomes.

CONCLUSIONS

Implementation teams can use the narrative explanations generated in this review to optimize sustainability planning. This can sustain practice changes and improve quality of care and patient outcomes. Future research should seek to iteratively refine the proposed narrative explanations.

Assessing the sustainability capacity of evidence-based programs in community and health settings

Background

Within many public health settings, there remain large challenges to sustaining evidence-based practices. The Program Sustainability Assessment Tool has been developed and validated to measure sustainability capacity of public health, social service, and educational programs. This paper describes how this tool was utilized between January 2014 and January 2019. We describe characteristics of programs that are associated with increased capacity for sustainability and ultimately describe the utility of the PSAT in sustainability research and practice.

Methods

The PSAT is comprised of 8 subscales, measuring sustainability capacity in eight distinct conceptual domains. Each subscale is made up of five items, all assessed on a 7-point Likert scale. Data were obtained from persons who used the PSAT on the online website (https://sustaintool.org/), from 2014 to 2019. In addition to the PSAT scale, participants were asked about four program-level characteristics. The resulting dataset includes 5,706 individual assessments reporting on 2,892 programs.

Results

The mean overall PSAT score was 4.73, with the lowest and highest scoring subscales being funding stability and program adaptation, respectively. Internal consistency for each subscale was excellent (average Cronbach's alpha = 0.90, ranging from 0.85 to 0.94). Confirmatory factor analysis highlighted good to excellent fit of the PSAT measurement model (eight distinct conceptual domains) to the observed data, with a comparative fit index of 0.902, root mean square error of approximation equal to 0.054, and standardized root mean square residual of 0.054. Overall sustainability capacity was significantly related to program size (F = 25.6; p < 0.001). Specifically, smaller programs (with staff sizes of ten or below) consistently reported lower program sustainability capacity. Capacity was not associated with program age and did not vary significantly by program level.

Discussion

The PSAT maintained its excellent reliability when tested with a large and diverse sample over time. Initial criterion validity was explored through the assessment of program characteristics, including program type and program size. The data collected reinforces the ability of the PSAT to assess sustainability capacity for a wide variety of public health and social programs.

Factors contributing to the sustained implementation of an early childhood obesity prevention intervention: The INFANT Program

Background

The INFANT Program is an efficacious, group-based program for first-time parents, delivered at three-monthly intervals when INFANT are aged 3-18 months through an existing universal care service in Victoria, Australia. Many lessons have been learnt from its origins as a cluster randomized control trial to its small-scale, community-level implementation. This study aimed to describe factors contributing to its sustained implementation to inform large-scale implementation across Australia.

Methods

This study used a multi-site qualitative exploratory approach. INFANT facilitators trained between 2013 and 2017 were sent an online survey, with optional telephone interviews. The Consolidated Framework for Implementation Research (CFIR) was selected as the underpinning theoretical framework as it offered the opportunity to explore a breadth of possible barriers and enablers across patterns of implementation (never, discontinued, ongoing).

Results

All participants were female (n = 31), the majority were Maternal and Child Health Nurses (48%), representing five regional and nine metro local government areas (LGAs), across all patterns of implementation (never implemented n = 4; discontinued implementation n = 5; ongoing implementation n = 5). All consenting participants were interviewed (n = 11) representing four regional and seven metro LGAs, across all patterns of implementation (never implemented n = 3; discontinued implementation n = 4; ongoing implementation n = 4). The main reason for attending INFANT Program training was to become skilled to implement the program. Mapping identified barriers and enablers to the CFIR revealed the inner and outer settings and implementation process to be of greatest influence. Main differences between LGAs with ongoing and discontinued implementation related to funding availability, organizational management support and endorsement, organizational resourcing and capacity, integration into routine practice and establishing role clarity with partner organizations, and planning for sustained implementation from the start.

Conclusion

This study provides important insights into the barriers and enablers to the sustained implementation of an evidence-based intervention (the INFANT Program) during small scale community-level implementation. The authors therefore contend that the pre-requisite for scale-up of a population health intervention is not just proof of effectiveness but also proof of sustained implementation at the local/organizational level. Study findings have broad transferability given their similarity to those identified for health promotion interventions implemented globally, in healthcare, education and community settings.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America

BACKGROUND

Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America.

METHODS

Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact.

RESULTS

From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care.

CONCLUSIONS

Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes.

LAY SUMMARY

Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Sustainability in pediatric hospitals: An exploration at the intersection of quality improvement and implementation science

Background

Although new evidence-based practices are frequently implemented in clinical settings, many are not sustained, limiting the intended impact. Within implementation science, there is a gap in understanding sustainability. Pediatric healthcare settings have a robust history of quality improvement (QI), which includes a focus on continuation of change efforts. QI capability and sustainability capacity, therefore, serve as a useful concept for connecting the broader fields of QI and implementation science to provide insights on improving care. This study addresses these gaps in understanding of sustainability in pediatric settings and its relationship to QI.

Methods

This is a cross-sectional observational study conducted within pediatric academic medical centers in the United States. Clinicians surveyed worked with one of three evidence-based clinical programs: perioperative antimicrobial stewardship prescribing, early mobility in the intensive care unit, and massive blood transfusion administration. Participants completed two assessments: (1) the Clinical Sustainability Assessment Tool (CSAT) and (2) a 19-question assessment that included demographics and validation questions, specifically a subset of questions from the Change Process Capability Questionnaire, a QI scale. Initial descriptive and bivariate analyses were conducted prior to building mixed-effects models relating perceived QI to clinical sustainability capacity.

Results

A total of 181 individuals from three different programs and 30 sites were included in the final analyses. QI capability scores were assessed as a single construct (5-point Likert scale), with an average response of 4.16 (higher scores indicate greater QI capability). The overall CSAT score (7-point Likert scale) was the highest for massive transfusion programs (5.51, SD = 0.91), followed by early mobility (5.25, SD = 0.92) and perioperative antibiotic prescribing (4.91, SD = 1.07). Mixed-effects modeling illustrated that after controlling for person and setting level variables, higher perceptions of QI capabilities were significantly related to overall clinical sustainability.

Conclusion

Organizations and programs with higher QI capabilities had a higher sustainability capacity, even when controlling for differences at the individual and intervention levels. Organizational factors that enable evidence-based interventions should be further studied, especially as they relate to sustainability. Issues to be considered by practitioners when planning for sustainability include bedside provider perceptions, intervention achievability, frequency of delivery, and organizational influences.

Predictors of sustainment of two distinct nutrition and physical activity programs in early care and education

Introduction

The goal of the present study was to investigate factors associated with sustainment of two evidence-based programs for nutrition promotion in early care and education (ECE) settings - Food Friends (FF) and Together, We Inspire Smart Eating (WISE).

Materials and methods

In a cross-sectional study design, ECE directors (N = 55) from centers that had previously been trained in WISE or FF completed a survey. Program-specific measures included Steckler's Perception of Innovations, the Program Sustainability Assessment Tool (PSAT), and the Organizational Readiness for Change Assessment (ORCA). For our primary outcomes, two measures of sustainment were examined: Nutrition Continued Practice (i.e., the use of or general focus on nutrition programs) and Program Fidelity (i.e., how well centers used specific evidence-based practices of WISE or FF). Multiple regression was used to determine the association of these outcomes with program, years since last implementation, and overall scores on predictors. Follow-up correlation analyses were used to investigate outcome relationships with context submeasures due to high intercorrelations between predictor submeasures.

Results

Nutrition Continued Practice was significantly predicted by program and overall PSAT score. WISE programs had significantly higher Nutrition Continued Practice scores than FF program (p = 0.03). All subscales of the PSAT (e.g., environmental support, funding stability, organizational capacity, program adaptation, communications, and strategic planning) were significantly correlated with Nutrition Continued Practice (all rs > 0.30, all ps < 0.03). Program Fidelity was significantly predicted by PSAT and Steckler Perception of Innovation scores. All subscales of the PSAT were strongly positively correlated with Program Fidelity (all rs > 0.48, all ps < 0.001); relative advantage (r = 0.54, p < 0.001) and level of institutionalization (r = 0.61, p < 0.001) were positively correlated with Program Fidelity.

Conclusion

This study suggests that factors associated with the continued practice of program principles are partially distinct from those that are associated with the sustainment of specific practices driving program fidelity. Results suggest capacity building strategies may be important for both continued attention to nutrition and physical activity as well as sustaining fidelity to specific evidence-based practices.

Core functions and forms of Bright IDEAS: A multi-methods evaluation of the adoption of an evidence-based psychosocial training program through iterative adaptation

Background

Despite efforts to widely disseminate interventions designed to increase access to quality supportive care to pediatric cancer patients and their families, many of these interventions fail to meet expectations once deployed in real-life clinical settings. This study identifies the functions and forms of Bright IDEAS: Problem-Solving Skills Training, an evidence based psychosocial intervention for caregivers of children recently diagnosed with cancer, to identify pragmatic program adaptations in its real-world clinical implementation. We compare intervention adoption before and after adaptations to the Bright IDEAS training program as part of a national training program designed to disseminate the intervention.

Methods

209 pediatric psychosocial oncology practitioners representing 134 unique institutions were trained during 10 in-person 8-hour workshops (2015-2019). Functions and forms of Bright IDEAS were identified, and adaptations made to the training agenda and curriculum based on practitioner feedback following implementation in local institutions. Mixed method evaluation included longitudinal surveys at 6- and 12-months post training; and qualitative interviews among a subgroup of practitioners (N = 47) to understand and compare perspectives on intervention adoption and barriers to implementation before and after adaptations to the Bright IDEAS training program. The RE-AIM framework was used to guide dissemination evaluation.

Results

A total of four adaptations were tailored to the identified forms of the intervention: case studies; pre-training reading materials; training videos; and letters of institutional support from primary supervisor. Pre- and post-training adaptations to the Bright IDEAS training program were mapped to RE-AIM constructs. Quantitative findings demonstrate that adaptations appeared to improve adoption and usage overall.

Conclusion

This study provides insight into how contextual factors influence psychosocial practitioners' capacity to adopt, implement, and maintain Bright IDEAS in the clinical setting. This study demonstrates the use of real-time stakeholder feedback to guide intervention translation from research to practice settings.

Implementation of a psychological online intervention for low to moderate depression in primary care: study protocol

BACKGROUND

Depression affects millions of people all over the world and implies a great socioeconomic burden. Despite there are different effective evidence-based interventions for treating depression, only a small proportion of these patients receives an appropriate treatment. In this regard, information and communication technologies (ICTs) can be used with therapeutic aims and this can contribute to make interventions more accessible. One example is "Smiling is fun", an internet-based treatment which has proved to be effective and cost-effective for treating depression in Spanish Primary Care (PC). However, the "know-do gap" between research and clinical settings implies that the actual implementation of such interventions could last up to 20 years. To overcome this obstacle, the implementation research establishes the methodology to implement the advances developed in the laboratories to the health care services maintaining the validity of the intervention and offering specific strategies for the implementation process.

OBJECTIVE

This is the protocol of an implementation study for the Internet-based program "Smiling is fun", which will be conducted on patients with mild-to-moderate depression of Spanish PC settings. In the implementation study, the feasibility, efficacy, cost-efficacy, acceptability, adoption, appropriateness, fidelity, penetration, normalization, and sustainability will be assessed.

METHODS

The current investigation is a Hybrid Effectiveness-Implementation Type II design. A Stepped Wedge randomized controlled trial design will be used, with a cohort of 420 adults diagnosed with depression (mild-to-moderate) who will undergo a first control phase (no treatment) followed by the intervention, which will last 16 weeks, and finishing with an optional use of the intervention. All patients will be assessed at baseline, during the treatment, and at post-treatment. The study will be conducted in three Spanish regions: Andalusia, Aragon, and the Balearic Islands. Two primary care centers of each region will participate, one located in the urban setting and the other in the rural setting. The primary outcome will be implementation success of the intervention assessing the reach, clinical effect, acceptability, appropriateness, adoption, feasibility, fidelity, penetration, implementation costs and sustainability services.

DISCUSSION

"Smiling is Fun", which has already been established as effective and cost-effective, will be adapted according to users' experiences and opinions, and the efficacy and cost-efficacy of the program will again be assessed. The study will point out barriers and facilitators to consider in the implementation process of internet-based psychological interventions in health services. The ultimate goal is to break the research-to-practice split, which would undoubtedly contribute to reduce the high burden of depression in our society.

TRIAL REGISTRATION

ClinicalTrials.gov, Identifier: NCT05294614.

Results from an effectiveness-implementation evaluation of a postpartum depression prevention intervention delivered in home visiting programs

BACKGROUND

Building on growing research examining lay health professionals delivering postpartum depression preventive interventions, we conducted a hybrid effectiveness-implementation Type 2 trial to examine implementation metrics and determine whether pregnant women receiving Mothers and Babies 1-on-1 delivered by lay home visitors exhibit greater reductions in depressive symptoms and perceived stress than women receiving usual home visiting.

METHODS

1229 (672 control, 557 intervention) pregnant women were enrolled, with intervention participants receiving Mothers and Babies 1-on-1 delivered by a lay home visitor and control participants receiving usual home visiting services. Baseline and six-month follow-up assessments measured client mental health outcomes, with management information system data collected to assess intervention dosage. Surveys were administered nine months post-training to agency managers as well as home visitors who delivered any intervention content.

RESULTS

Intent-to-treat analyses indicated a significant reduction in perceived stress among intervention participants compared to controls, while as-treated analyses showed significant reductions in perceived stress and depressive symptoms. Although all study sites adopted the intervention, <50 % of eligible women received the intervention. Over two-thirds of home visitors made at least one fidelity-consistent adaptation, with client recruitment and retention in home visiting highlighted as challenges to delivery.

LIMITATIONS

Unmeasured historical events may have affected study outcomes and caution should be used generalizing to perinatal women from different racial/ethnic groups and home visiting models.

CONCLUSION

Mothers and Babies 1-on-1 delivered by lay home visitors leads to reductions in perceived stress and depressive symptoms, suggesting task shifting to non-mental health professionals is viable when appropriate training and supervision is provided.

Perspectives of healthcare providers on implementation of long-acting cabotegravir plus rilpivirine in US healthcare settings from a Hybrid III Implementation-effectiveness study (CUSTOMIZE)

INTRODUCTION

CUSTOMIZE evaluated the implementation of long-acting (LA) cabotegravir + rilpivirine, a novel healthcare provider-administered injectable antiretroviral therapy regimen, in diverse US healthcare settings. Findings from staff-study participants (SSPs) through 12 months of implementation are reported.

METHODS

CUSTOMIZE was a phase IIIb, 12-month, single-arm, hybrid III implementation-effectiveness study conducted from July 2019 to October 2020 at eight US clinics of five clinic types: private practice (n = 2), federally qualified health centre (n = 2), university (n = 2), AIDS Healthcare Foundation (n = 2) and health maintenance organization (n = 1). Eligible patient participants received monthly cabotegravir + rilpivirine LA injections after a 1-month oral lead-in. At baseline, month 4 and month 12, SSPs (n = 3 each per clinic), including physicians, nurses or injectors, and administrators, completed quantitative surveys and semi-structured interviews to assess implementation outcomes (acceptability, appropriateness and feasibility of intervention measures), programme sustainability and SSP perceptions of, attitudes towards, and expectations for cabotegravir + rilpivirine LA. Month 12 data collection occurred during the COVID-19 pandemic.

RESULTS

In surveys, SSPs reported high mean total scores for acceptability, appropriateness and feasibility of cabotegravir + rilpivirine LA implementation at baseline (4.43, 4.52 and 4.38 of 5, respectively) and month 12 (4.45, 4.61 and 4.46 of 5, respectively), regardless of clinic type. At month 12, SSPs were positive about the implementation sustainability (mean Program Sustainability Assessment Tool score, 5.83 out of 7). At baseline, SSPs' top concern was patients' ability to maintain monthly appointments (81%); at month 12, 39% had this concern. The proportion of SSPs reporting patient injection pain or soreness as a barrier was consistent at month 12 versus baseline (48% vs. 46%). Most (78%) SSPs reported optimal implementation of cabotegravir + rilpivirine LA in their clinics was achieved in 1-3 months. In interviews, SSP-reported strategies for successful implementation included teamwork, using a web-based treatment planner and having a designated person to track appointment scheduling. In month 12 interviews, SSP-reported structural changes needed for implementation included changing clinic hours and purchasing refrigerators.

CONCLUSIONS

In CUSTOMIZE, cabotegravir + rilpivirine LA was successfully implemented across a range of US healthcare settings. Barriers were mitigated with minor process adjustments.

Identifying and Exploring Sustainability Determinants of Mental Health Recovery-Oriented Interventions: A Mixed Methods Study Protocol

Mental health recovery is the new paradigm in the mental health service delivery system worldwide. Recovery-oriented services go beyond traditional clinical care that is centered on symptom remission, aiming to help people: restore social connections with other individuals and the community; develop hope and optimism for the future; reconstruct an identity beyond that of a “mental patient”; discover meaning in life; and feel empowered to gain control over treatment (CHIME framework). Over the last ten years, several efforts at implementation of recovery-oriented interventions have been documented in the scientific literature. However, little attention has been given to their sustainability, even though it is reported that not all health interventions can fully sustain their activities beyond the initial implementation phase. The aim of this mixed methods case study is to better understand the factors that determine the sustainability of two recovery-oriented interventions (peer support and recovery training) after their roll-out in four organizations in Canada that provide community housing for adults with mental health challenges. Qualitative and quantitative data will be collected from managers, service providers, and implementation team members that oversaw the implementation process along with organizational documents. Data collection and analysis will be guided by the Consolidated Framework for Sustainability Constructs in Healthcare, the Framework for Reporting Adaptations and Modifications, and the Program Sustainability Assessment Tool. Findings will expand our current evidence base on the intersection of sustainability and mental health recovery interventions that remains under-explored.

Time-efficient physical activity intervention for older adolescents with disability: rationale and study protocol for the Burn 2 Learn adapted (B2La) cluster randomised controlled trial

INTRODUCTION

Physical activity declines during adolescence, with the lowest levels of activity observed among those with disability. Schools are ideal settings to address this issue; however, few school-based interventions have been specifically designed for older adolescents with disability. Our aim is to investigate the effects of a school-based physical activity programme, involving high-intensity interval training (HIIT), on physical, mental and cognitive health in older adolescents with disability.

METHODS AND ANALYSIS

We will evaluate the Burn 2 Learn adapted (B2La) intervention using a two-arm, parallel group, cluster randomised controlled trial with allocation occurring at the school level (treatment or waitlist control). Secondary schools will be recruited in two cohorts from New South Wales, Australia. We will aim to recruit 300 older adolescents (aged 15-19 years) with disability from 30 secondary schools (10 in cohort 1 and 20 in cohort 2). Schools allocated to the intervention group will deliver two HIIT sessions per week during scheduled specialist support classes. The sessions will include foundational aerobic and muscle strengthening exercises tailored to meet student needs. We will provide teachers with training, resources, and support to facilitate the delivery of the B2La programme. Study outcomes will be assessed at baseline, 6 months (primary endpoint), and 9 months. Our primary outcome is functional capacity assessed using the 6 min walk/push test. Secondary outcomes include physical activity, muscular fitness, body composition, cognitive function, quality of life, physical literacy, and on-task behaviour in the classroom. We will also conduct economic and process evaluations to determine cost-effectiveness, programme acceptability, implementation, adaptability, and sustainability in schools.

ETHICS AND DISSEMINATION

This study has received approval from the University of Newcastle (H-2021-0262) and the New South Wales Department of Education (SERAP: 2021257) human research ethics committees. Findings will be published in peer-reviewed journals, and key stakeholders will be provided with a detailed report following the study.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry Number: ACTRN12621000884808.

Evaluating the sustainability of non-communicable diseases programs in Malaysia

BACKGROUND

The substantial rise in non-communicable diseases (NCDs) over the last two decades poses a major concern to the healthcare services in Malaysia. This study aimed to evaluate the sustainability of the current NCDs programs and identify the challenges and factors impeding the sustainability of the NCDs program implemented under the National Strategic Plan.

METHODS

This study applied the mixed-method approach using the Program Sustainability Assessment Tool (PSAT) to assess the eight domains for program sustainability combined with 5 open-ended questions. The survey was administered to key leaders from the district health offices in Malaysia. The mean score for each sustainability domain and the overall mean sustainability score were determined. Descriptive statistics and thematic analysis were conducted using Statistical Package for the Social Sciences (SPSS) version 25 and NVivo version 12, respectively.

RESULTS

A total of 80 key leaders responded to the survey. Overall seven domains scored an average of ≥ 4 with an overall mean sustainability score of 4.2. The highest domain mean scores were 4.5 (communications) and 4.4 (organizational capacity). The lowest mean score domain was 3.8 (funding stability). The open-ended responses revealed challenges faced by department heads, including implementation difficulties, factors impeding the planning of the NCDs program for sustainability, lack of financial resources, lack of human resources, and support for staff training which are largely consistent with the scores of each domain.

CONCLUSION

The sustainability factors affecting the NCDs program in Malaysia are qualitatively similar to other countries. For greater sustainability capacity, we should work towards strong leadership, strengthening funding stability, and incorporating evidence-based public health strategies in the implementation of the NCDs program.

School-level factors associated with the sustainment of weekly physical activity scheduled in Australian elementary schools: an observational study

BACKGROUND

We aimed to: (1) identify school-level factors associated with the sustainment of weekly physical activity (PA) scheduled in elementary schools following withdrawal of effective implementation support; and (2) determine teacher's perceived usefulness of suggested strategies for sustaining the scheduling of weekly PA.

METHODS

A secondary exploratory analysis was employed of data from the intervention arm (n = 31 schools) of a randomised controlled trial. Self-report survey data from 134 classroom teachers in New South Wales, Australia, collected following withdrawal of initial implementation support (follow-up T1) and six-months following completion of support (follow-up T2) were used. The outcomes of sustainment of weekly overall PA and energisers (short classroom PA breaks) scheduled were measured via teachers' completion of a daily activity logbook, with results presented as the difference in mean minutes of PA and energisers scheduled at T1 and T2. An adapted version of the Program Sustainability Assessment Tool (PSAT) was used to measure capacity for program sustainability across seven key domains at follow-up T2. Linear mixed regressions were conducted to evaluate associations between school-level sociodemographic characteristics (e.g., school size, remoteness, and type), teacher-reported school factors (i.e., seven adapted PSAT domains) and the sustainment of PA and energisers scheduled across the school week. Perceived usefulness of 14 proposed sustainability strategies was measured via the teacher survey at follow-up T2 and reported descriptively.

RESULTS

No school-level factor was statistically associated with the sustainment of overall weekly PA or energisers scheduled. Teacher-reported factors in two PSAT domains - 'strategic planning' and 'program evaluation' were statistically negatively associated with the sustainment of weekly energisers scheduled (- 6.74, 95% CI: - 13.02; - 0.47, p = 0.036 and - 6.65, 95% CI: - 12.17; - 1.12, p = 0.019 respectively). The proposed support sustainability strategy - 'provision of PA equipment packs that enable energisers or integrated lessons' was perceived useful by the most teachers (85%).

CONCLUSIONS

Further research is required to explore additional contextual-specific, and end-user appropriate factors associated with schools' sustainment of weekly PA scheduled. This will help accurately inform the development of strategies to address these determinants and support the sustainment and long-term benefits of school-based health interventions more broadly.

What makes for successful patient navigation implementation in cancer prevention and screening programs using an evaluation and sustainability framework

BACKGROUND

Integrating patient navigation into cancer prevention and early detection efforts has been effective in increasing cancer screening rates for the medically underserved. Few publications have focused on how cancer screening interventions in the primary care setting using patient navigation as a primary strategy are implemented, adapted, and sustained. In 2006, the University of Colorado Cancer Center established a statewide colorectal cancer screening program to reduce disparities and improve colorectal cancer (CRC) screening for the medically underserved in partnership with the safety net system. The program, known as the Colorado Cancer Screening Program (CCSP), has provided navigation into preventive screening for more than 35,000 patients.

METHODS

To evaluate sustainability and implementation, the Practical, Robust Implementation and Sustainability Model was used to examine the implementation and impact. To complement this model, the CCSP adapted the Program Sustainability Framework and Clinical Sustainability Framework and Assessment Tools to measure the capacity of participating clinics to sustain the program beyond grant funding.

RESULTS

The domains most frequently targeted for improvement in the sustainability plans were Workflow Integration (8 clinics), Communication, Planning, and Implementation (8 clinics), and Funding Stability (5 clinics). Activities in the implementation plans included revising workflows for efficiencies, incorporating quality improvement strategies, and building a business case for patient navigation.

CONCLUSIONS

Findings from this sustainability planning process provide insight about program outcomes, satisfaction, and illustrate that although funding remains one of the key sustainability questions, many clinic systems have prioritized other specific domains to continue sustainability beyond grant funding.

Collective pursuit for equity in cancer care: The National Navigation Roundtable

BACKGROUND

The evidence continues to build in support of implementing patient navigation to reduce barriers and increase access to care. However, health disparities remain in cancer outcomes. The goal of the National Navigation Roundtable (NNRT) is to serve as a convener to help support the field of navigation to address equity.

METHODS

To examine the progress and opportunities for navigation, the NNRT submitted a collection of articles based on the results from 2 dedicated surveys and contributions from member organizations. The intent was to help inform what we know about patient navigation since the last dedicated examination in this journal 10 years ago.

RESULTS

The online survey of >700 people described navigators and examined sustainability and policy issues and the longevity, specific role and function, and impact of clinical and nonclinical navigators in addition to the role of training and supervision. In addition, a full examination of coronavirus disease 2019 and contributions from member organizations helped further define progress and future opportunities to meet the needs of patients through patient navigation.

CONCLUSIONS

To achieve equity in cancer care will demand the sustained action of virtually every component of the cancer care system. It is the hope and intent of the NNRT that the information presented in this supplement will be a catalyst for action in this collective action approach.

Sustainability capacity of a vegetable gardening intervention for cancer survivors

BACKGROUND

Health behavior interventions, especially those that promote improved diet and physical activity, are increasingly directed toward cancer survivors given their burgeoning numbers and high risk for comorbidity and functional decline. However, for health behavior interventions to achieve maximal public health impact, sustainability at both the individual and organizational levels is crucial. The current study aimed to assess the individual and organizational sustainability of the Harvest for Health mentored vegetable gardening intervention among cancer survivors.

METHODS

Telephone surveys were conducted among 100 cancer survivors (mean age 63 years; primarily breast cancer) completing one-of-two Harvest for Health feasibility trials. Surveys ascertained whether participants continued gardening, and if so, whether they had expanded their gardens. Additionally, surveys were emailed to 23 stakeholders (Cooperative Extension county agents, cancer support group leaders, and healthcare representatives) who were asked to rate the intervention's ability to generate sustained service and produce benefits over time using the eight-domain Program Sustainability Assessment Tool (PSAT).

RESULTS

The survey among cancer survivors (91.9% response rate) indicated that 85.7% continued gardening throughout the 12 months following intervention completion; 47.3% expanded their gardens beyond the space of the original intervention. Moreover, 5.5% of cancer survivors enrolled in the certification program to become Extension Master Gardeners. The survey among stakeholders generated a similar response rate (i.e., 91.3%) and favorable scores. Of the possible maximum of 7 points on the PSAT, the gardening intervention's "Overall Capacity for Sustainability" scored 5.7 (81.4% of the maximum score), with subscales for "Funding Stability" scoring the lowest though still favorably (5.0) and "Program Evaluation" scoring the highest (6.3).

CONCLUSIONS

Data support the sustainability capacity of the Harvest for Health vegetable gardening intervention for cancer survivors. Indeed, few interventions have proven as durable in terms of individual sustainability. Furthermore, Harvest for Health's overall organizational score of 5.7 on the PSAT is considered strong when compared to a previous review of over 250 programs, where the mean overall organizational PSAT score was 4.84. Thus, solutions for long-term funding are currently being explored to support this strong, holistic program that is directed toward this vulnerable and growing population.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02150148.

Construct validation of the Research Engagement Survey Tool (REST)

BACKGROUND

The Research Engagement Survey Tool (REST) was developed to examine the level of partner (e.g., patients, caregivers, advocates, clinicians, community members) engagement in research studies. The REST is aligned with eight engagement principles based on the literature and consensus reached through a five round Delphi process. Each of the engagement principles has three-five corresponding items that are assessed on two Likert type scales quantity (how often: never, rarely, sometimes, often, always, not applicable) and quality (how well: poor, fair, good, very good, excellent, not applicable). We conducted a comprehensive validation of the REST. Despite the importance of partner engagement in research, currently no gold standard measure exists.

METHODS

Multiple strategies were employed to validate the REST. Here, we examine the internal consistency of items for each of the eight engagement principles. In addition, we examine the convergent validity of the comprehensive (32-item) REST with other measures (e.g., medical mistrust, Community Engagement in Research Index, Partnership Self-Assessment Tool, Wilder collaboration inventory, Partnership Assessment In community-based Research). We propose two scoring approaches for the REST; one aligned with the engagement principles and the other aligned with levels of community engagement: (1) outreach and education, (2) consultation, (3) cooperation, (4) collaboration, and (5) partnership.

RESULTS

The REST has strong internal consistency (Cronbach's alpha > 0.75) for each of the eight engagement principals measured on both scales (quality and quantity). The REST had negligible (e.g., medical mistrust, community engagement in research index), low (e.g., Partnership Assessment In community-based Research, Partnership Self-Assessment Tool- benefits scale), and moderate (e.g., Wilder collaboration inventory, Partnership Self-Assessment Tool- synergy scale) statistically significant correlations with other measures based on the Spearman rank correlation coefficient. These results suggest the REST is measuring something similar and correlated to the existing measures, but it captures a different construct (perceived research engagement).

CONCLUSIONS

The REST is a valid and reliable tool to assess research engagement of community health stakeholders in the research process. Valid tools to assess research engagement are necessary to examine the impact of engagement on the scientific process and scientific discovery and move the field of stakeholder engagement from best practices and lessons learned to evidence-based approaches based on empirical data.

FAST: A Framework to Assess Speed of Translation of Health Innovations to Practice and Policy

The 17-year time span between discovery and application of evidence in practice has become a unifying challenge for implementation science and translational science more broadly. Further, global pandemics and social crises demand timely implementation of rapidly accruing evidence to reduce morbidity and mortality. Yet speed remains an understudied metric in implementation science. Prevailing evaluations of implementation lack a temporal aspect, and current approaches have not yielded rapid implementation. In this paper, we address speed as an important conceptual and methodological gap in implementation science. We aim to untangle the complexities of studying implementation speed, offer a framework to assess speed of translation (FAST), and provide guidance to measure speed in evaluating implementation. To facilitate specification and reporting on metrics of speed, we encourage consideration of stakeholder perspectives (e.g., comparison of varying priorities), referents (e.g., speed in attaining outcomes, transitioning between implementation phases), and observation windows (e.g., time from intervention development to first patient treated) in its measurement. The FAST framework identifies factors that may influence speed of implementation and potential effects of implementation speed. We propose a research agenda to advance understanding of the pace of implementation, including identifying accelerators and inhibitors to speed.

How useful is the Making Every Contact Count Healthy Conversation Skills approach for supporting people with musculoskeletal conditions?

Aim

To explore the current use and perceptions of the Wessex model of Making Every Contact Count (MECC), incorporating Healthy Conversation Skills (HCS), focussing specifically on physiotherapists supporting people living with musculoskeletal conditions.

Methods

A mixed method, sequential explanatory design was employed. This article reports the first phase of the study, in which an online questionnaire was administered, consisting of items relating to perceived acceptability, appropriateness, feasibility, sustainability, and uptake of MECC HCS. Barriers and facilitators to MECC HCS delivery were additionally explored and mapped to the Theoretical Domains Framework.

Results

Seventy-one professionals responded, including 15 physiotherapists supporting people with MSK conditions. Across professional groups, MECC HCS was found to be highly acceptable, appropriate, and feasible. A significant interaction between perceived sustainability of MECC HCS and the location in which professionals worked was observed. Physiotherapists reported using their MECC HCS at least daily; however, there were discrepancies between the number of their patients they believed could benefit from behaviour change intervention, and the number to whom they reported actually delivering MECC HCS. Perceived barriers and facilitators to MECC HCS implementation mapped mostly to ‘Environmental Context and Resources’ on the Theoretical Domains Framework.

Conclusions

The Wessex model of MECC is a promising brief or very brief intervention for physiotherapists supporting individuals with musculoskeletal conditions. Barriers associated with the sustainability of the intervention within organisations must be addressed in order to enhance future implementation. Further rollout of this intervention may be beneficial for meeting the goals of the NHS and Public Health England in prevention of chronic MSK conditions and promotion of musculoskeletal health.

Communities Helping the Hearing of Infants by Reaching Parents (CHHIRP) through patient navigation: a hybrid implementation effectiveness stepped wedge trial protocol

INTRODUCTION

As the most common neonatal sensory disorder in the USA, infant hearing loss has an incidence of 1.7 per 1000 births. The consequences of delayed diagnosis and failure to obtain timely intervention include significant communication impairment and negative socioeconomic effects. Early Hearing Detection and Intervention (EHDI) national standards dictate that all infants should be screened and diagnosed by 3 months of age and there is a need for interventions that promote adherence to timely diagnosis. Patient navigation (PN) has been shown to be efficacious to decrease non-adherence with infant hearing diagnostic care; however, PN has yet to be tested in diverse communities or implemented into real-world settings.

METHODS AND ANALYSIS

The proposed research is a community-engaged, type 1 hybrid effectiveness-implementation trial of a PN intervention aimed at decreasing infant hearing diagnosis non-adherence after failed newborn hearing screening, delivered in state-funded EHDI clinics. Guided by our community advisory board and partners, we aim to (1) test the effectiveness of PN to decrease non-adherence to receipt of infant hearing diagnosis within 3 months after birth using a stepped-wedge trial design, (2) investigate implementation outcomes and factors influencing implementation and (3) determine the cost-effectiveness of PN from the perspective of third-party payers. The study will be conducted from April 2019 until March 2024.

ETHICS AND DISSEMINATION

This protocol was approved by the University of Kentucky Institutional Review Board. Although all research involving human subjects contains some risk, there are no known serious risks anticipated from participating in this study. We will seek to disseminate our results in a systematic fashion to patients, key stakeholder, policymakers and the scientific community. Our results will impact the field by partnering with communities to inform the scale-up of this innovative patient supportive intervention to create efficient and effective EHDI programmes and maximise public health impact.

TRIAL REGISTRATION NUMBER

Clinicaltrials.gov (Pre-results phase): NCT03875339.

Harmonizing Implementation and Outcome Data Across HIV Prevention and Care Studies in Resource-Constrained Settings

Harmonizing measures across studies can facilitate comparisons and strengthen the science, but procedures for establishing common data elements are rarely documented. We detail a rigorous, 2-year process to harmonize measures across the Prevention And Treatment through a Comprehensive Care Continuum for HIV-affected Adolescents in Resource Constrained Settings (PATC3H) consortium, consisting of eight federally-funded studies. We created a repository of measured constructs from each study, classified and selected constructs for harmonization, and identified survey instruments. Measures were harmonized for implementation science, HIV prevention and care, demographics and sexual behavior, mental health and substance use, and economic assessment. Importantly, we present our harmonized implementation science constructs. A common set of implementation science constructs have yet to be recommended in the literature for low-to-middle-income countries despite increasing recognition of their importance to delivering and scaling up effective interventions. Drawing on RE-AIM (Reach Effectiveness Adoption Implementation Maintenance) and the Implementation Outcomes Framework, items were harmonized for staff/administrators and study participants to measure reach, adoption, implementation, maintenance, feasibility, acceptability, appropriateness, and fidelity. The process undertaken to harmonize measures and the codified set of implementation science measures developed by our consortium can inform future data harmonization efforts, critical to strengthening the replication and generalizability of findings while facilitating collaborative research-especially in resource-limited settings. We conclude with recommendations for research consortia, namely ensuring representation from all study teams and research priorities; adopting a flexible, transparent, and systematic approach; strengthening the literature on implementation science harmonization; and being responsive to life events (e.g., COVID-19).

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-022-00042-7.

The question of the question: impactful implementation science to address the HIV epidemic

INTRODUCTION

Questions about the implementation of evidence-based intervention to treat and prevent HIV have risen to the top of the field's scientific priorities. Despite the availability of highly efficacious treatment and prevention interventions, impact has fallen short of targets because these interventions are used with insufficient reach, consistency, sustainability and equity in diverse real-world settings. At present, substantial excitement for implementation science - defined as research methods and strategies to improve use of evidence-based interventions - has focused on developing and disseminating methods to conduct rigorous research. Yet, impactful answers depend on a sometimes less visible, but even more important, step: asking good questions about implementation.

DISCUSSION

In this commentary, we offer several considerations for researchers formulating implementation research questions based on several distinctive features of the field. First, as findings are used not only by other researchers but by implementers, scientific questions must incorporate a range of stakeholder and community perspectives to be most relevant. Second, real-world settings are contextually diverse, and the most relevant scientific questions must position answers to make sense within these contexts (whether geographical, organizational and sociological), rather than apart from them. Third, implementation is complex and dynamic; consequently, research questions must make use of emerging standards in describing implementation strategies and their effects whenever possible. Finally, the field of implementation science continues to evolve, so framing problems with a diverse disciplinary lens will enable researchers to pose insightful and impactful questions.

CONCLUSIONS

We are now at a juncture marked by both rich evidence-based interventions and a persistent global pandemic. To achieve continued scientific progress against the HIV epidemic, asking the right questions might be part of the answer itself.

Designing for Dissemination and Sustainability to Promote Equitable Impacts on Health

Designing for dissemination and sustainability (D4DS) refers to principles and methods for enhancing the fit between a health program, policy, or practice and the context in which it is intended to be adopted. In this article we first summarize the historical context of D4DS and justify the need to shift traditional health research and dissemination practices. We present a diverse literature according to a D4DS organizing schema and describe a variety of dissemination products, design processes and outcomes, and approaches to messaging, packaging, and distribution. D4DS design processes include stakeholder engagement, participatory codesign, and context and situation analysis, and leverage methods and frameworks from dissemination and implementation science, marketing and business, communications and visualarts, and systems science. Finally, we present eight recommendations to adopt a D4DS paradigm, reflecting shifts in ways of thinking, skills and approaches, and infrastructure and systems for training and evaluation.

Exploring perceptions of implementation practice capacity in community-based behavioral health organizations

Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.

Implementation of Evidence-Based Disease Self-Management Programs in a Rural Region: Leveraging and Linking Community and Health Care System Assets

CONTEXT

Rural populations experience both a higher prevalence of and risk for premature death from chronic conditions than do their urban counterparts. Yet barriers to implement community-based chronic disease self-management programs persist.

PROGRAM

The Living Well program, a multi-sector collaboration between a rural health care system and a network of community-based organizations, has offered the 6-week evidence-based Chronic Disease Self-Management and Diabetes Self-Management workshops since 2017. The program was a response to a quality improvement initiative to improve hypertension and diabetes outcomes throughout the health care system.

IMPLEMENTATION

Using the rapid cycling quality improvement process, Living Well developed a self-management program recruitment, referral, and coordinating office for a six-county region. Through continuous capacity-building efforts with community partners, as well as leveraging key health care system assets such as the electronic health record and provider detailing, program reach and adoption was increased.

EVALUATION

The Reach, Effectiveness, Adoption, Implementation, and Maintenance framework was used for the process evaluation. During 3 years, more than 750 individuals engaged with the program, with nearly 600 completing a workshop. The region saw increased engagement by primary care clinicians to refer, and structural changes were embedded into the health care system to facilitate clinic-community partnerships.

DISCUSSION

A coordinated, multi-sector approach is necessary to develop solutions to complex, chronic health problems. A regional coordinating hub is an effective strategy for implementing community-based programs in rural areas. However, low health care system engagement and fragmented funding remain as barriers to optimal implementation.

Cultural adaptation of psychological interventions for people with mental disorders delivered by lay health workers in Africa: scoping review and expert consultation

BACKGROUND

Lay Health Workers (LHW) are important providers of community mental health services and help mitigate access and treatment gaps in Africa. However, there is a paucity of knowledge about the role and performance of these workers, as well as about the extent to which the interventions delivered are culturally adapted to the African context.

AIMS

This scoping review aimed to explore the content and aspects concerning the cultural adaptation and sustainability of psychological interventions delivered by LHW to people with mental disorders in Africa.

METHODS

We conducted a scoping review of the peer-reviewed literature published from January 2000 to December 2018 to identify psychological interventions delivered by LHW for people with mental disorders in Africa. We systematically searched PubMed, Google scholar and Hinari to select relevant publications. The articles were evaluated for risk of bias according to study design with the National Heart, Lung, and Blood Institute's (NHLBI) Quality Assessment Tools. Expert consultation was performed according to Arksey & O'Malley framework and cultural adaptation analysis was performed according to Bernal framework.

RESULTS

Out of 14,549 retrieved records, we identified ten peer-reviewed articles conducted in Zimbabwe, Uganda, South Africa and Zambia describing four distinct interventions. Six were randomized controlled trials; none addressed implementation outcomes. Group-based interpersonal therapy (n = 5), trauma-focused cognitive behaviour therapy (n = 1), problem solving therapy (n = 3) and narrative exposure therapy (n = 1) emerged as psychological interventions delivered by LHW for people with depression, anxiety, trauma and suicidal behavior. Psychological interventions delivered by LHW in Africa were all culturally adapted to meet the competence of LHW. All the interventions were associated with symptom improvement, but the quality of this evidence varied widely with study design.

CONCLUSION

Task-shifting psychological interventions delivered by LHW after appropriate cultural adaptation show promise for addressing unmet mental health care needs in Africa. More effectiveness and implementation evidence is needed, especially with regard to psychological interventions delivered by LHW for adolescence, older people and those with severe mental disorders and suicidal behaviors.

Scaling Up Science-Based Care for Depression and Unhealthy Alcohol Use in Colombia: An Implementation Science Project

BACKGROUND

Mental disorders are a major cause of the global burden of disease and significantly contribute to disability and death. This challenge is particularly evident in low- and middle-income countries (LMICs), where >85% of the world's population live. Latin America is one region comprising LMICs where the burden of mental disorders is high and the availability of mental health services is low. This is particularly evident in Colombia, a country with a long-standing history of violence and associated mental health problems.

METHODS

This article describes the design of a multisite implementation science project, "Scaling Up Science-Based Mental Health Interventions in Latin America" (also known as the DIADA project), that is being conducted in six primary care systems in Colombia. This project, funded via a cooperative agreement from the National Institute of Mental Health, seeks to implement and assess the impact of a new model for promoting widespread access to mental health care for depression and unhealthy alcohol use within primary care settings and building an infrastructure to support research capacity and sustainability of the new service delivery model in Colombia. This care model centrally harnesses mobile health technology to increase the reach of science-based mental health care for depression and unhealthy alcohol use.

RESULTS

This initiative offers great promise to increase capacity for providing and sustaining evidence-based treatment for depression and unhealthy alcohol use in Colombia.

NEXT STEPS

This project may inform models of care that can extend to other regions of Latin America or other LMICs.