Examining the sustainment of the Adolescent-Community Reinforcement Approach in community addiction treatment settings: protocol for a longitudinal mixed method study

Comparing organization-focused and state-focused financing strategies on provider-level reach of a youth substance use treatment model: a mixed-method study

BACKGROUND

Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes.

METHOD

A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach.

RESULTS

The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities).

DISCUSSION

As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment.

Comparing two federal financing strategies on penetration and sustainment of the adolescent community reinforcement approach for substance use disorders: protocol for a mixed-method study

BACKGROUND

Sustained, widespread availability of evidence-based practices (EBPs) is essential to address the public health and societal impacts of adolescent substance use disorders (SUD). There remains a particularly significant need to identify effective financing strategies, which secure and direct financial resources to support the costs associated with EBP implementation and sustainment. This protocol describes a new project comparing two types of U.S. federal grant mechanisms (i.e., a type of financing strategy), which supported the implementation of the Adolescent Community Reinforcement Approach (A-CRA) EBP for SUD, through either organization-focused or state-focused granting of funds. The Exploration-Preparation-Implementation-Sustainment (EPIS) framework will guide our study aims, hypotheses, and selection of measures.

METHOD

We will employ a longitudinal, mixed-method (i.e., web surveys, semi-structured interviews, document review, focus groups, administrative data), quasi-experimental design to compare the grant types' outcomes and examine theoretically informed mediators and moderators. Aim 1 will examine the proportion of eligible clinicians certified in A-CRA with adequate fidelity levels (i.e., penetration outcomes) at the end of grant funding. Aim 2 will examine the sustainment of A-CRA up to 5 years post-funding, using a 10-element composite measure of treatment delivery and supervision activities. We will integrate the new data collected from state-focused grant recipients (~85 organizations in 19 states) with previously collected data from organization-focused grant recipients (Hunter et al., Implement Sci 9:104, 2014) (82 organizations in 26 states) for analysis. We will also use sensitivity analyses to characterize the effects of observed and unobserved secular trends in our quasi-experimental design. Finally, aim 3 will use comparative case study methods (integrating diverse quantitative and qualitative measures) to identify and disseminate policy implications about the roles of state- and organization-focused federal grants in efforts to promote adolescent SUD EBP implementation and sustainment.

DISCUSSION

The proposed research will have direct, practical implications for behavioral health administrators, policymakers, implementation experts, and the public. It will offer new knowledge that can directly inform financing strategies to support large-scale, sustained EBP delivery in behavioral health-while advancing implementation science through the use of novel methods to study financing strategies and sustainment.

Kentucky Women's Justice Community Opioid Innovation Network (JCOIN): A type 1 effectiveness-implementation hybrid trial to increase utilization of medications for opioid use disorder among justice-involved women

The opioid crisis has disproportionately affected women, but research on approaches to increase initiation of medications for opioid use disorder (MOUD) among women is limited. The Kentucky Justice Community Opioid Innovation Network (JCOIN) will implement a type 1 hybrid effectiveness and implementation trial to examine an innovative MOUD pretreatment model using telehealth (alone and in combination with peer navigators) for justice-involved women in transition from jail to the community. The overall goal of the project is to increase initiation and maintenance of MOUD among high-risk justice-involved women during community reentry to reduce opioid relapse and overdose. This project and other studies through the JCOIN network have the potential to significantly impact the OUD treatment field by contributing empirical evidence about the effectiveness and implementation of innovative technologies to increase initiation and maintenance of MOUD during a critical, high-risk time of community reentry among vulnerable, justice-involved individuals in both urban and nonurban communities.

Measuring sustainability of a grassroots program in a large integrated health care delivery system: the Warrior to Soul Mate Program

Introduction

Veterans experience many physical and psychosocial adjustment problems that challenge personal relationships and social functioning and successful social reintegration. The Warrior to Soul Mate (W2SM) program uses a structured curriculum [i.e., the Practical Application of Intimate Relationships Skills (PAIRS)] to address veterans' interpersonal needs by teaching participants effective interpersonal skills. Veterans who attended the W2SM program reported lower anxiety levels, improvements in marital alterations and satisfaction, and increased intimacy, cohesion, and affection. Therefore, sustaining the W2SM program can have long-term positive effects for veterans, families, and the greater society. The purpose of this paper is to describe the sustainability of the W2SM program.

Methods

The Model of Community-based Program Sustainability conceptually guided the evaluation. Twenty-three VA hospitals in the U.S. that offer W2SM programs completed a self-report survey to measure sustainability.

Results

The highest scoring sustainability elements were "Demonstrating program results" (M=5.82, SD=1.23), "Staff involvement and integration" (M= 5.79, SD= 1.34), and "Program responsivity" (M=4.39, SD= 1.16); the lowest scoring element was "Strategic funding" (M=2.78, SD=1.75). Statistically significant associations were found between the global middle-range program results and three sustainability elements: leadership competence (r = .472, p = .023), effective collaboration (r = .470, p = .024), and strategic funding (r = .507, p = .014).

Discussion

Efforts to sustain programs should focus on leaders planning for sustainability at the onset of program implementation, collaborators must be involved in program design, implementation and evaluation, and long-term funding sources must be secured to support program operations and continuation.

Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: study protocol for a cluster randomized trial

BACKGROUND

Improving the extent to which evidence-based practices (EBPs)-treatments that have been empirically shown to be efficacious or effective-are integrated within routine practice is a well-documented challenge across numerous areas of health. In 2014, the National Institute on Drug Abuse funded a type 2 effectiveness-implementation hybrid trial titled the substance abuse treatment to HIV Care (SAT2HIV) Project. Aim 1 of the SAT2HIV Project tests the effectiveness of a motivational interviewing-based brief intervention (MIBI) for substance use as an adjunct to usual care within AIDS service organizations (ASOs) as part of its MIBI Experiment. Aim 2 of the SAT2HIV Project tests the effectiveness of implementation and sustainment facilitation (ISF) as an adjunct to the Addiction Technology Transfer Center (ATTC) model for training staff in motivational interviewing as part of its ISF Experiment. The current paper describes the study protocol for the ISF Experiment.

METHODS

Using a cluster randomized design, case management and leadership staff from 39 ASOs across the United States were randomized to receive either the ATTC strategy (control condition) or the ATTC + ISF strategy (experimental condition). The ATTC strategy is staff-focused and includes 10 discrete strategies (e.g., provide centralized technical assistance, conduct educational meetings, provide ongoing consultation). The ISF strategy is organization-focused and includes seven discrete strategies (e.g., use an implementation advisor, organize implementation team meetings, conduct cyclical small tests of change). Building upon the exploration-preparation-implementation-sustainment (EPIS) framework, the effectiveness of the ISF strategy is examined via three staff-level measures: (1) time-to-proficiency (i.e., preparation phase outcome), (2) implementation effectiveness (i.e., implementation phase outcome), and (3) level of sustainment (i.e., sustainment phase outcome).

DISCUSSION

Although not without limitations, the ISF experiment has several strengths: a highly rigorous design (randomized, hypothesis-driven), high-need setting (ASOs), large sample size (39 ASOs), large geographic representation (23 states and the District of Columbia), and testing along multiple phases of the EPIS continuum (preparation, implementation, and sustainment). Thus, study findings will significantly improve generalizable knowledge regarding the best preparation, implementation, and sustainment strategies for advancing EBPs along the EPIS continuum. Moreover, increasing ASO's capacity to address substance use may improve the HIV Care Continuum. Trial registration ClinicalTrials.gov: NCT03120598.

Factors associated with an evidence-based measure of implementation for the Adolescent Community Reinforcement Approach

BACKGROUND

An evidence-based measure of implementation (EBMI) is an implementation outcome measure shown to have predictive validity with one or more future-measured constructs of importance. The current study sought to identify correlates and predictors of an EBMI called procedure exposure. Garner et al. (2016) found procedure exposure to be an EBMI for the Adolescent Community Reinforcement Approach (A-CRA).

METHODS

The dataset included 76 community-based substance use treatment organizations located across the United States. Organizational-level regression analyses, which were framed within the context of Chaudoir et al. (2013) framework for predicting implementation outcomes, were used to examine predictors of A-CRA procedure exposure RESULTS: The Washington Circle's treatment initiation performance measure (B=5.05 [SE=1.60], p=0.002), as well as session exposure (B=0.18 [SE=0.06], p=0.003), were significant predictors of A-CRA procedure exposure in the backward stepwise regression analysis (Adjusted R-square=0.55). The Washington Circle's treatment engagement performance measure (B=7.93 [SE=0.77], p<0.001), as well as time-to-proficiency (B=-0.04 [SE=0.02], p=0.02), each had significant bivariate relationships with A-CRA procedure exposure but were not retained in the final model.

CONCLUSIONS

Organizations implementing A-CRA are encouraged to make the following high priorities: (a) scheduling and completing a subsequent treatment session within 14days of their index session (treatment initiation) and (b) providing a targeted number of treatment sessions to each client (session exposure). To the extent organizations do this, they may be more likely to achieve higher levels of A-CRA procedure exposure.

Predicting evidence-based treatment sustainment: results from a longitudinal study of the Adolescent-Community Reinforcement Approach

BACKGROUND

Implementation support models are increasingly being used to enhance the delivery of evidence-based treatments (EBTs) in routine care settings. Little is known about the extent to which these models lead to continued EBT use after implementation support ends. Moreover, few empirical studies longitudinally examine the hypothesized factors associated with long-term psychosocial EBT use (i.e., sustainment). In an effort to address this gap, the current study examined sustainment of an EBT called the Adolescent-Community Reinforcement Approach (A-CRA) following the end of implementation support.

METHODS

Between 2006 and 2010, the Substance Abuse and Mental Health Services Administration awarded 3 years of A-CRA implementation support to 82 community-based organizations around the USA. The extent to which A-CRA was sustained following grant end and the hypothesized factors associated with EBT sustainment were collected using both retrospective and prospective data. We examined the extent to which 10 core treatment elements of A-CRA were sustained and the associations between the extent of A-CRA sustainment and hypothesized factors using a pattern-mixture longitudinal modeling approach.

RESULTS

Staff from 76 organizations participated in data collection for a 92.86% response rate. On average, about half of the 10 core treatment elements were sustained following the loss of implementation support. Factors that appeared most important to A-CRA sustainment included characteristics that were related to the outer setting (communication, funding, and partnerships), inner setting (political support, organizational capacity, and supervisor turnover rate), implementation support period (number of clinicians and supervisors certified and employed at support end and number of youth served), and staff perceptions of the intervention (implementation difficulty, relative advantage, and perceived success).

CONCLUSIONS

Even with multiple years of implementation support, community-based organizations face challenges in sustaining EBT delivery over time. Consistent with implementation theories, multiple factors appear related with EBT sustainment, including the degree of implementation during the initial support period, as well as adequate funding, infrastructure support, and staff support following the end of funding.

Toward Evidence-Based Measures of Implementation: Examining the Relationship Between Implementation Outcomes and Client Outcomes

BACKGROUND

Developing consistent, valid, and efficient implementation outcome measures is necessary to advance implementation science. However, development of such measures has been limited to date, especially for validating the extent to which such measures are associated with important improvements in client outcomes. This study seeks to address this gap by developing one or more evidence-based measures of implementation (EBMIs; i.e., implementation outcome measure that is predictive of improvements in key client outcomes) for the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based practice (EBP) for adolescent substance use.

METHODS

Data for the current study were collected as part of a large-scale federally funded EBP dissemination and implementation initiative. The multilevel dataset included 65 substance use treatment organizations, 308 clinicians, and 5873 adolescent clients. Adjusted multilevel regression analyses were used to examine the extent to which client-level outcome measures assessed at 6-month follow-up (i.e., substance use, emotional problems) could be predicted by four implementation outcomes: two measures of fidelity (i.e., session exposure, procedure exposure) and two measures of penetration (i.e., absolute client penetration, absolute staff penetration).

RESULTS

Adjusting for client substance use at intake, as well as several client characteristics (e.g., age, race, criminal justice involvement), client substance use at follow-up was significantly lower for treatment organizations that had higher procedure exposure (B=-1.227, standard error [SE]=0.583, 95% confidence interval=-2.370, 0.252; p<.05). None of the other three implementation outcome measures were found to predict improvements in client outcomes.

CONCLUSIONS

The current study provides support for procedure exposure as an organizational-level EBMI for A-CRA. Thus, future efforts focused on implementing A-CRA could be improved by measuring and monitoring the extent to which A-CRA procedures are being delivered to clients. Additionally, given the dearth of studies that have examined the relationship between organizational-level measures of implementation and client outcomes, this article provides a prototype for future research to identify EBMIs for other behavioral treatments.

The role of schools in substance use prevention and intervention

Schools provide an ideal setting for screening, brief interventions, and outpatient treatment for substance use disorders (SUD). Individual treatment for SUD is effective at decreasing substance use as well as substance-related harm. In some contexts, rather than being helpful, group interventions can result in harm to participants; therefore, individual treatment may be preferred. Early interventions for adolescents who are using alcohol and other drugs (AOD) are generally effective in decreasing frequency and quantity of AOD use as well as decreasing risky behaviors.