Is necessity also the mother of implementation? COVID-19 and the implementation of evidence-based treatments for opioid use disorders

Opioid-related overdoses and the coronavirus disease 2019 (COVID-19) represent two of the deadliest crises in United States' history and together constitute a syndemic. The intersecting risks of this syndemic underscore the urgent need to implement effective opioid use disorder (OUD) treatments that are sustainable amid COVID-19 mitigation strategies. In response to new federal guidance released during the pandemic, opioid treatment programs (OTPs) have quickly innovated to implement new systems of medication delivery. OTPs rapid implementation of new medication delivery models defies conventional wisdom about the pace of research transfer. As part of an ongoing cluster-randomized type 3 hybrid trial evaluating strategies to implement contingency management (CM), select staff of eight OTPs had been trained to deliver CM and were in the midst of receiving ongoing implementation support. As COVID-19 emerged, all eight OTPs mirrored trends in the addiction field and effectively adapted to federal/state demands to implement new methods of medication delivery. However, over the past few months, necessity has arguably been the mother of implementation. We have observed greater variance among these OTPs' success with the additional implementation of adjunctive CM. The speed and variability of innovation raises novel questions about drivers of implementation. We argue that the mother of the next innovation should be a public call for a progressive, thoughtful set of public health policies and other external setting levers to address the needs of those with OUD and the OTPs that serve them.

•

Opioid-related overdoses and COVID-19 constitute a syndemic.

•

Opioid treatment programs (OTPs) have rapidly innovated in response to COVID-19.

•

OTPs have implemented new medication for opioid use disorder (MOUD) delivery models.

•

OTPs have had variable success with sustaining adjunct behavioral interventions.

•

Speed and variability of innovation raises questions about implementation drivers.

The implementation and sustainment facilitation strategy improved implementation effectiveness and intervention effectiveness: Results from a cluster-randomized, type 2 hybrid trial

Background:

Substance use disorders (SUDs) among people with HIV are both prevalent and problematic. The Substance Abuse Treatment to HIV care project was funded to test the Implementation and Sustainment Facilitation (ISF) strategy as an adjunct to the Addiction Technology Transfer Center (ATTC) strategy for integrating a motivational interviewing-based brief intervention (MIBI) for SUDs within HIV community-based organizations.

Methods:

Using a cluster-randomized, type 2 hybrid trial design, 39 HIV organizations were randomized to either (1) ATTC (n = 19) or (2) ATTC + ISF (n = 20). Each HIV organization identified two staff members to be prepared to implement the MIBI (N = 78). Subsequently, during the implementation phase, HIV organizations in each condition randomized client participants (N = 824) to one of the two intervention conditions: usual care (UC; n = 415) or UC + MIBI (n = 409). Both staff-level outcomes and client-level outcomes were examined.

Results:

The ISF strategy had a significant impact on the implementation effectiveness (i.e., the consistency and the quality of implementation; β = .65, p = .01) but not on time-to-proficiency (β = −.02) or level-of-sustainment (β = .09). In addition, the ISF strategy was found to have a significant impact on the intervention effectiveness (the effectiveness of the MIBI), at least in terms of significantly decreasing the odds (odds ratio = 0.11, p = .02) of clients using their primary substance daily during follow-up.

Conclusion:

The ISF strategy was found to be an effective adjunct to the ATTC strategy in terms of implementation effectiveness and intervention effectiveness. It is recommended that future efforts to integrate the project’s MIBI for SUD within HIV organizations use the ATTC + ISF strategy. However, given the ISF strategy did not have a significant impact on level-of-sustainment, implementation research testing the extent to which the ATTC + ISF strategy can be significantly enhanced through effective sustainment strategies is warranted.

Plain language abstract

Substance use among people living with HIV is associated with increased mental health problems, worse medication adherence, and worse HIV viral suppression. Increasing substance use-related services in HIV community-based organizations is an important public health need. The Substance Abuse Treatment to HIV care project tested two strategies for helping HIV organizations implement a brief intervention (BI) designed to motivate clients to decrease their substance use. The project also tested if receiving a BI improved clients’ outcome. Two staff from each of the 39 participating organizations were taught how to deliver the BI using the Addiction Technology Transfer Center (ATTC) training strategy (online and in-person training, monthly feedback, and coaching). Half of the organizations also received the Implementation and Sustainment Facilitation (ISF) strategy, which included monthly meetings with an ISF coach for the two BI staff and one or more leadership staff from the organization. Organizations that received both the ATTC and ISF strategies delivered more BIs and higher quality BIs than organizations that only received the ATTC strategy. In addition, clients receiving BIs at organizations that received both strategies were more likely to decrease their substance use. However, receiving both strategies did not improve how quickly staff learned to deliver the BI or improve the number of BIs delivered during the project’s 6-month sustainment phase. Future research focused on implementing BIs within HIV organizations should consider using the ATTC and ISF strategies while also seeking to enhance the strategies to improve sustainment.

Implementing Web-Based Interventions in HIV Primary Care Clinics: Pilot Implementation Evaluation of Positive Health Check

Background

Web-based interventions can help people living with HIV achieve better clinical outcomes and behaviors, but integrating them into clinical practice remains challenging. There is a gap in understanding the feasibility of implementing these interventions in HIV clinic settings from the clinicians’ perspective.

Objective

The goal of the research was to determine whether Positive Health Check (PHC)—a Web-based, tailored video counseling tool focused on increasing patient adherence and retention in care and reducing HIV risk among HIV-positive patients—was acceptable, appropriate, and feasible for HIV primary care clinic staff to implement in clinic workflows.

Methods

A multiple-case study design was used to evaluate the pilot implementation. Four primary care clinics located in the southeastern United States implemented PHC over a 1-month period. Nine clinic staff across the clinics participated in structured interviews before, during, and after the implementation. In total, 54 interviews were conducted. We used a framework analysis approach to code the data and identify themes related to implementation outcomes, including acceptability, appropriateness, and feasibility. We also analyzed patient intervention use metrics (n=104) to quantify patient intervention completion rates (n=68).

Results

Overall, clinicians viewed PHC as acceptable and appropriate. Themes that emerged related to these implementation outcomes include the ability for PHC to increase provider-patient communication and its ability to engage patients due to the tailored and interactive design. While generally feasible to implement, challenges to the clinic workflow and physical environment were areas that clinics needed to manage to make PHC work in their clinics.

Conclusions

Findings from this pilot implementation suggest that clinical staff viewed PHC as acceptable and appropriate, especially as more patients used the intervention over the pilot period. Feasibility of implementation was challenging in some cases, and lessons learned from this pilot implementation can provide information for larger scale tests of the intervention that include assessment of both implementation outcomes and clinical outcomes.

The Temporal Relationship Between Medicaid Payment Acceptance and the Implementation of Medication-Assisted Drug Treatment

OBJECTIVE

To examine the temporal relationship of Medicaid funding on the implementation of evidence-based practices (EBPs) in outpatient substance use disorder (SUD) treatment.

METHODS

We examined data from 61 publicly funded SUD treatment programs in 2011 and 2013 using crossed-lagged regressions. We tested the impact of Medicaid payment acceptance on 2 measures of EBP implementation-contingency management treatment (CMT) and medication-assisted treatment (MAT).

RESULTS

Medicaid payment acceptance at wave 1 was not associated with implementation of CMT at wave 2 (standardized estimate = 0.170, SE = 0.208, P > .05). However, Medicaid payment acceptance at wave 1 was associated with implementation of MAT at wave 2 (standardized estimate = 0.880, SE = 0.047, P < .001).

CONCLUSIONS

Medicaid payment acceptance has a temporal relationship with the implementation of MAT in SUD treatment programs serving one of the largest racial/ethnic minority communities in the United States.

Pay-for-performance as a cost-effective implementation strategy: results from a cluster randomized trial

BACKGROUND

Pay-for-performance (P4P) has been recommended as a promising strategy to improve implementation of high-quality care. This study examined the incremental cost-effectiveness of a P4P strategy found to be highly effective in improving the implementation and effectiveness of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment (EBT) for adolescent substance use disorders (SUDs).

METHODS

Building on a $30 million national initiative to implement A-CRA in SUD treatment settings, urn randomization was used to assign 29 organizations and their 105 therapists and 1173 patients to one of two conditions (implementation-as-usual (IAU) control condition or IAU+P4P experimental condition). It was not possible to blind organizations, therapists, or all research staff to condition assignment. All treatment organizations and their therapists received a multifaceted implementation strategy. In addition to those IAU strategies, therapists in the IAU+P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions found to be associated with significantly improved patient outcomes (target A-CRA). Incremental cost-effectiveness ratios (ICERs), which represent the difference between the two conditions in average cost per treatment organization divided by the corresponding average difference in effectiveness per organization, and quality-adjusted life years (QALYs) were the primary outcomes.

RESULTS

At trial completion, 15 organizations were randomized to the IAU condition and 14 organizations were randomized to the IAU+P4P condition. Data from all 29 organizations were analyzed. Cluster-level analyses suggested the P4P strategy led to significantly higher average total costs compared to the IAU control condition, yet this average increase of 5% resulted in a 116% increase in the average number of months therapists demonstrated competence in treatment delivery (ICER = $333), a 325% increase in the average number of patients who received the targeted dosage of treatment (ICER = $453), and a 325% increase in the number of days of abstinence per patient in treatment (ICER = $8.134). Further supporting P4P as a cost-effective implementation strategy, the cost per QALY was only $8681 (95% confidence interval $1191-$16,171).

CONCLUSION

This study provides experimental evidence supporting P4P as a cost-effective implementation strategy.

TRIAL REGISTRATION

NCT01016704 .

Correction to: Testing the effectiveness of a motivational interviewing-based brief intervention for substance use as an adjunct to usual care in community-based AIDS service organizations: study protocol for a multisite randomized controlled trial

Upon publication of the original article.

Testing the effectiveness of a motivational interviewing-based brief intervention for substance use as an adjunct to usual care in community-based AIDS service organizations: study protocol for a multisite randomized controlled trial

Background

In 2010, the first comprehensive National HIV/AIDS Strategy for the United States was released and included three goals: (1) reducing the number of people who become infected with HIV, (2) increasing access to care and improving health outcomes for people living with HIV, and (3) reducing HIV-related health disparities and health inequities. In 2013, as part of its effort to help address the National HIV/AIDS Strategy, the National Institute on Drug Abuse (NIDA) funded a type 2 effectiveness-implementation hybrid trial titled the Substance Abuse Treatment to HIV Care (SAT2HIV) Project. Aim 1 of the SAT2HIV Project tests the effectiveness of a motivational interviewing-based brief intervention (MIBI) for substance use as an adjunct to usual care within AIDS Service Organizations (ASOs) as part of its MIBI Experiment. Aim 2 of the SAT2HIV Project tests the effectiveness of implementation and sustainment facilitation (ISF) as an adjunct to the Addiction Technology Transfer Center (ATTC) model for training staff in motivational interviewing as part of its ISF Experiment. The current paper describes the study protocol for the ISF Experiment.

Methods

As part of a multisite randomized controlled trial, individuals with comorbid HIV/AIDS and problematic substance use are randomized to receive either the ASOs’ usual care (control condition) or usual care plus a MIBI for substance use (experimental condition) delivered by trained ASO case-management staff. Primary outcome measures are reductions in days of primary substance use, number of substance-related problems, times engaging in risky behaviors, days of non-adherence to HIV medications, and increases in substance use treatment. As part of this paper, we describe the trial protocol in accordance with the Standard Protocol Items: Recommendations for Interventional Trials guidelines.

Discussion

If successfully able to implement MIBI as an effective adjunct to usual care, the current trial may have a significant impact on increasing the capacity of ASOs to address problematic substance use among individuals living with HIV/AIDS. Reducing the prevalence of problematic substance use among individuals living with HIV/AIDS within the United States may lead to significant improvements on key performance measures (i.e., the HIV Care Continuum and the 90-90-90 target).

Trial registration ClinicalTrials.gov: NCT02495402

Electronic supplementary material

The online version of this article (10.1186/s13722-017-0095-8) contains supplementary material, which is available to authorized users.

Testing the implementation and sustainment facilitation (ISF) strategy as an effective adjunct to the Addiction Technology Transfer Center (ATTC) strategy: study protocol for a cluster randomized trial

BACKGROUND

Improving the extent to which evidence-based practices (EBPs)-treatments that have been empirically shown to be efficacious or effective-are integrated within routine practice is a well-documented challenge across numerous areas of health. In 2014, the National Institute on Drug Abuse funded a type 2 effectiveness-implementation hybrid trial titled the substance abuse treatment to HIV Care (SAT2HIV) Project. Aim 1 of the SAT2HIV Project tests the effectiveness of a motivational interviewing-based brief intervention (MIBI) for substance use as an adjunct to usual care within AIDS service organizations (ASOs) as part of its MIBI Experiment. Aim 2 of the SAT2HIV Project tests the effectiveness of implementation and sustainment facilitation (ISF) as an adjunct to the Addiction Technology Transfer Center (ATTC) model for training staff in motivational interviewing as part of its ISF Experiment. The current paper describes the study protocol for the ISF Experiment.

METHODS

Using a cluster randomized design, case management and leadership staff from 39 ASOs across the United States were randomized to receive either the ATTC strategy (control condition) or the ATTC + ISF strategy (experimental condition). The ATTC strategy is staff-focused and includes 10 discrete strategies (e.g., provide centralized technical assistance, conduct educational meetings, provide ongoing consultation). The ISF strategy is organization-focused and includes seven discrete strategies (e.g., use an implementation advisor, organize implementation team meetings, conduct cyclical small tests of change). Building upon the exploration-preparation-implementation-sustainment (EPIS) framework, the effectiveness of the ISF strategy is examined via three staff-level measures: (1) time-to-proficiency (i.e., preparation phase outcome), (2) implementation effectiveness (i.e., implementation phase outcome), and (3) level of sustainment (i.e., sustainment phase outcome).

DISCUSSION

Although not without limitations, the ISF experiment has several strengths: a highly rigorous design (randomized, hypothesis-driven), high-need setting (ASOs), large sample size (39 ASOs), large geographic representation (23 states and the District of Columbia), and testing along multiple phases of the EPIS continuum (preparation, implementation, and sustainment). Thus, study findings will significantly improve generalizable knowledge regarding the best preparation, implementation, and sustainment strategies for advancing EBPs along the EPIS continuum. Moreover, increasing ASO's capacity to address substance use may improve the HIV Care Continuum. Trial registration ClinicalTrials.gov: NCT03120598.

Measuring sustainment of an evidence based treatment for adolescent substance use

BACKGROUND

Measuring the extent a behavioral treatment is sustained in usual care practice settings after initial support for implementation ends is challenging. Oftentimes dichotomous self-report measures are used to measure health program sustainment, but these measures may not adequately capture the quality or extent of behavioral treatment delivery. Using data collected from community based organizations that received support to implement the Adolescent Community Reinforcement Approach (A-CRA), a measure of the extent of sustainment was derived.

METHODS

Based on implementation theories and implementation support protocols, a total of 10 core treatment elements were identified to measure the extent of sustainment using information collected from key clinical staff. Item response theory (IRT) and principal component analyses (PCA) were used to further refine the 10 elements into composite measures of sustainment. The association between the 10 elements and the relationships between the comprehensive measures to a dichotomous sustainment measure were also examined.

RESULTS

Results from PCA identified two components from the initial 10 elements for measuring the extent of A-CRA treatment sustainment. The two components described different aspects of organizational support for A-CRA treatment implementation, one representing the quality or extent of treatment staffing and delivery and the other representing the quality of or extent of clinical supervision.

CONCLUSIONS

Using IRT and PCA, we were able to derive components that could be used to measure the extent of EBT sustainment and also better capture the quality of treatment delivery than the use of simple dichotomous measure. The methodological contribution of our study is that we have demonstrated a general analytic approach that may be applicable for other psychosocial treatments.

Factors associated with an evidence-based measure of implementation for the Adolescent Community Reinforcement Approach

BACKGROUND

An evidence-based measure of implementation (EBMI) is an implementation outcome measure shown to have predictive validity with one or more future-measured constructs of importance. The current study sought to identify correlates and predictors of an EBMI called procedure exposure. Garner et al. (2016) found procedure exposure to be an EBMI for the Adolescent Community Reinforcement Approach (A-CRA).

METHODS

The dataset included 76 community-based substance use treatment organizations located across the United States. Organizational-level regression analyses, which were framed within the context of Chaudoir et al. (2013) framework for predicting implementation outcomes, were used to examine predictors of A-CRA procedure exposure RESULTS: The Washington Circle's treatment initiation performance measure (B=5.05 [SE=1.60], p=0.002), as well as session exposure (B=0.18 [SE=0.06], p=0.003), were significant predictors of A-CRA procedure exposure in the backward stepwise regression analysis (Adjusted R-square=0.55). The Washington Circle's treatment engagement performance measure (B=7.93 [SE=0.77], p<0.001), as well as time-to-proficiency (B=-0.04 [SE=0.02], p=0.02), each had significant bivariate relationships with A-CRA procedure exposure but were not retained in the final model.

CONCLUSIONS

Organizations implementing A-CRA are encouraged to make the following high priorities: (a) scheduling and completing a subsequent treatment session within 14days of their index session (treatment initiation) and (b) providing a targeted number of treatment sessions to each client (session exposure). To the extent organizations do this, they may be more likely to achieve higher levels of A-CRA procedure exposure.

Does the implementation of evidence-based and culturally competent practices reduce disparities in addiction treatment outcomes?

RATIONALE

Research is limited on the extent to which implementation of evidence-based and culturally responsive practices reduces outcome disparities in substance use disorder treatment. We examined the role of contingency management treatment (CMT), medication-assisted treatment (MAT), and culturally competent practices on Mexican Americans' rate of successful completion of treatment.

METHODS

We analyzed a concatenated dataset from 153 publicly funded substance use disorder treatment programs in Los Angeles County, California, in 2011 and 2013. These data were merged with data from 15,412 adult clients in both periods, of whom we selected only Mexican Americans (46.3%) and non-Latino Whites (53.7%). The outcome was successful treatment completion. The main independent variables were client demographics, drug use severity, mental health issues, and program license and professional accreditation.

RESULTS

Less than half of the programs highly implemented CMT, MAT, and culturally competent practices. CMT and cultural competence were not associated with successful treatment completion. However, Mexican Americans in programs with high degree of implementation of MAT had higher odds of successfully completing treatment compared to non-Latino Whites and programs with low MAT (OR=1.389; 95% CI=1.018, 1.897).

CONCLUSIONS

Findings highlight the role of MAT in reducing the disparity in treatment completion between Mexican Americans and non-Latino Whites. Implications for health policy and the dissemination of MAT are discussed.

Predicting evidence-based treatment sustainment: results from a longitudinal study of the Adolescent-Community Reinforcement Approach

BACKGROUND

Implementation support models are increasingly being used to enhance the delivery of evidence-based treatments (EBTs) in routine care settings. Little is known about the extent to which these models lead to continued EBT use after implementation support ends. Moreover, few empirical studies longitudinally examine the hypothesized factors associated with long-term psychosocial EBT use (i.e., sustainment). In an effort to address this gap, the current study examined sustainment of an EBT called the Adolescent-Community Reinforcement Approach (A-CRA) following the end of implementation support.

METHODS

Between 2006 and 2010, the Substance Abuse and Mental Health Services Administration awarded 3 years of A-CRA implementation support to 82 community-based organizations around the USA. The extent to which A-CRA was sustained following grant end and the hypothesized factors associated with EBT sustainment were collected using both retrospective and prospective data. We examined the extent to which 10 core treatment elements of A-CRA were sustained and the associations between the extent of A-CRA sustainment and hypothesized factors using a pattern-mixture longitudinal modeling approach.

RESULTS

Staff from 76 organizations participated in data collection for a 92.86% response rate. On average, about half of the 10 core treatment elements were sustained following the loss of implementation support. Factors that appeared most important to A-CRA sustainment included characteristics that were related to the outer setting (communication, funding, and partnerships), inner setting (political support, organizational capacity, and supervisor turnover rate), implementation support period (number of clinicians and supervisors certified and employed at support end and number of youth served), and staff perceptions of the intervention (implementation difficulty, relative advantage, and perceived success).

CONCLUSIONS

Even with multiple years of implementation support, community-based organizations face challenges in sustaining EBT delivery over time. Consistent with implementation theories, multiple factors appear related with EBT sustainment, including the degree of implementation during the initial support period, as well as adequate funding, infrastructure support, and staff support following the end of funding.

Identifying and reducing disparities in successful addiction treatment completion: testing the role of Medicaid payment acceptance

BACKGROUND

Medicaid has become the largest payer of substance use disorder treatment and may enhance access to quality care and reduce disparities. We tested whether treatment programs' acceptance of Medicaid payments was associated with reduced disparities between Mexican Americans and non-Latino Whites.

METHODS

We analyzed client and program data from 122 publicly funded treatment programs in 2010 and 112 programs in 2013. These data were merged with information regarding 15,412 adult clients from both periods, of whom we selected only Mexican Americans (n = 7130, 46.3%) and non-Latino Whites (n = 8282, 53.7%). We used multilevel logistic regression and variance decomposition to examine associations and underlying factors associated with Mexican American and White differences in treatment completion. Variables of interest included client demographics; drug use severity and mental health issues; and program license, accreditation, and acceptance of Medicaid payments.

RESULTS

Mexican Americans had lower odds of treatment completion (OR = 0.677; 95% CI = 0.534, 0.859) compared to non-Latino Whites. This disparity was explained in part by primary drug used, greater drug use severity, history of mental health disorders, and program acceptance of Medicaid payments. The interaction between Mexican Americans and acceptance of Medicaid was statistically significant (OR = 1.284; 95% CI = 1.008, 1.637).

CONCLUSIONS

Findings highlighted key program and client drivers of this disparity and the promising role of program acceptance of Medicaid payment to eliminate disparities in treatment completion among Mexican Americans. Implications for health policy during the Trump Administration are discussed.

Toward Evidence-Based Measures of Implementation: Examining the Relationship Between Implementation Outcomes and Client Outcomes

BACKGROUND

Developing consistent, valid, and efficient implementation outcome measures is necessary to advance implementation science. However, development of such measures has been limited to date, especially for validating the extent to which such measures are associated with important improvements in client outcomes. This study seeks to address this gap by developing one or more evidence-based measures of implementation (EBMIs; i.e., implementation outcome measure that is predictive of improvements in key client outcomes) for the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based practice (EBP) for adolescent substance use.

METHODS

Data for the current study were collected as part of a large-scale federally funded EBP dissemination and implementation initiative. The multilevel dataset included 65 substance use treatment organizations, 308 clinicians, and 5873 adolescent clients. Adjusted multilevel regression analyses were used to examine the extent to which client-level outcome measures assessed at 6-month follow-up (i.e., substance use, emotional problems) could be predicted by four implementation outcomes: two measures of fidelity (i.e., session exposure, procedure exposure) and two measures of penetration (i.e., absolute client penetration, absolute staff penetration).

RESULTS

Adjusting for client substance use at intake, as well as several client characteristics (e.g., age, race, criminal justice involvement), client substance use at follow-up was significantly lower for treatment organizations that had higher procedure exposure (B=-1.227, standard error [SE]=0.583, 95% confidence interval=-2.370, 0.252; p<.05). None of the other three implementation outcome measures were found to predict improvements in client outcomes.

CONCLUSIONS

The current study provides support for procedure exposure as an organizational-level EBMI for A-CRA. Thus, future efforts focused on implementing A-CRA could be improved by measuring and monitoring the extent to which A-CRA procedures are being delivered to clients. Additionally, given the dearth of studies that have examined the relationship between organizational-level measures of implementation and client outcomes, this article provides a prototype for future research to identify EBMIs for other behavioral treatments.

Associations between implementation characteristics and evidence-based practice sustainment: a study of the Adolescent Community Reinforcement Approach

Background

Few empirical studies longitudinally examine evidence-based practice (EBP) sustainment and the hypothesized factors that influence it. In an effort to address this gap, the current study examined sustainment of an EBP for adolescent substance use called the adolescent community reinforcement approach (A-CRA).

Methods

A-CRA sustainment was assessed via information collected as part of key informant interviews and surveys with clinical staff from community-based treatment organizations that had received federal funding to implement A-CRA. Administrative data from the funding period on implementation was also used. Using discrete-time survival analysis, we regressed A-CRA sustainment on several factors theorized to influence EBP sustainment. Factors examined included outer setting, inner setting, implementation quality during the funding period, and intervention-related characteristics.

Results

Overall, data from 83 % of the targeted sample of treatment organizations was collected. A-CRA sustainment was strongly related to the time since funding loss. Strong relationships were found between sustainment status and implementation quality during the funding period, agency focus, funding stability, and political support for the treatment along with staff perceptions of the treatment’s complexity and implementation difficulty.

Conclusions

Consistent with the Consolidated Framework for Implementation Research, the current study found several factors related to the outer setting (e.g., funding stability), inner setting (e.g., agency focus), implementation quality during the funding period (e.g., staff trained, clients served), and characteristics of the intervention (e.g., implementation complexity) to be associated with EBP sustainment. Future research is warranted to examine the extent to which these relationships are stable over time. Efforts to ensure that adequate implementation occurs during the initial implementation period and that adequate funding, infrastructure, and staff support following the ending of initial support are critical to a program’s survival.

The relationship between recovery and health-related quality of life

Building upon recommendations to broaden the conceptualization of recovery and to assess its relationship with health-related quality of life (HRQoL), this study addressed three primary aims. These included: 1) testing the model fit of a hypothesized latent measure of recovery, 2) examining the extent to which this multidimensional measure of recovery was associated with concurrently measured HRQoL, and 3) examining the extent to which this multidimensional measure of recovery predicted changes in HRQoL during the subsequent year. Data were from 1,008 adults who completed follow-up assessments at 15 and 16 years post-intake. Confirmatory factor analysis indicated a good fit for a hypothesized recovery measure (CFI=.98; RMSEA=.06). Additionally, structural equation modeling suggested that this recovery measure was not only concurrently associated with HRQoL (β=.78, p<.001), but was also a significant predictor of changes in HRQoL during the subsequent year (β=.25, p<.001).

Predictors of Staff Turnover and Turnover Intentions within Addiction Treatment Settings: Change Over Time Matters

This study examined the extent to which changes over time in clinicians’ responses to measures of work attitude (eg, job satisfaction) and psychological climate (eg, supervisor support) could predict actual turnover and turnover intentions above and beyond absolute levels of these respective measures. Longitudinal data for this study were collected from a sample of clinicians (N = 96) being trained to implement an evidence-based treatment for adolescent substance use disorders. Supporting findings from a recent staff turnover study, we found job satisfaction change was able to predict actual turnover above and beyond average levels of job satisfaction. Representing new contributions to the staff turnover literature, we also found that change over time in several other key measures (eg, job satisfaction, role manageability, role clarity) explained a significant amount of variance in turnover intentions above and beyond the absolute level of each respective measure. A key implication of the current study is that organizations seeking to improve their ability to assess risk for staff turnover may want to consider assessing staff at multiple points in time in order to identify systematic changes in key employee attitudes like turnover intentions and job satisfaction.

Examining the sustainment of the Adolescent-Community Reinforcement Approach in community addiction treatment settings: protocol for a longitudinal mixed method study

BACKGROUND

Although evidence-based treatments are considered the gold standard for clinical practice, it is widely recognized that evidence-based treatment implementation in real world practice settings has been limited. To address this gap, the federal government provided three years of funding, training and technical assistance to 84 community-based treatment programs to deliver an evidence-based treatment called the Adolescent-Community Reinforcement Approach (A-CRA). Little is known about whether such efforts lead to long-term A-CRA sustainment after the initial funding ends.

METHODS/DESIGN

We will use a longitudinal mixed method data analytic approach to characterize sustainment over time and to examine the factors associated with the extent to which A-CRA is sustained. We will use implementation data collected during the funding period (e.g., organizational functioning, staff certification rates and penetration) and supplement it with additional data collected during the proposed project period regarding implementation quality and the hypothesized predictors of sustainment (i.e., inner and outer contextual variables) collected over three waves from 2013 to 2015 representing program sustainment up to five years post-initial funding.

DISCUSSION

Gaining a better understanding of the factors that influence the evidence-based treatment sustainment may lead to more effective dissemination strategies and ultimately improve the quality of care being delivered in community-based addiction treatment settings.

The relationship between child maltreatment and substance abuse treatment outcomes among emerging adults and adolescents

Emerging adulthood is the period of greatest risk for problematic substance use. The primary aim of the current study was to examine the relationship between a broad measure of child maltreatment and several key outcomes for a large clinical sample of emerging adults (n = 858) and adolescents (n = 2,697). The secondary aim was to examine the extent to which the relationship between child maltreatment and treatment outcomes differed between emerging adults and adolescents. Multilevel latent growth curve analyses revealed emerging adults and adolescents who experienced child maltreatment reported significantly greater reductions over time on several treatment outcomes (e.g., substance use, substance-related problems, and emotional problems). Overall, analyses did not support differential relationships between child maltreatment and changes over time in these substance use disorder treatment outcomes for emerging adults and adolescents. The one exception was that although emerging adults with child maltreatment did reduce their HIV risk over time, their improvements were not as great as were the improvements in HIV risk reported by adolescents who had experienced child maltreatment.

A Behaviorally-Anchored Rating System to Monitor Treatment Integrity for Community Clinicians Using the Adolescent Community Reinforcement Approach

This study evaluated a process for training raters to reliably rate clinicians delivering the Adolescent Community Reinforcement Approach (A-CRA) in a national dissemination project. The unique A-CRA coding system uses specific behavioral anchors throughout its 73 procedure components. Five randomly-selected raters each rated "passing" and "not passing" examples of the 19 A-CRA procedures. Ninety-four percent of the final ICCs were at least 'good' (≥.60) and 66.7% were 'excellent' (≥.75), and 95% of the ratings exceeded the 60% or better agreement threshold between raters and the gold standard. Raters can be trained to provide reliable A-CRA feedback for large-scale dissemination projects.

Recovery Support for Adolescents with Substance use Disorders: The Impact of Recovery Support Telephone Calls Provided by Pre-Professional Volunteers

The present quasi-experiment examined the direct and indirect effects of recovery support telephone calls following adolescent substance use disorder treatment. Six-month outcome data from 202 adolescents who had received recovery support calls from primarily pre-professional (i.e., college-level social service students) volunteers was compared to 6-month outcome data from a matched comparison sample of adolescents (n = 404). Results suggested adolescents in the recovery support sample had significantly greater reductions in their recovery environment risk relative to the comparison sample (β = -.17). Path analysis also suggested that the reduction in recovery environment risk produced by recovery support calls had indirect impacts (via recovery environment risk) on reductions in social risk (β = .22), substance use (β = .23), and substance-related problems (β = .16). Finally, moderation analyses suggested the effects of recovery support calls did not differ by gender, but were significantly greater for adolescents with lower levels of treatment readiness. In addition to providing rare empirical support for the effectiveness of recovery support services, an important contribution of this study is that it provides evidence that recovery support services do not necessarily have to be "peer-based," at least in terms of the recovery support service provider having the experiential credentials of being "in recovery." If replicated, this latter finding may have particularly important implications for helping increase the recovery support workforce.

The GAIN Short Screener (GSS) as a Predictor of Future Arrest or Incarceration Among Youth Presenting to Substance Use Disorder (SUD) Treatment

The National Institutes of Health (NIH) data harmonization project on existing measures (www.phenx.org) has recommended the Global Appraisal of Individual Needs (GAIN)—Short Screener (GSS) as one of the most reliable, valid, efficient, and inexpensive general behavioral health screeners to quickly identify people with internalizing and externalizing mental health disorders, substance use disorders, and crime/violence problems. The present study examined how well the four GSS screeners and their sum predict future arrest or incarceration among individuals entering treatment for a substance use disorder. Using a cross-validation design, a diverse sample of 6,815 youth with substance use disorders was split into a development sample and a validation sample. Overall, results found the GSS’s crime and violence screener (CVScr) and the substance disorder screener (SDScr) to be the two best predictors of arrest/incarceration within the 12 months following treatment intake. Additionally, we found that these screeners could be used to categorize individuals into three groups (low risk, moderate risk, high risk) and this simplified classification had good predictive validity (Area Under the Curve = 0.601). In sum, the GSS’s predictive validity was similar to other instruments that have been developed to predict risk for recidivism; however, the GSS takes only a fraction of the time to collect (ie, approximately 2–3 minutes for just these two screeners).

Using pay for performance to improve treatment implementation for adolescent substance use disorders: results from a cluster randomized trial

OBJECTIVE

To test whether pay for performance (P4P) is an effective method to improve adolescent substance use disorder treatment implementation and efficacy.

DESIGN

Cluster randomized trial.

SETTING

Community-based treatment organizations.

PARTICIPANTS

Twenty-nine community-based treatment organizations, 105 therapists, and 986 adolescent patients (953 with complete data).

INTERVENTION

Community-based treatment organizations were assigned to 1 of the following conditions: the implementation-as-usual (IAU) control condition or the P4P experimental condition. In addition to delivering the same evidence-based treatment (ie, using the Adolescent Community Reinforcement Approach [A-CRA]), each organization received standardized levels of funding, training, and coaching from the treatment developers. Therapists in the P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (ie, A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions (ie, target A-CRA) that has been found to be associated with significantly improved patient outcomes.

MAIN OUTCOME MEASURES

Outcomes included ACRA competence (ie, a therapist-level implementation measure), target A-CRA (ie, a patient-level implementation measure), and remission status (ie, a patient-level treatment effectiveness measure).

RESULTS

Relative to therapists in the IAU control condition, therapists in the P4P condition were significantly more likely to demonstrate A-CRA competence (24.0% vs 8.9%; event rate ratio, 2.24; 95% CI, 1.12- 4.48; P=.02). Relative to patients in the IAU control condition, patients in the P4P condition were significantly more likely to receive target A-CRA (17.3% vs 2.5%; odds ratio, 5.19; 95% CI, 1.53-17.62; P=.01). However, no significant differences were found between conditions with regard to patients' end-of-treatment remission status.

CONCLUSION

Pay for performance can be an effective method of improving treatment implementation.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT01016704

The relationship between clinician turnover and adolescent treatment outcomes: an examination from the client perspective

The turnover of substance use disorder (SUD) treatment staff has been assumed to adversely impact treatment effectiveness, yet only limited research has empirically examined this assumption. Representing an extension of prior organizational-level analyses of the impact of staff turnover on client outcomes, this study examined the impact of SUD clinician turnover on adolescent treatment outcomes using a client perspective. Multilevel regression analysis did reveal that relative to those adolescents who did not experience clinician turnover, adolescents who experienced both direct and indirect clinician turnover reported a significantly higher percentage of days using alcohol or drugs at 6-month follow-up. However, clinician turnover was not found to have significant associations (negative or positive) with the other five treatment outcomes examined (e.g., substance-related problems, involvement in illegal activity). Thus, consistent with our prior findings, the current study provides additional evidence that turnover of SUD clinicians is not necessarily associated with adverse treatment outcomes.

The Brief Treatment Cost Analysis Tool (TCAT-Lite) for Substance Abuse Treatment: Reliability and Application

Although several costing instruments have been previously developed, few have been validated or applied systematically to the delivery of evidence-based practices (EBPs). Using data collected from 26 organizations implementing the same EBP, this paper examined the reliability, validity, and applicability of the brief Treatment Cost Analysis Tool (TCAT-Lite). The TCAT-Lite demonstrated good reliability-correlations between replications averaged 0.61. Validity also was high, with correlation of treated episodes per $100,000 between the TCAT-Lite and independent data of 0.57. In terms of applicability, cost calculations found that if all organizations had operated at optimal scale (124 client episodes per year), existing funds could have supported 64% more clients.