Community program therapist adherence and competence in motivational enhancement therapy

Examination of posttraining supervision of peer counselors in a motivational enhancement intervention to reduce drinking in a sample of heavy-drinking college students

Importance of peer counselor posttraining supervision on motivational interviewing (MI) microskills and postintervention drinking outcomes were evaluated in a sample of heavy-drinking undergraduate students completing Brief Alcohol Screening and Intervention for College Students (BASICS; L.A. Dimeff, J.S. Baer, D.R. Kivlahan, & G.A. Marlatt, 1999). Two peer counselor groups were trained using identical protocols. Posttraining, one group was randomized to receive supervision, whereas the other received no supervision. Groups were subsequently compared on MI microskills. College students (n = 122) were randomly assigned to either assessment-only control, supervision, or no supervision groups and completed a BASICS intervention. Postintervention drinking outcomes were examined. Results suggested supervision aided peer counselors in reducing use of closed-ended questions. Both treatment groups reduced total drinks per week and heavy-drinking behaviors compared to control. No differences on peak blood alcohol concentration (BAC) or alcohol-related consequences were observed. Differences in supervision did not influence drinking outcomes; however, posttraining supervision for peer counselors deficient in MI microskills may be needed to improve BASICS fidelity.

Partnerships and pathways of dissemination: the National Institute on Drug Abuse-Substance Abuse and Mental Health Services Administration Blending Initiative in the Clinical Trials Network

Since 2001, the National Drug Abuse Treatment Clinical Trials Network (CTN) has worked to put the results of its trials into the hands of community treatment programs, in large part through its participation in the National Institute on Drug Abuse-Substance Abuse and Mental Health Services Administration Blending Initiative and its close involvement with the Center for Substance Abuse Treatment's Addiction Technology Transfer Centers. This article describes (a) the CTN's integral role in the Blending Initiative, (b) key partnerships and dissemination pathways through which the results of CTN trials are developed into blending products and then transferred to community treatment programs, and (c) three blending initiatives involving buprenorphine, motivational incentives, and motivational interviewing. The Blending Initiative has resulted in high utilization of its products, preparation of more than 200 regional trainers, widespread training of service providers in most U.S. States, Puerto Rico, and the U.S. Virgin Islands and movement toward the development of Web-based implementation supports and technical assistance. Implications for future directions of the Blending Initiative and opportunities for research are discussed.

Psychometric properties of the contingency management competence scale

Contingency management (CM) is an evidence-based treatment, and clinicians are beginning to implement this intervention in practice. However, little research exists on methods for assuring appropriate implementation of CM. This study describes the development and psychometric properties of the 12-item CM Competence Scale (CMCS). Thirty-five therapists from nine community-based clinics participated; following a training period, a randomized trial evaluated the efficacy of CM in cocaine abusing patients. Analyses of the CMCS are based on ratings from 1613 audiotapes of therapist interactions with 78 patients enrolled in the training phase and 103 patients in the randomized phase. Inter-rater reliability from 11 raters and internal consistency of items on the CMCS was good to excellent. Items loaded onto two factors: one contained items specific to discussions of the outcomes of urine testing and reinforcement, and the other contained general items related to use of praise, communication of confidence, empathy, skillfulness, and maintaining session structure, as well as discussions of self-reports of drug use when they occurred. During the training phase in CM delivery, scores on the CMCS rose significantly between earlier and later training sessions, and during the randomized phase, CM sessions were rated more highly than non-CM sessions. Scores on the subscale assessing general items were significantly correlated with indices of the therapeutic alliance and predictive of durations of cocaine abstinence achieved. These data suggest that the CMCS is reliable and valid in assessing delivery of CM and that competence in CM delivery is associated with improved patient outcomes.

Factors Associated with Treatment Compliance and its Effects on Retention among Participants in a Court-Mandated Treatment Program

Drug treatment court (DTC) programs have been implemented and promoted in American as well as Canadian judicial systems as an effective tool for reducing criminal recidivism rates. An evaluation of the program in Toronto revealed that the drug court participants' substance abuse and criminal behaviors are reduced while they are under the drug courts' jurisdiction, and to some extent recidivism is reduced after participants leave the program. However, while we know from the literature that there are positive effects of the program, the characteristics of drug-dependent offenders who benefit the most from the DTC are less clear. The main purpose of this study was to understand where the prediction from literature, that compliance determines success in treatment, fails. Thus, study participants were divided into two groups: 1) those who might normally be expected to not comply yet who do in the long run (unexpected retention, UR); and 2) those who might normally be expected to comply, but who do not (unexpected expulsions, UE). Discriminant function analysis showed that participants considered UR were subject to conditions of social disadvantage yet quite motivated; whereas UE participants had no housing concern, no indication of family problems, but had additional criminal justice involvement at an early stage of the program. Implications for strengthening DTCs as well as suggestions for future research in the drug treatment and drug court fields are discussed.

The alliance in motivational enhancement therapy and counseling as usual for substance use problems

Data from a community-based multicenter study of motivational enhancement therapy (MET) and counseling as usual (CAU) for outpatient substance users were used to examine questions about the role of the alliance in MET and CAU. Most (94%) of the sample met diagnostic criteria for abuse or dependence (primarily alcohol and/or cocaine). Sixteen therapists for CAU and 14 for MET participated. No reliable differences in patient ratings (n = 319) on the Helping Alliance Questionnaire-II (HAq-II) were evident for MET compared to CAU, but significant differences between therapists were found within each condition in mean patient-rated HAq-II scores. Overall, average levels of alliance were high. The between-therapists component of the alliance, but not the within-therapist component, was significantly associated with self-reported days of primary substance use during the follow-up period from Week 4 to Week 16 (Cohen's d = 0 .39; n = 257). Therapists with either low or very high alliances had relatively poorer average outcomes (quadratic effect, d = 0.44). For therapists in both MET and CAU, increased use of MET fundamental techniques and MET advanced techniques during treatment sessions was associated with higher levels of alliance. Implications of the findings for conceptualization of the alliance and for training of therapists are discussed.

Implementation fidelity in community-based interventions

Implementation fidelity is the degree to which an intervention is delivered as intended and is critical to successful translation of evidence-based interventions into practice. Diminished fidelity may be why interventions that work well in highly controlled trials may fail to yield the same outcomes when applied in real life contexts. The purpose of this paper is to define implementation fidelity and describe its importance for the larger science of implementation, discuss data collection methods and current efforts in measuring implementation fidelity in community-based prevention interventions, and present future research directions for measuring implementation fidelity that will advance implementation science.

Training and Consultation in Evidence-Based Psychosocial Treatments in Public Mental Health Settings: The ACCESS Model

We present a model of training in evidence-based psychosocial treatments (EBTs). The ACCESS (assess and adapt, convey basics, consult, evaluate, study outcomes, sustain) model integrates principles and findings from adult education and training literatures, research, and practical suggestions based on a community-based clinician training program. Descriptions of the steps are provided as a means of guiding implementation efforts and facilitating training partnerships between public mental health agencies and practitioners of EBTs.

Randomized trial: Quitline specialist training in gain-framed vs standard-care messages for smoking cessation

BACKGROUND

Smoking accounts for a large proportion of cancer-related mortality, creating a need for better smoking cessation efforts. We investigated whether gain-framed messages (ie, presenting benefits of quitting) will be a more persuasive method to encourage smoking cessation than standard-care messages (ie, presenting both costs of smoking [loss-framed] and benefits of quitting).

METHODS

Twenty-eight specialists working at the New York State Smokers' Quitline (a free telephone-based smoking cessation service) were randomly assigned to provide gain-framed or standard-care counseling and print materials. Smokers (n = 2032) who called the New York State Smokers' Quitline between March 10, 2008, and June 13, 2008, were exposed to either gain-framed (n = 810) or standard-care (n = 1222) messages, and all medically eligible callers received nicotine replacement therapy. A subset of 400 call recordings was coded to assess treatment fidelity. All treated smokers were contacted for 2-week and 3-month follow-up interviews. All statistical tests were two-sided.

RESULTS

Specialists providing gain-framed counseling used gain-framed statements statistically significantly more frequently than those providing standard-care counseling as assessed with frequency ratings for the two types of gain-framed statements, achieving benefits and avoiding negative consequences (for achieving benefits, gain-framed mean frequency rating = 3.9 vs standard-care mean frequency rating = 1.4; mean difference = -2.5; 95% confidence interval [CI] = -2.8 to -2.3; P < .001; for avoiding negative consequences, gain-framed mean frequency rating = 1.5 vs standard-card mean frequency rating = 1.0; mean difference = -0.5; 95% CI = -0.6 to -0.3; P < .001). Gain-framed counseling was associated with a statistically significantly higher rate of abstinence at the 2-week follow-up (ie, 99 [23.3%] of the 424 in the gain-framed group vs 76 [12.6%] of the 603 in the standard-care group, P < .001) but not at the 3-month follow-up (ie, 148 [28.4%] of the 522 in the gain-framed group vs 202 [26.6%] of the 760 in the standard-care group, P = .48).

CONCLUSIONS

Quitline specialists can be trained to provide gain-framed counseling with good fidelity. Also, gain-framed messages appear to be somewhat more persuasive than standard-care messages in promoting early success in smoking cessation.

A multisite randomized effectiveness trial of motivational enhancement therapy for Spanish-speaking substance users

Hispanic individuals are underrepresented in clinical and research populations and are often excluded from clinical trials in the United States. Hence, there are few data on the effectiveness of most empirically validated therapies for Hispanic substance users. The authors conducted a multisite randomized trial comparing the effectiveness of 3 individual sessions of motivational enhancement therapy with that of 3 individual sessions of counseling as usual on treatment retention and frequency of substance use; all assessment and treatment sessions were conducted in Spanish among 405 individuals seeking treatment for any type of current substance use. Treatment exposure was good, with 66% of participants completing all 3 protocol sessions. Although both interventions resulted in reductions in substance use during the 4-week therapy phase, there were no significant Treatment Condition x Time interactions nor Site x Treatment Condition interactions. Results suggest that the individual treatments delivered in Spanish were both attractive to and effective with this heterogeneous group of Hispanic adults, but the differential effectiveness of motivational enhancement therapy may be limited to those whose primary substance use problem is alcohol and may be fairly modest in magnitude.

Correspondence of motivational enhancement treatment integrity ratings among therapists, supervisors, and observers

This study examined the correspondence of treatment integrity ratings (adherence and competence) among community program therapists, supervisors, and observers for therapists who used motivational enhancement therapy (MET) within a National Institute on Drug Abuse Clinical Trials Network protocol. The results suggested there was reasonable agreement between the three groups of raters about the presence or absence of several fundamental MET strategies. Moreover, relative to observers, therapists and supervisors were more positive in their evaluations of the therapists' MET adherence and competence. These findings underscore the need for objective monitoring of therapists' performance when using empirically supported treatments and for adequately training therapists and supervisors to evaluate their treatment implementation in community programs, and are consistent with observations that different perspectives on the therapeutic process are not interchangeable.

Client and program factors associated with dropout from court mandated drug treatment

To examine why court mandated offenders dropout of drug treatment and to compare their characteristics, treatment experiences, perceptions, and outcomes with treatment completers, we analyzed self-reported and administrative data on 542 dropouts (59%) and 384 completers (41%) assessed for Proposition 36 treatment by thirty sites in five California counties during 2004. At intake, dropouts had lengthier criminal histories, lower treatment motivation, more severe employment and psychiatric problems, and more were using drugs, especially heroin. Relatively fewer dropouts received residential treatment and their retention was much shorter. A similar proportion of dropouts received services as completers and the mean number of services received per day by dropouts was generally more, especially to address psychiatric problems, during the first three months of treatment. The most commonly offender-reported reasons for dropout included low treatment motivation (46.2%) and the difficulty of the Proposition 36 program (20.0%). Consequences for dropout included incarceration (25.3%) and permission to try treatment again (24.0%). Several factors predicting drug treatment dropout were identified. Both groups demonstrated improved functioning at one-year follow-up, but fewer dropouts had a successful outcome (34.5% vs. 59.1%) and their recidivism rate was significantly higher (62.9% vs. 28.9%) even after controlling for baseline differences. Understanding factors associated with drug treatment dropout can aid efforts to improve completion rates, outcomes, and overall effectiveness of California's Proposition 36 program. Findings may also aid a broader audience of researchers and policy analysts who are charged with designing and evaluating criminal-justice diversion programs for treating drug-addicted offenders.

Evaluating motivational enhancement therapy adherence and competence among Spanish-speaking therapists

Despite the fact that the number of Hispanic individuals in need of treatment for substance use problems is increasing internationally, no studies have investigated the extent to which therapists can provide empirically supported treatments to Spanish-speaking clients with adequate fidelity. Twenty-three bilingual Hispanic therapists from five community outpatient treatment programs in the United States were randomly assigned to deliver either three sessions of motivational enhancement therapy (MET) or an equivalent number of drug counseling-as-usual (CAU) sessions in Spanish to 405 Spanish-speaking clients randomly assigned to these conditions. Independent ratings of 325 sessions indicated the adherence/competence rating system had good to excellent interrater reliability and indicated strong support for an a priori defined fundamental MET skill factor. Support for an advanced MET skill factor was relatively weaker. The rating scale indicated significant differences in therapists' MET adherence and competence across conditions. These findings indicate that the rating system has promise for assessing the performance of therapists who deliver MET in Spanish and suggest that bilingual Spanish-speaking therapists from the community can be trained to implement MET with adequate fidelity and skill using an intensive multisite training and supervision model.

Construct, concurrent and predictive validity of the URICA: data from two multi-site clinical trials

BACKGROUND

A better understanding of how to measure motivation to change and how it relates to behavior change in patients with drug and alcohol dependence would broaden our understanding of the role of motivation in addiction treatment.

METHODS

Two multi-site, randomized clinical trials comparing brief motivational interventions with standard care were conducted in the National Institute on Drug Abuse Clinical Trials Network. Patients with primary drug dependence and alcohol dependence entering outpatient treatment participated in a study of either Motivational Enhancement Therapy (n=431) or Motivational Interviewing (n=423). The construct, concurrent, and predictive validity of two composite measures of motivation to change derived from the University of Rhode Island Change Assessment (URICA): Readiness to Change (RTC) and Committed Action (CA) were evaluated.

RESULTS

Confirmatory factor analysis confirmed the a priori factor structure of the URICA. RTC was significantly associated with measures of addiction severity at baseline (r=.12-.52, p<.05). Although statistically significant (p<.01), the correlations between treatment outcomes and RTC were low (r=-.15 and -18). Additional analyses did not support a moderating or mediating effect of motivation on treatment retention or substance use.

CONCLUSIONS

The construct validity of the URICA was confirmed separately in a large sample of drug- and alcohol-dependent patients. However, evidence for the predictive validity of composite scores was very limited and there were no moderating or mediating effects of either measure on treatment outcome. Thus, increased motivation to change, as measured by the composite scores of motivation derived from the URICA, does not appear to influence treatment outcome.

Informal discussions in substance abuse treatment sessions

This study evaluated the extent to which counselors initiated informal discussions (i.e., general discussions and self-disclosures about matters unrelated to treatment) with their clients during treatment sessions within two National Institute on Drug Abuse Clinical Trial Network protocols involving adaptations of motivational interviewing (MI). Sixty counselors across the two protocols had 736 sessions independently rated for counselor treatment fidelity and the occurrence of informal discussions. The results showed that 88% of the counselors initiated informal discussions in their sessions and that most of these discussions involved counselors sharing personal information or experiences they had in common with their clients. The major finding was that counselor training in MI was associated with significantly less informal discussion across sessions. A higher frequency of informal discussion was related to less counselor MI proficiency and less in-session change in client motivation, although unrelated to client program retention and substance use outcomes. The findings suggest that although some informal discussions may help build an alliance between counselors and clients, too much of it may hinder counselors' proficient implementation of MI treatment strategies and the clients' motivational enhancement process.

What is usual about "treatment-as-usual"? Data from two multisite effectiveness trials

Despite increased emphasis on broadening the implementation of empirically supported therapies (ESTs) to improve standard clinical practice and patient outcomes, objective descriptions of what actually constitutes standard practice in community-based drug abuse treatment do not exist. We present data from independent ratings of 379 audiotapes drawn from the "treatment-as-usual" arm of two multisite randomized effectiveness trials in the National Institute on Drug Abuse Clinical Trials Network. As expected, the most frequently occurring strategies involved assessing the participant's substance use and social functioning, asking open-ended questions, discussing problems and feedback, and giving advice and direction. However, a number of interventions associated with ESTs were very rarely implemented in these early sessions. These data suggest missed opportunities for optimally engaging patients in the early stages of treatment and enhancing substance use outcomes and only moderate success to date of efforts to bridge the gap between research and practice.