The dependability of alliance assessments: the alliance-outcome correlation is larger than you might think

OBJECTIVE

To examine the dependability of alliance scores at the patient and therapist level, to evaluate the potential causal direction of session-to-session changes in alliance and depressive symptoms, and to investigate the impact of aggregating the alliance over progressively more sessions on the size of the alliance-outcome relationship.

METHOD

We used data from a study (N = 45 patients; N = 9 therapists) of psychotherapy for major depressive disorder in which the alliance was measured at every treatment session to calculate generalizability coefficients and to predict change in depressive symptoms from alliance scores. Two replication samples were also used.

RESULTS

At the therapist level, a large number of patients (about 60) per therapist is needed to provide a dependable therapist-level alliance score. At the patient level, generalizability coefficients revealed that a single assessment of the alliance is only marginally acceptable. Very good (>.90) dependability at the patient level is only achieved through aggregating 4 or more assessments of the alliance. Session-to-session change in the alliance predicted subsequent session-to-session changes in symptoms. Evidence for reverse causation was found in later-in-treatment sessions, suggesting that only aggregates of early treatment alliance scores should be used to predict outcome. Session 3 alliance scores explained 4.7% of outcome variance, but the average of Sessions 3-9 explained 14.7% of outcome variance.

CONCLUSION

Adequate assessment of the alliance using multiple patients per therapist and at least 4 treatment sessions is crucial for fully understanding the size of the alliance-outcome relationship.

Combined medication and cognitive therapy for generalized anxiety disorder

The current study assessed efficacy of combined cognitive behavioral therapy (CBT) and venlafaxine XR compared to venlafaxine XR alone in the treatment of generalized anxiety disorder (GAD) within settings where medication is typically offered as the treatment for this disorder. Patients with DSM-IV-diagnosed GAD who were recently enrolled in a long-term venlafaxine XR study were randomly offered (n=77), or not offered (n=40), the option of adding 12 sessions of CBT. Of those offered CBT, 33% (n=26) accepted and attended at least one treatment session. There were no differences between the combined treatment group and the medication only group on primary or secondary efficacy measures in any of the sample comparisons. Many patients who present in medical/psychopharmacology settings seeking treatment for GAD decline the opportunity to receive adjunctive treatment. Of those that receive CBT, there appears to be no additional benefit of combined treatment compared to venlafaxine XR alone.

A generalizability theory analysis of group process ratings in the treatment of cocaine dependence

Videotaped group drug counseling sessions were rated for alliance, self-disclosure, positive and negative feedback, group cohesion, and degree of participation of each group member. Interrater reliability was good to excellent for most measures. However, generalizability coefficients based on statistical models that included terms for patient, counselor, session, group, and rater revealed that some measures had inadequate dependability at the patient level if only two raters and two sessions were used to create patient-level scores. In contrast, good generalizability coefficients based on two raters and two sessions were obtained for alliance, non-positive learning statements received from counselor, participation variables, and self-disclosures about the past. The implications of the findings for the design of process-outcome studies are discussed.

A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs

The purpose of this study was to examine the effects of feedback provided to counselors on the outcomes of patients treated at community-based substance abuse treatment programs. A version of the Outcome Questionnaire (OQ-45), adapted to include drug and alcohol use, was administered to patients (N = 304) in 3 substance abuse treatment clinics. Phase I of the study consisted only of administration of the assessment instruments. Phase II consisted of providing feedback reports to counselors based on the adapted OQ-45 at every treatment session up to Session 12. Patients who were found to not be progressing at an expectable rate (i.e., "offtrack") were administered a questionnaire that was used as a second feedback report for counselors. For offtrack patients, feedback compared with no feedback led to significant linear reductions in alcohol use throughout treatment and also in OQ-45 total scores and drug use from the point of the second feedback instrument to Session 12. The effect for improving mental health functioning was evident at only 1 of the 3 clinics. These results suggest that a feedback system adapted to the treatment of substance use problems is a promising approach that should be tested in a larger randomized trial.

Program, counselor, and patient variability in the alliance: a multilevel study of the alliance in relation to substance use outcomes

We explored patient, therapist, and program variability in the alliance in relation to drug and alcohol use during treatment, and whether alliance mediates the relation of program characteristics to drug/alcohol use. Data (N = 1,613 patients) were drawn from a randomized clinical trial investigating the efficacy of an intervention that provided alliance and outcome feedback to 112 counselors across 20 community-based outpatient substance abuse treatment clinics in the northeast United States. Program characteristics were measured using the Organization Readiness for Change scale. Using multilevel modeling, we found that alliance was related to both drug and alcohol use during the past week at the patient and program levels of analysis, but not the counselor level. Several program characteristics were related to average drug and alcohol use. The alliance was not a mediator of these relationships. Program variability in the alliance is important to the alliance-outcome relationship in the treatment of substance abuse. Better outcomes can be achieved by improving both organizational functioning and the patient-counselor alliance.

Unique and common mechanisms of change across cognitive and dynamic psychotherapies

The goal of this article was to examine theoretically important mechanisms of change in psychotherapy outcome across different types of treatment. Specifically, the role of gains in self-understanding, acquisition of compensatory skills, and improvements in views of the self were examined. A pooled study database collected at the University of Pennsylvania Center for Psychotherapy Research, which includes studies conducted from 1995 to 2002 evaluating the efficacy of cognitive and psychodynamic therapies for a variety of disorders, was used. Patient samples included major depressive disorder, generalized anxiety disorder, panic disorder, borderline personality disorder, and adolescent anxiety disorders. A common assessment battery of mechanism and outcome measures was given at treatment intake, termination, and 6-month follow-up for all 184 patients. Improvements in self-understanding, compensatory skills, and views of the self were all associated with symptom change across the diverse psychotherapies. Changes in self-understanding and compensatory skills across treatment were predictive of follow-up symptom course. Changes in self-understanding demonstrated specificity of change to dynamic psychotherapy.

A pilot study of community-friendly manual-guided drug counseling

Therapist training manuals that are more "community friendly" are needed to facilitate effectiveness testing and dissemination of treatments to community based setting. The aim of the current project was to create revised versions of individual drug counseling (IDC) and group drug counseling (GDC) treatment manuals for cocaine dependence and to conduct a preliminary study of their effectiveness. After changing the format and context of existing drug counseling manuals to have greater ease of use in the community, draft manuals were given to 23 community-based counselors for their feedback. Final versions were then used in a pilot randomized clinical trial involving 41 cocaine-dependent patients who received 3 months of either IDC + GDC or GDC-alone treatment. Counselors implemented the new treatment manuals with acceptable levels of adherence and competence. Outcome results indicated that substantial change in drug use was evident, but the amount of abstinence obtained was limited.

Dopamine transporter levels in cocaine dependent subjects

Cocaine use is a significant problem in the US and it is well established that cocaine binds to the dopamine transporter (DAT) in the brain. This study was designed to determine if the DAT levels measured by 99mTc TRODAT SPECT (single photon emission computed tomography) brain scans are altered in cocaine dependent subjects and to explore clinical correlates of such alterations. SPECT brain scans were acquired on 21 cocaine dependent subjects and 21 healthy matched controls. There were significantly higher DAT levels in cocaine dependent subjects compared to controls for the anterior putamen (p=0.003; Cohen's d effect size=0.98), posterior putamen (p<0.001; effect size=1.32), and caudate (p=0.003; effect size=0.97). DAT levels in these regions were 10%, 17%, and 8% higher in the cocaine dependent subjects compared to controls. DAT levels were unrelated to craving, severity of cocaine use, or duration of cocaine use, but DAT levels in the caudate and anterior putamen were significantly (p<0.05) negatively correlated with days since last use of cocaine.

Supportive-Expressive Psychodynamic Therapy for Cocaine Dependence: A Closer Look

Using data from the National Institute on Drug Abuse Collaborative Cocaine Treatment Study, this article focuses on the outcomes of patients who received supportive-expressive (SE) psychodynamically-oriented psychotherapy (plus group drug counseling; GDC). Short-term SE for cocaine dependent individuals, while not the most efficacious treatment examined in the study (individual drug counseling [IDC] plus GDC was), produced large improvements in cocaine use. In addition, there was evidence that SE was superior to IDC on change in family/social problems at the 12 month follow-up assessment, particularly for those patients with relatively more severe difficulties in this domain at baseline. For patients who achieved abstinence early in treatment, SE produced comparable drug use outcomes to IDC, with mean drug use scores numerically lower for SE at all of the follow-up assessments (9, 12, 15, and 18 months). SE patients who achieved initial abstinence decreased cocaine use from a mean 10.1 days per month at baseline to a mean of 1.3 days at 12 months.

Additional treatment services in a cocaine treatment study: level of services obtained and impact on outcome

The objective of this study was to examine the level of additional treatment services obtained by patients enrolled in the NIDA Cocaine Collaborative Study, a multi-center efficacy trial of four treatments for cocaine dependence, and to determine whether these services impact treatment outcome. Cocaine-dependent patients (N = 487) were recruited at five sites and randomly assigned to six months of one of four psychosocial treatments. Assessments were made at baseline, monthly during treatment, and at follow-ups at 9, 12, 15, and 18 months post-randomization. On average, patients received little or no additional treatment services during active treatment (first six months), but the rate of obtaining most services increased during the follow-up phase (month 7 to 18). In general, the treatment groups did not differ in the rates of obtaining non-protocol services. For all treatment groups, patients with greater psychiatric severity received more medical and psychiatric services during active treatment and follow-up. Use of treatment services was unrelated to drug use outcomes during active treatment. However, during the follow-up period, increased use of psychiatric medication, twelve-step attendance, and twelve-step participation was related to less drug use. The results suggest that during uncontrolled follow-up phases, additional non-protocol services may potentially confound the interpretation of treatment group comparisons in drug use outcomes.

Changes in Positive Quality of Life over the Course of Psychotherapy

The objective of this study was to examine patients' reports of positive quality of life over the course of multiple forms of psychotherapy and disorders. Data from five studies using a common assessment battery were pooled to evaluate the magnitude of change in positive quality of life and explore the relation of change in positive quality of life to change in symptoms, and how these relations vary by disorder. Positive quality of life was measured at intake, termination, and during two post-treatment visits 6 and 12 months following termination. Results revealed that positive quality of life improves moderately over the course of psychotherapy and sustains the improvement through follow-up. Levels of positive quality of life and the degree of change in positive quality of life varied considerably by disorder. There also were moderate sized correlations between changes in positive quality of life and changes in symptomatic response and interpersonal functioning from intake to termination. Implications of the findings for clinical practice and future research are discussed.

Women on welfare: a study of the Florida WAGES population

Using the ASI, a multi-dimensional survey instrument, data were collected on women in Florida's welfare program (WAGES). The women manifested serious problems in terms of physical and mental health, employment skills and childcare needs. Length of time on welfare was strongly associated with the severity of recipients' problems. Women with 2 + years on welfare were significantly more likely to have problems. However, substance use was lower than anticipated which may be because substance abusers are dropping out of welfare. This possibility raises concerns that, rather than going into the workfore, women may be returning to the streets. If so, instead of reducing the welfare costs, we are shifting those costs to local health, social service and criminal justice systems.

Critical issues in adolescent substance use assessment

Despite advances in methodology and instrumentation, the assessment of adolescent drug and alcohol involvement remains a complex clinical and practical process. It requires the careful and skillful implementation of procedures across a wide range of service systems and providers. While the literature identifies and provides information on singular aspects of the assessment of adolescents, few sources furnish an integrated overview of the key issues necessary for appropriate and accountable assessment. Consequently, this paper synthesizes theoretical, research, and clinical issues into a practical framework that can be used by clinical and research staff making assessment decisions. Issues discussed have been informed by the literature and by our collective experience during the 8-year development and testing of the Comprehensive Adolescent Severity Inventory (CASI).