Patient characteristics and variability in adherence and competence in cognitive-behavioral therapy for panic disorder

Where it all begins: Predicting initial therapeutic skills before clinical training in cognitive behavior therapy

To train novice students adequately, it is crucial to understand where they start and how they develop their skills. This study examined the impact of novice students' characteristics on their initial clinical micro-skills when treating simulated patients with cognitive behavior therapy. The sample consisted of 44 graduate psychology students treating seven simulated patients. Clinical micro-skills were measured both using video-based ratings in reaction to short video clips of simulated patients (via the Facilitative Interpersonal Skills (FIS) performance task) and by using video-based ratings within a session with a simulated patient (using the Inventory of Therapeutic Interventions and Skills; ITIS). Two separate LASSO regressions were performed using machine learning to select potential predictors for both skills assessments. Subsequently, a bootstrapping algorithm with 10,000 iterations was used to examine the variability of regression coefficients. Using LASSO regression, we identified two predictors for clinical micro-skills in standardized scenarios: extraversion (b = 0.10) and resilience (b = 0.09), both were not significantly associated with clinical micro-skills. Together, they explained 15% of the skill variation. Bootstrapping confirmed the stability of these predictors. For clinical micro-skills in sessions, only competitiveness was excluded by LASSO regression, and all predictors showed significant instability. The results provide initial evidence that trainees' resilience and extraversion should be promoted in the clinical training of cognitive behavior therapy. More studies on clinical micro-skills and training with larger sample sizes are needed to fully understand clinical development.

You never know what you are going to get: Large-scale assessment of therapists' supportive counseling skill use

Supportive counseling skills like empathy and active listening are critical ingredients of all psychotherapies, but most research relies on client or therapist reports of the treatment process. This study utilized machine-learning models trained to evaluate counseling skills to evaluate supportive skill use in 3,917 session recordings. We analyzed overall skill use and variation in practice patterns using a series of mixed effects models. On average, therapists scored moderately high on observer-rated empathy (i.e., 3.8 out of 5), 3.3% of the therapists' utterances in a session were open questions, and 12.9% of their utterances were reflections. However, there were substantial differences in skill use across therapists as well as across clients within-therapist caseloads. These findings highlight the substantial variability in the process of counseling that clients may experience when they access psychotherapy. We discuss findings in the context of both the need for therapists to be responsive and flexible with their clients, but also potential costs related to the lack of a more uniform experience of care. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Systematic review of training in cognitive-behavioral therapy: Summarizing effects, costs and techniques

With the steadily growing importance of psychotherapeutic care, there is also an increasing need for high-quality training. We analyze the literature published between 2009 and 2022 on the effectiveness of training in cognitive behavioral therapy. The review addresses current gaps in the literature by focusing on the description of specific training components and their associated costs, as well as examining therapist-level predictors of training effectiveness. Our findings confirm the effect of additional supervision on both therapist competence and patient outcomes. Instructor-led training and self-guided web-based training seem to moderately increase competence, especially when targeting specific and highly structured treatments or skills. The level of prior training and experience of a therapist appears to predict the strength of training-related gains in competence. Few studies analyzed the differential effect of certain elements of training (e.g., the amount of active learning strategies) and training costs were generally not reported. Future studies should replicate or expand the existing evidence on active ingredients and therapist-level predictors of training effectiveness. Costs should be systematically reported to enhance the comparability of different training strategies.

Session-to-session effects of therapist adherence and facilitative conditions on symptom change in CBT and IPT for depression

OBJECTIVE

The objective of this study was to analyze the effect of adherence to both specific technique factors and facilitative condition variables (e.g., therapists' involvement, understanding and support) in Cognitive Behavior Therapy (CBT) and Interpersonal Psychotherapy (IPT). In addition, we were interested in whether the effect of therapist adherence would depend on the level of the working alliance.

METHOD

Three sessions each from 74 patients diagnosed with Major Depressive Disorder who were randomized to 14 sessions of IPT or CBT were rated for adherence using a modified version of The Collaborative Study Psychotherapy Rating Scale-6 (CSPRS-6). Data was analyzed using Multilevel Modeling.

RESULTS

No effects of adherence to specific factors on outcome were found in neither CBT nor IPT. Facilitative conditions were associated with better outcome in CBT but not in IPT, even after adjustment for the quality of the working alliance. No interaction effects were found.

CONCLUSIONS

Our findings highlight the importance of relational factors in CBT, but do not support the need for specific adherence to any of the two treatments. Possible explanations of the findings and directions for future research are discussed.Trial registration: ClinicalTrials.gov identifier: NCT01851915.

Problematic Anger in the Military: Focusing on the Forgotten Emotion

PURPOSE OF REVIEW

Problematic anger is common in veteran and military populations, yet understudied relative to other mental health difficulties. However, in recent years, more clinical and research attention has been turned to problematic anger. This paper highlights important new findings in the epidemiology, course, and neurobiology of anger, the associations of anger with other mental health problems and risk, and next steps for research and practice.

RECENT FINDINGS

In longitudinal research, findings show that problematic anger changes over the life course of military members and veterans, and that deployment increases the likelihood of problematic levels of anger. Problematic anger is related to a range of mental health issues, most perniciously aggression and suicidality. Promising new assessment and treatment approaches are emerging, including innovations that leverage digital technology. Key areas of research include advancing assessment of problematic anger to identify patterns of heterogeneity, as well as advancing the evidence base for anger treatments. Recommended progress in clinical practice include conducting routine assessment of problematic anger in veteran and military populations, developing prevention and early intervention for at risk individuals, and optimizing the timing of interventions throughout the military lifecycle.

How does hostile resistance interfere with the benefits of cognitive-behavioral therapy for panic disorder? The role of therapist adherence and working alliance

Objective Although clients' hostile behavior directed at therapists (hostile resistance) predicts worse outcomes in cognitive-behavioral therapy (CBT) for panic disorder, the process by which this happens remains unknown. This study examines two putative mechanisms: working alliance and therapist adherence. Method: Seventy-one adults with primary panic disorder received CBT in a larger trial. Hostile resistance and adherence in Sessions 2 and 10 were reliably coded using observer-rated measures; client- and therapist-rated questionnaires assessed working alliance. Outcome measures were attrition and symptomatic improvement, assessed at multiple timepoints with the Panic Disorder Severity Scale. Results: Hostile resistance was significantly related to both preexisting (r  = -.36, p  =  .04) and subsequent declines (r  = -.58, p  <  .0001) in the working alliance. Nevertheless, hierarchical linear modeling revealed that neither a declining alliance nor therapist adherence (whether treated as linear or curvilinear) was independently predictive of symptom change, nor did these factors mediate hostile resistance's association with worse symptomatic improvement. Exploratory logistic regressions similarly indicated that neither adherence nor alliance moderated whether hostilely resistant clients dropped out. Conclusion: This is the first study to establish a bidirectional association between hostile resistance and a declining working alliance. Findings also add to a mixed literature on the adherence-outcome relationship.

Competence in Delivering Cognitive Processing Therapy and the Therapeutic Alliance Both Predict PTSD Symptom Outcomes

Cognitive Processing Therapy (CPT) is efficacious in treating PTSD, but there remains a need to improve outcomes for individuals who do not fully respond to treatment. Differences between patient-therapist dyads in the fidelity (i.e., adherence and competence) of CPT delivery and the quality of the therapeutic relationship may partly explain differential levels of symptom improvement. Sessions were sampled from a randomized trial comparing different consultation conditions in training therapists new to CPT. Among 69 patients, one session from Sessions 1-3 and one session from Sessions 4-7 were reliably rated for adherence and competence using the CPT Therapist Adherence and Competence Scale, and for therapeutic alliance using the Working Alliance Inventory-Observer scale. Mixed models, including detrending using a fixed effect of session, predicted self-reported Posttraumatic Stress Disorder Checklist (PCL-IV) scores in one session using process scores from the previous session. The statistical interaction between fidelity and alliance scores to predict outcome was also examined. Alliance had significant, positive correlations (rs = 0.18-0.21) with same-session adherence and competence. Higher competence scores and higher therapeutic alliance scores in one session were independently associated with lower PCL-IV scores in the subsequent session. Adherence scores, which tended to be very high with relatively less variability, did not significantly relate to subsequent-session PCL-IV scores. Competence significantly interacted with alliance, such that sessions high in both competence and alliance predicted especially lower subsequent-session PCL-IV scores. A strong therapeutic alliance may have a synergistic, salutary effect with the competent delivery of CPT.

The Resistance Vignette Task: Validating a rapid measure of therapist skill at managing resistance

BACKGROUND

Therapist appropriate responsivity to client ambivalence and resistance is considered an important interpersonal skill to avoid disengagement and ensure a continued collaborative, productive process. The present study examined the predictive validity of the newly developed Resistance Vignette Task (RVT), a 10-item rapidly administered measure of therapist ability to appropriately respond to various presentations of client resistance.

METHODS

Following a resistance management workshop, the concurrent and prospective predictive capacity of RVT scores were examined through test interviews with ambivalent simulators and volunteers.

RESULTS

Prospectively, in test interviews with ambivalent interviewees, higher RVT scores immediately postworkshop were associated with significantly greater responsivity (appropriate responsivity and fewer responsivity errors) at 4-month follow-up. RVT scores at the 4-month follow-up point were also concurrently associated with significantly greater therapist responsivity and lower levels of interviewee resistance.

CONCLUSIONS

These findings provide further validation for the RVT as a measure of therapist responsivity in vivo, in actual interviews by predicting and being concurrently associated with therapist performance in response to client resistance. Thus, the RVT holds promise in advancing therapist training, as well as research on resistance as it represents an efficient measure of this key therapist skill.

Does it blend? Exploring therapist fidelity in blended CBT for anxiety disorders

Blended cognitive-behavioural therapy (bCBT) combines face-to-face CBT (FtFCBT) and Internet-based CBT (iCBT) into one integrated treatment protocol, opening up new ways to deliver therapy, increase cost-effectiveness and resolve scarcity of therapist availability. When traditional therapy is transformed into a new format, there is a need to evaluate whether principles of the new protocol are consistently applied. This study aimed to explore therapist fidelity to bCBT protocols for anxiety disorders in specialised mental health care and to assess whether fidelity is related to patient characteristics. Adult patients (N = 44) received bCBT within a randomised controlled trial. Ratio of FtF to online sessions, session frequency and therapist adherence to instructions were assessed. Overall therapist fidelity with regard to ratio of blending, session frequency and instructions was high. Correlations were found between patients' share of online sessions and both session frequency (r = 0.373, p = .013), as well as patient computer experience (r = 0.314, p = .038). Adherence to instructions in FtF sessions was based on a subset of patients (n = 23) and should therefore be interpreted with caution. The blended approach was generally delivered as intended, indicating that the format is feasible in specialised mental health.

Shedding light on the effects of supportive techniques on nonverbal synchrony and their moderators in psychotherapy for depression

Objective: Accumulating research demonstrates the importance of utilizing supportive techniques in psychotherapy; however, little is known about therapeutic processes that are set in motion following the use of supportive techniques. The present study examined the effects of supportive techniques on nonverbal synchrony, both at the sample level and at the individual differences level.Method: The sample consisted of 86 patients from a randomized controlled trial for treatment of depression. Supportive techniques were rated by patients and therapists after every session, and nonverbal synchrony was quantified by motion energy analysis (MEA) for each session. The ability of supportive techniques to predict subsequent nonverbal synchrony was examined using polynomial regression and response surface analysis.Results: The findings suggest that, at the sample level, greater use of supportive techniques was a significant predictor of subsequent higher levels of nonverbal synchrony. At the individual differences level, this effect was significant for patients with low levels of depression severity and personality disorders, yet not significant for patients with high levels.Conclusion: The present study demonstrates that greater use of supportive techniques in treatment may facilitate a process that manifests as higher levels of synchrony, especially for patients with lower levels of personality disorders and depression.

Comparing Fidelity Outcomes of Paraprofessional and Professional Delivery of a Perinatal Depression Preventive Intervention

Mothers and Babies (MB), a perinatal depression preventive intervention, has proven effective in decreasing depressive symptoms and preventing onset of major depression. An ongoing cluster-randomized trial is comparing the effectiveness of the six-session MB group intervention led by paraprofessionals versus mental health professionals. Twenty percent of all audio-recorded intervention sessions were randomly selected for fidelity checks. Analyses assessed mean facilitator adherence and competency overall, by study arm, and by session; and, examined site, facilitator, and client-specific effects. There were no significant differences found between study arms. Findings show paraprofessionals can deliver MB with similar fidelity as mental health professionals.

The Dialectical Behavior Therapy Adherence Coding Scale (DBT ACS): Psychometric properties

The Dialectical Behavior Therapy Adherence Coding Scale (DBT ACS) is an observer-rated measure used to evaluate the extent to which therapists deliver individual and group DBT with adherence to the manual. Despite its frequent use in clinical trials of DBT, relatively little is known about its psychometric properties. The present study utilized data from six clinical trials conducted in research and community settings with a variety of patient populations. Across these studies, the DBT ACS was used to code a total of 1,271 DBT individual therapy sessions and 180 DBT group sessions. Results indicate the DBT ACS computed global score has good internal consistency (α = .81) and excellent interrater reliability (ICC = .93). A confirmatory factor analysis found that a single factor yielded acceptable goodness of fit indices. The DBT ACS discriminated between DBT and another treatment and between research and community therapists. Across studies, variability in adherence scores was attributable more to therapists (33%) than to patients (15%). Both therapist and patient variability were higher in effectiveness than efficacy trials. Generalizability coefficients indicated that 5 sessions are needed to estimate a dependable adherence score at the patient level, whereas 9-15 sessions are needed to achieve adequate generalizability at the therapist level. Fewer sessions were needed to yield dependable scores for community therapists compared to research therapists. The DBT ACS appears to be a reliable, valid, and dependable method of assessing therapist adherence to individual and group DBT across diverse treatment settings, therapist types, and patient populations. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Patient, therapist, and relational antecedents of hostile resistance in cognitive-behavioral therapy for panic disorder: A qualitative investigation

Hostile resistance (clients' openly combative behavior directed at therapists) predicts poor outcomes in cognitive-behavioral therapy (CBT) for panic disorder, but its origins are poorly understood. It is important to have a holistic understanding of the etiology of hostile resistance that incorporates the therapeutic context if these behaviors-and their negative consequences-are to be prevented and effectively addressed. Of the 71 adults who received CBT for panic disorder as part of larger trial, 8 exhibited hostile resistance. Grounded theory methodology was used to develop a theoretical framework to understand why these patients became hostile in session. The 10 minutes of session preceding instances of hostile resistance and matched portions of sessions from five never hostile controls were coded. Two pathways to hostile resistance emerged-one in which patient characteristics were primary and one wherein therapist failures (particularly of empathy) were primary. Being a challenging patient (i.e., narcissistic, obsessive, angry, resistant) moderated which pathway was followed. However, even among challenging patients, rarely was hostile resistance attributable to patients' dispositions alone. Most often, patient factors interacted with therapist (e.g., displays of frustration) and treatment (e.g., directiveness, degree of structure) factors to produce such resistance. Contrary to the view of hostile resistance as simply a product of a hostile patient, the picture is more complex. Findings indicate that greater attention to common factors in CBT and more flexible applications of treatment protocols is warranted. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

A Glimpse into the "Black Box": Which Elements of Consultation in an EBP are Associated with Client Symptom Change and Therapist Fidelity?

Background: Consultation is an implementation strategy that improves delivery and clinical outcomes for Cognitive Processing Therapy (CPT), an evidence-based practice (EBP) for posttraumatic stress disorder (PTSD). However, little is known about the specific components of consultation that influence the fidelity of treatment delivery or clinical outcomes. Methods: The current study examined whether specific activities performed during CPT consultation meetings were associated with better fidelity to the CPT protocol among 60 newly trained therapists or improved clinical outcomes among 135 clients treated by these therapists. Consultation activities that fall under three broad categories (discussion of the application of CPT to individual cases, review/feedback on fidelity, and technical difficulties) were measured by consultant checklists for each consultation session. Treatment fidelity (adherence to the protocol and competence of delivery) was rated by trained observers for a random sample of therapists' CPT sessions following consultation. The self-reported PTSD Checklist-IV assessed PTSD symptom change. Results: Multilevel regression analyses indicated that higher therapist consultation attendance predicted a greater decrease in their clients' PTSD symptoms and that attendance was not associated with observer-rated treatment fidelity. Discussion of the application of specific CPT strategies was the only consultation activity that was significantly associated with greater improvement in PTSD symptoms. Lastly, no consultation activities were significantly associated with treatment fidelity. Conclusions: Our findings suggest that specific consultation strategies such as emphasizing the discussion of the application of specific CPT strategies to individual cases during consultation meetings may be effective in improving the clinical outcomes of CPT.

An exploration of the relationships between patient application of CBT skills and therapeutic outcomes during a two-week CBT treatment

The application of Cognitive Behavioural Therapy (CBT) skills are believed to be a mechanism of therapeutic change in treatment. Research has shown that the application of CBT skills affects outcomes, however, the way these relationships may change during treatment has not been explored. In this study, a naturalistic observational approach is used to examine the relationships between patients' wellbeing, symptoms, and the application of CBT skills throughout treatment. It is hypothesized that the application of CBT skills would lead to an increase in patients reported wellbeing, and a decrease in symptoms. Additionally, it was hypothesized that the application of CBT skills affects wellbeing and symptoms at different points in therapy. A sample of 584 patients in a two-week CBT treatment completed session-to-session measures of wellbeing, symptoms, and their application of CBT skills. Results of an autoregressive cross-lagged path analysis indicated that in the early stages of treatment the application of CBT skills predicted patient wellbeing but not symptoms. At the later stages of therapy, the application of CBT skills predicted both patient wellbeing and symptoms. At no point in treatment did patient wellbeing or symptoms predict the later application of CBT skills. Implications and future directions for research are discussed.

Assessing panic disorder-specific competencies: evaluation of the Cognitive Therapy Competence Scale for panic disorder

BACKGROUND

Evidence-based treatment for panic disorder consists of disorder-specific cognitive behavioural therapy (CBT) protocols. However, most measures of CBT competence are generic and there is a clear need for disorder-specific assessment measures.

AIMS

To fill this gap, we evaluated the psychometric properties of the Cognitive Therapy Competence Scale (CTCP) for panic disorder.

METHOD

CBT trainees (n = 60) submitted audio recordings of CBT for panic disorder that were scored on a generic competence measure, the Cognitive Therapy Scale - Revised (CTS-R), and the CTCP by markers with experience in CBT practice and evaluation. Trainees also provided pre- to post-treatment clinical outcomes on disorder-specific patient report measures for cases corresponding to their therapy recordings.

RESULTS

The CTCP exhibited strong internal consistency (α = .79-.91) and inter-rater reliability (ICC = .70-.88). The measure demonstrated convergent validity with the CTS-R (r = .40-.54), although investigation into competence classification indicated that the CTCP may be more sensitive at detecting competence for panic disorder-specific CBT skills. Notably, the CTCP demonstrated the first indication of a relationship between therapist competence and clinical outcome for panic disorder (r = .29-.35); no relationship was found for the CTS-R.

CONCLUSIONS

These findings provide initial support for the reliability and validity of the CTCP for assessing therapist competence in CBT for panic disorder and support the use of anxiety disorder-specific competence measures. Further investigation into the psychometric properties of the measure in other therapist cohorts and its relationship with clinical outcomes is recommended.

Stepped-care versus treatment as usual in panic disorder: A randomized controlled trial

Stepped-care (SC) models for anxiety disorders are implemented on a large scale and are assumed to be as effective for the greater majority of patients as more intensive treatment schemes. To compare the outcomes of SC and international guideline-based treatment (Treatment as Usual: TAU) for panic disorder, a total of 128 patients were randomized to either SC or TAU (ratio 2: 1, respectively) using a computer generated algorithm. They were treated in four mental health care centres in the Netherlands after therapists had been trained in SC by a senior expert therapist. SC comprised 10-week guided self-help (pen-and-paper version) followed, if indicated, by 13-week manualized face-to-face cognitive behavioural therapy (CBT), with medication- if prescribed- kept constant. TAU consisted of 23-week regular face-to-face CBT (RCBT) with medication -when prescribed- also kept constant. The means of the attended sessions in the SC condition was 5.9 (SD = 4.8) for ITT and 9.6 (SD = 9.6) for the RCBT condition. The difference in the number of attended sessions between the conditions was significant (t(126) = -3.87, p < .001). Remission rates between treatment conditions did not differ significantly (SC: 44.5%; RCBT: 53.3%) and symptom reduction was similar. Stepping up SC treatment to face-to-face CBT showed a minimal additional effect. Importantly, drop-out rates differed significantly for the two conditions (SC: 48.2%; RCBT: 26.7%). SC was effective in the treatment of panic disorder in terms of symptom reduction and remission rate, but dropout rates were twice as high as those seen in RCBT, with the second phase of SC not substantially improving treatment response. However, SC required significantly less therapist contact time compared to RCBT, and more research is needed to explore predictors of success for guided self-help interventions to allow treatment intensity to be tailored to patients' needs and preferences.

A systematic review exploring therapist competence, adherence, and therapy outcomes in individual CBT for children and young people

Objective: Whilst the evidence base for cognitive behavioural therapy (CBT) with children and young people is growing, the mechanisms through which these beneficial effects occur are still unclear. This systematic review seeks to appraise the relationship between therapeutic outcomes in CBT and therapist adherence and competence, within the child and adolescent literature. Method: A systematic review was carried out, with five studies identified as meeting the inclusion criteria. Results: The literature is currently small and inconclusive. Amongst the studies reviewed, there were inconsistent findings, with minimal-to-no effect sizes found between adherence, competence, and outcomes. Conclusions: The current paucity of research in this area means that conclusions are currently limited. The role and impact of adherence and competence on therapeutic outcomes remains unclear within individual CBT in a child population. This is comparable with the current adult literature, where findings also remain inconclusive. Further research avenues are discussed.

The Relationship of MMPI-2-RF Scales to Treatment Engagement and Alliance

Clients' personality characteristics can be important correlates of treatment engagement and alliance. The Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) is one of the most comprehensive and widely used personality measures in clinical settings and includes measures of symptom validity. A few prior studies using the MMPI-2 and MMPI-2-RF suggest that externalizing characteristics and the validity scales might be associated with treatment engagement, but no studies to date have examined MMPI correlates of treatment alliance. This study examined the relationship of MMPI-2-RF scales to treatment engagement and alliance in 134 individuals seeking outpatient treatment at a psychology department training clinic. It was predicted that validity scales and externalizing scales would be related to treatment engagement (premature termination, no-show rate) and to alliance. Contrary to expectations, MMPI-2-RF validity scales were not related to premature termination but high scores on F-r were related to higher no-show rates and high scores on Symptom Validity (FBS-r) were related to lower alliance. As predicted, higher scores on scales assessing externalizing psychopathology were related to premature termination and higher no-show rate. Exploratory analyses also suggested higher scores on somatic and interpersonal scales were related to lower alliance. Accuracy statistics using clinical cutoffs on MMPI scales are provided.

Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change

OBJECTIVE

The purpose of this study is to examine associations between therapist adherence, competence, and modifications of an evidence-based protocol (EBP) delivered in routine clinical care and client outcomes.

METHOD

Data were derived from a NIMH-funded implementation-effectiveness hybrid study of Cognitive Processing Therapy (CPT) for PTSD in a diverse community health center. Providers (n = 19) treated clients (n = 58) as part of their routine clinical care. Clients completed the PCL-S and PHQ-9 at baseline, after each CPT session, and posttreatment. CPT sessions were rated for treatment fidelity and therapist modifications.

RESULTS

Overall, therapist adherence was high, although it decreased across sessions suggesting potential drift. Therapist competence ratings varied widely. Therapists made on average 1.6 fidelity-consistent and 0.4 fidelity-inconsistent modifications per session. Results show that higher numbers of fidelity-consistent modifications were associated with larger reductions in posttraumatic stress and depressive symptoms. High adherence ratings were associated with greater reductions in depressive symptoms, whereas higher competence ratings were associated with greater reduction in posttraumatic stress symptoms.

CONCLUSIONS

The results highlight the importance of differentially assessing therapist adherence, competence, and modifications to EBP in usual care settings. The findings also suggest that effective EBP delivery in routine care may require minor adaptations to meet client needs, consistent with previous studies. Greater attention to fidelity and adaptation can enhance training so providers can tailor while retaining core components of the intervention. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Modeling empathy as synchrony in clinician and patient vocally encoded emotional arousal: A failure to replicate

Empathy is a well-defined active ingredient in clinical encounters. To measure empathy, the current gold standard is behavioral coding (i.e., trained coders attribute overall ratings of empathy to clinician behaviors within an encounter), which is labor intensive and subject to important reliability challenges. Recently, an alternative measurement has been proposed: capturing empathy as synchrony in vocally encoded arousal, which can be measured as the mean fundamental frequency of the voice (mean F0). This method has received preliminary support by one study (Imel, Barco, et al., 2014). We aimed to replicate this study by using 2 large samples of clinical interactions (alcohol brief motivational interventions with young adults, N = 208; general practice consultations, N = 204). Audio files were segmented to identify respective speakers and mean F0 was measured using speech signal processing software. All sessions were independently rated by behavioral coders using 2 validated empathy scales. Synchrony between clinician and patient F0 was analyzed using multivariate multilevel models and compared with high and low levels of empathy derived from behavioral coding. Findings showed no support for our hypothesis that mean F0 synchrony between clinicians and patients would be higher in high-empathy sessions. This lack of replication was consistent for both clinical samples, both behavioral coding instruments, and using measures of F0 synchrony occurring at both the session-level and minute-level. We considered differences in culture and language, patients' characteristics, and setting as explanations for this failure to replicate. Further replication testing and new developments regarding measurement methods and modeling are needed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Analysis of brief Cognitive Behavioral Therapy for panic discorder

The aim of this study was to determine if a modification made to the traditional treatments for panic disorder (PD) proved to be effective in adjusting to the cultural and economic characteristics of patients in the southern Andean Region of Colombia. A quasi-experimental model was used, measurements were taken before and after treatment and follow-ups took place after 1 and 2 years; the sample was made up of 82 people (47 women and 35 men, with an average age of 34 and 29 years respectively). Results showed a reduction of PD clinical symptoms after the treatment (d>0.8), the significance in all cases was p <0.001 and changes maintained throughout the follow up period. In conclusion, it is posible to draw the treatment closer to the socio-cultural characteristics of patients to whom it is directed and the number of sessions could be reduced maintaining the effectiveness of the treatment.

Empirical evidence of the effect of personality pathology on the outcome of panic disorder

BACKGROUND

Treatment resistant disorders are a significant clinical problem. Impediments to good outcome need to be identified and addressed. Personality pathology has been hypothesized to be one such factor in panic disorder. There is no consensus as to the effects of personality pathology on the outcome of panic disorder. This study examined empirical evidence. The hypothesis was that personality pathology would cause poorer outcome of panic disorder.

METHODS

A literature search was conducted that winnowed 2627 articles down to 27 based on 1) longitudinal design; 2) validated measures of personality; 3) validated outcome measures; and 4) the presence of effect size or data to calculate effect size. All effect sizes were translated into odds ratios (ORs) for ease of comparison.

RESULTS

An overall median OR of 2.7 was found, indicating personality pathology negatively affected outcome. This finding persisted even when adjusted for baseline severity of illness. The effects were found for both clinical outcomes (OR = 2.7) and for social adjustment (OR = 2.9). There was a tendency for more dropouts in the personality pathology group. More highly structured drug therapy regimens and highly structured psychotherapy seemed to partially mitigate this outcome.

CONCLUSION

The negative effect of personality pathology was confirmed in well-designed longitudinal studies. This was not related to initial clinical severity. Clinical implications are that patients with personality pathology require the therapist to stick more closely to treatment protocols and to mitigate the tendency of these patients to drop out of treatment.

Psychological treatments for return to work in individuals on sickness absence due to common mental disorders or musculoskeletal disorders: a systematic review and meta-analysis of randomized-controlled trials

Purpose

Common mental disorders (CMDs) and musculoskeletal disorders are highly prevalent in the population and cause significant distress and disability, and high costs to society. The main objective of this systematic review and meta-analysis was to examine the outcome and comparative effectiveness of psychological interventions in reducing sickness absence (SA) due to CMDs or musculoskeletal disorders, compared to a waitlist control group, usual care or another clinical intervention.

Methods

We reviewed 3515 abstracts of randomized controlled trials published from 1998 to 2017. Of these, 30 studies were included in the analysis.

Results

The psychological interventions were overall more effective than treatment as usual in reducing SA (small effect sizes), but not compared to other clinical interventions. Results were similar for studies on CMDs and musculoskeletal pain. A few significant moderating effects were found for treatment-specific variables. However, these were  difficult to interpret as they pointed in different directions.

Conclusion

There was a small but significant effect of psychological treatments in reducing SA. We identified areas of improvement such as methodological problems among the included studies and failure to specifically address RTW in the interventions that were evaluated. Clinical implications of the findings, and ways of improving methodological rigour of future studies are discussed.

Electronic supplementary material

The online version of this article (10.1007/s00420-018-1380-x) contains supplementary material, which is available to authorized users.

Therapist adherence and therapeutic alliance in individual cognitive-behavioural therapy for adolescent binge-eating disorder

To evaluate psychological treatments for adolescent binge-eating disorder (BED), reliable information on therapeutic process factors is needed. This study examines therapist adherence and therapeutic alliance and their associations in cognitive-behavioural therapy (CBT) for adolescents with BED. In a randomised-controlled efficacy trial, adherence and alliance were objectively determined based on 247 audio-taped CBT sessions from a sample of N = 64 adolescents with BED. Variability of adherence and alliance, explained by treatment module, patient, and therapist were examined using multilevel modeling. Although adherence and alliance were excellent and unaffected by treatment module and therapist, there was significant between-patient variability for both concepts. Adherence was negatively associated with patient's treatment expectation. Alliance was negatively associated with the number of loss of control eating episodes and positively associated with adherence. Excellent adherence supported the internal validity of CBT for adolescent BED. Associations between process factors and patient characteristics demand adequate supervision in CBT.

Treatment delivery of the community reinforcement approach in outpatient addiction treatment

OBJECTIVE

Treatment model adherence is an important predictor of treatment outcome. In clinical practice evidence-based treatments are delivered in widely varying degrees. This study examines which Community Reinforcement Approach (CRA) procedures are delivered by addiction care therapists and how this is associated with therapist characteristics.

METHOD

The study integrated two observational designs. Firstly, using a prospective design, 24 therapists registered every CRA procedure delivered during every patient contact over a six month period. Secondly, using a cross-sectional design, personal characteristics of 69 therapists were assessed including their self-reported delivery of CRA procedures and their perceptions with regard to the meaningfulness and complexity of these procedures.

RESULTS

The number of CRA procedures delivered varied substantially among therapists both at session and patient level. More experienced therapists and those that had received advanced training previously, delivered more CRA procedures. Finally, the delivery of CRA procedures was positively associated with experienced meaningfulness and negatively associated with difficulty.

CONCLUSIONS

The results confirm the relation between treatment delivery and experienced meaningfulness and difficulty of CRA procedures and provides support for advanced training to enhance the delivery of a wider range of CRA procedures.

Explaining variability in therapist adherence and patient depressive symptom improvement: The role of therapist interpersonal skills and patient engagement

Understanding why therapists deviate from a treatment manual is crucial to interpret the mixed findings on the adherence–outcome association. The current study aims to examine whether therapists' interpersonal behaviours and patients' active engagement predict treatment outcome and therapist adherence in cognitive behaviour therapy (CBT) and mindfulness‐based cognitive therapy (MBCT) for depressive symptoms. In addition, the study explores rater's explanations for therapist nonadherence at sessions in which therapist adherence was low. Study participants were 61 patients with diabetes and depressive symptoms who were randomized to either CBT or MBCT. Depressive symptoms were assessed by the Beck Depression Inventory‐II. Therapist adherence, therapist interpersonal skills (i.e., empathy, warmth, and involvement), patients' active engagement, and reasons for nonadherence were assessed by two independent raters (based on digital video recordings). Therapist adherence, therapists' interpersonal skills, and patients' active engagement did not predict posttreatment depressive symptom reduction. Patients' active engagement was positively associated with therapist adherence in CBT and in MBCT. This indicates that adherence may be hampered when patients are not actively engaged in treatment. Observed reasons for nonadherence mostly covered responses to patient's in‐session behaviour. The variety of reasons for therapist nonadherence might explain why therapist adherence was not associated with outcomes of CBT and MBCT.

A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes

This randomized controlled hybrid implementation/effectiveness trial aimed to compare the impact of three different models of training and consultation by examining the PTSD treatment outcomes achieved by therapists who were learning a front-line recommended psychotherapy for posttraumatic stress disorder (PTSD), Cognitive Processing Therapy (CPT; Resick, Monson, & Chard, 2017). Therapists (N = 134) were randomized into one of three conditions after attending a standard CPT training workshop: No Consultation with delayed feedback on CPT fidelity, Standard Consultation involving discussion and conceptualization of cases without session audio review, and Consultation Including Audio Review, which included a review of segments of audiorecorded CPT sessions. Across all training conditions, the patients treated by these therapists (N = 188) evidenced statistically significant reductions in PTSD symptoms, (d = -0.95 to -1.78), comorbid symptoms and functioning (d = -0.27 to -0.51). However, patients of therapists in the Standard Consultation condition (ΔPTSD = - 19.64, d = -1.78) experienced significantly greater improvement than those in the No Consultation condition (ΔPTSD = - 10.54, d = -0.95, ΔDEV = 6.30, ΔParms = 2, p = .043). This study demonstrates that patients who receive evidence-based psychotherapy for PTSD in routine care settings can experience significant symptom improvement. Our findings also suggest that to maximize patient benefit, therapist training should include consultation, but that audio review of sessions during consultation may not be necessary, at least for structured protocols. Implications for implementation, including the reduction of burden and cost of post-workshop support, are discussed.

Do clinical experience, formal cognitive behavioural therapy training, adherence, and competence predict outcome in cognitive behavioural therapy for anxiety disorders in youth?

OBJECTIVE

The aim was to investigate whether clinical experience, formal cognitive behavioural therapy (CBT) training, adherence, and competence predict outcome in CBT for anxiety disorders in youth.

METHOD

Videotapes (N = 181) from the sessions in a randomized controlled effectiveness trial (Wergeland et al., 2014, Behaviour Research and Therapy, 57, 1-12) comprising youth (N = 182, M age = 11.5 years) with mixed anxiety disorders were assessed for treatment adherence and competence using the Competence and Adherence Scale for CBT for anxiety disorders in youth (Bjaastad et al., 2016, Psychological Assessment, 28, 908-916). Therapists' (N = 17) clinical experience and educational background were assessed. Participants completed a diagnostic interview (Anxiety Disorders Interview Schedule, child and parent versions) and an anxiety symptom measure (Spence Children's Anxiety Scale, child and parent versions) at pretreatment, posttreatment, and 1-year follow-up.

RESULTS

Higher therapist adherence was related to better treatment outcomes, whereas number of years of clinical experience and competence was related to worse outcomes. However, these findings were not consistent across informants and the time points for the assessments. Interaction effects suggested that competence among therapists with formal CBT training was related to better patient outcomes.

CONCLUSIONS

Therapist adherence, competence, and clinical experience are associated with outcomes of manualized CBT for youth anxiety disorders, but mixed findings indicate the need for more research in this area.

In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy

OBJECTIVE

Three recent meta-analyses have made the claim, albeit with some caveats, that cognitive-behavioral treatments (CBT) are superior to other psychotherapies, in general or for specific disorders (e.g., social phobia).

METHOD

The purpose of the present article was to examine four issues in meta-analysis that mitigate claims of CBT superiority: (a) effect size, power, and statistical significance, (b) focusing on disorder-specific symptom measures and ignoring other important indicators of psychological functioning, (c) problems inherent in classifying treatments provided in primary studies into classes of treatments, and (d) the inclusion of problematic trials, which biases the results, and the exclusion of trials that fail to find differences among treatments.

RESULTS

When these issues are examined, the effects demonstrating the superiority of CBT are small, nonsignificant for the most part, limited to targeted symptoms, or are due to flawed primary studies.

CONCLUSION

Meta-analytic evidence for the superiority of CBT in the three meta-analysis are nonexistent or weak.

Client resistance predicts outcomes in cognitive-behavioral therapy for panic disorder

Objective: Little is known about how therapy processes relate to outcome in cognitive-behavioral therapy (CBT) for panic disorder (PD). This study examined whether client resistance predicts CBT for PD outcomes beyond the effects of established pre-treatment predictors. A secondary aim was to assess the consistency of resistance over treatment. Method: Data were from 71 adults participating in up to 24 biweekly sessions of CBT in a randomized controlled trial. Panic severity was assessed before, during (at Weeks 1, 5, and 9), and at termination of treatment (Week 12) using the Panic Disorder Severity Scale. Trained coders reliably rated resistance in videos of Sessions 2 and 10 using the Client Resistance Code. Results: Resistance was found to be moderately consistent (r = .64). Although overall resistance was unrelated to outcomes, hierarchical linear modeling revealed that openly hostile resistance at Session 10 predicted significantly diminished symptom change (r = .28, CI_95% = [.01, .51]), beyond the effects of pretreatment predictors. Hostile resistance at Session 2 predicted attrition (r_rb = -.30, p = .001), even after established predictors were controlled. Conclusions: Although some forms of resistance may be benign, openly hostile resistance is an important therapy marker that warrants increased clinical and research attention.

Harnessing the Therapist Effect in Patient-Centered Mental Health Care Decision Making

In this commentary, we address the critical importance of the research literature documenting therapist differences in skill and outcomes. In particular, we focus on the implications of therapist differences for patient-centered decision making, including the matching of patients to specific psychotherapists who have empirically-based track records of positive performance. In addition, we present preliminary results from a grant supported study of patients' values and preferences regarding the use of provider performance track records in routine mental health care decision making.

Development of Therapist Adherence in Relation to Treatment Outcomes of Adolescents with Behavioral Problems

Therapist adherence to the treatment manual is assumed to be crucial for adequate implementation and subsequent achievement of the intended, positive treatment outcomes. Although adherence has been mostly studied as a static factor, recent studies suggest that adherence might be dynamic and changes over time. We investigated how parent-perceived adherence to the multisystemic therapy (MST) model develops during treatment and how this development is related to treatment outcomes up to 18 months posttreatment, controlling for the effect of alliance. We used routinely collected data from 848 adolescents (66% male and 76% Western, M age = 15.25 years) and their caregivers participating in MST, a family- and community-based intervention for antisocial adolescents. Adherence and alliance were measured monthly through phone interviews with the caregivers using the Therapist Adherence Measure-Revised. Outcomes were assessed at the end of the treatment and at 18 months posttreatment using the scale Rule-Breaking Behavior of the Child Behavior Checklist and two MST Ultimate Outcomes (i.e., police contact and out-of-home placement). On average, adherence showed an increasing and then flattening slope. The initial level of adherence predicted treatment outcomes at the end of treatment but not at 18 months posttreatment. Change in adherence did not predict treatment outcomes after controlling for alliance. We advocate the need to consider the dynamic nature of adherence in research as well as clinical practice. Change in adherence during treatment, as well as its association with outcome, is likely to be dependent on the adherence measure being used.

Generalizability and Decision Studies of a Treatment Adherence Instrument

Observational measurement of treatment adherence has long been considered the gold standard. However, little is known about either the generalizability of the scores from extant observational instruments or the sampling needed. We conducted generalizability (G) and decision (D) studies on two samples of recordings from two randomized controlled trials testing cognitive–behavioral therapy for youth anxiety in two different contexts: research versus community. Two doctoral students independently coded 543 session recordings from 52 patients treated by 13 therapists. The initial G-study demonstrated that context accounted for a disproportionately large share of variance, so we conducted G- and D-studies for the two contexts separately. Results suggested that reliable cognitive–behavioral therapy adherence studies require at least 10 sessions per patient, assuming 12 patients per therapists and two coders—a challenging threshold even in well-funded research. Implications, including the importance of evaluating alternatives to observational measurement, are discussed.

The global therapist competence scale for youth psychosocial treatment: Development and initial validation

OBJECTIVE

We describe the development and initial psychometric properties of the observer-rated Global Therapist Competence Scale for Youth Psychosocial Treatment (G-COMP) in the context of cognitive-behavioral treatment (CBT) for youth anxiety disorders.

METHOD

Independent coders rated 744 sessions from a sample of 68 youth (mean age = 10.56 years) using the G-COMP and the instruments of alliance, involvement, CBT adherence, CBT competence.

RESULTS

Inter-rater reliability coefficients, ICC(2,2), were greater than .60 for the 5 G-COMP domain scores. G-COMP scores yielded small to medium correlations with instruments of alliance (rs = .17-.44) and youth involvement in treatment (rs = .08-.53), and medium to large correlations with instruments of CBT competence and adherence (rs = .26-.63). Therapists in the research setting were rated higher compared to newly trained therapists in community clinics.

CONCLUSION

Preliminary reliability and validity of the G-COMP are promising, but future research is needed with non-CBT samples.

The Expanding Relevance of Routinely Collected Outcome Data for Mental Health Care Decision Making

Evidence shows that routine outcome monitoring (ROM) and feedback using standardized measurement tools enhances the outcomes of individual patients. When outcome data from a large number of patients and clinicians are collected, patterns can be tracked and comparisons can be made at multiple levels. Variability in skills and outcomes among clinicians and service settings has been documented, and the relevance of ROM for decision making is rapidly expanding alongside the transforming health care landscape. In this article, we highlight several developing core implications of ROM for mental health care, and frame points of future work and discussion.

Variability in motivational interviewing adherence across sessions, providers, sites, and research contexts

Providers' adherence in the delivery of behavioral interventions for substance use disorders is not fixed, but instead can vary across sessions, providers, and intervention sites. This variability can substantially impact the quality of intervention that clients receive. However, there has been limited work to systematically evaluate the extent to which substance use intervention adherence varies from session-to-session, provider-to-provider, and site-to-site. The present study quantifies the extent to which adherence to Motivational Interviewing (MI) for alcohol and drug use varies across sessions, providers, and intervention sites and compares the extent of this variability across three common MI research contexts that evaluate MI efficacy, MI effectiveness, and MI training. Independent raters coded intervention adherence to MI from 1275 sessions delivered by 216 providers at 15 intervention sites. Multilevel models indicated that 57%-94% of the variance in MI adherence was attributable to variability between sessions (i.e., within providers), while smaller proportions of variance were attributable to variability between providers (3%-26%) and between intervention sites (0.1%-28%). MI adherence was typically lowest and most variable within contexts evaluating MI training (i.e., where MI was not protocol-guided and delivered by community treatment providers) and, conversely, adherence was typically highest and least variable in contexts evaluating MI efficacy and effectiveness (i.e., where MI was highly protocolized and delivered by trained therapists). These results suggest that MI adherence in efficacy and effectiveness trials may be substantially different from that obtained in community treatment settings, where adherence is likely to be far more heterogeneous.

Benchmarking Treatment Adherence and Therapist Competence in Individual Cognitive-Behavioral Treatment for Youth Anxiety Disorders

Evidence-based treatments (EBTs) for youth are typically developed and established through studies in research settings designed to ensure treatment integrity, that is, protocol adherence and competence by therapists. An important question for implementation science is how well integrity is maintained when these EBTs are delivered in community settings. The present study investigated whether the integrity achieved by therapists in community settings achieved a benchmark set by therapists in a research setting when they delivered the same EBT-an individual cognitive-behavioral treatment (ICBT) for youth anxiety. Therapists (N = 29; 68.97% White; 13.79% male) provided ICBT to 68 youths (M age = 10.60 years, SD = 2.03; 82.35% White; 52.94% male) diagnosed with a principal anxiety disorder in research or community settings. Training and supervision protocols were the same across settings. Two independent teams of trained coders rated 744 sessions using observational instruments designed to assess ICBT adherence and competence. Both adherence and competence were higher in the research setting. Group differences in competence were consistent across treatment, but differences in adherence were most pronounced when treatment shifted to exposure, widely viewed as the most critical component of ICBT. When using the benchmarks from the research setting, therapists from the community settings fell short for indices of adherence and competence. However, given differences between therapists and clients, as well as the fact that treatment outcomes were similar across settings, our findings raise questions about whether it is appropriate to use treatment integrity benchmarks from research settings for community.

The Psychotherapy Outcome Problem: The Development of the Outcome Stability Index

OBJECTIVE

Psychotherapy research commonly utilizes clients' last session score as an indicator of treatment outcome. We examined whether this last session score is consistent with what would be predicted based on clients' general trajectory in psychological functioning across sessions. We focused on the unstandardized residual variance at the last session, as this represents the degree to which the session score is divergent (or not) from what is predicted from the previous sessions (i.e., Outcome Stability Index; OSI).

METHOD

The sample included 27,958 clients who attended on average 9.41 sessions. Each session, clients completed the Behavioral Health Measure-20 as a measure of psychological functioning. We converted the unstandardized residual variance for clients' last session score into a Cohen's d coefficient to aid in interpretation.

RESULTS

The mean OSI was 0.07 (SD = 0.58), suggesting excellent stability in their last session therapy outcome scores. However, approximately 33% of clients demonstrated poor or extremely problematic stability in their last session therapy outcome scores. Clients who demonstrated poor stability were classified as demonstrating reliable deterioration.

CONCLUSIONS

Researchers may want to consider reporting OSI to assist readers' understanding of the stability of therapy outcomes. Clinical or methodological significance of this article: Therapy outcome scores can vary from session to session, which can influence how we understand therapy outcomes that rely on last session scores. Studies examining therapy outcomes could report the Outcome Stability Index to better contextualize the results.