Cut-off Scores and Clinical Change Indices for the Dutch Outcome Questionnaire (OQ-45) in a Large Sample of Normal and Several Psychotherapeutic Populations

Disentangling the Therapist Effect: Clustering Therapists by Using Different Treatment Outcomes

Previous studies have shown that therapists' performance varies, known as therapist effects, and have indicated that therapists who excel in one treatment outcome may not necessarily be effective in other outcomes. This observational naturalistic study aimed to enhance our understanding of therapist effects and the assessment of therapists' performance in different areas. The study included 68 therapists and 5,582 clients from a large mental health facility. Information about their learning activities was available for a subsample of 49 therapists. Separate multilevel analyses were conducted for treatment outcomes, including case mix-corrected OQ-45 change scores, dropout rates, referrals to other facilities, treatment duration, and client satisfaction ratings. A hierarchical cluster analysis was performed to identify groups of therapists based on their performance across various treatment outcomes. Additionally, differences in therapist characteristics among the clusters identified were examined. Therapist effects varied across different outcomes, ranging from small (2.6% for OQ-45 change) to moderate (6.5% for number of sessions). The cluster analysis revealed four distinct clusters of therapists with specific profiles. They had performance differences in certain areas but not in others. This exploratory study supports the notion that therapists exhibit diverse profiles regarding treatment outcomes. These findings are significant for future investigations of therapist effects that aim to identify the characteristics of effective therapists and in the context of personalizing treatment for clients.

Case report: Brief, intensive EMDR therapy for borderline personality disorder: results of two case studies with one year follow-up

Background

Exposure to adverse childhood events plays an important role in the development of borderline personality disorder (BPD). Emerging evidence suggests that trauma-focused therapy using eye movement desensitization and reprocessing (EMDR) can be beneficial for patients with BPD symptoms. To date, the effects of brief, intensive EMDR treatment for this target group have not been investigated in this population.

Objective

This study aimed to evaluate the effects of a brief and intensive trauma-focused therapy course using EMDR therapy in two patients diagnosed with BPD who did not fulfill the diagnostic criteria for post-traumatic stress disorder (PTSD). It was hypothesized that this approach would be associated with a decline in the core symptoms of BPD, and that this would have an enduring long-term effect on patients' diagnostic status.

Method

Ten sessions of EMDR therapy were carried out across four consecutive treatment days, with the aim of processing patients' core adverse childhood experiences. Both A-criterion-worthy memories (without intrusive reliving) and non-A-criterion-worthy memories that were considered responsible for the patients' most prominent symptoms were targeted. The effects of EMDR therapy on trauma symptom severity and BPD diagnostic status (as established by the Structured Clinical Interview DSM-5) were determined. Additionally, the effects on psychological distress, quality of life, and difficulties in emotion regulation were determined at intake, post-treatment, and at 3-, 6-, and 12-months follow-up.

Results

Both patients showed a strong decline in psychological distress and difficulties in emotion regulation, and reported an improvement in their quality of life. At post-treatment, and at 3-, 6-, and 12-months follow-up they no longer met the DSM-5 criteria for BPD.

Conclusion

The findings of this small case study are in line with mounting evidence that a brief track of intensive trauma-focused therapy can result in long-term remission in patients with BPD. EMDR therapy seems to be a promising treatment approach for patients with BPD; however, the results need to be replicated in clinical trials.

Comparative analysis of algorithm-guided treatment and predefined duration treatment programmes for depression: exploring cost-effectiveness using routine care data

BACKGROUND

More knowledge on the cost-effectiveness of various depression treatment programmes can promote efficient treatment allocation and improve the quality of depression care.

OBJECTIVE

This study aims to compare the real-world cost-effectiveness of an algorithm-guided programme focused on remission to a predefined duration, patient preference-centred treatment programme focused on response using routine care data.

METHODS

A naturalistic study (n=6295 in the raw dataset) was used to compare the costs and outcomes of two programmes in terms of quality-adjusted life years (QALY) and depression-free days (DFD). Analyses were performed from a healthcare system perspective over a 2-year time horizon. Incremental cost-effectiveness ratios were calculated, and the uncertainty of results was assessed using bootstrapping and sensitivity analysis.

FINDINGS

The algorithm-guided treatment programme per client yielded more DFDs (12) and more QALYs (0.013) at a higher cost (€3070) than the predefined duration treatment programme. The incremental cost-effectiveness ratios (ICERs) were around €256/DFD and €236 154/QALY for the algorithm guided compared with the predefined duration treatment programme. At a threshold value of €50 000/QALY gained, the programme had a probability of <10% of being considered cost-effective. Sensitivity analyses confirmed the robustness of these findings.

CONCLUSIONS

The algorithm-guided programme led to larger health gains than the predefined duration treatment programme, but it was considerably more expensive, and hence not cost-effective at current Dutch thresholds. Depending on the preferences and budgets available, each programme has its own benefits.

CLINICAL IMPLICATION

This study provides valuable information to decision-makers for optimising treatment allocation and enhancing quality of care cost-effectively.

Self-rated personality disorder symptoms do not predict treatment outcome for posttraumatic stress disorder in routine clinical care

OBJECTIVE

To test the hypothesis that self-rated personality disorder (PD) symptoms are a significant and clinically relevant predictor of treatment outcomes in a naturalistic treatment setting specialized in trauma-focused treatment using a single-group pretest-posttest design.

METHOD

Treatment-seeking patients reporting clinical levels of posttraumatic stress disorder (PTSD) symptoms filled out questionnaires at intake and after treatment. The primary outcome was change in PTSD severity after treatment, measured by the PTSD Checklist for DSM-5 (PCL-5). PD symptoms were measured with the Structured Clinical Interview for DSM-5 Screening Personality Questionnaire (SCID-5-SPQ). Secondary outcomes were general mental health problems, treatment response, number of sessions and dropout.

RESULTS

N = 1174 patients (59% female, baseline PCL-5 score M [SD] = 53.0 [10.8]) were included for the primary analysis. Regression analysis revealed that PD symptoms explained 0.4% of variance in PTSD symptom change (p = .066). After controlling for baseline PTSD symptoms, PD symptoms explained 0.0% of variance (p = .311). The fully adjusted model including baseline PTSD symptom severity, age, gender, cumulative exposure to potentially traumatic experiences, PD symptoms, and number of sessions together explained 5% of the observed variance in PTSD symptom change. Baseline PTSD severity was the only significant predictor and negatively predicted outcome. Sensitivity analyses with imputed data from N = 2694 cases yielded comparable results. Finally, secondary analyses showed that PD symptoms did not predict significant or clinically relevant changes in treatment response status, general mental health problems, dropout rates or number of sessions.

CONCLUSION

The findings provide no evidence that self-rated PD symptoms predict treatment outcomes for patients suffering from clinical levels of PTSD symptoms in a naturalistic treatment setting specializing in trauma-focused treatment. Self-report screening for these symptoms to inform clinicians about expected effects of PTSD treatment is not supported by the evidence.

Exploration of eye movement desensitization and reprocessing in treating posttraumatic stress-disorder in patients with acquired brain injury: a retrospective case series

Background: Posttraumatic stress disorder (PTSD) is prevalent in people with acquired brain injury (ABI). Despite the established efficacy of eye movement desensitization and reprocessing (EMDR) for PTSD in general, evaluation studies on EMDR in ABI patients with PTSD are limited.Objective: The aim of this study is to explore clinical features, treatment characteristics, feasibility and first indications of efficacy of EMDR in adult ABI patients with PTSD.Method: This retrospective consecutive case series included ABI patients, who received at least one session of EMDR for PTSD between January 2013 and September 2020. PTSD symptoms were measured using the Impact of Event Scale (IES) pre- and post-treatment. Affective distress was measured using the Subjective Units of Distress (SUD) pre- and post-treatment of the first target.Results: Sixteen ABI patients (median age 46 years, 50% males), with predominantly moderate or severe TBI (50%) or stroke (25%) were included. Treatment duration was a median of seven sessions. Post-treatment IES scores were significantly lower than pre-treatment scores (p < .001). In 81% of the cases there was an individual statistically and clinically relevant change in IES score. Mean SUD scores of the first target were significantly lower at the end of treatment compared to scores at the start of treatment (p < .001). In 88% of the patients full desensitization to a SUD of 0-1 of the first target was accomplished. Only few adjustments to the standard EMDR protocol were necessary.Conclusions: Findings suggest that EMDR is a feasible, well tolerated and potentially effective treatment for PTSD in ABI patients. For clinical practice in working with ABI patients, it is advised to consider EMDR as a treatment option.

Second Opinions for Patients With a Persistent Depressive Disorder: Effects on Severity of Depression and Quality of Life

BACKGROUND

A persistent depressive disorder has a major impact on both patients and health care systems. Despite the advice in guidelines to seek a second opinion if there is insufficient evidence of recovery after treatment, and the great number of second opinions in psychiatric care for patients with persistent depression, only a few studies have been published about their effects.

METHODS

Multilevel analyses were conducted to compare the mean test scores of a group of patients with a persistent depressive disorder who received the intervention of a second opinion with scores from a matched control group, at 3 time points: baseline, intervention, and follow-up.

RESULTS

A significant decrease in the severity of depression 3 months after the second opinion was found. No effects on quality of life or treatment satisfaction were found.

LIMITATIONS

The study sample was a convenience sample without randomization, and many values were missing in the data. In addition, a 3-month follow-up may have been too short to expect effects of the recommendations from the second opinion. The instructions concerning how to rate treatment satisfaction were also ambiguous.

CONCLUSIONS

A second opinion can be of value for persistent depression. Further research should address the question of whether the effect that was found is caused by the second opinion itself or is the result of subsequent changes in treatment.

Early trajectories of symptom change and working alliance as predictors of treatment outcome

OBJECTIVE

We aim to examine how different trajectories of symptom change and working alliance in early psychotherapy predict treatment outcomes.

METHOD

We performed a growth mixture model (GMM) to examine trajectories of symptom change and working alliance in the first five therapy sessions in a sample of 272 outpatients and tested the association of early symptom trajectories and alliance patterns with treatment outcome.

RESULTS

We identified two symptom trajectories: high symptom/steady change (63.2%) and early improving (36.8%), and four alliance development patterns: undeveloped alliance (40.1%), strengthening moderate alliance (31.6%), optimal alliance (17.3%), and improved alliance (11%) in early psychotherapy. The symptom trajectories and alliance patterns both independently and interactively predicted treatment outcomes. The optimal alliance was generally associated with the best outcome. The effect of improved alliance on treatment outcome was moderated by symptom trajectories: for high symptom/steady change subgroup, the improved alliance was related to better treatment outcome, whereas for early improving subgroup, the improved alliance was associated with poorer outcome.

CONCLUSIONS

Patients fell into different trajectories regarding symptom reduction and alliance development in early psychotherapy that affected final treatment outcome. Combining early symptom trajectories and alliance trajectories simultaneously can facilitate routine outcome monitoring and contribute to the prediction of treatment outcome.

A Common Measurement Scale for Self-Report Instruments in Mental Health Care

Abstract. The diversity of measures in clinical psychology hampers a straightforward interpretation of test results, complicates communication with the patient, and constitutes a challenge to the implementation of measurement-based care. In educational research and assessment, it is common practice to convert test scores to a common metric, such as T scores. We recommend applying this also in clinical psychology and propose and test a procedure to arrive at T scores approximating a normal distribution that can be applied to individual test scores. We established formulas to estimate normalized T scores from raw scale scores by regressing IRT-based θ scores on raw scores. With data from a large population and clinical samples, we established crosswalk formulas. Their validity was investigated by comparing calculated T scores with IRT-based T scores. IRT and formulas yielded very similar T scores, supporting the validity of the latter approach. Theoretical and practical advantages and disadvantages of both approaches to convert scores to common metrics and alternative approaches are discussed. Provided that scale characteristics allow for their computation, T scores will help to better understand measurement results, which makes it easier for patients and practitioners to use test results in joint decision-making about the course of treatment.

The feasibility, acceptability and effectiveness of a feedback-informed group treatment (FIGT) tool for patients with anxiety or depressive disorders

Monitoring treatment progress by the use of standardized measures in individual therapy, also called feedback-informed treatment (FIT), has a small but significant effect on improving outcomes. Results of FIT in group therapy settings are mixed, possibly due to contextual factors. The goals of this study were to investigate the feasibility, acceptability and effectiveness of a feedback-informed group treatment (FIGT) tool, based on the principles of the Contextual Feedback Theory and earlier FIGT research. Patients with anxiety or depressive disorders following interpersonal or cognitive behavioural group psychotherapy (IPT-G or CBT-G) were randomized to either feedback (n=104) or Treatment As Usual (TAU; n=93). In the feedback condition, patients filled out the Outcome-Questionnaire 45 (OQ-45) weekly in a FIGT tool and therapists were instructed to discuss the results in each session. Dropout, attendance and outcomes were measured. Additionally, in the feedback condition, OQ-45 response, feedback discussions and acceptability by patients and therapists were assessed. Results showed no differences on dropout, but lower attendance rates in the feedback condition. Although therapists reported high rates of feedback use and helpfulness, patients experienced that results were discussed with them only half of the time and they were also less optimistic about its usefulness. The findings indicate that the FIGT instrument was partially feasible, more acceptable to therapists than patients, and was not effective as intended. Future research is needed to discover how feedback can be beneficial for both therapists and patients in group therapy.

Feedback-informed Group Treatment: A Qualitative Study of the Experiences and Needs of Patients and Therapists

Therapists, including group therapists, can systematically gather feedback from patients about how their group members are responding to treatment. However, results of research on using feedback-informed group treatment (FIGT) are mixed, and the underlying mechanisms responsible for positive patient changes remain unclear. Therefore, the present qualitative study examined the perceptions and experiences of both (a) group therapists and (b) group members regarding using feedback in their therapy groups to gauge treatment progress, across five different therapy groups. Specifically, three interpersonal psychotherapy groups and two cognitive-behavioral therapy groups used a FIGT tool in which treatment progress updates were provided to patients and therapists. Observational data were collected in the form of feedback discussions in these therapy groups, as well as during interviews conducted with patients and therapists. Data were analyzed using thematic analysis and a grounded theory approach. Overall, patients were mostly positive about their experiences with FIGT, but therapists also expressed concerns about FIGT. Results indicated that FIGT is useful for gaining insight and strengthening the working alliance. In addition, specific group processes were also found to be important, especially interpersonal learning, cohesion, and social comparison. Practical implications are discussed.

Comparing the effectiveness and predictors of cognitive behavioural therapy-enhanced between patients with various eating disorder diagnoses: a naturalistic study

Cognitive behaviour therapy-enhanced (CBT-E) is an effective treatment for non-underweight patients with eating disorders. Its efficacy and effectiveness is investigated mostly among transdiagnostic samples and remains unknown for binge eating disorder. The aim of the present study was to assess several treatment outcome predictors and to compare effectiveness of CBT-E among adult out-patients with bulimia nervosa (n=370), binge eating disorder (n=113), and those with a restrictive food pattern diagnosed with other specified feeding and eating disorders (n=139). Effectiveness of CBT-E was assessed in routine clinical practice in a specialised eating disorders centre. Eating disorder pathology was measured with the EDEQ pre- and post-treatment, and at 20 weeks follow-up. Linear mixed model analyses with fixed effect were performed to compare treatment outcome among the eating disorder groups. Several predictors of treatment completion and outcome were examined with a regression analysis. No predictors for drop-out were found, except the diagnosis of bulimia nervosa. Eating disorder pathology decreased among all groups with effect sizes between 1.43 and 1.70 on the EDE-Q total score. There were no differences in remission rates between the three groups at end of treatment or at follow-up. Eating disorder severity at baseline affected treatment response. The results can be generalised to other specialised treatment centres. No subgroup of patients differentially benefited from CBT-E supporting the transdiagnostic perspective for the treatment of eating disorders. Longer-term follow-up data are necessary to measure persistence of treatment benefits.

Key learning aims

(1)

Buffering effect of in-patient psychiatric care on the link between fear of covid-19 and mental health consequences

Background& aimes

Psychiatric admissions during the covid-19 pandemic were limited, overlooking their possible benefit. This study focused on assessing the effect of the fear of covid on the mental health and well-being of inpatients as opposed to outpatients.

Methods

During the first lockdown, forty-four inpatients and day care patients (inpatient group) and 74 outpatients (outpatient group) were recruited after an informed consent procedure. Fear of the infection was assessed using the Fear of COVID-19 (FCV–19S); severity of mental health symptomatology was evaluated with the outcome questionnaire-45 (OQ-45); wellbeing was assessed with the Psychological well-being scale (PWB).

Outcomes

There was no difference between the inpatient group and outpatient group in their fear of COVID-19 levels.

FCV-19 predicted changes in the outpatient OQ total score (B ​= ​2.21, p ​< 0.001), OQ interpersonal relation subscale (B ​= ​0.34, p ​= 0.01), PWB total score (B ​= ​−0.05, p ​< 0.001), PWB environmental mastery subscale (B ​= ​−0.07, p ​< 0.001) and PWB positive relation subscale (B ​= ​−0.05, p ​< 0.001), but not in the inpatient group.

Conclusions

Mental health and wellbeing of the outpatient group, which had less therapeutic contact than the inpatient group, correlated with the fear of covid, supporting the hypothesis that intensive psychiatric therapy had a protective effect on the mental health consequences of “fear of covid”.

Common measures or common metrics? A plea to harmonize measurement results

OBJECTIVE

There is a great variety of measurement instruments to assess similar constructs in clinical research and practice. This complicates the interpretation of test results and hampers the implementation of measurement-based care.

METHOD

For reporting and discussing test results with patients, we suggest converting test results into universally applicable common metrics. Two well-established metrics are reviewed: T scores and percentile ranks. Their calculation is explained, their merits and drawbacks are discussed, and recommendations for the most convenient reference group are provided.

RESULTS

We propose to express test results as T scores with the general population as reference group. To elucidate test results to patients, T scores may be supplemented with percentile ranks, based on data from a clinical sample. The practical benefits are demonstrated using the published data of four frequently used instruments for measuring depression: the CES-D, PHQ-9, BDI-II and the PROMIS depression measure.

DISCUSSION

Recent initiatives have proposed to mandate a limited set of outcome measures to harmonize clinical measurement. However, the selected instruments are not without flaws and, potentially, this directive may hamper future instrument development. We recommend using common metrics as an alternative approach to harmonize test results in clinical practice, as this will facilitate the integration of measures in day-to-day practice.

Attitudes of patients with severe mental illness towards COVID-19 vaccinations: A preliminary report from a public psychiatric hospital

BACKGROUND

As patients with severe mental illness are at increased risk for COVID-19 mortality, the issue of willingness to be vaccinated is of extreme importance.

METHODS

During February 2021 Shalvata Mental Health hospital provided Covid-19 vaccines to its patients. Fifty one patients suffering from severe mental illness, out of 196 patients hospitalized in closed, open or day wards during that period, signed the informed consent and were assessed for their clinical condition (OQ-45), fear of Covid-19 (FCV-19S) and approach to the vaccine (C19-VHS). All patients who were not vaccinated in February 2021 (baseline) were re-approached a month later to assess whether they had gotten vaccinated since.

RESULTS

Patients who were not vaccinated at baseline had an oppositional approach to the vaccine, and did not significantly differ in their fear of Covid-19 levels or in levels of clinical severity (t(49) = 2.51, p = 0.02) from those who were vaccinated. From the 29 patients who were not vaccinated at baseline approach to the vaccine was a good predictor to getting vaccinated after one month (79% positive predictive value).

CONCLUSIONS

The majority of patients suffering from a severe mental illness are willing to get vaccinated, and their decision of whether or not to get vaccinated is based on their viewpoint on the vaccine rather than being an outcome of their level of distress (OQ-45). It is important to allow vaccine accessibility to hospitalized patients, to consider their opinions and to provide useful information to lower vaccine hesitancy and improve vaccination rates.

Systematic client feedback to brief therapy in basic mental healthcare: study protocol for a four-centre clinical trial

INTRODUCTION

The Partners for Change Outcome Management System (PCOMS) is a client feedback-system built on two brief visual analogue self-report scales. Prior studies of PCOMS have found effects varying from significant positive to negative. Aims of present study are; to test the predicted beneficial impact of PCOMS, while accounting for methodological flaws in prior studies and to clarify under which circumstances the addition of PCOMS to therapy has a beneficial effect.

METHODS AND ANALYSIS

This study focuses on patients applying for brief, time-limited treatments. Four centres will be randomised to either treatment as usual (TAU) or TAU with PCOMS. All participating patients will be assessed four times. The full staff in the experimental condition will be trained in PCOMS. In the second part of this study, all therapists in the PCOMS condition will fill in a questionnaire concerning the influence of regulatory focus, self-efficacy, external or internal feedback orientation and perceived feedback validity of PCOMS. Finally, patients in the PCOMS condition will be asked to give feedback through a structured interview.The primary outcome measure is the Outcome Questionnaire over the period from beginning to end of therapy. The Mental Health Continuum-Short Form and Consumer Quality Index are also completed. In the primary analysis, outcomes of the two treatment conditions on treatment outcome, patient satisfaction, costs, drop-out and duration will be examined with a three-level (within patient, between patients and between therapists) multilevel analysis. The DSM-classification, sex, education level, age of each patient and therapist factors will be included as covariates.

ETHICS AND DISSEMINATION

The Medical Ethics Committee of the University of Twente approved this study (K15-11, METC Twente). Data will be included from 1 January 2016 to 1 July 2019. Study results will be disseminated through peer-reviewed journals and conferences.

TRIAL REGISTRATION NUMBER

NTR5466; Pre-results.

The Factor Structure of Outcome Questionnaire–45.2 Scores Using Confirmatory Tetrad Analysis–Partial Least Squares

The researchers employed a confirmatory tetrad analysis (CTA) using partial least squares–structural equation modeling (PLS-SEM) with Outcome Questionnaire–45.2 (OQ-45) data, examining the measurement model of the OQ-45 scores with a sample of male adult clients ( N = 1,558) receiving individual therapy at a university-based community counseling and research center (UBCCRC). Using CTA-PLS, this study examined the reflective and formative nature of each of the OQ-45 items and dimensions. These results identified the innovative second-order formative–formative three-factor model as a best alternative measurement model to represent and calculate the scores of OQ-45 scale.

The Brief Symptom Inventory and the Outcome Questionnaire-45 in the Assessment of the Outcome Quality of Mental Health Interventions

Self-report questionnaires are economical instruments for routine outcome assessment. In this study, the performance of the German version of the Outcome Questionnaire-45 (OQ-45) and the Brief Symptom Inventory (BSI) was evaluated when applied in analysis of the outcome quality of psychiatric and psychotherapeutic interventions. Pre-post data from two inpatient samples (N = 5711) and one outpatient sample (N = 239) were analyzed. Critical differences (reliable change index) and cut-off points between functional and dysfunctional populations were calculated using the Jacobson and Truax method of calculating clinical significance. Overall, the results indicated that the BSI was more accurate than the OQ-45 in correctly classifying patients as clinical subjects. Nonetheless, even with the BSI, about 25% of inpatients with schizophrenia attained a score at admission below the clinical cut-off. Both questionnaires exhibited the highest sensitivity to psychopathology with patients with personality disorders. When considering the differences in the prescores, both questionnaires showed the same sensitivity to change. The advantage of using these self-report measures is observed primarily in assessing outpatient psychotherapy outcome. In an inpatient setting two main problems—namely, the low response rate and the scarce sensitivity to psychopathology with severely ill patients—limit the usability of self-report questionnaires.