Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures

Deteriorated and unchanged patients in psychological treatment in Swedish primary care and psychiatry

BACKGROUND

Despite substantial effect sizes for psychological therapy among different diagnosis groups and in different treatment contexts, many studies show that a large proportion of patients do not attain reliable improvement and a substantial portion are worse off after treatment. Previous studies suggest that patients in psychiatry may have worse outcome than patients in primary care.

AIMS

In this practice-based study of psychological treatment in Swedish primary care and adult psychiatry, the proportions of patients who did not improve and who deteriorated were assessed.

METHODS

Proportions of reliably improved, unchanged, and reliably deteriorated patients among 840 patients in primary care and 317 patients in specialist psychiatry were assessed by self-ratings using the Clinical Outcomes in Routine Evaluation - Outcome Measure (CORE-OM).

RESULTS

More than half of the patients did not change reliably. About 2% of the patients in primary care and 7% in psychiatry deteriorated. Multilevel analyses of the data from primary care indicated that there were no therapist effects.

CONCLUSIONS

The results emphasize the importance of monitoring treatment continuously in order to increase results for patients who do not improve.

Psychometric properties of the Spanish version of the Clinical Outcomes in Routine Evaluation - Outcome Measure

OBJECTIVE

The objective of this paper is to assess the reliability and validity of the Spanish translation of the Clinical Outcomes in Routine Evaluation - Outcome Measure, a 34-item self-report questionnaire that measures the client's status in the domains of Subjective well-being, Problems/Symptoms, Life functioning, and Risk.

METHOD

Six hundred and forty-four adult participants were included in two samples: the clinical sample (n=192) from different mental health and primary care centers; and the nonclinical sample (n=452), which included a student and a community sample.

RESULTS

The questionnaire showed good acceptability and internal consistency, appropriate test-retest reliability, and acceptable convergent validity. Strong differentiation between clinical and nonclinical samples was found. As expected, the Risk domain had different characteristics than other domains, but all findings were comparable with the UK referential data. Cutoff scores were calculated for clinical significant change assessment.

CONCLUSION

The Spanish version of the Clinical Outcomes in Routine Evaluation - Outcome Measure showed acceptable psychometric properties, providing support for using the questionnaire for monitoring the progress of Spanish-speaking psychotherapy clients.

Sickness absence and presence among employees in treatment for common mental disorders

Purpose: Common mental disorders are a major cause of long-term sickness absence and a reason for disability benefits, although many people with these disorders remain employed. Therefore, it is important to prevent them from taking sick leave or relying on disability benefits. Consequently, we wished to identify the factors associated with sickness presence among patients undergoing treatment. Method: Participants were recruited from patients who met for their first session at a Return to Work clinic. A total of 251 patients completed a questionnaire that included questions on background information, mental health and functioning, and psychosocial work factors. Of these, 49% were fully working, 21.9% were partially working, and 29.1% were on full sickness absence. Results: Fully working patients had fewer symptoms, functioned better, and experienced greater well-being than patients wholly on sick leave. They also experienced work as less demanding, were more appreciative, and had more employment security and autonomy. They reported symptoms, functioning, and well-being at the same level as the partially working group. However, their therapists reported that they functioned better and they themselves considered work demands somewhat less stressful. Conclusions: The results indicate that both symptoms and functional capacity, in addition to work environment, are perceived as more favorable among fully working patients, compared with those completely on sick leave. However, because of the cross-sectional design, we need more studies with prospective design to examine whether these relationships are causal, and to examine when sickness presence is beneficial for patients.

Systematic review and economic modelling of the clinical effectiveness and cost-effectiveness of art therapy among people with non-psychotic mental health disorders

BACKGROUND

Mental health problems account for almost half of all ill health in people under 65 years. The majority are non-psychotic (e.g. depression, anxiety and phobias). For some people, art therapy may provide more profound and long-lasting healing than more standard forms of treatment, perhaps because it can provide an alternative means of expression and release from trauma. As yet, no formal evaluation of art therapy for non-psychotic mental health disorders has been conducted.

AIM

This review aimed to evaluate evidence for the clinical effectiveness and cost-effectiveness of art therapy for non-psychotic mental health disorders.

METHODS

Comprehensive literature searches for studies examining art therapy in populations with non-psychotic mental health disorders were performed in major health-related and social science bibliographic databases including MEDLINE, EMBASE, The Cochrane Library, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, Allied and Complementary Medicine Database (AMED) and Applied Social Sciences Index and Abstracts (ASSIA) from inception up to May 2013. A quantitative systematic review of clinical effectiveness, a qualitative review to explore the acceptability, relative benefits and potential harms, and a cost-utility analysis of studies evaluating cost-effectiveness of art therapy were conducted.

RESULTS

In the quantitative review, 15 randomised controlled trials (RCTs) were included (n = 777). Meta-analysis was not possible because of clinical heterogeneity and insufficient comparable data on outcome measures across studies. A narrative synthesis reports that art therapy was associated with significant positive changes relative to the control group in mental health symptoms in 10 out of the 15 studies. The control groups varied between studies but included wait-list/no treatment, attention placebo controls and psychological therapy comparators. Four studies reported improvement from baseline but no significant difference between groups. One study reported that outcomes were more favourable in the control group. The quality of included RCTs was generally low. In the qualitative review, 12 cohort studies were included (n = 188 service users; n = 16 service providers). Themes relating to benefits of art therapy for service users included the relationship with the therapist, personal achievement and distraction. Areas of potential harms were related to the activation of emotions that were then unresolved, lack of skill of the art therapist and sudden termination of art therapy. The quality of included qualitative studies was generally low to moderate. In the cost-effectiveness review, a de novo model was constructed and populated with data identified from the clinical review. Scenario analyses were conducted allowing comparisons of group art therapy with wait-list control, group art therapy with group verbal therapy, and individual art therapy versus control. Art therapy appeared cost-effective compared with wait-list control with high certainty, although generalisability to the target population was unclear. Verbal therapy appeared more cost-effective than art therapy but there was considerable uncertainty and a sizeable probability that art therapy was more clinically effective. The cost-effectiveness of individual art therapy was uncertain and dependent on assumptions regarding clinical benefit and duration of benefit.

CONCLUSIONS

From the limited available evidence, art therapy was associated with positive effects when compared with a control in a number of studies in patients with different clinical profiles, and it was reported to be an acceptable treatment and was associated with a number of benefits. Art therapy appeared to be cost-effective compared with wait-list but further studies are needed to confirm this finding as well as evidence to inform future cost-effective analyses of art therapy versus other treatments.

STUDY REGISTRATION

The study is registered as PROSPERO CRD42013003957.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

Computerised cognitive behaviour therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomised controlled trial

STUDY QUESTION

How effective is supported computerised cognitive behaviour therapy (cCBT) as an adjunct to usual primary care for adults with depression?

METHODS

This was a pragmatic, multicentre, three arm, parallel randomised controlled trial with simple randomisation. Treatment allocation was not blinded. Participants were adults with symptoms of depression (score ≥ 10 on nine item patient health questionnaire, PHQ-9) who were randomised to receive a commercially produced cCBT programme ("Beating the Blues") or a free to use cCBT programme (MoodGYM) in addition to usual GP care. Participants were supported and encouraged to complete the programme via weekly telephone calls. Control participants were offered usual GP care, with no constraints on the range of treatments that could be accessed. The primary outcome was severity of depression assessed with the PHQ-9 at four months. Secondary outcomes included health related quality of life (measured by SF-36) and psychological wellbeing (measured by CORE-OM) at four, 12, and 24 months and depression at 12 and 24 months.

STUDY ANSWER AND LIMITATIONS

Participants offered commercial or free to use cCBT experienced no additional improvement in depression compared with usual GP care at four months (odds ratio 1.19 (95% confidence interval 0.75 to 1.88) for Beating the Blues v usual GP care; 0.98 (0.62 to 1.56) for MoodGYM v usual GP care). There was no evidence of an overall difference between either programme compared with usual GP care (0.99 (0.57 to 1.70) and 0.68 (0.42 to 1.10), respectively) at any time point. Commercially provided cCBT conferred no additional benefit over free to use cCBT or usual GP care at any follow-up point. Uptake and use of cCBT was low, despite regular telephone support. Nearly a quarter of participants (24%) had dropped out by four months. The study did not have enough power to detect small differences so these cannot be ruled out. Findings cannot be generalised to cCBT offered with a much higher level of guidance and support.

WHAT THIS STUDY ADDS

Supported cCBT does not substantially improve depression outcomes compared with usual GP care alone. In this study, neither a commercially available nor free to use computerised CBT intervention was superior to usual GP care.

FUNDING, COMPETING INTERESTS, DATA SHARING

Commissioned and funded by the UK National Institute for Health Research (NIHR) Health Technology Assessment (HTA) programme (project No 06/43/05). The authors have no competing interests. Requests for patient level data will be considered by the REEACT trial management groupTrial registration Current Controlled Trials ISRCTN91947481.

Session-by-session outcome monitoring in CAMHS: clinicians’ beliefs

The Children and Young People's Improving Access to Psychological Therapies (CYP IAPT) programme emphasizes the meaningful contribution session-by-session routine outcome monitoring (ROM) can make to clinical practice and its importance in highlighting services’ effectiveness. Two studies on issues related to the implementation of ROM in children's services were conducted. Study 1 was qualitative; 12 Child and Adolescent Mental Health Services (CAMHS) professionals participated in focus groups. Themes identified included the idea that ROM could provide objectivity, could be collaborative and empowering. Concerns included how measures may adversely influence therapeutic sessions and how the information may be used by the service. These themes were used to develop a questionnaire about professionals’ experience of and views on session-by-session ROM. In Study 2, 59 professionals from four CAMHS teams completed the questionnaire. It was found that only 6.8% reported ‘almost always’ utilizing session-by-session ROM. Detailed analysis of questionnaire responses suggested two subscales reflecting the perceived negative and positive impact of session-by-session ROM. It was found that clinicians who currently use session-by-session ROM hold stronger positive and negative beliefs than clinicians who do not. This study suggests that session-by-session ROM is not currently routine practice within CAMHS and highlights the importance of considering how this practice can be best implemented within this setting with reference to clinician attitudes.

Patient-focused and feedback research in psychotherapy: Where are we and where do we want to go?

In the last 15 years feedback interventions have had a significant impact on the field of psychotherapy research and have demonstrated their potential to enhance treatment outcomes, especially for patients with an increased risk of treatment failure. This article serves as an introduction to the special issue on "Patient-focused and feedback research in psychotherapy: Where are we and where do we want to go?" Current investigations on feedback research are concerned with potential moderators and mediators of these effects, as well as the design and the implementation of feedback into routine care. This introduction summarizes the current state of feedback research and provides an overview of the three main research topics in this issue: (1) How to implement feedback systems into routine practice and how do therapist and patient attitudes influence its effects?, (2) How to design feedback reports and decision support tools?, and (3) What are the reasons for patients to become at risk of treatment failure and how should therapists intervene with these patients? We believe that the studies included in this special issue reflect the current state of feedback research and provide promising pathways for future endeavors that will enhance our understanding of feedback effects.

Cognitive-behavioural therapy for outpatients with eating disorders: effectiveness for a transdiagnostic group in a routine clinical setting

Whilst there is a growing evidence to support the impact of cognitive-behavioural therapy (CBT) in the treatment of adults with eating disorders, much of this evidence comes from tightly controlled efficacy trials. This study aimed to add to the evidence regarding the effectiveness of CBT when delivered in a routine clinical setting. The participants were 203 adults presenting with a range of eating disorder diagnoses, who were offered CBT in an out-patient community eating disorders service in the UK. Patients completed measures of eating disorder pathology at the start of treatment, following the sixth session, and at the end of treatment. Symptoms of anxiety, depression, and psychosocial functioning were measured pre- and post-treatment. Approximately 55% of patients completed treatment, and there were no factors that predicted attrition. There were significant improvements in eating disorder psychopathology, anxiety, depression and general functioning, with particular changes in eating attitudes in the early part of therapy. Effect sizes were medium to large for both completer and intention to treat analyses. These findings confirm that evidence-based forms of CBT can be delivered with strong outcomes in routine clinical settings. Clinicians should be encouraged to deliver evidence-based treatments when working in these settings.

The clinical effectiveness of stepped care systems for depression in working age adults: a systematic review

BACKGROUND

Stepped care service delivery models involve treatments that become increasingly intense through successive steps, with patients re-assigned via pre-defined decision criteria. This article reviews the clinical effectiveness of stepped care systems for depression in working age adults.

METHODS

Systematic literature review of quantitative clinical outcome evidence comprising 14 controlled and uncontrolled studies meeting specified criteria. Principal outcomes were (a) recovery rates, defined as patients no longer meeting clinical cut-off criteria for the specific outcome measure and (b) treatment response rates, defined as a 50% decrease in outcome measure score.

RESULTS

Stepped care systems had recovery rates ranging predominantly between 40% and 60% and response rates approximating 60%. Studies comparing stepped care with usual/enhanced usual care tended to find significant differences favouring stepped care. The median recovery odds ratio was 1.31 (interquartile intervals of 1.05 and 1.66; k=7 studies). The median comparative Cohen's d effect size estimate was 0.41 (interquartile intervals 0.25 and 0.45; k=5 studies).

LIMITATIONS

The inclusion of uncontrolled studies could be seen as reducing the overall quality of evidence and a meta-analysis was not included due to limitations with the available data.

CONCLUSIONS

Evidence suggested that stepped care interventions for depression are at least as effective as usual care. However, the clinical and organisational superiority of stepped care is yet to be scientifically verified. Differential benefits of stepped care may ultimately depend on service quality. Further research investigating and comparing the specific components and configurations of stepped care interventions are indicated.

Predictors of patient non-attendance at Improving Access to Psychological Therapy services demonstration sites

BACKGROUND

Improving Access to Psychological Therapy (IAPT) services have increased the number of people with common mental health disorders receiving psychological therapy in England, but concerns remain about how equitably these services are accessed.

METHOD

Using cohort patient data (N=363) collected as part of the independent evaluation of the two demonstration sites, logistic regression was utilised to identify socio-demographic, clinical and service factors predictive of IAPT non-attendance.

RESULTS

Significant predictors of IAPT first session non-attendance by patients were: lower non-risk score on the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM); more frequent thoughts of "being better off dead" (derived from the CORE-OM); either a very recent onset of common mental health disorder (1 month or less) or a long term condition (more than 2 years); and site.

LIMITATIONS

The small sample and low response rate are limitations, as the sample may not be representative of all those referred to IAPT services. The predictive power of the logistic regression model is limited and suggests other variables not available in the dataset may also be important predictors.

CONCLUSIONS

The clinical characteristics of risk to self, severity of emotional distress, and illness duration, along with site, were more predictive of IAPT non-attendance than socio-demographic characteristics. Further testing of the relationship between these variables and IAPT non-attendance is recommended. Clinicians should monitor IAPT uptake in those they refer and implement strategies to increase their engagement with services, particularly when referring people presenting with suicidal ideation or more chronic illness.

Tracking Responses to Items in Measures as a Means of Increasing Therapeutic Engagement in Clients: A Complementary Clinical Approach to Tracking Outcomes

This article presents a novel clinical application of questionnaire feedback, which focuses on change at the individual question level rather than the total mean or clinical score level. We term the approach 'Tracking Responses to Items in Measures' (TRIM) and promote the key aims to be (1) providing both client and practitioner with feedback on areas of positive change that may be masked by numerical feedback, (2) reinforcing client strengths and self-efficacy, (3) exploring potential extra-therapeutic factors that may contribute to the lack of change or deterioration on individual questions and (4) establishing a collaborative dialogue relating clients' problems to their goals and the consequent aims of treatment. This paper profiles the clinical origins and technical development of TRIM as a clear, user-friendly display of item change across sessions using colour codes and illustrates the clinical utility through two clinical vignettes. Although the profile of the TRIM method herein uses the Clinical Outcomes in Routine Evaluation Outcome Measure, we believe the method could easily be used with other measures. These could include Generalized Anxiety Disorder 7 and Patient Health Questionnaire 9 used in English National Health Service primary care Improving Access to Psychological Therapies services, or disorder specific measures for particular problems commonly used in National Health Service specialist services. We suggest TRIM is a practical complement to existing feedback systems, especially in work with clients who may be less likely to show empirically meaningful change on mean item or clinical score levels.

KEY PRACTITIONER MESSAGE

Using outcome questionnaires as conversational tools helps practitioners focus on change at the individual item level rather than the numeric level. Tracking Responses to Items in Measures helps provide clients and practitioners with feedback on areas of positive change that may be masked by summary score analysis. Exploring the lack of change or deterioration on particular questions helps practitioners to assess extra-therapeutic factors that may be compromising change. Using individual item change profiles as feedback for clients helps validate their progress and reinforce their strengths and self-efficacy.

Development and evaluation of culturally sensitive psychosocial interventions for under-served people in primary care

BACKGROUND

Psychological therapy is effective for symptoms of mental distress, but many groups with high levels of mental distress face significant barriers in terms of access to care, as current interventions may not be sensitive to their needs or their understanding of mental health. There is a need to develop forms of psychological therapy that are acceptable to these groups, feasible to deliver in routine settings, and clinically and cost effective.

METHODS

We developed a culturally sensitive wellbeing intervention with individual, group and sign-posting elements, and tested its feasibility and acceptability for patients from ethnic minorities and older people in an exploratory randomised trial.

RESULTS

We recruited 57 patients (57% of our target) from 4 disadvantaged localities in the NW of England. The results of the exploratory trial suggest that the group receiving the wellbeing interventions improved compared to the group receiving usual care. For elders, the largest effects were on CORE-OM and PHQ-9. For ethnic minority patients, the largest effect was on PHQ-9. Qualitative data suggested that patients found the intervention acceptable, both in terms of content and delivery.

CONCLUSIONS

This exploratory trial provides some evidence of the efficacy and acceptability of a wellbeing intervention for older and ethnic minority groups experiencing anxiety and depression, although challenges in recruitment and engagement remain. Evidence from our exploratory study of wellbeing interventions should inform new substantive trial designs.

TRIAL REGISTRATION

Current controlled trials ISRCTN68572159.

Evaluation of a group programme of mindfulness-based cognitive therapy for women with fertility problems

Mindfulness-based cognitive therapy (MBCT) has proved helpful for a number of health-related conditions but there is relatively little published literature about its use with fertility problems. The aim of this paper is to describe a pilot group programme adopted by a Clinical Health Psychology department, and to present findings from the routine outcomes data gathered by the service, evaluating its effectiveness. Data from nine women with fertility problems that took part in the programme were analysed. They completed measures of wellbeing and psychological distress before and after the treatment. The results showed clinically significant improvements in participants' wellbeing scores and psychological distress. It was a limitation of the study that the impact of concurrent treatments could not be assessed and so could also have contributed to this outcome in half of the cases. Nevertheless, these results suggest that MBCT may be a helpful treatment for women presenting with fertility-related distress.

Effectiveness and cost-effectiveness of individually tailored Internet-delivered cognitive behavior therapy for anxiety disorders in a primary care population: a randomized controlled trial

A significant proportion of the general population suffers from anxiety disorders, often with comorbid psychiatric conditions. Internet-delivered cognitive behavior therapy (ICBT) has been found to be a potent treatment for patients with specific psychiatric conditions. The aim of this trial was to investigate the effectiveness and cost-effectiveness of ICBT when tailoring the treatment to address comorbidities and preferences for primary-care patients with a principal anxiety disorder. One hundred participants were recruited through their primary-care contact and randomized to either treatment or an active control group. The treatment consisted of 7-10 weekly individually assigned modules guided by online therapists. At post-treatment, 46% of the treatment group had achieved clinically significant improvement on the primary outcome measure (CORE-OM) and between-group effect sizes ranged from d = 0.20 to 0.86, with a mean effect of d = 0.59. At one-year follow-up, within-group effect sizes varied between d = 0.53 to 1.00. Cost analysis showed significant reduction of total costs for the ICBT group, the results were maintained at one-year follow-up and the incremental cost-effectiveness ratio favored ICBT compared to control group. Individually tailored ICBT is an effective and cost-effective treatment for primary-care patients with anxiety disorders with or without comorbidities.

TRIAL REGISTRATION

Clinicaltrials.gov: NCT01390168.

Comparison of face-to-face versus email guided self-help for binge eating: study protocol for a randomised controlled trial

Background

Guided self-help is a recommended first-step treatment for bulimia nervosa, binge eating disorder and atypical variants of these disorders. Further research is needed to compare guided self-help that is delivered face-to-face versus via email.

Methods/Design

This clinical trial uses a randomised, controlled design to investigate the effectiveness of providing guided self-help either face-to-face or via e-mail, also using a delayed treatment control condition. At least 17 individuals are required per group, giving a minimum N of 51.

Discussion

Symptom outcomes will be assessed and estimates of cost-effectiveness made. Results are proposed to be disseminated locally and internationally (through submission to conferences and peer-reviewed journals), and will hopefully inform local service provision. The trial has been approved by an ethics review board and was registered with ClinicalTrials.gov NCT01832792 on 9 April 2013.

The Content, Quality and Impact of Cognitive Behavioural Case Formulation During Treatment of Obsessive Compulsive Disorder

Background: Case formulation (CF) is considered a core component of cognitive behavioural therapy (CBT). Despite this, few studies have explored the content and quality of CFs in routine practice and any associated impact on treatment outcome. Aims: This study investigated (1) the content, timing and quality of CF for patients (N = 29) with Obsessive Compulsive Disorder; (2) the impact of CF on symptoms, distress and therapeutic alliance; and (3) the relationship between CF quality and treatment outcome. Method: CF content and quality were assessed from audiotapes of routine CBT sessions using a validated coding manual and evaluated against treatment outcomes at different stages of therapy. Results: CFs were developed early during treatment and contained strong behavioural and cognitive components, with a focus on symptoms and maintaining factors. CF quality ratings ranged from rudimentary to excellent. A significant improvement in distress and the therapeutic alliance occurred following the introduction of CF, but no significant relationship was found between CF quality and outcome at any stage of treatment. Conclusion: CF may be valuable in reducing patient attrition, due to its impact early in treatment. Further research is needed to explore the most important components of CF. Theoretically sound and disorder specific measurement tools for evaluating CFs are required.

Using Item and Test Information to Optimize Targeted Assessments of Psychological Distress

The need for efficient clinical assessment instruments has been growing during the past years. In the current application, the item information (item response theory) is used to evaluate and build fixed short versions. The method was applied to a questionnaire measuring psychological distress and data were collected from two mixed outpatient and general population samples. After fitting the partial credit model, two short versions were built: one to increase efficiency in screening applications; the other for the monitoring of high distress patients. A cross-validation bootstrap procedure is proposed to check whether the short versions are more efficient than alternative item selections. Using the partial credit model, the results from short and full versions can be compared on score level, which improves the flexibility of the assessment. The discussion focuses on the model selection and on how many items are realistically needed in routine assessments of psychological distress.

An organizational cybernetics framework for achieving balance in evidence-based practice and practice-based evidence

This article applies the systems science of organizational cybernetics to the implementation of evidence-based practice (EBP) in the provision of social work services in a residential treatment center setting. It does so by systemically balancing EBP with practice-based evidence (PBE) with a focus on the organizational and information system infrastructures necessary to ensure successful implementation. This application is illustrated by discussing a residential treatment program that implemented evidence-based programming and evaluated the results; however, the systemic principles articulated can be applied to any human services organizational setting.

Developing practice-based evidence: benefits, challenges, and tensions

Attempts to regulate service delivery in line with results from randomized trials have been vigorously debated. In this paper, results from practice-based studies using the CORE System illustrate the potential to enrich knowledge about the actual outcome of psychological therapy in routine care. These studies also provide data for important questions in psychotherapy research, like orientation differences, the importance of the therapist factor, number of sessions needed for clinical effect, and the alliance-outcome question. Obstacles and challenges in making such studies are illustrated. In conclusion, arguments are put forward for introducing a common measurement system that strikes a balance between clinicians' questions and the need for comparable data, and that encompasses the complexities of patients' reasons for seeking psychological help.

Effect size calculations for the clinician: methods and comparability

OBJECTIVE

The measurement of clinical change via single-group pre-post effect size has become increasingly common in psychotherapy settings that collect practice-based evidence and engage in feedback-informed treatment. Different methods of calculating effect size for the same sample of clients and the same measure can lead to wide-ranging results, reducing interpretability.

METHOD

Effect sizes from therapists-including those drawn from a large web-based database of practicing clinicians-were calculated using nine different methods.

RESULTS

The resulting effect sizes varied significantly depending on the method employed. Differences between measurement methods routinely exceeded 0.40 for individual therapists.

CONCLUSIONS

Three methods for calculating effect sizes are recommended for moderating these differences, including two equations that show promise as valid and practical methods for use by clinicians in professional practice.

The use of routine outcome measures in two child and adolescent mental health services: a completed audit cycle

BACKGROUND

Routine outcome measurement (ROM) is important for assessing the clinical effectiveness of health services and for monitoring patient outcomes. Within Child and Adolescent Mental Health Services (CAMHS) in the UK the adoption of ROM in CAMHS has been supported by both national and local initiatives (such as government strategies, local commissioning policy, and research).

METHODS

With the aim of assessing how these policies and initiatives may have influenced the uptake of ROM within two different CAMHS we report the findings of two case-note audits: a baseline audit conducted in January 2011 and a re-audit conducted two years later in December 2012-February 2013.

RESULTS

The findings show an increase in both the single and repeated use of outcome measures from the time of the original audit, with repeated use (baseline and follow-up) of the Health of the Nation Outcome Scale for Children and Adolescents (HoNOSCA) scale increasing from 10% to 50% of cases. Re-audited case-notes contained more combined use of different outcome measures, with greater consensus on which measures to use. Outcome measures that were applicable across a wide range of clinical conditions were more likely to be used than symptom-specific measures, and measures that were completed by the clinician were found more often than measures completed by the service user.

CONCLUSIONS

The findings show a substantial improvement in the use of outcome measures within CAMHS. These increases in use were found across different service organisations which were subject to different types of local service priorities and drivers.

Translating the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) into Lithuanian

BACKGROUND

There are no standardized tools in Lithuanian feasible for ongoing routine use to measure the effectiveness of psychotherapeutic treatment. The CORE-OM is a widely used 34-item self-report measure for such purpose.

AIMS

To explore the reliability, validity and sensitivity of the Lithuanian translation of CORE-OM questionnaire.

METHODS

A validation study of the CORE-OM was conducted in the psychiatric clinic attached to Vilnius University. A Lithuanian translation of the English original CORE-OM was prepared by a team of translators. Then 39 psychotherapy outpatients and 187 students were asked to complete the Lithuanian version of the CORE-OM; 66 were tested twice to determine test-retest stability. Analysis included both internal and test-retest reliability, acceptability, influence of gender, principal component analysis and criteria for reliable and clinically significant change.

RESULTS

Internal and test-retest reliability were good (0.61-0.94), though somewhat lower for the risk domain (α: 0.57-0.79, Spearman's rho 0.25-0.60). Differences between scores of the clinical and non-clinical samples were large and significant (P < 0.001). Some of the Lithuanian criteria for clinically significant change were a bit lower than those of the original UK criteria (e.g. well-being) and others higher (symptoms, functioning, overall score), illustrating the need for local exploration.

CONCLUSIONS

In spite of small differences in psychometric properties from the original, the Lithuanian version of the CORE-OM was reliable and sensitive in both clinical and non-clinical settings. It has the potential to become a practical, sensitive and reliable tool for psychotherapists in Lithuania.

Comparing approaches for categorizing measure reliability in the assessment of anxiety in older adults

A systematic review of the anxiety measures most commonly used with older adults found that most are developed for a younger population and lacked sufficient evidence of their psychometric properties when used with an older population. As researchers and clinicians need a fast way to judge whether a measure is appropriate when faced with daily assessment tasks, recent efforts have been made in developing guidelines to operationalize the criteria necessary to designate a measure as evidence-based. The goal of this study is to: (a) apply the reliability criteria for two existing evidence based assessment categorization systems to the most commonly used anxiety measures with older adults and (b) compare the results of these categorization systems to the results obtained in a previous reliability generalization study that gave the mean reliability of each measure. We discuss the strengths and limitations of both approaches and suggest how researchers and clinicians can identify psychometrically sound measures without having to conduct more labour-intensive meta-analysis studies.

Randomized clinical trial comparing affect regulation and supportive group therapies for victimization-related PTSD with incarcerated women

Traumatic victimization and associated problems with posttraumatic stress disorder (PTSD) and affect dysregulation are prevalent among incarcerated women, but there is limited evidence to support psychotherapeutic interventions for these problems in this underserved population. A group psychotherapy designed to enhance affect regulation without trauma memory processing-Trauma Affect Regulation: Guide for Education and Therapy (TARGET)-was compared to a supportive group therapy (SGT) in a randomized clinical trial with 72 incarcerated women with full or partial PTSD. Both interventions achieved statistically significant reductions in PTSD and associated symptom severity and increased self-efficacy. Dropout rates for both interventions were low (<5%). TARGET was more effective than SGT in increasing sense of forgiveness toward others who have caused harm in the past. Group therapy that teaches affect regulation may enhance incarcerated women's ability to achieve affective resolution (forgiveness) while also reducing their victimization-related PTSD and associated symptoms. Experiential-focused supportive group therapy also may reduce victimization-related PTSD and associated symptoms. Both group therapy approaches warrant further study with this vulnerable population.

Counselling for sight loss: Using systematic case study research to build a client informed practice model

There is compelling evidence to suggest that acquired sight loss negatively impacts on emotional well-being. Despite increasing recognition of the need to provide emotional support for people with sight loss, we still do not fully understand what counselling interventions help and why they help. The aim of this study was to examine the process and outcome of counselling for a 70-year-old client who had experienced complete, irreversible, post-operative sight loss in order to gain a deeper understanding of client-defined helpful aspects of therapy. A Hermeneutic Single-Case Efficacy Design study was undertaken having received ethical approval from the University’s Research Ethics Committee. The client received six sessions of counselling from a vision-impaired counsellor working within a pluralistic framework. Measures were completed by the client at every session, as well as at pre- and post-counselling. All sessions were recorded and transcribed. The client also participated in pre- and post-counselling interviews. Data formed a rich case record that was analysed by a quasi-judicial enquiry team. Results suggested that this was a successful outcome case. Client-defined helpful aspects of therapy were (1) feeling understood; (2) being able to express emotions around the loss of sight; (3) finding a new identity; (4) finding ways to cope with fear, loss, dependency, and other people’s perceptions; (5) exploring the possibility of a positive future without sight; (6) making sense of things; and (7) finding ways to become more socially connected. Relevant therapeutic tasks are proposed, and four key aspects of therapy are identified, which may have implications for the development of a practice model.

Impact of exchanges and client-therapist alliance in online-text psychotherapy

The impact of exchanges and client-therapist alliance of online therapy text exchanges were compared to previously published results in face-to-face therapy, and the moderating effects of four participant factors found significant in previously published face-to-face studies were investigated using statistical mixed-effect modeling analytic techniques. Therapists (N=30) and clients (N=30) engaged in online therapy were recruited from private practitioner sites, e-clinics, online counseling centers, and mental-health-related discussion boards. In a naturalistic design, they each visited an online site weekly and completed the standard impact and alliance questionnaires for at least 6 weeks. Results indicated that the impact of exchanges and client-therapist alliance in text therapy was similar to, but in some respects more positive than, previous evaluations of face-to-face therapy. The significance of participant factors previously found to influence impact and alliance in face-to-face therapy (client symptom severity, social support, therapist theoretical orientation, and therapist experience) was not replicated, except that therapists with the more symptomatic clients rated their text exchanges as less smooth and comfortable. Although its small size and naturalistic design impose limitations on sensitivity and generalizability, this study provides some insights into treatment impact and the alliance in online therapy.

Role of the working alliance on treatment outcome in tailored internet-based cognitive behavioural therapy for anxiety disorders: randomized controlled pilot trial

Background

Internet-based cognitive behavioral therapy (ICBT) is a form of guided self-help that has been found to be effective for addressing several problems. The target for this type of therapy is usually restricted to one specific disorder. Tailoring the treatment widens the scope of ICBT in that it can address comorbid conditions directly.

Objectives

The working, or therapeutic, alliance has been found to predict outcome in studies of face-to-face therapy. The extent to which these findings apply to ICBT is largely unknown. We therefore decided to find out whether the working alliance could predict outcome in tailored ICBT for anxiety disorders.

Methods

Data were obtained from the treatment group (n=27) in a randomized controlled trial aiming to test the effects of tailored ICBT for anxiety disorders. The forthcoming study was designed to test the hypothesis that the working alliance measured both pre-treatment and early in treatment (week 3) can predict treatment outcome as measured by the Clinical Outcomes in Routine Evaluation–Outcome Measure (CORE-OM) in a heterogeneous group of patients with anxiety disorders (n=27).

Results

Working alliance measured at week 3 into the treatment correlated significantly with the residual gain scores on the primary outcome measure (r=-.47, P=.019, n=25), while expected working alliance pre-treatment did not (r=-.17, P=.42, n=27).

Conclusions

These results raise questions about the importance of working alliance in ICBT treatments, and suggest that the working alliance could be important in ICBT.