Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study

Perceptions of mental health providers of the barriers and facilitators of using and engaging youth in digital mental-health-enabled measurement based care

Objectives

Increased rates of mental health disorders and substance use among youth and young adults have increased globally, furthering the strain on an already burdened mental health system. Digital solutions have been proposed as a potential option for the provision of timely mental health services for youth, with little research exploring mental health professional views about using such innovative tools. In Alberta, Canada, we are evaluating the implementation and integration of a digital mental health (dMH) platform into existing service pathways. Within this paper we seek to explore mental health professionals' perceptions of the barriers and facilitators that may influence their utilization of digital MH-enabled measurement-based care (MBC) with the youth who access their services.

Methods

A qualitative, descriptive methodology was used to inductively generate themes from focus groups conducted with mental health professionals from specialized mental health services and primary care networks in Alberta.

Results

As mental health professionals considered the barriers and facilitators of using dMH with youth, they referenced individual and family barriers and facilitators to consider. Providers highlighted perceived barriers, including: first, cultural stigma, family apprehension about mental health care, and parental access to dMH and MBC as deterrents to providers adopting digital platforms in routine care; second, perceptions of increased responsibility and liability for youth in crisis; third, perception that some psychiatric and neurodevelopmental disorders in youth are not amenable to dMH; fourth, professionals contemplated youth readiness to engage with dMH-enabled MBC. Participants also highlighted pertinent facilitators to dMH use, noting: first, the suitability of dMH for youth with mild mental health concerns; second, youth motivated to report their changes in mental health symptoms; and lastly, youth proficiency and preference for dMH options.

Conclusions

By identifying professionals' perceptions of barriers and facilitators for youth users, we may better understand how to address misconceptions about who is eligible and appropriate for dMH through training and education.

Evidence-Based Assessments for Transdiagnostic Eating Disorder Symptoms: Guidelines for Current Use and Future Directions

Eating disorders are severe and often chronic mental illnesses that are associated with high impairment and mortality rates. Recent estimates suggest that eating disorder prevalence rates are on the rise, indicating an increased need for accurate assessment and detection. The current review provides an overview of transdiagnostic eating disorder assessments, including interview, self-report, health and primary care screeners, and technology-based and objective assessments. We focused on assessments that are transdiagnostic in nature and exhibit high impact in the field. We provide recommendations for how these assessments should be used in research and clinical settings. We also discuss considerations that are crucial for assessment, including the use of a categorical versus dimensional diagnostic framework, assessment of eating disorders in related fields (i.e., anxiety and depression), and measurement-based care for eating disorders. Finally, we provide suggestions for future research, including the need for more research on short transdiagnostic screeners for use in health care settings, standardized assessments for ecological momentary assessment, development of state-based assessment of eating disorder symptoms, and consideration of assessment across multiple timescales.

A baseline comparison of three diagnostic groups using the Progress Monitoring Tool for Eating Disorders

Utilisation of intensive inpatient treatment for eating disorders (EDs) has climbed in the last decade, illuminating a need for better consensus on what constitutes effective treatment and context-appropriate progress/outcome monitoring during residential stays. The novel Progress Monitoring Tool for Eating Disorders (PMED) measure is specifically designed for inpatient settings. Previous research supports the factorial validity and internal consistency of the PMED; however, additional work is needed to determine its appropriateness for complex patient populations. This study used measurement invariance (MI) testing to determine if the PMED administered at programme admission measures the same items in similar ways across patients with anorexia nervosa restricting- and binge-purge subtypes (AN-R; AN-BP) and bulimia nervosa (BN, N = 1121; M_age  = 24.33 years, SD = 10.20; 100% female). Progressively constrained models were used to determine the level of invariance upheld between the three groups. Results indicated that, while the PMED meets configural and metric MI, it does not display scalar invariance. Said otherwise, the PMED similarly assesses constructs and items across AN-R, AN-BP, and BN, however the same score overall may reflect different levels of psychopathology for patients in one diagnostic category versus another. Comparisons of severity between different EDs should be made with caution, however the PMED appears to be a sound tool for understanding the baseline functioning of patients with EDs in an inpatient setting.

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

PURPOSE

Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address.

METHODS

The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session.

RESULTS

Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care.

CONCLUSION

Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations

OBJECTIVE

To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.

METHOD

A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies.

RESULTS

Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.

CONCLUSION

ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.

Patient, family and provider views of measurement-based care in an early-psychosis intervention programme

Background

Measurement-based care (MBC) in mental health improves patient outcomes and is a component of many national guidelines for mental healthcare delivery. Nevertheless, MBC is not routinely integrated into clinical practice. Several known reasons for the lack of integration exist but one lesser explored variable is the subjective perspectives of providers and patients about MBC. Such perspectives are critical to understand facilitators and barriers to improve the integration of MBC into routine clinical practice.

Aims

This study aimed to uncover the perspectives of various stakeholders towards MBC within a single treatment centre.

Method

Researchers conducted qualitative semi-structured interviews with patients (n = 15), family members (n = 7), case managers (n = 8) and psychiatrists (n = 6) engaged in an early-psychosis intervention programme. Data were analysed using thematic analysis, informed by critical realist theory.

Results

Analysis converged on several themes. These include (a) implicit negative assumptions; (b) relevance and utility to practice; (c) equity versus flexibility; and (d) shared decision-making. Providers assumed patients’ perspectives of MBC were negative. Patients’ perspectives of MBC were actually favourable, particularly if MBC was used as an instrument to engage patients in shared decision-making and communication rather than as a dogmatic and rigid clinical decision tool.

Conclusions

This qualitative study presents the views of various stakeholders towards MBC, providing an in-depth examination of the barriers and facilitators to MBC through qualitative investigation. The findings from this study should be used to address the challenges organisations have experienced in implementing MBC.

Identification of psychiatric inpatient recovery trajectories using routine outcome monitoring with emerging adults

Early intervention for emerging adults with addiction and mental health disorders is beneficial for long-term recovery. The present study investigated the utility of routine outcome monitoring during acute inpatient hospitalization for identifying emerging adults at risk of poor outcomes. This is a retrospective study using latent class growth analysis (LCGA) to identify patient groups with different recovery trajectories, with additional analyses to clarify the characteristics of these trajectory groups. The results identified four patient groups: Rapid responders (38%), gradual responders (34%), high distress non-responders (9%), and low distress non-responders (19%). The high distress non-responding group is characterized by behaviours and disorders associated with ambivalent care seeking: Voluntary admission, longer length of stay, lower service satisfaction, higher outpatient service utilization, elevated risk of emergency department presentation and hospital readmission, and depression/personality disorder diagnosis. The low distress group is characterized by behaviours and disorders associated with treatment rejection: Involuntary admission, shorter length of stay, reduced post-discharge service utilization, and psychotic disorder diagnosis. The results have implications for identifying at-risk youth and developing stepped-care models for more effective and efficient inpatient care.

Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis

Progress feedback is an intervention aimed at enhancing patient outcomes in routine clinical practice. This study reports a comprehensive multilevel meta-analysis on the effectiveness of progress feedback in psychological treatments in curative care. The short- and long-term effects of feedback on symptom reduction were investigated using 58 (randomized and non-randomized) studies, analyzing 110 effect sizes in a total of 21,699 patients. Effects of feedback on dropout rate, percentage of deteriorated cases, and treatment duration were also examined. Moderation analyses were conducted for study and feedback characteristics. A small significant effect of progress feedback on symptom reduction (d = 0.15, 95% CI: [0.10, 0.20]) was found, compared to control groups. This was also true for not-on-track cases (d = 0.17, 95% CI: [0.11, 0.22]). In addition, feedback had a small favorable effect on dropout rates (OR = 1.19, 95% CI: [1.03, 1.38]). The moderation analyses identified several potentially interesting variables for further research, including feedback instrument, outcome instrument, type of feedback, feedback frequency, treatment intensity, and country in which the study was conducted. Future studies should report on these variables more consistently so that we can obtain a better understanding of when and why feedback improves outcomes.

Single-case experimental designs: Characteristics, changes, and challenges

Tactics of Scientific Research (Sidman, 1960) provides a visionary treatise on single-case designs, their scientific underpinnings, and their critical role in understanding behavior. Since the foundational base was provided, single-case designs have proliferated especially in areas of application where they have been used to evaluate interventions with an extraordinary range of clients, settings, and target foci. This article highlights core features of single-case experimental designs, how key and ancillary features of the designs have evolved, the special strengths of the designs, and challenges that have impeded their integration in many areas where their contributions are sorely needed. The article ends by placing the methodological approach in the context of other research traditions. In this way, the discussion moves from the specific designs toward foundations and philosophy of science issues in keeping with the strengths of the person and book we are honoring.

Further development of the 12-item EDE-QS: identifying a cut-off for screening purposes

BACKGROUND

The Eating Disorder Examination - Questionnaire Short (EDE-QS) was developed as a 12-item version of the Eating Disorder Examination Questionnaire (EDE-Q) with a 4-point response scale that assesses eating disorder (ED) symptoms over the preceding 7 days. It has demonstrated good psychometric properties at initial testing. The purpose of this brief report is to determine a threshold score that could be used in screening for probable ED cases in community settings.

METHODS

Data collected from Gideon et al. (2016) were re-analyzed. In their study, 559 participants (80.86% female; 9.66% self-reported ED diagnosis) completed the EDE-Q, EDE-QS, SCOFF, and Clinical Impairment Assessment (CIA). Discriminatory power was compared between ED instruments using receiver operating characteristic (ROC) curve analyses.

RESULTS

A score of 15 emerged as the threshold that ensured the best trade-off between sensitivity (.83) and specificity (.85), and good positive predictive value (.37) for the EDE-QS, with discriminatory power comparable to other ED instruments.

CONCLUSION

The EDE-QS appears to be an instrument with good discriminatory power that could be used for ED screening purposes.

Implementing Measurement-Based Care in Behavioral Health: A Review

IMPORTANCE

Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up.

OBSERVATIONS

Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives.

CONCLUSIONS AND RELEVANCE

This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

Adverse Effects of Outcome Monitoring Feedback in Patients With Personality Disorders: A Randomized Controlled Trial in Day Treatment and Inpatient Settings

This study aimed to evaluate the differential effect of outcome monitoring feedback to therapists and to patients on outcomes in cluster B, cluster C, and personality disorder not otherwise specified (PD-NOS) patients. Day treatment patients (n = 112) and inpatients (n = 94) were randomly assigned to a feedback to therapist (FbT), feedback to therapist and patient (FbTP), or no feedback (NFb) condition. Feedback was based on weekly administrations of the Outcome Questionnaire-45 (OQ-45). In cluster B and PD-NOS patients FbTP resulted in increased OQ-45 scores during the first 6 months of therapy for not on track (NOT) patients. In cluster C patients, no adverse effects of feedback were found. These results suggest that for certain personality disorder patient groups, providing feedback during treatment may not always be beneficial, although more research is needed to further assess these effects.

Psychotherapeutic Treatment for Anorexia Nervosa: A Systematic Review and Network Meta-Analysis

Background: The aim of the study was a systematic review of studies evaluating psychotherapeutic treatment approaches in anorexia nervosa and to compare their efficacy. Weight gain was chosen as the primary outcome criterion. We also aimed to compare treatment effects according to service level (inpatient vs. outpatient) and age group (adolescents vs. adults). Methods:The data bases PubMed, Cochrane Library, Web of Science, Cinahl, and PsychInfo were used for a systematic literature search (until Feb 2017). Search terms were adapted for data base, combining versions of the search terms anorexia, treat^*/therap^* and controlled trial. Studies were selected using pre-defined in- and exclusion criteria. Data were extracted by two independent coders using piloted forms. Network-meta-analyses were conducted on all RCTs. For a comparison of service levels and age groups, standard mean change (SMC) statistics were used and naturalistic, non-randomized studies included. Results: Eighteen RCTs (trials on adults: 622 participants; trials on adolescents: 625 participants) were included in the network meta-analysis. SMC analyses were conducted with 38 studies (1,164 participants). While family-based approaches dominate interventions for adolescents, individual psychotherapy dominates in adults. There was no superiority of a specific approach. Weight gains were more rapid in adolescents and inpatient treatment. Conclusions: Several specialized psychotherapeutic interventions have been developed and can be recommended for AN. However, adult and adolescent patients should be distinguished, as groups differ in terms of treatment approaches considered suitable as well as treatment response. Future trials should replicate previous findings and be multi-center trials with large sample sizes to allow for subgroup analyses. Patient assessment should include variables that can be considered relevant moderators of treatment outcome. It is desirable to explore adaptive treatment strategies for subgroups of patients with AN. Identifying and addressing maintaining factors in AN remains a major challenge.

Nutzung von psychometrischem Feedback als empirische Unterstützung des Supervisionsprozesses bei Ausbildungstherapien

Zusammenfassung. Theoretischer Hintergrund: Trotz der gut belegten generellen Wirksamkeit von Psychotherapie wird die Zahl der Patienten, die nicht auf eine Therapie ansprechen oder sich sogar im Verlauf verschlechtern, auf etwa ein Drittel geschätzt. Da Therapeuten im Vergleich zu empirischen Algorithmen weniger gut in der Lage sind negative Entwicklungen zu entdecken oder zu prognostizieren, brauchen sie zusätzliche Unterstützung in Form von kontinuierlichen Rückmeldungen über den Fortschritt ihrer Patienten. Solche Feedbackinterventionen können als empirisch basierte Unterstützung des Supervisions- oder Intervisionsprozesses verstanden werden. Diese Interventionen haben ihre Wirksamkeit zur Reduktion therapeutischer Misserfolge in zahlreichen Einzelstudien und Meta-Analysen wiederholt zeigen können. Fragestellung: Wie nutzen Therapeuten ein solches Feedback in ihrer praktischen Arbeit und in welchem Ausmaß spielen Therapeutenfaktoren dabei eine Rolle? Methode: In der vorliegenden Studie wurden 72 Therapeuten für 648 ihrer Patienten unmittelbar nach der Therapie dazu befragt, wie sie das psychometrische Feedback genutzt haben. Therapeutenunterschiede wurden mittels Mehrebenenmodellen ermittelt. Ergebnisse: Es konnte gezeigt werden, dass Therapeuten für einen Großteil ihrer Patienten das Feedback verwendeten. In etwa einem Drittel der Fälle gab es den Therapeuten den Anstoß zusätzliche Hilfen (z. B. Supervision/Intervision) zu beanspruchen. Ähnlich einer personengestützten Supervision wurde für über die Hälfte der Patienten das Feedback genutzt um therapeutische Interventionen anzupassen. Ob und in welcher Form es genutzt wurde hing jedoch stark von dem Therapeuten ab. Je nach Verwendungsart konnten Therapeutenunterschiede zwischen 27 % und 52 % der Feedbacknutzung erklären. Die Wahrscheinlichkeit, dass Therapeuten die Nutzungsmöglichkeiten des Feedbacks anwendeten war größer, wenn diese angaben im Durchschnitt zufriedener mit den grafischen Rückmeldungen zu sein. Schlussfolgerungen: Diese Ergebnisse machen deutlich, dass es zu einem großen Teil nicht nur vom Therapieverlauf oder den Charakteristika der jeweiligen Patienten abhängt wie Therapeuten das Feedback nutzen, sondern auch von Variablen, die den Therapeuten betreffen.

Maximizing Psychotherapy Outcome beyond Evidence-Based Medicine

Despite evidence that psychotherapy has a positive impact on psychological disorders, 30% of patients fail to respond during clinical trials, and as many as 65% of patients in routine care leave treatment without a measured benefit. In addition, therapists appear to overestimate positive outcomes in their patients relative to measured outcomes and are particularly poor at identifying patients at risk for a negative outcome. These problems suggest the need for measuring and monitoring patient treatment response over the course of treatment while applying standardized methods of identifying at-risk cases. Computer-assisted methods for measuring, monitoring, identifying potential deteriorators, and providing feedback to clinicians are described along with a model that explains why feedback is likely to be beneficial to patients. The results of 12 clinical trials are summarized and suggest that deterioration rates can be substantially reduced in at-risk cases (from baseline rates of 21% down to 13%) and that recovery rates are substantially increased in this subgroup of cases (from a baseline of 20% up to 35%) when therapists are provided this information. When problem-solving methods are added to feedback, deterioration in at-risk cases is further reduced to 6% while recovery/improvement rates rise to about 50%. It is suggested that the feedback methods become a standard of practice. Such a change in patterns of care can be achieved through minimal modification to routine practice but may require discussions with patients about their clinical progress.

Assessing Patient Progress in Psychological Therapy Through Feedback in Supervision: the MeMOS* Randomized Controlled Trial (*Measuring and Monitoring clinical Outcomes in Supervision: MeMOS)

BACKGROUND

Psychological therapy services are often required to demonstrate their effectiveness and are implementing systematic monitoring of patient progress. A system for measuring patient progress might usefully 'inform supervision' and help patients who are not progressing in therapy.

AIMS

To examine if continuous monitoring of patient progress through the supervision process was more effective in improving patient outcomes compared with giving feedback to therapists alone in routine NHS psychological therapy.

METHOD

Using a stepped wedge randomized controlled design, continuous feedback on patient progress during therapy was given either to the therapist and supervisor to be discussed in clinical supervison (MeMOS condition) or only given to the therapist (S-Sup condition). If a patient failed to progress in the MeMOS condition, an alert was triggered and sent to both the therapist and supervisor. Outcome measures were completed at beginning of therapy, end of therapy and at 6-month follow-up and session-by-session ratings.

RESULTS

No differences in clinical outcomes of patients were found between MeMOS and S-Sup conditions. Patients in the MeMOS condition were rated as improving less, and more ill. They received fewer therapy sessions.

CONCLUSIONS

Most patients failed to improve in therapy at some point. Patients' recovery was not affected by feeding back outcomes into the supervision process. Therapists rated patients in the S-Sup condition as improving more and being less ill than patients in MeMOS. Those patients in MeMOS had more complex problems.

Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults

BACKGROUND

Routine outcome monitoring of common mental health disorders (CMHDs), using patient reported outcome measures (PROMs), has been promoted across primary care, psychological therapy and multidisciplinary mental health care settings, but is likely to be costly, given the high prevalence of CMHDs. There has been no systematic review of the use of PROMs in routine outcome monitoring of CMHDs across these three settings.

OBJECTIVES

To assess the effects of routine measurement and feedback of the results of PROMs during the management of CMHDs in 1) improving the outcome of CMHDs; and 2) in changing the management of CMHDs.

SEARCH METHODS

We searched the Cochrane Depression Anxiety and Neurosis group specialised controlled trials register (CCDANCTR-Studies and CCDANCTR-References), the Oxford University PROMS Bibliography (2002-5), Ovid PsycINFO, Web of Science, The Cochrane Library, and International trial registries, initially to 30 May 2014, and updated to 18 May 2015.

SELECTION CRITERIA

We selected cluster and individually randomised controlled trials (RCTs) including participants with CMHDs aged 18 years and over, in which the results of PROMs were fed back to treating clinicians, or both clinicians and patients. We excluded RCTs in child and adolescent treatment settings, and those in which more than 10% of participants had diagnoses of eating disorders, psychoses, substance use disorders, learning disorders or dementia.

DATA COLLECTION AND ANALYSIS

At least two authors independently identified eligible trials, assessed trial quality, and extracted data. We conducted meta-analysis across studies, pooling outcome measures which were sufficiently similar to each other to justify pooling.

MAIN RESULTS

We included 17 studies involving 8787 participants: nine in multidisciplinary mental health care, six in psychological therapy settings, and two in primary care. Pooling of outcome data to provide a summary estimate of effect across studies was possible only for those studies using the compound Outcome Questionnaire (OQ-45) or Outcome Rating System (ORS) PROMs, which were all conducted in multidisciplinary mental health care or psychological therapy settings, because both primary care studies identified used single symptom outcome measures, which were not directly comparable to the OQ-45 or ORS.Meta-analysis of 12 studies including 3696 participants using these PROMs found no evidence of a difference in outcome in terms of symptoms, between feedback and no-feedback groups (standardised mean difference (SMD) -0.07, 95% confidence interval (CI) -0.16 to 0.01; P value = 0.10). The evidence for this comparison was graded as low quality however, as all included studies were considered at high risk of bias, in most cases due to inadequate blinding of assessors and significant attrition at follow-up.Quality of life was reported in only two studies, social functioning in one, and costs in none. Information on adverse events (thoughts of self-harm or suicide) was collected in one study, but differences between arms were not reported.It was not possible to pool data on changes in drug treatment or referrals as only two studies reported these. Meta-analysis of seven studies including 2608 participants found no evidence of a difference in management of CMHDs between feedback and no-feedback groups, in terms of the number of treatment sessions received (mean difference (MD) -0.02 sessions, 95% CI -0.42 to 0.39; P value = 0.93). However, the evidence for this comparison was also graded as low quality.

AUTHORS' CONCLUSIONS

We found insufficient evidence to support the use of routine outcome monitoring using PROMs in the treatment of CMHDs, in terms of improving patient outcomes or in improving management. The findings are subject to considerable uncertainty however, due to the high risk of bias in the large majority of trials meeting the inclusion criteria, which means further research is very likely to have an important impact on the estimate of effect and is likely to change the estimate. More research of better quality is therefore required, particularly in primary care where most CMHDs are treated.Future research should address issues of blinding of assessors and attrition, and measure a range of relevant symptom outcomes, as well as possible harmful effects of monitoring, health-related quality of life, social functioning, and costs. Studies should include people treated with drugs as well as psychological therapies, and should follow them up for longer than six months.

Development and Psychometric Validation of the EDE-QS, a 12 Item Short Form of the Eating Disorder Examination Questionnaire (EDE-Q)

Objective

The aim of this study was to develop and validate a short form of the Eating Disorder Examination Questionnaire (EDE-Q) for routine, including session by session, outcome assessment.

Method

The current, 28-item version (6.0) of the EDE-Q was completed by 489 individuals aged 18–72 with various eating disorders recruited from three UK specialist eating disorder services. Rasch analysis was carried out on factors identified by means of principal component analysis, which in combination with expert ratings informed the development of an EDE-Q short form. The shortened questionnaire’s reliability, validity and sensitivity was assessed based on online data collected from students of a UK university and volunteers with a history of eating disorders recruited from a national eating disorders charity aged 18–74 (N = 559).

Results

A 12-item short form, the Eating Disorder Examination Questionnaire Short (EDE-QS) was derived. The new measure showed high internal consistency (Cronbach’s α = .913) and temporal stability (ICC = .93; p < .001). It was highly correlated with the original EDE-Q (r = .91 for people without ED; r = .82 for people with ED) and other measures of eating disorder and comorbid psychopathology. It was sufficiently sensitive to distinguish between people with and without eating disorders.

Discussion

The EDE-QS is a brief, reliable and valid measure of eating disorder symptom severity that performs similarly to the EDE-Q and that lends itself for the use of sessional outcome monitoring in treatment and research.

Challenges in the Implementation of Measurement Feedback Systems

This commentary on the articles published in the special section on the development and implementation of measurement feedback systems (MFSs) discusses three challenging themes in the process of MFS implementation: design and planning, organizational context, and sustainability and unintended consequences. It is argued that the implementation of MFSs is complex, but is an important step in improving outcomes in routine care for children and young persons.

Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review

Due to recent increases in the use of feedback from outcome measures in mental health settings, we systematically reviewed evidence regarding the impact of feedback from outcome measures on treatment effectiveness, treatment efficiency, and collaborative practice. In over half of 32 studies reviewed, the feedback condition had significantly higher levels of treatment effectiveness on at least one treatment outcome variable. Feedback was particularly effective for not-on-track patients or when it was provided to both clinicians and patients. The findings for treatment efficiency and collaborative practice were less consistent. Given the heterogeneity of studies, more research is needed to determine when and for whom feedback is most effective.

The effectiveness of clinician feedback in the treatment of depression in the community mental health system

OBJECTIVE

We describe the development and evaluation of a clinician feedback intervention for use in community mental health settings. The Community Clinician Feedback System (CCFS) was developed in collaboration with a community partner to meet the needs of providers working in such community settings.

METHOD

The CCFS consists of weekly performance feedback to clinicians, as well as a clinical feedback report that assists clinicians with patients who are not progressing as expected. Patients in the randomized sample (N = 100) were predominantly female African Americans, with a mean age of 39 years.

RESULTS

Satisfaction ratings of the CCFS indicate that the system was widely accepted by clinicians and patients. A hierarchical linear models (HLM) analysis comparing rates of change across conditions controlling for baseline gender, age, and racial group indicated a moderate effect in favor of the feedback condition for symptom improvement, t(94) = 2.41, p = .017, d = .50. Thirty-six percent of feedback patients compared with only 13% of patients in the no-feedback condition demonstrated clinically significant change across treatment, χ2(1) = 6.13, p = .013.

CONCLUSIONS

These results indicate that our CCFS is acceptable to providers and patients of mental health services and has the potential to improve the effectiveness of services for clinically meaningful depression in the community mental health setting.

Would continuous feedback of patient's clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies

PURPOSE

Continuous outcome monitoring studies have been conducted by one group of researchers in the United States, mainly in university counselling clinics. We completed a systematic review of continuous outcome monitoring and feedback during psychological therapy and assessed the quality and methodological rigour of existing studies to examine if the findings might be applicable to psychological therapy settings in the United Kingdom.

METHODS

An electronic database literature search was carried out on studies on or after 1990 to June 2013 using strict research criteria. Independent ratings of the quality of existing studies were undertaken.

RESULTS

Ten studies with original data met inclusion criteria and two meta-analyses. Feedback improves outcomes for clients who are at risk of treatment failure but effect sizes diminish with more severe psychiatric populations. No study has followed up patients to assess maintenance of gains. Study quality is highly variable. Few studies included diagnostic information and details of randomization. Clinical Support Tools are thought to be helpful but how these were used was not described.

CONCLUSIONS

Although research in continuous monitoring and feedback of clinical outcomes shows promising results in counselling settings, study quality, and methodological issues set limitations on the generalizability of the findings.

PRACTITIONER POINTS

Feedback improves the outcome of therapy for young people with mild problems for those who are at risk of not improving with therapy. Feedback improves outcomes for those with more severe mental health problems but with reduced effect sizes. We do not know if improved outcomes are sustained. The generalizability of the findings may be limited.

Evaluating reliable and clinically significant change in eating disorders: comparisons to changes in DSM-IV diagnoses

Assessing clinically meaningful change is valuable for treatment planning, monitoring course of illness and evaluating outcome. Although DSM eating disorder (ED) diagnoses have been criticized for poor clinical utility, instability, and uncertainty, remission/change of diagnosis is often the standard for evaluating outcome. We tested the validity of the clinically significant reliable change index (CS/RCI) compared to change in DSM-IV ED-diagnoses. We investigated if CS/RCI was concordant to diagnostic change and compared explained variance on measures at follow-up. Using a database for specialized ED treatment in Sweden the sample contained 1042 female patients (246 adolescents/796 adults). CS/RCI was calculated for the Clinical Impairment Assessment (CIA) and the Eating Disorder Examination Questionnaire (EDE-Q). CS/RCI explained more variance in gain scores for psychopathology measures than diagnostic change (DSM-IV). Average agreement between diagnostic change and CS/RCI was 62% and 60% for CIA and EDE-Q, respectively. Diagnostic change always resulted in more positive outcome than CS/RCI. Together with clinical judgment, CS/RCI is a valuable method for determining clinically significant changes in clinical practice and research. It is economically sound and results are easily interpreted and communicated to patients.

Feedback versus no feedback in improving patient outcome in group psychotherapy for eating disorders (F-EAT): protocol for a randomized clinical trial

BACKGROUND

Continuous feedback on patient improvement and the therapeutic alliance may reduce the number of dropouts and increase patient outcome. There are, however, only three published randomized trials on the effect of feedback on the treatment of eating disorders, showing inconclusive results, and there are no randomized trials on the effect of feedback in group therapy. Accordingly the current randomized clinical trial, initiated in September 2012 at the outpatient clinic for eating disorders at Stolpegaard Psychotherapy Centre, aims to investigate the impact of continuous feedback on attendance and outcome in group psychotherapy.

METHODS/DESIGN

The hypothesis is that continuous feedback to both patient and therapist on treatment progress and alliance will increase attendance and treatment outcome. The trial is set up using a randomized design with a minimum of 128 patients allocated to either an experimental or control group at a ratio of 1:1. The experimental group will receive standard treatment (systemic and narrative group psychotherapy) with feedback intervention, whereas the control group will receive standard treatment only. The participants are diagnosed with bulimia nervosa, binge eating disorder, or an eating disorder not otherwise specified, according to the DSM-IV. In the experimental group feedback to the participants, based on the Outcome Rating Scale (ORS) and the Group Session Rating Scale (GSRS), is actively added to standard treatment. The ORS assesses areas of life functioning known to change as a result of therapeutic intervention. The GSRS assesses key dimensions of effective therapeutic relationships. In the control group, the patients fill out the Outcome Rating Scale only, and feedback is not provided.The primary outcome is the rate of attendance to treatment sessions. The secondary outcome is the severity of eating disorder symptoms. Exploratory outcomes are the level of psychological and social functioning, and suicide or self-harm. This is measured with the ORS, Symptom Check List, WHO-Five Wellbeing Index, Sheehan Disability Scale and a modified version of the Self-Harm Inventory.

DISCUSSION

If the results will confirm the hypothesis, this trial will support feedback as a way to improve group treatment attendance for outpatients with eating disorders.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT01693237.

Feedback on patient progress and clinical support tools for therapists: improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice

OBJECTIVES

Although psychosomatic in-patient treatment is effective, 5-10% of the patients deteriorate. Providing patient progress feedback and clinical support tools to therapists improves the outcome for patients at risk of deterioration in counseling, outpatient psychotherapy, and substance abuse treatment. This study investigated the effects of feedback on psychosomatically treated in-patients at risk of treatment failure.

METHODS

At intake, all patients of two psychosomatic clinics were randomized either into the experimental group or the treatment-as-usual control group. Both groups were tracked weekly with the "Outcome Questionnaire" (OQ-45) measuring patient progress and with the clinical support tool "Assessment of Signal Cases" (ASC). Therapists received feedback from both instruments for all their experimental group patients. "Patients at risk" were defined as patients who deviated from expected recovery curves by at least one standard deviation. Of 252 patients, 43 patients were at risk: 23 belonged to the experimental group, 20 to the control group. The feedback effect was analyzed using a level-2-model for discontinuous change, effect size (d), reliable change index (RCI), and odds ratio for reliable deterioration.

RESULTS

For patients at risk, the experimental group showed an improved outcome on the OQ-45 total scale compared to the control group (p<0.05, d=0.54). By providing feedback, the rate of reliably deteriorated patients at risk was reduced from 25.0% (control group) to 8.7% (experimental group) - odds ratio=0.29. All reliably improved patients at risk belonged to the experimental group.

CONCLUSION

Feedback improves the outcome of patients at risk undergoing psychosomatic in-patient treatment.