Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations

The German version of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM): Factorial validity, internal consistency, and gender differences in a large outpatient sample

OBJECTIVE

The Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is a pantheoretical mental health assessment instrument that has been translated into over 50 languages. Despite its widespread international use in clinical practice and research, the psychometric properties of CORE-OM require further investigation.

METHOD

We explored and tested the factorial validity of the German version of CORE-OM in a large adult clinical outpatient sample (N = 4355) using exploratory and confirmatory factor analysis. Internal consistency and correlations of the four CORE-OM domains (Well-being, Problems, Functioning, and Risk) across gender identities are presented.

RESULTS

While no model satisfied all fit criteria in confirmatory analyses, the three-factor structure derived from exploratory factor analysis outperformed the theoretically favored four-domain solution. Internal consistency was overall acceptable with Well-being scoring slightly lower than the other scales. Non-binary respondents had statistically significantly higher average Risk scores then men and women.

CONCLUSION

Our findings support the reliability of CORE-OM and lend limited support to its factorial structure in a large German-speaking sample, and emphasize the importance of considering diverse gender identities in mental health assessment. The analyses further indicate a need for refinement in the scoring of CORE-OM in various cultural contexts.

What time-varying network models based on functional analysis tell us about the course of a patient's problem

Background: Relations among psychological variables are assumed to be complex and to vary over time. Personalized networks can model multivariate complex interactions. The development of time-varying networks allows to model the variation of parameters over time. Objectives: We aimed to determine the value of time-varying networks for clinical practice. Methods: We applied time-varying mixed graphical models (TV-MGM) and time-varying vector autoregressive models (TV-VAR) to intensive longitudinal data of nine participants with depressive symptoms (n = 6) or anxiety (n = 3). Results: Most of the participants showed temporal changes in network topology within the assessment period of 30 days. Time-varying networks of participants with small, medium, and large time variability in edge parameters clearly show the different temporal evolvements of dynamic interactions between variables. The case example indicates clinical utility but also limitations to the application of time-varying networks in clinical practice. Conclusion: Time-varying network models provide a data-driven and exploratory approach that could complement current diagnostic standards by reflecting interacting, often mutually reinforcing processes of mental health problems and by accounting for variation over time. They can be used to generate hypotheses for further confirmatory and clinical testing.

Effects of an Organizational Implementation Strategy on Sustainment of Measurement-Based Care in Community Mental Health

OBJECTIVE

Little is known about how to sustain evidence-based interventions with fidelity in community mental health settings. Phase 1 of the Working to Implement and Sustain Digital Outcome Measures (WISDOM) trial showed that an organizational strategy improved the implementation of measurement-based care (MBC) in mental health services for youths 1-12 months after clinician MBC training. The authors report results from phase 2 of the trial, in which the strategy's effects on MBC sustainment 13-26 months after clinician MBC training were examined.

METHODS

Twenty-one outpatient mental health clinics were randomly assigned to MBC training and technical assistance plus the Leadership and Organizational Change for Implementation (LOCI) strategy (11 clinics) or to training and technical assistance only (10 clinics). In phase 2, the primary outcomes of MBC completion rate, youth symptom improvement, and MBC fidelity were examined for 452 youths who entered treatment 13-26 months after clinician MBC training.

RESULTS

No differences were found in MBC completion rate or symptom improvement between the two conditions; however, among the 81 youths who received MBC, fidelity was significantly higher at LOCI sites relative to control sites (24%, SE=11.1 vs. 1%, SE=1.0, respectively; p=0.003).

CONCLUSIONS

During phase 2, LOCI sites (vs. control sites) sustained superior MBC fidelity when MBC was used; however, superior MBC completion rates and clinical outcomes were not sustained. Sustainment of MBC may require strategies that improve its fit with regulatory and reimbursement environments in addition to strategies that develop clinic infrastructure.

A scoping review of key domains for youth outcome measurement in alcohol and other drug treatment

INTRODUCTION

The alcohol and other drug treatment needs of young people differ from adults. It is important that outcomes measured in this client population are meaningful and use tools that are validated among young people. However, there has been no research to date that has looked at which outcomes and tools are most relevant for this population. This scoping review identifies outcome domains for young people that are supported by the research literature and clinical practice frameworks and identifies important evidence gaps. We also assessed which validated tools exists to measure these domains.

METHOD

A scoping review of peer reviewed and grey literature was undertaken. Five electronic databases for published papers and eight grey literature databases were searched. Details of studies were extracted in a table and a quality assessment was undertaken on a group level.

KEY FINDINGS

3688 publications were identified, with 38 meeting inclusion criteria being included in the final review. Overall, the quality of the evidence was satisfactory to good, except for the level of evidence component. Twelve outcome domains and 47 outcome tools were identified.

DISCUSSION AND CONCLUSIONS

Alcohol and other drug use, peers and social networks, mental health and wellbeing and family were identified as most relevant for young people in treatment. Although many outcome tools were identified, none of the identified tools completely meet the needs of clinicians and young people in alcohol and other drug treatment (for example, too long or do not capture all domains).

Enhancing psychological assessment and treatment of chronic pain: A research agenda for personalized and process-based approaches

The heterogeneity of chronic pain and stagnating improvements in treatment effectiveness have prompted calls for a shift toward personalized and process-based approaches to the assessment and treatment of chronic pain. As this opens a new line of research, several fundamental questions arise. We begin by defining key terms and reviewing attempts to personalize treatment to date. Despite progress in personalization, long-term effects remain unclear. Existing studies are limited by group-based approaches that overlook individual variability. Future research should use idiographic methods and process-based therapy to tailor interventions to individual needs. A person- and process-oriented research agenda is needed that combines ambulatory assessment, network modeling, and single-case designs to advance personalized treatments for chronic pain and improve clinical decision-making.

Treatment-related changes during and after inpatient treatment for refractory somatic symptom disorder or functional neurological symptom disorder: Testing the applicability of a new approach for analyzing routine outcome monitoring data

The aim of the current observational study was to examine changes and the moments of change during and after intensive integrated multidisciplinary inpatient treatment for patients with refractory Somatic Symptom Disorder (SSD) or Functional Neurological symptom Disorder (FND). Observational Routine Outcome Monitoring (ROM) data were analyzed to examine changes during and after tertiary care inpatient treatment. Treatment was a combination of acceptance and commitment therapy, body-oriented mentalization therapy, psychophysiology therapy, and systemic therapy. Fifty-five inpatients were included. Eight domains of health status (RAND-36) and symptoms of psychopathology (BSI) were analyzed with multiple-lag two-phase mixed model regression analysis. In this new approach, a series of regression analyses evaluated changes and the moments of change (i.e., the improvement lag). Graphs were created for each outcome measure to visualize estimates and significances as a function of all lags explored. A Monte Carlo validation study with simulated data demonstrated the applicability of this approach. Regarding the RAND-36, the most pronounced and significant (p < .001) improvements were found for perceived change in health (improvement lag = 25 days), energy/fatigue (lag = 58), and social functioning (lag = 169). For the BSI, improvements were found on the positive symptom distress index (lag = 43), the global severity index (lag = 71), obsession-compulsion (lag = 73), and psychoticism (lag = 133). This study observed increases in mental and physical health and decreases in symptoms of psychopathology during and after inpatient treatment for refractory SSD or FND, with delayed improvements for some outcomes.

An examination of therapists' professional characteristics as moderators of the effect of feedback on psychological treatment outcomes

Feedback-informed treatment (FIT) has been shown to reduce the gap between more and less effective therapists. This study aimed to examine therapists' professional characteristics as potential moderators of the effect of feedback on treatment outcomes.

The IAPT-FIT Trial was a clinical trial where therapists were randomly assigned to a FIT group or a usual care control group. Treatment response was monitored using measures of depression (PHQ-9), anxiety (GAD-7) and functional impairment (WSAS). In a secondary analysis of this trial (n = 1,835 patients; t = 67 therapists), we used multilevel modelling to examine interactions between therapists' professional characteristics (e.g., attitude towards and self-efficacy regarding feedback utilization, decision-making style, job satisfaction, burnout, difficulties in practice, coping styles, caseload size) with random allocation (FIT vs. controls) to identify moderators of the effects of feedback.

Between 9.6% and 10.8% of variability in treatment outcomes was attributable to therapist effects. Therapist-level caseload sizes and external feedback propensity (EFP) moderated the effect of feedback on depression outcomes. No statistically significant main effects were found for any of the included therapist characteristics.

FIT reduced variability in outcomes between therapists and was particularly effective for therapists with high EFP and larger caseloads.

Effectiveness of cognitive behavioral therapy for adult mental disorders: A large-scale naturalistic study across 29 university outpatient clinics

Practice-based evidence has emerged as an important complementary paradigm to studies in controlled trials. This paper presents results of a large research-practice network at German university outpatient clinics; the KODAP initiative. Pre-post effect sizes, direct assessments of change, and rates of clinically significant and reliable improvement are reported in a heterogeneous clinical sample of 6624 adult patients treated between 2023 and 2014 in 29 psychotherapeutic outpatient clinics. Clinical diagnoses, determined with structured diagnostic clinical interviews at baseline across all clinics, encompassed a wide range of psychopathology. Effectiveness was comparable to other studies in naturalistic settings (d ≈ 0.75-0.95) and somewhat lower than changes reported in disorder-specific CBT efficacy trials. In direct assessments of change, only 1.9% of the patients reported symptom worsening and 3.4% reported no change during treatment. Overall, the results show the potential of multi-site naturalistic research initiatives in general and the effectiveness of outpatient CBT at German university outpatient clinics in particular.

A mixed-methods study of staff perspectives on the barriers and facilitators to the implementation of patient-reported routine outcome measures and feedback in alcohol and other drug treatment

INTRODUCTION

Preliminary evidence supports the use of patient-reported outcome measures (PROM) and feedback for enhancing client outcomes in alcohol and other drug (AOD) treatment. However, successful implementation remains challenging. This mixed-methods study applied the Consolidated Framework for Implementation Research (CFIR) framework to examine inner setting and staff characteristics that act as barriers and facilitators to the implementation of PROMs in AOD treatment.

METHODS

To understand CFIR-informed barriers and facilitators to implement PROMs in AOD treatment, qualitative interviews were conducted with N = 23 AOD counsellors. A separate quantitative survey was conducted with N = 108 AOD counsellors.

RESULTS

Four qualitative themes emerged: (i) PROMs and feedback are valuable to AOD treatment; (ii) counsellor resistance towards PROMs and feedback is a barrier to successful implementation; (iii) competing interests and logistical issues are barriers to the implementation of PROMs and feedback; and (iv) PROMs are a burden to clients that may serve to disengage them from treatment. Survey results indicated a positive association between leadership support (CFIR inner setting construct) and counsellor knowledge and beliefs regarding PROMs and feedback (CFIR staff characteristics construct; β = 0.35, 95% CI [0.13, 0.60]). Findings demonstrated a positive association between available PROMs resources (CFIR inner setting construct) and both knowledge and beliefs regarding PROMs and feedback (β = 0.31, 95% CI [0.14, 0.48]) and self-efficacy to implement PROMs and feedback (CFIR staff characteristics construct; β = 0.18, 95% CI [0.04, 0.32]).

DISCUSSION AND CONCLUSIONS

Findings point to the critical need to adopt a whole-of-organisation approach to foster buy-in for PROMs and feedback to support successful implementation.

Development and validation of an 8-item version of the Real Relationship Inventory-Client form

OBJECTIVE

To develop and validate a very brief version of the 24-item Real Relationship Inventory-Client (RRI-C) form.

METHOD

Two independent samples of individual psychotherapy patients (Nsample1 = 700, Nsample2 = 434) completed the RRI-C along with other measures. Psychometric scale shortening involved exploratory factor analysis, item response theory analysis, confirmatory factor analysis (CFA), and multigroup CFA. Reliability and convergent and discriminant validity of the scale and subscales were also assessed.

RESULTS

The 8-item RRI-C (RRI-C-SF) preserves the two-factor structure: Genuineness (k = 4, α = .86) and Realism (k = 4, α = .87), which were correlated at r = .74. CFA provided the following fit indices for the bifactor model: X2/df = 2.16, CFI = .99, TLI = .96, RMSEA = .07, and SRMR = .03. Multigroup CFA showed that the RRI-C-SF was invariant across in-person and remote session formats. The RRI-C-SF demonstrated high reliability (α = .91); high correlation with the full-length scale (r = .96); and excellent convergent and discriminant validity with measures of other elements of the therapeutic relationship, personality characteristics, current mental health state, and demographic-clinical variables. Clinical change benchmarks were calculated to serve as valuable tools for both research and clinical practice.

CONCLUSION

The RRI-C-SF is a reliable measure that can be used for both research and clinical purposes. It enables a nuanced assessment of the genuineness and the realism dimensions of the real relationship.

Personalization of structured group psychotherapy through add-on interventions: A potential for active engagement

OBJECTIVE

Routine Outcome Monitoring (ROM) in group psychotherapy has shown varied results, as personalizing therapy for multiple patients is challenging. This study explored the impact of ROM and individual Add-On Interventions (AOIs) for patients with depression who were not progressing during Group Cognitive Behavioral Therapy (GCBT). We followed the research question, "How can individual AOIs contribute to patients' therapy courses?".

METHOD

We interviewed patients and therapists involved in GCBT with ROM and individual AOIs prompted by Not-On-Track alerts. Thematic analysis was used to generate themes related to participants' experiences. Three cases were selected to illustrate the structure of the themes.

RESULTS

The main theme, "AOIs: Potential for active engagement," was constituted by seven subthemes concerning the influence of ROM, therapeutic collaboration, shared decision-making, allowing for person-tailored interventions, and the dynamic between group and individual sessions. The potential for active engagement was nurtured through flexible awareness, as patients shifted between a first-person perspective and an external perspective on their therapy process.

CONCLUSION

Individual AOIs, prompted by patient feedback, could create opportunities for reflection and engagement. However, the impact was shaped by the therapeutic relationships, the shared decision-making process, and the extent to which the AOIs offered complementary approaches to group psychotherapy.

[Distinct psychotherapeutic approaches, eclecticism, or integration? On the relevance of therapeutic approaches in everyday practice - results of a nationwide survey of psychotherapists]

The psychotherapy guidelines of the Federal Joint Committee (GBA) are oriented towards the model of distinct psychotherapeutic approaches. The consequences of these guidelines for therapeutic practice and training have been controversially discussed for some time. The present study investigated the attitude of licensed psychotherapists in Germany towards distinct psychotherapeutic approaches.Data were collected using an online survey of n=507 licensed psychotherapists. The participants were asked about their therapeutic orientation, the use of techniques compliant or non-compliant with their own approach, and their opinion on therapeutic approaches in practice and clinical training.The majority of therapists described their orientation as integrative, with assimilative integration being the most common. Techniques that are non-compliant with the therapist's own approach were considered relevant for everyday practice. The majority of respondents were able to identify well with their own approach and described that having distinct therapeutic approaches was helpful for everyday practice. The majority of behavioral therapists were in favor of transtheoretical clinical training, whereas the majority of psychoanalytic therapists rejected it.According to GBA, a combination of different psychotherapeutic approaches is prohibited, but this contradicts the current practice. Although the model of distinct therapeutic approaches offers an important frame of reference for practitioners, it can also be perceived as restrictive if it is interpreted too rigidly.The perspective of practitioners should be given greater weight in the scientific discourse on psychotherapeutic approaches.

Three-Month Polysubstance Use Patterns Among People Enrolled in Outpatient Treatment for Methamphetamine Use

BACKGROUND

Polysubstance use is common among people who use methamphetamine. This prospective study examined the three-month polysubstance use profiles among people enrolled in outpatient treatment for methamphetamine use and associated substance use, mental health, and treatment correlates.

METHOD

The present study used routinely collected client-reported outcome measures data from N = 1,507 clients enrolled in outpatient treatment who reported methamphetamine as their primary drug of concern (Mean age = 34.48; SD = 8.68; 56% male). Past-month substance use was assessed at baseline, one-, and three-months.

FINDINGS

Repeated measures latent class analyses revealed four classes: (1) high and decreasing methamphetamine + stable moderate alcohol + stable high cannabis and daily tobacco (n = 474, 31.45%); (2) stable high methamphetamine + stable high alcohol and daily tobacco (n = 346, 22.96%); (3) low and decreasing methamphetamine + stable moderate daily tobacco (n = 322, 21.37%); (4) stable high methamphetamine + stable moderate daily tobacco (n = 365, 24.22%). Probability of using substances other than methamphetamine remained relatively stable for each class across time. Classes 1 and 4 had greatest severity of methamphetamine involvement at baseline and three-months. Class 1 had greater odds of experiencing moderate-to-severe depression and anxiety, and PTSD and psychosis, compared to class 3.

CONCLUSION

Individuals enrolled in outpatient treatment who report methamphetamine as their primary drug of concern report distinct substance use patterns, although daily tobacco use was mostly ubiquitous. Polysubstance use was widespread, with 79% of participants having moderate-to-high probability of polysubstance use at all timepoints. Clients with the most severe polysubstance use had the highest rates of co-occurring psychopathology.

Barriers to Progress Feedback Adoption in Outpatient Geriatric Mental Healthcare: Exploring Age-Related Factors - A Qualitative Study

Monitoring treatment progress through progress feedback is recognized for its efficacy and demonstrated value. However, its integration and utilization within treatments still need to be improved. Insufficient understanding exists regarding the factors within geriatric mental healthcare influencing the adoption of progress feedback. This study aimed to explore the determinants impacting the utilization of progress feedback within outpatient geriatric mental healthcare, specifically focusing on age-related perspectives and patient group characteristics. This qualitative investigation employed semi-structured interviews involving clinicians (N = 14) selected from four outpatient geriatric teams. The findings revealed both inhibiting and facilitating perspectives concerning progress feedback. Clinicians preferred user-friendly, specific, and tailored measures. Challenges included organizational support, integration in work processes, training, and the digital progress feedback system. Age-related perspectives such as older adults' diverse issues, limited digital skills, and cognitive problems hindered implementation, particularly in the oldest generation of older patients. In outpatient geriatric mental healthcare, many factors and attitudes influencing progress feedback align with those observed in adult psychiatry literature. Moreover, this study highlights specific age-related factors that impede the adoption and implementation of progress feedback, shedding light on the specific barriers within this context.

Psychotherapists' Experience with In-Session Use of Routine Outcome Monitoring: A Qualitative Meta-analysis

Routine outcome monitoring (ROM) has become an increasingly utilized tool in therapeutic practice that has the potential to improve therapy outcomes. This study aimed to synthesize the findings of existing qualitative studies investigating how clinicians use ROM in their work with clients. A systematic search of qualitative studies on clinicians' experience with the use of ROM in mental health services was conducted via PsycInfo, PsycArticles, Medline, Web of Science, and Scopus databases. Qualitative meta-analysis was used to synthesize the finding of the primary studies. Forty-seven studies met the inclusion criteria. The analysis resulted in 21 meta-categories organized into six clusters, namely (1) obtaining clinically relevant information, (2) adapting treatment, (3) facilitating communication, (4) enhancing the therapeutic relationship, (5) facilitating change in clients, and (6) personalized usage of ROM. The meta-analysis revealed that clinicians utilized ROM in diverse ways, including both informational and communicational functions. From the clinicians' perspective, ROM was an element that, on the one hand, introduced additional structure and standardization in treatment and, on the other hand, allowed for greater flexibility and tailoring of treatment.

Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature

Objective: There is a growing interest in idiographic patient-reported outcome measures (I-PROMs) for routine outcome monitoring (ROM) and clinical feedback (CF) in psychotherapy, but to our knowledge, no systematic reviews of the empirical literature. Method: We conducted a systematic literature search for empirical papers investigating effects and experiences of I-PROMs for ROM/CF and found a total of 13 papers. There was only one experimental controlled effectiveness study. Results: We formulated a narrative summary of the data set as a whole. We conducted a secondary analysis of nine papers containing qualitative data on stakeholder experiences with I-PROMs and found three superordinate themes and eight subthemes, summarized as "I-PROMs can facilitate self-reflection for patients, assist in identifying and tracking therapeutic topics, and make patients more committed to therapy by giving them a greater sense of responsibility and empowerment. Formulating goals and problems can be difficult, and lack of progress can be demotivating. Time in therapy is precious and must be spent wisely. Effective use of I-PROMs is facilitated by flexibility and therapists' use of clinical skills." Conclusion: We discuss the limitations of the study and provide recommendations for future research and clinical practice.

Dose-Response Effects of MittEcho, a Measurement Feedback System, in an Indicated Mental Health Intervention for Children in Municipal and School Services in Norway

Including routine client feedback can increase the effectiveness of mental health interventions for children, especially when implemented as intended. Rate of implementation, or dose, of such feedback interventions has been shown to moderate results in some studies. Variation in implementation and use of client feedback may also contribute to the mixed results observed within the feedback literature. This study evaluates dose-response associations of client feedback using a novel Measurement Feedback System (MFS) within an indicated group intervention. The primary aim was to determine whether the rate of MFS implementation predicts symptom reduction in anxiety and depression among school-aged children. The secondary aim was to assess whether the rate of MFS implementation influences children's satisfaction with the group intervention or their dropout rates. Data were collected via a randomized factorial study (clinicaltrials.gov NCT04263558) across 58 primary schools in Norway. Children aged 8 to 12 years (N = 701) participated in a group-based, transdiagnostic intervention targeting elevated symptoms of anxiety or depression. Half of the child groups also received the feedback intervention using the MittEcho MFS. Group leaders (N = 83), recruited locally, facilitated the interventions. The MFS dose was measured using the Implementation Index, which combines the use of MFS by both children and providers (group leaders) into a single dose variable. Results showed no significant additional effect of dose of MFS on change in depression or anxiety scores, on user satisfaction with the intervention or on intervention dropout. The discussion addresses potential reasons for these non-significant findings and implications for MFS implementation in preventive, group-based interventions in school settings.

Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review

We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients' treatment response with standardized measures, is an evidence-based practice that continues to be under-utilized in routine care. The aim of the current review is to provide a summary of the current evidence base for the use of progress feedback, its mechanisms of action and considerations for successful implementation. We reviewed ten available meta-analyses, which report small to medium overall effect sizes. The results suggest that adding feedback to a wide range of psychological and psychiatric interventions (ranging from primary care to hospitalization and crisis care) tends to enhance the effectiveness of these interventions. The strongest evidence is for patients with common mental health problems compared to those with very severe disorders. Effect sizes for not-on-track cases, a subgroup of cases that are not progressing well, are found to be somewhat stronger, especially when clinical support tools are added to the feedback. Systematic reviews and recent studies suggest potential mechanisms of action for progress feedback include focusing the clinician's attention, altering clinician expectations, providing new information, and enhancing patient-centered communication. Promising approaches to strengthen progress feedback interventions include advanced systems with signaling technology, clinical problem-solving tools, and a broader spectrum of outcome and progress measures. An overview of methodological and implementation challenges is provided, as well as suggestions for addressing these issues in future studies. We conclude that while feedback has modest effects, it is a small and affordable intervention that can potentially improve outcomes in psychological interventions. Further research into mechanisms of action and effective implementation strategies is needed.

Routine outcome monitoring and feedback in alcohol and other drug treatment: A qualitative study of client perspectives on implementation

INTRODUCTION

Routine outcome monitoring (ROM) and feedback is an evidence-supported strategy for evaluating alcohol and other drug (AOD) treatment outcomes. However, the implementation of ROM and feedback into AOD services remains a significant challenge. Research aimed at understanding client perspectives on ROM and feedback is needed to facilitate successful implementation. This study examined experiences with and perceptions of ROM and feedback in a sample of clients receiving AOD treatment.

METHODS

Interviews and online surveys were conducted with N = 26 people (13 male; Mage = 36.12 years, SD = 10.29) enrolled in an AOD treatment program in Australia. Data analysis of the transcripts was guided by thematic analysis, while descriptive statistics were used to analyse quantitative survey data.

RESULTS

Four major themes were identified in the qualitative data: (i) ROM and feedback is valuable to AOD treatment; (ii) clear and concise outcome measures with an integrated feedback loop are vital to reliable ROM; (iii) desire for visual and verbal feedback that highlights progress; and (iv) ROM and feedback can be emotionally challenging.

DISCUSSION AND CONCLUSIONS

Participants valued ROM when it was clearly integrated within AOD treatment and they received feedback on their responses. Potential facilitators to implementing and improving the provision of ROM and feedback in AOD treatment include: (i) a clear, treatment-based rationale to foster client buy-in for ROM and maximise AOD treatment benefit; (ii) brief outcome measure surveys; and (iii) graphical visualisations of ROM feedback.

Routine Outcome Monitoring from Psychotherapists' Perspectives: A Framework Analysis Study of Expected Benefits and Difficulties

Psychotherapists' attitudes and expectations towards routine outcome monitoring can impact the likelihood of its fruitful implementation. While existing studies have predominantly focused on Europe and North America, research in Latin America remains limited. The aim of this study is to explore therapists' expected benefits and difficulties prior to implementing a routine outcome monitoring system in a university psychotherapy service in Ecuador. An exploratory and descriptive cross-sectional qualitative study was carried out with 20 participants aged 21 to 47. Semi-structured interviews were conducted to explore participants' knowledge about routine outcome monitoring, their expectations of the difficulties, benefits, usability and risks of using a monitoring system, as well as their expectations about their role in the process. The data analysis adhered to the framework analysis methodology, leading to the identification of six overarching themes, 36 specific themes and 82 subthemes. The interviews highlighted a spectrum of positive and negative expectations at several levels: institutional/general, therapeutic process, therapists, and clients. Perceived benefits encompassed various aspects, including the availability of supplementary information, continuous adaptation of the therapeutic process, facilitation of organization and treatment planning, opportunities for professional development, and fostering patient trust and empowerment. On the other hand, anticipated difficulties comprised concerns such as discomfort among therapists and clients, increased workload, system usage and technical difficulties, and the risk of excessive quantification. Overall, participants expressed more anticipated benefits than difficulties. We present recommendations that can support and optimize the current local implementation efforts of routine outcome monitoring, both within this service and in other settings. These recommendations consider ways to meet positive expectations and address or mitigate negative ones.

[Learning Evidence-Based Practice - Multi-Perspective Competence Development using the Example of Generalised Anxiety Disorder]

Within the framework of the evidence-based practice model of the American Psychological Association (APA, 2006), psychotherapeutic core competences are mostly formulated transdiagnostically and transtheoretically, but do not exclude the systematic consideration of symptom-specific aspects. This article provides an exemplary case study of a person suffering from a generalized anxiety disorder to illustrate how evidence-based practice can be implemented. Multi-perspective competence development can be stimulated in training through the following therapeutic areas: (1) through broad assessment and psychodiagnostics, (2) through joint development of an individual explanatory model, (3) through inclusion of symptom-specific models, (4) through broad consideration of stringent interventions, (5) through application of various treatment modalities, (6) through patient-centred treatment implementation. The article concludes with a list of study examples of how psychotherapeutic competence development can be researched within the framework of the evidence-based practice model.

Making the most out of timeseries symptom data: A machine learning study on symptom predictions of internet-based CBT

Objective

Predicting who will not benefit enough from Internet-Based Cognitive Behavioral (ICBT) Therapy early on can assist in better allocation of limited mental health care resources. Repeated measures of symptoms during treatment is the strongest predictor of outcome, and we want to investigate if methods that explicitly account for time-dependency are superior to methods that do not, with data from (a) only two pre-treatment timepoints and (b) the pre-treatment timepoints and three timepoints during initial treatment.

Methods

We use 1) commonly used time-independent methods (i.e., Linear Regression and Random Forest models) and 2) time-dependent methods (i.e., multilevel model regression, mixed-effects random forest, and a Long Short-Term Memory model) to predict symptoms during treatment, including the final outcome. This is done with symptom scores from 6436 ICBT patients from regular care, using robust multiple imputation and nested cross-validation methods.

Results

The models had a 14 %-12 % root mean squared error (RMSE) in predicting the post-treatment outcome, corresponding to a balanced accuracy of 67-74 %. Time-dependent models did not have higher accuracies. Using data for the initial treatment period (b) instead of only from before treatment (a) increased prediction results by 1.3 % percentage points (12 % to 10.7 %) RMSE and 6 % percentage points BACC (69 % to 75 %).

Conclusion

Training prediction models on only symptom scores of the first few weeks is a promising avenue for symptom predictions in treatment, regardless of which model is used. Further research is necessary to better understand the interaction between model complexity, dataset length and width, and the prediction tasks at hand.

Effectiveness of a Novel Web-Based Intervention to Enhance Therapeutic Relationships and Treatment Outcomes in Adult Individual Psychotherapy: Randomized Controlled Trial and Analysis of Predictors of Dropouts

BACKGROUND

Routine process and outcome monitoring interventions added to psychotherapy are known to improve treatment outcomes, although they vary in format and effectiveness.

OBJECTIVE

This study aimed to evaluate whether a therapist-independent, internet-based routine process monitoring and feedback system could significantly reduce psychological distress and enhance the quality of the therapeutic relationship compared with a treatment-as-usual control group among individuals already engaged in individual psychotherapy.

METHODS

We randomized 475 participants into either the intervention group, which received access to an internet-based routine process monitoring and feedback system in addition to psychotherapy, or the control group, which received only psychotherapy. The trial lasted for 10 weeks. Follow-up assessments at 5 weeks and 10 weeks used the Clinical Outcomes in Routine Evaluation-Outcome Measure as the primary outcome, with the Working Alliance Inventory-Short Revised and the Real Relationship Inventory-Client form as secondary outcomes.

RESULTS

Per-protocol analyses (n=166) showed that psychological distress decreased in both groups, but there was no significant advantage for the intervention group. The intervention group experienced a decline in the genuineness dimension score of the real relationship, with an effect size of d=-0.27, compared with d=0.01 in the control group. In the intervention group (but not in the control group), dropouts showed significantly lower real relationship levels (P=.002), working alliance quality (P=.051), and emotional disclosure (P=.01) compared with those who completed the study. Additionally, logistic regression revealed distinct predictors of dropout within the control group and intervention group.

CONCLUSIONS

The findings do not provide conclusive evidence for the efficacy of the new internet-based intervention in enhancing self-monitoring and prompting reflection on patients' emotional responses to their therapists. However, the intervention appears to influence patients' perceptions of the genuineness dimension in the therapeutic relationship, warranting further investigation. We hypothesize that this alteration in the genuineness dimension could be attributed to the intervention facilitating a more realistic and accurate perception of the therapeutic relationship among participants.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06038747; https://clinicaltrials.gov/study/NCT06038747.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/55369.

Response processes for patients providing quantitative self-report data: a qualitative study

OBJECTIVE

To identify factors that influence response processes for patients providing quantitative self-report data. Secondly, due to the lack of integrative and explanatory models in this area, to develop a model of patients' response processes that can guide what to look for when considering validity evidence and interpreting scores on individual items.

METHODS

Participants (n = 13) were recruited from a specialized substance use disorder treatment clinic and interviewed while responding to items from a clinical feedback system implemented for routine outcome monitoring in that setting. The interview approach was based on cognitive interviewing. Data collection and analysis were inspired by a grounded theory approach.

RESULTS

We identified several variables that influenced the participants' response processes. The variables were organized into five categories: context-related variables; item-related variables; response base variables; reasoning strategies; and response selection strategies. We also found that the participants' responses for many items were affected by different aspects of the response process in ways that are relevant to interpretation but not necessarily discernible from the numerical scores alone, and we developed response categories to capture this.

CONCLUSION

The findings suggest that patients providing quantitative self-report data encounter conditions in the response process that challenge and influence their ability to convey meaning and accuracy. This results in responses that for many of the items reflect messages important for interpretation and follow-up, even if it does not appear from the numerical scores alone. The proposed model may be a useful tool when developing items, assessing validity, and interpreting responses.

Do Therapists Know When Their Clients Deteriorate? An Investigation of Therapists' Ability to Estimate and Predict Client Change During and After Psychotherapy

In routine outcome monitoring, psychotherapists receive feedback from their clients about their self-reported progress during therapy. This practice is based on research indicating that therapists overestimate their effectiveness and cannot detect and predict negative client change. However, this assumption is based on only a few studies. This study aimed to investigate whether trainee therapists could estimate client deterioration after each session and after therapy and whether they, from session to session, could predict client post-therapy outcomes. Fifty-three postgraduate trainee therapists at a university clinic treated 105 clients, with an average of 13.1 sessions. A questionnaire was developed to measure the therapists' estimation of client change at each session and their session-by-session prediction of client post-therapy outcomes. The 10-item version of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) was used to measure clients' self-reported change at each session. The data included 96 (91.5%) therapist estimations of client post-therapy outcomes, 1015 (87.8%) estimations of client change from the second to the penultimate session, and 1140 predictions of post-therapy outcomes. The study found that at post-therapy, the therapists were only able to identify one out of eight clients who showed deterioration on the CORE-10. Additionally, during therapy, they could accurately estimate only six out of 83 sessions in which clients had experienced deterioration on the CORE-10, and they failed to predict any of the eight clients who ended therapy with deterioration. In conclusion, therapists cannot rely on their clinical judgement alone to assess client progress and outcomes and will depend on routine outcome monitoring to detect client deterioration.

The long shadow of early-change patterns: a 3-year follow-up after the use of a web-based intervention for mild to moderate depressive symptoms

Web-based interventions can be effective in treating depressive symptoms. Patients with risk not responding to treatment have been identified by early change patterns. This study aims to examine whether early changes are superior to baseline parameters in predicting long-term outcome. In a randomized clinical trial with 409 individuals experiencing mild to moderate depressive symptoms using the web-based intervention deprexis, three latent classes were identified (early response after registration, early response after screening and early deterioration) based on early change in the first four weeks of the intervention. Baseline variables and these classes were included in a Stepwise Cox Proportional Hazard Multiple Regression to identify predictors associated with the onset of remission over 36-months. Early change class was a significant predictor of remission over 36 months. Compared to early deterioration after screening, both early response after registration and after screening were associated with a higher likelihood of remission. In sensitivity and secondary analyses, only change class consistently emerged as a predictor of long-term outcome. Early improvement in depression symptoms predicted long-term outcome and those showing early improvement had a higher likelihood of long-term remission. These findings suggest that early changes might be a robust predictor for long-term outcome beyond baseline parameters.

Transforming the Effectiveness and Equity of a Psychological Therapy Service: A Case Study in the English NHS Talking Therapies Program

To work with a psychological therapies service to implement a recovery plan, as required by a government body, aimed at improving patient outcomes (effectiveness) and decreasing practitioner variability (equity). A case-study utilizing components of a learning health system, including nationally mandated patient outcome data, comprising three 18-month phases: (1) retrospective baseline; (2) improving patient outcomes (management-led); and (3) reducing practitioner variability (clinician-led). Primary analyses focused on 35 practitioners (NPR = 35) who were constant across the three phases and their patients in each phase (NPA = 930, 1226, 1217, respectively). Reliable improvement rates determined patient outcomes and multilevel modeling yielded practitioner effects. To test generalizability, results were compared to the whole practitioner sample for each phase: (1) NPR = 81, NPA = 1982; (2) NPR = 80, NPA = 2227; (3) NPR = 74, NPA = 2267. Ethical approval was granted by the Health Research Authority. Patient outcomes improved in successive phases for both the core and whole practitioner samples with the largest impact occurring in the management-led intervention. Practitioner variability decreased in successive phases in both the core and whole practitioner samples except in the management-led intervention of the whole sample. Compared with the management-led intervention, the practitioner-led intervention yielded a decrease in practitioner effect exceeding 60% in the core sample and approaching 50% in the whole sample. The implementation of multiple components of a learning health system can lead to improvements in both the effectiveness and equity of a psychological therapy service.

Methodological choices and clinical usefulness for machine learning predictions of outcome in Internet-based cognitive behavioural therapy

BACKGROUND

While psychological treatments are effective, a substantial portion of patients do not benefit enough. Early identification of those may allow for adaptive treatment strategies and improved outcomes. We aimed to evaluate the clinical usefulness of machine-learning (ML) models predicting outcomes in Internet-based Cognitive Behavioural Therapy, to compare ML-related methodological choices, and guide future use of these.

METHODS

Eighty main models were compared. Baseline variables, weekly symptoms, and treatment activity were used to predict treatment outcomes in a dataset of 6695 patients from regular care.

RESULTS

We show that the best models use handpicked predictors and impute missing data. No ML algorithm shows clear superiority. They have a mean balanced accuracy of 78.1% at treatment week four, closely matched by regression (77.8%).

CONCLUSIONS

ML surpasses the benchmark for clinical usefulness (67%). Advanced and simple models perform equally, indicating a need for more data or smarter methodological designs to confirm advantages of ML.

Randomized Trial of an Organizational Implementation Strategy to Improve Measurement-Based Care Fidelity and Youth Outcomes in Community Mental Health

OBJECTIVE

Measurement-based care (MBC), which collects session-by-session symptom data from patients and provides clinicians with feedback on treatment response, is a highly generalizable evidence-based practice with significant potential to improve the outcomes of mental health treatment in youth when implemented with fidelity; however, it is rarely used in community settings. This study tested whether an implementation strategy targeting organizational leadership and organizational implementation climate could improve MBC fidelity and clinical outcomes for youth in outpatient mental health clinics.

METHOD

In a cluster randomized trial, 21 clinics were assigned to the Leadership and Organizational Change for Implementation strategy plus training and technical assistance in MBC (k = 11, n = 117) or training and technical assistance only (k = 10, n = 117). Primary outcomes of MBC fidelity (assessed via electronic metadata) and youth symptom improvement (assessed via caregiver-reported change on the Shortform Assessment for Children Total Problem Score) were collected for consecutively enrolled youths (ages 4-18 years) who initiated treatment in the 12 months following MBC training. Outcomes of each youth were assessed for 6 months following baseline.

RESULTS

A total of 234 youths were enrolled and included in intent-to-treat analyses. At baseline, there were no significant differences by condition in clinic, clinician, or youth characteristics. Youths in clinics using the Leadership and Organizational Change for Implementation strategy experienced significantly higher MBC fidelity compared with youths in control clinics (23.1% vs 3.4%, p = .014), and exhibited significantly greater reductions in symptoms from baseline to 6 months (d = 0.31, 95% CI: 0.04-0.58, p = .023).

CONCLUSION

Implementation strategies targeting organizational leadership and focused implementation climate can improve fidelity to evidence-based practices and clinical outcomes of youth mental health services.

PLAIN LANGUAGE SUMMARY

Measurement-based care is an evidence-based intervention that has been shown to improve the outcomes of mental health services in dozens of randomized trials; however, it is not widely used in routine practice. In this randomized controlled trial of 21 outpatient mental health clinics and 234 youth, the authors found an organizational intervention which trained clinic leaders in skills to support the use of measurement-based care increased the extent to which patients received measurement-based care compared to control clinics where clinic leaders did not receive this training (23% vs. 3%). Youth receiving services in the clinics that received the organizational intervention also had greater reductions in mental health symptoms.

CLINICAL TRIAL REGISTRATION INFORMATION

Working to Implement and Sustain Digital Outcome Measures (WISDOM); https://clinicaltrials.gov/; NCT04096274.

Precision Mental Health and Data-Informed Decision Support in Psychological Therapy: An Example

Outcome measurement including data-informed decision support for therapists in psychological therapy has developed impressively over the past two decades. New technological developments such as computerized data assessment, and feedback tools have facilitated advanced implementation in several seetings. Recent developments try to improve the clinical decision-making process by connecting clinical practice better with empirical data. For example, psychometric data can be used by clinicians to personalize the selection of therapeutic programs, strategies or modules and to monitor a patient's response to therapy in real time. Furthermore, clinical support tools can be used to improve the treatment for patients at risk for a negative outcome. Therefore, measurement-based care can be seen as an important and integral part of clinical competence, practice, and training. This is comparable to many other areas in the healthcare system, where continuous monitoring of health indicators is common in day-to-day clinical practice (e.g., fever, blood pressure). In this paper, we present the basic concepts of a data-informed decision support system for tailoring individual psychological interventions to specific patient needs, and discuss the implications for implementing this form of precision mental health in clinical practice.

Using the 'Leapfrog' Design as a Simple Form of Adaptive Platform Trial to Develop, Test, and Implement Treatment Personalization Methods in Routine Practice

The route for the development, evaluation and dissemination of personalized psychological therapies is complex and challenging. In particular, the large sample sizes needed to provide adequately powered trials of newly-developed personalization approaches means that the traditional treatment development route is extremely inefficient. This paper outlines the promise of adaptive platform trials (APT) embedded within routine practice as a method to streamline development and testing of personalized psychological therapies, and close the gap to implementation in real-world settings. It focuses in particular on a recently-developed simplified APT design, the 'leapfrog' trial, illustrating via simulation how such a trial may proceed and the advantages it can bring, for example in terms of reduced sample sizes. Finally it discusses models of how such trials could be implemented in routine practice, including potential challenges and caveats, alongside a longer-term perspective on the development of personalized psychological treatments.

Evaluation of completely online psychotherapy with app-support versus therapy as usual for clients with depression or anxiety disorder: A retrospective matched cohort study investigating the effectiveness, efficiency, client satisfaction, and costs

INTRODUCTION

Depressive and anxiety disorders are common mental disorders ranking among the leading causes of global disease burden. Not all clients currently benefit from therapy and clients are looking for modern ways of therapy. Online psychotherapy is a promising option for better meeting clients' needs. Recently, a new psychotherapy concept has emerged that combines videoconferencing sessions with support through a mobile application. The latter allows for ecological momentary assessments and interventions, facilitates communication between patients and therapists in between sessions through chat, and allows for incorporating feedback-informed treatment principles.

MATERIAL AND METHODS

The study was a retrospective observational matched cohort study, comparing online psychotherapy with Therapy As Usual (TAU) for clients with depressive or anxiety disorders. Data were obtained via questionnaires, which are part of standard clinical care. Primary outcomes included general mental functioning, and symptoms of depression and anxiety. Secondary outcomes were efficiency, client satisfaction, and therapy costs. Primary endpoints were analyzed using linear mixed models analysis, with an interaction term between time and group. Secondary outcomes were analyzed using linear regression.

RESULTS

Larger improvements were observed in the online compared to the TAU group for general mental functioning and depressive disorder (i.e., General mental functioning: B = -8.50, 95 CI: -15.01 - -1.97, p = 0.011; Depressive disorder: B = - 3.66, 95 % CI: -5.79 - -1.54p < 0.01). No significant differences in change over time between the two groups were observed for anxiety disorder (B = -3.64, 95 % CI: (-13.10 - 5.82) p = 0.447). The total number of sessions was significantly higher in the online psychotherapy group than in TAU (B = 3.71, p < 0.01), although clients were matched on treatment time in weeks. Treatment session duration in minutes was comparable across the groups.

DISCUSSION

Online psychotherapy with app support showed to be a promising alternative to TAU for depressive and anxiety disorders. More research is needed to evaluate the effectiveness, cost-effectiveness and client satisfaction of online psychotherapy compared to TAU, such as randomized controlled trials or studies multiple baseline series designs, and in-depth qualitative research.

Youth Perspectives on 'Highly Personalised and Measurement-Based Care': Qualitative Co-Design of Education Materials

OBJECTIVES

Despite high levels of mental ill-health amongst young people (aged 15-30), this group demonstrates low help-seeking and high drop-out from mental health services (MHS). Whilst shared decision-making can assist people in receiving appropriate and effective health care, young people frequently report that they do not feel involved in treatment decisions. The current study focused on co-design of a clinical education and participant information programme for the Brain and Mind Centre Youth Model of Care. This model, which articulates a youth-focused form of highly personalised and measurement-based care, is designed to promote shared decision-making between young people and clinical service providers.

METHODS

We conducted workshops with 24 young people (16-31; MAge = 21.5) who had accessed mental health services. Participants were asked what advice they would give to young people entering services, before giving advice on existing materials. Workshops were conducted and transcripts were coded using thematic analysis by two lived experience researchers and a clinical researcher.

RESULTS

Young people found it empowering to be educated on transdiagnostic models of mental illness, namely clinical staging, which gives them a better understanding of why certain treatments may be inappropriate and ineffective, and thus reduce self-blame. Similarly, young people had limited knowledge of links between mental health and other life domains and found it helpful to be educated on multidisciplinary treatment options. Measurement-based care was seen as an important method of improving shared decision-making between young people and health professionals; however, to facilitate shared decision-making, young people also wanted better information on their rights in care and more support to share their expertise in their own needs, values and treatment preferences.

CONCLUSIONS

These findings will inform the delivery of the further development and implementation of a youth-specific clinical education and participant information programme for the BMC Youth Model.

PATIENT OR PUBLIC CONTRIBUTION

Workshops were facilitated by researchers with lived expertise in mental ill-health (A.H. and/or C.G.) and a clinical researcher (who has expertise as an academic and a clinical psychologist). A.H. and C.G. were also involved in conceptualisation, analysis, interpretation, review and editing of this paper.

Validation of the intersession alliance measure: Individual, couple, and family versions

Monitoring the therapeutic alliance throughout treatment can improve client outcomes and lead to improved care. The individual, couple, and family versions of the intersession alliance measure (IAM) were developed to facilitate routine monitoring of the expanded therapeutic alliance. Psychometric properties of the three versions of the IAM were examined using a clinical sample. Participants were drawn from clinics in the United States participating in the Marriage and Family Therapy Practice Research Network. Using this sample, results indicate that items on each version of the IAM load on one factor, are invariant across sex, and that each version has good internal consistency, test-retest reliability, and concurrent validity. The IAM-C and IAM-F also have good predictive validity, while the IAM-I has more limited evidence for its predictive validity. These results suggest that the IAMs are valid and reliable measures that can facilitate the routine monitoring of the expanded therapeutic alliance in psychotherapy.

Asking questions that are "close to the bone": integrating thematic analysis and natural language processing to explore the experiences of people with traumatic brain injuries engaging with patient-reported outcome measures

Introduction

Patient-reported outcomes measures (PROMs) are valuable tools for assessing health-related quality of life and treatment effectiveness in individuals with traumatic brain injuries (TBIs). Understanding the experiences of individuals with TBIs in completing PROMs is crucial for improving their utility and relevance in clinical practice.

Methods

Sixteen semi-structured interviews were conducted with a sample of individuals with TBIs. The interviews were transcribed verbatim and analysed using Thematic Analysis (TA) and Natural Language Processing (NLP) techniques to identify themes and emotional connotations related to the experiences of completing PROMs.

Results

The TA of the data revealed six key themes regarding the experiences of individuals with TBIs in completing PROMs. Participants expressed varying levels of understanding and engagement with PROMs, with factors such as cognitive impairments and communication difficulties influencing their experiences. Additionally, insightful suggestions emerged on the barriers to the completion of PROMs, the factors facilitating it, and the suggestions for improving their contents and delivery methods. The sentiment analyses performed using NLP techniques allowed for the retrieval of the general sentimental and emotional "tones" in the participants' narratives of their experiences with PROMs, which were mainly characterised by low positive sentiment connotations. Although mostly neutral, participants' narratives also revealed the presence of emotions such as fear and, to a lesser extent, anger. The combination of a semantic and sentiment analysis of the experiences of people with TBIs rendered valuable information on the views and emotional responses to different aspects of the PROMs.

Discussion

The findings highlighted the complexities involved in administering PROMs to individuals with TBIs and underscored the need for tailored approaches to accommodate their unique challenges. Integrating TA-based and NLP techniques can offer valuable insights into the experiences of individuals with TBIs and enhance the interpretation of qualitative data in this population.

Algorithm-based modular psychotherapy vs. cognitive-behavioral therapy for patients with depression, psychiatric comorbidities and early trauma: a proof-of-concept randomized controlled trial

Effect sizes of psychotherapies currently stagnate at a low-to-moderate level. Personalizing psychotherapy by algorithm-based modular procedures promises improved outcomes, greater flexibility, and a better fit between research and practice. However, evidence for the feasibility and efficacy of modular-based psychotherapy, using a personalized treatment algorithm, is lacking. This proof-of-concept randomized controlled trial was conducted in 70 adult outpatients with a primary DSM-5 diagnosis of major depressive disorder, a score higher than 18 on the 24-item Hamilton Rating Scale for Depression (HRSD-24), at least one comorbid psychiatric diagnosis according to the Structured Clinical Interview for DSM-5 (SCID-5), a history of at least "moderate to severe" childhood maltreatment on at least one domain of the Childhood Trauma Questionnaire (CTQ), and exceeding the cut-off value on at least one of three measures of early trauma-related transdiagnostic mechanisms: the Rejection Sensitivity Questionnaire (RSQ), the Interpersonal Reactivity Index (IRI), and the Difficulties in Emotion Regulation Scale-16 (DERS-16). Patients were randomized to 20 sessions of either standard cognitive-behavioral therapy alone (CBT) or CBT plus transdiagnostic modules according to a mechanism-based treatment algorithm (MoBa), over 16 weeks. We aimed to assess the feasibility of MoBa, and to compare MoBa vs. CBT with respect to participants' and therapists' overall satisfaction and ratings of therapeutic alliance (using the Working Alliance Inventory - Short Revised, WAI-SR), efficacy, impact on early trauma-related transdiagnostic mechanisms, and safety. The primary outcome for efficacy was the HRSD-24 score at post-treatment. Secondary outcomes included, among others, the rate of response (defined as a reduction of the HRSD-24 score by at least 50% from baseline and a score <16 at post-treatment), the rate of remission (defined as a HRSD-24 score ≤8 at post-treatment), and improvements in early trauma-related mechanisms of social threat response, hyperarousal, and social processes/empathy. We found no difficulties in the selection of the transdiagnostic modules in the individual patients, applying the above-mentioned cut-offs, and in the implementation of MoBa. Both participants and therapists reported higher overall satisfaction and had higher WAI-SR ratings with MoBa than CBT. Both approaches led to major reductions of depressive symptoms at post-treatment, with a non-significant superiority of MoBa over CBT. Patients randomized to MoBa were nearly three times as likely to experience remission at the end of therapy (29.4% vs. 11.4%; odds ratio, OR = 3.2, 95% CI: 0.9-11.6). Among mechanism-based outcomes, MoBa patients showed a significantly higher post-treatment effect on social processes/empathy (p<0.05) compared to CBT patients, who presented an exacerbation on this domain at post-treatment. Substantially less adverse events were reported for MoBa compared to CBT. These results suggest the feasibility and acceptability of an algorithm-based modular psychotherapy complementing CBT in depressed patients with psychiatric comorbidities and early trauma. While initial evidence of efficacy was observed, potential clinical advantages and interindividual heterogeneity in treatment outcomes will have to be investigated in fully powered confirmation trials.

The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and outcomes of interest. We propose a novel conceptual framework that uses a human-centered systems lens to foster such embedded evaluation in clinical routine. This approach emphasizes the evaluator-practitioner partnership to build confidence in the bi-directional learning of practice-based evidence with evidence-based practice. The iterative cycles inherent to design thinking are aimed at developing better evaluation questions. The attention to structure and context inherent to systems thinking is intended to support meaningful perspectives in the naturally complex world of health care. Importantly, the combined human-centered systems lens can create greater awareness of the influence of individual and systemic biases that exist in any endeavor or institution that involves people. Recommended tools and strategies include systems mapping, program theory development, and visual facilitation using a logic model to represent the complexity of mental health treatment for communication, shared understanding, and connection to the broader evidence base. To illustrate elements of the proposed conceptual framework, two case examples are drawn from routine outcome monitoring (ROM) and progress feedback. We conclude with questions for future collaboration and research that may strengthen the partnership of evaluators and practitioners as a community of learners in service of local and system-level improvement.

Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions

In the past decade, there has been an increase in research related to the routine collection and active use of standardized patient data in psychotherapy. Research has increasingly focused on personalization of care to patients, clinical skills and interventions that modulate treatment outcomes, and implementation strategies, all of which appear to enhance the beneficial effects of ROM and feedback. In this article, we summarize trends and recent advances in the research on this topic and identify several essential directions for the field in the short to medium term. We anticipate a broadening of research from the focus on average effects to greater specificity around what kinds of feedback, provided at what time, to which individuals, in what settings, are most beneficial. We also propose that the field needs to focus on issues of health equity, ensuring that ROM can be a vehicle for increased wellbeing for those who need it most. The complexity of mental healthcare systems means that there may be multiple viable measurement solutions with varying costs and benefits to diverse stakeholders in different treatment contexts, and research is needed to identify the most influential components in each of these contexts.

From Theory to Practice: A Transtheoretical Treatment and Training Model (4TM)

Background

In this paper, we present the conceptual background and clinical implications of a research-based transtheoretical treatment and training model (4TM).

Method

The model implements findings from psychotherapy outcome, process, and feedback research into a clinical and training framework that is open to future research.

Results

The framework is based on interventions targeting patient processes on a behavioral, cognitive, emotional, motivational, interpersonal, and systemic/socio-cultural level. The 4TM also includes a data-based decision support and feedback system called the Trier Treatment Navigator (TTN).

Conclusion

We discuss important problems associated with clinical orientations solely based on one school of thought. We then contrast these concerns with a clinical and training framework that embraces ongoing research, serving as a guiding structure for process-based transtheoretical interventions. Such research-based psychological therapy can take both traditional and novel clinical developments as well as findings from psychotherapy research into account and be adaptively disseminated to a variety of patient populations.

Psychotherapy Works - An Inclusive and Affirming View to a Modern Mental Health Treatment

Psychotherapy is a highly collaborative and individualized mental health practice developed in (post-) modern societies. The mental health outcomes of psychotherapy cover a broad range of psychological factors including the reduction of suffering/symptoms as well as the promotion of well-being, personal values, and personal strengths. There is extensive meta-analytic evidence that legitimate psychotherapy works remarkably well and robustly for most common mental disorders. In addition, there is a large body of meta-analytic evidence supporting the potential relevance of transdiagnostic relationship principles and transtheoretical psychotherapy factors. Based on this ongoing empirical evidence, we propose four relevant implications for future training and practice in transdiagnostic psychotherapy: 1) the development of a transtheoretical legal framework for psychotherapeutic treatments, 2) the formulation of evidence-based transtheoretical interpersonal skills, 3) an orientation toward transtheoretical therapeutic factors, and 4) the exploration of comprehensive psychotherapy outcomes. We conclude with some more general guidance for future directions.

Responding to Key Process Markers as a Focus of Psychotherapy Training and Practice

Historically, evidence-based psychotherapy training has favored the standardized application of discrete treatment packages, with key outcomes being the therapist's adherence to and competent delivery of theory-prescribed ingredients. However, this model often fails to align with the priorities and values of clinicians, and research casts doubt on the notion that a therapist's faithful application of treatment protocols is a valid index of clinical expertise. Considering this, training and practice models that emphasize evidence-based clinician flexibility and patient-centered tailoring of interventions are receiving increased attention. In this article, we outline one such model informed by the context-responsive psychotherapy integration (CRPI) framework. Consistent with CRPI principles, we describe several "if this/then try that" marker-response sequences that could become a centerpiece of a more nuanced, clinically representative, and evidence-based psychotherapy training paradigm. Finally, we offer several recommendations for future work on CRPI.

Applications of the experience sampling method (ESM) in paediatric healthcare: a systematic review

BACKGROUND

With the Experience Sampling Method (ESM) participants are asked to provide self-reports of their symptoms, feelings, thoughts and behaviours in daily life. This preregistered systematic review assessed how ESM is being used to monitor emotional well-being, somatic health, fatigue and pain in children and adolescents with a chronic somatic illness.

METHODS

Databases were searched from inception. Studies were selected if they included children or adolescents aged 0-25 years with a chronic somatic illness and used ESM focussing on mental health or psychosocial wellbeing, biopsychosocial factors and/or somatic health. Two reviewers extracted data of the final 47 papers, describing 48 studies.

RESULTS

Most studies evaluated what factors influence medical or psychological symptoms and how symptoms influence each other. Another common purpose was to study the feasibility of ESM or ESM as part of an app or intervention. Study methods were heterogeneous and most studies lack adequate reporting of ESM applications and results.

CONCLUSIONS

While ESM holds great potential for providing results and feedback to patients and caregivers, little use is being made of this option. Future studies should consider what they report in their studies, conduct a priori power analyses and how ESM can be embedded in clinical practice.

IMPACT

While ESM has many clinical applications, it is currently mostly used for research purposes. Current studies using ESM are heterogeneous and lack consistent, high-quality reporting. There is great potential in ESM for providing patients and parents with personalised feedback.

Individual-Specific Animated Profiles of Mental Health

How important is the timing of the pretreatment evaluation? If we consider mental health to be a relatively fixed condition, the specific timing (e.g., day, hour) of the evaluation is immaterial and often determined on the basis of technical considerations. Indeed, the fundamental assumption underlying the vast majority of psychotherapy research and practice is that mental health is a state that can be captured in a one-dimensional snapshot. If this fundamental assumption, underlying 80 years of empirical research and practice, is incorrect, it may help explain why for decades psychotherapy failed to rise above the 50% efficacy rate in the treatment of mental-health disorders, especially depression, a heterogeneous disorder and the leading cause of disability worldwide. Based on recent studies suggesting within-individual dynamics, this article proposes that mental health and its underlying therapeutic mechanisms have underlying intrinsic dynamics that manifest across dimensions. Computational psychotherapy is needed to develop individual-specific pretreatment animated profiles of mental health. Such individual-specific animated profiles are expected to improve the ability to select the optimal treatment for each patient, devise adequate treatment plans, and adjust them on the basis of ongoing evaluations of mental-health dynamics, creating a new understanding of therapeutic change as a transition toward a more adaptive animated profile.

Development of decision rules for an adaptive aftercare intervention based on individual symptom courses for agoraphobia patients

As other mental illnesses, agoraphobia is associated with a significant risk for relapse after the end of treatment. Personalized and adaptive approaches appear promising to improve maintenance treatment and aftercare as they acknowledge patients' varying individual needs with respect to intensity of care over time. Currently, there is a deficit of knowledge about the detailed symptom course after discharge from acute treatment, which is a prerequisite for the empirical development of rules to decide if and when aftercare should be intensified. Therefore, this study aimed firstly at the investigation of the naturalistic symptom course of agoraphobia after discharge from initial treatment and secondly at the development and evaluation of a data-driven algorithm for a digital adaptive aftercare intervention. A total of 56 agoraphobia patients were recruited in 3 hospitals. Following discharge, participants completed a weekly online monitoring assessment for three months. While symptom severity remained stable at the group level, individual courses were highly heterogeneous. Approximately two-thirds of the patients (70%) reported considerable symptoms at some time, indicating a need for medium or high-intense therapeutic support. Simulating the application of the algorithm to the data set resulted in an early (86% before week six) and relatively even allocation of patients to three groups (need for no, medium, and high-intense support respectively). Overall, findings confirm the need for adaptive aftercare strategies in agoraphobia. Digital, adaptive approaches may provide immediate support to patients who experience symptom deterioration and thus promise to contribute to an optimized allocation of therapeutic resources and overall improvement of care.

E-therapists' views on the acceptability and feasibility of an internet-administered, guided, low-intensity cognitive behavioural therapy intervention for parents of children treated for cancer: A qualitative study

Background

Childhood cancer treatment completion can be a period of vulnerability for parents and is associated with mental health difficulties such as depression and anxiety. We developed an internet-administered, guided, low-intensity cognitive behavioural therapy-based self-help intervention (EJDeR) for parents delivered on the U-CARE-portal (Portal). The acceptability and feasibility of EJDeR and study procedures were examined using a single-arm feasibility trial (ENGAGE). Results indicated that EJDeR and ENGAGE study procedures are acceptable and feasible, however, a need for clinical and technical modifications to EJDeR and refinements to ENGAGE study procedures was identified.

Objectives

This study aimed to explore the acceptability and feasibility of EJDeR and ENGAGE study procedures from the perspective of e-therapists to inform clinical and technical modifications to EJDeR and refinements to study procedures prior to progression to a superiority randomised controlled trial.

Methods

We conducted semi-structured interviews with 10 e-therapists. Data were analysed using manifest content analysis.

Results

We identified three categories relating to the acceptability and feasibility of EJDeR: (a) Support to e-therapists (subcategories: Clinical supervision and Technical difficulties); (b) Guidance to parents (subcategories: Support protocols and Synchronous communication); and (c) Content (subcategories: Relevancy of the intervention and Pacing of the intervention). We identified four categories relating to the acceptability and feasibility of study procedures: (a) Recruitment and training of e-therapists (subcategories: Definition of the role and Training program); (b) Retention of parents (subcategories: Parent suitability and screening and Frequency of weekly Portal assessments); (c) Retention of e-therapists (subcategories: Administrative requirements and Communication with the research team); and (d) The Portal.

Conclusions

EJDeR and study procedures were considered acceptable and feasible, however, clinical and technical modifications and refinements to study procedures were suggested to enhance acceptability and feasibility. Results may also inform implementation considerations for both EJDeR and other similar digital psychological interventions.

Trial registration number

ISRCTN 57233429.

Psychotherapie wirkt

Psychotherapie ist eine kooperative und individualisierte Behandlung zur Förderung der psychischen Gesundheit, die sich in (post-)modernen Gesellschaften weiterentwickelt. Psychotherapieerfolg umfasst ein breites Spektrum von Kriterien, wie beispielsweise die Verringerung von symptombezogenem Leidensdruck sowie die Förderung von Wohlbefinden, persönlichen Werten, Stärken und psychosozialer Partizipation. Es liegen umfangreiche metaanalytische Belege dafür vor, dass Psychotherapie bei den häufigsten psychischen Störungen und deren Komorbidität bemerkenswert gut und stabil wirkt. Darüber hinaus gibt es eine Vielzahl metaanalytischer Belege für die potenzielle Relevanz transtheoretischer Beziehungs- und Wirkprinzipien. Ausgehend von der Darstellung des sich kontinuierlich entwickelnden evidenzbasierten Konsolidierungsprozesses werden im vorliegenden Beitrag Schlussfolgerungen für die zukünftige Aus- und Weiterbildung sowie die Praxis einer transtheoretisch orientierten Psychotherapie gezogen. Der Beitrag schließt mit allgemeineren Hinweisen auf zukünftige Ziele in transtheoretischer Psychotherapie.