Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package

Perceived psychological control relates to coping-related drinking motives via social anxiety among adolescents: A cross-sectional mediation analysis

Accumulating evidence suggests that particular parenting behaviors (e.g., elevated psychological control) may increase risk for both problematic social anxiety and alcohol use among youth; however, no work has yet examined these factors together in a single model. Building developmentally sensitive models of problematic alcohol use trajectories is key to developing effective prevention and intervention strategies. The present study includes 94 adolescents (ages 14-17 years; 53.3% girls; 89.2% White) entering a treatment facility for a variety of internalizing and externalizing forms of psychological distress. Levels of perceived parental psychological control, social anxiety, and coping-related drinking motives were assessed. Higher levels of perceived psychological control were associated with a greater endorsement of coping-related drinking motives; however, a significant proportion of that association was accounted for by elevated social anxiety symptoms. These data extend the existing literature and lay groundwork for more sophisticated experimental and longitudinal designs to corroborate the findings. Moreover, personality-targeted drinking interventions for adolescents may benefit from identifying elevated perceived psychological control as a developmentally relevant risk factor for social anxiety and problematic drinking motives and administering relevant interventions (e.g., personality-targeted coping skills training, parent-involved care) before drinking patterns are established.

Routine Outcome Monitoring and Clinical Feedback in Psychotherapy: Recent Advances and Future Directions

In the past decade, there has been an increase in research related to the routine collection and active use of standardized patient data in psychotherapy. Research has increasingly focused on personalization of care to patients, clinical skills and interventions that modulate treatment outcomes, and implementation strategies, all of which appear to enhance the beneficial effects of ROM and feedback. In this article, we summarize trends and recent advances in the research on this topic and identify several essential directions for the field in the short to medium term. We anticipate a broadening of research from the focus on average effects to greater specificity around what kinds of feedback, provided at what time, to which individuals, in what settings, are most beneficial. We also propose that the field needs to focus on issues of health equity, ensuring that ROM can be a vehicle for increased wellbeing for those who need it most. The complexity of mental healthcare systems means that there may be multiple viable measurement solutions with varying costs and benefits to diverse stakeholders in different treatment contexts, and research is needed to identify the most influential components in each of these contexts.

Therapist-Level Moderators of Patient-Therapist Match Effectiveness in Community Psychotherapy

Based on patient-reported outcomes data analyzed at the provider level, there is evidence that psychotherapists can possess effectiveness strengths and weaknesses when treating patients with different presenting concerns. These within-therapist differences hold promise for personalizing care by prospectively matching patients to therapists' historical effectiveness strengths. In a double-masked randomized controlled trial (RCT; NCT02990000), such matching outperformed pragmatically determined usual case assignment-which leaves personalized, measurement-based matching to chance-in naturalistic outpatient psychotherapy (Constantino et al., JAMA Psychiatry 78:960-969, 2021). Demonstrating that personalization can be even more precise, some research has demonstrated that the strength of this positive match effect was moderated by certain patient characteristics. Notably, though, it could also be that matching is especially important for some therapists to achieve more effective outcomes. Examining this novel question, the present study drew on the Constantino et al. (JAMA Psychiatry 78:960-969, 2021) trial data to explore three therapist-level moderators of matching: (a) effectiveness "spread" (i.e., greater performance variability across patients' presenting problem domains), (b) overestimation of their measurement-based and problem-specific effectiveness, and (c) the frequency with which they use patient-reported routine outcomes monitoring in their practice. Patients were 206 adults, randomized to the match or control condition, treated by 40 therapists who were crossed over conditions. The therapist variables were assessed at the trial's baseline and patients' symptomatic/functional impairment and global distress were assessed regularly up to 16 weeks of treatment. Hierarchical linear models revealed that only therapist effectiveness spread significantly moderated the match effect for the global distress outcome; for therapists with more spread, the match effect was more pronounced, whereas the match effect was minimal for therapists with less effectiveness spread. Notably, two therapist-level covariates unexpectedly emerged as significant moderators for the symptomatic/functional impairment outcome; for clinicians who consistently treated patients with higher versus lower average severity levels and who relatedly treated a higher proportion of patients with primary presenting problems of substance misuse or violence, the beneficial match effect was even stronger. Thus, measurement-based matching may be especially potent for therapists with more variable effectiveness across problem domains, and who consistently treat patients with more severe presenting concerns or with particular primary problems, which provides further precision in conceptualizing personalized care.

Assessment of Depression in Adults and Youth

This article selectively reviews the key issues and measures for the assessment of depressive disorders and symptoms in youth and adults. The first portion of the article addresses the nature and conceptualization of depression and some key issues that must be considered in its assessment. Next, the diagnostic interview and clinician- and self-administered rating scales that are most widely used to diagnose, screen for, and assess the severity of depression in adults and youth are selectively reviewed. In addition, the assessment of three transdiagnostic clinical features (anhedonia, irritability, and suicidality) that are frequently associated with both depression and other forms of psychopathology is discussed. The article concludes with some broad recommendations for assessing depression in research and clinical practice and suggestions for future research.

Predicting Successful Placements for Youth in Child Welfare with Machine Learning

Out-of-home placement decisions have extremely high stakes for the present and future well-being of children in care because some placement types, and multiple placements, are associated with poor outcomes. We propose that a clinical decision support system (CDSS) using existing data about children and their previous placement success could inform future placement decision-making for their peers. The objective of this study was to test the feasibility of developing machine learning models to predict the best level of care placement (i.e., the placement with the highest likelihood of doing well in treatment) based on each youth's behavioral health needs and characteristics. We developed machine learning models to predict the probability of each youth's treatment success in psychiatric residential care (i.e., Psychiatric Residential Treatment Facility [PRTF]) versus any other placement (AUROCs > 0.70) using data collected in standard care at a behavioral health organization. Placement recommendations based on these machine learning models distinguished between youth who did well in residential care versus non-residential care (e.g., 80% of those who received care in the recommended setting with the highest predicted likelihood of success had above average risk-adjusted outcomes). Then we developed and validated machine learning models to predict the probability of each youth's treatment success across specific placement types in a state-wide system, achieving an average AUROC score of greater than 0.75. Machine learning models based on risk-adjusted behavioral health and functional data show promise in predicting positive placement outcomes and informing future placement decisions for youth in care. Related ethical considerations are discussed.

A Qualitative Analysis of Stakeholder Attitudes Regarding Personalized Provider Selection and Patient-Therapist Matching

This study explored mental health care patients and therapists' perspectives on using therapists' measurement-based and problem-specific effectiveness data to inform case assignments - a type of treatment personalization that has been shown to outperform non-measurement-based case assignment as usual (Constantino et al., 2021). We conducted semi-structured qualitative interviews with 8 patients (75% women; M age = 33.75 years) and 8 therapists (75% women; M age = 47.50 years). The interview protocols were unique to stakeholder group. Recorded responses were transcribed and qualitatively analyzed by four judges using a blend of consensual qualitative research and grounded theory methods. Derived patient domains included preferred characteristics of a provider, and experiences and suggestions regarding provider selection. Within the domains, most patients expressed an interest in accessing more specific provider information online. Additionally, most patients indicated that both provider outcome track records and personal preference information (e.g., therapist characteristics) should be considered in the therapist selection process. All patients endorsed being comfortable with having the ability to select a provider based on a list of empirically well-matched recommendations. Derived therapist domains included using routine outcomes monitoring for patient-provider matching, referral source and direct patient use of preferred provider lists, and improvements to the provider selection process. Within the domains, all therapists remarked that outcome data would be useful for matching patients to providers; however, most also indicated that outcome data should not be the only factor used in provider selection. All therapists expressed a willingness to be included in preferred provider lists that incorporate track record data. Overall, both patients and therapists held generally positive views toward using therapist effectiveness data to help personalize mental health care. Yet, both stakeholder groups acknowledged that other personalization factors should be considered alongside these data. Based on these results, our team is in the process of implementing patient-therapist match strategies in larger and more diverse mental health care contexts.

Existential Isolation as a Correlate of Mental Health Problems, Predictor of Treatment Outcome, and Moderator of a Patient-Therapist Match Effect

Introduction: Ample research has established that interpersonal isolation—the objective separateness from others—is a correlate of maladaptive psychological outcomes. However, existential isolation (EI)—the feeling of aloneness in one's subjective experience—has received less empirical attention. From the limited existing research, higher EI has been associated with greater severity of mental health concerns and more negative beliefs about treatment. Yet, these investigations have largely been conducted with non-clinical samples. Further, virtually no studies have examined EI as a predictor of current psychotherapy outcomes. Moreover, given their risk of holding negative treatment beliefs, it is plausible that therapy would be most effective if more existentially isolated individuals experienced being well matched to their therapist. This study extended EI research to a clinical sample and provided a novel test of EI as a direct predictor of outcome and moderator of a patient-therapist match system in naturalistic psychotherapy. Method: Data derived from a randomized trial comparing the effectiveness of prospectively matching patients (N = 218) to therapists (N = 48) with empirical strengths in treating the patient's specific presenting problem(s) versus case assignment as usual (Constantino et al., 2021). Patients rated EI at baseline and mental health outcomes repeatedly through treatment. We conducted correlations to examine baseline EI-symptom associations and multilevel modeling to test EI as a predictor of symptom change and moderator of the known beneficial match effect on outcome. Results: As predicted, higher EI was associated with greater depression, anxiety, and distress at baseline, as well as poorer therapy outcome across and at the end of treatment. In the expected direction, though not to a statistically significant level, the positive match effect was stronger for patients with higher versus lower EI. Discussion: We discuss research and practice implications at the intersection of social and clinical psychology.

Brief Adjustment Scale-6 for Measurement-Based Care: Psychometric Properties, Measurement Invariance, and Clinical Utility

The Brief Adjustment Scale-6 (BASE-6) was recently developed for measuring general psychological functioning within measurement-based care (MBC). The present study further evaluated psychometric properties, generalizability to race/ethnic populations, and clinical utility of the BASE-6. Three adult samples, Sample 1: online community participants (n = 394); Sample 2: college students (n = 249); Sample 3: outpatient clinic clients (n = 80), were included. The results demonstrated a high level of internal consistency, good test-retest reliability, and convergent validity in all samples. The unidimensional structure of BASE-6 was confirmed and factorial invariance was established across groups. Finally, the BASE-6 captured change over time by demonstrating a large effect size of pre-post treatment changes and significant linear change in multilevel growth modeling. These results support the BASE-6 as a reliable and valid measure regardless of race/ethnicity and can sensitively detect clinical change over the course of the treatment. Thus, the BASE-6 appears to accurately monitor overall psychological adjustment.

Integration of hatha yoga and evidence-based psychological treatments for common mental disorders: An evidence map

BACKGROUND

Interest in the use of yoga to enhance engagement with and augment the benefits of psychological treatment has grown. However, a systematic approach to reviewing existing research examining the use of yoga with psychological treatment is lacking.

MATERIALS AND METHODS

This mapping review identified and synthesised research trialling yoga as an integrated or adjunct therapy with evidence-based psychological interventions for the treatment of anxiety, depression, PTSD, and eating disorders.

RESULTS

Overall, the review identified ten published and three unpublished studies, representing either single group or small quasi-experimental research designs.

DISCUSSION

Limited but promising findings were shown for yoga with CBT for anxiety and depression, and the integration of yoga within intensive treatment models for PTSD.

CONCLUSIONS

Future research is encouraged to focus on controlled trials that enable examination of the component effect of yoga when applied with evidence-based psychological treatment and acceptability and feasibility data to further knowledge regarding a role for yoga in clinical practice.

Overview of Ten Child Mental Health Clinical Outcome Measures: Testing of Psychometric Properties with Diverse Client Populations in the U.S

While many standardized assessment measures exist to track child mental health treatment outcomes, the degree to which such tools have been adequately tested for reliability and validity across race, ethnicity, and class is uneven. This paper examines the corpus of published tests of psychometric properties for the ten standardized measures used in U.S. child outpatient care, with focus on breadth of testing across these domains. Our goal is to assist care providers, researchers, and legislators in understanding how cultural mismatch impacts measurement accuracy and how to select tools appropriate to the characteristics of their client populations. We also highlight avenues of needed research for measures that are in common use. The list of measures was compiled from (1) U.S. state Department of Mental Health websites; (2) a survey of California county behavioral health agency directors; and (3) exploratory literature scans of published research. Ten measures met inclusion criteria; for each one a systematic review of psychometrics literature was conducted. Diversity of participant research samples was examined as well as differences in reliability and validity by gender, race or ethnicity, and socio-economic class. All measures showed adequate reliability and validity, however half lacked diverse testing across all three domains and all lacked testing with Asian American/Pacific Islander and Native American children. ASEBA, PSC, and SDQ had the broadest testing.

Depression Anxiety Stress Scale-10: A Brief Measure for Routine Psychotherapy Outcome and Progress Assessment

Routine outcome measurement and progress monitoring is well established to enhance quality assurance in clinical psychology service delivery but is not widely used in routine care. A major barrier to more widespread implementation is the lack of public domain, brief, psychometrically sound outcome measures that easily integrate into clinical information systems. The current study assessed a brief 10-item version of the widely used Depression Anxiety Stress (DASS)-42 scale, which we called the Depression Anxiety Stress-10 (DASS-10) scale. In two clinical samples of adults (n = 1036, 445 men, 591 women; and n = 1084, 493 men, 591 women), the DASS-10 had a replicable two-level factor structure, which at the lower level had two factors assessing stress-anxiety and depression, which each loaded onto a superordinate psychological distress scale. The items in the distress score discriminated between a clinical sample (n = 376) and a community sample (n = 379) and were sensitive to clinical change. The measure has the potential to make routine outcome measurement and progress monitoring more cost-effective to implement than existing measures, particularly when integrated with practice management software to make administration, scoring, and use easy.

Trajectories of depression in psychotherapy: How client characteristics predict clinical improvement

OBJECTIVE

The current study aims to ascertain the trajectories of psychotherapy clients' symptom change and identify client factors that predict treatment outcome.

METHOD

We conducted a latent growth mixture model (LGMM) to identify the change trajectories of 44 clients' depression scores during psychotherapy. Client characteristics were then explored to determine whether any were associated with change trajectories. We examined whether the number of physician visits and/or client self-concealment scores predict 63 clients' improvement after controlling for initial symptom severity.

RESULTS

Two trajectories of clients' symptom change were identified: nonimprovers (52.3%) and improvers (47.7%). Nonimprovers had higher levels of self-concealment and baseline depression than improvers. The number of physician visits was associated with higher depression scores at baseline and greater clinical improvement during psychotherapy.

CONCLUSION

Clients showed distinct trajectories of symptom change in psychotherapy. Early identification of clients at risk for treatment failure may increase the probability of therapeutic success.

Test of a clinical model of poor physical health and suicide: The role of depression, psychosocial stress, interpersonal conflict, and panic

BACKGROUND

This study employed a structural equation model to examine the relationships between poor physical health, suicide, depression, psychosocial stress, interpersonal conflict, and panic.

METHODS

The sample consisted of a large, archived set of mental health treatment-seeking adults who completed a behavioral outcome questionnaire prior to beginning treatment.

RESULTS

Results supported the extant literature indicating that poor physical health, depression, psychosocial stress, interpersonal conflict, and panic impose increased risk for suicidal ideation, with depression demonstrating the highest risk for increased suicidal ideation. The results also supported the hypotheses that depression, psychosocial stress, interpersonal conflict, and panic would mediate the association between poor physical health and suicidal ideation. Although no a priori hypotheses were made regarding relationships among the 15 physical illnesses examined, results indicated that HIV/AIDS had the strongest correlation with depression and the weakest correlation with interpersonal conflict.

LIMITATIONS

Firstly, the study sample was primarily Caucasian, limiting its generalizability. Secondly, causal inferences should be interpreted with caution, due to the quasi-experimental design. Thirdly, these data were self-reported, which create response biases since suicidal ideation is stigmatized.

CONCLUSIONS

These findings highlight the importance of considering interpersonal factors as potential mediators in the relationship between poor physical health, mental illness, and suicide. Clinically, the impact of an active major depressive episode on an individual who is struggling with a serious physical illness may be strongly predictive of suicidal ideation.

Attending to the Alliance in the Application of the Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders: A Case Study

As conceptualizations of mood and anxiety disorders shift toward a dimensional approach, transdiagnostic treatments have gained recognition and support. The Unified Protocol for the Transdiagnostic Treatment of Emotional Disorders (UP) is an evidence-based cognitive behavioral therapy that targets the core processes that underlie common and comorbid mental disorders. It is designed to help clients learn how to confront, experience, and respond to their emotions in adaptive ways through the modification of their emotion regulation strategies. The current case study describes the flexible application of the UP with a treatment-naïve 25-year-old female who presented to outpatient therapy with symptoms of anxiety and depression. Additions to the UP were made to address issues related to the therapeutic alliance and information discovered over the course of treatment. Outcome measures administered to the client reflect significant symptom improvement and add to a growing body of literature that supports the usefulness of transdiagnostic approaches to treating a range of disorders. Moreover, quantitative and qualitative data point to the necessity for clinicians to attend to the therapeutic alliance and consider cultural factors when delivering manualized treatment approaches to individuals from diverse backgrounds.

Latent trajectories of change for clients at a psychodynamic training clinic

OBJECTIVE

Employing practice-based research methods, we addressed the need to examine the effectiveness of psychodynamic treatment as a supplement to the efficacy evidence offered by randomized clinical trials.

METHOD

We used person-centered analyses to generate latent subgroups of clients (N = 118; M _age  = 40.92; 53.4% female; 81.4% Caucasian; 80.5% heterosexual) receiving contemporary relational psychotherapy (CRP) at a psychodynamic community mental health training clinic.

RESULTS

Subgroups of clients reported a change in depression, social conflict, and anxiety symptomatology, and overall life satisfaction, depicted by significant quadratic growth curves. Findings also offered exploratory support for a theoretical proposition from CRP that improved relational functioning would correspond to improved affect dysregulation and overall life satisfaction.

CONCLUSION

Clinical and training implications highlight the need to distinguish subgroups of "responders" and "nonresponders" to inform treatment.

Deterioration rates in Virtual Reality Therapy: An individual patient data level meta-analysis

Ample evidence supports the use of Virtual Reality (VR) for anxiety disorders. Nonetheless, currently there is no evidence about moderators or potential negative effects of VR treatment strategies. An Individual Patient Data (IPD) approach was employed with 15 retrieved datasets. The current study sample was composed of 810 patients. Randomized control trials (RCTs) for each primary outcome measure were performed, in addition to moderator analyses of the socio-demographic variables. Deterioration rates were 14 patients (4.0%) in VR, 8 (2.8%) in active control conditions, and 27 (15%) in the WL condition. With regard to receiving treatment, patients in a waiting list control condition had greater odds of deteriorating than in the two active conditions, odds ratios (ORs) 4.87, 95% confidence interval (CI) [0.05, 0.67]. In the case of the socio-demographic variables, none of them were associated with higher or lower odds of deterioration, with the exception of marital status in the WL condition; married people presented a significantly lower probability of deterioration, OR 0.19, 95% CI [0.05, 0.67]. Finally, when comparing pooled effects of VR versus all control conditions, the OR was 0.61 (95% CI 0.31-1.23) in favor of VR, although this result was not statistically significant. This study provides evidence about the deterioration rates of a therapeutic VR approach, showing that the number of deteriorated patients coincides with other therapeutic approaches, and that deterioration is less likely to occur, compared to patients in WL control groups.

Anxiety sensitivity and suicidal ideation/suicide risk: A meta-analysis

OBJECTIVE

Suicide is a global public health concern. To inform the prevention and treatment of suicidality, it is crucial to identify transdiagnostic vulnerability factors for suicide and suicide-related conditions. One candidate factor is anxiety sensitivity (AS)-the fear of anxiety-related sensations-which has been implicated in the pathogenesis of a host of mental health outcomes, including suicidal thoughts and behaviors. Importantly, AS is distinct from trait anxiety and negative affectivity, highlighting its potential incremental utility in the understanding of psychopathology. Despite a burgeoning body of literature demonstrating that AS is linked to suicidal thoughts and behaviors, this research has yet to be synthesized.

METHOD

This meta-analysis includes 33 articles representing 34 nonredundant samples (N = 14,002) that examined at least one relationship between AS global or subfactor (i.e., cognitive, physical, social) scores and suicidal ideation and/or suicide risk.

RESULTS

Findings revealed small-to-moderate and moderate associations between global AS and suicidal ideation (r = .24, 95% confidence interval (CI): [.21, .26], p < .001) and suicide risk (r = .35, 95% CI [.31, .38], p < .001), respectively. All AS subfactors evinced significant associations with suicidal ideation (rs = .13-.24) and suicide risk (rs = .22-.32).

CONCLUSIONS

AS is related to suicidal ideation and global suicide risk. Research is needed to disentangle AS from other indices of distress in the prediction of suicidal thoughts and behaviors. Theoretical and clinical implications of these findings are discussed. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

A systematic review of therapist effects: A critical narrative update and refinement to review

OBJECTIVE

To review the therapist effects literature since Baldwin and Imel's (2013) review.

METHOD

Systematic literature review of three databases (PsycINFO, PubMed and Web of Science) replicating Baldwin and Imel (2013) search terms. Weighted averages of therapist effects (TEs) were calculated, and a critical narrative review of included studies conducted.

RESULTS

Twenty studies met inclusion criteria (3 RCTs; 17 practice-based) with 19 studies using multilevel modeling. TEs were found in 19 studies. The TE range for all studies was 0.2% to 29% (weighted average = 5%). For RCTs, 1%-29% (weighted average = 8.2%). For practice-based studies, 0.2-21% (weighted average = 5%). The university counseling subsample yielded a lower TE (2.4%) than in other groupings (i.e., primary care, mixed clinical settings, and specialist/focused settings). Therapist sample sizes remained lower than recommended, and few studies appeared to be designed specifically as TE studies, with too few examples of maximising the research potential of large routine patient datasets.

CONCLUSIONS

Therapist effects are a robust phenomenon although considerable heterogeneity exists across studies. Patient severity appeared related to TE size. TEs from RCTs were highly variable. Using an overall therapist effects statistic may lack precision, and TEs might be better reported separately for specific clinical settings.

Harnessing the Therapist Effect in Patient-Centered Mental Health Care Decision Making

In this commentary, we address the critical importance of the research literature documenting therapist differences in skill and outcomes. In particular, we focus on the implications of therapist differences for patient-centered decision making, including the matching of patients to specific psychotherapists who have empirically-based track records of positive performance. In addition, we present preliminary results from a grant supported study of patients' values and preferences regarding the use of provider performance track records in routine mental health care decision making.

Adverse Effects of Outcome Monitoring Feedback in Patients With Personality Disorders: A Randomized Controlled Trial in Day Treatment and Inpatient Settings

This study aimed to evaluate the differential effect of outcome monitoring feedback to therapists and to patients on outcomes in cluster B, cluster C, and personality disorder not otherwise specified (PD-NOS) patients. Day treatment patients (n = 112) and inpatients (n = 94) were randomly assigned to a feedback to therapist (FbT), feedback to therapist and patient (FbTP), or no feedback (NFb) condition. Feedback was based on weekly administrations of the Outcome Questionnaire-45 (OQ-45). In cluster B and PD-NOS patients FbTP resulted in increased OQ-45 scores during the first 6 months of therapy for not on track (NOT) patients. In cluster C patients, no adverse effects of feedback were found. These results suggest that for certain personality disorder patient groups, providing feedback during treatment may not always be beneficial, although more research is needed to further assess these effects.

Patients' experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature

Routine outcome monitoring (ROM) and clinical feedback (CF) systems have become important tools for psychological therapies, but there are challenges for their successful implementation.

OBJECTIVE

To overcome these challenges, a greater understanding is needed about how patients experience the use of ROM/CF.

METHOD

We conducted a systematic literature search of qualitative studies on patient experiences with the use of ROM/CF in mental health services.

RESULTS

The findings from 16 studies were synthesized, resulting in four meta-themes: (1) Suspicion towards service providers, (2) Flexibility and support to capture complexity, (3) Empowering patients, and (4) Developing collaborative practice.

CONCLUSIONS

We discuss the implications of these meta-themes for further development and implementation of ROM/CF into clinical practice, acknowledging the limitations of our review and suggesting avenues for further research. Clinical or methodological significance of this article: This article provides useful and actionable knowledge about the patient perspective on ROM/CF, an important discussion on the current state of research in this area, and useful and concrete suggestions for further avenues of research.

Leading Horses to Water: Lessons from a Decade of Helping Psychological Therapy Services Use Routine Outcome Measurement to Improve Practice

We summarise the recent reflections of five thought leaders in the field of routine outcome measurement (ROM) for psychological therapy, and then add our own experience of introducing a national ROM system in the UK. We highlight, in particular, the post-implementation challenge of securing data of sufficient reliability to help inform service quality improvements. We ground our conclusions and recommendations in the rapidly evolving discipline of implementation science, and offer a best practice model for applying research recommendations in practice settings. In this context we portray ROM implementation as significant organizational change that benefits from rigorous process and clearly defined, well-communicated targets.

Development of the clinically adaptive multidimensional outcome survey

OBJECTIVE

Routine outcome monitoring (ROM) has been strongly endorsed by psychotherapy researchers, but has yet to achieve widespread implementation in clinical settings. This article describes the development of the Clinically Adaptive Multidimensional Outcome Survey (CAMOS), an innovative ROM system that allows for local adaptation while providing high quality data.

METHOD

Three-hundred and four clients at a university counseling center and 211 female patients at an eating disorder treatment facility were administered the CAMOS at intake, and 118 took the CAMOS at both intake and discharge. Two models were developed and compared. Both models were developed using exploratory and confirmatory factor analysis.

RESULTS

A five-factor model was found to have the best model fit, internal consistency, convergent validity, and discriminant validity.

CONCLUSIONS

The CAMOS has evidence to support its reliability and validity as a measure of various dimensions of distress. Distinctive tailoring features of the CAMOS compared to other ROM measures are described.

A Randomized Clinical Trial Investigating the Effect of a Healthcare Access Model for Individuals with Severe Psychiatric Disabilities

We conducted a randomized trial to examine a model for integrating primary care into a community mental health setting. Two hundred individuals were recruited and randomly assigned to receive primary care delivered by a nurse practitioner (n = 94) or services-as-usual (n = 106), assessed on health and mental health outcomes, and followed for 12 months. Intent-to-Treat and exposure analyses were conducted and suggest that participants who engaged with the nurse practitioner experienced gains in perceptions of primary care quality. Health benefits accrued for individuals having receiving nurse practitioner services in a mental health setting to address primary care needs.

Distress tolerance predicts coping motives for marijuana use among treatment seeking young adults

Given increasing marijuana use and abuse among young adults in the United States and the associated physical and mental health consequences, it is important to improve our understanding of factors that may contribute to problematic marijuana use. A convergence of theory and research underscores the relevance of particular marijuana use motives generally, and coping-related motives specifically, in enhancing risk for marijuana use problems. Distress tolerance is a transdiagnostic emotion vulnerability factor that may relate to coping-related motives for marijuana use. The current study was designed to further explore this relationship within a treatment-seeking sample of young adults (Mage=24.40; SD=2.06 years). Results were consistent with hypotheses, suggesting distress tolerance is related to coping motives for marijuana use within this treatment-seeking sample, even after accounting for a number of theoretically relevant covariates. Theoretical and applied implications of distress tolerance as it relates to coping motives for marijuana use as treatment targets are discussed.

Real-Time Monitoring of Psychotherapeutic Processes: Concept and Compliance

Objective: The feasibility of a high-frequency real-time monitoring approach to psychotherapy is outlined and tested for patients' compliance to evaluate its integration to everyday practice. Criteria concern the ecological momentary assessment, the assessment of therapy-related cognitions and emotions, equidistant time sampling, real-time nonlinear time series analysis, continuous participative process control by client and therapist, and the application of idiographic (person-specific) surveys.

Methods: The process-outcome monitoring is technically realized by an internet-based device for data collection and data analysis, the Synergetic Navigation System. Its feasibility is documented by a compliance study on 151 clients treated in an inpatient and a day-treatment clinic.

Results: We found high compliance rates (mean: 78.3%, median: 89.4%) amongst the respondents, independent of the severity of symptoms or the degree of impairment. Compared to other diagnoses, the compliance rate was lower in the group diagnosed with personality disorders.

Conclusion: The results support the feasibility of high-frequency monitoring in routine psychotherapy settings. Daily collection of psychological surveys allows for the assessment of highly resolved, equidistant time series data which gives insight into the nonlinear qualities of therapeutic change processes (e.g., pattern transitions, critical instabilities).

Challenges in the Implementation of Measurement Feedback Systems

This commentary on the articles published in the special section on the development and implementation of measurement feedback systems (MFSs) discusses three challenging themes in the process of MFS implementation: design and planning, organizational context, and sustainability and unintended consequences. It is argued that the implementation of MFSs is complex, but is an important step in improving outcomes in routine care for children and young persons.

Clinicians' perspectives on negative effects of psychological treatments

Negative effects of psychological treatments is a fairly unexplored area of clinical research. Previous investigations have indicated that a portion of all patients experience negative effects in terms of deterioration and various adverse events. Meanwhile, evidence suggests that many clinicians are untrained in identifying negative effects and unaware of the current research findings. The objective of the current study is thus to investigate clinicians' own perspectives and experiences of possible negative effects of psychological treatments. An invitation to participate in an anonymous online survey consisting of 14 open-ended questions was distributed via three mailing lists used by clinicians that primarily identify themselves as cognitive behavior therapists. The responses were analyzed using a qualitative method based on thematic analysis. In total, 74 participants completed the survey. A majority agreed that negative effects of psychological treatments exist and pose a problem, and many reported having experienced both deterioration and adverse events among patients in their own practice. The thematic analysis resulted in three core themes: characteristics of negative effects, causal factors, as well as methods and criteria for evaluating negative effects. The clinicians recognize that negative effects exist, but many are unaware of the current research findings and are unfamiliar with methods and criteria for identifying and preventing deterioration and adverse events. The results provide evidence for further dissemination of the present knowledge regarding negative effects, particularly during basic clinical training, as well as the need for raising awareness of the available methods for identifying and preventing negative effects.

Yoga-enhanced cognitive behavioural therapy (Y-CBT) for anxiety management: a pilot study

Cognitive behavioural therapy (CBT) is an effective treatment for generalized anxiety disorder, but there is still room for improvement. The aim of the present study was to examine the potential benefit of enriching CBT with kundalini yoga (Y-CBT). Participants consisted of treatment resistant clients at a community mental health clinic. A total of 32 participants enrolled in the study and 22 completed the programme. After the Y-CBT intervention, pre-post comparisons showed statistically significant improvements in state and trait anxiety, depression, panic, sleep and quality of life. Results from this preliminary study suggest that Y-CBT may have potential as a promising treatment for those suffering from generalized anxiety disorder.

KEY PRACTITIONER MESSAGES

Yoga-enhanced cognitive behavioural therapy (Y-CBT) may be a promising new treatment for those suffering from generalized anxiety disorder. Y-CBT may also reduce depression in those suffering from generalized anxiety. Y-CBT may reduce depression and anxiety in a clinic population where clients suffer from multiple diagnoses including generalized anxiety disorder.

Examining changes in substance use and conduct problems among treatment-seeking adolescents

BACKGROUND

Outdoor behavioral healthcare (OBH) treatment offers an alternative to parents of youth who are treatment-resistant or avoidant.

METHOD

The current study evaluated OBH therapeutic outcomes. The sample was 190 adolescents (M_age  = 15.69) presenting for treatment between 2006 and 2008. To be eligible, participants had to be between the ages of 13 and 17 years and be admitted to one of the three OBH programs for mental health intervention. Primary study hypotheses were that OBH treatment would be associated with a reduction in psychiatric symptomatology from baseline to post-treatment and second, that the OBH intervention would be associated with the maintenance of the hypothesized treatment gains.

RESULTS AND CONCLUSIONS

Findings were consistent with hypotheses, suggesting that youth demonstrated significant symptomatic reductions and maintained these improvements over a 12-month follow-up period.

The contribution of children's temperamental fear and effortful control to restraint and seclusion during inpatient treatment in a psychiatric hospital

The current study examined temperament characteristics as risk factors for restraint and seclusion (R/S) events in psychiatrically hospitalized youth, extending work that has sought to identify R/S risk factors and research examining temperament-behavior problem associations that has largely relied upon community samples. It was anticipated that children with poor effortful control (EC) and greater frustration would have more instances of R/S during psychiatric hospitalization. The contribution of children's fearfulness to R/S was also examined. A measure of temperament was completed by youths' clinicians and youths (n = 52) completed objective measures of EC. The frequency of R/S events for each participant was obtained from hospital records. After controlling for R/S risk factors, lower EC and higher fearfulness predicted increased R/S occurrences during the first 2 weeks of hospitalization and over the course of children's entire hospitalization. These findings indicate that temperament should potentially be considered in individualized treatment plans targeting the prevention and/or reduction of R/S. Additional implications of the findings are also discussed.