What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals

A Content Analysis of Self-report Child Anxiety Measures

A clear understanding of the item content of psychological assessments is critical but often overlooked. This study describes the content overlap of seven commonly used and psychometrically validated measures of anxiety among children and adolescents. Symptom codes were created for all items across measures and items were sorted by these codes, which all fell into specific symptom categories. We conducted two analyses of all items: a "bottom-up" content categorization approach, which used symptom categories that were developed during this study, and a "top-down" DSM-5 categorization which mapped items onto symptoms of anxiety disorders in the DSM-5. Findings reveal a weak mean overlap across the included measures of youth anxiety. This suggests that the scope of anxiety measures should be carefully considered when designing studies, interpreting research, or assessing youth in clinical practice. Further research is needed to develop and establish a coding scheme for a more objective, comprehensive content analysis.

Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review

We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients' treatment response with standardized measures, is an evidence-based practice that continues to be under-utilized in routine care. The aim of the current review is to provide a summary of the current evidence base for the use of progress feedback, its mechanisms of action and considerations for successful implementation. We reviewed ten available meta-analyses, which report small to medium overall effect sizes. The results suggest that adding feedback to a wide range of psychological and psychiatric interventions (ranging from primary care to hospitalization and crisis care) tends to enhance the effectiveness of these interventions. The strongest evidence is for patients with common mental health problems compared to those with very severe disorders. Effect sizes for not-on-track cases, a subgroup of cases that are not progressing well, are found to be somewhat stronger, especially when clinical support tools are added to the feedback. Systematic reviews and recent studies suggest potential mechanisms of action for progress feedback include focusing the clinician's attention, altering clinician expectations, providing new information, and enhancing patient-centered communication. Promising approaches to strengthen progress feedback interventions include advanced systems with signaling technology, clinical problem-solving tools, and a broader spectrum of outcome and progress measures. An overview of methodological and implementation challenges is provided, as well as suggestions for addressing these issues in future studies. We conclude that while feedback has modest effects, it is a small and affordable intervention that can potentially improve outcomes in psychological interventions. Further research into mechanisms of action and effective implementation strategies is needed.

Canadian Network for Mood and Anxiety Treatments (CANMAT) 2023 Update on Clinical Guidelines for Management of Major Depressive Disorder in Adults: Réseau canadien pour les traitements de l'humeur et de l'anxiété (CANMAT) 2023 : Mise à jour des lignes directrices cliniques pour la prise en charge du trouble dépressif majeur chez les adultes

BACKGROUND

The Canadian Network for Mood and Anxiety Treatments (CANMAT) last published clinical guidelines for the management of major depressive disorder (MDD) in 2016. Owing to advances in the field, an update was needed to incorporate new evidence and provide new and revised recommendations for the assessment and management of MDD in adults.

METHODS

CANMAT convened a guidelines editorial group comprised of academic clinicians and patient partners. A systematic literature review was conducted, focusing on systematic reviews and meta-analyses published since the 2016 guidelines. Recommendations were organized by lines of treatment, which were informed by CANMAT-defined levels of evidence and supplemented by clinical support (consisting of expert consensus on safety, tolerability, and feasibility). Drafts were revised based on review by patient partners, expert peer review, and a defined expert consensus process.

RESULTS

The updated guidelines comprise eight primary topics, in a question-and-answer format, that map a patient care journey from assessment to selection of evidence-based treatments, prevention of recurrence, and strategies for inadequate response. The guidelines adopt a personalized care approach that emphasizes shared decision-making that reflects the values, preferences, and treatment history of the patient with MDD. Tables provide new and updated recommendations for psychological, pharmacological, lifestyle, complementary and alternative medicine, digital health, and neuromodulation treatments. Caveats and limitations of the evidence are highlighted.

CONCLUSIONS

The CANMAT 2023 updated guidelines provide evidence-informed recommendations for the management of MDD, in a clinician-friendly format. These updated guidelines emphasize a collaborative, personalized, and systematic management approach that will help optimize outcomes for adults with MDD.

Implementation Science and Practice-Oriented Research: Convergence and Complementarity

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

Data-Informed Communication: How Measurement-Based Care Can Optimize Child Psychotherapy

Measurement-based care (MBC) research and practice, including clinical workflows and systems to support MBC, are grounded in adult-serving mental health systems. MBC research evidence is building in child and adolescent services, but MBC practice is inherently more complex due to identified client age, the family system and the need to involve multiple reporters. This paper seeks to address a gap in the literature by providing practical guidance for youth-serving clinicians implementing MBC with children and their families. We focus on MBC as a data-informed, client-centered communication process, and present three key strategies to enhance usual care child and adolescent psychotherapy via developmentally-appropriate MBC. These strategies include (1) go beyond standardized measures; (2) lean into discrepancies; and (3) get curious together. Case-based examples drawn from various child-serving settings illustrate these key strategies of MBC in child psychotherapy.

Implementing Measurement-Based Care in a Youth Partial Hospital Setting: Leveraging Feedback for Sustainability

This paper describes the successful implementation of Measurement-Based Care (MBC) within a Partial Hospitalization Program (PHP) for children and adolescents. Measurement-based care (MBC), the practice of using patient-reported measures routinely to inform decision-making, is associated with improved clinical outcomes for behavioral health patients (Jong et al., Clinical Psychology Review 85, 2021; Fortney & Sladek, 2015). MBC holds great promise in partial hospital programs (PHP) to improve outcomes, yet implementation strategies are as complex as the setting itself. This paper provides a case study example of MBC implementation in a PHP for youth. Over the course of 18 months, an interdisciplinary staff of approximately 20 behavioral health professionals provided partial hospitalization level of care to 633 (39% in-person, 61% telehealth) youth from ages 5 to 18 years old. MBC in this setting incorporated daily patient self-report and weekly caregiver-reported measurements. This descriptive reconstruction, which includes examples of the data that were used during the implementation project, illustrates specific barriers and facilitators in a successful implementation in the local PHP setting. Implementation strategies to address workflow integration, leadership and supervision, and coaching are described, including evolution of these strategies over the course of implementation. Practical considerations for implementing MBC in youth PHP settings are discussed. Finally, the authors explore the potential relationships between the data-driven MBC model of decision making and the development of resilient organizations.

A Pilot Project to Integrate Individualized Measurement Into Measurement-Based Care in a Child Partial Hospitalization Program

Measurement-based care (MBC), or the regular use of progress measures to inform clinical decision-making, improves quality of care and clinical outcomes. MBC typically focuses on standardized rather than individualized outcome measurement. In this pilot study, we examined the clinical utility of integrating individualized measurement with existing standardized outcome monitoring in a children's partial hospitalization program. Participants were 48 youth (M age 10.13 ± 1.39; 54.2% male, 41.7% female, 4.2% transgender or nonbinary). Comorbidity was common; 83.4% of youth had more than one diagnosis at intake. Using the Youth Top Problems for individualized outcome measurement, we examined Top Problem content and clinical improvement over time. Finally, we examined completion rates and describe implementation issues. Top Problems were heterogeneous and sensitive to change. Of the 144 problems, 107 (74%) had a focus consistent with measures used in program, while 37 (26%) were not captured by standardized measures used in program. Effect sizes from admission to final measurement ranged from Cohen's d = .75 - 1.00. Initial adoption of the MBC was strong, but sustained use of the system over the treatment course was challenging. Individualized outcome measurement in children's partial hospitalization programs is feasible to administer and sensitive to clinical change that is unique from change captured in standardized measures. Parents were able to self-identify clinically meaningful, highly individualized Top Problems. Challenges of implementation and clinical assessment in acute settings and potential strategies for improving implementation are discussed.

Perceptions of mental health providers of the barriers and facilitators of using and engaging youth in digital mental-health-enabled measurement based care

Objectives

Increased rates of mental health disorders and substance use among youth and young adults have increased globally, furthering the strain on an already burdened mental health system. Digital solutions have been proposed as a potential option for the provision of timely mental health services for youth, with little research exploring mental health professional views about using such innovative tools. In Alberta, Canada, we are evaluating the implementation and integration of a digital mental health (dMH) platform into existing service pathways. Within this paper we seek to explore mental health professionals' perceptions of the barriers and facilitators that may influence their utilization of digital MH-enabled measurement-based care (MBC) with the youth who access their services.

Methods

A qualitative, descriptive methodology was used to inductively generate themes from focus groups conducted with mental health professionals from specialized mental health services and primary care networks in Alberta.

Results

As mental health professionals considered the barriers and facilitators of using dMH with youth, they referenced individual and family barriers and facilitators to consider. Providers highlighted perceived barriers, including: first, cultural stigma, family apprehension about mental health care, and parental access to dMH and MBC as deterrents to providers adopting digital platforms in routine care; second, perceptions of increased responsibility and liability for youth in crisis; third, perception that some psychiatric and neurodevelopmental disorders in youth are not amenable to dMH; fourth, professionals contemplated youth readiness to engage with dMH-enabled MBC. Participants also highlighted pertinent facilitators to dMH use, noting: first, the suitability of dMH for youth with mild mental health concerns; second, youth motivated to report their changes in mental health symptoms; and lastly, youth proficiency and preference for dMH options.

Conclusions

By identifying professionals' perceptions of barriers and facilitators for youth users, we may better understand how to address misconceptions about who is eligible and appropriate for dMH through training and education.

A Clinical Leadership Lens on Implementing Progress Feedback in Three Countries: Development of a Multidimensional Qualitative Coding Scheme

BACKGROUND

Progress feedback, also known as measurement-based care (MBC), is the routine collection of patient-reported measures to monitor treatment progress and inform clinical decision-making. Although a key ingredient to improving mental health care, sustained use of progress feedback is poor. Integration into everyday workflow is challenging, impacted by a complex interrelated set of factors across patient, clinician, organizational, and health system levels. This study describes the development of a qualitative coding scheme for progress feedback implementation that accounts for the dynamic nature of barriers and facilitators across multiple levels of use in mental health settings. Such a coding scheme may help promote a common language for researchers and implementers to better identify barriers that need to be addressed, as well as facilitators that could be supported in different settings and contexts.

METHODS

Clinical staff, managers, and leaders from two Dutch, three Norwegian, and four mental health organizations in the USA participated in semi-structured interviews on how intra- and extra-organizational characteristics interact to influence the use of progress feedback in clinical practice, supervision, and program improvement. Interviews were conducted in the local language, then translated to English prior to qualitative coding.

RESULTS

A team-based consensus coding approach was used to refine an a priori expert-informed and literature-based qualitative scheme to incorporate new understandings and constructs as they emerged. First, this hermeneutic approach resulted in a multi-level coding scheme with nine superordinate categories and 30 subcategories. Second-order axial coding established contextually sensitive categories for barriers and facilitators.

CONCLUSIONS

The primary outcome is an empirically derived multi-level qualitative coding scheme that can be used in progress feedback implementation research and development. It can be applied across contexts and settings, with expectations for ongoing refinement. Suggestions for future research and application in practice settings are provided. Supplementary materials include the coding scheme and a detailed playbook.

Transforming global approaches to chronic disease prevention and management across the lifespan: integrating genomics, behavior change, and digital health solutions

Chronic illnesses are a major threat to global population health through the lifespan into older age. Despite world-wide public health goals, there has been a steady increase in chronic and non-communicable diseases (e.g., cancer, cardiovascular and metabolic disorders) and strong growth in mental health disorders. In 2010, 67% of deaths worldwide were due to chronic diseases and this increased to 74% in 2019, with accelerated growth in the COVID-19 era and its aftermath. Aging and wellbeing across the lifespan are positively impacted by the presence of effective prevention and management of chronic illness that can enhance population health. This paper provides a short overview of the journey to this current situation followed by discussion of how we may better address what the World Health Organization has termed the "tsunami of chronic diseases." In this paper we advocate for the development, validation, and subsequent deployment of integrated: 1. Polygenic and multifactorial risk prediction tools to screen for those at future risk of chronic disease and those with undiagnosed chronic disease. 2. Advanced preventive, behavior change and chronic disease management to maximize population health and wellbeing. 3. Digital health systems to support greater efficiencies in population-scale health prevention and intervention programs. It is argued that each of these actions individually has an emerging evidence base. However, there has been limited research to date concerning the combined population-level health effects of their integration. We outline the conceptual framework within which we are planning and currently conducting studies to investigate the effects of their integration.

Improving measurement-based care implementation in adult ambulatory psychiatry: a virtual focus group interview with multidisciplinary healthcare professionals

BACKGROUND

Measurement-Based Care (MBC) is an evidence-based practice shown to enhance patient care. Despite being efficacious, MBC is not commonly used in practice. While barriers and facilitators of MBC implementation have been described in the literature, the type of clinicians and populations studied vary widely, even within the same practice setting. The current study aims to improve MBC implementation in adult ambulatory psychiatry by conducting focus group interviews while utilizing a novel virtual brainwriting premortem method.

METHODS

Semi-structured focus group interviews were conducted with clinicians (n = 18) and staff (n = 7) to identify their current attitudes, facilitators, and barriers of MBC implementation in their healthcare setting. Virtual video-conferencing software was used to conduct focus groups, and based on transcribed verbatin, emergent barriers/facilitators and four themes were identified. Mixed methods approach was utilized for this study. Specifically, qualitative data was aggregated and re-coded separately by three doctoral-level coders. Quantitative analyses were conducted from a follow-up questionnaire surveying clinician attitudes and satisfaction with MBC.

RESULTS

The clinician and staff focus groups resulted in 291 and 91 unique codes, respectively. While clinicians identified a similar number of barriers (40.9%) and facilitators (44.3%), staff identified more barriers (67%) than facilitators (24.7%) for MBC. Four themes emerged from the analysis; (1) a description of current status/neutral opinion on MBC; (2) positive themes that include benefits of MBC, facilitators, enablers, or reasons on why they conduct MBC in their practice, (3) negative themes that include barriers or issues that hinder them from incorporating MBC into their practice, and (4) requests and suggestions for future MBC implementation. Both participant groups raised more negative themes highlighting critical challenges to MBC implementation than positive themes. The follow-up questionnaire regarding MBC attitudes showed the areas that clinicians emphasized the most and the least in their clinical practice.

CONCLUSION

The virtual brainwriting premortem focus groups provided critical information on the shortcomings and strengths of MBC in adult ambulatory psychiatry. Our findings underscore implementation challenges in healthcare settings and provide insight for both research and clinical practice in mental health fields. The barriers and facilitators identified in this study can inform future training to increase sustainability and better integrate MBC with positive downstream outcomes in patient care.

The results of clinician-focused implementation strategies on uptake and outcomes of Measurement-Based Care (MBC) in general mental health care

BACKGROUND

Measurement-Based Care (MBC) is the routine administration of measures, clinicians' review of the feedback and discussion of the feedback with their clients, and collaborative evaluation of the treatment plan. Although MBC is a promising way to improve outcomes in clinical practice, the implementation of MBC faces many barriers, and its uptake by clinicians is low. The purpose of this study was to investigate whether implementation strategies that were developed with clinicians and aimed at clinicians had an effect on (a) clinicians' uptake of MBC and (b) clients' outcomes of MBC.

METHODS

We used an effectiveness-implementation hybrid design based on Grol and Wensing's implementation framework to assess the impact of clinician-focused implementation strategies on both clinicians' uptake of MBC and outcomes obtained with MBC for clients in general mental health care. We hereby focused on the first and second parts of MBC, i.e., the administration of measures and use of feedback. Primary outcome measures were questionnaire completion rate and discussion of the feedback with clients. Secondary outcomes were treatment outcome, treatment length, and satisfaction with treatment.

RESULTS

There was a significant effect of the MBC implementation strategies on questionnaire completion rate (one part of clinicians' uptake), but no significant effect on the amount of discussion of the feedback (the other part of clinicians' uptake). Neither was there a significant effect on clients' outcomes (treatment outcome, treatment length, and satisfaction with treatment). Due to various study limitations, the results should be viewed as exploratory.

CONCLUSIONS

Establishing and sustaining MBC in real-world general mental health care is complex. This study helps to disentangle the effects of MBC implementation strategies on differential clinician uptake, but the effects of MBC implementation strategies on client outcomes need further examination.

Do Degrees Matter? Rethinking Workforce Development for Youth with Intellectual Disabilities and Mental Health Challenges

The global workforce crisis significantly impacts how evidence-based treatment is provided to youth with developmental disabilities and co-occurring mental health conditions. Addressing the workforce crisis requires re-examining the long-standing methods of selecting individuals for employment based on academic degrees. This project offers an innovative workforce development option that provides specialized training to staff with advanced education degrees and staff with less education. The participants in this study were employed in a rural area of the USA within the mental health, child welfare, and correctional industries. All participants worked with youth experiencing intellectual disabilities and mental illness. Results indicated that participants improved their knowledge of the population, demonstrated a better understanding of EBPs, and were willing to employ evidence-based approaches regardless of their education or age. Although overall attitudes toward EBPs decreased, diverging attitudes increased, suggesting a need to accommodate treatment strategies when EBP models are unavailable for special populations. Initial knowledge gaps demonstrated by those with a master's degree and those with less education disappeared after the training. This finding supports the application of innovative task-shifting options in mental health, such as diverting more sophisticated care tasks to nonprofessionally trained persons, which can reduce workforce pressure and unmet demand for care. This study demonstrates cost-effective and time-efficient methods of training staff regardless of education by relying less on specific EBP models and more on adaptation.

A Survey of Behavioral Health Care Providers on Use and Barriers to Use of Measurement-Based Care

OBJECTIVE

Despite robust evidence for efficacy of measurement-based care (MBC) in behavioral health care, studies suggest that adoption of MBC is limited in practice. A survey from Blue Cross-Blue Shield of North Carolina was sent to behavioral health care providers (BHCPs) about their use of MBC, beliefs about MBC, and perceived barriers to its adoption.

METHODS

The authors distributed the survey by using professional networks and snowball sampling. Provider and clinical practice characteristics were collected. Numerical indices of barriers to MBC use were created. Ordered logistic regression models were used to identify associations among practice and provider characteristics, barriers to MBC use, and level of MBC use.

RESULTS

Of the 922 eligible BHCPs who completed the survey, 426 (46%) reported using MBC with at least half of their patients. Providers were more likely to report MBC use if they were part of a large group practice, had MBC training, had more weekly care hours, or practiced in nonmetropolitan settings. Physicians, self-reported generalists, more experienced providers, and those who did not accept insurance were less likely to report MBC use. Low perceived clinical utility was the barrier most strongly associated with less frequent use of MBC.

CONCLUSIONS

Although evidence exists for efficacy of MBC in behavioral health care, less than half of BHCPs reported using MBC with at least half of their patients, and low perceived clinical utility of MBC was strongly associated with lower MBC use. Implementation strategies that attempt to change negative attitudes toward MBC may effectively target this barrier to use.

A Meta-Analysis on Differences and Associations between Alliance Ratings in Child and Adolescent Psychotherapy

OBJECTIVE

The alliance in child and adolescent psychotherapy is widely recognized as an important factor in therapy. Studies on the alliance have increasingly focused on assessment of the alliance as a dyadic construct, measuring both client and therapist alliance ratings. However, cross-informant reports of the alliance in child psychotherapy have not yet been subjected to meta-analysis. Therefore, the present meta-analysis aims to increase knowledge on the degree of convergence and divergence between child, parent, therapist, and observer alliance ratings in child and adolescent psychotherapy.

METHODS

A series of three-level meta-analyses of 78 studies was conducted to investigate differences and associations between child, parent, therapist, and observer alliance ratings in child and adolescent psychotherapy.

RESULTS

Findings indicated that children and parents in general rated the alliance more positively than their therapists (d = 0.35, d = 0.72, respectively), and that child-therapist and parent-therapist alliance ratings were moderately correlated (r = .32, r = .23, respectively). Associations between child and therapist ratings and observer ratings were moderate to large (r = .43, r = .53, respectively).

CONCLUSIONS

It can be concluded that children and parents generally report more positively on the alliance compared to their therapists, which is consistent with research on the alliance in adult populations. The small to moderate associations between alliance ratings indicate that individuals to some extent have a shared perspective on their alliance, and that the various perspectives on alliance should be acknowledged when dealing with children and parents in therapy. Implications for future research are discussed.

The Implementation of Measurement-Based Care in the Context of Telemedicine: Qualitative Study

BACKGROUND

The Measurement Based Care in Mental Health Initiative launched by the Department of Veterans Affairs in 2016 is an example of an evidence-based practice that uses patient-reported outcome measures (PROMs) to improve patient outcomes. The acceptance of measurement-based care (MBC) among Veterans Affairs providers is relatively high. However, there are barriers to MBC for telehealth providers. Health information technologies might afford opportunities to address some of the barriers related to the uptake of MBC.

OBJECTIVE

This paper reports on an implementation effort to integrate MBC into mental health care telehealth practice using eHealth solutions.

METHODS

Qualitative data were generated from 22 semistructured interviews with psychiatrists (n=4), psychologists (n=3), social workers (n=3), nurses (n=6), a pharmacist (n=1), and administrative staff (n=5) who provide telemental health care through a community-based outpatient clinic in the rural Midwestern United States. The interviews were conducted during the pilot phase of an implementation initiative to increase the adoption of MBC by revising clinic workflows to integrate the use of eHealth technologies. Data were analyzed using thematic analysis.

RESULTS

Time burden and workflow issues were the most common barrier to provider adoption of MBC; sharing and reviewing pencil-and-paper measures and results in the same room was no longer possible in novel telehealth workflows necessitated by the COVID-19 pandemic. Providers voiced concerns about how long it would take to collect, adequately score, interpret, share, and document the PROMs during the telehealth visit. Concerns about time might also correspond to a gap in providers' familiarity with these assessments, greater comfort in assessing symptoms through clinical interviews, and being accustomed to using the assessments as screening tools more so than longitudinal outcome measures. Capacities associated with eHealth technologies may address workflow concerns and promote providers' understanding and use of the measures as tracking tools.

CONCLUSIONS

The need to use limited appointment time well was a top priority for telemental health providers. eHealth technologies provided operative supports that protect time in appointments by shifting when and how PROMs are collected. Bolstering providers' familiarity with how to use PROMs in the course of treatment may impact providers' buy-in by encouraging them to reconsider how sharing and acting on PROMs could be time well spent.

Measurement feedback system implementation in public youth mental health treatment services: a mixed methods analysis

BACKGROUND

Prior studies indicate the effectiveness of measurement-based care (MBC), an evidence-based practice, in improving and accelerating positive outcomes for youth receiving behavioral health services. MBC is the routine collection and use of client-reported progress measures to inform shared decision-making and collaborative treatment adjustments and is a relatively feasible and scalable clinical practice, particularly well-suited for under-resourced community mental health settings. However, uptake of MBC remains low, so information on determinants related to MBC practice patterns is needed.

METHODS

Quantitative and qualitative data from N = 80 clinicians who implemented MBC using a measurement feedback system (MFS) were merged to understand and describe determinants of practice over three study phases. Quantitative, latent class analysis identified clinician groups based on participants' ratings of MFS acceptability, appropriateness, and feasibility and describes similarities/differences between classes in clinician-level characteristics (e.g., age; perceptions of implementation climate; reported MFS use; phase I). Qualitative analyses of clinicians' responses to open-ended questions about their MFS use and feedback about the MFS and implementation supports were conducted separately to understand multi-level barriers and facilitators to MFS implementation (phase II). Mixing occurred during interpretation, examining clinician experiences and opinions across groups to understand the needs of different classes of clinicians, describe class differences, and inform selection of implementation strategies in future research (phase III).

RESULTS

We identified two classes of clinicians: "Higher MFS" and "Lower MFS," and found similarities and differences in MFS use across groups. Compared to Lower MFS participants, clinicians in the Higher MFS group reported facilitators at a higher rate. Four determinants of practice were associated with the uptake of MBC and MFS in youth-serving community mental health settings for all clinicians: clarity, appropriateness, and feasibility of the MFS and its measures; clinician knowledge and skills; client preferences and behaviors; and incentives and resources (e.g., time; continuing educational support). Findings also highlighted the need for individual-level implementation strategies to target clinician needs, skills, and perceptions for future MBC and MFS implementation efforts.

CONCLUSION

This study has implications for the adoption of evidence-based practices, such as MBC, in the context of community-based mental health services for youth.

Organization-level variation in therapists' attitudes toward and use of measurement-based care

PURPOSE

Despite significant interest in improving behavioral health therapists' implementation of measurement-based care (MBC)-and widespread acknowledgment of the potential importance of organization-level determinants-little is known about the extent to which therapists' use of, and attitudes toward, MBC vary across and within provider organizations or the multilevel factors that predict this variation.

METHODS

Data were collected from 177 therapists delivering psychotherapy to youth in 21 specialty outpatient clinics in the USA. Primary outcomes were use of MBC for progress monitoring and treatment modification, measured by the nationally-normed Current Assessment of Practice Evaluation-Revised. Secondary outcomes were therapist attitudes towards MBC. Linear multilevel regression models tested the association of theory-informed clinic and therapist characteristics with these outcomes.

RESULTS

Use of MBC varied significantly across clinics, with means on progress monitoring ranging from values at the 25th to 93rd percentiles and means on treatment modification ranging from the 18th to 71st percentiles. At the clinic level, the most robust predictor of both outcomes was clinic climate for evidence-based practice implementation; at the therapist level, the most robust predictors were: attitudes regarding practicality, exposure to MBC in graduate training, and prior experience with MBC. Attitudes were most consistently related to clinic climate for evidence-based practice implementation, exposure to MBC in graduate training, and prior experience with MBC.

CONCLUSIONS

There is important variation in therapists' attitudes toward and use of MBC across clinics. Implementation strategies that target clinic climate for evidence-based practice implementation, graduate training, and practicality may enhance MBC implementation in behavioral health.

Standardized Versus Tailored Implementation of Measurement-Based Care for Depression in Community Mental Health Clinics

Objective

Measurement-based care (MBC) is an evidence-based practice that is rarely integrated into psychotherapy. The authors sought to determine whether tailored MBC implementation can improve clinician fidelity and depression outcomes compared with standardized implementation.

Methods

This cluster-randomized trial enrolled 12 community behavioral health clinics to receive 5 months of implementation support. Clinics randomized to the standardized implementation received electronic health record data captured with the nine-item Patient Health Questionnaire (PHQ-9), a needs assessment, clinical training, guidelines, and group consultation in MBC fidelity. Tailored implementation support included these strategies, but the training content was tailored to clinics’ barriers to MBC, and group consultation centered on overcoming these barriers. Clinicians (N=83, tailored; N=71, standardized) delivering individual psychotherapy to 4,025 adults participated. Adult patients (N=87, tailored; N=141, standardized) contributed data for depression outcome analyses.

Results

The odds of PHQ-9 completion were lower in the tailored group at baseline (odds ratio [OR]=0.28, 95% CI=0.08–0.96) but greater at 5 months (OR=3.39, 95% CI=1.00–11.48). The two implementation groups did not differ in full MBC fidelity. PHQ-9 scores decreased significantly from baseline (mean±SD=17.6±4.4) to 12 weeks (mean=12.6±5.9) (p<0.001), but neither implementation group nor MBC fidelity significantly predicted PHQ-9 scores at week 12.

Conclusions

Tailored MBC implementation outperformed standardized implementation with respect to PHQ-9 completion, but discussion of PHQ-9 scores in clinician-patient sessions remained suboptimal. MBC fidelity did not predict week-12 depression severity. MBC can critically inform collaborative adjustments to session or treatment plans, but more strategic system-level implementation support or longer implementation periods may be needed.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

To Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth

Mental health organizations that serve youth are under pressure to adopt measurement-based care (MBC), defined as the continuous collection of client-report data used to support clinical decision-making as part of standard care. However, few frameworks exist to help leadership ascertain how to select an MBC approach for a clinical setting. This paper seeks to define how an MBC approach can display clinical utility to provide such a framework. Broadly, we define clinical utility as evidence that an MBC approach assists stakeholders in fulfilling clinical goals related to care quality (i.e., improve client-clinician alliance and clinical outcomes) at the client (i.e., youth and caregiver), clinician, supervisor, and administrator levels. More specifically, our definition of clinical utility is divided into two categories relevant to the usability and usefulness of an MBC approach for a specific setting: (a) implementability (i.e., evidence indicating ease of use in a clinical setting) and (b) usefulness in aiding clinical activities (i.e., evidence indicating the potential to improve communication and make clinical activities related to care quality easier or more effective). These categories provide valuable information about how easy an MBC approach is to use and the potential benefits that the MBC data will confer. To detail how we arrived at this definition, we review prior definitions of clinical utility, discuss how previous definitions inform our definition of clinical utility for MBC, and provide examples of how the concept of clinical utility can be applied to MBC. We finish with a discussion of future research directions.

A modified measurement-based care approach to improve mental health treatment engagement among racial and ethnic minoritized youth

Despite high levels of need, racial and ethnic minoritized (REM) youth are much less likely than their White peers to engage in mental health treatment. Concerns about treatment relevance and acceptability and poor therapeutic alliance have been shown to impact treatment engagement, particularly retention, among REM youth and families. Measurement-based care (MBC) is a client-centered practice of collecting and using client-reported progress data throughout treatment to inform shared decision-making. MBC has been associated with increased client involvement in treatment, improved client-provider communication, and increased satisfaction with treatment services. Despite its promise as a treatment engagement strategy, MBC has not been studied in this capacity with REM youth or systematically modified to address the needs of culturally-diverse populations. In this article, we propose a culturally-modified version of MBC, Strategic Treatment Assessment with Youth (STAY), to improve treatment engagement among REM youth and families. Specifically, STAY is designed to target perceptual barriers to treatment to improve treatment retention and ultimately, client outcomes. The four STAY components (i.e., Introduce, Collect, Share, and Act) are based on an existing MBC practice framework and modified to address perceptual barriers to treatment among REM youth. The clinical application of this model is presented via a case example. Finally, future research directions to explore the use of MBC as a treatment retention strategy with REM client populations are provided. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Pragmatic AI-augmentation in mental healthcare: Key technologies, potential benefits, and real-world challenges and solutions for frontline clinicians

The integration of artificial intelligence (AI) technologies into mental health holds the promise of increasing patient access, engagement, and quality of care, and of improving clinician quality of work life. However, to date, studies of AI technologies in mental health have focused primarily on challenges that policymakers, clinical leaders, and data and computer scientists face, rather than on challenges that frontline mental health clinicians are likely to face as they attempt to integrate AI-based technologies into their everyday clinical practice. In this Perspective, we describe a framework for "pragmatic AI-augmentation" that addresses these issues by describing three categories of emerging AI-based mental health technologies which frontline clinicians can leverage in their clinical practice-automation, engagement, and clinical decision support technologies. We elaborate the potential benefits offered by these technologies, the likely day-to-day challenges they may raise for mental health clinicians, and some solutions that clinical leaders and technology developers can use to address these challenges, based on emerging experience with the integration of AI technologies into clinician daily practice in other healthcare disciplines.

Festschrift for Leonard Bickman: Introduction to The Future of Children's Mental Health Services Special Issue

This introductory article describes the genesis of the Festschrift for Leonard Bickman and of this Festschrift special issue entitled, The Future of Children’s Mental Health Services. The special issue includes a collection of 11 original children’s mental health services research articles, broadly organized in accordance with three themes (i.e., Improving Precision and Use of Service Data to Guide Policy and Practice, Implementation and Dissemination, and Preparing for Innovation), followed by an interview-style article with Bickman. Then follows a featured manuscript by Bickman himself, three invited commentaries, and a compilation of letters and notes in which colleagues reflect on his career and on their experiences of him. The introduction concludes with a few thoughts about the future of children’s mental health services portended by the extraordinary scholarly contributions of Bickman and those who have been inspired by him.

Applying behaviour change theory to understand the barriers to implementing routine outcome monitoring

BACKGROUND

Routine outcome monitoring (ROM) is a valuable tool for monitoring client progress and pre-empting deterioration, however, there is considerable variation in how data are collected and recorded and uptake in clinical practice remains low. The aim of this study was to develop a self-report measure of practitioner attitudes to ROM in order to better understand the barriers to successful implementation in Child and Adolescent Mental Health Services (CAMHS).

METHODS

An anonymous survey was completed by 184 CAMHS practitioners in the United Kingdom. The survey was designed using the Capability, Opportunity, and Motivation Model of Behaviour (COM-B). Practitioners who reported using ROM frequently in their clinical work (53%) were compared to those who used ROM infrequently (47%) across dimensions of the COM-B survey subscales.

RESULTS

Confirmatory factor analysis confirmed the proposed four-factor structure, showing acceptable model fit, with high factor loadings and good reliability for all subscales. Frequent users of ROM exhibited significantly higher psychological capability, physical opportunity, social opportunity, and motivation, compared to infrequent users F (4, 140) = 14.76, p < .0001; Pillai's Trace = .297, partial η²  = .30. Results highlight several barriers to ROM, including the belief that there is not a strong evidence base for ROM, not receiving external training, and not discussing feedback and outcome data in supervision.

IMPLICATIONS

In the hope of improving the successful implementation of ROM, this research provides an evidence-based tool for assessing practitioners' attitudes to ROM, which map on to intervention functions and represent targets for future implementation efforts.

PRACTITIONER POINTS

The value of routine outcome monitoring (ROM) as a means to measure client progress and to elevate the efficiency and quality of mental health care is well-documented in the research literature, however, uptake in practice remains relatively low. This study applied behaviour change theory to develop a psychometrically sound self-report measure of practitioners' perspectives and practices to understand the barriers to implementation in child and adolescent mental health services in the United Kingdom. The complex and multifaceted nature of the barriers to implementation requires multilevel behaviour change strategies at the client, clinician, and organisational level. Recommendations for practice include the need for integrated, multilevel strategies aimed at improving practitioners' capabilities and motivations, strong organisational leadership and a culture of data gathering and sharing, and implementation interventions, which are tailored to target local barriers.

Using a Patient Safety/Quality Improvement Model to Assess Telehealth for Psychiatry and Behavioral Health Services Among Special Populations During COVID-19 and Beyond

Telehealth has been rapidly deployed in the environment of the Coronavirus 2019 (COVID-19) pandemic to help meet critical mental health needs. As systems of care use telehealth during the pandemic and evaluate the future of telehealth services beyond the crisis, a quality and safety framework may be useful in weighing important considerations for using telehealth to provide psychiatric and behavioral health services within special populations. Examining access to care, privacy, diversity, inclusivity, and sustainability of telehealth to meet behavioral and psychiatric care needs in geriatric and disadvantaged youth populations can help highlight key considerations for health care organizations in an increasingly electronic health care landscape.

Exploration, Preparation, and Implementation of Standardized Assessment in a Multi-agency School Behavioral Health Network

School mental health treatment services offer broad public health impact and could benefit from more widespread implementation and sustainment of standardized assessments (SA). This demonstration study describes one approach to increase SA use in a large school behavioral health network using the Exploration, Preparation, Implementation and Sustainment (EPIS) framework. Mental health administrator interviews with four participating agencies and a multidisciplinary planning team informed SA measure selection and implementation supports. The SA initiative was implemented during one school year, including system-wide training and ongoing implementation supports for 95 clinicians. Linear mixed effect models revealed improvements in clinician attitudes about the SA for clinical utility and treatment planning immediately following the half-day training (N = 95, p < .001). Clinicians self-reported a significant increase in use of SA for new clients during intakes (p < .001) over time and 71.4% of expected SA data were submitted. Qualitative feedback, including recommendations to offer more SA choices and beginning new SA data collection earlier in the school year, was integrated to inform quality improvements and future sustainment efforts.

Implementing Measurement-Based Care for Depression: Practical Solutions for Psychiatrists and Primary Care Physicians

Measurement-based care (MBC) can be defined as the clinical practice in which care providers collect patient data through validated outcome scales and use the results to guide their decision-making processes. Despite growing evidence supporting the effectiveness of MBC for depression and other mental health conditions, many physicians and mental health clinicians have yet to adopt MBC practice. In part, this is due to individual and organizational barriers to implementing MBC in busy clinical settings. In this paper, we briefly review the evidence for the efficacy of MBC focusing on pharmacological management of depression and provide example clinical scenarios to illustrate its potential clinical utility in psychiatric settings. We discuss the barriers and challenges for MBC adoption and then address these by suggesting simple solutions to implement MBC for depression care, including recommended outcome scales, monitoring tools, and technology solutions such as cloud-based MBC services and mobile health apps for mood tracking. The availability of MBC tools, ranging from paper-pencil questionnaires to mobile health technology, can allow psychiatrists and clinicians in all types of practice settings to easily incorporate MBC into their practices and improve outcomes for their patients with depression.