Research, Data, and Evidence-Based Treatment Use in State Behavioral Health Systems, 2001-2012

Individual placement and support (IPS): duration of employment support and equity of access and outcome in routine clinical practice

AIMS AND METHOD

To explore the duration of support, reach, effectiveness and equity in access to and outcome of individual placement and support (IPS) in routine clinical practice. A retrospective analysis of routine cross-sectional administrative data was performed for people using the IPS service (N = 539).

RESULTS

A total of 46.2% gained or retained employment, or were supported in education. The median time to gaining employment was 132 days (4.3 months). Further, 84.7% did not require time-unlimited in-work support, and received in-work support for a median of 146 days (4.8 months). There was a significant overrepresentation of people from Black and minority ethnic communities accessing IPS, but no significant differences in outcomes by diagnosis, ethnicity, age or gender.

CLINICAL IMPLICATIONS

Most people using IPS services do not appear to need time-unlimited in-work support. Community teams with integrated IPS employment specialists can be optimistic when addressing people's recovery goals of gaining and retaining employment.

An examination of mental health policy implementation efforts and the intermediaries that support them in New Zealand, Canada and Sweden: a comparative case study

Introduction

The implementation of evidence-informed policies and practices across systems is a complex, multifaceted endeavor, often requiring the mobilization of multiple organizations from a range of contexts. In order to facilitate this process, policy makers, innovation developers and service deliverers are increasingly calling upon intermediaries to support implementation, yet relatively little is known about precisely how they contribute to implementation. This study examines the role of intermediaries supporting the implementation of evidence-informed policies and practices in the mental health and addictions systems of New Zealand, Ontario, Canada and Sweden.

Methods

Using a comparative case study methodology and taking an integrated knowledge translation approach, we drew from established explanatory frameworks and implementation theory to address three questions: (1) Why were the intermediaries established? (2) How are intermediaries structured and what strategies do they use in systems to support the implementation of policy directions? and (3) What explains the lack of use of particular strategies? Data collection included three site visits, 49 key informant interviews and document analysis.

Results

In each jurisdiction, a unique set of problems (e.g., negative events involving people with mental illness), policies (e.g., feedback on effectiveness of existing policies) and political events (e.g., changes in government) were coupled by a policy entrepreneur to bring intermediaries onto the decision agenda. While intermediaries varied greatly in their structure and characteristics, both the strategies they used and the strategies they didn't use were surprisingly similar. Specifically it was notable that none of the intermediaries used strategies that directly targeted the public, nor used audit and feedback. This emerged as the principle policy puzzle. Our analysis identified five reasons for these strategies not being employed: (1) their need to build/maintain healthy relationships with policy actors; (2) their need to build/maintain healthy relationships with service delivery system actors; (3) role differentiation with other system actors; (4) perceived lack of "fit" with the role of policy intermediaries; and (5) resource limitations that preclude intensive distributed (program-level) work.

Conclusion

Policy makers and implementers must consider capacity to support implementation, and our study identifies how intermediaries can be developed and harnessed to support the implementation process.

Addressing Inequities in Access to Mental Healthcare: A Policy Analysis of Community Mental Health Systems Serving Minoritized Populations in North Carolina

Racial and ethnic minoritized uninsured populations in the United States face the greatest barriers to accessing mental healthcare. Historically, systems of care in the U.S. were set up using inadequate evidence at the federal, state, and local levels, driving inequities in access to quality care for minoritized populations. These inequities are most evident in community-based mental health services, which are partially or fully funded by federal programs and predominantly serve historically minoritized groups. In this descriptive policy analysis, we outline the history of federal legislative policies that have dictated community mental health systems and how these policies were implemented in North Carolina, which has a high percentage of uninsured communities of color. Several gaps between laws passed in the last 60 years and research on improving inequities in access to mental health services are discussed. Recommendations to expand/fix these policies include funding accurate data collection and implementation methods such as electronic health record (EHR) systems to ensure policies are informed by extensive data, implementation of evidence-informed and culturally sensitive interventions, and prioritizing preventative services that move past traditional models of mental healthcare.

Provider Adherence to Modular Cognitive Behavioral Therapy for Children and Adolescents

This study explored predictors of community-based providers' adherence to MATCH, a modular cognitive behavioral therapy for children and adolescents. Provider-reported adherence to MATCH was measured using three increasingly strict criteria: (1) session content (whether the session covered MATCH content consistent with the client's target problem), (2) session content and sequencing (whether the session covered MATCH content in the expected sequence for the client's target problem), and (3) session content, sequencing, and participant (whether the session covered MATCH content in the expected sequence and with the expected participant(s) for the client's target problem). Session, client, provider, and organizational predictors of adherence to MATCH were assessed using multilevel modeling. Results revealed that nearly all providers delivered MATCH content that corresponded to the target problem, but only one-third of providers delivered MATCH content in the expected sequence and with the expected participant for the client's target problem. This difference underscores the need for nuanced adherence measurement to capture important implementation information that broad operationalizations of adherence miss. Regardless of the criteria used providers were most adherent to MATCH during sessions when clients presented with interfering comorbid mental health symptoms. This suggests that the design of MATCH, which offers flexibility and structured guidance to address comorbid mental health problems, may allow providers to personalize treatment to address interfering comorbidity symptoms while remaining adherent to evidence-based practices. Additional guidance for providers on managing other types of session interference (e.g., unexpected events) may improve treatment integrity in community settings.

An Equity-Focused Assessment of Evidence-Based Parenting Intervention Research

Evidence-based parenting interventions (EBPI) support children and families to promote resilience, address emotional and behavioral concerns, and prevent or address issues related to child maltreatment. Critiques of EBPIs include concerns about their relevance and effectiveness for diverse populations when they are implemented at population scale. Research methods that center racial equity and include community-based participatory approaches have the potential to address some of these concerns. The purpose of the present review was to document the extent to which methods associated with promoting racial equity in research have been used in studies that contribute to the evidence base for programs that meet evidentiary standards for a clearinghouse that was developed to support the Family First Prevention Services Act in the United States. We developed a coding system largely based on the Culturally Responsive Evaluation model. A sample of 47 papers that are part of the evidence base for ten in-home parent skill-based programs were reviewed and coded. Only three of 28 possible codes were observed to occur in over half of the studies (including race/ethnicity demographic characteristics, conducting measure reliability for the study sample, and including information on socioeconomic status). Although the overall presence of equity-informed methods was low, a positive trend was observed over time. This review highlights ways in which rigorous research can incorporate racial equity into the planning, design, execution, and interpretation and dissemination of programs of study. We posit that doing so improves the external validity of studies while maintaining high-quality research that can contribute to an evidence base.

Implementation Feasibility and Hidden Costs of Statewide Scaling of Evidence-Based Therapies for Children and Adolescents

OBJECTIVE

State mental health systems are retraining their workforces to deliver services supported by research. Knowledge about evidence-based therapies (EBTs) for child and adolescent disorders is robust, but the feasibility of their statewide scaling has not been examined. The authors reviewed implementation feasibility for 12 commonly used EBTs, defining feasibility for statewide scaling as an EBT having at least one study documenting acceptability, facilitators and barriers, or fidelity; at least one study with a racially and ethnically diverse sample; an entity for training, certification, or licensing; and fiscal data reflecting the costs of implementation.

METHODS

The authors reviewed materials for 12 EBTs being scaled in New York State and conducted a literature review with search terms relevant to their implementation. Costs and certification information were supplemented by discussions with treatment developers and implementers.

RESULTS

All 12 EBTs had been examined for implementation feasibility, but only three had been examined for statewide scaling. Eleven had been studied in populations reflecting racial-ethnic diversity, but few had sufficient power for subgroup analyses to demonstrate effectiveness with these samples. All had certifying or licensing entities. The per-clinician costs of implementation ranged from $500 to $3,500, with overall ongoing costs ranging from $100 to $6,000. A fiscal analysis of three EBTs revealed hidden costs ranging from $5,000 to $24,000 per clinician, potentially limiting sustainability.

CONCLUSIONS

The evidence necessary for embedding EBTs in state systems has notable gaps that may hinder sustainability. Research-funding agencies should prioritize studies that focus on the practical aspects of scaling to assist states as they retrain their workforces.

Policy Complexities in Financing First Episode Psychosis Services: Implementation Realities from a Home Rule State

Over the past decade, significant investments have been made in coordinated specialty care (CSC) models for first episode psychosis (FEP), with the goal of promoting recovery and preventing disability. CSC programs have proliferated as a result, but financing challenges imperil their growth and sustainability. In this commentary, the authors discuss (1) entrenched and emergent challenges in behavioral health policy of consequence for CSC financing; (2) implementation realities in the home rule context of Ohio, where significant variability exists across counties; and (3) recommendations to improve both care quality and access for individuals with FEP. The authors aim to provoke careful thought about policy interventions to bridge science-to-service gaps, and in this way, advance behavioral health equity.

Differential Associations Among Cyberbullying Victimization, Parental Monitoring, and Suicidal Thoughts and Behaviors in Male and Female College Students

PURPOSE

This study aimed to examine the role of parental monitoring and help seeking in the relationship between cyberbullying victimization and suicidal thoughts and behaviors in male and female college students.

METHOD

Data were collected for 336 college students (71.72% female and 28.28% male) aged 18 to 24 or older years from two universities in the Midwest and the South Central regions.

RESULTS

Logistic regression indicated the interaction term of cyberbullying victimization and parental monitoring was negatively related to suicidal thoughts and behaviors in a male group (B = -.155, p < .05, Exp(B) = .86).

DISCUSSION

Male students whose parents monitored about being safe on the computer had dramatically fewer suicidal thoughts/behaviors. In both male and female groups, seeking professional help was not a significant moderator that weakened the relationship.

CONCLUSION

There is a need for additional research on the importance of prevention and intervention efforts to foster open dialogue between students and their parents.

Expanding access to evidence-based psychotherapy in VA settings: implementation of the brief cognitive behavioral therapy for depression program

Introduction

Evidence-based psychotherapies (EBPs) are effective for mental health conditions, but access to these services remains limited and rural Veterans are particularly underserved. Specialized implementation and dissemination programs are needed to improve access to known EBPs.

Methods

The current project sought to improve access to a known EBP-brief Cognitive Behavioral Therapy for depression (Brief CBT). Diverse Veterans and those from rural settings were a focus of this work. Aligned with the RE-AIM framework, a multifaceted implementation program was used to train and support VHA providers in their use of Brief CBT in VHA mental health settings, with specific outreach efforts made to providers at VHA Community-Based Outpatient Clinics (CBOCs) where rural Veterans often receive care. Evaluation included all facets of RE-AIM with a particular focus on adoption, effectiveness, and maintenance.

Results

During the first two years, over 40 VHA facilities adopted the program across four regional networks. Eighty-three providers were approached, and 54 (65.1%) providers completed the training and are delivering the intervention. A total of 688 Veterans, 174 rural (25.7%), received 2,186 sessions (average of 3.5 sessions per Veteran). Veterans receiving Brief CBT with elevated depression scores who completed three or more sessions were found to have significant symptom reductions of 4.6 points (first to last available evaluations).

Discussion

Implementation efforts of Brief CBT resulted in rapid uptake and significant clinical impact on Veterans. Rural outreach efforts, including targeted training for CBOC providers and use of tele-mental health, enhanced availability of EBP services for rural Veterans.

Comparing organization-focused and state-focused financing strategies on provider-level reach of a youth substance use treatment model: a mixed-method study

BACKGROUND

Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes.

METHOD

A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach.

RESULTS

The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities).

DISCUSSION

As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment.

The role of implementation organizations in scaling evidence-based psychosocial interventions

BACKGROUND

To bring evidence-based interventions (EBIs) to individuals with behavioral health needs, psychosocial interventions must be delivered at scale. Despite an increasing effort to implement effective treatments in communities, most individuals with mental health and behavioral problems do not receive EBIs. We posit that organizations that commercialize EBIs play an important role in disseminating EBIs, particularly in the USA. The behavioral health and implementation industry is growing, bringing the implementation field to an important inflection point: how to scale interventions to improve access while maintaining EBI effectiveness and minimizing inequities in access to psychosocial intervention.

MAIN BODY

We offer a first-hand examination of five illustrative organizations specializing in EBI implementation: Beck Institute for Cognitive Behavioral Therapy; Incredible Years, Inc.; the PAXIS Institute; PracticeWise, LLC; and Triple P International. We use the Five Stages of Small Business Growth framework to organize themes. We discuss practical structures (e.g., corporate structures, intellectual property agreements, and business models) and considerations that arise when trying to scale EBIs including balancing fidelity and reach of the intervention. Business models consider who will pay for EBI implementation and allow organizations to scale EBIs.

CONCLUSION

We propose research questions to guide scaling: understanding the level of fidelity needed to maintain efficacy, optimizing training outcomes, and researching business models to enable organizations to scale EBIs.

A landscape assessment of the activities and capacities of evidence-to-policy intermediaries (EPI) in behavioral health

BACKGROUND

A significant gap exists between the production of research evidence and its use in behavioral health policymaking. Organizations providing consulting and support activities for improving policy represent a promising source for strengthening the infrastructure to address this gap. Understanding the characteristics and activities of these evidence-to-policy intermediary (EPI) organizations can inform the development of capacity-building activities, leading to strengthened evidence-to-policy infrastructure and more widespread evidence-based policymaking.

METHODS

Online surveys were sent to 51 organizations from English-speaking countries involved in evidence-to-policy activities in behavioral health. The survey was grounded in a rapid evidence review of the academic literature regarding strategies used to influence research use in policymaking. The review identified 17 strategies, which were classified into four activity categories. We administered the surveys via Qualtrics and calculated the descriptive statistics, scales, and internal consistency statistics using R.

RESULTS

A total of 31 individuals completed the surveys from 27 organizations (53% response rate) in four English-speaking countries. EPIs were evenly split between university (49%) and non-university (51%) settings. Nearly all EPIs conducted direct program support (mean = 4.19/5 [sd = 1.25]) and knowledge-building (4.03 [1.17]) activities. However, engagement with traditionally marginalized and non-traditional partners (2.84 [1.39]) and development of evidence reviews using formal critical appraisal methods (2.81 [1.70]) were uncommon. EPIs tend to be specialized, focusing on a group of highly related strategies rather than incorporating multiple evidence-to-policy strategies in their portfolios. Inter-item consistency was moderate to high, with scale α's ranging from 0.67 to 0.85. Ratings of respondents' willingness to pay for training in one of three evidence dissemination strategies revealed high interest in program and policy design.

CONCLUSIONS

Our results suggest that evidence-to-policy strategies are frequently used by existing EPIs; however, organizations tend to specialize rather than engage in a breadth of strategies. Furthermore, few organizations reported consistently engaging with non-traditional or community partners. Focusing on building capacity for a network of new and existing EPIs could be a promising strategy for growing the infrastructure needed for evidence-informed behavioral health policymaking.

Misalignment in Community Mental Health Leader and Therapist Ratings of Psychological Safety Climate Predicts Therapist Self-Efficacy with Evidence-Based Practices (EBPs)

Therapist self-efficacy in delivering evidence-based practices (EBPs) is associated with implementation outcomes, including adoption and sustainment in community mental health settings. Inner context organizational climate, including psychological safety, can proximally shape therapist learning experiences within EBP implementation. Psychologically safe environments are conducive to learning behaviors including taking risks, admitting mistakes, and seeking feedback. Organization leaders are instrumental in facilitating psychological safety, but may have differing perspectives of organizational climate than front-line therapists. Discrepant leader and therapist views of psychological safety may have independent associations with therapist EBP learning and implementation outcomes over and above average therapist perceptions of climate. This study examined survey data from 337 therapists and 123 leaders from 49 programs contracted to deliver multiple EBPs within a study examining determinants of sustainment within a large system-driven implementation. Both leaders and therapists completed measures of psychological safety climate and therapists reported on their self-efficacy in delivering multiple EBPs in children's mental health services. Polynomial regression and response surface analysis models were conducted to examine the associations of therapist and leader reports of psychological safety and therapist EBP self-efficacy. Greater discrepancies between leader and therapist reports of psychological safety, in either direction, were associated with lower therapist EBP self-efficacy. Alignment in leader and therapist views of psychological safety climate may impact EBP implementation outcomes. Strategies for improving alignment in perceptions and priorities among organizational members can be included in organizational implementation interventions and may represent unexamined implementation mechanisms of action.

Access, retention, and effectiveness of individual placement and support in the US: Are there racial or ethnic differences?

BACKGROUND: Increased federal attention to advancing racial equity and support for underserved communities suggests the need for data on racial and ethnic differences in evidence-based employment services for people with serious mental illness. Individual Placement and Support (IPS) is an evidence-based model of supported employment for this population. OBJECTIVE: The objective was to identify differences based on race and ethnicity in IPS services. METHODS: This narrative review examined the empirical literature on IPS services in the U.S., assessing evidence of differences in access, retention, and outcomes for Black and Hispanic IPS clients, relative to non-Hispanic Whites. RESULTS: We identified 12 studies examining racial and ethnic differences in access (4 studies), retention (3 studies), and effectiveness (6 studies). The findings for access to IPS were mixed, with two studies showing no differences, one finding less access for Blacks, and another finding greater access for Blacks but less access for Hispanics. Three studies found better retention rates for clients enrolled in IPS regardless of race or ethnicity. Compared to clients receiving usual vocational services, all studies found better employment outcomes for IPS clients regardless of race or ethnicity. CONCLUSION: Unlike for most of health care, few racial and ethnic differences have been found for IPS employment services in the U.S. Access to IPS is inadequate for all groups, with conflicting evidence whether Blacks and Hispanics have even less access. Based on the available evidence, Black and Hispanic clients have comparable retention and employment outcomes in IPS as non-Hispanic White clients. State and local mental health leaders responsible for monitoring IPS outcomes should routinely report statistics on race and ethnicity. They should also give active attention to client needs and equity. Research designs should answer multifaceted questions regarding disparities for historically underserved populations.

Implementation and Mental Health Outcomes of a Service Cascade Linking Child Welfare and Children's Mental Health Systems: A Case Study of the Gateway CALL Demonstration

The mental health needs of children and youth involved in the child welfare system remain largely unmet. Service cascades are an emerging approach to systematizing mental health screening, assessment, and treatment referral processes. However, evidence is minimal and inconsistent regarding the effectiveness of such approaches for improving mental health service access and outcomes. In an effort to address this gap, this study presents a case-study of the implementation fidelity and treatment outcomes of the Gateway CALL service cascade. Study analyses involved longitudinal data collected as part of a larger evaluation of Gateway CALL. Specifically, descriptive and linear mixed model analyses were conducted to assess the implementation of service cascade components, and changes in mental health outcomes (behavior problems) among 175 children placed out-of-home during the study. Study analyses found that although fidelity was strong early in the service cascade, implementation began to break down once components involved more than one service system (child welfare, mental health). However, results also indicated that parent-reported child behavior problems decreased significantly over time, despite later cascade components being implemented with poor fidelity to the Gateway CALL service model. For children and youth involved in child welfare systems, service cascades like Gateway CALL have the potential to significantly improve both mental health service receipt and outcomes. To maximize the effectiveness of such approaches, later phases of implementation may require increased attention and support, particularly regarding processes and outcomes that cross child welfare and mental health service systems.

Scaling-up Child and Youth Mental Health Services: Assessing Coverage of a County-Wide Prevention and Early Intervention Initiative During One Fiscal Year

PURPOSE

In the U.S., the percentage of youth in need of evidence-based mental health practices (EBPs) who receive them (i.e., coverage rate) is low. We know little about what influences coverage rates. In 2010, the Los Angeles County Department of Mental Health (LACDMH) launched a reimbursement-driven implementation of multiple EBPs in youth mental health care. This study examines two questions: (1) What was the coverage rate of EBPs delivered three years following initial implementation? (2) What factors are associated with the coverage rates?

METHODS

To assess coverage rates of publicly insured youth, we used LACDMH administrative claims data from July 1, 2013 to June 30, 2014 and estimates of the size of the targeted eligible youth population from the 2014 American Community Survey (ACS). The unit of analysis was clinic service areas (n = 254). We used Geographic Information Systems and an OLS regression to assess community and clinic characteristics related to coverage.

RESULTS

The county coverage rate was estimated at 17%, much higher than national estimates. The proportion of ethnic minorities, individuals who are foreign-born, adults with a college degree within a geographic area were negatively associated with clinic service area coverage rates. Having more therapists who speak a language other than English, providing care outside of clinics, and higher proportion of households without a car were associated with higher coverage rates.

CONCLUSION

Heterogeneity in municipal mental health record type and availability makes it difficult to compare the LACDMH coverage rate with other efforts. However, the LACDMH initiative has higher coverage than published national rates. Having bilingual therapists and providing services outside the clinic was associated with higher coverage. Even with higher coverage, inequities persisted.

State Department and Provider Agency Utilization of Evidence-Based Program Registries in Behavioral Healthcare and Child Welfare

Evidence-based program registries (EBPRs) are web-based compilations of behavioral healthcare programs/interventions that rely on research-based criteria to rate program efficacy or effectiveness for support of programmatic decision-making. The objective was to determine the extent to which behavioral health decision-makers access EBPRs and to understand whether and exactly how they use the information obtained from EPBRs. Single State Authorities (SSAs) and service provider agencies in the areas of behavioral health and child welfare were recruited nationally. Senior staff (n = 375) responsible for the selection and implementation of programs and/or policies were interviewed by telephone concerning their visits (if any) to 28 relevant EBPRs, the types of information they were seeking, whether they found it, and how they may have used that information to effect changes in their organizations. At least one EBPR was visited by 80% of the respondents, with a median of three different registers being visited. Most visitors (55%) found all the information they were seeking; those who did not desired more guidance or tools for individual program implementation or were unable to locate the program or practice that they were seeking. Most visitors (65%) related using the information obtained to make changes in their organizations, in particular to select, start or change a program, or to support the adoption or improvement of evidence-based clinical practices. EBPRs were shown to be important resources for dissemination of research-based program effectiveness data, leading to increased use of evidence-based practices in the field, but the study also identified needs for greater awareness of EBPRs generally and for more attention to implementation of specific recommended programs and practices.

Reducing Anxiety and Stress among Youth in a CBT-Based Equine-Assisted Adaptive Riding Program

Simple Summary

Reining in Anxiety (RiA) is a therapeutic program for youth with mild-to-moderate anxiety delivered in a therapeutic riding setting by Certified Therapeutic Riding Instructors. RiA is based on five foundational components of Cognitive Behavioral Therapy (CBT): in vivo exposure, cognitive restructuring, youth psychoeducation, relaxation, and caregiver psychoeducation about anxiety. The intervention sought to support youth between the ages of 6–17 with self-identified anxiety. Due to global pandemic trauma, in the second iteration of the protocol, researchers also included two evidence-based trauma components: maintenance and personal safety skills. All instructors were trained in the RiA curriculum and delivered the same lessons. In addition to assessing the youth’s perception and changes over time, the researchers also assessed changes in the horses, both through saliva sampling. The authors learned that RiA may be a promising approach for reducing anxiety and stress among youth and that the intervention can be delivered by adaptive/therapeutic horseback riding instructors in a non-clinic setting.

Abstract

Reining in Anxiety (RiA) is a therapeutic program for youth with mild to moderate anxiety delivered in a therapeutic riding setting by Certified Therapeutic Riding Instructors. RiA was developed after a review of the evidence base for youth anxiety, is manualized, and includes five core CBT components: in vivo exposure, cognitive restructuring, youth psychoeducation, relaxation, and caregiver psychoeducation about anxiety. This study extended findings from a prior RCT that examined (1) the feasibility of collecting saliva samples from horses and children to measure stress (cortisol) and relaxation (oxytocin); (2) whether changes in stress and relaxation occurred both during each lesson and over the course of the 10-week intervention for horses and youth; (3) whether changes in anxiety symptoms, emotional regulation, and self-efficacy found in the first trial were comparable; and (4) if fidelity to the program was reliable. Youth participants (n = 39) ages 6–17 with caregiver-identified mild-to-moderate anxiety participated in a ten-week therapeutic intervention (RiA), which combined adaptive riding and components of CBT. Physiological data and self-report measures were taken at weeks one, four, seven, and ten for the youth and horses. Saliva assays assessed cortisol as a physiological marker of stress and anxiety, and oxytocin as a measure of relaxation. Fidelity data were recorded per session. Anxiety, as measured by caregiver self-reporting, significantly decreased from pre- to post-test, while emotional regulation scores increased. No significant changes in self-efficacy from pre- to post-test were observed. Saliva samples obtained from participants before and after riding sessions showed a consistent decrease in cortisol and a significant increase in oxytocin at two of the four timepoints (Week 1 and Week 7), but no overall pre- to post-test changes. Horse saliva data were collected using a modified bit; there were no significant changes in oxytocin or cortisol, suggesting that the horses did not have an increase in stress from the intervention. RiA may be a promising approach for reducing anxiety and stress among youth, as measured both by self-reported and by physiological measures. Collection of salivary assays for both youth and horses is feasible, and the intervention does not increase stress in the horses. Importantly, RiA can be delivered by adaptive/therapeutic horseback riding instructors in naturalistic (e.g., non-clinic-based) settings. As youth anxiety is a growing public health problem, novel interventions, such as RiA, that can be delivered naturalistically may have the potential to reach more youth and thus improve their quality of life. Further research is needed to examine the comparative value of RiA with other animal-assisted interventions and to assess its cost-effectiveness.

State Policies that Impact the Design of Children's Mental Health Services: A Modified Delphi Study

To identify the state-level policies and policy domains that state policymakers and advocates perceive as most important for positively impacting the use of children's mental health services (CMHS). We used a modified Delphi technique (i.e., two rounds of questionnaires and an interview) during Spring 2021 to elicit perceptions among state mental health agency officials and advocates (n = 28) from twelve states on state policies that impact the use of CMHS. Participants rated a list of pre-specified policies on a 7-point Likert scale (1 = not important, 7 = extremely important) in the following policy domains: insurance coverage and limits, mental health services, school and social. Participants added nine policies to the initial list of 24 policies. The "school" policy domain was perceived as the most important, while the "social" policy domain was perceived as the least important after the first questionnaire and the second most important policy domain after the second questionnaire. The individual policies perceived as most important were school-based mental health services, state mental health parity, and Medicaid reimbursement rates. Key stakeholders in CMHS should leverage this group of policies to understand the current policy landscape in their state and to identify gaps in policy domains and potential policy opportunities to create a more comprehensive system to address children's mental health from a holistic, evidence-based policymaking perspective.

Variations in Definitions of Evidence-Based Interventions for Behavioral Health in Eight Selected U.S. States

BACKGROUND

U.S. state legislatures fill a vital role in supporting the use of evidence-based interventions (EBIs) through statutes and regulations (mandates).

OBJECTIVE

The study determined the terms used by selected states to describe EBIs and how those terms are defined in mandates.

RESEARCH METHODS

The mandates of eight purposely selected states were accessed and coded using the Westlaw Legal Research Database.

RESULTS

Considerable variation was found in the terms used by states to describe EBIs. Although "evidence-based" was the most frequently utilized term (60% of mandates), an additional 29 alternative terms appeared with varying frequencies. Most terms were simply mentioned, with no further definition or elaboration. When terms were further defined or elaborated, the majority were defined using numerous and different types of external sources or references. Three approaches were found in the mandates defining EBIs: "single definition," "hierarchies of evidence levels," and "best available evidence"; the states differed considerably in the approaches used in their mandates.

CONCLUSIONS

The variations in EBI-related terminology across states and within states, coupled with a lack of elaboration on the meaning of important terms and the predominant use of external rather than internal guidelines, may be a source of confusion for behavioral health provider agencies that seek direction about what constitutes an EBI. Prior studies indicate that many agencies may lack staff with the technical ability to adequately evaluate what constitutes an EBI. Thus, lack of clear guidance from official state government mandates may impede the implementation of EBIs within states.

Inter-agency collaboration is associated with increased frequency of research use in children's mental health policy making

OBJECTIVE

To determine whether the self-report frequency of inter-agency collaboration about children's mental health issues is associated with the self-report frequency of using research evidence in children's mental health policy and program decision making in mental health agencies (MHAs).

DATA SOURCES

Primary data were collected through web-based surveys of state (N = 221) and county (N = 117) MHA officials.

DESIGN

The primary independent variable was a composite score quantifying the frequency of collaboration about children's mental health issues between officials in MHAs and six other state agencies. The dependent variables were composite scores quantifying the frequency of research use in children's mental health policy and program decision making in general and for specific purposes (i.e., conceptual, instrumental, tactical, imposed). Covariates were composite scores quantifying well-established determinants of research use (e.g., agency leadership, research use skills) in agency policy and program decision making.

DATA METHODS

Separate multiple linear regression models estimated associations between frequency of inter-agency collaboration and research use scores, adjusting for other determinants of research use, respondent state, and other covariates. Data from state and county officials were analyzed separately.

PRINCIPAL FINDINGS

The frequency of inter-agency collaboration was positively and independently associated with the frequency of research use in children's mental health policy making among state (β = 0.22, p = 0.004) and county (β = 0.39, p < 0.0001) MHA officials. Inter-agency collaboration was also the only variable significantly associated with the frequency of research use for all four specific purposes among state MHA officials, and similar findings we observed among county MHA officials. The magnitudes of associations between inter-agency collaboration and frequency of research use were generally stronger than for more well-established determinants of research use in policy making.

CONCLUSIONS

Strategies that promote collaboration between MHA officials and external agencies could increase the use of research evidence in children's mental health policy and program decision making in MHAs.

Comparing two federal financing strategies on penetration and sustainment of the adolescent community reinforcement approach for substance use disorders: protocol for a mixed-method study

BACKGROUND

Sustained, widespread availability of evidence-based practices (EBPs) is essential to address the public health and societal impacts of adolescent substance use disorders (SUD). There remains a particularly significant need to identify effective financing strategies, which secure and direct financial resources to support the costs associated with EBP implementation and sustainment. This protocol describes a new project comparing two types of U.S. federal grant mechanisms (i.e., a type of financing strategy), which supported the implementation of the Adolescent Community Reinforcement Approach (A-CRA) EBP for SUD, through either organization-focused or state-focused granting of funds. The Exploration-Preparation-Implementation-Sustainment (EPIS) framework will guide our study aims, hypotheses, and selection of measures.

METHOD

We will employ a longitudinal, mixed-method (i.e., web surveys, semi-structured interviews, document review, focus groups, administrative data), quasi-experimental design to compare the grant types' outcomes and examine theoretically informed mediators and moderators. Aim 1 will examine the proportion of eligible clinicians certified in A-CRA with adequate fidelity levels (i.e., penetration outcomes) at the end of grant funding. Aim 2 will examine the sustainment of A-CRA up to 5 years post-funding, using a 10-element composite measure of treatment delivery and supervision activities. We will integrate the new data collected from state-focused grant recipients (~85 organizations in 19 states) with previously collected data from organization-focused grant recipients (Hunter et al., Implement Sci 9:104, 2014) (82 organizations in 26 states) for analysis. We will also use sensitivity analyses to characterize the effects of observed and unobserved secular trends in our quasi-experimental design. Finally, aim 3 will use comparative case study methods (integrating diverse quantitative and qualitative measures) to identify and disseminate policy implications about the roles of state- and organization-focused federal grants in efforts to promote adolescent SUD EBP implementation and sustainment.

DISCUSSION

The proposed research will have direct, practical implications for behavioral health administrators, policymakers, implementation experts, and the public. It will offer new knowledge that can directly inform financing strategies to support large-scale, sustained EBP delivery in behavioral health-while advancing implementation science through the use of novel methods to study financing strategies and sustainment.

Growth of IPS Supported Employment Programs in the United States: An Update

OBJECTIVE

Individual placement and support (IPS), an evidence-based supported employment practice, is a core service in community mental health in the United States. Several factors promote the growth of IPS, including a network of 24 states participating in a learning community devoted to expanding IPS services. This study examined growth of IPS in the United States from 2016 to 2019, comparing growth rates for states within and outside the learning community.

METHODS

This national survey included telephone interviews with 70 representatives from state mental health and vocational rehabilitation agencies in 50 states and the District of Columbia, replicating methods of a 2016 survey. The primary outcomes were the number of IPS programs and clients served. The survey inquired about four indicators of state-level support for IPS implementation and sustainment: collaboration between state agencies, independent fidelity reviews, technical assistance and training, and funding.

RESULTS

In 2019, 41 (80%) of 50 states and the District of Columbia had IPS services, with 857 IPS programs serving an estimated 43,209 clients. Between 2016 and 2019, the number of programs increased from 272 to 486 in 22 learning-community states and two learning-community counties, and from 251 to 371 in 18 states outside the learning community. State-level support for IPS was significantly greater in learning-community states, compared with non-learning-community states.

CONCLUSIONS

IPS services expanded substantially in the United States between 2016 and 2019. Learning-community states had more rapid growth and provided greater implementation support, facilitating implementation, expansion, and sustainment of high-fidelity IPS. Nevertheless, access to IPS remains limited.

In Search of the Common Elements of Clinical Supervision: A Systematic Review

The importance of clinical supervision for supporting effective implementation of evidence-based treatments (EBTs) is widely accepted; however, very little is known about which supervision practice elements contribute to implementation effectiveness. This systematic review aimed to generate a taxonomy of empirically-supported supervision practice elements that have been used in treatment trials and shown to independently predict improved EBT implementation. Supervision practice elements were identified using a two-phase, empirically-validated distillation process. In Phase I, a systematic review identified supervision protocols that had evidence of effectiveness based on (a) inclusion in one or more EBT trials, and (b) independent association with improved EBT implementation in one or more secondary studies. In Phase II, a hybrid deductive-inductive coding process was applied to the supervision protocols to characterize the nature and frequency of supervision practice elements across EBTs. Twenty-one of the 876 identified articles assessed the associations of supervision protocols with implementation or clinical outcomes, representing 13 separate studies. Coding and distillation of the supervision protocols resulted in a taxonomy of 21 supervision practice elements. The most frequently used elements were: reviewing supervisees' practice (92%; n = 12), clinical suggestions (85%; n = 11), behavioral rehearsal (77%; n = 10), elicitation (77%; n = 10), and fidelity assessment (77%; n = 10). This review identified supervision practice elements that could be targets for future research testing which elements are necessary and sufficient to support effective EBT implementation. Discrepancies between supervision practice elements observed in trials as compared to routine practice highlights the importance of research addressing supervision-focused implementation strategies.

Coordination of sustainable financing for evidence-based youth mental health treatments: protocol for development and evaluation of the fiscal mapping process

BACKGROUND

Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health and economic impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies (hereafter, "service agencies"). Strategic planning tools are needed that can guide these service agencies in their coordination of sustainable funding for EBTs. This protocol describes a mixed-methods research project designed to (1) develop and (2) evaluate our novel fiscal mapping process that guides strategic planning efforts to finance the sustainment of EBTs in youth mental health services.

METHOD

Participants will be 48 expert stakeholder participants, including representatives from ten service agencies and their partners from funding agencies (various public and private sources) and intermediary organizations (which provide guidance and support on the delivery of specific EBTs). Aim 1 is to develop the fiscal mapping process: a multi-step, structured tool that guides service agencies in selecting the optimal combination of strategies for financing their EBT sustainment efforts. We will adapt the fiscal mapping process from an established intervention mapping process and will incorporate an existing compilation of 23 financing strategies. We will then engage participants in a modified Delphi exercise to achieve consensus on the fiscal mapping process steps and gather information that can inform the selection of strategies. Aim 2 is to evaluate preliminary impacts of the fiscal mapping process on service agencies' EBT sustainment capacities (i.e., structures and processes that support sustainment) and outcomes (e.g., intentions to sustain). The ten agencies will pilot test the fiscal mapping process. We will evaluate how the fiscal mapping process impacts EBT sustainment capacities and outcomes using a comparative case study approach, incorporating data from focus groups and document review. After pilot testing, the stakeholder participants will conceptualize the process and outcomes of fiscal mapping in a participatory modeling exercise to help inform future use and evaluation of the tool.

DISCUSSION

This project will generate the fiscal mapping process, which will facilitate the coordination of an array of financing strategies to sustain EBTs in community youth mental health services. This tool will promote the sustainment of youth-focused EBTs.

Organizational factors associated with community therapists’ self-efficacy in EBP delivery: The interplay between sustainment leadership, sustainment climate, and psychological safety

Background

Inner context organizational factors proximally shape therapist experiences with evidence-based practice (EBP) implementation and may influence therapist self-efficacy, which has been linked to sustained use of EBPs in community mental health settings. Research has primarily focused on constructs such as implementation leadership and climate. However, the effects of such factors may depend upon other inner context dimensions, such as psychological safety. Psychologically safe environments are conducive to taking risks, speaking up about problems, and requesting feedback and may promote therapist self-efficacy during implementation. This study examines whether organizational sustainment leadership and sustainment climate relate to therapist EBP self-efficacy only under conditions of psychological safety.

Methods

Data were collected from 410 clinicians in 85 programs during the sustainment phase of a system-driven implementation of multiple EBPs in children's mental health services. Therapists reported on their organization's sustainment leadership, sustainment climate, psychological safety, and their own self-efficacy in delivering specific EBPs. Multilevel regression analyses were conducted to account for nested data structure.

Results

Among program-level variables, sustainment leadership and psychological safety both significantly predicted therapist self-efficacy. However, there were no significant interactions between program-level sustainment climate and psychological safety. Exploratory post-hoc analyses revealed a significant interaction between program-level sustainment leadership and therapist-level perceptions of psychological safety such that that the conditional effect of psychological safety on EBP self-efficacy was significant at high levels of sustainment leadership, but not at low or average levels.

Conclusion

We noted independent links between sustainment leadership, organizational psychological safety and therapists feelings of confidence and mastery with EBPs. Therapists’ individual perceptions of psychological safety were linked to self-efficacy only in programs with high sustainment leadership. Thus, sustainment leadership and psychological safety may both represent implementation intervention targets, but it may not be critical to assess for perceptions of psychological safety before deploying organizational leadership strategies. Plain language abstract Therapist self-efficacy is a therapist's belief that they are capable, knowledgeable, and skilled enough to deliver evidence-based practices (EBPs), and is thought to promote improved clinical and implementation outcomes, such as therapists’ sustained use of EBPs. Conditions within community mental health organizations may influence therapists’ sense of EBP self-efficacy. Leaders’ support and expectations for EBP implementation, and collective staff perceptions about the organization's climate to support EBPs are linked to positive therapist attitudes and EBP adoption. However, less is known about how these implementation-specific organizational factors associated with therapist EBP self-efficacy in the long-term, and how this may depend on general workplace conditions. Specifically, psychologically safe environments – where therapists feel safe taking risks such as asking questions, admitting mistakes, and trying new skills – may be needed to promote self-efficacy when therapists are tasked with learning and using complex multi-component EBP innovations. The current study tested the prediction that leader-driven and program-wide focus on EBP sustainment may promote therapist EBP self-efficacy only in organizations where conditions for learning are psychologically safe. Our findings confirmed that fostering strong sustainment focused leadership and psychologically safe environments may each be important for increasing therapists’ EBP self-efficacy. The model results suggested that individual therapist perceptions of psychological safety were more strongly related to EBP self-efficacy in programs with greater implementation leadership. Findings suggest the importance of increasing EBP leadership behavior to fully potentiate other facilitating conditions for therapist learning in the sustainment phase of EBP implementation initiatives.

The implementation potential of a method to monitor empirically-supported children's mental health treatment through claims data

Background

The delivery of evidence-supported treatments (EST) in children’s mental health could be a valuable measure for monitoring mental healthcare quality; however, efforts to monitor the use of EST in real world systems are hindered by the lack of pragmatic methods. This mixed methods study examined the implementation and agency response rate of a pragmatic, claims-based measure of EST designed to be applied as a universal quality measure for child psychotherapy encounters in a state Medicaid system.

Methods

Implementation potential of the EST measure was assessed with healthcare leader rankings of the reporting method’s acceptability, appropriateness and feasibility (n = 53), and post-implementation ratings of EST rate accuracy. Ability of the healthcare system to monitor EST through claims was measured by examining the agency responsivity in using the claims-based measure across 98 Medicaid-contracted community mental health (CMH) agencies in Washington State.

Results

The analysis found the reporting method had high implementation potential. The method was able to measure the use of an EST for 83% of children covered by Medicaid with 58% CMH agencies reporting > 0 ESTs in one quarter. Qualitative analyses revealed that the most significant barrier to reporting ESTs was the operability of electronic health record systems and agencies’ mixed views regarding the accuracy and benefits of reporting.

Conclusions

Measurement of child mental health ESTs through Medicaid claims reporting has acceptable implementation potential and promising real world responsiveness from CMH agencies in one state. Variation in reporting by agency site and low to moderate perceived value by agency leaders suggests the need for additional implementation supports for wider uptake.

Systemic, Racial Justice-Informed Solutions to Shift "Care" From the Criminal Legal System to the Mental Health Care System

The current configuration and function of U.S. societal structures drives the overrepresentation of people with serious mental illness in the criminal legal system. Although the causes are multifactorial, the mental health system poorly serves those at highest risk of criminal legal system involvement. The growth of the mental health evidence base regarding the social determinants of mental health has ushered in greater understanding of their central role in the promotion and maintenance of mental illness and health. These academic strides, however, have failed to translate into widespread care and payment policy changes. Additionally, as is the case in the criminal legal system, structural racism shapes people's experiences in the mental health care system, contributing to inequitable mental health outcomes for persons with severe mental illness from racial and ethnic minority groups. This is a critical consideration for the population involved in the criminal legal system: Black and Brown people make up more than half of those incarcerated in the United States (despite comprising just 32% of the total population). In the absence of an intersectional, antiracist, structurally informed approach, any attempt by the mental health care system to stem the overrepresentation of people with serious mental illness in the criminal legal system will fail. This article provides an overview of the current mental health care system's shortcomings in serving this population. It proposes concrete steps to address these shortcomings, with a special focus on race and social determinants of health.

Psychiatric Crisis Care and the More is Less Paradox

Psychiatric crisis care in the U.S. exemplifies the "more is less paradox" of U.S. health care. We spend more for health care than any other high-income country, yet our outcomes are typically poor compared to these other countries (OECD in OECD health statistics. Retrieved from https://www.oced.org/health/health-data.html , 2020). We do this, in part, by emphasizing medical treatments for problems that are inherently social, rather than addressing social determinants of health. Medical interventions for socio-economic problems are usually expensive and ineffective. For mental health crisis care, adding unfunded, untested, medical interventions to the current mélange of poorly funded, disorganized arrangements will not help. Instead, the U.S. should address social determinants, emphasize research-based interventions, and emphasize prevention-proven strategies that decrease costs and improve outcomes.

Barriers and Facilitators to Behavior Change for Individuals with Severe Mental Illness who Received the Transdiagnostic Intervention for Sleep and Circadian Dysfunction in a Community Mental Health Setting

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) was implemented in a community mental health center (CMHC) setting. The goal of TranS-C is to improve sleep and circadian dysfunction among people with severe mental illness. The present study uses the Theoretical Domains Framework (TDF) to uncover barriers and facilitators to changing behaviors learned in TranS-C. Adults with severe mental illness who completed TranS-C (n = 14) were given a semi-structured interview based on the TDF. Interview transcripts were independently coded using inductive and deductive coding. The most commonly coded TDF domains were Behavior Regulation, Beliefs about Consequences, Knowledge and Beliefs about Capabilities. Action planning was the most discussed facilitator and compromising sleep health in favor of time spent with loved ones was the most discussed barrier. These findings suggest that TranS-C has promising strengths and raise important barriers that can be addressed in TranS-C to improve its fit within CMHCs.

The Organizational Financial Context of Publicly-Funded Mental Health Clinics: Development and Preliminary Psychometric Evaluation of the Agency Financial Status Scales

Funding is a major barrier to implementation of evidence-based practices (EBPs) in publicly-funded community mental health clinics (CMHCs). Understanding how best to deploy implementation strategies that address this barrier requires greater clarity on the financial context within agencies. We developed the Agency Financial Status Scales (AFSS) to assess employee perceptions of the level of three hypothesized and theoretical funding related constructs in organizations: (a) perceptions of financial health, (b) financial attitudes toward EBPs, and (c) strategic financial climate. This investigation serves as a preliminary evaluation of this measure. Participants were 239 therapists and 40 supervisors from 25 publicly-funded CMHCs providing outpatient mental health services for young people. Confirmatory factor analysis was used to investigate the latent trait structure of the items. Internal consistency, interrater agreement, concordance between therapists and supervisors, and convergent validity were also examined. A two-factor model measuring perceptions of financial health and strategic financial climate best fit the data. For both of these scales, alpha reliability was acceptable and agreement statistics provided moderate support for aggregation at the organizational level. Analyses supported the convergent validity of the scales. The development and preliminary evaluation of the AFSS is an important first step in understanding the financial context of publicly-funded CMHCs. Though findings from this investigation are promising, additional development and testing are needed to develop a more thorough understanding of the constructs and to improve the validity and reliability of this measure.

Scaling up evidence-based treatments in youth behavioral healthcare: Social work licensing influences on task-shifting opportunities

Youth behavioral healthcare workforce shortages have inhibited the scale-up of evidence-based treatments to address longstanding unmet needs andinequitable service coverage. Task-shifting is a strategy that could bolster workforce shortages. Legal and regulatory barriers, such as scope of practice licensing regulations, have hampered the use of task-shifting. Social workers make up the majority of the behavioral healthcare workforce in the U.S. and most social workers provide services to children and families. As such, social workers would play a pivotal role in any scale-up effort. In this guest editorial, we discuss the importance of social work licensing and use a case example to illustrate the unintended consequences that certain licensing regulations have on scaling-up evidence-based treatments via task-shifting. We conclude with recommendations on how social workers could be involved in taskshifting efforts to scale-up evidence-based treatments.

Academic-Policy Partnerships in Evidence-Based Practice Implementation and Policy Maker Use of Child Mental Health Research

OBJECTIVE

Strategies are needed to improve policy makers' evidence-informed decision making and the availability of evidence-based, state-supported services. This study examined whether academic-policy partnerships could promote these outcomes.

METHODS

Data from two national surveys of state mental health agency representatives were used to compare barriers to implementation of evidence-based practices (EBPs) and policy makers' use of child mental health research in states with strong academic-policy partnerships in workforce training or in program implementation/evaluation (IE) with barriers in states with no or limited partnerships in these areas.

RESULTS

Strong IE partnerships were associated with more confidence in research use and fewer issues with provider readiness and capacity but with more issues with EBP fidelity. Strong training partnerships were associated with fewer endorsements of lack of time as a barrier to research use.

CONCLUSIONS

Academic-policy partnerships had some benefit for states' research use and EBP implementation. Because these partnerships may reduce barriers, further research should explore characteristics of effective collaborations.

Factors that affect quality of care among mental health providers: Focusing on job stress and resources

Objective: High-quality, person-centered care is a priority for mental health services. The current study conducted secondary data analysis to examine the impact of job stress (i.e., interaction with high-risk consumer cases, increased caseload, emotional exhaustion) and resources (i.e., increased organizational and supervisory support, autonomy, role clarity) on providers' perceived quality of care. Methods: Data consisted of 145 direct care providers from an urban community mental health center. Structural equation modeling was used for testing the hierarchical regression model, sequentially adding job stress and resource variables in the prediction models for the quality of care (i.e., person-centered care, discordant care [conflict with consumers and tardiness]). Results: Person-centered care was positively associated with increased role clarity, organizational support, and larger caseload size, while a lower level of discordant care was associated with lower emotional exhaustion, smaller caseload size, less interaction with high-risk consumer cases, and with increased role clarity. Conclusions and Implications for Practice: Resources on the job may be particularly important for improved person-centered care, and lowering job stress may help reduce discordant care. The current study suggests the need for the mental health organizations to attend to both job stress and resources for providers to improve the quality of care. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Manuscript: Defining Quality Standards for Intensive Home Based Treatment Programs for Youth with Serious Emotional Disorders

Intensive Home Based Treatment (IHBT) is a critical component of the continuum of community-based behavioral healthcare for youth with serious emotional disorder (SED) and their families. Yet despite being used nationwide at costs of over $100 million annually in some states, a well-vetted, research-based set of quality standards for IHBT has yet to be developed. The current project aimed to define program and practice standards for IHBT, drawing upon literature review, expert interviews, and a systematic Delphi process engaging over 80 participants, including IHBT developers, experts in evidence-based youth mental health, youth and family advocates, IHBT providers, and state policymakers. After two rounds of quantitative and qualitative input, adequate consensus was achieved on 32 IHBT Program Standards and 43 IHBT Practice Standards. These standards hold potential for informing efforts such as development of state regulations, provider contracts, memoranda of agreement, and training and workforce development initiatives. Translation of the quality standards into measurement strategies holds potential for providing a method of continuous quality improvement across multiple levels as well as use in research on IBHT.

The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review

BACKGROUND

First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders' access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes.

METHODS

A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks.

RESULTS

Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership's positive relationship with providers' EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers' role in implementation.

CONCLUSIONS

Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation.

TRIAL REGISTRATION

This review was not registered.

Evidence Based Practice in Systems of Care for Children with Complex Mental Health Needs

Purpose: Community-based social work with families and youth with complex behavioral health needs highlights challenges to incorporating empirical evidence into routine practice. This article presents a framework for integrating evidence in community-based Systems of Care for these children and their families.Method: This article reviews research on various approaches to integrating evidence into children's behavioral health and community-based care and contextualizes it within dominant paradigms of Systems of Care (SoC) and Wraparound principles.Results: Based on this review, this article proposes the Evidence-Based Practice in Systems of Care (EBP in SoC) model. The model describes how to incorporate evidence into every aspect of community-based SoCs for children with mental health concerns.Discussion and Conclusion: Discussion of the model will focus on implications of using the framework for practitioners, mental health organizations, communities, and state and federal administration and policymaking.

Translating economic evaluations into financing strategies for implementing evidence-based practices

BACKGROUND

Implementation researchers are increasingly using economic evaluation to explore the benefits produced by implementing evidence-based practices (EBPs) in healthcare settings. However, the findings of typical economic evaluations (e.g., based on clinical trials) are rarely sufficient to inform decisions about how health service organizations and policymakers should finance investments in EBPs. This paper describes how economic evaluations can be translated into policy and practice through complementary research on financing strategies that support EBP implementation and sustainment.

MAIN BODY

We provide an overview of EBP implementation financing, which outlines key financing and health service delivery system stakeholders and their points of decision-making. We then illustrate how economic evaluations have informed decisions about EBP implementation and sustainment with three case examples: (1) use of Pay-for-Success financing to implement multisystemic therapy in underserved areas of Colorado, USA, based in part on the strength of evidence from economic evaluations; (2) an alternative payment model to sustain evidence-based oncology care, developed by the US Centers for Medicare and Medicaid Services through simulations of economic impact; and (3) use of a recently developed fiscal mapping process to collaboratively match financing strategies and needs during a pragmatic clinical trial for a newly adapted family support intervention for opioid use disorder.

CONCLUSIONS

EBP financing strategies can help overcome cost-related barriers to implementing and sustaining EBPs by translating economic evaluation results into policy and practice. We present a research agenda to advance understanding of financing strategies in five key areas raised by our case examples: (1) maximize the relevance of economic evaluations for real-world EBP implementation; (2) study ongoing changes in financing systems as part of economic evaluations; (3) identify the conditions under which a given financing strategy is most beneficial; (4) explore the use and impacts of financing strategies across pre-implementation, active implementation, and sustainment phases; and (5) advance research efforts through strong partnerships with stakeholder groups while attending to issues of power imbalance and transparency. Attention to these research areas will develop a robust body of scholarship around EBP financing strategies and, ultimately, enable greater public health impacts of EBPs.

Receipt of Behavioral Health Services Among US Children and Youth With Adverse Childhood Experiences or Mental Health Symptoms

Importance

Epidemiological literature on children's mental health and children's adverse childhood experiences (ACEs) have consistently pointed to widespread, unaddressed, and treatable high-risk conditions among children.

Objective

To estimate the proportion of children with either high levels of ACEs and/or high levels of mental health symptoms who were not receiving services from behavioral health professionals.

Design, Setting, and Participants

This cross-sectional study included 11 896 children who participated in 3 National Surveys of Children's Exposure to Violence (NatSCEV), which were nationally representative surveys conducted in 2008, 2011, and 2014. The surveys entailed telephone interviews with youth aged 10 to 17 years and caregivers of children aged 2 to 9 years. Data were analyzed from February to August 2020.

Main Outcomes and Measures

Nationally representative samples were obtained from a mix of random digit dial and address-based sampling methods. The primary outcome was the proportion of children with high ACEs, high distress symptoms, and both who were receiving clinical contact, broken down by demographic characteristics.

Results

Of the 11 896 children, 4045 (34.0%) participated in the 2008 NatSCEV; 4112 (34.6%) in the 2011 NatSCEV; and 3738 (31.4%) in the 2014 NatSCEV; 5532 (46.5%) were aged 2 to 9 years (2785 [50.4%] aged 2-5 years; 2693 [48.7%] girls; 3521 [63.7%] White children), and 6365 (53.5%) were aged 10 to 17 years (3612 [56.7%] aged 14-17 years; 3117 [49.0%] female participants; 4297 [67.5%] White individuals). Among participants aged 2 to 9 years, no clinical contact was reported for 57% (95% CI, 51%-62%) of the high ACE group, 53% (95% CI, 48%-58%) of the high distress symptom group, and 41% (95% CI, 32%-51%) of the group with high levels on both indicators. Among participants aged 10 to 17 years, the group with no clinical contact comprised 63% (95% CI, 56%-69%) of the high ACE group, 52% (95% CI, 46%-57%) of the high distress symptom group, and 62% (95% CI, 51%-71%) of youth scoring high on both indicators. Among racial groups, odds of contact were very low for Black children aged 2 to 9 years with high ACEs compared with non-Hispanic White children with the same age and exposure (odds ratio, 0.26; 95% CI, 0.14-0.49).

Conclusions and Relevance

In this cross-sectional study combining findings from 3 US national surveys, large portions of children at high risk because of adversity or mental health symptoms were not receiving clinical services. Better ways are needed to find these at-risk populations and help them obtain relevant intervention resources.

Debate: The greater the needs the lesser the evidence - therapeutic residential care for young people

In this debate article, we provide our thoughts and reflections on the issues and uses of Therapeutic Residential Care (TRC) in child welfare systems in the US and England. We highlight the issues associated with the lack of clarity of how TRC is defined and when and how it is used. The premise for the article is that some of our most vulnerable young people are living in residential homes without there being a sufficient evidence base to understand whether their needs are being adequately met, or the best outcomes are being achieved. We set out some suggested elements to try to progress debates and decisions that will ultimately improve the services and placements that are provided.

Implementing Coordinated Specialty Care for First Episode Psychosis: A Review of Barriers and Solutions

Specialized early interventions (SEI) for individuals diagnosed with a first episode of psychosis (FEP) are effective treatment modalities (Azrin et al. in Psychiatr Ann 45(11):548, https://doi.org/10.3928/00485713-20151103-05 , 2015). SEI offered immediately or shortly following a first episode improves functional and clinical outcomes for those individuals with, and at risk for, serious mental illness (SMI; Correll et al. in JAMA Psychiatry 75(6):555-565, https://doi.org/10.1001/jamapsychiatry.2018.0623 , 2018). In the United States, SEI programs referred to as Coordinated Specialty Care (CSC), have been utilized to provide a beneficial, team-based, multi-component method of treating FEP. However, despite the success, CSC programming is still met with considerable challenges. This article reviews existing CSC literature to identify and explore relevant barriers to successful implementation of CSC. Identified barriers include stigma, cultural competence, disengagement, measurement and evaluation, workforce development, implementation in rural areas, and financial stability. The ongoing efforts to address these barriers are described and areas for continued improvements are discussed.

Determinants of using children's mental health research in policymaking: variation by type of research use and phase of policy process

Background

Research use in policymaking is multi-faceted and has been the focus of extensive study. However, virtually no quantitative studies have examined whether the determinants of research use vary according to the type of research use or phase of policy process. Understanding such variation is important for selecting the targets of implementation strategies that aim to increase the frequency of research use in policymaking.

Methods

A web-based survey of US state agency officials involved with children’s mental health policymaking was conducted between December 2019 and February 2020 (n = 224, response rate = 33.7%, 49 states responding (98%), median respondents per state = 4). The dependent variables were composite scores of the frequency of using children’s mental health research in general, specific types of research use (i.e., conceptual, instrumental, tactical, imposed), and during different phases of the policy process (i.e., agenda setting, policy development, policy implementation). The independent variables were four composite scores of determinants of research use: agency leadership for research use, agency barriers to research use, research use skills, and dissemination barriers (e.g., lack of actionable messages/recommendations in research summaries, lack of interaction/collaboration with researchers). Separate multiple linear regression models estimated associations between determinant and frequency of research use scores.

Results

Determinants of research use varied significantly by type of research use and phase of policy process. For example, agency leadership for research use was the only determinant significantly associated with imposed research use (β = 0.31, p < 0.001). Skills for research use were the only determinant associated with tactical research use (β = 0.17, p = 0.03) and were only associated with research use in the agenda-setting phase (β = 0.16, p = 0.04). Dissemination barriers were the most universal determinants of research use, as they were significantly and inversely associated with frequency of conceptual (β = −0.21, p = 0.01) and instrumental (β = −0.22, p = 0.01) research use and during all three phases of policy process.

Conclusions

Decisions about the determinants to target with policy-focused implementation strategies—and the strategies that are selected to affect these targets—should reflect the specific types of research use that these strategies aim to influence.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01081-8.

Preventing Child and Adolescent Mental Illness - We Got This

Background:

International data indicates that up to 20% of the world’s children and adolescents have at least one mental health disorder. In the United States, nearly 50% of teenagers meet DSM criteria for a psychiatric disorder, and over 25% suffer from a “severe disorder.” Mental health and substance use disorders remain two of the greatest contributors to the global disease burden. Typically, mental health professionals are not trained for prevention; however, over the past 50 years, the field of psychiatry has identified many practices that prevent and limit the severity of psychiatric disorders.

Objective:

In this overview, we first address the great degree of cognitive, emotional, and behavioral suffering that children and adolescents face world-wide. We then describe how a health promotion/disease prevention model differs from typical mental health care. Finally, we describe a series of interventions at the individual, community, and societal levels that can be utilized to prevent and lessen the burden of mental illness.

Conclusion:

Given our enhanced understanding of the prevalence of mental illness, the degree to which it interferes with healthy functioning, and the enormous global burden it causes, now is the time to engage psychiatrists and psychologists in health promotion and disease prevention. The field of psychiatry should begin to focus on designing and implementing mental health promotion and disease prevention programs, akin to those described here, to combat the onset, development, and progression of mental illness.

Dissemination Strategies to Accelerate the Policy Impact of Children's Mental Health Services Research

The United States is in the midst of a children's mental health crisis, with rates of depression, anxiety, and suicide increasing precipitously. Evidence produced by children's mental health services research can help address this crisis by informing public policy decisions about service delivery, system design, and investments in the social determinants of mental health. Unfortunately, the policy impact of children's mental health services research is limited because evidence often fails to reach policy makers, be responsive to their needs, resonate with their worldview, or reflect the contexts in which they make decisions. Dissemination strategies-defined as the development and targeted distribution of messages and materials about research evidence pertaining to a specific issue or intervention-can help address these challenges. Yet, limited integrated guidance exists to inform the design of such strategies. This article addresses this need by synthesizing the results of empirical studies to provide guidance about how to enhance the dissemination of children's mental health services research to policy makers. The article provides four recommendations about the content of policy maker-focused dissemination materials, discusses how strategic framing and message tailoring can increase the chances that evidence is persuasive to policy makers, and highlights strategies to ensure that evidence reaches policy makers.

Implementing a transdiagnostic sleep and circadian intervention in a community mental health setting: A qualitative process evaluation with community stakeholders

The implementation of evidence-based psychological treatments (EBPTs) may be particularly challenging to accomplish in community mental health settings for individuals with severe mental illness (SMI). Transdiagnostic treatments, or treatments that target a mechanism that underpins multiple mental health problems, may be particularly well-suited to community mental health settings. This study examines community stakeholder perspectives (N = 22) of the Transdiagnostic Sleep and Circadian Intervention (TranS-C) implemented in a community mental health setting in the context of a randomized controlled trial of TranS-C for SMI. The present study aimed to identify barriers and facilitators to the implementation of TranS-C for SMI in a community mental health setting using (1) a deductive theory-based process based on the Framework for Dissemination in Health Services Intervention Research and (2) an inductive thematic analysis process. All deductive themes were identified as both barriers and facilitators to the implementation of EBPTs and TranS-C in this community mental health setting. Seven additional themes were identified through the inductive thematic analysis. A discussion of how the findings are related to prior research, other EBPT implementation, and future TranS-C implementation are included.

Exploring Similarities and Differences of Non-European Migrants among Forensic Patients with Schizophrenia

Migrants diagnosed with schizophrenia are overrepresented in forensic-psychiatric clinics. A comprehensive characterization of this offender subgroup remains to be conducted. The present exploratory study aims at closing this research gap. In a sample of 370 inpatients with schizophrenia spectrum disorders who were detained in a Swiss forensic-psychiatric clinic, 653 different variables were analyzed to identify possible differences between native Europeans and non-European migrants. The exploratory data analysis was conducted by means of supervised machine learning. In order to minimize the multiple testing problem, the detected group differences were cross-validated by applying six different machine learning algorithms on the data set. Subsequently, the variables identified as most influential were used for machine learning algorithm building and evaluation. The combination of two childhood-related factors and three therapy-related factors allowed to differentiate native Europeans and non-European migrants with an accuracy of 74.5% and a predictive power of AUC = 0.75 (area under the curve). The AUC could not be enhanced by any of the investigated criminal history factors or psychiatric history factors. Overall, it was found that the migrant subgroup was quite similar to the rest of offender patients with schizophrenia, which may help to reduce the stigmatization of migrants in forensic-psychiatric clinics. Some of the predictor variables identified may serve as starting points for studies aimed at developing crime prevention approaches in the community setting and risk management strategies tailored to subgroups of offenders with schizophrenia.

Advancing the pragmatic measurement of sustainment: a narrative review of measures

BACKGROUND

Sustainment, an outcome indicating an intervention continues to be implemented over time, has been comparatively less studied than other phases of the implementation process. This may be because of methodological difficulties, funding cycles, and minimal attention to theories and measurement of sustainment. This review synthesizes the literature on sustainment measures, evaluates the qualities of each measure, and highlights the strengths and gaps in existing sustainment measures. Results of the review will inform recommendations for the development of a pragmatic, valid, and reliable measure of sustainment.

METHODS

A narrative review of published sustainment outcome and sustainability measures (i.e., factors that influence sustainment) was conducted, including appraising measures in the Society of Implementation Research Collaboration (SIRC) instrument review project (IRP) and the Dissemination and Implementation Grid-Enabled Measures database initiative (GEM-D&I). The narrative review used a snowballing strategy by searching the reference sections of literature reviews and definitions of sustainability and sustainment. Measures used frequently and judged to be comprehensive and/or validated by a team of implementation scientists were extracted for analysis.

RESULTS

Eleven measures were evaluated. Three of the included measures were found in the SIRC-IRP, three in the GEM-D&I database, (one measure was in both databases) and six were identified in our additional searches. Thirteen constructs relating to sustainment were coded from selected measures. Measures covered a range of determinants for sustainment (i.e., construct of sustainability) as well as constructs of sustainment as an outcome. Strengths of the measures included, development by expert panels knowledgeable about particular interventions, fields or contexts, and utility in specific scenarios. A number of limitations were found in the measures analyzed including inadequate assessment of psychometric characteristics, being overly intervention or context specific, being lengthy and/or complex, and focusing on outer context factors.

CONCLUSION

There is a lack of pragmatic and psychometrically sound measures of sustainment that can be completed by implementation stakeholders within inner context settings (e.g., frontline providers, supervisors).

Competition Among Mental Health Organizations: Environmental Drivers and Strategic Responses

While mental health system reforms have sought to leverage competition in the private sector to improve service quality and costs, competition among mental health organizations is poorly understood. To inform future studies about the impact of policy and system reforms on mental health organizations and service delivery, this qualitative study explores (1) resources for which organizations compete most intensively, (2) drivers of competition, and (3) leaders’ strategic organizational responses. Semi-structured phone interviews were conducted with 15 organizational leaders (CEO’s, executive directors) representing about 22% of organizations in the regional mental health market. Interviews covered leaders’ perceptions about competition, and their strategic responses. Porter’s seminal framework on competition was used to interpret codes and themes. Intensive competition for personnel was driven by workforce shortages, new for-profit organizations, and alternative employment opportunities. In response, organizations have attended to wages/benefits, recruitment, and retention. However, strong community need, expanded insurance coverage, and a history of local strategic responses that created service niches appeared to have minimized competition for financial resources in the region. Competition for funding and clients was expected to intensify under systems reform, and in anticipation, organizations were expanding services. Leaders also feared for the viability of smaller organizations in highly competitive environments. Consistent with theory on competition, mental health organizations compete and respond in ways that might improve services. However, the goals of privatization may have been unrealized because of minimal competition for funding and clients, and intense competition may undermine quality.