Lessons From an Implementation Evaluation of a Real-World Multi-City Initiative to Address COVID-19 Vaccination Inequities

Background: The COVID-19 pandemic shed light on stark racial and ethnic inequities in access to care and accurate health information in the U.S. When COVID-19 vaccines became available, communities of color faced multiple barriers that contributed to low vaccine rates. To address this gap, the Equity-First Vaccination Initiative supported community organizations in five demonstration cities to plan and implement hyper-local strategies to increase COVID-19 vaccine access and uptake among communities of color.Purpose: To draw learnings from the experiences of the participating organizations, we applied a framework that integrated implementation science and health equity principles.Design and sample: In this commentary, we describe how we used this framework to guide qualitative interviews with community organizations, focusing on insights across five implementation elements (reach, design, implementation, adaptation, implementation outcomes).Conclusions: Learnings from this evaluation may help guide future implementation of similarly complex initiatives involving multiple organizations and sites to advance health equity during a public health crisis.

Narrative review: Revised Principles and Practice Recommendations for Adolescent Substance Use Treatment and Policy

OBJECTIVE

In 2014, the U.S. National Institute on Drug Abuse released the "Principles of Adolescent Substance Use Disorder Treatment," summarizing previously established evidence and outlining principles of effective assessment, treatment, and aftercare for substance use disorders (SUD). Winters et al. (2018) updated these principles to be developmentally appropriate for adolescents. This review builds on that formative work and recommends updated adolescent assessment, treatment, and aftercare principles and practices.

METHOD

The Cochrane, MEDLINE-PubMed, and PsychInfo databases were searched for relevant studies with new data about adolescent substance use services. This article updates the 13 original principles; condenses the 8 original modalities into 5 practices; and highlights implications for public policy approaches, future funding, and research.

RESULTS

Key recommendations from the principles include integrating care for co-occurring mental health disorders and SUDs, improving service accessibility including through the educational system, maintaining engagement, and addressing tension between agencies when collaborating with other youth service systems. Updates to the treatment practices include adoption of Screening, Brief Intervention and Referral to Treatment (SBIRT), investment in social programs and family involvement in treatment, expanding access to behavioral therapies and medications, increasing funding to harm reduction services, supporting reimbursement for continuing care services, and increasing investment in research.

CONCLUSION

These revised principles of adolescent assessment, treatment, and aftercare approaches and practices aim to establish guidance and evidence-based practices for treatment providers, while encouraging necessary support from policymakers and funding agencies to improve the standard of care for adolescent SUD services.

Stakeholder perspectives on a telemedicine referral and coordination model to expand medication treatment for opioid use disorder in rural primary care clinics

INTRODUCTION

Opioid overdose deaths are increasing rapidly in the United States. Medications for opioid use disorder (MOUD) are effective and can be delivered in primary care, but uptake has been limited in rural communities. Referral to and coordination with an external telemedicine (TM) vendor by rural primary care clinics for MOUD (TM-MOUD) may increase MOUD access for rural patients, but we know little about perspectives on this model among key stakeholders. As part of a TM-MOUD feasibility study, we explored TM-MOUD acceptability and feasibility among personnel and patients from seven rural primary care clinics and a TM-MOUD vendor.

METHODS

We conducted virtual interviews or focus groups with clinic administrators (n = 7 interviews), clinic primary care and behavioral health providers (8 groups, n = 30), other clinic staff (9 groups, n = 37), patients receiving MOUD (n = 16 interviews), TM-MOUD vendor staff (n = 4 interviews), and vendor-affiliated behavioral health and prescribing providers (n = 17 interviews). We asked about experiences with and acceptability of MOUD (primarily buprenorphine) and telemedicine (TM) and a TM-MOUD referral and coordination model. We conducted content analysis to identify themes and participants quantitatively rated acceptability of TM-MOUD elements on a 4-item scale.

RESULTS

Perceived benefits of vendor-based TM-MOUD included reduced logistical barriers, more privacy and less stigma, and access to services not available locally (e.g., counseling, pain management). Barriers included lack of internet or poor connectivity in patients' homes, limited communication and trust between TM-MOUD and clinic providers, and questions about the value to the clinic of TM-MOUD referral to external vendor. Acceptability ratings for TM-MOUD were generally high; they were lowest among frontline staff.

CONCLUSIONS

Rural primary care clinic personnel, TM-MOUD vendor personnel, and patients generally perceived referral from primary care to a TM-MOUD vendor to hold potential for increasing access to MOUD in rural communities. Increasing TM-MOUD uptake requires buy-in and understanding among staff of the TM-MOUD workflow, TM services offered, requirements for patients, advantages over clinic-based or TM services from clinic providers, and identification of appropriate patients. Poverty, along with patient hesitation to initiate treatment, creates substantial barriers to MOUD treatment generally; insufficient internet availability creates a substantial barrier to TM-MOUD.

A case study of pragmatic measure development of the Treatment Integrity for Elementary Settings self-report measure for teachers

Introduction

Due to usability, feasibility, and acceptability concerns, observational treatment fidelity measures are often challenging to deploy in schools. Teacher self-report fidelity measures with specific design features might address some of these barriers. This case study outlines a community-engaged, iterative process to adapt the observational Treatment Integrity for Elementary Settings (TIES-O) to a teacher self-report version designed to assess the use of practices to support children's social-emotional competencies in elementary classrooms.

Method

Cognitive walkthrough interviews were conducted with teachers to improve the usability of the teacher self-report measure, called the Treatment Integrity for Elementary Schools-Teacher Report (TIES-T). Qualitative content analysis was used to extract themes from the interviews and inform changes to the measure.

Results

Increasing clarity and interactive elements in the measure training were the dominant themes, but suggestions for the measure format and jargon were also suggested.

Conclusion

The suggested changes resulted in a brief measure, training, and feedback system designed to support the teacher's use of practices to support children's social-emotional competencies in elementary classrooms. Future research with the TIES-T will examine the score reliability and validity of the measure.

Pilot evaluation of the Fiscal Mapping Process for sustainable financing of evidence-based youth mental health treatments: A comparative case study analysis

Background

Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies. Supports are needed that can guide service agencies in accessing sustainable funding for EBTs. We conducted a pilot evaluation of the Fiscal Mapping Process, an Excel-based strategic planning tool that helps service agency leaders identify and coordinate financing strategies for their EBT programs.

Method

Pilot testing of the Fiscal Mapping Process was completed with 10 youth mental health service agencies over a 12-month period, using trauma-focused cognitive-behavioral therapy or parent-child interaction therapy programs. Service agency representatives received initial training and monthly coaching in using the tool. We used case study methods to synthesize all available data (surveys, focus groups, coaching notes, document review) and contrast agency experiences to identify key findings through explanation building.

Results

Key evaluation findings related to the process and outcomes of using the Fiscal Mapping Process, as well as contextual influences. Process evaluation findings helped clarify the primary use case for the tool and identified the importance-and challenges-of engaging external collaborators. Outcome evaluation findings documented the impacts of the Fiscal Mapping Process on agency-reported sustainment capacities (strategic planning, funding stability), which fully explained reported improvements in outcomes (extent and likelihood)-although these impacts were incremental. Findings on contextual factors documented the influence of environmental and organizational capacities on engagement with the tool and concerns about equitable impacts, but also the view that the process could usefully generalize to other EBTs.

Conclusions

Our pilot evaluation of the Fiscal Mapping Process was promising. In future work, we plan to integrate the tool into EBT implementation initiatives and test its impact on long-term sustainment outcomes across various EBTs, while increasing attention to equity considerations.

Comparing organization-focused and state-focused financing strategies on provider-level reach of a youth substance use treatment model: a mixed-method study

BACKGROUND

Financial barriers in substance use disorder service systems have limited the widespread adoption-i.e., provider-level reach-of evidence-based practices (EBPs) for youth substance use disorders. Reach is essential to maximizing the population-level impact of EBPs. One promising, but rarely studied, type of implementation strategy for overcoming barriers to EBP reach is financing strategies, which direct financial resources in various ways to support implementation. We evaluated financing strategies for the Adolescent Community Reinforcement Approach (A-CRA) EBP by comparing two US federal grant mechanisms, organization-focused and state-focused grants, on organization-level A-CRA reach outcomes.

METHOD

A-CRA implementation took place through organization-focused and state-focused grantee cohorts from 2006 to 2021. We used a quasi-experimental, mixed-method design to compare reach between treatment organizations funded by organization-focused versus state-focused grants (164 organizations, 35 states). Using administrative training records, we calculated reach as the per-organization proportion of trained individuals who received certification in A-CRA clinical delivery and/or supervision by the end of grant funding. We tested differences in certification rate by grant type using multivariable linear regression models that controlled for key covariates (e.g., time), and tested threats to internal validity from our quasi-experimental design through a series of sensitivity analyses. We also drew on interviews and surveys collected from the treatment organizations and (when relevant) interviews with state administrators to identify factors that influenced reach.

RESULTS

The overall certification rates were 27 percentage points lower in state-focused versus organization-focused grants (p = .01). Sensitivity analyses suggested these findings were not explained by confounding temporal trends nor by organizational or state characteristics. We did not identify significant quantitative moderators of reach outcomes, but qualitative findings suggested certain facilitating factors were more influential for organization-focused grants (e.g., strategic planning) and certain barrier factors were more impactful for state-focused grants (e.g., states finding it difficult to execute grant activities).

DISCUSSION

As the first published comparison of EBP reach outcomes between financing strategies, our findings can help guide state and federal policy related to financing strategies for implementing EBPs that reduce youth substance use. Future work should explore contextual conditions under which different financing strategies can support the widespread implementation of EBPs for substance use disorder treatment.

Perspectives on Financing Strategies for Evidence-Based Treatment Implementation in Youth Mental Health Systems

BACKGROUND

Evidence-based treatments (EBTs) are critical to effectively address mental health problems among children and adolescents, but costly for mental health service agencies to implement and sustain. Financing strategies help agencies overcome cost-related barriers by obtaining financial resources to support EBT implementation and/or sustainment.

AIMS

We sought to (i) understand how youth mental health system decision-makers involved with EBT implementation and sustainment view key features (e.g., relevance, feasibility) that inform financing strategy selection and (ii) compare service agency, funding agency, and intermediary representative perspectives.

METHOD

Two surveys were disseminated to 48 representatives across U.S. youth mental health service agencies, funding agencies, and intermediaries who were participating in a larger study of financing strategies. Quantitative and qualitative data were gathered on 23 financing strategies through quantitative ratings and open-ended responses. Data were analyzed using descriptive statistics and rapid content analysis.

RESULTS

The financing strategies rated as most relevant include braided funding streams, contracts for EBTs, credentialing/rostering providers, fee-for-service reimbursement (regular and increased), and grant funding. All other strategies were unfamiliar to 1/3 to 1/2 of participants. The six strategies were rated between somewhat and quite available, feasible, and effective for EBT sustainment. For sustaining different EBT components (e.g., delivery, materials), the mix of financing strategies was rated as somewhat adequate. Qualitative analysis revealed challenges with strategies being non-recurring or unavailable in representatives' regions. Ratings were largely similar across participant roles, though funding agency representatives were the most familiar with financing strategies.

DISCUSSION

Despite the breadth of innovative financing strategies, expert representatives within the youth mental health services ecosystem had limited knowledge of most options. Experts relied on strategies that were familiar but often did not adequately support EBT implementation or sustainment. These findings underscore more fundamental issues with under-resourced mental health systems in the U.S.; financing strategies can help agencies navigate EBT use but must be accompanied by larger-scale system reforms. Limitations include difficulties generalizing results due to using a small sample familiar with EBTs, high agreement as a potential function of snowball recruiting, and limited responses to the open-ended survey questions.

IMPLICATIONS FOR HEALTH CARE PROVISION AND USE

Although EBTs have been found to effectively address mental health problems in children and adolescents, available strategies for financing their implementation and sustainment in mental health systems are insufficient. This constraint prevents many children and adolescents from receiving high-quality services.

IMPLICATIONS FOR HEALTH POLICIES

Financing strategies alone cannot solve systematic issues that prevent youth mental health service agencies from providing EBTs. Policy changes may be required, such as increased financial investment from the U.S. government into mental health services to support basic infrastructure (e.g., facility operations, measuring outcomes).

IMPLICATIONS FOR FURTHER RESEARCH

Future work should examine expert perspectives on EBT financing strategies in different contexts (e.g., substance use services), gathering targeted feedback on financing strategies that are less well known, and exploring topics such as strategic planning, funding stability, and collaborative decision-making as they relate to EBT implementation and sustainment.

Bridging HCI and Implementation Science for Innovation Adoption and Public Health Impact

Human computer interaction (HCI) and implementation science (IS) each have been applied to improve the adoption and delivery of innovative health interventions, and the two fields have complementary goals, foci, and methods. While the IS community increasingly draws on methods from HCI, there are many unrealized opportunities for HCI to draw from IS and to catalyze bidirectional collaborations. This workshop will explore similarities and differences between fields, with a goal of articulating a research agenda at their intersection.

Comparing two federal financing strategies on penetration and sustainment of the adolescent community reinforcement approach for substance use disorders: protocol for a mixed-method study

BACKGROUND

Sustained, widespread availability of evidence-based practices (EBPs) is essential to address the public health and societal impacts of adolescent substance use disorders (SUD). There remains a particularly significant need to identify effective financing strategies, which secure and direct financial resources to support the costs associated with EBP implementation and sustainment. This protocol describes a new project comparing two types of U.S. federal grant mechanisms (i.e., a type of financing strategy), which supported the implementation of the Adolescent Community Reinforcement Approach (A-CRA) EBP for SUD, through either organization-focused or state-focused granting of funds. The Exploration-Preparation-Implementation-Sustainment (EPIS) framework will guide our study aims, hypotheses, and selection of measures.

METHOD

We will employ a longitudinal, mixed-method (i.e., web surveys, semi-structured interviews, document review, focus groups, administrative data), quasi-experimental design to compare the grant types' outcomes and examine theoretically informed mediators and moderators. Aim 1 will examine the proportion of eligible clinicians certified in A-CRA with adequate fidelity levels (i.e., penetration outcomes) at the end of grant funding. Aim 2 will examine the sustainment of A-CRA up to 5 years post-funding, using a 10-element composite measure of treatment delivery and supervision activities. We will integrate the new data collected from state-focused grant recipients (~85 organizations in 19 states) with previously collected data from organization-focused grant recipients (Hunter et al., Implement Sci 9:104, 2014) (82 organizations in 26 states) for analysis. We will also use sensitivity analyses to characterize the effects of observed and unobserved secular trends in our quasi-experimental design. Finally, aim 3 will use comparative case study methods (integrating diverse quantitative and qualitative measures) to identify and disseminate policy implications about the roles of state- and organization-focused federal grants in efforts to promote adolescent SUD EBP implementation and sustainment.

DISCUSSION

The proposed research will have direct, practical implications for behavioral health administrators, policymakers, implementation experts, and the public. It will offer new knowledge that can directly inform financing strategies to support large-scale, sustained EBP delivery in behavioral health-while advancing implementation science through the use of novel methods to study financing strategies and sustainment.

Coordination of sustainable financing for evidence-based youth mental health treatments: protocol for development and evaluation of the fiscal mapping process

BACKGROUND

Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health and economic impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies (hereafter, "service agencies"). Strategic planning tools are needed that can guide these service agencies in their coordination of sustainable funding for EBTs. This protocol describes a mixed-methods research project designed to (1) develop and (2) evaluate our novel fiscal mapping process that guides strategic planning efforts to finance the sustainment of EBTs in youth mental health services.

METHOD

Participants will be 48 expert stakeholder participants, including representatives from ten service agencies and their partners from funding agencies (various public and private sources) and intermediary organizations (which provide guidance and support on the delivery of specific EBTs). Aim 1 is to develop the fiscal mapping process: a multi-step, structured tool that guides service agencies in selecting the optimal combination of strategies for financing their EBT sustainment efforts. We will adapt the fiscal mapping process from an established intervention mapping process and will incorporate an existing compilation of 23 financing strategies. We will then engage participants in a modified Delphi exercise to achieve consensus on the fiscal mapping process steps and gather information that can inform the selection of strategies. Aim 2 is to evaluate preliminary impacts of the fiscal mapping process on service agencies' EBT sustainment capacities (i.e., structures and processes that support sustainment) and outcomes (e.g., intentions to sustain). The ten agencies will pilot test the fiscal mapping process. We will evaluate how the fiscal mapping process impacts EBT sustainment capacities and outcomes using a comparative case study approach, incorporating data from focus groups and document review. After pilot testing, the stakeholder participants will conceptualize the process and outcomes of fiscal mapping in a participatory modeling exercise to help inform future use and evaluation of the tool.

DISCUSSION

This project will generate the fiscal mapping process, which will facilitate the coordination of an array of financing strategies to sustain EBTs in community youth mental health services. This tool will promote the sustainment of youth-focused EBTs.

Enhancing Early Engagement (E3) in mental health services training for children's advocacy center's victim advocates: feasibility protocol for a randomized controlled trial

Background

Child maltreatment is a major public issue in the United States, yet most children affected by abuse or neglect never engage in evidence-based practices (EBP) for child mental health. Children’s Advocacy Centers (CACs’) are uniquely situated to serve as Family Navigators who connect children impacted by maltreatment to appropriate EBPs. In fact, the CAC position of Victim Advocate mirrors the Mental Health Family Navigator national initiative.

Methods

The feasibility study protocol is to develop, implement, and evaluate web-based and consultative training for Victim Advocates to enhance early engagement in services (E3 training). The interactive web-based training embeds key targets of knowledge and skills related to family engagement, trauma, and EBP services. Participating CACs were randomized to E3 webinar-based training, E3 webinar plus consultation, or delayed training. The project will test the E3 training’s impact on key mechanisms of change (e.g., knowledge, skills) to improve rates of screening, referral, and access to EBP services. The feasibility of implementing the training program and differential impact and costs by level of training will be examined.

Discussion

The overarching goal of this project is to test the feasibility of training that is readily implemented through CACs and examine the mechanisms for improving early engagement and, ultimately, child, and adolescent mental health outcomes. Results and cost findings will be used to plan a large-scale comprehensive, mixed-methods hybrid type II effectiveness-implementation and cost-effectiveness trial of family navigator E3 training. If outcomes are positive, considerable infrastructure exists to support the scale-up and sustainability of E3 training nationwide, by embedding the training in national CAC training protocols.

Trial registration

NCT04221633

Date and version identifier

March 25, 2021; Vers. 1.0 (original); September 11, 2021; Vers 2.0 (revision); October 29, 2021; Vers. 3.0 (revision)

Moving beyond Aim Three: a need for a transdisciplinary approach to build capacity for economic evaluations in implementation science

BACKGROUND

Understanding the costs and economic benefits of implementation has been identified by policymakers and researchers as critical to increase the uptake and sustainment of evidence-based practices, but this topic remains relatively understudied. Conducting team science with health economists has been proposed as a solution to increase economic evaluation in implementation science; however, these recommendations ignore the differences in goals and perspectives in these two fields. Our recent qualitative research identified that implementation researchers predominantly approach health economists to examine costs, whereas the majority of health economists expressed limited interest in conducting economic evaluations and a desire to be more integrated within implementation science initiatives. These interviews pointed to challenges in establishing fruitful partnerships when health economists are relegated to the "Third Aim" (i.e., lowest-priority research objective) in implementation science projects by their research partners.

DISCUSSION

In this debate paper, we argue that implementation researchers and health economists need to focus on team science research principles to expand capacity to address pressing research questions that cut across the two fields. Specifically, we use the four-phase model of transdisciplinary research to outline the goals and processes needed to build capacity in this area (Hall et al., Transl Behav Med 2:415-30, 2012). The first phase focuses on the development of transdisciplinary research teams, including identifying appropriate partners (e.g., considering policy or public health researchers in addition to health economists) and building trust. The conceptual phase focuses on strategies to consider when developing joint research questions and methodology across fields. In the implementation phase, we outline the effective processes for conducting research projects, such as team learning. Finally, in the translation phase, we highlight how a transdisciplinary approach between health economists and implementation researchers can impact real-world practice and policy. The importance of investigating the economic impact of evidence-based practice implementation is widely recognized, but efforts have been limited due to the challenges in conducting team science across disciplines. Training in team science can help advance transdisciplinary efforts, which has the potential to increase the rigor and impact of economic evaluations in implementation science while expanding the roles taken by health economists.

Value of family involvement in substance use disorder treatment: Aligning clinical and financing priorities

BACKGROUND

Family members' support (e.g., informational, tangible, emotional) has important and lasting impacts on individuals' recovery from substance use disorders (SUDs). Unfortunately, SUD services in the United States do not consistently incorporate patients' family members effectively. One barrier to family involvement in SUD services is the mechanisms through which SUD services in the United States are commonly financed.

METHOD

Using our recent experiences with developing a group intervention for support persons of patients with opioid use disorder, we illustrate how gaps in feasible financing models limit SUD service systems from effectively implementing and sustaining family services for individuals receiving SUD treatment.

DISCUSSION

Long-term availability of family-inclusive interventions will require collaboration with payors and health systems. We offer two sets of recommendations for funding family involvement in SUD services; one set of immediately implementable recommendations and other longer-term goals requiring structural changes in SUD service delivery and financing.

Practitioner use of and attitudes towards videoconferencing for the delivery of evidence-based telemental health interventions: A mixed methods study

The implementation of evidence-based psychosocial interventions using video-conference delivery (VCD) has the potential to increase accessibility to effective treatments, although its use remains limited and understudied. This study employed a mixed methods approach in surveying mental health practitioners about their attitudes regarding VCD of interventions that are considered evidence-based (i.e., have been shown to improve targeted outcomes in rigorous research). One hundred and eleven practitioners were sampled from several national and regional U.S. practice organizations and were administered quantitative surveys about their use of and attitudes towards VCD of evidence-based interventions (EBI). We examined the relationship between practitioner-level technology access, experience, and training with technology fluency and acceptability of using VCD. Quantitative results indicated the most frequently used adaptation for VCD was Tailoring and that practitioner education predicted attitudes towards EBIs. A subset (n = 20) of respondents were then purposively selected for qualitative interviews to further investigate accessibility, appropriateness, and feasibility of delivering EBIs via video conference. A conventional content analysis revealed that VCD was appropriate and acceptable for EBIs; however, many practitioners also described barriers related to feasibility of implementation. The results of this study have important implications for telemental health dissemination efforts which seek to extend services to populations not served well by traditional, in-person mental health services.

Translating economic evaluations into financing strategies for implementing evidence-based practices

BACKGROUND

Implementation researchers are increasingly using economic evaluation to explore the benefits produced by implementing evidence-based practices (EBPs) in healthcare settings. However, the findings of typical economic evaluations (e.g., based on clinical trials) are rarely sufficient to inform decisions about how health service organizations and policymakers should finance investments in EBPs. This paper describes how economic evaluations can be translated into policy and practice through complementary research on financing strategies that support EBP implementation and sustainment.

MAIN BODY

We provide an overview of EBP implementation financing, which outlines key financing and health service delivery system stakeholders and their points of decision-making. We then illustrate how economic evaluations have informed decisions about EBP implementation and sustainment with three case examples: (1) use of Pay-for-Success financing to implement multisystemic therapy in underserved areas of Colorado, USA, based in part on the strength of evidence from economic evaluations; (2) an alternative payment model to sustain evidence-based oncology care, developed by the US Centers for Medicare and Medicaid Services through simulations of economic impact; and (3) use of a recently developed fiscal mapping process to collaboratively match financing strategies and needs during a pragmatic clinical trial for a newly adapted family support intervention for opioid use disorder.

CONCLUSIONS

EBP financing strategies can help overcome cost-related barriers to implementing and sustaining EBPs by translating economic evaluation results into policy and practice. We present a research agenda to advance understanding of financing strategies in five key areas raised by our case examples: (1) maximize the relevance of economic evaluations for real-world EBP implementation; (2) study ongoing changes in financing systems as part of economic evaluations; (3) identify the conditions under which a given financing strategy is most beneficial; (4) explore the use and impacts of financing strategies across pre-implementation, active implementation, and sustainment phases; and (5) advance research efforts through strong partnerships with stakeholder groups while attending to issues of power imbalance and transparency. Attention to these research areas will develop a robust body of scholarship around EBP financing strategies and, ultimately, enable greater public health impacts of EBPs.

Long-term effects of multisystemic therapy for problem sexual behaviors: A 24.9-year follow-up to a randomized clinical trial

Objective: Although there is evidence that the positive impact of multisystemic therapy for problem sexual behaviors (MST-PSB) reaches as far as young adulthood, the longer-term effects of MST-PSB into midlife are unknown. The present study examined criminal and civil court outcomes for sexually offending youths who participated on average 24.9 years earlier in a clinical trial of MST-PSB (Borduin et al., Journal of Consulting and Clinical Psychology, 2009, 77, p. 26). Method: Participants were 48 individuals who were originally randomized to MST-PSB or usual community services (UCS) and were at high risk of continued criminality. Arrest, incarceration, and civil suit data were obtained in middle adulthood when participants averaged 39.4 years of age. Results: Intent-to-treat analyses showed that MST-PSB participants had 85% fewer sexual offenses and 70% fewer nonsexual offenses than did UCS participants. In addition, MST-PSB participants were sentenced to 46% fewer days of incarceration and had 62% fewer family-related civil suits. Moreover, the favorable effects of MST-PSB on participants' crimes and civil suits were mediated by improved peer and family relations during treatment. Conclusion: The current study represents the longest and most comprehensive follow-up to date of an MST-PSB clinical trial and demonstrates that the positive effects of an evidence-based youth treatment for sexual crimes can last well into adulthood. Implications of the findings for policymakers, service providers, and researchers are discussed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Is telemedicine the answer to rural expansion of medication treatment for opioid use disorder? Early experiences in the feasibility study phase of a National Drug Abuse Treatment Clinical Trials Network Trial

Telemedicine (TM) enabled by digital health technologies to provide medical services has been considered a key solution to increasing health care access in rural communities. With the immediate need for remote care due to the COVID-19 pandemic, many health care systems have rapidly incorporated digital technologies to support the delivery of remote care options, including medication treatment for individuals with opioid use disorder (OUD). In responding to the opioid crisis and the COVID-19 pandemic, public health officials and scientific communities strongly support and advocate for greater use of TM-based medication treatment for opioid use disorder (MOUD) to improve access to care and have suggested that broad use of TM during the pandemic should be sustained. Nevertheless, research on the implementation and effectiveness of TM-based MOUD has been limited. To address this knowledge gap, the National Drug Abuse Treatment Clinical Trials Network (CTN) funded (via the NIH HEAL Initiative) a study on Rural Expansion of Medication Treatment for Opioid Use Disorder (Rural MOUD; CTN-0102) to investigate the implementation and effectiveness of adding TM-based MOUD to rural primary care for expanding access to MOUD. In preparation for this large-scale, randomized controlled trial incorporating TM in rural primary care, a feasibility study is being conducted to develop and pilot test implementation procedures. In this commentary, we share some of our experiences, which include several challenges, during the initial two-month period of the feasibility study phase. While these challenges could be due, at least in part, to adjusting to the COVID-19 pandemic and new workflows to accommodate the study, they are notable and could have a substantial impact on the larger, planned pragmatic trial and on TM-based MOUD more broadly. Challenges include low rates of identification of risk for OUD from screening, low rates of referral to TM, digital device and internet access issues, workflow and capacity barriers, and insurance coverage. These challenges also highlight the lack of empirical guidance for best TM practice and quality remote care models. With TM expanding rapidly, understanding implementation and demonstrating what TM approaches are effective are critical for ensuring the best care for persons with OUD.

Design of CLARO (Collaboration Leading to Addiction Treatment and Recovery from other Stresses): A randomized trial of collaborative care for opioid use disorder and co-occurring depression and/or posttraumatic stress disorder

INTRODUCTION

Opioid use disorder (OUD) co-occurring with depression and/or posttraumatic stress disorder (PTSD) is common and, if untreated, may lead to devastating consequences. Despite the availability of evidence-based treatments for these disorders, receipt of treatment is low. Even when treatment is provided, quality is variable. Primary care is an important and underutilized setting for treating co-occurring disorders (COD) because OUD, depression and PTSD are frequently co-morbid with medical conditions and most people visit a primary care provider at least once a year. With rising rates of OUD and opioid-related fatalities, this is a critical treatment and quality gap in a vulnerable and stigmatized population.

METHODS

CLARO (Collaboration Leading to Addiction Treatment and Recovery from Other Stresses) is a multi-site, randomized pragmatic trial of collaborative care (CC) for co-occurring disorders in 13 rural and urban primary care clinics in New Mexico to improve care for patients with OUD and co-occurring depression and/or PTSD. CC, a service delivery approach that uses multi-faceted interventions, has not been tested with COD. We will enroll and randomize 900 patients to either CC adapted for COD (CC-COD) or enhanced usual care (EUC) and will collect patient data at baseline, 3-, and 6-month follow-up. Our primary outcomes are medications for OUD (MOUD) access, MOUD continuity of care, depression symptoms, and PTSD symptoms.

DISCUSSION

Although CC is effective for improving outcomes in primary care among patients with mental health conditions, it has not been tested for COD. This article describes the CLARO CC-COD intervention and clinical trial.

Incorporating telehealth into health service psychology training: A mixed-method study of student perspectives

OBJECTIVE

Telehealth is increasingly recognized as an avenue for enhancing psychologists' capacities to meet the mental health needs of a diverse and underserved (due to barriers e.g., distance, transportation) public. The present study sought to inform training in telepsychology (i.e., telehealth delivery of psychological services) by using both quantitative and qualitative methods to explore the perspectives of doctoral students who have already been involved in such training.

METHOD

A total of 19 predoctoral students from two universities, with at least some experience in telepsychology training, provided their perspectives on two complementary research questions: (1) How do students perceive their level of competence in various domains of telepsychology?; and (2) What are students' perspectives on the process of telepsychology competency development during their doctoral training?

RESULTS

The results of our study provide early evidence that doctoral trainees are able to develop telepsychology competencies and suggest that a supportive, training-oriented environment and fit between telepsychology and existing programmatic areas of emphasis are likely key to success.

CONCLUSIONS

Continued efforts to enhance training in providing telepsychology services should focus on how to best define, measure, and promote competency development in this emerging specialty area.

Collaborating with health economists to advance implementation science: a qualitative study

Background

Implementation research infrequently addresses economic factors, despite the importance of understanding the costs of implementing evidence-based practices (EBPs). Though partnerships with health economists have the potential to increase attention to economic factors within implementation science, barriers to forming these collaborations have been noted. This study investigated the experiences of health economists and implementation researchers who have partnered across disciplines to inform strategies to increase such collaborations.

Methods

A purposeful sampling approach was used to identify eight health economists and eight implementation researchers with experience participating in cross-disciplinary research. We used semi-structured interviews to gather information about participants' experiences with collaborative research. Thematic analysis was conducted to identify core themes related to facilitators and barriers to collaborations.

Results

Health economists and implementation researchers voiced different perspectives on collaborative research, highlighting the importance of increasing cross-disciplinary understanding. Implementation researchers described a need to measure costs in implementation studies, whereas many health economists described that they seek to collaborate on projects that extend beyond conducting cost analyses. Researchers in both disciplines articulated motivations for collaborative research and identified strategies that promote successful collaboration, with varying degrees of convergence across these themes. Shared motivations included improving methodological rigor of research and making a real-world impact. Strategies to improve collaboration included starting partnerships early in the study design period, having a shared interest, and including health economists in the larger scope of the research.

Conclusions

Health economists and implementation researchers both conduct research with significant policy implications and have the potential to inform one another's work in ways that might more rapidly advance the uptake of EBPs. Collaborative research between health economists and implementation science has the potential to advance the field; however, researchers will need to work to bridge disciplinary differences. By beginning to develop strong working relationships; increasing their understanding of one another's disciplinary culture, methodology, and language; and increasing the role economists have within research design and execution, both implementation researchers and health economists can support successful collaborations and robust and informative research.

Estimating Downstream Budget Impacts in Implementation Research

Health care decision makers often request information showing how a new treatment or intervention will affect their budget (i.e., a budget impact analysis; BIA). In this article, we present key topics for considering how to measure downstream health care costs, a key component of the BIA, when implementing an evidence-based program designed to reduce a quality gap. Tracking health care utilization can be done with administrative or self-reported data, but estimating costs for these utilization data raises 2 issues that are often overlooked in implementation science. The first issue has to do with applicability: are the cost estimates applicable to the health care system that is implementing the quality improvement program? We often use national cost estimates or average payments, without considering whether these cost estimates are appropriate. Second, we need to determine the decision maker's time horizon to identify the costs that vary in that time horizon. If the BIA takes a short-term time horizon, then we should focus on costs that vary in the short run and exclude costs that are fixed over this time. BIA is an increasingly popular tool for health care decision makers interested in understanding the financial effect of implementing an evidence-based program. Without careful consideration of some key conceptual issues, we run the risk of misleading decision makers when presenting results from implementation studies.

Sustaining Treatment for Youth with Problematic Sexual Behavior: Administrator and Stakeholder Perspectives Following Implementation

This study examines administrator and stakeholder perspectives on factors influencing the sustainability of Problematic Sexual Behavior Cognitive Behavioral Therapy (PSB-CBT). After initial implementation of PSB-CBT, qualitative interviews (N = 42) on the sustainability of services were conducted with treatment program administrators (n = 10) and community stakeholders (n = 32) from six sites across the USA. Interviewees discussed key facilitators and barriers for sustainability and identified the following factors as impacting the sustainability of PSB-CBT: public relations, policy, inter-agency collaboration, funding, and workforce issues. Results were overall consistent with the EPIS (Exploration, Preparation, Implementation, Sustainment) model for implementation in public service sectors, but proposed modifications are also noted. Findings underscore the value of qualitative research in identifying best practices for sustaining valuable therapeutic interventions. The authors argue that future efforts to sustain evidence-based interventions, especially those dealing with sensitive topics around which misinformation and stigma are associated, should prioritize public relations (i.e., outreach, education) in addition to the intervention.

Designing the Future of Children's Mental Health Services

Advancements in evidence-based psychosocial interventions, digital technologies, and implementation strategies (i.e., health services research products) for youth mental health services have yet to yield significant improvement in public health outcomes. Achieving such impact will require that these research products are easy to use, useful, and contextually appropriate. This paper describes how human-centered design (HCD), an approach that aligns product development with the needs of the people and settings that use those products, can be leveraged to improve youth mental health services. We articulate how HCD can advance accessibility, effectiveness, and equity, with specific consideration of unique aspects of youth mental health services.

A scoping review of strategies for financing the implementation of evidence-based practices in behavioral health systems: State of the literature and future directions

Background:

Increased availability of evidence-based practices (EBPs) is essential to alleviating the negative public health and societal effects of behavioral health problems. A major challenge to implementing and sustaining EBPs broadly is the limited and fragmented nature of available funding.

Method:

We conducted a scoping review that assessed the current state of evidence on EBP financing strategies for behavioral health based on recent literature (i.e., post-Affordable Care Act). We defined financing strategies as techniques that secure and direct financial resources to support EBP implementation. This article introduces a conceptualization of financing strategies and then presents a compilation of identified strategies, following established reporting guidelines for the implementation strategies. We also describe the reported level of use for each financing strategy in the research literature.

Results:

Of 23 financing strategies, 13 were reported as being used within behavioral health services, 4 had potential for use, 5 had conceptual use only, and 1 was potentially contraindicated. Examples of strategies reported being used include increased fee-for-service reimbursement, grants, cost sharing, and pay-for-success contracts. No strategies had been evaluated in ways that allowed for strong conclusions about their impact on EBP implementation outcomes.

Conclusion:

The existing literature on EBP financing strategies in behavioral health raises far more questions than answers. Therefore, we propose a research agenda that will help better understand these financing strategies. We also discuss the implications of our findings for behavioral health professionals, system leaders, and policymakers who want to develop robust, sustainable financing for EBP implementation in behavioral health systems.

Plain language abstract:

Organizations that treat behavioral health problems (mental health and substance use) often seek to adopt and use evidence-based practices (EBPs). A challenge to adopting EBPs broadly is the limited funding available, often from various sources that are poorly coordinated with one another. To help organizations plan effectively to adopt EBPs, we conducted a review of recent evidence (i.e., since the passage of the 2010 Affordable Care Act) on strategies for financing EBP adoption in behavioral health systems. We present definitions of 23 identified strategies and describe each strategy’s reported (in the research literature) level of use to fund EBP adoption in behavioral health services. Of the 23 financing strategies, 13 strategies had evidence of use, 4 had potential for use, 5 had conceptual use only, and 1 was potentially contraindicated. Examples of strategies with evidence of use include increased fee-for-service reimbursement, grants, cost sharing, and pay-for-success contracts. This comprehensive list of EBP financing strategies may help guide decision-making by behavioral health professionals, system leaders, and policymakers. The article also presents a research agenda for building on the current research literature by (1) advancing methods to evaluate financing strategies’ effects, (2) partnering with stakeholders and decision-makers to examine promising financing strategies, (3) focusing on strategies and service systems with the greatest needs, (4) improving methods to guide the selection of financing strategies, and (5) paying greater attention to sustainable long-term financing of EBPs.

A glossary of user-centered design strategies for implementation experts

User-centered design (UCD), a discipline that seeks to ground the design of an innovation in information about the people who will ultimately use that innovation, has great potential to improve the translation of evidence-based practices from behavioral medicine research for implementation in health care settings. UCD is a diverse, innovative field that remains highly variable in terms of language and approaches. Ultimately, we produced a glossary of UCD-related strategies specifically for experts in implementation research and practice, with the goal of promoting interdisciplinary collaboration in implementation efforts. We conducted a focused literature review to identify key concepts and specific strategies of UCD to translate into the implementation field. We also categorized the strategies as primarily targeting one or more levels of the implementation process (i.e., interventions, individuals, inner context, and outer context). Ultimately, we produced a glossary of 30 UCD strategies for implementation experts. Each glossary term is accompanied by a short, yet comprehensive, definition. The strategies and their definitions are illustrated, using a hypothetical behavioral medicine intervention as an example, for each of the four levels of the implementation process. This UCD glossary may prove useful to implementation experts who wish to develop effective collaborations and "shared language" with UCD experts to enhance use of behavioral medicine research in health services. Directions for future research are also discussed.

The Potential of Pay-for-Success as a Financing Strategy for Evidence-Based Practices: An Illustration with Multisystemic Therapy

There is a critical need to identify strategies for financing the implementation of evidence-based practices. We illustrate the potential of pay-for-success financing (PFS)-a strategy in which private investors fund implementation and receive a return on investment from a government payer-using multisystemic therapy as an example. We argue that standard multisystemic therapy (for serious juvenile offenders) and several of its adaptations (for other complex behavioral problems in youth) would be good candidates for PFS in the right contexts. Despite some challenges for policymakers and administrators, PFS has significant potential as a financing strategy for evidence-based practices.

Economic value of community-based services for problematic sexual behaviors in youth: A mixed-method cost-effectiveness analysis

BACKGROUND

Problematic sexual behavior in youth represents a significant public health problem in need of evidence-based treatments. Unfortunately, such treatments are not available in most communities.

OBJECTIVE

This study used a mixed quantitative-qualitative approach to investigate the economics of the implementation of Problematic Sexual Behavior - Cognitive-Behavioral Therapy (PSB-CBT), an evidence-based treatment for problem sexual behaviors in youth.

PARTICIPANTS AND SETTING

Youth (N = 413) participated in PSB-CBT at six program sites in youth service agencies across the United States.

METHOD

We used cost-effectiveness ratios (CERs) to compare the direct and indirect costs of PSB-CBT to self- and caregiver-reported youth clinical outcomes (i.e., problem sexual behavior as well as secondary behavioral health problems). CERs represented the cost of achieving one standard unit of change on a measure (i.e., d = 1.0). The design and interpretation of those quantitative analyses were informed by qualitative themes about program costs and benefits that were derived from interviews with 59 therapists, administrators, and stakeholders.

RESULTS

CERs (i.e., $ per SD) were $1,772 per youth for problem sexual behavior and ranged from $2,867 to $4,899 per youth for secondary outcomes. These quantitative results, considered alongside the qualitative perspectives of interviewees, suggested that the implementation of PSB-CBT was cost-effective. The results were robust to uncertainty in key parameters under most, but not all, conditions.

CONCLUSIONS

The results have important implications for decisions made by administrators, policymakers, and therapists regarding use of community-based approaches to address problematic sexual behavior of youth.

Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study

BACKGROUND

Innovative approaches are needed to maximize fit between the characteristics of evidence-based practices (EBPs), implementation strategies that support EBP use, and contexts in which EBPs are implemented. Standard approaches to implementation offer few ways to address such issues of fit. We characterized the potential for collaboration with experts from a relevant complementary approach, user-centered design (UCD), to increase successful implementation.

METHOD

Using purposive and snowball sampling, we recruited 56 experts in implementation (n = 34) or UCD (n = 22). Participants had 5+ years of professional experience (M = 10.31), worked across many settings (e.g., healthcare, education, human services), and were mostly female (59%) and white (73%). Each participant completed a web-based concept mapping structured conceptualization task. They sorted strategies from established compilations for implementation (36 strategies) and UCD (30 strategies) into distinct clusters, then rated the importance and feasibility of each strategy.

RESULTS

We used multidimensional scaling techniques to examine patterns in the sorting of strategies. Based on conceptual clarity and fit with established implementation frameworks, we selected a final set of 10 clusters (i.e., groups of strategies), with five implementation-only clusters, two UCD-only clusters, and three trans-discipline clusters. The highest-priority activities (i.e., above-average importance and feasibility) were the trans-discipline clusters plus facilitate change and monitor change. Implementation and UCD experts sorted strategies into similar clusters, but each gave higher importance and feasibility ratings to strategies/clusters from their own discipline.

CONCLUSIONS

In this concept mapping study, experts in implementation and UCD had perspectives that both converged (e.g., trans-discipline clusters, which were all rated as high-priority) and diverged (e.g., in importance/feasibility ratings). The results provide a shared understanding of the alignment between implementation science and UCD, which can increase the impact and sustainability of EBP implementation efforts. Implications for improved collaboration among implementation and UCD experts are discussed.

Economic evaluation in implementation science: Making the business case for implementation strategies

Implementation researchers have made notable progress in developing and testing implementation strategies (i.e., highly-specified methods used to help providers improve uptake of mental health evidence-based practices: EBPs). Yet, implementation strategies are not widely applied in healthcare organizations to improve delivery of EBPs. Economic considerations are a key factor influencing the use of implementation strategies to deliver and sustain mental health evidence-based practices, in part because many health care leaders are reluctant to invest in ongoing implementation strategy support without knowing the return-on-investment. Comparative economic evaluation of implementation strategies provides critical information for payers, policymakers, and providers to make informed decisions if specific strategies are an efficient use of scarce organizational resources. Currently, few implementation studies include implementation cost data and even fewer conduct comparative economic analyses of implementation strategies. This summary will introduce clinicians, researchers and other health professionals to the economic evaluation in implementation science. We provide an overview of different economic evaluation methods, discuss differences between economic evaluation in health services and implementation science. We also highlight approaches and frameworks to guide economic evaluation of implementation, provide an example for a cognitive-behavioral therapy program and discuss recommendations.

The social ecology of aggression in youths with autism spectrum disorder

This study examined the social-ecological correlates of aggressive behavior in 120 youths with autism spectrum disorder. Youths were divided into three groups based on caregiver reports of the youth's aggressive acts: youths who engaged in acts of both physical and verbal aggression, youths who engaged only in acts of physical aggression, and nonaggressive youths. Caregivers and youths completed self-report instruments and behavior rating inventories that assessed youth individual functioning, family relations, and extrafamilial factors (i.e., peer relations, academic performance). Results showed that youths who engaged in both verbal and physical aggression were characterized by poor sleep quality and victimization by peers, and their caregivers evidenced high levels of distress and avoidant coping. In contrast, youths who were physically but not verbally aggressive were distinguished by difficulties in social interaction and communication. In general, each group of youths who were aggressive experienced more problems with repetitive behaviors, family relations, and academic performance than did their nonaggressive counterparts. The implications of these findings for theory, research, and treatment are discussed. Autism Res 2019. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: The present study demonstrated that youths with autism spectrum disorder may be classified by the types of aggressive behaviors that they exhibit: youths who are verbally and physically aggressive, physically aggressive only, or not aggressive. Compared to the nonaggressive group, both groups of youths who were aggressive experienced difficulties in their individual, family, peer, and academic functioning. Youths with both verbal and physical aggression showed the most problems in their functioning.

Mixed-method approaches to strengthen economic evaluations in implementation research

BACKGROUND

Guidance from economic evaluations on which implementation strategies represent the best return on investment will be critical to advancing the Triple Aim of health care: improving patient care and population health while minimizing per-capita cost. The results of traditional (quantitative) economic evaluations are limited by a remaining "qualitative residual" of contextual information and stakeholders perspectives, which cannot be captured by monetary values alone and is particularly prevalent in implementation science research. The emergence of qualitative methods for economic evaluation offers a promising solution.

MAIN BODY

To maximize the contributions of economic evaluations to implementation science, we recommend that researchers embrace a mixed-methods research agenda that merges traditional quantitative approaches with innovative, contextually grounded qualitative methods. Such studies are exceedingly rare at present. To assist implementation scientists in making use of mixed methods in this research context, we present an adapted taxonomy of mixed-method studies relevant to economic evaluation. We then illustrate the application of mixed methods in a recently completed cost-effectiveness evaluation, making use of an adapted version of reporting standards for economic evaluations.

CONCLUSIONS

By incorporating qualitative methods, implementation researchers can enrich their economic evaluations with detailed, context-specific information that tells the full story of the costs and impacts of implementation. We end by providing suggestions for building a research agenda in mixed-method economic evaluation, along with more resources and training to support investigators who wish to answer our call to action.

Integrating implementation and user-centred design strategies to enhance the impact of health services: protocol from a concept mapping study

BACKGROUND

Innovative approaches are needed to maximise the uptake and sustainment of evidence-based practices in a variety of health service contexts. This protocol describes a study that will seek to characterise the potential of one such approach, user-centred design (UCD), which is an emerging field that seeks to ground the design of an innovation in information about the people who will ultimately use that innovation. The use of UCD to enhance strategies for implementation of health services, although promising, requires a multidisciplinary perspective based on a firm understanding of how experts from each discipline perceives the interrelatedness and suitability of these strategies.

METHOD

This online study will use a combination of purposive and snowball sampling to recruit a sample of implementation experts (n = 30) and UCD experts (n = 30). These participants will each complete a concept mapping task, which is a mixed-method conceptualisation technique that will allow for identification of distinct clusters of implementation and/or UCD strategies. The research team has selected a set of implementation strategies and UCD strategies that each participant will sort and rate on dimensions of importance and feasibility. Data analyses will focus on describing the sample, identifying related clusters of strategies, and examining the convergences, divergences, and potential for collaboration between implementation science and UCD.

DISCUSSION

By leading to a better understanding of the overlap between implementation science and UCD, grounded within established theoretical frameworks, this study holds promise for improving the impact and sustainability of evidence-based health services in community settings.

Telemental health training and delivery in primary care: A case report of interdisciplinary treatment

Telehealth can overcome access and availability barriers that often impede receiving needed mental health services. This case report describes an interdisciplinary approach to treatment for an individual with chronic physical health conditions and comorbid mental health concerns, which resulted in high utilization (and associated costs) of preventable emergency services. The report describes clinical case progression on anxiety symptoms and emergency service utilization while concurrently highlighting telehealth-specific practice implications, especially as they pertain to training settings.

Economic Impact of Multisystemic Therapy for Child Abuse and Neglect

This study evaluated the economics of Multisystemic Therapy for Child Abuse and Neglect (MST-CAN) by applying the Washington State Institute for Public Policy (WSIPP) cost-benefit model to data from a randomized effectiveness trial with 86 families (Swenson et al. in JFP 24:497-507, 2010b). The net benefit of MST-CAN, versus enhanced outpatient treatment, was $26,655 per family at 16 months post-baseline. Stated differently, every dollar spent on MST-CAN recovered $3.31 in savings to participants, taxpayers, and society at large. Policymakers and public service agencies should consider these findings when making investments into interventions for high-need families involved with child protective services.

Economic Impact of the Statewide Implementation of an Evidence-Based Treatment: Multisystemic Therapy in New Mexico

Several states have made considerable investments into large-scale implementation of evidence-based treatments (EBTs), yet little is known about key success indicators for these implementation efforts such as cost and sustainability. To that end, the present study examined the economic impact of statewide implementation of multisystemic therapy (MST; Henggeler, Schoenwald, Borduin, Rowland, & Cuningham, 2009), a family- and community-based behavioral EBT for serious juvenile offenders in New Mexico. Participants were 1,869 youth who received MST across 23 teams during the study period. We conducted a cost-benefit analysis using metrics from state data sources that compared the cost of MST to its benefits (i.e., avoided expenses from pre- to posttreatment) in two domains: (a) behavioral health services (i.e., Medicaid claims) and (b) juvenile crime (i.e., taxpayer expenses, tangible and intangible expenses to crime victims). MST costs were based on Medicaid claims, which were reimbursed at an enhanced billing rate that was intended to cover expenses for both clinical and implementation (e.g., training, quality assurance) activities. Results suggest that implementation of MST in New Mexico over the 7-year study period may have produced net benefits, through 2 years posttreatment, of more than $4,643 per youth in avoided behavioral health claims and $15,019 per youth through reductions in juvenile crime. Stated differently, every dollar that New Mexico spent on MST appeared to have returned $3.34 for a total benefit of $64.2 million over the course of the study. We discuss implications of these findings for policymakers, administrators, and researchers who are interested in increasing the sustainability of complex EBTs in community settings.

Community-based implementation of trauma-focused interventions for youth: Economic impact of the learning collaborative model

This study investigated the economics of the learning collaborative (LC) model in the implementation of Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT), an evidence-based intervention for traumatic stress in youth. We evaluated the cost-effectiveness of the LC model based on data from 13 LCs completed in the southeastern United States. Specifically, we calculated cost-effectiveness ratios (CERs) for 2 key service outcomes: (a) clinician TF-CBT competence, based on pre- and post-LC self-ratings (n = 574); and (b) trauma-related mental health symptoms (i.e., traumatic stress and depression), self- and caregiver-reported, for youth who received TF-CBT (n = 1,410). CERs represented the cost of achieving 1 standard unit of change on a measure (i.e., d = 1.0). The results indicated that (a) costs of $18,679 per clinician were associated with each unit increase in TF-CBT competency and (b) costs from $5,318 to $6,548 per youth were associated with each unit decrease in mental health symptoms. Thus, although the impact of LC participation on clinician competence did not produce a favorable CER, subsequent reductions in youth psychopathology demonstrated high cost-effectiveness. Clinicians and administrators in community provider agencies should consider these findings in their decisions about implementation of evidence-based interventions for youth with traumatic stress disorders. (PsycINFO Database Record

Effects of multisystemic therapy on caregivers of serious juvenile offenders: A 20-year follow-up to a randomized clinical trial

OBJECTIVE

Caregivers of serious juvenile offenders often hold favorable attitudes about criminality and frequently have histories of involvement in antisocial behaviors themselves. In the present study, the authors examined the long-term criminal and noncriminal outcomes for caregivers of serious juvenile offenders who had participated two decades earlier in a randomized clinical trial of multisystemic therapy (MST; Borduin et al., 1995).

METHOD

Participants were 276 caregivers of serious juvenile offenders who were originally randomized to MST or individual therapy (IT). Criminal and civil suit data for caregivers were obtained during a 20.7-year follow-up when caregivers were on average 61.5 years old.

RESULTS

Caregivers in the MST condition had 94% fewer felonies and 70% fewer misdemeanors than did caregivers in the IT condition. In addition, caregivers in the IT condition were sentenced to 92% more days of incarceration and had 50% more family-related civil suits. Moreover, the favorable long-term effects of MST on caregiver criminality and civil suits were mediated by improved family relations during treatment.

CONCLUSION

The present study represents the only follow-up to date of caregivers in an MST clinical trial and demonstrates the broader clinical benefits of a family-based treatment for serious juvenile offenders. Implications of the findings for policymakers and researchers are discussed. (PsycINFO Database Record

Evidence-Based Treatments for Youths Who Engage in Illegal Sexual Behaviors

Effective treatments for youths who have engaged in illegal sexual behaviors are needed to reduce the societal impact of sexual crimes. This article reviews the state of the evidence base for treatments that target this clinical population. We conducted a comprehensive literature review to identify studies that evaluated outcomes of treatments for youths who have engaged in illegal sexual behaviors. Based on the results of our review, we characterized each treatment using established criteria for five evidence-based treatment classifications. We identified 10 treatment studies that met inclusion criteria. We classified one treatment-multisystemic therapy for problem sexual behaviors-as Probably Efficacious (Level 2), and two treatments-cognitive-behavioral therapy and behavior management through adventure-as Experimental (Level 4). Cognitive-behavioral therapy has limited research support with youths who have engaged in illegal sexual behaviors, but it is widely used in the United States and Canada. In contrast, multisystemic therapy for problem sexual behaviors had the highest level of research support but is used much less extensively with this population. We discuss implications of the present findings for treatment providers, policymakers, and researchers who seek to improve clinical services in this area.

Economic impact of multisystemic therapy with juvenile sexual offenders

This study investigated the economics of multisystemic therapy for problem sexual behaviors (MST-PSB), a family-based treatment that has shown promise with juvenile sexual offenders. We evaluated the cost and benefits of MST-PSB versus usual community services using arrest data obtained in an 8.9-year follow-up from a randomized clinical trial with 48 juvenile sexual offenders, who averaged 22.9 years of age at follow-up (Borduin, Schaeffer, & Heiblum, 2009). The net benefit of MST-PSB over usual community services was calculated in terms of (a) the value to taxpayers, which was based on measures of criminal justice system expenses (e.g., police and sheriff's offices, court processing, community supervision); and (b) the value to crime victims, which was based on measures of both tangible (e.g., property damage and loss, health care, lost productivity) and intangible (e.g., pain, suffering, reduced quality of life) losses. Lower rates of posttreatment arrests in the MST-PSB versus usual community services conditions were associated with lasting reductions in expenses for both taxpayers and crime victims, with an estimated total benefit of $343,455 per MST-PSB participant. Stated differently, every dollar spent on MST-PSB recovered $48.81 in savings to taxpayers and crime victims over the 8.9-year follow-up. These findings demonstrate that a family-based treatment such as MST-PSB can produce lasting economic benefits with juvenile sexual offenders. Policymakers and public service agencies should consider these findings when making decisions about interventions for this challenging clinical population.

The economic impact of multisystemic therapy through midlife: a cost-benefit analysis with serious juvenile offenders and their siblings

OBJECTIVE

This study investigated the economic benefits of multisystemic therapy (MST) versus individual therapy (IT) using arrest data from 176 serious juvenile offenders and 129 of their closest-in-age siblings who participated, on average, 25 years earlier in a randomized clinical trial (Borduin et al., 1995).

METHOD

Two types of benefits of MST were evaluated: (a) The value to taxpayers was derived from measures of criminal justice system expenses (e.g., police and sheriffs' offices, court processing, community supervision), and (b) the value to crime victims was derived from measures of both tangible (e.g., property damage and loss, health care, lost productivity) and intangible (e.g., pain, suffering, reduced quality of life) losses.

RESULTS

Reductions in criminality in the MST versus IT conditions were associated with lasting benefits to both taxpayers and crime victims, with cumulative benefits of MST estimated at $35,582 per juvenile offender and $7,798 per sibling. Overall, every dollar spent on MST recovered $5.04 in savings to taxpayers and crime victims in the 25 years following treatment.

CONCLUSIONS

This study represents the most comprehensive cost-benefit analysis of an MST clinical trial to date and demonstrates that an evidence-based treatment such as MST can produce modest economic benefits well into adulthood. Implications of the authors' findings for policymakers and public service agencies are discussed.

Long-term prevention of criminality in siblings of serious and violent juvenile offenders: a 25-year follow-up to a randomized clinical trial of multisystemic therapy

OBJECTIVE

Family-based treatment models that have shown effectiveness with juvenile offenders may also lead to reduced criminality in siblings of those offenders. However, the lasting effects of such treatments on siblings have not been evaluated. In the present study, the authors examined criminal outcomes for siblings of serious and violent juvenile offenders who had participated on average 25.0 years earlier in a clinical trial of multisystemic therapy (MST; Borduin et al., 1995).

METHOD

Participants were 129 closest-in-age siblings of individuals who were originally randomized to MST or individual therapy (IT) during adolescence. Arrest and incarceration data were obtained in middle adulthood when siblings were on average 38.4 years old.

RESULTS

Intent-to-treat analyses showed that arrest rates were significantly lower for siblings in the MST condition than in the IT condition (43.3% vs. 72.0%, respectively). In addition, siblings in the IT condition were about 3 times as likely to be convicted of a felony and more than twice as likely to be sentenced to incarceration and probation.

CONCLUSION

The present study represents the longest follow-up to date of sibling participants in an MST clinical trial and demonstrates that the positive impact of an evidence-based treatment for serious and violent juvenile offenders can extend to other family members. Implications of the authors' findings for policymakers and service providers are discussed.