Scaling up Evidence-Based Interventions in US Public Systems to Prevent Behavioral Health Problems: Challenges and Opportunities

Adaptation of a trauma-informed intervention to prevent opioid use among youth in the legal system

INTRODUCTION

Youth in the legal system are at high risk for opioid and other substance use problems and exhibit high rates of trauma exposure. Trauma-focused therapeutic approaches to prevent substance use show promise, but few evidence-based interventions are designed with justice-involved youth in mind. Consequently, implementing trauma-informed, evidence-based interventions within juvenile justice systems is challenging. The current paper describes the systematic adaptation of Trust-Based Relational Intervention (TBRI) as a family-centered substance use prevention program for youth transitioning from secure residential facilities.

METHODS

The study utilized the ADAPT-ITT methodological framework to adapt TBRI Caregiver Training, an evidence-based, trauma-informed intervention designed to help caregivers support children and youth with histories of trauma. Phases of adaptation included (1) Assessment, (2) Decision, (3) Prototype Development, and (4) Testing and Integration. The adaptation process explored contextual factors (e.g., systems, facilities, and staff) and the needs of the new target population (i.e., youth in the legal system and their caregivers). Adaptations were made to both content (e.g., terminology and activities) and structure (e.g., session duration and delivery setting) with input from participants from the target population, key stakeholders, and content experts.

RESULTS

The systematic adaptation of the intervention model resulted in a two-phase, four-component intervention package that can be implemented in juvenile justice settings as part of youth reentry services. The primary intervention, delivered while youth are in residential facilities, includes the TBRI Caregiver Curriculum, TBRI Youth & Young Adult Curriculum, and TBRI Nurture Groups. The secondary intervention, delivered after youth transition home, includes the TBRI Family Coaching Curriculum.

CONCLUSIONS

Utilizing a systematic methodological framework to guide adaptation has implications for developing accessible, culturally relevant, and contextually appropriate interventions. Accounting for contextual factors and population needs can improve the fit of evidence-based interventions for youth in the legal system, facilitating uptake and ultimately improving outcomes for youth at risk for substance use problems.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04678960.

Challenges in Disseminating Evidence-Based Health Promotion Programs in Faith Community Settings: What We Need to Include

BACKGROUND

Effective dissemination of information about evidence-based programs (EBPs) is essential for promoting health equity. Faith-based and other community organizations have difficulty locating EBPs for implementation in their settings. A research team engaged in a systematic search to identify a menu of EBPs that could be offered to African American FBOs as part of a community-engaged implementation study. Methods. A four-stage process was developed to search for EBPs meeting seven inclusion criteria for dissemination in faith-based organizations (FBOs). Criteria included relevance to identified health disparity topics, endorsement on a federal website, free access to downloadable program materials, facilitator guidance, no requirements for health care providers, and culturally relevant materials for African American communities.

RESULTS

Nineteen government websites were searched. Sixty-six potential EBPs were identified. Six EBPs met all inclusion criteria.

DISCUSSION

The search for EBPs that met seven criteria for implementation in African American FBOs demonstrated challenges that have been described in the literature. Researchers encountered a lack of standardized terminology for identifying EBPs on federal websites, frequent requirement for health care providers or clinics and/or fees for training and materials. FBOs are supportive and safe places to offer EBPs to promote health, and EBPs need to be designed and disseminated to meet the needs and preferences of FBOs. Including members of FBOs and others in the community in EBP development, design, and dissemination, such as searchable health promotion EBP registries, can increase the likelihood that effective programs intended to address health disparities are readily accessible to FBOs for implementation.

We Must Consider Infrastructure when Attempting to Scale up Autism EBIs: A Case Example from Early Intervention Systems

In the autism field, there is increasing interest in translating evidence-based interventions (EBIs) into systems that serve young autistic children and their families. Public Early Intervention systems have been a focal point of research-based implementation efforts given that these systems are federally mandated to provide services to children birth to three years of age with developmental delays under Part C of the Individuals with Disabilities Education Act. Although a growing number of research studies are now training Early Intervention providers to deliver autism EBIs, this work has been conducted on a relatively small scale and has only just begun to consider the alignment of these models with Early Intervention systems and whether sufficient infrastructure exists to scale up these training efforts and to sustain their public health impact. This commentary aims to address this gap by reviewing factors that have been found to uniformly impact the scale-up of EBIs across diverse public systems (Fagan 20, 1147-1168, 2019), and to extend this framework to the implementation of EBIs within public Early Intervention systems. These factors include developer and funder capacity, the public's awareness of and support for EBIs, the system's leadership support for EBI use, the capacity for community engagement in implementation efforts, the availability of a skilled workforce capable of delivering EBIs, and the capacity for data monitoring and quality improvement. This commentary discusses how these factors may specifically impact the scale-up of autism EBIs within EI systems to support toddlers and young, autistic children, and implications for autism researchers.

Demonstration Projects to Test Built Environment Changes: A Systematic Review

CONTEXT

Built environment interventions (pedestrian/bicycle infrastructure and enhanced access) mitigate barriers to physical activity by making the healthy choice the default choice. Demonstration projects (eg, temporary pedestrian lanes or sidewalks marked with tape) are used to test these interventions before making permanent changes. However, it is unknown whether demonstration projects lead to desired built environment changes.

OBJECTIVE

To systematically review the literature to determine outcomes and overall public health impacts of demonstration projects and whether they lead to permanent changes to the built environment.

DESIGN

Systematic review, conducted from March to September 2022 by searching PubMed and EBSCOhost for peer-reviewed literature and Google for gray (non-peer-reviewed) literature. Inclusion criteria were policy, systems, or environmental interventions; temporary implementation; and presence of evaluation data. Exclusion criteria were individual/interpersonal-level interventions, permanent implementation, and absence of evaluation data. Two authors coded for inclusion/exclusion and resolved discrepancies, coded a portion of included sources and resolved discrepancies, refined coding guide definitions, and coded remaining sources.

MAIN OUTCOME MEASURES

Data were extracted based on the expanded RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, which incorporates constructs of the Implementation Outcomes Framework (acceptability, appropriateness, feasibility).

RESULTS

Gray (N = 23) and peer-reviewed (N = 1) sources describing unique demonstration projects (N = 31) met inclusion criteria. Projects tested built environment interventions including traffic calming measures, crosswalks, bike lanes, intersection design, and trails. Sources primarily reported effectiveness (typically improved safety), maintenance, acceptability, and appropriateness. Most sources did not report projects leading to permanent changes to the built environment.

CONCLUSIONS

Based on inconsistent reporting of key outcomes (number of community members reached, changes to physical activity levels), overall impacts are unknown. Most demonstration projects captured community members' feedback, which was typically positive, but it is unknown whether feedback led to long-term changes. We recommend providing improved demonstration project guidance for practitioners to facilitate robust data collection, including suggested evaluation methods and tools.

Using Causative Methods to Determine System-Level Factors Driving the Uptake and Use of Evidence-Based Practices in a Public Early Intervention System

Part C Early Intervention (EI) systems are an entry point to services for autistic toddlers and can be leveraged to facilitate access to autism evidence-based practices (EBPs). However, EI systems are complex and limited research has examined how an EI system's infrastructure (i.e. system-level factors) impacts the adoption and implementation of EBPs. To address this gap, 36 EI providers and 9 EI administrators completed a semi-structured interview or focus group about factors impacting the implementation of autism EBPs. Qualitative analysis included a combination of grounded theory and causative coding. Analyses were refined by input from providers, administrators, and family stakeholders in the form of round tables and presentations at the state's interagency coordinating council. Primary themes centered on: (1) the costs associated with independent contracting structures; (2) operational demands; (3) workforce stability; (4) communication consistency; and (5) implementation supports for EBP implementation. Causative coding helped to demonstrate the perceived relationships between these factors and underscored the important role of incentivization structures, collaboration opportunities, and championing in supporting the use of EBPs within a system that primarily uses independent contracting structures. The current study extends previous research by demonstrating how several system-level factors are perceived to play a role in the adoption and implementation of EBPs by independently contracted EI providers. These findings underscore the need for implementation strategies, such as incentivization strategies and social network building, to increase providers' implementation of autism EBPs within EI systems.

Rapid jail-based implementation of overdose education and naloxone distribution in response to the COVID-19 pandemic

BACKGROUND

People incarcerated in jails are highly impacted by the opioid epidemic, and overdose education and naloxone distribution (OEND) is an effective strategy to reduce opioid overdose deaths. This study examines barriers and facilitators of fast-track OEND implementation within the jails in the Wave 1 Kentucky counties of the HEALing Communities Study during the COVID-19 pandemic.

METHODS

Meeting minutes with jail stakeholders were qualitatively coded using the Practical, Robust Implementation and Sustainability Model (PRISM) as the coding framework. The analysis highlighted the top barriers and facilitators to fast-track OEND implementation within the PRISM framework.

RESULTS

Space and staffing shortages related to the COVID-19 pandemic, disruptions in interorganizational programming from pandemic-related service suspensions, and a lack of technological solutions (e.g., reliable Internet access) for socially distanced delivery were the top barriers to fast-track OEND implementation. In addition, there were limitations on non-jail staff access to jails during COVID-19. Top facilitators included jail leadership support, the option to prioritize high-risk groups, and the incorporation of OEND processes into existing communications and management software. While the COVID-19 pandemic strained jail infrastructure, jail and partner agency collaboration led to creative implementation strategies for the successful integration of OEND into jail operations. Urban jails were more likely than rural jails to be early adopters of OEND during the public health emergency.

CONCLUSIONS

Understanding the barriers to and facilitators of OEND within jails will improve implementation efforts seeking to curb opioid overdose deaths. Jail leadership support and interorganizational efforts were key facilitators to implementation; therefore, it is recommended to increase buy-in with multiple agencies to promote success. Challenges brought on by COVID-19 have resulted in a need for innovative solutions for implementation.

CLINICAL TRIAL INFORMATION

ClinicalTrials.gov, NCT04111939, Submitted 30 September 2019, https://clinicaltrials.gov/study/NCT04111939?titles=HEALing%20Communities%20Study&rank=1 .

REALITIES in health disparities: Researching Evidence-based Alternatives in Living, Imaginative, Traumatised, Integrated, Embodied Systems

Introduction

Under the backdrop of pervasive health inequalities, public health professionals, researchers and non-academic partners in the United Kingdom are mobilising to understand how and in what ways community assets can address health disparities at scale in complex systems. While there is recognition that cultural, natural and community resources can improve health outcomes, these are unequally dispersed with lack of integration in communities and health and social care systems. Researching Evidence-based Alternatives in Living, Imaginative, Traumatised, Integrated, Embodied Systems (REALITIES) is a participatory action research Scottish consortium of 57 with established community asset hubs in five localities with strong relationships uniting conflicting ways of seeing the world. Our collective of lived and felt experience community members, community-embedded researchers, academics and non-academics draws upon a variety of practices, methods, datasets and philosophies to expand existing approaches to tackling health inequalities.

Methods

We present conceptual and theoretical underpinnings for our co-produced systems-level model and empirical findings from testing REALITIES across three disadvantaged localities (November 2022, ongoing). After explaining the context that led to the development of the new scalable REALITIES model for integrated public systems to interface with 'assets', we detail philosophical pillars and guiding principles for our model and how we applied these mechanisms to explain how integrated partnership working can lead to improved health outcomes across multiple public systems.

Results

We present a meta-analysis from co-producing and testing the model, showing how measuring change in complex public systems involves critical investigation of People, Process, Place, Price, Power and Purpose. Our critique reflects on power imbalances and inequities in Research-practice-Policy (RPP) partnerships and suggestions for how to nurture healthy ecosystems: overcoming barriers and enabling participation; reflecting on challenges of scaling up, testability and complexity of RPP partnerships; moving from siloed learning to transdisciplinary collaboration in practice; ensuring knowledge exchange has direct impact on communities and frontline practitioners; embedding relational ethics and safeguarding into daily practice.

Discussion

We propose the REALITIES model to unite alternative, sometimes conflicting, ways of thinking about public systems and community assets by continuously reflecting on entanglements between different assumptions about knowledge, reality, evidence, and unnecessary binaries between creative methodologies and scientific method.

Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA.

Unpacking Technical Assistance (TA) Strategies Within a State-Level Prevention Support System: A Mixed-Method Study in Determining Types and Amount of TA

The research-practice gap between evidence-based intervention efficacy and its uptake in real-world contexts remains a central challenge for prevention and implementation science. Providing technical assistance (TA) is considered a crucial support mechanism that can help narrow the gap. However, empirical measurement of TA strategies and their variation is often lacking. The current study unpacks the black box of TA, highlighting different TA strategies, amounts, and their relation to intervention characteristics. First, we qualitatively categorized interactions between TA providers and implementers. Second, we explored how characteristics of implementing organizations and the intervention related to variations in the amount of TA delivered. Using data spanning six years, we analyzed over 10,000 encounters between TA providers and implementers. Content analysis yielded four distinct strategies: Consultation (27.2%), Coordination Logistics (24.5%), Monitoring (16.5%), and Resource Delivery (28.2%). Organizations with prior experience required less monitoring and resource delivery. Additionally, characteristics of the intervention were significantly associated with the amount of consultation, monitoring, coordination logistics, and resource delivery provided. The specific features of the intervention showed significant variation in their relation to TA strategies. These findings provide initial insights into the implications of intervention characteristics in determining how much of which TA strategies are needed to support implementations in real-world settings.

How do the Substance Abuse and Mental Health Services Administration's Technology Transfer Centers Decide What Evidence-Based Practices to Disseminate and Determine How to Do So? A Cross-Sectional Study of a National Network

It is important to use evidence-based programs and practices (EBPs) to address major public health issues. However, those who use EBPs in real-world settings often require support in bridging the research-to-practice gap. In the US, one of the largest systems that provides such support is the Substance Abuse and Mental Health Services Administration's (SAMHSA's) Technology Transfer Center (TTC) Network. As part of a large external evaluation of the Network, this study examined how TTCs determine which EBPs to promote and how to promote them. Using semi-structured interviews and pre-testing, we developed a "Determinants of Technology Transfer" survey that was completed by 100% of TTCs in the Network. Because the study period overlapped with the onset of the COVID-19 pandemic, we also conducted a retrospective pre/post-pandemic comparison of determinants. TTCs reported relying on a broad group of factors when selecting EBPs to disseminate and the methods to do so. Stakeholder and target audience input and needs were consistently the most important determinant (both before and during COVID-19), while some other determinants fluctuated around the pandemic (e.g., public health mandates, instructions in the funding opportunity announcements). We discuss implications of the findings for technology transfer and frame the analyses in terms of the Interactive Systems Framework for Dissemination and Implementation.

A qualitative analysis of post-hoc interviews with multilevel participants of a randomized controlled trial of a community-based intervention

INTRODUCTION

Community-based health interventions often demonstrate efficacy in clinical trial settings but fail to be implemented in the real-world. We sought to identify the key operational and contextual elements of the Los Angeles Barbershop Blood Pressure Study (LABBPS), an objectively successful community-based health intervention primed for real-world implementation. LABBPS was a cluster randomized control trial that paired the barbers of Black-owned barbershops with clinical pharmacists to manage uncontrolled hypertension in Black male patrons, demonstrating a substantial 21.6 mmHg reduction in systolic blood pressure. Despite this success, the LABBPS intervention has not expanded beyond the original clinical trial setting. The aim of this study was to determine the facilitating and limiting factors to expansion of the LABBPS intervention.

METHODS

We undertook a qualitative assessment of semi-structured interviews with study participants performed after trial completion. Interviews included a total of 31 participants including 20 (6%) of the 319 LABBPS program participants ("patrons"), 10 (19%) barbers, and one (50%) clinical pharmacist. The semi-structured interviews were focused on perceptions of the medical system, study intervention, and influence of social factors on health.

RESULTS

Several common themes emerged from thematic analysis of interview responses including: importance of care provided in a convenient and safe environment, individual responsibility for health and health-related behaviors, and engagement of trusted community members. In particular, patrons reported that receiving the intervention from their barber in a familiar environment positively influenced the formation of relationships with clinical pharmacists around shared efforts to improve medication adherence and healthy habits. All interviewee groups identified the trust diad, comprising the familiar environment and respected community member, as instrumental in increasing health-related behaviors to a degree not usually achieved by traditional healthcare providers.

DISCUSSION

In conclusion, participants of an objectively successful community-based intervention trial consistently identified key features that could facilitate wider implementation and efficacy: social trust relationships, soliciting insights of trust bearers, and consistent engagement in a familiar community setting. These findings can help to inform the design and operations of future community-based studies and programs aiming to achieve a broad and sustainable impact.

Childhood Physical Health and Attention Deficit/Hyperactivity Disorder: A Systematic Review and Meta-Analysis of Modifiable Factors

Although neurobiologic and genetic factors figure prominently in the development of attention deficit/hyperactivity disorder (ADHD), adverse physical health experiences and conditions encountered during childhood may also play a role. Poor health is known to impact the developing brain with potential lifelong implications for behavioral issues. In attempt to better understand the relationship between childhood physical health and the onset and presence of ADHD symptoms, we summarized international peer-reviewed articles documenting relationships between a select group of childhood diseases or health events (e.g., illnesses, injuries, syndromes) and subsequent ADHD outcomes among children ages 0-17 years. Drawing on a larger two-phase systematic review, 57 longitudinal or retrospective observational studies (1978-2021) of childhood allergies, asthma, eczema, head injury, infection, or sleep problems and later ADHD diagnosis or symptomatology were identified and subjected to meta-analysis. Significant associations were documented between childhood head injuries, infections, and sleep problems with both dichotomous and continuous measures of ADHD, and between allergies with dichotomous measures of ADHD. We did not observe significant associations between asthma or eczema with ADHD outcomes. Heterogeneity detected for multiple associations, primarily among continuously measured outcomes, underscores the potential value of future subgroup analyses and individual studies. Collectively, these findings shed light on the importance of physical health in understanding childhood ADHD. Possible etiologic links between physical health factors and ADHD are discussed, as are implications for prevention efforts by providers, systems, and communities.

Validity Evidence for an Observational Fidelity Measure to Inform Scale-Up of Evidence-Based Interventions

As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of fidelity observation protocols to guide future research studying evidence-based interventions scaled-up under real-world conditions. We describe a process to build evidence of validity for items within the Session Review Form, an observational tool measuring fidelity to interactive drug prevention programs such as the Botvin LifeSkills Training program. Following Kane's (2006) assumptions framework requiring that validity evidence be built across four areas (scoring, generalizability, extrapolation, and decision), confirmatory factor analysis supported the hypothesized two-factor structure measuring quality of delivery (seven items assessing how well the material is implemented) and participant responsiveness (three items evaluating how well the intervention is received), and measurement invariance tests suggested the structure held across grade level and schools serving different student populations. These findings provide some evidence supporting the extrapolation assumption, though additional research is warranted since a more complete overall depiction of the validity argument is needed to evaluate fidelity measures.

Clinical effectiveness/child-patient and parent satisfaction of two topical fluoride treatments for caries: a randomised clinical trial

Knowledge gaps exist regarding optimal silver diammine fluoride (SDF) regimens and the efficacy of new products for arresting dental caries in young children. We evaluated the effectiveness of 38%-SDF (SDI-RivaStar), Tiefenfluorid (TF) comparing with Placebo (P), all in conjunction with behavioural modification (BM), in preventing major complications (endodontic/extractions/pain)-a patient-centred outcome-due to early childhood caries over 12 months in children under 71-months. A six-arm, patient/parent-blinded, superiority, placebo-controlled randomised control trial at the university clinic in Riga, Latvia, from 1/9/20-31/8/22 (Protocol registration ISRCTN17005348). The trial tested six protocols, using three compounds (P/SDF/TF) under two regimes: annual and biannual (P1/P2/TF1/TF2/SDF1/SDF2) for major complications. Secondary outcomes included minor complications and parental satisfaction. All groups received BM. 373/427 randomised children (87.3%) completed the study. SDF2 had a significantly lower rate and risk of major (21.5%, OR = 0.28, 95%CI [0.11, 0.72], p < 0.05) and minor complications (OR = 0.16 (95%CI [0.05, 0.50], p = 0.002). Overall satisfaction was 96% (p > 0.05). SDF biannual application with BM effectively prevented major complications of early childhood caries and was well accepted by children and their parents. Trial registration number: ISRCTN17005348, principal investigator: Ilze Maldupa, registration date: 30/06/2021.Clinical trial registration number: ISRCTN registry: ISRCTN17005348, https://doi.org/10.1186/ISRCTN17005348 , registration date: 30/06/2021.

Revisiting the Percentage of K-12 Students in Need of Preventive Interventions in Schools in a "Peri-COVID" Era: Implications for the Implementation of Tiered Programming

As the public health framework has been implemented in schools through multi-tiered systems of support, as in Positive Behavioral Interventions and Supports (PBIS), a prominent interpretation has been that 80% of students will benefit from universal or Tier 1 schoolwide behavior support, around 15% will require added selective or Tier 2 targeted support, and 5% will require the more intensive selective or Tier 3 intervention. The PBIS framework also emphasizes the use of tiered logic, with strengthened efforts at the universal and selective levels when student behavioral or mental health needs exceed expected levels. The prediction that 5% of students will require indicated support was based mostly on students at risk for discipline encounters (i.e., office discipline referral data) and, more recently, systematic screening data, but this percentage remains an interpretation of the public health framework. Further, epidemiologic data over the past decade show that rates of childhood mental health disorders have risen and are even higher now as schools struggle to recover from the COVID-19 pandemic-much higher than 15% and 5% for selective and indicated levels. Thus, we believe it is time to revisit projections of the number of students in need of Tier 2 and Tier 3 support. In this position paper, we review the evidence for escalating youth mental health needs and discuss the implications for the tiered prevention framework in schools. We describe strategies to expand the availability of preventive intervention supports beyond Tier 1 efforts and conclude with recommendations for practice, policy, and research in this peri-COVID recovery era.

A Mixed Methods Examination of Decision-Making During Program Exploration and Implementation in Schools

Schools are a critical setting to promote healthy youth development through the provision of evidence-based programs (EBPs), yet preventive EBPs in schools are underutilized. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework highlights numerous factors that may influence program adoption during the Exploration phase and progress monitoring during the Implementation phase. However, no research has systematically and simultaneously identified the factors that influence school administrators' decision-making during these important processes. We conducted semi-structured interviews with 24 school administrators in the Midwestern region of the U.S. to understand how they weigh various considerations that inform their adoption and progress monitoring of prevention programs. Results indicated that school administrators consider five separate factors during the adoption decision, prioritized in the following order: need for the program, school community buy-in, contextual fit, resources, and program characteristics (including the evidence-base). Further, administrators consider five indicators to monitor program performance, prioritized as follows: intervention fidelity, quantitative and qualitative data that determine if the identified need was met, school community buy-in, resource consumption, and program characteristics. Implications for prevention scientists and suggestions for future research are discussed.

Support From Intermediary Organizations for Evidence-Based Practices in Behavioral Health Care

Intermediary and purveyor organizations play a key role in disseminating and implementing evidence-based behavioral health best practices (EBPs). The authors provide a case example to describe how state-funded intermediaries can enhance the implementation and sustainment of EBP. Benefits of using state-funded intermediaries include the ability to collaborate with state entities to address barriers to and then incentivize best practices, access to resources to develop a robust infrastructure to support EBP training and implementation, and enhanced capacity to support organizations beyond individual EBPs (e.g., developing an internal quality-improvement process, supporting cross-cutting competencies, and helping organizations to identify synergies across EBP and to prioritize what to implement first).

Mis-implementation of evidence-based behavioural health practices in primary care: lessons from randomised trials in Federally Qualified Health Centers

Background

Implementing evidence-based practices (EBPs) within service systems is critical to population-level health improvements - but also challenging, especially for complex behavioral health interventions in low-resource settings. "Mis-implementation" refers to poor outcomes from an EBP implementation effort; mis-implementation outcomes are an important, but largely untapped, source of information about how to improve knowledge exchange.

Aims and objectives

We present mis-implementation cases from three pragmatic trials of behavioral health EBPs in U.S. Federally Qualified Health Centers (FQHCs).

Methods

We adapted the Consolidated Framework for Implementation Research and its Outcomes Addendum into a framework for mis-implementation and used it to structure the case summaries with information about the EBP and trial, mis-implementation outcomes, and associated determinants (barriers and facilitators). We compared the three cases to identify shared and unique mis-implementation factors.

Findings

Across cases, there was limited adoption and fidelity to the interventions, which led to eventual discontinuation. Barriers contributing to mis-implementation included intervention complexity, low buy-in from overburdened providers, lack of alignment between providers and leadership, and COVID-19-related stressors. Mis-implementation occurred earlier in cases that experienced both patient- and provider-level barriers, and that were conducted during the COVID-19 pandemic.

Discussion and conclusion

Multi-level determinants contributed to EBP mis-implementation in FQHCs, limiting the ability of these health systems to benefit from knowledge exchange. To minimize mis-implementation, knowledge exchange strategies should be designed around common, core barriers but also flexible enough to address a variety of site-specific contextual factors and should be tailored to relevant audiences such as providers, patients, and/or leadership.

Effectiveness-implementation hybrid trial of Spanish language, digital cognitive-behavioral therapy (dCBT) intervention for depression and anxiety - protocol for the SUPERA (SUpport from PEeRs to expand Access) study

BACKGROUND

Limited English Proficiency (LEP) Latinxs experience a longer duration of untreated depression and anxiety. LEP Latinxs have difficulty accessing mental healthcare due to insufficient Spanish-speaking behavioral/mental health clinicians to meet demand. These under-resourced healthcare systems are less likely to be the site for the implementation of innovations. Digital interventions can provide an effective option for overcoming these barriers; yet, when digital evidence-based treatments are available, uptake and engagement is often low. This manuscript presents the protocol for the SUPERA (SUpport from PEeRs to expand Access) study which will evaluate the implementation of an evidence-based, Spanish language, digital cognitive-behavioral therapy (dCBT) intervention (i.e., SilverCloud) in safety-net primary care clinics for LEP Latinx patients with depression or anxiety.

METHODS

We will conduct an effectiveness-implementation hybrid trial (Type 2) design comparing engagement and clinical outcomes in two modalities of dCBT delivery (peer-supported vs. unsupported). We will also compare provider-level outreach (using a clinic patient registry) versus inreach (traditional provider referral) to compare rates of initiation, completion, and cost. Participants will be 426 LEP Latinx adults ≥18 years of age, PHQ-9 ≥ 10 or GAD-7 ≥ 8, with access to the internet via smartphone, and not currently receiving individual psychotherapy. We will collect baseline, post-intervention (8 weeks), and follow up (3 months) data.

CONCLUSION

The long-term goal of this research is to aid in the implementation of digital mental health interventions that can be sustainably implemented in low-resourced settings, while reducing the reliance on professionals, overcoming workforce deficits, and increasing relevance for diverse populations.

Adolescent Perceptions of Adult-Mediated Healthcare Communication

Adolescence is a time of rapid growth and development and may be accompanied by increased risk-taking behaviors and independence. Youth are particularly at risk for high levels of stress, decreased physical activity, unsafe sexual activity, abuse, depression, and suicide. Considering the unique health risks adolescents face, healthcare service access and utilization can play a pivotal role in promoting positive long term health outcomes throughout adulthood. At the same time, adolescents must often rely on parents/caregivers to mediate their healthcare access. Understanding how adolescents perceive adult interactions within healthcare is important for developing interventions that increase youth access to healthcare. We found that adolescents perceived adult-mediated healthcare experiences as either supportive (Subthemes: Recognition Builds Trust and Validation) or unsupportive (Subthemes: Adult-Focused Communication and Lack of Privacy). Based on our findings, we argue that prevention-focused interventions should include communication-based strategies. We discuss social work and healthcare practice and policy implications of these findings.

Kailo: a systemic approach to addressing the social determinants of young people's mental health and wellbeing at the local level

The mental health and wellbeing of children and young people is deteriorating. It is increasingly recognised that mental health is a systemic issue, with a wide range of contributing and interacting factors. However, the vast majority of attention and resources are focused on the identification and treatment of mental health disorders, with relatively scant attention on the social determinants of mental health and wellbeing and investment in preventative approaches. Furthermore, there is little attention on how the social determinants manifest or may be influenced at the local level, impeding the design of contextually nuanced preventative approaches. This paper describes a major research and design initiative called Kailo that aims to support the design and implementation of local and contextually nuanced preventative strategies to improve children's and young people's mental health and wellbeing. The Kailo Framework involves structured engagement with a wide range of local partners and stakeholders - including young people, community partners, practitioners and local system leaders - to better understand local systemic influences and support programmes of youth-centred and evidence-informed co-design, prototyping and testing. It is hypothesised that integrating different sources of knowledge, experience, insight and evidence will result in better embedded, more sustainable and more impactful strategies that address the social determinants of young people's mental health and wellbeing at the local level.

Healthy eating and active living policy, systems, and environmental changes in rural Louisiana: a contextual inquiry to inform implementation strategies

BACKGROUND

Healthy eating and active living policy, systems, and environmental (PSE) changes are implemented across the United States through Cooperative Extension. However, translating multisector PSE changes to practice in community settings is challenging and there is a lack of knowledge about barriers and facilitators to PSE changes among state Extension systems using standardized frameworks. Therefore, a research-to-practice partnership effort aimed to identify Louisiana Cooperative Extension Service Family and Consumer Science (LFCS) practitioners' barriers and facilitators to implementing PSE changes in rural Louisiana communities.

METHODS

A qualitative approach using the 2022 Consolidated Framework for Implementation Research (2022 CFIR) was used. Focus group discussions were conducted at five LFCS regional trainings between February and May 2022. All LFCS practitioners with any level of experience implementing healthy eating and active living PSE changes were eligible to participate, with emphasis on understanding efforts within more rural communities. Focus group discussions were audio-recorded and transcribed verbatim. Researchers analyzed qualitative data using the constant comparison method and 2022 CFIR domains and constructs including Inner Setting (LFCS organization), Outer Setting (rural Louisiana communities), Innovation (PSE changes), and Individuals (PSE change implementation actors/partners).

RESULTS

Across the five regions, LFCS practitioners (n = 40) described more barriers (n = 210) than facilitators (n = 100); findings were often coded with multiple 2022 CFIR domains. Reported Inner Setting barriers were lack of formal or informal information sharing and lack of access to knowledge and information. Outer Setting barriers included sustaining and initiating community partnerships and local environmental or political conditions. Individual barriers included a lack of time and expertise, and Innovation barriers included the complex nature of rural PSE changes. Facilitators were mentioned at multiple levels and included community partner buy-in and practitioners' motivation to implement PSE changes.

CONCLUSIONS

Implementation strategies are needed to build on organizational strengths and to overcome multi-level barriers to PSE change implementation among LFCS practitioners. The results from the in-depth contextual inquiry used could serve as a guide for future pragmatic assessment efforts among other state Extension systems or as a model for identifying barriers and facilitators and associated implementation strategies among other public health systems in the U.S. and abroad.

Foundations of Community Engagement: A Series for Effective Community-Engaged Research

Introduction

Medical students lack systematic exposure to community engagement. Community-engaged research (CEnR) is an effective approach to improve community health, and community-engaged physicians are better attuned to the community context of their patients' health and well-being. The Medical College of Wisconsin (MCW) Office of Community Engagement began offering the educational series Foundations of Community Engagement in 2021 to meet this need.

Methods

We developed and implemented a four-session series for medical students at MCW and the University of Nebraska Medical Center. A 1-hour session on the foundations of CEnR was held for all learners. Three 1-hour sessions dove deeper into CEnR principles for a self-selected cohort. These small-group sessions involved discussion between faculty and community partners and facilitated small-group discussion. Students completed evaluations after each session.

Results

A total of 160 students participated in the introductory session; 36 took part in the follow-up series. Survey response rates varied from 38% to 67% for each session. Overall, 87% of students in all sessions felt their session was worthwhile, with 85% of large-group and 96% of small-group respondents reporting they learned something they would use in their practice or profession. Qualitative responses included appreciation for addressing a curricular gap and desire for more time and more sessions to continue discussions.

Discussion

The program was effective at stimulating medical student self-reported gains in skills, attitudes, and future intentions regarding CEnR in an efficient manner. Effective programs that transfer positive CEnR skills and attitudes to future physicians can promote CEnR within academic medicine.

HEAL Preventing Opioid Use Disorder: a Vision for Research to Increase Access to Prevention Services

Launched in 2018, the National Institutes of Health (NIH) Helping to End Addiction Long-term Initiative®, or NIH HEAL Initiative, is an aggressive effort to speed scientific solutions to stem this national public health crisis. Investments in new strategies to prevent opioid misuse are a key component of this comprehensive response to the opioid epidemic. In 2019, funded through the NIH HEAL Initiative® and administered by the National Institute on Drug Abuse (NIDA), HEAL Preventing Opioid Use Disorder (HEAL Preventing OUD) research program began, filling the gap of needed upstream prevention interventions. The vision for HEAL Preventing OUD is that: Healthcare organizations and public systems will be able to make evidence-based preventive intervention services accessible to all persons who experience risk for opioid and other substance misuse or use disorder. Realizing this vision will require research investments in four strategic areas: (1) risk identification; (2) intervention development; (3) social determinants, health equity, and policy; and (4) dissemination, implementation, scale up, and sustainment. There exists tremendous potential for prevention to be a viable solution for the ongoing opioid crisis, particularly through investments in upstream, equitable, and sustainable prevention services.

Testing Cross-Generational Effects of the Raising Healthy Children Intervention on Young Adult Offspring of Intervention Participants

This study tested whether effects of a preventive intervention delivered in elementary school showed benefits for the young adult offspring of intervention recipients over 20 years later. The Raising Healthy Children (RHC) intervention, trialed in 18 public schools in Seattle, Washington, from 1980-1986 (grades 1-6), sought to build strong bonds to family and school to promote school success and avoidance of substance use and illegal behavior. Four intervention groups were constituted: full, late, parent training only, and control. Participants were followed through 2014 (age 39 years). Those who became parents were enrolled in an intergenerational study along with their oldest offspring (10 assessments between 2002 and 2018). This study includes young adult offspring (ages 18-25 years; n = 169; 52% female; 4% Asian, 25% Black, 40% multiracial, 4% Native American, 2% Native Hawaiian/Pacific Islander, 25% White, and 14% Hispanic/Latinx) of participants in the original RHC trial. Offspring outcome measures included high school noncompletion, financial functioning, alcohol misuse, cannabis misuse, cigarette use, criminal behavior, internalizing behavior, social skills, and social bonding. A global test across all young adult outcome measures showed that offspring of parents who received the full RHC intervention reported better overall functioning compared to offspring of control group parents. Analyses of individual outcomes showed that offspring of full intervention group parents reported better financial functioning than offspring of control group parents. Findings show the potential of universal preventive interventions to provide long-term benefits that reach into the next generation. ClinicalTrials.gov Identifier: NCT04075019; retrospectively registered in 2019.

Acceptability, appropriateness, and feasibility of Rural School Support Strategies for behavioral interventions: a mixed methods evaluation over two years of a hybrid type 3 implementation-effectiveness trial

BACKGROUND

Positive Behavioral Interventions and Supports (PBIS) is a framework for implementing evidence-based interventions for preventing behavioral issues and improving climate in schools. The implementation of school-wide PBIS with fidelity is complex, requiring leadership commitment, teaming, and coordination of systems for tracking behaviors and consequences. Putting these components in place while ensuring alignment with the values and needs of the school community can be difficult for schools with fewer resources, such as rural schools. Implementation supports are needed, including strategies such as technical assistance, but it is unclear whether lower-cost modalities such as virtual support are acceptable, appropriate, and feasible and whether perceptions vary throughout the implementation process.

METHODS

A type 3 hybrid implementation-effectiveness trial is taking place in 40 Idaho schools, testing a bundle of implementation supports selected to meet the needs of schools in rural areas. Supports include technical assistance from an implementation support practitioner (ISP), didactic trainings, virtual learning sessions, and an online resource portal. Surveys and interviews in the first 2 years of implementation (fall 2019 to spring 2021) explored outcomes of acceptability, appropriateness, and feasibility regarding the implementation supports among more than 150 school stakeholders.

RESULTS

Evaluations showed high acceptability and appropriateness of the PBIS concepts and training. The 20 schools receiving additional implementation support rated the technical assistance and support from the project's ISPs as the most acceptable and appropriate resource. Reasons for acceptability were the relationship built with the ISP, the ISP's expertise, and being a "neutral party." Although in-person support from the ISP was preferred, remote support was acceptable and increased feasibility of attendance. Virtual learning sessions were acceptable for learning and collaboration, particularly in the second year of implementation, once ISPs had developed closer relationships with school teams.

CONCLUSIONS

School staff found training, technical assistance, and virtual learning sessions to be acceptable and appropriate. Virtual formats of training and technical assistance decreased in acceptability but increased feasibility of attendance. In-person support was preferred during initial implementation, and virtual support was more acceptable thereafter.

TRIAL REGISTRATION

This trial was prospectively registered on ClinicalTrials.gov ( NCT03736395 ), on November 9, 2018.

Normalization of Prevention Principles and Practices to Reduce Substance Use Disorders Through an Integrated Dissemination and Implementation Framework

Major research breakthroughs over the past 30 years in the field of substance use prevention have served to: (1) enhance understanding of pharmacological effects on the central and peripheral nervous systems and the health and social consequences of use of psychoactive substances, particularly for children and adolescents; (2) delineate the processes that increase vulnerability to or protect from initiation of substance use and progression to substance use disorders (SUDs) and, based on this understanding, (3) develop effective strategies and practices to prevent the initiation and escalation of substance use. The challenge we now face as a field is to "normalize" what we have learned from this research so that it is incorporated into the work of those involved in supporting, planning, and delivering prevention programming to populations around the world, is integrated into health and social service systems, and helps to shape public policies. But we wish to go further, to incorporate these effective prevention practices into everyday life and the mind-sets of the public, particularly parents and educators. This paper reviews the advances that have been made in the field of prevention and presents a framework and recommendations to achieve these objectives generated during several meetings of prevention and implementation science researchers sponsored by the International Consortium of Universities for Drug Demand Reduction (ICUDDR) that guides a roadmap to achieve "normalization."

Fortifying the Foundations: A Comprehensive Approach to Enhancing Mental Health Support in Educational Policies Amidst Crises

In recent times, global crises such as the COVID-19 pandemic, climate change, and geopolitical conflicts have significantly impacted pupils' mental health. This opinion article presents evidence-based recommendations to bolster mental health support within educational systems, aiming to alleviate the psychological burden faced by students during these challenging times. This article argues that a proactive, holistic approach to mental health is essential for building a resilient educational infrastructure. More than ever, we support the call for the integration of mental health education into the core curriculum, equipping students with vital coping skills and fostering emotional intelligence. Additionally, we emphasize the importance of training educators and staff to identify and address mental health issues. Furthermore, this article highlights the need for interdisciplinary collaboration involving general practitioners, mental health professionals, community organizations, and policymakers in crafting and implementing support strategies. Educational institutions can effectively leverage the expertise of diverse stakeholders to create targeted interventions by cultivating partnerships. Finally, the significance of continuously evaluating and refining mental health support policies to ensure their efficacy and adaptability in the face of evolving crises is emphasized. Through these comprehensive recommendations, this opinion article seeks to catalyze a transformation in educational policies, prioritize mental health support, and empower pupils to thrive during tumultuous times.

The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study

Emerging literature has highlighted the importance of discerning general and strategic organizational context (OC) factors (e.g., leadership and climate) and their interaction effect on individual implementation behaviors (e.g., attitudes toward evidence-based practices; EBPs) in youth mental healthcare. This study aimed to examine how leadership and climate (general and strategic) are associated with implementer attitudes toward EBPs across the individual and organizational levels and their interaction effect in schools. A series of multilevel models (MLMs) were fitted on a diverse sample of schools actively implementing universal prevention programs for youth mental health (441 implementers from 52 schools). The organization-level aggregates and individual educators' perceptions of general and strategic leadership and climate, and their interaction terms, were entered as level-2 and level-1 predictors of four attitudinal dimensions (Requirement, Openness, Appeal, and Divergence) based on their level of measurement. At the organizational level, higher levels of strategic leadership and climate, but not their general counterparts, were consistently associated with more favorable attitudes in all four dimensions. At the individual/within-school level, higher levels of perceived general and strategic leadership and climate were associated with more favorable attitudes of Requirement and Openness. At the organizational/between-school level, general climate moderated the positive effect of strategic climate on implementers' perception of appeal and divergence of EBPs. Our findings indicate that leaders should make data-based decisions to allocate resources on strategic and/or general leadership and climate to foster favorable staff attitudes toward EBPs based on the level of measurement, implementation-specificity, and attitudinal dimensions.

A Scoping Review of the Influence of Evidence-Based Program Resources (EBPR) Websites for Behavioral Health

Evidence-based program resources (EBPR) websites evaluate behavioral health programs, practices or policies (i.e., interventions) according to a predetermined set of research criteria and standards, usually resulting in a summary rating of the strength of an intervention's evidence base. This study is a mixed-methods analysis of the peer-reviewed academic literature relating to the influence of EBPRs on clinical practice and policy in the behavioral health field. Using an existing framework for a scoping review, we searched for research articles in PubMed, Web of Science, SCOPUS, and ProQuest that were published between January 2002 and March 2022, referenced an EBPR or multiple EBPRs, and presented data showing the influence of one or more EBPRs on behavioral health. A total of 210 articles met the inclusion criteria and were classified into five distinct categories of influence, the most important of which was showing the direct impact of one or more EBPRs on behavioral health (8.1% of articles), defined as documenting observable changes in interventions or organizations that are at least partly due to information obtained from EBPR(s). These included impacts at the state legislative and policy-making level, at the community intervention level, provider agency level, and individual practitioner level. The majority of influences identified in the study were indirect demonstrations of how EBPRs are used in various ways. However, more studies are needed to learn about the direct impact of information from EBPRs on the behavioral health field, including impact on clinician practice and treatment outcomes for consumers.

Keep It Up! 3.0: Study protocol for a type III hybrid implementation-effectiveness cluster-randomized trial

BACKGROUND

Despite evidence that eHealth approaches can be effective in reducing HIV risk, their implementation requirements for public health scale up are not well established, and effective strategies to bring these programs into practice are still unknown. Keep It Up! (KIU!) is an online program proven to reduce HIV risk among young men who have sex with men (YMSM) and ideal candidate to develop and evaluate novel strategies for implementing eHealth HIV prevention programs. KIU! 3.0 is a Type III Hybrid Effectiveness-Implementation cluster randomized trial designed to 1) compare two strategies for implementing KIU!: community-based organizations (CBO) versus centralized direct-to-consumer (DTC) recruitment; 2) examine the effect of strategies and determinants on variability in implementation success; and 3) develop materials for sustainment of KIU! after the trial concludes. In this article, we describe the approaches used to achieve these aims.

METHODS

Using county-level population estimates of YMSM, 66 counties were selected and randomized 2:1 to the CBO and DTC approaches. The RE-AIM model was used to drive outcome measurements, which were collected from CBO staff, YMSM, and technology providers. Mixed-methods research mapped onto the domains of the Consolidated Framework for Implementation Research will examine determinants and their relationship with implementation outcomes.

DISCUSSION

In comparing our implementation recruitment models, we are examining two strategies which have shown effectiveness in delivering health technology interventions in the past, yet little is known about their comparative advantages and disadvantages in implementation. The results of the trial will further the understanding of eHealth prevention intervention implementation.

A National Strategy for Preventing Substance and Opioid Use Disorders Through Evidence-Based Prevention Programming that Fosters Healthy Outcomes in Our Youth

The recently released National Drug Control Strategy (2022) from the White House Office of National Drug Control Policy (ONDCP) lays out a comprehensive plan to, not only enhance access to treatment and increase harm reduction strategies, but also increase implementation of evidence-based prevention programming at the community level. Furthermore, the Strategy provides a framework for enhancing our national data systems to inform policy and to evaluate all components of the plan. However, not only are there several missing components to the Strategy that would assure its success, but there is a lack of structure to support a national comprehensive service delivery system that is informed by epidemiological data, and trains and credentials those delivering evidence-based prevention, treatment, and harm reduction/public health interventions within community settings. This paper provides recommendations for the establishment of such a structure with an emphasis on prevention. Systematically addressing conditions known to increase liability for behavioral problems among vulnerable populations and building supportive environments are strategies consistently found to avert trajectories away from substance use in general and substance use disorders (SUD) in particular. Investments in this approach are expected to result in significantly lower rates of SUD in current and subsequent generations of youth and, therefore, will reduce the burden on our communities in terms of lowered social and health systems involvement, treatment needs, and productivity. A national strategy, based on strong scientific evidence, is presented to implement public health policies and prevention services. These strategies work by improving child development, supporting families, enhancing school experiences, and cultivating positive environmental conditions.

Adaptation of a trauma-informed intervention for youth involved in the legal system

Background

Youth in the legal system (YILS) have high rates of trauma exposure, which are associated with increased risk of behavioral health needs (e.g., substance-use problems) and recidivism. Research suggests that a trauma-focused therapeutic approach can improve outcomes for YILS, but few evidence-based interventions (EBIs) are designed with justice-involved youth in mind. Consequently, implementing trauma-informed EBIs within juvenile justice (JJ) systems is challenging. The current paper describes the systematic adaptation of Trust-based Relational Intervention (TBRI) as a substance use prevention intervention for YILS and their caregivers.

Methods

The current study utilized a methodology based on the ADAPT-ITT framework to adapt TBRI Caregiver Training, an evidence-based, trauma-informed intervention program. Phases of adaptation included (1) Assessment, (2) Decision, (3) Prototype Development, and (4) Testing and Integration. The adaptation process explored contextual factors (e.g., systems, facilities, and staff) and the needs of the new target population (i.e., YILS and their caregivers). Adaptations were made to both content (e.g., terminology and activities) and structure (e.g., session duration and delivery setting) in an iterative process with input from participants from the target population, key stakeholders, and content experts.

Results

The systematic adaptation of the intervention model resulted in a two-phase, four-component intervention package that can be implemented in juvenile justice settings as part of youth reentry services. The primary intervention, delivered while youth are in residential facilities, includes the TBRI Caregiver Curriculum, TBRI Youth & Young Adult Curriculum, and TBRI Nurture Groups. The secondary intervention, delivered after youth transition home, includes the TBRI Family Coaching Curriculum.

Conclusions

Utilizing an implementation science framework to guide adaptation has implications for developing accessible, culturally relevant, and contextually-appropriate interventions. Accounting for contextual factors and population needs can improve the fit of EBIs in juvenile justice, facilitating uptake and ultimately improving outcomes for youth.

Trial registration

ClinicalTrials.gov Identifier: NCT04678960.

Sticking with Programs That Do Not Work: The Role of Escalation of Commitment in Schools

Schools are the most common site to implement evidence-based prevention programs and practices (EBPs) to improve behavioral and mental health outcomes among children and adolescents. Research has highlighted the critical role of school administrators in the adoption, implementation, and evaluation of such EBPs, focusing on the factors they should consider during the adoption decision and the behaviors needed for successful implementation. However, scholars have only recently begun to focus on the de-adoption or de-implementation of low-value programs and practices to make room for evidence-based alternatives. This study introduces escalation of commitment as a theoretical framework for understanding why school administrators may stick with ineffective programs and practices. Escalation of commitment is a robust decision-making bias in which people feel compelled to continue with a course of action even when performance indicators suggest it is not going well. Using grounded theory methodology, we conducted semi-structured interviews with 24 building- and district-level school administrators in the Midwestern United States. Results suggested that escalation of commitment occurs when administrators attribute the underlying causes of poor program performance not to the program itself but instead to issues related to implementation, leadership, or the limitations of the performance indicators themselves. We also identified a variety of psychological, organizational, and external determinants that accentuate administrators' continuance of ineffective prevention programs. Based on our findings, we highlight several contributions to theory and practice.

Prevention Science and Health Equity: A Comprehensive Framework for Preventing Health Inequities and Disparities Associated with Race, Ethnicity, and Social Class

The ultimate goal of our public health system is to reduce the incidence of disability and premature death. Evidence suggests that, by this standard, the USA falls behind most other developed countries largely as a function of disparities in health outcomes among significant portions of the US population. We present a framework for addressing these disparities that attributes them, not simply to differences in the behavioral and physical risk factors, but to social, environmental, and structural inequities such as poverty, discrimination, toxic physical setting, and the marketing of harmful products. These inequities result from de facto and instituted public policies. An analysis of the NIH research portfolio indicates a relative lack of investment in experimental evaluations of preventive interventions-especially studies targeting disadvantaged populations. Moreover, experimental research on reducing social inequities is almost entirely lacking. A line of research focusing on the drivers of inequities and their dissolution must include experimental evaluation of strategies for getting policies adopted that will reduce inequities. In conclusion, a summary is provided of the types of research that are needed and the challenges involved in conducting the experimental research that is essential for reducing inequities and disparities and, in turn, prolonging life.

Streamlined pediatric anxiety program for school mental health services

There needs to be serious transformation of evidence-based interventions (EBIs) into real-world solutions; otherwise, EBIs will never achieve the intended public health impact. In a randomized trial, we reported effects of a redesigned anxiety program. Herein, we described the redesign process that led to the program. Survey data revealed provider preferences for school mental health anxiety services. Focus groups and prototype feedback sessions revealed service barriers to uptake, implementation, and sustainability along with corresponding enabling strategies. Prototype feedback sessions also focused on refinement and fine-tuning of the redesign. In the end, traditional EBI strategies were transformed and packaged into six lessons, lasting 20-30 minutes each, and amenable to delivery in small-group format. The redesign achieved the intended purpose of retaining elements from cognitive and behavior therapy and social skills training for the target population of the intervention (e.g., 3rd to 5th graders with heterogeneous anxiety problems - identified and referred). The streamlined EBI is accessible from PBS LearningMedia™ - a service that hosts public, research-based, and school-ready materials.

Supporting School Mental Health Providers: Evidence from a Short-Term Telementoring Model

Background

To support student mental health, school staff must have knowledge of evidence-based practices and the capacity to implement them. One approach used to address this challenge is a group-based telementoring model called Extension for Community Healthcare Outcomes (ECHO). In other applications (e.g., healthcare settings), ECHO has been shown to increase healthcare professionals' self-efficacy and knowledge of evidence-based practices leading to improved patient outcomes.

Objectives

This study examined the potential for ECHO to be used as a method for increasing school staff engagement and knowledge of evidence-based school mental health practices.

Methods

Using a quasi-experimental design, this study compared outcomes across two professional development experiences aimed at promoting school staff ability to provide evidence-based mental health services. School staff from four school districts participated in a school mental health training initiative. All participants (N = 57) had access to asynchronous, online mental health modules. A sub-sample (n = 33) was also offered monthly ECHO sessions.

Results

Tests of group difference in outcomes revealed significant increases in engagement with online learning (d = 0.58) and satisfaction (d = 0.82) for those who participated in ECHO as compared to those who did not. Knowledge about evidence-based practices was not significantly different between groups.

Conclusions

Results suggest that group-based telementoring may be a promising approach for improving engagement and satisfaction with training initiatives aimed at promoting evidence-based school mental health practices. However, further study of ProjectECHO using experimental designs is needed to make causal inferences about its effect on provider outcomes.

Strategic Directions in Preventive Intervention Research to Advance Health Equity

As commissioned by the Society for Prevention Research, this paper describes and illustrates strategic approaches for reducing health inequities and advancing health equity when adopting an equity-focused approach for applying prevention science evidence-based theory, methodologies, and practices. We introduce an ecosystemic framework as a guide for analyzing, designing, and planning innovative equity-focused evidence-based preventive interventions designed to attain intended health equity outcomes. To advance this process, we introduce a health equity statement for conducting integrative analyses of ecosystemic framework pathways, by describing the role of social determinants, mechanisms, and interventions as factors directly linked to specific health equity outcomes. As background, we present health equity constructs, theories, and research evidence which can inform the design and development of equity-focused intervention approaches. We also describe multi-level interventions that when coordinated can produce synergistic intervention effects across macro, meso, and micro ecological levels. Under this approach, we encourage prevention and implementation scientists to apply and extend these strategic directions in future research to increase our evidence-based knowledge and theory building. A general goal is to apply prevention science knowledge to design, widely disseminate, and implement culturally grounded interventions that incrementally attain specific HE outcomes and an intended HE goal. We conclude with recommendations for conducting equity-focused prevention science research, interventions, and training.

Studying the implementation of Zero Suicide in a large health system: Challenges, adaptations, and lessons learned

Background

Suicide remains the 10th leading cause of death in the United States. Many patients presenting to healthcare settings with suicide risk are not identified and their risk mitigated during routine care. Our aim is to describe the planned methodology for studying the implementation of the Zero Suicide framework, a systems-based model designed to improve suicide risk detection and treatment, within a large healthcare system.

Methods

We planned to use a stepped wedge design to roll-out the Zero Suicide framework over 4 years with a total of 39 clinical units, spanning emergency department, inpatient, and outpatient settings, involving ∼310,000 patients. We used Lean, a widely adopted a continuous quality improvement (CQI) model, to implement improvements using a centralize "hub" working with smaller "spoke" teams comprising CQI personnel, unit managers, and frontline staff.

Results

Over the course of the study, five major disruptions impacted our research methods, including a change in The Joint Commission's safety standards for suicide risk mitigation yielding massive system-wide changes and the COVID-19 pandemic. What had been an ambitious program at onset became increasingly challenging because of the disruptions, requiring significant adaptations to our implementation approach and our study methods.

Conclusions

Real-life obstacles interfered markedly with our plans. While we were ultimately successful in implementing Zero Suicide, these obstacles led to adaptations to our approach and timeline and required substantial changes in our study methodology. Future studies of quality improvement efforts that cut across multiple units and settings within a given health system should avoid using a stepped-wedge design with randomization at the unit level if there is the potential for sentinel, system-wide events.

Development of the SPREAD framework to support the scaling of de-implementation strategies: a mixed-methods study

OBJECTIVE

We aimed to increase the understanding of the scaling of de-implementation strategies by identifying the determinants of the process and developing a determinant framework.

DESIGN AND METHODS

This study has a mixed-methods design. First, we performed an integrative review to build a literature-based framework describing the determinants of the scaling of healthcare innovations and interventions. PubMed and EMBASE were searched for relevant studies from 1995 to December 2020. We systematically extracted the determinants of the scaling of interventions and developed a literature-based framework. Subsequently, this framework was discussed in four focus groups with national and international de-implementation experts. The literature-based framework was complemented by the findings of the focus group meetings and adapted for the scaling of de-implementation strategies.

RESULTS

The literature search resulted in 42 articles that discussed the determinants of the scaling of innovations and interventions. No articles described determinants specifically for de-implementation strategies. During the focus groups, all participants agreed on the relevance of the extracted determinants for the scaling of de-implementation strategies. The experts emphasised that while the determinants are relevant for various countries, the implications differ due to different contexts, cultures and histories. The analyses of the focus groups resulted in additional topics and determinants, namely, medical training, professional networks, interests of stakeholders, clinical guidelines and patients' perspectives. The results of the focus group meetings were combined with the literature framework, which together formed the supporting the scaling of de-implementation strategies (SPREAD) framework. The SPREAD framework includes determinants from four domains: (1) scaling plan, (2) external context, (3) de-implementation strategy and (4) adopters.

CONCLUSIONS

The SPREAD framework describes the determinants of the scaling of de-implementation strategies. These determinants are potential targets for various parties to facilitate the scaling of de-implementation strategies. Future research should validate these determinants of the scaling of de-implementation strategies.

Behavioral Parent Training for Families With Young Deaf or Hard of Hearing Children Followed in Hearing Health Care

PURPOSE

It is well established that individuals with a communication disability, including being deaf or hard of hearing (DHH), experience inequities in health services and outcomes. These inequities extend to DHH children's access to psychosocial evidence-based interventions (EBIs). Behavioral parent training is an EBI that can be used to improve caregiver and child outcomes. Despite being supported by decades of effectiveness research, this EBI is rarely accessed by, or studied with, caregivers of DHH children. The purpose of this article is to describe a program of stakeholder-engaged research adapting and assessing behavioral parent training with caregivers of young DHH children followed in hearing health care, aimed at reducing inequities in access to this EBI.

METHOD

The first section briefly summarizes the literature on disruptive behavior problems in young children, with a focus on preschool-age DHH children. The evidence base for behavioral parent training is described. Next, the gaps in knowledge and practice regarding disruptive behaviors among DHH children are highlighted, and the potential integration of behavioral parent training into the standard of care for this population is proposed.

CONCLUSIONS

Young DHH children who use hearing aids and/or cochlear implants experience disruptive behavior problems at rates at least as high as typically hearing children, but their access to EBIs is limited, and behavioral parent training programs tailored to this population have not been rigorously tested. Caregivers and hearing health care service providers affirm the potential benefits of behavioral parent training and were partners in adapting this EBI. This research highlights several principles and approaches essential for reducing inequities and improving the quality of life not only for DHH children and their families but also for individuals with communication disabilities more broadly: engagement of key stakeholders in research, collaboration across disciplines, and using implementation science methods and models to design for implementation, dissemination, and sustainment. Presentation Video: https://doi.org/10.23641/asha.21215900.

Mental Health Reform: Design and Implementation of a System to Optimize Outcomes for Veterans and Their Families

The social, health, and economic burden of mental health problems in the veteran community is heavy. Internationally, the array of services and support available to veterans and their families are extensive but vary in quality, are often disconnected, complex to navigate, and lack clear coordination. This paper describes a conceptual framework to guide the design and implementation of a system of services and supports to optimize the mental health and wellbeing of all veterans and their families. The framework recognizes the diversity of veterans across intersecting identities that uniquely shape experiences of posttraumatic mental health and wellbeing. It brings together several strands of research: the values and principles that should underpin the system; the needs of diverse veterans and their families; challenges in the current services and supports; evidence-based interventions; and principles of effective implementation. Central to the future system design is a next generation stepped model of care that organizes best and next practice interventions in a coherent system, matches service provision to level of need and addresses access and navigation. Practical guidance on implementation provides an aspirational and flexible structure for system evolution, and a template for all stakeholders-individuals, groups, agencies and organizations-to effect system change.

Combined Race and Gender Trend Disparities in Depressive Symptoms among U.S. High School Students: 1999-2019

In 2019, over 3.2 million adolescents in the U.S. reported depressive symptoms-a number that continues to increase annually. Not only can depression negatively impact an adolescent's academic performance, social development, and cognitive function, but it is also the most common condition associated with suicide. Previous studies have reported prevalence rates and statistical trends by either gender or race. We conducted an in-depth analysis of the current racial and gender trend disparities in adolescent depressive symptoms by examining linear and quadratic trends from the Youth Behavior Risk Survey (N = 158,601) over two decades (1999-2019), stratified by gender and race subgroups, both separately and combined. This novel quantitative method allows for a more nuanced approach when exploring social and cultural influences on adolescent depressive symptoms. We found a significant difference in the prevalence of depressive symptoms between males and females among Black, Hispanic, and multiracial adolescents in each separate year of pooled data. However, an increased prevalence trend over the 20-year period was only seen among the females of these three racial categories. White and Asian female adolescents also exhibited a statistical increase in prevalence of depressive symptoms over time. The only group of males with a significant trend increase over time were White adolescents. Understanding the intersection of gender and race in adolescent depressive symptoms trends enhances evidence for nurses and other healthcare professionals when developing and implementing targeted, effective prevention and intervention measures.

Visitors' Assessment and Utilization of Evidence-Based Program Resources (EBPR) Websites

Background: Evidence-based program resources (EBPR) websites for behavioral health are a potentially useful tool to assist decision-makers and practitioners in deciding which behavioral health interventions to implement. EBPR websites apply rigorous research standards to assess the effectiveness of behavioral healthcare programs, models, and clinical practices. Method: Visitors to a convenience sample of six EBPR websites (N=369, excluding students) were recruited for telephone interviews primarily by means of a pop-up invitation on the sites. Results: The visitors view the EBPR sites as important sources of information to support the identification and adoption of evidence-based programs/practices (EBPs) in behavioral healthcare, which aligns with the primary mission of EBPRs. For repeat visitors, there was some indication that the information obtained helped effect certain changes in their agencies' programs and policies. However, increased or improved guidance on EBP implementation was also requested. Conclusion: EBPR websites should be better publicized to the behavioral healthcare field.

Trends and Opportunities for Bridging Prevention Science and US Federal Policy

Prevention science sheds light on complex social policy problems, yet its social impact cannot reach full potential without the uptake of research evidence by policymakers. This mixed-methods study examined the US federal legislation pertaining to justice-involved youth to reveal opportunities for strengthening the use of prevention science in legislation. The results indicated that research language, particularly references to the type of study (e.g., longitudinal) or methodology (e.g., data mining), within bills predicted bill progression out of committee and enactment. Rigorous scientific methods may either lend credence to a bill during its progression in the legislative process or may be infused in language during mark-up and negotiation of bills that successfully progress in Congress. In-depth bill coding illustrated the ways that research has been used in legislation to define problems, reinforce effective practice, generate knowledge through research and evaluation, and disseminate findings. A prominent implication of these findings is that policies could be used to improve data monitoring and evaluation capacity in ways that enhance the implementation of evidence-based interventions. The comprehensive use of research in legislation increases the likelihood that policies reach their intended outcomes and benefit those they are designed to serve.

Variations in Definitions of Evidence-Based Interventions for Behavioral Health in Eight Selected U.S. States

BACKGROUND

U.S. state legislatures fill a vital role in supporting the use of evidence-based interventions (EBIs) through statutes and regulations (mandates).

OBJECTIVE

The study determined the terms used by selected states to describe EBIs and how those terms are defined in mandates.

RESEARCH METHODS

The mandates of eight purposely selected states were accessed and coded using the Westlaw Legal Research Database.

RESULTS

Considerable variation was found in the terms used by states to describe EBIs. Although "evidence-based" was the most frequently utilized term (60% of mandates), an additional 29 alternative terms appeared with varying frequencies. Most terms were simply mentioned, with no further definition or elaboration. When terms were further defined or elaborated, the majority were defined using numerous and different types of external sources or references. Three approaches were found in the mandates defining EBIs: "single definition," "hierarchies of evidence levels," and "best available evidence"; the states differed considerably in the approaches used in their mandates.

CONCLUSIONS

The variations in EBI-related terminology across states and within states, coupled with a lack of elaboration on the meaning of important terms and the predominant use of external rather than internal guidelines, may be a source of confusion for behavioral health provider agencies that seek direction about what constitutes an EBI. Prior studies indicate that many agencies may lack staff with the technical ability to adequately evaluate what constitutes an EBI. Thus, lack of clear guidance from official state government mandates may impede the implementation of EBIs within states.

How substance use prevention research gets used in United States federal policy

BACKGROUND AND AIMS

The growing body of research evidence on substance use and substance use disorder (SU/SUD) prevention could be leveraged to strengthen the intended impact of policies that address SU/SUD. The aim of the present study was to explore how research was used in United States federal legislation that emphasized SU/SUD prevention.

DESIGN

Using a mixed-methods approach, we assessed whether the use of research predicted a bill's legislative progress. We randomly sampled 10 bills that represented different types of research keywords to examine how research was used in these bills, applying content analysis.

SETTING

United States Congress.

PARTICIPANTS/CASES

Federal legislation introduced between the 101st and the 114th Congresses (1989-2017; n = 1866).

MEASUREMENTS

The quantitative outcome measures were bills' likelihood of passing out of committee and being enacted. Qualitative outcomes included the ways research was used in legislation.

FINDINGS

Bills that used any research language were 2.2 times more likely to pass out of committee (OR = 2.18; 95% CI, 1.75, 2.72) and 82% more likely to be enacted (OR = 1.82; 95% CI, 1.23, 2.69) than bills not using research language. Bills using dissemination words were 57% more likely to pass out of committee (OR = 1.57; CI, 1.08, 2.28) and analysis words were 93% more likely (OR = 1.93; 95% CI, 1.51, 2.47) than bills not using dissemination or analysis words. Research was used to (i) define the problem to justify legislative action, (ii) address the problem by providing funding, and (iii) address the problem through industry regulations. However, there was a lack of research use that targets underlying risk and protective factors.

CONCLUSIONS

In the US Congress, substance use and substance use disorder prevention bills that use research language appear to be more likely to progress in the legislative cycle than bills that do not, suggesting that legislation using research may be viewed as more credible.

Clearinghouse Standards of Evidence on the Transparency, Openness, and Reproducibility of Intervention Evaluations

Clearinghouses are influential repositories of information on the effectiveness of social interventions. To identify which interventions are "evidence-based," clearinghouses review intervention evaluations using published standards of evidence that focus primarily on internal validity and causal inferences. Open science practices can improve trust in evidence from evaluations on the effectiveness of social interventions. Including open science practices in clearinghouse standards of evidence is one of many efforts that could increase confidence in designations of interventions as "evidence-based." In this study, we examined the policies, procedures, and practices of 10 federal evidence clearinghouses that review preventive interventions-an important and influential subset of all evidence clearinghouses. We found that seven consider at least one open science practice when evaluating interventions: replication (6 of 10 clearinghouses), public availability of results (6), investigator conflicts of interest (3), design and analysis transparency (3), study registration (2), and protocol sharing (1). We did not identify any policies, procedures, or practices related to analysis plan registration, data sharing, code sharing, material sharing, and citation standards. We provide a framework with specific recommendations to help federal and other evidence clearinghouses implement the Transparency and Openness Promotion (TOP) Guidelines. Our proposed "TOP Guidelines for Clearinghouses" includes reporting whether evaluations used open science practices, incorporating open science practices in their standards for receiving "evidence-based" designations, and verifying that evaluations used open science practices. Doing so could increase the trustworthiness of evidence used for policy making and support improvements throughout the evidence ecosystem.

References to Evidence-based Program Registry (EBPR) websites for behavioral health in U.S. state government statutes and regulations

BACKGROUND AND AIM

U.S. state governments have the responsibility to regulate and license behavioral healthcare interventions, such as for addiction and mental illness, with increasing emphasis on implementing evidence-based programs (EBPs). A serious obstacle to this is lack of clarity or agreement about what constitutes "evidence-based." The study's purpose was to determine the extent to which and in what contexts web-based Evidence-based Program Registries (EBPRs) are referenced in state government statutes and regulations ("mandates") concerning behavioral healthcare. Examples are: What Works Clearinghouse; National Register of Evidence-based Programs and Practices; Cochrane Database of Systematic Reviews.

METHODS

The study employed the Westlaw Legal Research Database to search for 30 known EBPR websites relevant to behavioral healthcare within the statutes and regulations of all 50 states.

RESULTS

There was low prevalence of EBPR references in state statutes and regulations pertaining to behavioral healthcare; 20 states had a total of 33 mandates that referenced an EBPR. These mandates usually do not rely on an EBPR as the sole acceptable source for classifying a program or practice as "evidence-based." Instead, EBPRs were named in conjunction with internal state or external sources of information about putative program effectiveness, which may be less valid than EBPRs, to determine what is "evidence-based."

CONCLUSION

Greater awareness of scientifically - based EBPRs and greater understanding of their advantages need to be fostered among state legislators and regulators charged with making policy to increase or improve the use of evidence-based programs and practices in behavioral healthcare in the U.S.

A Smartphone App for Parental Management of Adolescent Conduct Problems: Randomized Clinical Trial of iKinnect

OBJECTIVE

This study evaluates iKinnect, a linked caregiver-teen mobile app system designed to address serious adolescent conduct problems through a focus on key targets of evidence-based treatments for juvenile offending, such as parent expectation setting, monitoring, consistency, and positive reinforcement. Additional gamification and autonomy-supporting features are designed to maximize youth engagement. Digital therapeutics such as mobile apps have great potential to expand access to effective interventions, particularly for youth who engage in serious conduct problems and substance abuse, since most never receive an evidence-based treatment and few apps exist for these concerns.

METHODS

This randomized clinical trial used a short-term (12 week) longitudinal design with four time points. Recruited was a U.S. national sample of teens (n = 72, age 13-17, 59.7% male, 68.1% White) receiving services for a serious conduct problem and their primary caregiver. The efficacy of iKinnect, used by parent and teen dyads, was measured against an active control condition, Life360, an app that provided mutual GPS-based location tracking to dyads.

RESULTS

Across 12 weeks of app use, youth who used iKinnect showed significantly greater reductions in alcohol use, marijuana use, school delinquency, status offenses, and general delinquency than did controls. Parents who used iKinnect Reported greater improvements in structure/rule clarity and discipline consistency relative to control parents. Teen and parent iKinnect app use and acceptability ratings were high.

CONCLUSIONS

Real-world use of iKinnect in future applications can, like other emerging digital health technologies, help to expand the reach of evidence-based interventions to children, youth, and families.Registered at clinicaltrials.gov (NCT03065517).