Protocol for a hybrid type 3 effectiveness-implementation trial of a pragmatic individual-level implementation strategy for supporting school-based prevention programming

BACKGROUND

For approximately one in five children who have social, emotional, and behavioral (SEB) challenges, accessible evidence-based prevention practices (EBPPs) are critical. In the USA, schools are the primary setting for children's SEB service delivery. Still, EBPPs are rarely adopted and implemented by front-line educators (e.g., teachers) with sufficient fidelity to see effects. Given that individual behavior change is ultimately required for successful implementation, focusing on individual-level processes holds promise as a parsimonious approach to enhance impact. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a pragmatic, multifaceted pre-implementation strategy targeting volitional and motivational mechanisms of educators' behavior change to enhance implementation and student SEB outcomes. This study protocol describes a hybrid type 3 effectiveness-implementation trial designed to evaluate the main effects, mediators, and moderators of the BASIS-T implementation strategy as applied to Positive Greetings at the Door, a universal school-based EBPP previously demonstrated to reduce student disruptive behavior and increase academic engagement.

METHODS

This project uses a blocked randomized cohort design with an active comparison control (ACC) condition. We will recruit and include approximately 276 teachers from 46 schools randomly assigned to BASIS-T or ACC conditions. Aim 1 will evaluate the main effects of BASIS-T on proximal implementation mechanisms (attitudes, subjective norms, self-efficacy, intentions to implement, and maintenance self-efficacy), implementation outcomes (adoption, reach, fidelity, and sustainment), and child outcomes (SEB, attendance, discipline, achievement). Aim 2 will examine how, for whom, under what conditions, and how efficiently BASIS-T works, specifically by testing whether the effects of BASIS-T on child outcomes are (a) mediated via its putative mechanisms of behavior change, (b) moderated by teacher factors or school contextual factors, and (c) cost-effective.

DISCUSSION

This study will provide a rigorous test of BASIS-T-a pragmatic, theory-driven, and generalizable implementation strategy designed to target theoretically-derived motivational mechanisms-to increase the yield of standard EBPP training and support strategies.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT05989568. Registered on May 30, 2023.

Findings from an Organizational Context Survey to Inform the Implementation of a Collaborative Care Study for Co-occurring Disorders

Primary care is an opportune setting to deliver treatments for co-occurring substance use and mental health disorders; however, treatment delivery can be challenging due multi-level implementation barriers. Documenting organizational context can provide insight into implementation barriers and the adaptation of new processes into usual care workflows. This study surveyed primary care and behavioral health staff from 13 clinics implementing a collaborative care intervention for opioid use disorders co-occurring with PTSD and/or depression as part of a multisite randomized controlled trial. A total of 323 completed an online survey for a 60% response rate. The Consolidated Framework for Implementation Research guided this assessment of multi-level factors that influence implementation. Most areas for improvement focused on inner setting (organizational level) constructs whereas individual-level constructs tended to be strengths. This work addresses a research gap regarding how organizational analyses can be used prior to implementation and provides practical implications for researchers and clinic leaders.

Care coordination between rural primary care and telemedicine to expand medication treatment for opioid use disorder: Results from a single-arm, multisite feasibility study

PURPOSE

The use of telemedicine (TM) has accelerated in recent years, yet research on the implementation and effectiveness of TM-delivered medication treatment for opioid use disorder (MOUD) has been limited. This study investigated the feasibility of implementing a care coordination model involving MOUD delivered via an external TM provider for the purpose of expanding access to MOUD for patients in rural settings.

METHODS

The study tested a care coordination model in 6 rural primary care sites by establishing referral and coordination between the clinic and a TM company for MOUD. The intervention spanned approximately 6 months from July/August 2020 to January 2021, coinciding with the peak of the COVID-19 pandemic. Each clinic tracked patients with OUD in a registry during the intervention period. A pre-/post-intervention design (N = 6) was used to assess the clinic-level outcome as patient-days on MOUD based on patient electronic health records.

FINDINGS

All clinics implemented critical components of the intervention, with an overall TM referral rate of 11.7% among patients in the registry. Five of the 6 sites showed an increase in patient-days on MOUD during the intervention period compared to the 6-month period before the intervention (mean increase per 1,000 patients: 132 days, P = .08, Cohen's d = 0.55). The largest increases occurred in clinics that lacked MOUD capacity or had a greater number of patients initiating MOUD during the intervention period.

CONCLUSIONS

To expand access to MOUD in rural settings, the care coordination model is most effective when implemented in clinics that have negligible or limited MOUD capacity.

Screening for opioid use disorder and co-occurring depression and post-traumatic stress disorder in primary care in New Mexico

BACKGROUND

Identifying patients in primary care services with opioid use disorder and co-occurring mental health disorders is critical to providing treatment. Objectives of this study were to (1) assess the feasibility of recruiting people to screen in-person for opioid use disorder and co-occurring mental health disorders (depression and/or post-traumatic stress disorder) in primary care clinic waiting rooms in preparation for a randomized controlled trial, and (2) compare results of detecting these disorders by universal in-person screening compared to electronic health record (EHR) diagnoses.

METHODS

This cross-sectional feasibility and pilot study recruited participants from four primary care clinics, two rural and two urban, from three health care organizations in New Mexico. Inclusion criteria were adults (≥ 18 years), attending one of the four clinics as a patient, and who spoke English or Spanish. Exclusion criteria were people attending the clinic for a non-primary care visit (e.g., dental, prescription pick up, social support). The main outcomes and measures were (1) recruitment feasibility which was assessed by frequencies and proportions of people approached and consented for in-person screening, and (2) relative differences of detecting opioid use disorder and co-occurring mental health disorders in waiting rooms relative to aggregate EHR data from each clinic, measured by prevalence and prevalence ratios.

RESULTS

Over two-weeks, 1478 potential participants were approached and 1145 were consented and screened (77.5% of patients approached). Probable opioid use disorder and co-occurring mental health disorders were identified in 2.4% of those screened compared to 0.8% in EHR. Similarly, universal screening relative to EHR identified higher proportions of probable opioid use disorder (4.5% vs. 3.4%), depression (17.5% vs. 12.7%) and post-traumatic stress disorder (19.0% vs. 3.6%).

CONCLUSIONS

Universal screening for opioid use disorder, depression, and post-traumatic stress disorder was feasible, and identified three times as many patients with these co-occurring disorders compared to EHR. Higher proportions of each condition were also identified, especially post-traumatic stress disorder. Results support that there are likely gaps in identification of these disorders in primary care services and demonstrate the need to better address the persistent public health problem of these co-occurring disorders.

Ethnography and user-centered design to inform context-driven implementation

Despite pervasive findings pointing to its inextricable role in intervention implementation, context remains poorly understood in implementation science. Existing approaches for describing context (e.g., surveys, interviews) may be narrow in scope or superficial in their elicitation of contextual data. Thus, in-depth and multilevel approaches are needed to meaningfully describe the contexts into which interventions will be implemented. Moreover, many studies assess context without subsequently using contextual information to enhance implementation. To be useful for improving implementation, though, methods are needed to apply contextual information during implementation. In the case example presented in this paper, we embedded an ethnographic assessment of context within a user-centered design approach to describe implementation context and apply that information to promote implementation. We developed a patient-reported outcome measure-based clinical intervention to assess and address the pervasive unmet needs of young adults with cancer: the Needs Assessment & Service Bridge (NA-SB). In this paper, we describe the user-centered design process that we used to anticipate context modifications needed to deliver NA-SB and implementation strategies needed to facilitate its implementation. Our ethnographic contextual inquiry yielded a rich understanding of local implementation context and contextual variation across potential scale-up contexts. Other methods from user-centered design (i.e., translation tables and a design team prototyping workshop) allowed us to translate that information into specifications for NA-SB delivery and a plan for implementation. Embedding ethnographic methods within a user-centered design approach can help us to tailor interventions and implementation strategies to their contexts of use to promote implementation.

Harmonizing evidence-based practice, implementation context, and implementation strategies with user-centered design: a case example in young adult cancer care

BACKGROUND

Attempting to implement evidence-based practices in contexts for which they are not well suited may compromise their fidelity and effectiveness or burden users (e.g., patients, providers, healthcare organizations) with elaborate strategies intended to force implementation. To improve the fit between evidence-based practices and contexts, implementation science experts have called for methods for adapting evidence-based practices and contexts and tailoring implementation strategies; yet, methods for considering the dynamic interplay among evidence-based practices, contexts, and implementation strategies remain lacking. We argue that harmonizing the three can be facilitated by user-centered design, an iterative and highly stakeholder-engaged set of principles and methods.

METHODS

This paper presents a case example in which we used a three-phase user-centered design process to design and plan to implement a care coordination intervention for young adults with cancer. Specifically, we used usability testing to redesign and augment an existing patient-reported outcome measure that served as the basis for our intervention to optimize its usability and usefulness, ethnographic contextual inquiry to prepare the context (i.e., a comprehensive cancer center) to promote receptivity to implementation, and iterative prototyping workshops with a multidisciplinary design team to design the care coordination intervention and anticipate implementation strategies needed to enhance contextual fit.

RESULTS

Our user-centered design process resulted in the Young Adult Needs Assessment and Service Bridge (NA-SB), including a patient-reported outcome measure and a collection of referral pathways that are triggered by the needs young adults report, as well as implementation guidance. By ensuring NA-SB directly responded to features of users and context, we designed NA-SB for implementation, potentially minimizing the strategies needed to address misalignment that may have otherwise existed. Furthermore, we designed NA-SB for scale-up; by engaging users from other cancer programs across the country to identify points of contextual variation which would require flexibility in delivery, we created a tool intended to accommodate diverse contexts.

CONCLUSIONS

User-centered design can help maximize usability and usefulness when designing evidence-based practices, preparing contexts, and informing implementation strategies-in effect, harmonizing evidence-based practices, contexts, and implementation strategies to promote implementation and effectiveness.

An actionable needs assessment for adolescents and young adults with cancer: the AYA Needs Assessment & Service Bridge (NA-SB)

PURPOSE

In the USA, many of the nearly 90,000 adolescents and young adults (AYAs) diagnosed with cancer each year do not receive services to address the full scope of needs they experience during and after cancer treatment. To facilitate a systematic and patient-centered approach to delivering services to address the unmet needs of AYAs with cancer, we developed the AYA Needs Assessment & Service Bridge (NA-SB).

METHODS

To develop NA-SB, we leveraged user-centered design, an iterative process for intervention development based on prospective user (i.e., provider and AYA) engagement. Specifically, we conducted usability testing and concept mapping to refine an existing tool-the Cancer Needs Questionnaire-Young People-to promote its usability and usefulness in routine cancer practice.

RESULTS

Our user-centered design process yielded a need assessment which assesses AYAs' physical, psychosocial, and practical needs. Importantly, needs in the assessment are grouped by services expected to address them, creating an intuitive and actionable link between needs and services.

CONCLUSION

NA-SB has the potential to improve care coordination at the individual level by allowing cancer care programs to tailor service delivery and resource provision to the individual needs of AYAs they serve.

Testing the Community-Based Learning Collaborative (CBLC) implementation model: a study protocol

Background

High rates of youth exposure to violence, either through direct victimization or witnessing, result in significant health/mental health consequences and high associated lifetime costs. Evidence-based treatments (EBTs), such as Trauma-Focused Cognitive Behavioral Therapy (TF-CBT), can prevent and/or reduce these negative effects, yet these treatments are not standard practice for therapists working with children identified by child welfare or mental health systems as needing services. While research indicates that collaboration among child welfare and mental health services sectors improves availability and sustainment of EBTs for children, few implementation strategies designed specifically to promote and sustain inter-professional collaboration (IC) and inter-organizational relationships (IOR) have undergone empirical investigation. A potential candidate for evaluation is the Community-Based Learning Collaborative (CBLC) implementation model, an adaptation of the Learning Collaborative which includes strategies designed to develop and strengthen inter-professional relationships between brokers and providers of mental health services to promote IC and IOR and achieve sustained implementation of EBTs for children within a community.

Methods/design

This non-experimental, mixed methods study involves two phases: (1) analysis of existing prospective quantitative and qualitative quality improvement and project evaluation data collected pre and post, weekly, and monthly from 998 participants in one of seven CBLCs conducted as part of a statewide initiative; and (2) Phase 2 collection of new quantitative and qualitative (key informant interviews) data during the funded study period to evaluate changes in relations among IC, IOR, social networks and the penetration and sustainment of TF-CBT in targeted communities. Recruitment for Phase 2 is from the pool of 998 CBLC participants to achieve a targeted enrollment of n = 150. Study aims include: (1) Use existing quality improvement (weekly/monthly online surveys; pre-post surveys; interviews) and newly collected quantitative (monthly surveys) and qualitative (key informant interviews) data and social network analysis to test whether CBLC strategies are associated with penetration and sustainment of TF-CBT; and (2) Use existing quantitative quality improvement (weekly/monthly on-line surveys; pre/post surveys) and newly collected qualitative (key informant interviews) data and social network analysis to test whether CBLC strategies are associated with increased IOR and IC intensity.

Discussion

The proposed research leverages an on-going, statewide implementation initiative to generate evidence about implementation strategies needed to make trauma-focused EBTs more accessible to children. This study also provides feasibility data to inform an effectiveness trial that will utilize a time-series design to rigorously evaluate the CBLC model as a mechanism to improve access and sustained use of EBTs for children.