Work-Related Cognitive Behavioral Therapy for racially and economically diverse unemployed persons with social anxiety: A randomized clinical trial

Individuals with Social Anxiety Disorder (SAD) are at risk for employment problems. This multi-site trial examined the efficacy of Work-Related Cognitive Behavioral Therapy provided alongside vocational services as usual (WCBT+VSAU), a group-based treatment designed to improve mental health and employment outcomes for individuals with SAD. Vocational service-seeking participants with SAD (N = 250) were randomized to either WCBT+VSAU or VSAU-alone. Hypotheses were that participants randomized to WCBT+VSAU would report less social anxiety, less depression, and more hours worked than participants randomized to VSAU-alone. WCBT+VSAU participants had significantly greater improvements on the Liebowitz Social Anxiety Scale (LSAS; d=-.25, CI=-0.49 to -0.02, p = .03) at post-assessment compared to VSAU-alone. The conditions did not differ on any variable at later time points or on secondary outcomes. Unexpectedly, participants randomized to VSAU-alone experienced LSAS improvements, similar to WCBT+VASU at later timepoints. Baseline psychological flexibility (beta=-.098 [-0.19-0.008]) and depression (beta=-0.18 [-0.34-0.009]) moderated change in social anxiety. Participants with lower psychological flexibility and higher depression responded more strongly to WCBT+VSAU than VSAU-alone over the duration of the study, suggesting that WCBT+VSAU may particularly benefit those with greater psychopathology. Results indicate that vocational centers are promising settings for treating SAD and employment-focused refinements are likely needed to improve work outcomes.

Associations between Posttraumatic Stress Disorder and Diabetes in Vietnam-Era Women Veterans in the HealthViEWS Study

Background: Posttraumatic stress disorder (PTSD) is associated with incident diabetes. However, past studies have often included predominantly male samples, despite important sex and gender differences in diabetes. To address this limitation, this study examined the association between PTSD and diabetes in older Veteran women, a population with a high burden of PTSD. Materials and Methods: Data were collected from 4,105 women (Mage = 67.4 years), participating in the Health of Vietnam-Era Veteran Women's Study (HealthViEWS; Department of Veterans Affairs Cooperative Studies Program #579). Participants completed self-report measures of demographics, health conditions, and health behaviors. Information on military service was obtained through service records. A structured clinical interview was conducted by telephone to assess current and lifetime PTSD and other mental health disorders. Weighted descriptive and logistic regression analyses were used to examine associations between PTSD and diabetes. Results: The prevalence of diabetes was 28.4% among women with current full PTSD compared to 23.4%, 17.6%, and 17.5% for current subthreshold, remitted, and no PTSD. In unadjusted analyses, women with current full and subthreshold PTSD were 1.87 [1.49; 2.33] and 1.44 [1.11; 1.85] times more likely to have diabetes compared to women with no PTSD. Remitted PTSD was not associated with increased odds of diabetes. Effects were attenuated but remained significant after adjustment for relevant covariates. Conclusions: Vietnam-era women with current PTSD, including subthreshold symptoms, had a greater likelihood of diabetes compared to women without PTSD. These findings suggest that women with PTSD may benefit from increased diabetes prevention efforts.

Real-World Depression Screening Practices Among Primary Care Providers Across Patient-Level and Provider-Level Characteristics

This study examined primary care provider (PCP) alignment with guideline-based care for adolescent depression screening and identified factors associated with post-screening responses. A retrospective chart review was conducted across 17 primary care clinics. Logistical regressions were estimated across provider specialties, sociodemographic factors, and patient clinical histories. Significant differences in follow-up and identification of depression were found among patients with more severe depression presentation. Follow-up screening was also more likely to be completed among patients with private insurance and less likely to occur among Black patients. Patients with significant mental health history of a mood concern, history of being prescribed psychotropic medication, were currently on medications at the time of the screening, or had a history of an internal mental health referral had a higher predicted probability of being identified as depressed on the patient problem list.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 3: study protocol to evaluate sustainment in a hybrid type 2 effectiveness-implementation cluster-randomized trial

BACKGROUND

Although research on the implementation of evidence-based psychological treatments (EBPTs) has advanced rapidly, research on the sustainment of implemented EBPTs remains limited. This is concerning, given that EBPT activities and benefits regularly decline post-implementation. To advance research on sustainment, the present protocol focuses on the third and final phase-the Sustainment Phase-of a hybrid type 2 cluster-randomized controlled trial investigating the implementation and sustainment of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for patients with serious mental illness and sleep and circadian problems in community mental health centers (CMHCs). Prior to the first two phases of the trial-the Implementation Phase and Train-the-Trainer Phase-TranS-C was adapted to fit the CMHC context. Then, 10 CMHCs were cluster-randomized to implement Standard or Adapted TranS-C via facilitation and train-the-trainer. The primary goal of the Sustainment Phase is to investigate whether adapting TranS-C to fit the CMHC context predicts improved sustainment outcomes.

METHODS

Data collection for the Sustainment Phase will commence at least three months after implementation efforts in partnering CMHCs have ended and may continue for up to one year. CMHC providers will be recruited to complete surveys (N = 154) and a semi-structured interview (N = 40) on sustainment outcomes and mechanisms. Aim 1 is to report the sustainment outcomes of TranS-C. Aim 2 is to evaluate whether manipulating EBPT fit to context (i.e., Standard versus Adapted TranS-C) predicts sustainment outcomes. Aim 3 is to test whether provider perceptions of fit mediate the relation between treatment condition (i.e., Standard versus Adapted TranS-C) and sustainment outcomes. Mixed methods will be used to analyze the data.

DISCUSSION

The present study seeks to advance our understanding of sustainment predictors, mechanisms, and outcomes by investigating (a) whether the implementation strategy of adapting an EBPT (i.e., TranS-C) to the CMHC context predicts improved sustainment outcomes and (b) whether this relation is mediated by improved provider perceptions of treatment fit. Together, the findings may help inform more precise implementation efforts that contribute to lasting change.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT05956678 . Registered on July 21, 2023.

A mixed methods partner-focused cost and budget impact analysis to deploy implementation strategies for school-based prevention

BACKGROUND

Obtaining information on implementation strategy costs and local budget impacts from multiple perspectives is essential to data-driven decision-making about resource allocation for successful evidence-based intervention delivery. This mixed methods study determines the costs and priorities of deploying Enhanced Replicating Effective Programs (REP) to implement the Michigan Model for Health™, a universal school-based prevention intervention, from key shareholder perspectives.

METHODS

Our study included teachers in 8 high schools across 3 Michigan counties as part of a pilot cluster randomized trial. We used activity-based costing, mapping key Enhanced REP activities across implementation phases. We included multiple perspectives, including state agencies, regional education service agencies, lead organization, and implementers. We also conducted a budget impact analysis (BIA, assessing the potential financial impact of adopting Enhanced REP) and a scenario analysis to estimate replication and account for cost variability. We used an experimental embedded mixed methods approach, conducting semi-structured interviews and collecting field notes during the trial to expand and explain the cost data and the implications of costs across relevant perspectives.

RESULTS

Based on trial results, we estimate costs for deploying Enhanced REP are $11,903/school, with an estimated range between $8263/school and $15,201/school. We estimate that adding four additional schools, consistent with the pilot, would cost $8659/school. Qualitative results indicated misalignment in school and teacher priorities in some cases. Implementation activities, including training and implementation facilitation with the health coordinator, were sometimes in addition to regular teaching responsibilities. The extent to which this occurred was partly due to leadership priorities (e.g., sticking to the district PD schedule) and organizational priorities (e.g., budget).

CONCLUSIONS

Previous research findings indicate that, from a societal perspective, universal prevention is an excellent return on investment. However, notable misalignment in cost burden and priorities exists across shareholder groups. Our results indicate significant personal time costs by teachers when engaging in implementation strategy activities that impose an opportunity cost. Additional strategies are needed to improve the alignment of costs and benefits to enhance the success and sustainability of implementation. We focus on those perspectives informed by the analysis and discuss opportunities to expand a multi-level focus and create greater alignment across perspectives.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04752189. Registered on 12 February 2021.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 3: Study protocol to evaluate sustainment in a hybrid type 2 effectiveness-implementation cluster-randomized trial

treatments (EBPTs) has advanced rapidly, research on the sustainment of implemented EBPTs remains limited. This is concerning, given that EBPT activities and benefits regularly decline post-implementation. To advance research on sustainment, the present protocol focuses on the third and final phase - the Sustainment Phase - of a hybrid type 2 cluster-randomized controlled trial investigating the implementation and sustainment of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for patients with serious mental illness and sleep and circadian problems in community mental health centers (CMHCs). Prior to the first two phases of the trial - the Implementation Phase and Train-the-Trainer Phase - TranS-C was adapted to fit the CMHC context. Then, 10 CMHCs were cluster-randomized to implement Standard or Adapted TranS-C via facilitation and train-the-trainer. The primary goal of the Sustainment Phase is to investigate whether adapting TranS-C to fit the CMHC context predicts improved sustainment outcomes.

Methods

Data collection for the Sustainment Phase will commence at least three months after implementation efforts in partnering CMHCs have ended and may continue for up to one year. CMHC providers will be recruited to complete surveys (N = 154) and a semi-structured interview (N = 40) on sustainment outcomes and mechanisms. Aim 1 is to report the sustainment outcomes of TranS-C. Aim 2 is to evaluate whether manipulating EBPT fit to context (i.e., Standard versus Adapted TranS-C) predicts sustainment outcomes. Aim 3 is to test whether provider perceptions of fit mediate the relation between treatment condition (i.e., Standard versus Adapted TranS-C) and sustainment outcomes. Mixed methods will be used to analyze the data.

Discussion

The present study seeks to advance our understanding of sustainment predictors, mechanisms, and outcomes by investigating (a) whether the implementation strategy of adapting an EBPT (i.e., TranS-C) to the CMHC context predicts improved sustainment outcomes and (b) whether this relation is mediated by improved provider perceptions of treatment fit. Together, the findings may help inform more precise implementation efforts that contribute to lasting change.

Trial Registration

ClinicalTrials.gov identifier: NCT05956678. Registered on July 21, 2023. https://classic.clinicaltrials.gov/ct2/show/NCT05956678?term=NCT05956678&draw=2&rank=1.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: study protocol for a hybrid type 2 effectiveness-implementation cluster-randomized trial using train-the-trainer

BACKGROUND

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes and (b) providers' perceptions of fit.

METHODS

TTT will be implemented in nine CMHCs in California, USA (N = 60 providers; N = 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality), and (3) evaluate other possible moderators.

DISCUSSION

This trial has potential to (a) inform the process of embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) add to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advance our understanding of providers' perceptions of EBPT "fit" across TTT generations.

TRIAL REGISTRATION

ClinicalTrials.gov identifier NCT05805657 . Registered on April 10, 2023.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 2: Study protocol for a hybrid type 2 effectiveness-implementation cluster- randomized trial using train-the-trainer

Background

Train-the-trainer (TTT) is a promising method for implementing evidence-based psychological treatments (EBPTs) in community mental health centers (CMHCs). In TTT, expert trainers train locally embedded individuals (i.e., Generation 1 providers) to deliver an EBPT, who then train others (i.e., Generation 2 providers). The present study will evaluate implementation and effectiveness outcomes of an EBPT for sleep and circadian dysfunction-the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C)-delivered to CMHC patients with serious mental illness by Generation 2 providers (i.e., trained and supervised within CMHCs via TTT). Specifically, we will investigate whether adapting TranS-C to fit CMHC contexts improves Generation 2 (a) patient outcomes (b) providers' perceptions of fit.

Methods

TTT will be implemented in nine CMHCs in California, United States (N= 60 providers; N= 130 patients) via facilitation. CMHCs are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each CMHC, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will assess the effectiveness of TranS-C (combined Adapted and Standard), compared to UC-DT, on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms for Generation 2 patients. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to Generation 2 providers' perceptions of fit. Aim 3 will evaluate whether Generation 2 providers' perceived fit mediates the relation between TranS-C treatment condition and patient outcomes. Exploratory analyses will: (1) evaluate whether the effectiveness of TranS-C for patient outcomes is moderated by generation, (2) compare Adapted and Standard TranS-C on patient perceptions of credibility/improvement and PhenX Toolkit outcomes (e.g., substance use, suicidality); and (3) evaluate other possible moderators.

Discussion

This trial has potential to inform the process of (a) embedding local trainers and supervisors to expand delivery of a promising transdiagnostic treatment for sleep and circadian dysfunction, (b) adding to the growing body of TTT literature by evaluating TTT outcomes with a novel treatment and population, and (c) advancing our understanding of providers' perceptions of EBPT 'fit' across TTT generations.

Trial registration

Clinicaltrials.gov identifier: NCT05805657. Registered on April 10, 2023. https://clinicaltrials.gov/ct2/show/NCT05805657.

How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy

BACKGROUND

Healthcare facilitation, an implementation strategy designed to improve the uptake of effective clinical innovations in routine practice, has produced promising yet mixed results in randomized implementation trials and has not been fully researched across different contexts.

OBJECTIVE

Using mechanism mapping, which applies directed acyclic graphs that decompose an effect of interest into hypothesized causal steps and mechanisms, we propose a more concrete description of how healthcare facilitation works to inform its further study as a meta-implementation strategy.

METHODS

Using a modified Delphi consensus process, co-authors developed the mechanistic map based on a three-step process. First, they developed an initial logic model by collectively reviewing the literature and identifying the most relevant studies of healthcare facilitation components and mechanisms to date. Second, they applied the logic model to write vignettes describing how facilitation worked (or did not) based on recent empirical trials that were selected via consensus for inclusion and diversity in contextual settings (US, international sites). Finally, the mechanistic map was created based on the collective findings from the vignettes.

FINDINGS

Theory-based healthcare facilitation components informing the mechanistic map included staff engagement, role clarification, coalition-building through peer experiences and identifying champions, capacity-building through problem solving barriers, and organizational ownership of the implementation process. Across the vignettes, engagement of leaders and practitioners led to increased socialization of the facilitator's role in the organization. This in turn led to clarifying of roles and responsibilities among practitioners and identifying peer experiences led to increased coherence and sense-making of the value of adopting effective innovations. Increased trust develops across leadership and practitioners through expanded capacity in adoption of the effective innovation by identifying opportunities that mitigated barriers to practice change. Finally, these mechanisms led to eventual normalization and ownership of the effective innovation and healthcare facilitation process.

IMPACT

Mapping methodology provides a novel perspective of mechanisms of healthcare facilitation, notably how sensemaking, trust, and normalization contribute to quality improvement. This method may also enable more efficient and impactful hypothesis-testing and application of complex implementation strategies, with high relevance for lower-resourced settings, to inform effective innovation uptake.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 1: study protocol for a hybrid type 2 effectiveness-implementation cluster-randomized trial

BACKGROUND

Serious mental illness (SMI) can have devastating consequences. Unfortunately, many patients with SMI do not receive evidence-based psychological treatment (EBPTs) in routine practice settings. One barrier is poor "fit" between EBPTs and contexts in which they are implemented. The present study will evaluate implementation and effectiveness outcomes of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) implemented in community mental health centers (CMHCs). TranS-C was designed to target a range of SMI diagnoses by addressing a probable mechanism and predictor of SMI: sleep and circadian problems. We will investigate whether adapting TranS-C to fit CMHC contexts improves providers' perceptions of fit and patient outcomes.

METHODS

TranS-C will be implemented in at least ten counties in California, USA (N = 96 providers; N = 576 clients), via facilitation. CMHC sites are cluster-randomized by county to Adapted TranS-C or Standard TranS-C. Within each county, patients are randomized to immediate TranS-C or usual care followed by delayed treatment with TranS-C (UC-DT). Aim 1 will compare TranS-C (combined Adapted and Standard) with UC-DT on improvements in sleep and circadian problems, functional impairment, and psychiatric symptoms. Sleep and circadian problems will also be tested as a mediator between treatment condition (combined TranS-C versus UC-DT) and functional impairment/psychiatric symptoms. Aim 2 will evaluate whether Adapted TranS-C is superior to Standard TranS-C with respect to provider perceptions of fit. Aim 3 will evaluate whether the relation between TranS-C treatment condition (Adapted versus Standard) and patient outcomes is mediated by better provider perceptions of fit in the Adapted condition. Exploratory analyses will (1) compare Adapted versus Standard TranS-C on patient perceptions of credibility/improvement and select PhenX Toolkit outcomes and (2) evaluate possible moderators.

DISCUSSION

This trial has the potential to (a) expand support for TranS-C, a promising transdiagnostic treatment delivered to patients with SMI in CMHCs; (b) take steps toward addressing challenges faced by providers in delivering EBPTs (i.e., high caseloads, complex patients, poor fit); and (c) advance evidence on causal strategies (i.e., adapting treatments to fit context) in implementation science.

TRIAL REGISTRATION

Clinicaltrials.gov NCT04154631. Registered on 6 November 2019. https://clinicaltrials.gov/ct2/show/NCT04154631.

Michigan Model for HealthTM Learning to Enhance and Adapt for Prevention (Mi-LEAP): protocol of a pilot randomized trial comparing Enhanced Replicating Effective Programs versus standard implementation to deliver an evidence-based drug use prevention curriculum

Background

School-based drug use prevention programs have demonstrated notable potential to reduce the onset and escalation of drug use, including among youth at risk of poor outcomes such as those exposed to trauma. Researchers have found a robust relationship between intervention fidelity and participant (i.e., student) outcomes. Effective implementation of evidence-based interventions, such as the Michigan Model for Health^TM (MMH), is critical to achieving desired public health objectives. Yet, a persistent gap remains in what we know works and how to effectively translate these findings into routine practice. The objective of this study is to design and test a multi-component implementation strategy to tailor MMH to meet population needs (i.e., students exposed to trauma), and improve the population-context fit to enhance fidelity and effectiveness.

Methods

Using a 2-group, mixed-method randomized controlled trial design, this study will compare standard implementation versus Enhanced Replicating Effective Programs (REP) to deliver MMH. REP is a theoretically based implementation strategy that promotes evidence-based intervention (EBI) fidelity through a combination of EBI curriculum packaging, training, and as-needed technical assistance and is consistent with standard MMH implementation. Enhanced REP will tailor the intervention and training to integrate trauma-informed approaches and deploy customized implementation support (i.e., facilitation). The research will address the following specific aims: (1) design and test an implementation strategy (Enhanced REP) to deliver the MMH versus standard implementation and evaluate feasibility, acceptability, and appropriateness using mixed methods, (2) estimate the costs and cost-effectiveness of Enhanced REP to deliver MMH versus standard implementation.

Discussion

This research will design and test a multi-component implementation strategy focused on enhancing the fit between the intervention and population needs while maintaining fidelity to MMH core functions. We focus on the feasibility of deploying the implementation strategy bundle and costing methods and preliminary information on cost input distributions. The substantive focus on youth at heightened risk of drug use and its consequences due to trauma exposure is significant because of the public health impact of prevention. Pilot studies of implementation strategies are underutilized and can provide vital information on designing and testing effective strategies by addressing potential design and methods uncertainties and the effects of the implementation strategy on implementation and student outcomes.

Trial registration

NCT04752189—registered on 8 February 2021 on ClinicalTrials.gov PRS

How the VA is training the Next‐Generation workforce for learning health systems

Objectives

Methods

Results

Conclusions

Primary aim results of a clustered SMART for developing a school-level, adaptive implementation strategy to support CBT delivery at high schools in Michigan

Background

Schools increasingly provide mental health services to students, but often lack access to implementation strategies to support school-based (and school professional [SP]) delivery of evidence-based practices. Given substantial heterogeneity in implementation barriers across schools, development of adaptive implementation strategies that guide which implementation strategies to provide to which schools and when may be necessary to support scale-up.

Methods

A clustered, sequential, multiple-assignment randomized trial (SMART) of high schools across Michigan was used to inform the development of a school-level adaptive implementation strategy for supporting SP-delivered cognitive behavioral therapy (CBT). All schools were first provided with implementation support informed by Replicating Effective Programs (REP) and then were randomized to add in-person Coaching or not (phase 1). After 8 weeks, schools were assessed for response based on SP-reported frequency of CBT delivered to students and/or barriers reported. Responder schools continued with phase 1 implementation strategies. Slower-responder schools (not providing ≥ 3 CBT components to ≥10 students or >2 organizational barriers identified) were re-randomized to add Facilitation to current support or not (phase 2). The primary aim hypothesis was that SPs at schools receiving the REP + Coaching + Facilitation adaptive implementation strategy would deliver more CBT sessions than SPs at schools receiving REP alone. Secondary aims compared four implementation strategies (Coaching vs no Coaching × Facilitation vs no Facilitation) on CBT sessions delivered, including by type (group, brief and full individual). Analyses used a marginal, weighted least squares approach developed for clustered SMARTs.

Results

SPs (n = 169) at 94 high schools entered the study. N = 83 schools (88%) were slower-responders after phase 1. Contrary to the primary aim hypothesis, there was no evidence of a significant difference in CBT sessions delivered between REP + Coaching + Facilitation and REP alone (111.4 vs. 121.1 average total CBT sessions; p = 0.63). In secondary analyses, the adaptive strategy that offered REP + Facilitation resulted in the highest average CBT delivery (154.1 sessions) and the non-adaptive strategy offering REP + Coaching the lowest (94.5 sessions).

Conclusions

The most effective strategy in terms of average SP-reported CBT delivery is the adaptive implementation strategy that (i) begins with REP, (ii) augments with Facilitation for slower-responder schools (schools where SPs identified organizational barriers or struggled to deliver CBT), and (iii) stays the course with REP for responder schools.

Trial registration

ClinicalTrials.gov, NCT03541317, May 30, 2018.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01211-w.

Study protocol: A randomized controlled trial of Raising Our Spirits Together, an entertaining, group-based technology-assisted cognitive behavioral therapy for depression, tailored for rural adults and delivery by clergy

This paper presents a methodological description of a randomized controlled trial (RCT) testing the effect of Raising Our Spirits Together (ROST), a technology-assisted cognitive behavioral therapy (T-CBT) for depression, tailored for the rural context and for delivery by clergy, compared to an enhanced control condition. Depression is among the most common mental health conditions; yet the majority of adults with depression do not receive needed treatment due to limited access to mental health professionals, treatment-associated costs, distance to care, and stigma. These barriers are particularly salient in rural areas of the United States. T-CBT with human support is an accessible and effective treatment for depression; however, currently available T-CBTs have poor completion rates due to the lack of tailoring and other features to support engagement. ROST is a T-CBT specifically tailored for the rural setting and delivery by clergy, who are preferred, informal providers. ROST also presents core CBT content in a simple, jargon-free manner that supports multiple learning preferences. ROST is delivered virtually in a small group format across 8 weekly sessions via videoconferencing software consistent with other clergy-based programs, such as Bible studies or self-help groups. In this study, adults with depressive symptoms recruited from two rural Michigan counties will be randomized to receive ROST versus an enhanced control condition (N = 84). Depressive symptoms post-treatment and at 3 months follow-up according to the Patient Health Questionnaire (PHQ-9) will be the primary outcome. Findings will determine whether ROST is effective for improving depression symptoms in underserved, under resourced rural communities.

The National Heart Lung and Blood Institute Disparities Elimination through Coordinated Interventions to Prevent and Control Heart and Lung Disease Alliance

OBJECTIVE

To describe the National Heart Lung and Blood Institute (NHLBI) sponsored Disparities Elimination through Coordinated Interventions to Prevent and Control Heart and Lung Disease (DECIPHeR) Alliance to support late-stage implementation research aimed at reducing disparities in communities with high burdens of cardiovascular and/or pulmonary disease.

STUDY SETTING

NHBLI funded seven DECIPHeR studies and a Coordinating Center. Projects target high-risk diverse populations including racial and ethnic minorities, urban, rural, and low-income communities, disadvantaged children, and persons with serious mental illness. Two projects address multiple cardiovascular risk factors, three focus on hypertension, one on tobacco use, and one on pediatric asthma.

STUDY DESIGN

The initial phase supports planning activities for sustainable uptake of evidence-based interventions in targeted communities. The second phase tests late-stage evidence-based implementation strategies.

DATA COLLECTION/EXTRACTION METHODS

Not applicable.

PRINCIPAL FINDINGS

We provide an overview of the DECIPHeR Alliance and individual study designs, populations, and settings, implementation strategies, interventions, and outcomes. We describe the Alliance's organizational structure, designed to promote cross-center partnership and collaboration.

CONCLUSIONS

The DECIPHeR Alliance represents an ambitious national effort to develop sustainable implementation of interventions to achieve cardiovascular and pulmonary health equity.

Aligning quality improvement efforts and policy goals in a national integrated health system

OBJECTIVE

To describe the design and impact of a systematic, enterprise-wide process for engaging US Department of Veterans Affairs (VA) leadership in prioritizing scarce implementation and evaluation resources.

DATA SOURCES

From 2017 to 2021, the VA Quality Enhancement Research Initiative (QUERI) identified priorities from local, regional, and national leaders through qualitative discussions and a national survey and tracked impacts via reports generated from competitively funded initiatives addressing these priorities.

STUDY DESIGN

Guided by the Learning Health System framework and QUERI Implementation Roadmap, QUERI engaged stakeholders to nominate and rank-order priorities, peer-reviewed and funded initiatives to scale up and spread evidence-based practices (EBPs) using theory-based implementation strategies, and evaluated the impact of these initiatives using the QUERI Impact Framework.

DATA COLLECTION/EXTRACTION METHODS

QUERI collected priority nominations through qualitative discussions and a web-based survey, and live voting was used to rank-order priorities. QUERI-funded teams regularly submitted progress reports describing the key activities, findings, and impacts of the quality improvement (QI) initiatives using a standardized form created in the VA Research Electronic Data Capture (REDCap).

PRINCIPAL FINDINGS

QUERI launched five QI initiatives to address priorities selected by VA leadership. In partnership with 28 health system leaders, these initiatives are implementing 10 EBPs across 53 sites, supporting 1055 VA employees in delivering evidence-based care. The success of these initiatives led to an expansion of QUERI's process to address 2021 VA leadership priorities: virtual care, health disparities, delayed or suppressed care due to COVID-19, employee burnout, long-term and home care options, and quality and cost of community care.

CONCLUSIONS

QUERI, a unique program embedded in a national integrated health system, deployed a novel approach to inform policy making and enhance the real-world impact of research through prioritization of limited resources, rigorous peer-review, and assessment of impacts on the health system, employees, and Veterans.

Care team and practice-level implementation strategies to optimize pediatric collaborative care: study protocol for a cluster-randomized hybrid type III trial

BACKGROUND

Implementation facilitation is an effective strategy to support the implementation of evidence-based practices (EBPs), but our understanding of multilevel strategies and the mechanisms of change within the "black box" of implementation facilitation is limited. This implementation trial seeks to disentangle and evaluate the effects of facilitation strategies that separately target the care team and leadership levels on implementation of a collaborative care model in pediatric primary care. Strategies targeting the provider care team (TEAM) should engage team-level mechanisms, and strategies targeting leaders (LEAD) should engage organizational mechanisms.

METHODS

We will conduct a hybrid type 3 effectiveness-implementation trial in a 2 × 2 factorial design to evaluate the main and interactive effects of TEAM and LEAD and test for mediation and moderation of effects. Twenty-four pediatric primary care practices will receive standard REP training to implement Doctor-Office Collaborative Care (DOCC) and then be randomized to (1) Standard REP only, (2) TEAM, (3) LEAD, or (4) TEAM + LEAD. Implementation outcomes are DOCC service delivery and change in practice-level care management competencies. Clinical outcomes are child symptom severity and quality of life.

DISCUSSION

This statewide trial is one of the first to test the unique and synergistic effects of implementation strategies targeting care teams and practice leadership. It will advance our knowledge of effective care team and practice-level implementation strategies and mechanisms of change. Findings will support efforts to improve common child behavioral health conditions by optimizing scale-up and sustainment of CCMs in a pediatric patient-centered medical home.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04946253 . Registered June 30, 2021.

Technology-Assisted, Group-Based CBT for Rural Adults' Depression: Open Pilot Trial Results

PURPOSE

This pilot study assesses the association of Raising Our Spirits Together (ROST), a technology-assisted, group-based cognitive behavioral therapy for depression, with rural adults' depressive symptoms and anxiety.

METHOD

Nine adults from rural Michigan participated in an open pilot of ROST. Clergy facilitated pilot groups. The pilot began in February 2020 in-person. Due to COVID-19, the pilot was completed virtually.

RESULTS

Mean depressive symptom scores, based on the PHQ-9, significantly decreased from pre-treatment (M = 14.4) to post-treatment (M = 6.33; t (8) = 6.79; P < .001). Symptom reduction was maintained at 3-month follow-up (M = 8.00), with a significant pattern of difference in depressive symptoms over time (F(2) = 17.7; P < .001; eta-squared = .689). Similar patterns occurred for anxiety based on the GAD-7. Participants attended an average of 7.33 of 8 sessions. Fidelity ratings were excellent.

DISCUSSION

ROST is a potentially feasible intervention for rural adults' depressive symptoms. ROST offers a promising model for increasing treatment access and building capacity in rural areas.

A mixed methods investigation of implementation determinants for a school-based universal prevention intervention

Background

Effective implementation of evidence-based prevention interventions in schools is vital to reducing the burden of drug use and its consequences. Universal prevention interventions often fail to achieve desired public health outcomes due to poor implementation. One central reason for suboptimal implementation is the limited fit between the intervention and the setting. Research is needed to increase our understanding of how intervention characteristics and context influence intervention implementation in schools to design implementation strategies that will address barriers and improve public health impact.

Methods

Using a convergent mixed methods design we examined qualitative and quantitative data on implementation determinants for an evidence-based health curriculum, the Michigan Model for HealthTM (MMH) from the perspective of health teachers delivering the curriculum in high schools across the state. We examined data strands independently and integrated them by investigating data alignment, expansion, and divergence.

Results

We identified three mixed methods domains: (1) Acceptability, (2) intervention-context fit, and (3) adaptability. We found alignment across data strands as teachers reporting low acceptability also reported low fidelity. The fit between student needs and the curriculum predicted fidelity (expansion). Teachers mentioned instances of poor intervention-context fit (discordance), including when meeting the needs of trauma-exposed youth and keeping updated on youth drug use trends. Teachers reported high adaptability (concordance) but also instances when adaptation was challenging (discordance).

Conclusions

This investigation advances implementation research by deepening our understanding of implementation determinants for an evidence-based universal prevention intervention in schools. This will support designing effective implementation strategies to address barriers and advance the public health impact of interventions that address important risk and protective factors for all youth.

Plain Language Summary

(1) What is Already Known About the Topic? While many evidence-based interventions (EBIs) exist to address key health issues among youth including substance use and mental health, few of these interventions are effectively implemented in community settings, such as schools. Notable multilevel barriers exist to implement universal prevention in schools. Researchers identify that misalignment between the intervention and the context is a key reason why many implementation efforts do not achieve desired outcomes. (2) What Does This Paper Add? This paper combines the strengths of qualitative and quantitative research methods to identify and understand challenges to intervention-context fit for a comprehensive health curriculum, the Michigan Model for HealthTM (MMH) which is widely adopted throughout Michigan, from the perspective of end users. This paper also utilizes the consolidated framework for implementation research and implementation outcomes framework to guide our understanding of implementing complex interventions and key barriers to implementation in schools. This research provides a foundation to design effective strategies that will balance curriculum fidelity and adaptation to achieve public health objectives. (3) What are the Implications for Practice, Research, or Policy? We need implementation strategies that guide flexibility and fidelity in EBI delivery in schools. While overall teachers felt the curriculum was adaptable and met student needs, they also mentioned specific instances when they would benefit from additional implementation support, such as making adaptations to meet the needs of trauma-exposed youth and keeping up-to-date with emerging drugs. Implementation strategies designed to address these challenges can improve fidelity and ultimately student well-being.

Translating Violence Prevention Programs from Research to Practice: SafERteens Implementation in an Urban Emergency Department

BACKGROUND

Youth violence is a leading cause of adolescent mortality, underscoring the need to integrate evidence-based violence prevention programs into routine emergency department (ED) care.

OBJECTIVES

To examine the translation of the SafERteens program into clinical care.

METHODS

Hospital staff provided input on implementation facilitators/barriers to inform toolkit development. Implementation was piloted in a four-arm effectiveness-implementation trial, with youth (ages 14-18 years) screening positive for past 3-month aggression randomized to either SafERteens (delivered remotely or in-person) or enhanced usual care (EUC; remote or in-person), with follow-up at post-test and 3 months. During maintenance, ED staff continued in-person SafERteens delivery and external facilitation was provided. Outcomes were measured using the RE-AIM implementation framework.

RESULTS

SafERteens completion rates were 77.6% (52/67) for remote and 49.1% (27/55) for in-person delivery. In addition to high acceptability ratings (e.g., helpfulness), post-test data demonstrated increased self-efficacy to avoid fighting among patients receiving remote (incidence rate ratio [IRR] 1.22, 95% confidence interval [CI] 1.09-1.36) and in-person (IRR 1.23, 95% CI 1.12-1.36) SafERteens, as well as decreased pro-violence attitudes among patients receiving remote (IRR 0.83, 95% CI 0.75-0.91) and in-person (IRR 0.87, 95% CI 0.77-0.99) SafERteens when compared with their respective EUC groups. At 3 months, youth receiving remote SafERteens reported less non-partner aggression (IRR 0.52, 95% CI 0.31-0.87, Cohen's d -0.39) and violence consequences (IRR 0.47, 95% CI 0.22-1.00, Cohen's d -0.49) compared with remote EUC; no differences were noted for in-person SafERteens delivery. Barriers to implementation maintenance included limited staff availability and a lack of reimbursement codes.

CONCLUSIONS

Implementing behavioral interventions such as SafERteens into routine ED care is feasible using remote delivery. Policymakers should consider reimbursement for violence prevention services to sustain long-term implementation.

Understanding key implementation determinants for a school-based universal prevention intervention: a qualitative study

This study examined how teachers discuss various factors as impacting their ability to execute with fidelity the Michigan Model for Health (MMH), an evidence-based health universal prevention curriculum widely adopted throughout Michigan. Researchers have found a robust relationship between fidelity and participant outcomes, including in schools. While previous studies have identified barriers that inhibit fidelity, few have focused on identifying key barriers and deepening our understanding of how these factors influence intervention fidelity. We conducted a thematic analysis using the reflexive thematic approach to identify key barriers and facilitators and deepen our understanding of how these factors influence MMH implementation. Guided by the Consolidated Framework for Implementation Research (CFIR) and the Implementation Outcomes Framework, we conducted semistructured interviews with 23 high school health teachers across Michigan. Teachers identified intervention characteristics (e.g., design quality, packaging, and program adaptability), student needs (e.g., trauma exposure, substances), and the fit between the intervention and the context as factors that contributed to acceptability. They also discussed the curriculum and its alignment with their teaching style and/or experiences as contributing to fidelity. Teachers shared how they would often go "off protocol" to improve intervention-context fit and meet students' needs. Our results identified acceptability, a perceptual implementation outcome, as demonstrating an important role in shaping the relationship between CFIR factors and fidelity. Results provide guidance for systematically designing implementation strategies that address key barriers to improve acceptability, enhance fidelity, and ultimately achieve desired public health objectives.

The Life Goals Self-Management Mobile App for Bipolar Disorder: Consumer Feasibility, Usability, and Acceptability Study

Background

Life Goals is an evidence-based self-management intervention that assists individuals with bipolar disorder (BD) by aligning BD symptom coping strategies with their personal goals. The intervention can be availed via in-person and telephonic sessions, and it has been recently developed as an individualized, customizable mobile app.

Objective

We examined the feasibility, usability, and acceptability of the Life Goals self-management app among individuals diagnosed with BD who used the app for up to 6 months.

Methods

A total of 28 individuals with BD used the Life Goals app on their personal smartphone for 6 months. They completed key clinical outcome measurements of functioning, disability, and psychiatric symptoms at baseline, 3 months, and 6 months, in addition to a poststudy survey about usability and satisfaction.

Results

Participants used the app for a median of 25 times (IQR 13-65.75), and for a longer time during the first 3 months of the study. The modules on depression and anxiety were the most frequently used, accounting for 35% and 22% of total usage, respectively. Overall, the study participants found the app useful (15/25, 60%) and easy to use (18/25, 72%), and they reported that the screen displayed the material adequately (22/25, 88%). However, less than half of the participants found the app helpful in managing their health (10/25, 40%) or in making progress on their wellness goals (9/25, 36%). Clinical outcomes showed a trend for improvements in mental and physical health and mania-related well-being.

Conclusions

The Life Goals app showed feasibility of use among individuals with BD. Higher user engagement was observed in the initial 3 months with users interested more frequently in the mood modules than other wellness modules. Participants reported acceptability with the ease of app use and satisfaction with the app user interface, but the app showed low success in encouraging self-management within this small sample. The Life Goals app is a mobile health technology that can provide individuals with serious mental illness with more flexible access to evidence-based treatments.

Balancing reality in embedded research and evaluation: Low vs high embeddedness

Embedding research and evaluation into organizations is one way to generate “practice‐based” evidence needed to accelerate implementation of evidence‐based innovations within learning health systems. Organizations and researchers/evaluators vary greatly in how they structure and operationalize these collaborations. One key aspect is the degree of embeddedness: from low embeddedness where researchers/evaluators are located outside organizations (eg, outside evaluation consultants) to high embeddedness where researchers/evaluators are employed by organizations and thus more deeply involved in program evolution and operations. Pros and cons related to the degree of embeddedness (low vs high) must be balanced when developing these relationships. We reflect on this process within the context of an embedded, mixed‐methods evaluation of the Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program. Considerations that must be balanced include: (a) low vs high alignment of goals; (b) low vs high involvement in strategic planning; (c) observing what is happening vs being integrally involved with programmatic activities; (d) reporting findings at the project's end vs providing iterative findings and recommendations that contribute to program evolution; and (e) adhering to predetermined aims vs adapting aims in response to evolving partner needs.

The Use of Electronic Health Record Tools to Improve Evidence-Based Treatment of Adolescent Depression in Primary Care

OBJECTIVE

The aim of the current study was to evaluate primary care pediatrician (PCP) adoption of an electronic health record (EHR) documentation tool and their delivery of a behavioral activation (BA) intervention within their routine practice with adolescents who screened positive for depression.

METHODS

We used the RE-AIM framework to describe PCP adoption and implementation of EHR documentation tools and brief evidence-based protocols. Utilization was assessed using a customized toolbar (ie, actions toolbar) via retrospective chart review. A pre-post design was used to measure changes in PCP-reported knowledge, comfort, and feasibility managing depression before and after they were trained. A mixed-effects logistic regression model was used to analyze associations of resource utilization with depression severity.

RESULTS

PCPs used the actions toolbar to document responses to elevated Patient Health Questionnaire (PHQ-9) scores for 29.80% of encounters. The PCPs utilized the BA protocol for 10.5% of encounters with elevated PHQ-9 scores. Higher depression severity categories were associated with significantly higher odds of utilization relative to mild severity. The training was rated highly acceptable and PCPs reported significant post-training increases in comfort and feasibility.

CONCLUSION

This is the first study of its kind to implement and evaluate PCP utilization of an EHR documentation tool aimed to improve delivery of an evidence-based intervention for adolescent depression. Teaching PCPs to implement brief interventions has potential to increase access to evidence-based care; however, large-scale practice change requires an effective implementation strategy that does not increase provider burden and is fully integrated into physician documentation and workflow.

A randomized controlled trial of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) to improve serious mental illness outcomes in a community setting

OBJECTIVE

To determine if the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) improves functional impairment, psychiatric symptoms, and sleep and circadian functioning.

METHOD

Adults diagnosed with serious mental illness (SMI) and sleep and circadian dysfunction (N = 121) were randomly allocated to TranS-C plus usual care (TranS-C + UC; n = 61; 8 individual weekly sessions) or 6 months of Usual Care followed by Delayed Treatment with TranS-C (UC-DT; n = 60). Schizophrenia (45%) and anxiety disorders (47%) were common. Blind assessments were conducted pre-treatment, post-treatment, and 6 months later (6FU). The latter two were the post-randomization points of interest. The location was Alameda County Behavioral Health Care Services (ACBHCS), a Community Mental Health Center (CMHC) in California.

RESULTS

For the primary outcomes, relative to UC-DT, TranS-C + UC was associated with reduction in functional impairment (b = -3.18, p = 0.025, d = -0.58), general psychiatric symptoms (b = -5.88, p = 0.001, d = -0.64), sleep disturbance (b = -5.55, p < .0001, d = -0.96), and sleep-related impairment (b = -9.14, p < .0001, d = -0.81) from pre-treatment to post-treatment. These effects were maintained to 6-month follow-up (6FU; d = -0.42 to -0.82), except functional impairment (d = -0.37). For the secondary outcomes, relative to UC-DT, TranS-C + UC was associated with improvement in sleep efficiency and on the Sleep Health Composite score from pre-treatment to 6FU. TranS-C + UC was also associated with reduced total wake time and wake time variability from pre-treatment to post-treatment, as well as reduced hallucinations and delusions, bedtime variability, and actigraphy measured waking activity count variability from pre-treatment to 6FU.

CONCLUSIONS

A novel transdiagnostic treatment, delivered within a CMHC setting, improves selected measures of functioning, symptoms of comorbid disorders, and sleep and circadian outcomes. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Recommendations for strengthening the role of embedded researchers to accelerate implementation in health systems: Findings from a state-of-the-art (SOTA) conference workgroup

BACKGROUND

Traditional research approaches do not promote timely implementation of evidence-based innovations (EBIs) to benefit patients. Embedding research within health systems can accelerate EBI implementation by blending rigorous methods with practical considerations in real-world settings. A state-of-the-art (SOTA) conference was convened in February 2019 with five workgroups that addressed five facets of embedded research and its potential to impact healthcare. This article reports on results from the workgroup focused on how embedded research programs can be implemented into heath systems for greatest impact.

METHODS

Based on a pre-conference survey, participants indicating interest in accelerating implementation were invited to participate in the SOTA workgroup. Workgroup participants (N = 26) developed recommendations using consensus-building methods. Ideas were grouped by thematic clusters and voted on to identify top recommendations. A summary was presented to the full SOTA membership. Following the conference, the workgroup facilitators (LJD, CDH, NR) summarized workgroup findings, member-checked with workgroup members, and were used to develop recommendations.

RESULTS

The workgroup developed 12 recommendations to optimize impact of embedded researchers within health systems. The group highlighted the tension between "ROI vs. R01" goals-where health systems focus on achieving return on their investments (ROI) while embedded researchers focus on obtaining research funding (R01). Recommendations are targeted to three key stakeholder groups: researchers, funders, and health systems. Consensus for an ideal foundation to support optimal embedded research is one that (1) maximizes learning; (2) aligns goals across all 3 stakeholders; and (3) implements EBIs in a consistent and timely fashion.

CONCLUSIONS

Four cases illustrate a variety of ways that embedded research can be structured and conducted within systems, by demonstrating key embedded research values to enable collaborations with academic affiliates to generate actionable knowledge and meaningfully accelerate implementation of EBIs to benefit patients.

IMPLICATIONS

Embedded research approaches have potential for transforming health systems and impacting patient health. Accelerating embedded research should be a focused priority for funding agencies to maximize a collective return on investment.

A Roadmap to Inform the Implementation of Evidence-Based Collaborative Care Interventions in Communities: Insights From the Michigan Mental Health Integration Partnership

Background: Despite increasing calls for further spread of evidence-based collaborative care interventions (EBIs) in community-based settings, practitioner-driven efforts are often stymied by a lack of experience in addressing barriers to community-based implementation, especially for those not familiar with implementation science. The Michigan Mental Health Integration Partnership (MIP) is a statewide initiative that funds projects that support implementation and uptake of EBIs in community-based settings. MIP also provides an in situ implementation laboratory for understanding barriers to the uptake of EBIs across a variety of settings. We report findings from a statewide qualitative study of practitioners involved in MIP projects to garner their perspectives of best practices in the implementation of EBIs.

Methods: Twenty-eight semi-structured interviews of practitioners and researchers from six MIP Projects were conducted with individuals implementing various MIP EBI projects across Michigan, including stakeholders from project teams, implementation sites, and the State of Michigan, to identify common barriers, challenges, and implementation strategies deployed by the project teams, with the purpose of informing a set of implementation steps and milestones.

Results: Stakeholders identified a number of barriers to and strategies for success, including the need for tailoring program deployment and implementation to specific site needs, development of web-based tools for facilitating program implementation, and the importance of upper-level administration buy-in. Findings informed our resultant community-based Implementation Roadmap, which identifies critical steps across three implementation phases—pre-implementation, implementation, and sustainability—for implementation practitioners to use in their EBI implementation efforts.

Conclusion: Implementation practitioners interested in community-based EBI implementation often lack access to operationalized implementation “steps” or “best practices” that can facilitate successful uptake and evaluation. Our community-informed MIP Implementation Roadmap, offering generalized steps for reaching successful implementation, uses experiences from a diverse set of MIP teams to guide practitioners through the practices necessary for scaling up EBIs in community-based settings over pre-implementation, implementation and sustainability phases.

Development and Implementation of Preoperative Optimization for High-Risk Patients With Abdominal Wall Hernia

IMPORTANCE

Real-world surgical practice often lags behind the best scientific evidence. For example, although optimizing comorbidities such as smoking and morbid obesity before ventral and incisional hernia repair improves outcomes, as many as 25% of these patients have a high-risk characteristic at the time of surgery. Implementation strategies may effectively increase use of evidence-based practice.

OBJECTIVE

To describe current trends in preoperative optimization among patients undergoing ventral hernia repair, identify barriers to optimization, develop interventions to address these barriers, and then pilot these interventions.

DESIGN, SETTING, AND PARTICIPANTS

This quality improvement study used a retrospective medical record review to identify hospital-level trends in preoperative optimization among patients undergoing ventral and incisional hernia repair. Semistructured interviews with 21 practicing surgeons were conducted to elicit barriers to optimizing high-risk patients before surgery. Next, a task force of experts was convened to develop pragmatic interventions to increase surgeon use of preoperative optimization. Finally, these interventions were piloted at 2 sites to assess acceptability and feasibility. This study was performed from January 1, 2014, to December 31, 2019.

MAIN OUTCOMES AND MEASURES

The main outcome was rate of referrals for preoperative patient optimization at the 2 pilot sites.

RESULTS

Among 23 000 patients undergoing ventral hernia repair, the mean (SD) age was 53.9 (14.3) years, and 12 315 (53.5%) were men. Of these, 8786 patients (38.2%) had at least 1 high-risk characteristic at the time of surgery, including 7683 with 1, 1079 with 2, and 24 with 3. At the hospital level, the mean proportion of patients with at least 1 of 3 high-risk characteristics at the time of surgery was 38.2% (95% CI, 38.1%-38.3%). This proportion varied widely from 21.5% (95% CI, 17.6%-25.5%) to 52.8% (95% CI, 43.9%-61.8%) across hospitals. Interviews with surgeons identified 3 major barriers to improving this practice: lost financial opportunity by not offering a patient an operation, lack of surgeon awareness of available resources for optimization, and organizational barriers. A task force therefore developed 3 interventions: a financial incentive to optimize high-risk patients, an educational intervention to make surgeons aware of available optimization resources, and on-site facilitation. These strategies were piloted at 2 sites where preoperative risk optimization referrals increased 860%.

CONCLUSIONS AND RELEVANCE

This study demonstrates a stepwise process of identifying a practice gap, eliciting barriers that contribute to this gap, using expert consensus and local resources to develop strategies to address these barriers, and piloting these strategies. This implementation strategy can be adopted to diverse settings given that it relies on developing and implementing strategies based on local practice patterns.

Development and Implementation of Preoperative Optimization for High-Risk Patients With Abdominal Wall Hernia

IMPORTANCE

Real-world surgical practice often lags behind the best scientific evidence. For example, although optimizing comorbidities such as smoking and morbid obesity before ventral and incisional hernia repair improves outcomes, as many as 25% of these patients have a high-risk characteristic at the time of surgery. Implementation strategies may effectively increase use of evidence-based practice.

OBJECTIVE

To describe current trends in preoperative optimization among patients undergoing ventral hernia repair, identify barriers to optimization, develop interventions to address these barriers, and then pilot these interventions.

DESIGN, SETTING, AND PARTICIPANTS

This quality improvement study used a retrospective medical record review to identify hospital-level trends in preoperative optimization among patients undergoing ventral and incisional hernia repair. Semistructured interviews with 21 practicing surgeons were conducted to elicit barriers to optimizing high-risk patients before surgery. Next, a task force of experts was convened to develop pragmatic interventions to increase surgeon use of preoperative optimization. Finally, these interventions were piloted at 2 sites to assess acceptability and feasibility. This study was performed from January 1, 2014, to December 31, 2019.

MAIN OUTCOMES AND MEASURES

The main outcome was rate of referrals for preoperative patient optimization at the 2 pilot sites.

RESULTS

Among 23 000 patients undergoing ventral hernia repair, the mean (SD) age was 53.9 (14.3) years, and 12 315 (53.5%) were men. Of these, 8786 patients (38.2%) had at least 1 high-risk characteristic at the time of surgery, including 7683 with 1, 1079 with 2, and 24 with 3. At the hospital level, the mean proportion of patients with at least 1 of 3 high-risk characteristics at the time of surgery was 38.2% (95% CI, 38.1%-38.3%). This proportion varied widely from 21.5% (95% CI, 17.6%-25.5%) to 52.8% (95% CI, 43.9%-61.8%) across hospitals. Interviews with surgeons identified 3 major barriers to improving this practice: lost financial opportunity by not offering a patient an operation, lack of surgeon awareness of available resources for optimization, and organizational barriers. A task force therefore developed 3 interventions: a financial incentive to optimize high-risk patients, an educational intervention to make surgeons aware of available optimization resources, and on-site facilitation. These strategies were piloted at 2 sites where preoperative risk optimization referrals increased 860%.

CONCLUSIONS AND RELEVANCE

This study demonstrates a stepwise process of identifying a practice gap, eliciting barriers that contribute to this gap, using expert consensus and local resources to develop strategies to address these barriers, and piloting these strategies. This implementation strategy can be adopted to diverse settings given that it relies on developing and implementing strategies based on local practice patterns.

Learning health systems: Driving real-world impact in mental health and substance use disorder research

The Veterans Health Administration (VHA), under the U.S. Department of Veterans Affairs (VA), is one of the largest single providers of health care in the U.S. VA supports an embedded research program that addresses VA clinical priorities in close partnership with operations leaders, which is a hallmark of a Learning Health System (LHS). Using the LHS framework, we describe current VA research initiatives in mental health and substance use disorders that rigorously evaluate national programs and policies designed to reduce the risk of suicide and opioid use disorder (data to knowledge); test implementation strategies to improve the spread of effective programs for Veterans at risk of suicide or opioid use disorder (knowledge to performance); and identify novel research directions in suicide prevention and opioid/pain treatments emanating from implementation and quality improvement research (performance to data). Lessons learned are encapsulated into best practices for building and sustaining an LHS within health systems, including the need for early engagement with clinical leaders; pragmatic research questions that focus on continuous improvement; multi‐level, ongoing input from regional and local stakeholders, and business case analyses to inform ongoing investment in sustainable infrastructure to maintain the research‐health system partnership. Essential ingredients for supporting VA as an LHS include data and information sharing capacity, protected time for researchers and leaders, and governance structures to enhance health system ownership of research findings. For researchers, incentives to work with health systems operations (e.g., retainer funding) are vital for LHS research to be recognized and valued by academic promotion committees.

The Quality Enhancement Research Initiative (QUERI) Impact Framework: Measuring the Real-world Impact of Implementation Science

BACKGROUND

Measuring the health, economic, and cultural gains generated by scientific investments is crucial to reducing waste and improving quality of care. To date, there is no comprehensive framework for assessing the multi-faceted contributions of implementation and quality improvement sciences towards quality, cost, and patient and provider experiences in health systems.

OBJECTIVE

We describe the Quality Enhancement Research Initiative (QUERI) Impact Framework and its application to QUERI investments.

METHODS

The QUERI Impact Framework adapts and expands on metrics from the National Academy of Medicine, incorporating lessons learned from QUERI initiatives. The cross-cutting impact metrics reflect QUERI's strategic methodology across five domains of impact (Alignment, Commitment, Tailoring, Informing the field, Observing healthcare changes and generating New questions/projects or ACTION). Key impact metrics, including the number of implementation facilities, number of staff trained, and number of patients served, were derived directly from health system performance plan goals. QUERI applied the Framework by conducting iterative rapid assessments of impacts for QUERI Program centers, which are implementation laboratories that support 3-7 initiatives aligned with a cross-disciplinary goal addressing a national priority.

KEY RESULTS

From October 2015 to September 2019, QUERI Programs supported implementation of 49 evidence-based practices and promising innovations across 465 facilities, including 15 facilities that are experiencing quality gaps. As part of these implementation efforts, the programs worked with 71 operations partners to develop 71 tools/toolkits/manuals and support training of 5147 VA staff, serving 250,159 Veterans.

CONCLUSIONS

The QUERI Impact Framework aligns multiple stakeholders at different levels of a health system around common metrics, which cross implementation science and quality improvement boundaries. The Framework supports a comprehensive assessment of the short-term and distal impacts of implementation efforts in a health system, allowing both research and operations leadership to understand the value of implementation and quality improvement investments to inform program and policy decisions.

A Model for Advancing Scale-Up of Complex Interventions for Vulnerable Populations: the ALACRITY Center for Health and Longevity in Mental Illness

Many of the most pressing health issues in the USA and worldwide require complex, multi-faceted solutions. Delivery of such solutions is often complicated by the need to reach and engage vulnerable populations facing multiple barriers to care. While the fields of quality improvement and implementation science have made valuable gains in the development and spread of individual strategies to improve evidence-based practice delivery, models for coordinated deployment of numerous strategies to simultaneously implement multiple evidence-based interventions in vulnerable populations are lacking. In this Perspective, we describe a model for this type of comprehensive research-practice translation effort: the Johns Hopkins ALACRITY Center for Health and Longevity in Mental Illness, which is focused on reducing premature mortality in the population with serious mental illness. We describe the Center's conceptual framework, which is built upon an integrated set of quality improvement and implementation science frameworks, provide an overview of the Center's organizational structure and core research-practice translation activities, and discuss our vision for how the Center may evolve over time. Lessons learned from this Center's efforts could inform models to address other critical health issues in vulnerable populations that require multi-component solutions at the policy, system, provider, and patient levels.

Cost-effectiveness of the Adaptive Implementation of Effective Programs Trial (ADEPT): approaches to adopting implementation strategies

BACKGROUND

Theory-based methods to support the uptake of evidence-based practices (EBPs) are critical to improving mental health outcomes. Implementation strategy costs can be substantial, and few have been rigorously evaluated. The purpose of this study is to conduct a cost-effectiveness analysis to identify the most cost-effective approach to deploying implementation strategies to enhance the uptake of Life Goals, a mental health EBP.

METHODS

We used data from a previously conducted randomized trial to compare the cost-effectiveness of Replicating Effective Programs (REP) combined with external and/or internal facilitation among sites non-responsive to REP. REP is a low-level strategy that includes EBP packaging, training, and technical assistance. External facilitation (EF) involves external expert support, and internal facilitation (IF) augments EF with protected time for internal staff to support EBP implementation. We developed a decision tree to assess 1-year costs and outcomes for four implementation strategies: (1) REP only, (2) REP+EF, (3) REP+EF add IF if needed, (4) REP+EF/IF. The analysis used a 1-year time horizon and assumed a health payer perspective. Our outcome was quality-adjusted life years (QALYs). The economic outcome was the incremental cost-effectiveness ratio (ICER). We conducted deterministic and probabilistic sensitivity analysis (PSA).

RESULTS

Our results indicate that REP+EF add IF is the most cost-effective option with an ICER of $593/QALY. The REP+EF/IF and REP+EF only conditions are dominated (i.e., more expensive and less effective than comparators). One-way sensitivity analyses indicate that results are sensitive to utilities for REP+EF and REP+EF add IF. The PSA results indicate that REP+EF, add IF is the optimal strategy in 30% of iterations at the threshold of $100,000/QALY.

CONCLUSIONS

Our results suggest that the most cost-effective implementation support begins with a less intensive, less costly strategy initially and increases as needed to enhance EBP uptake. Using this approach, implementation support resources can be judiciously allocated to those clinics that would most benefit. Our results were not robust to changes in the utility measure. Research is needed that incorporates robust and relevant utilities in implementation studies to determine the most cost-effective strategies. This study advances economic evaluation of implementation by assessing costs and utilities across multiple implementation strategy combinations.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02151331 , 05/30/2014.

Merging Implementation Practice and Science to Scale Up Promising Practices: The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) Program

INTRODUCTION

The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program developed and manages a framework for identification, replication, and diffusion of promising practices throughout the nation's largest integrated health care system. DoE identifies promising practices through a "Shark Tank" competition with winning bidders receiving external implementation facilitation. DoE further supports diffusion of successful practices across the VHA.

METHODS

This article presents results of a mixed methods implementation evaluation of DoE, focusing on program reach, program participation and decisions to adopt innovative practices, implementation processes, and practice sustainment. Data sources include practice adoption metrics, focus groups with bidders (two focus groups), observations of DoE events (seven events), surveys of stakeholders (five separate surveys), and semistructured interviews of facility directors, practice developers, implementation teams, and facilitators (133 participants).

RESULTS

In the first four Shark Tank cohorts (2016-2018), 1,676 practices were submitted; 47 were designated Gold Status Practices (practices with facilitated implementation). Motivation for participation varied. Generally, staff led projects targeting problems they felt passionate about, facility directors focused on big-picture quality metrics and getting middle manager support, and frontline staff displayed variable motivation to implement new projects. Approximately half of facilitated implementation efforts were successful; barriers included insufficient infrastructure, staff, and resources. At the facility level, 73.3% of facilities originating or receiving facilitated implementation support have maintained the practice. VHA-wide, 834 decisions to adopt these practices were made.

CONCLUSION

DoE has resulted in the identification of many candidate practices, promoted adoption of promising practices by facility directors, and supported practice implementation and diffusion across the VHA.

Comparative effectiveness of external vs blended facilitation on collaborative care model implementation in slow-implementer community practices

OBJECTIVE

To evaluate the comparative effectiveness of external facilitation (EF) vs external + internal facilitation (EF/IF), on uptake of a collaborative chronic care model (CCM) in community practices that were slower to implement under low-level implementation support.

STUDY SETTING

Primary data were collected from 43 community practices in Michigan and Colorado at baseline and for 12 months following randomization.

STUDY DESIGN

Sites that failed to meet a pre-established implementation benchmark after six months of low-level implementation support were randomized to add either EF or EF/IF support for up to 12 months. Key outcomes were change in number of patients receiving the CCM and number of patients receiving a clinically significant dose of the CCM. Moderators' analyses further examined whether comparative effectiveness was dependent on prerandomization adoption, number of providers trained or practice size. Facilitation log data were used for exploratory follow-up analyses.

DATA COLLECTION

Sites reported monthly on number of patients that had received the CCM. Facilitation logs were completed by study EF and site IFs and shared with the study team.

PRINCIPAL FINDINGS

N = 21 sites were randomized to EF and 22 to EF/IF. Overall, EF/IF practices saw more uptake than EF sites after 12 months (Δ_EF/IF-EF  = 4.4 patients, 95% CI = 1.87-6.87). Moderators' analyses, however, revealed that it was only sites with no prerandomization uptake of the CCM (nonadopter sites) that saw significantly more benefit from EF/IF (Δ_EF/IF-EF  = 9.2 patients, 95% CI: 5.72, 12.63). For sites with prerandomization uptake (adopter sites), EF/IF offered no additional benefit (Δ_EF/IF-EF  = -0.9; 95% CI: -4.40, 2.60). Number of providers trained and practice size were not significant moderators.

CONCLUSIONS

Although stepping up to the more intensive EF/IF did outperform EF overall, its benefit was limited to sites that failed to deliver any CCM under the low-level strategy. Once one or more providers were delivering the CCM, additional on-site personnel did not appear to add value to the implementation effort.

Estimating Costs of an Implementation Intervention

Health care systems frequently have to decide whether to implement interventions designed to reduce gaps in the quality of care. A lack of information on the cost of these interventions is often cited as a barrier to implementation. In this article, we describe methods for estimating the cost of implementing a complex intervention. We review methods related to the direct measurement of labor, supplies and space, information technology, and research costs. We also discuss several issues that affect cost estimates in implementation studies, including factor prices, fidelity, efficiency and scale of production, distribution, and sunk costs. We examine case studies for stroke and depression, where evidence-based treatments exist and yet gaps in the quality of care remain. Understanding the costs for implementing strategies to reduce these gaps and measuring them consistently will better inform decision makers about an intervention's likely effect on their budget and the expected costs to implement new interventions.

A Smartphone App to Monitor Mood Symptoms in Bipolar Disorder: Development and Usability Study

BACKGROUND

There is considerable scientific interest in finding new and innovative ways to capture rapid fluctuations in functioning within individuals with bipolar disorder (BD), a severe, recurrent mental disorder associated with frequent shifts in symptoms and functioning. The use of smartphones can provide valid and real-world tools for use in measurement-based care and could be used to inform more personalized treatment options for this group, which can improve standard of care.

OBJECTIVE

We examined the feasibility and usability of a smartphone to capture daily fluctuations in mood within BD and to relate daily self-rated mood to smartphone use behaviors indicative of psychomotor activity or symptoms of the illness.

METHODS

Participants were 26 individuals with BD and 12 healthy control individuals who were recruited from the Prechter Longitudinal Study of BD. All were given a smartphone with a custom-built app and prompted twice a day to complete questions of mood for 28 days. The app automatically and unobtrusively collected phone usage data. A poststudy satisfaction survey was also completed.

RESULTS

Our sample showed a very high adherence rate to the daily momentary assessments (91% of the 58 prompts completed). Multivariate mixed effect models showed that an increase in rapid thoughts over time was associated with a decrease in outgoing text messages (β=-.02; P=.04), and an increase in impulsivity self-ratings was related to a decrease in total call duration (β=-.29; P=.02). Participants generally reported positive experiences using the smartphone and completing daily prompts.

CONCLUSIONS

Use of mobile technology shows promise as a way to collect important clinical information that can be used to inform treatment decision making and monitor outcomes in a manner that is not overly burdensome to the patient or providers, highlighting its potential use in measurement-based care.

The User-Program Interaction: How Teacher Experience Shapes the Relationship Between Intervention Packaging and Fidelity to a State-Adopted Health Curriculum

Intervention effects observed in efficacy trials are rarely seen when programs are broadly disseminated, underscoring the need to better understand factors influencing fidelity. The Michigan Model for Health™ (MMH) is an evidence-based health curriculum disseminated in schools throughout Michigan that is widely adopted but delivered with limited fidelity. Understanding implementation determinants and how they influence fidelity is essential to achieving desired implementation and behavioral outcomes. The study surveyed health teachers throughout Michigan (n = 171) on MMH implementation, guided by the Consolidated Framework for Implementation Research. We investigated relationships between context, intervention and provider factors and dose delivered (i.e., the proportion of curriculum delivered by teachers), a fidelity dimension. We also examined whether intervention factors were moderated by provider factors to influence fidelity. Our results indicated that program packaging ratings were associated with dose delivered (fidelity). We also found that this relationship was moderated by teacher experience. The strength of this relationship diminished with increasing levels of experience, with no relationship among the most experienced teachers. Intervention adaptability was also associated with dose delivered. We found no association between health education policies (context), provider beliefs, and dose delivered. Intervention factors are important determinants of fidelity. Our results suggest that providers with more experience may need materials tailored to their knowledge and skill level to support materials' continued usefulness and fidelity long-term. Our results also suggest that promoting adaptability may help enhance fidelity. Implementation strategies that focus on systematically adapting evidence-based health programs may be well suited to enhancing the fidelity of the MMH curriculum across levels of teacher experience.

Implementing a State-Adopted High School Health Curriculum: A Case Study

BACKGROUND

The Michigan Model for Health™ (MMH) is the official health curriculum for the State of Michigan and prevailing policy and practice has encouraged its adoption. Delivering evidence-based programs such as MMH with fidelity is essential to program effectiveness. Yet, most schools do meet state-designated fidelity requirements for implementation (delivering 80% or more of the curriculum).

METHODS

We collected online survey (N = 20) and in-person interview (N = 5) data investigating fidelity and factors related to implementation of the MMH curriculum from high school health teachers across high schools in one socioeconomically challenged Michigan county and key stakeholders.

RESULTS

We found that 68% of teachers did not meet state-identified standards of fidelity for curriculum delivery. Our results indicate that factors related to the context and implementation processes (eg, trainings) may be associated with fidelity. Teachers reported barriers to program delivery, including challenges with adapting the curriculum to suit their context, competing priorities, and meeting students' needs on key issues such as substance use and mental health issues.

CONCLUSIONS

Multiple factors influence the fidelity of health curriculum delivery in schools serving low-income students. Investigating these factors guided by implementation science frameworks can inform use of implementation strategies to support and enhance curriculum delivery.

Accelerating implementation of research in Learning Health Systems: Lessons learned from VA Health Services Research and NCATS Clinical Science Translation Award programs

Translation of research to practice is challenging. In addition to the scientific challenges, there are additional hurdles in navigating the rapidly changing US health care system. There is a need for innovative health interventions that can be adopted in "real-world" settings. Barriers to translation involve misaligned timing of research funding and health system decision-making, lack of research questions aligned with health system and community priorities, and limited incentives in academia for health system and community-based research. We describe new programs from the US Department of Veterans Affairs Health Services Research and Development (HSR&D) and the National Center for Advancing Translational Sciences (NCATS) Clinical and Translational Science Award (CTSA) Programs that are building capacity for Learning Health System research. These programs help to incentivize adopting and adapting Learning Health System principles to ensure that, primarily in implementation science within academic/veterans affairs health systems, there is alignment of the research with the health system and community needs. Both HSR&D and NCATS CTSA Program encourage researchers to develop problem-focused research innovations in partnership with health systems and communities to ultimately facilitate design treatments that are feasible in "real-world" practice.

Comprehensive approaches to addressing mental health needs and enhancing school security: a hybrid type II cluster randomized trial

BACKGROUND

School safety is fundamental to fostering positive outcomes for children. Violence remains a critical public health issue with 8.1% of elementary and 21.8% of middle school students reporting daily or weekly bullying in 2015-16. Similarly, over half of lifetime mental health concerns become evident before age 14. Thus, elementary school is a key time for comprehensive school safety interventions. Yet, interventions are rarely delivered with fidelity in community settings. Evidence-based interventions must be complemented by implementation strategies to achieve desired public health outcomes.

METHODS

We develop and test an intervention focused on promoting a positive school climate guided by a school-based 3-person leadership team (3-PLT) using a hybrid Type II design. The 3-PLT includes a School Resource Officer, (SRO), administrator and mental health services professional as a newly appointed climate specialist (CS). The interventions to be delivered include 1) Restorative justice, 2) Mental Health First Aid and 3) Crime Prevention Through Environmental Design. The CS will lead the team and coordinate implementation through a process of interactive problem solving and supports, consistent with the implementation facilitation strategy. We will conduct a cluster randomized controlled trial with staged entry over two school years in Genesee County, Michigan (n = 20 elementary schools, with 10 participating per school year). We will use a combination of data sources including data collected by schools (e.g., discipline data), a student survey, and a teacher survey. We will also conduct a process evaluation and assess implementation and sustainability through focus groups with key stakeholders, teachers, and students. Finally, we will conduct a cost-benefit analysis.

DISCUSSION

Results from both the behavioral outcome and implementation strategy evaluations are expected to have significant implications for school safety and student well-being. This study adopts a unique approach by integrating three evidence-based programs and incorporating implementation facilitation led by the CS as part of the 3-PLT to support intervention delivery and enhance public health impact among schools in disadvantaged communities with students at risk of poor health outcomes. This study aims to create a comprehensive, well-integrated model intervention that is sustainable and can be translated to similar high-risk settings.

TRIAL REGISTRATION

Trial was retrospectively registered, registration ISRCTN1226421, May 16, 2019.

Economic evaluation in implementation science: Making the business case for implementation strategies

Implementation researchers have made notable progress in developing and testing implementation strategies (i.e., highly-specified methods used to help providers improve uptake of mental health evidence-based practices: EBPs). Yet, implementation strategies are not widely applied in healthcare organizations to improve delivery of EBPs. Economic considerations are a key factor influencing the use of implementation strategies to deliver and sustain mental health evidence-based practices, in part because many health care leaders are reluctant to invest in ongoing implementation strategy support without knowing the return-on-investment. Comparative economic evaluation of implementation strategies provides critical information for payers, policymakers, and providers to make informed decisions if specific strategies are an efficient use of scarce organizational resources. Currently, few implementation studies include implementation cost data and even fewer conduct comparative economic analyses of implementation strategies. This summary will introduce clinicians, researchers and other health professionals to the economic evaluation in implementation science. We provide an overview of different economic evaluation methods, discuss differences between economic evaluation in health services and implementation science. We also highlight approaches and frameworks to guide economic evaluation of implementation, provide an example for a cognitive-behavioral therapy program and discuss recommendations.

Study protocol: A multisite trial of Work-Related Cognitive behavioral therapy for unemployed persons with social anxiety

This paper provides a methodological description of a multi-site, randomized controlled trial (RCT) of a cognitive-behavioral intervention for enhancing employment success among unemployed persons whose employment efforts have been undermined by social anxiety disorder (SAD). SAD is a common and impairing condition, with negative impacts on occupational functioning. In response to these documented employment-related impairments, in a previous project, we produced and tested an eight-session work-related group cognitive-behavioral therapy provided alongside vocational services as usual (WCBT + VSAU). WCBT is delivered by vocational service professionals and is designed in a context and style that overcomes accessibility and stigma-related obstacles with special focus on employment-related targets. Our previous project found that WCBT + VSAU significantly improved social anxiety, depression, and a range of employment-related outcomes compared to a control group of socially anxious job-seekers who received vocational services as usual without WCBT (VSAU-alone). Participants in this study were all homeless, primarily African American job-seekers with high levels of psychiatric comorbidity and limited education and employment histories. The present, two-region study addresses whether WCBT + VSAU enhances job placement, job retention and mental health outcomes in a larger sample assessed over an extended follow-up period. In addition, this trial evaluates whether the effects of WCBT + VSAU generalize to a new population of urban-based, racially diverse job-seekers with vocational and educational histories that differ from our original sample. This study also investigates the system-effects of WCBT + VSAU in a new site that will be informative for broad implementation of WCBT + VSAU. Finally, this project involves a refined, technology-assisted form of WCBT + VSAU designed to be delivered more easily by vocational services professionals.

Research Lifecycle to Increase the Substantial Real-world Impact of Research: Accelerating Innovations to Application

BACKGROUND

US health care systems face a growing demand to incorporate innovations that improve patient outcomes at a lower cost. Funding agencies increasingly must demonstrate the impact of research investments on public health. The Learning Health System promotes continuous institutional innovation, yet specific processes to develop innovations for further research and implementation into real-world health care settings to maximize health impacts have not been specified.

OBJECTIVE

We describe the Research Lifecycle and how it leverages institutional priorities to support the translation of research discoveries to clinical application, serving as a broader operational approach to enhance the Learning Health System.

METHODS

Developed by the US Department of Veterans Affairs Office of Research and Development Research-to-Real-World Workgroup, the Research Lifecycle incorporates frameworks from product development, translational science, and implementation science methods. The Lifecycle is based on Workgroup recommendations to overcome barriers to more direct translation of innovations to clinical application and support practice implementation and sustainability.

RESULTS

The Research Lifecycle posits 5 phases which support a seamless pathway from discovery to implementation: prioritization (leadership priority alignment), discovery (innovation development), validation (clinical, operational feasibility), scale-up and spread (implementation strategies, performance monitoring), and sustainability (business case, workforce training). An example of how the Research Lifecycle has been applied within a health system is provided.

CONCLUSIONS

The Research Lifecycle aligns research and health system investments to maximize real-world practice impact via a feasible pathway, where priority-driven innovations are adapted for effective clinical use and supported through implementation strategies, leading to continuous improvement in real-world health care.