The relationship between consumer, clinician, and organizational characteristics and use of evidence-based and non-evidence-based therapy strategies in a public mental health system

Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE)

BACKGROUND

For youth receiving care in community mental health centers, comorbidities are the rule rather than the exception. Using measurement-based care (MBC), or the routine evaluation of symptoms to inform care decisions, as the foundation of treatment for youth with comorbid problems significantly improves the impact of psychotherapy by focusing care and building engagement and alliance. MBC increases the rate of symptom improvement, detects clients who would otherwise deteriorate, and alerts clinicians to non-responders. Despite its demonstrated utility, MBC is rarely implemented with fidelity; less than 15% of providers report using MBC per recommendations. Previous efforts to support MBC implementation have yielded suboptimal outcomes, in part, due to organizations' challenges with identifying and prioritizing barriers and selecting and developing strategies to overcome them. New methods are needed for identifying and prioritizing barriers, and matching strategies to barriers to optimize MBC implementation and treatment quality to improve youth mental health outcomes in community settings.

METHODS

Pragmatic implementation methods will be piloted in four diverse community mental health centers. Methods include (a) rapid evidence synthesis; (b) rapid ethnography; (c) design kits (e.g., kits with disposable cameras, journals, maps); (d) barrier prioritization, and (e) causal pathway diagramming. These activities will generate actionable barriers; subsequently, we will use facilitated group processes to prioritize barriers and develop causal pathway diagrams to match strategies to barriers to create implementation plans that optimize MBC fidelity (Aim 1). We will track strategy deployment for 6 months, then compare MBC fidelity for another 6 months post-implementation with data from 2 years of historical controls (Aim 2). Finally, we will co-design a toolkit for design kit methods with youth and the practice and scientific communities (Aim 3).

DISCUSSION

Optimizing MBC implementation in community mental health centers could transform youth mental health care by ensuring the most pressing symptoms are targeted early in treatment. The discussion section highlights expected challenges and limits to using the five methods, including recruitment and engagement given the high pressure on community mental health settings.

TRIAL REGISTRATION

Clinicaltrials.gov. NCT05644756 . Registered on 18 November 2022. This trial was retrospectively registered.

Predicting Therapists' Intentions to Use Innovations: Comparing the Role of Individual, Organizational, and Innovation Characteristics

Theories emphasize the role of individual and organizational characteristics in implementation outcomes, yet research indicates that these characteristics account for only a small amount of variance in those outcomes. Innovation characteristics might be important proximal determinants of implementation outcomes but are infrequently examined in mental health services research. This study examined the relative variance explained by individual, organizational, and innovation characteristics on behavioral intentions, a central implementation outcome in implementation theories. Data were collected from 95 therapists and 28 supervisors who participated in a cluster randomized trial that tested the effectiveness of two clinical decision-making innovations. Multilevel models compared individual, organizational, and innovation characteristics as predictors of therapists' intentions to use the innovations. Subsequent mediational path analyses tested whether innovation characteristics mediated the effect of innovation type on intentions. Individual and organizational characteristics explained 29% of the variability in therapists' intentions. Approximately 75% of the variability in therapists' intentions was accounted for by innovation characteristics. Individual and organizational characteristics were not statistically significant predictors of intentions after controlling for innovation characteristics. The indirect effect of innovation type on intentions through therapists' beliefs was statistically significant (B = 0.410, 95% Bootstrapped CI = [0.071, 0.780]), but the direct effect of innovation type was not (B = 0.174, p = .365). Innovation characteristics are related to therapist intentions and might explain why some innovations are received more favorably than others. Future studies should explore the complex interrelationships between these beliefs alongside other individual or organizational characteristics.

Principle-Guided Psychotherapy for Children and Adolescents (FIRST): study protocol for a randomized controlled effectiveness trial in outpatient clinics

BACKGROUND

Hundreds of youth psychotherapy randomized trials have generated scores of helpful empirically supported treatments (ESTs). However, the standardized structure of many ESTs and their focus on a single disorder or homogeneous cluster of problems may not be ideal for clinically referred youths who have comorbidity and whose treatment needs may shift from week to week. This concern has prompted development of flexible transdiagnostic, modular youth psychotherapies. One of these, designed for efficient training and implementation, is FIRST-a transdiagnostic intervention built on five empirically supported principles of change (i.e., feeling calm, increasing motivation, repairing thoughts, solving problems, and trying the opposite) and targeting common internalizing and externalizing youth mental health disorders and problems. FIRST has shown promise in improving youth mental health in three open trials. Now, in a more rigorous test, we seek to (1) conduct a randomized controlled trial comparing FIRST to usual care in real-world clinical practice settings; (2) examine a promising candidate mediator of change-regulation of negative emotions; and (3) explore variables that may influence clinicians' treatment implementation.

METHODS

This is an assessor-naïve randomized controlled effectiveness trial in youth outpatient community clinics in New England and Texas. Using double randomization, clinic-employed clinicians and treatment-referred youths (7-15 years old) are independently randomly allocated (1:1) to FIRST or usual care. We aim to recruit 212 youth participants, all referred through normal community pathways, with elevated symptoms of anxiety, depression, conduct problems, or post-traumatic stress. This study will test the effectiveness of FIRST compared to usual care on mental health outcomes, examine whether those outcomes are mediated by regulation of negative emotions, and explore clinician factors that may be associated with FIRST implementation and outcomes. Session recordings are coded to assess treatment fidelity.

DISCUSSION

This study will evaluate the effectiveness of FIRST in youth community mental health settings, relative to the care usually provided in those settings. If FIRST is found to be effective, it could offer an efficient and practical method to increase use of empirically supported treatment principles in real-world practice contexts.

TRIAL REGISTRATION

NIH Clinical Trials Registry, NCT04725721. Registered 27 January 2021, https://clinicaltrials.gov/ct2/show/study/NCT04725721.

Using session recordings to understand the content of community-based treatment for childhood anxiety disorders and response to technology-based training

OBJECTIVE

The goal of the current study is to advance efforts to increase the quality of care for childhood anxiety disorder (CADs) through (1) detailing the content of community-based treatment sessions, (2) exploring the validity of therapist surveys, (3) examining the influence of setting differences, and (4) testing the effects of a technology-based training on use of nonexposure strategies.

METHODS

Thirteen therapists were randomly assigned to technology-based training in the use of exposure therapy or treatment as usual (TAU) for CADs. Therapeutic techniques were coded from 125 community-based treatment sessions.

RESULTS

Consistent with survey responses community therapists spent the majority of session time reviewing symptoms (34% of session time), implementing nonexposure cognitive behavioral therapy (CBT; 36%), and rarely engaged in exposure (3%). An integrated behavioral health setting was associated with greater endorsement of exposure on survey, p < 0.05, although this difference was not significant in session recordings, p = 0.14. Multilevel models indicated that technology-based training that has been shown to increase exposure, also decreased use of nonexposure CBT techniques (2% vs. 29%, p < 0.001).

CONCLUSION

The study supports the validity of survey-based findings that community-based care for CADs consists of non-exposure CBT techniques. Efforts should be invested in dissemination of within-session exposure.

Principle-Guided Psychotherapy for Children and Adolescents (FIRST): Study Protocol for a Randomized Controlled Effectiveness Trial in Outpatient Clinics

Background

Hundreds of youth psychotherapy randomized trials have generated scores of helpful empirically supported treatments (ESTs). However, the standardized structure of many ESTs and their focus on a single disorder or homogeneous cluster of problems may not be ideal for clinically referred youths who have comorbidity and whose treatment needs may shift from week to week. This concern has prompted development of flexible transdiagnostic, modular youth psychotherapies. One of these, designed for efficient training and implementation, is FIRST-a transdiagnostic intervention built on five empirically supported principles of change (i.e., feeling calm, increasing motivation, repairing thoughts, solving problems, and trying the opposite) and targeting common internalizing and externalizing youth mental health disorders and problems. FIRST has shown promise in improving youth mental health in three open trials. Now, in a more rigorous test, we seek to (1) conduct a randomized controlled trial comparing FIRST to usual care in real-world clinical practice settings; (2) examine a promising candidate mediator of change-regulation of negative emotions; and (3) explore variables that may influence clinicians' treatment implementation.

Methods

This is an assessor-naïve randomized controlled effectiveness trial in youth outpatient community clinics in New England and Texas. Using double randomization, clinic-employed clinicians and treatment-referred youths (7-15 years old) are independently randomly allocated (1:1) to FIRST or usual care. We aim to recruit 212 youth participants, all referred through normal community pathways, with elevated symptoms of anxiety, depression, conduct problems, or post-traumatic stress. This study will test the effectiveness of FIRST compared to usual care on mental health outcomes, examine whether those outcomes are mediated by regulation of negative emotions, and explore clinician factors that may be associated with FIRST implementation and outcomes. Session recordings are coded to assess treatment fidelity.

Discussion

This study will evaluate the effectiveness of FIRST in youth community mental health settings, relative to the care usually provided in those settings. If FIRST is found to be effective, it could offer an efficient and practical method to increase use of empirically supported treatment principles in real-world practice contexts.

Trial registration

NIH Clinical Trials Registry, NCT04725721. Registered 27 January 2021, https://clinicaltrials.gov/ct2/show/study/NCT04725721.

Organization-level variation in therapists' attitudes toward and use of measurement-based care

PURPOSE

Despite significant interest in improving behavioral health therapists' implementation of measurement-based care (MBC)-and widespread acknowledgment of the potential importance of organization-level determinants-little is known about the extent to which therapists' use of, and attitudes toward, MBC vary across and within provider organizations or the multilevel factors that predict this variation.

METHODS

Data were collected from 177 therapists delivering psychotherapy to youth in 21 specialty outpatient clinics in the USA. Primary outcomes were use of MBC for progress monitoring and treatment modification, measured by the nationally-normed Current Assessment of Practice Evaluation-Revised. Secondary outcomes were therapist attitudes towards MBC. Linear multilevel regression models tested the association of theory-informed clinic and therapist characteristics with these outcomes.

RESULTS

Use of MBC varied significantly across clinics, with means on progress monitoring ranging from values at the 25th to 93rd percentiles and means on treatment modification ranging from the 18th to 71st percentiles. At the clinic level, the most robust predictor of both outcomes was clinic climate for evidence-based practice implementation; at the therapist level, the most robust predictors were: attitudes regarding practicality, exposure to MBC in graduate training, and prior experience with MBC. Attitudes were most consistently related to clinic climate for evidence-based practice implementation, exposure to MBC in graduate training, and prior experience with MBC.

CONCLUSIONS

There is important variation in therapists' attitudes toward and use of MBC across clinics. Implementation strategies that target clinic climate for evidence-based practice implementation, graduate training, and practicality may enhance MBC implementation in behavioral health.

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity

Prominent theories within the field of implementation science contend that organizational leaders can improve providers' fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate's influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals' EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals' increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT-however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.

Clinical Supervision in Community Mental Health: Characterizing Supervision as Usual and Exploring Predictors of Supervision Content and Process

Clinical supervision can be leveraged to support implementation of evidence-based practices in community mental health settings, though it has been understudied. This study focuses on 32 supervisors at 23 mental health organizations in Philadelphia. We describe characteristics of supervisors and organizations and explore predictors of supervision content and process. Results highlight a low focus on evidence-based content and low use of active supervision processes. They underscore the need for further attention to the community mental health context when designing supervision-targeted implementation strategies. Future work should assess whether supervision models specific to community mental health are needed.

Prospective predictors of sustainment of multiple EBPs in a system-driven implementation context: Examining sustained delivery based on administrative claims

Background

System-driven scale-up of multiple evidence-based practices (EBPs) is an increasingly common method used in public mental health to improve care. However, there are little data on the long-term sustained delivery of EBPs within these efforts, and previous studies have relied on retrospective self-report within cross-sectional studies. This study identified prospective predictors of sustained EBP delivery at the EBP-, therapist-, and organizational-levels using survey and administrative claims data within a large-scale system-driven implementation effort.

Methods

777 therapists and 162 program leaders delivering at least one of six EBPs of interest completed surveys assessing perceptions of EBPs and organizational context. These surveys were linked to administrative data to examine prospective predictors of therapists' EBP delivery over 33 months.

Results

Five of the six EBPs implemented showed sustained delivery in the system, with volume varying by EBP. Although total EBP claim volume per therapist decreased over time, the volume ratio (ratio of EBP-specific claims to total EBP and non-EBP claims) stayed relatively stable. Multilevel models revealed that EBPs that required consultation, had unstructured content, higher therapist self-efficacy with the EBP, and more positive program leader perceptions of the EBP were associated with greater sustained volume and volume ratio of the EBP. Therapists who were trained in fewer EBPs, who were unlicensed, and who worked in agencies rated by program leaders as lower on organizational staff autonomy and stress showed greater sustained EBP volume and volume ratio. Finally, more direct service hours per week provided by therapist predicted greater sustained EBP volume, but lower volume ratio.

Conclusions

The results point to the importance of EBP, therapist, and organizational factors that may be targeted in implementation strategies to promote the sustainment of EBPs.

Community Therapist Response to Technology-Assisted Training in Exposure Therapy for Childhood Anxiety Disorders

Despite the efficacy of exposure for childhood anxiety disorders (CADs), dissemination has been unsuccessful. The current study examined community-therapist response to a brief (90-minutes) training in technology-assisted exposure therapy for CADs. The results indicated that therapists found the training in the therapy approach and technology acceptable, despite endorsing mainly non-exposure-based practice prior to the training. Training also increased positive beliefs about exposure, t (23) = 4.32, p < .000, that persisted 6 months later, t (23) = 4.56, p < .000. In addition, the number of therapists reporting an intention to implement exposure increased substantially from baseline (41.7%) to post-training (83.3%), with many therapists (70.8%) reporting use of exposure within the 6 months following training. However, automatically recorded data indicated little use of the technology. Results suggest that a dissemination message focusing on exposure is acceptable and has the potential to increase the use of this central treatment component.

Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale (EBPAS) in a large and representative Swedish sample: is the use of the total scale and subscale scores justified?

Background

There is a call for valid and reliable instruments to evaluate implementation of evidence-based practices (EBP). The 15-item Evidence-Based Practice Attitude Scale (EBPAS) measures attitude toward EBP, incorporating four lower-order factor subscales (Appeal, Requirements, Openness, and Divergence) and a Total scale (General Attitudes). It is one of a few measures of EBP attitudes evaluated for its psychometric properties. The reliability of the Total scale has been repeatedly supported, but also the multidimensionality of the inventory. However, whether all of the items contribute to the EBPAS Total beyond their subscales has yet to be demonstrated. In addition, the Divergence subscale has been questioned because of its low correlation with the other subscales and low inter-item correlations. The EBPAS is widely used to tailor and evaluate implementation efforts, but a Swedish version has not yet been validated. This study aimed to contribute to the development and cross-validation of the EBPAS by examining the factor structure of t a Swedish-language version in a large sample of mental health professionals.

Methods

The EBPAS was translated into Swedish and completed by 570 mental health professionals working in child and adolescent psychiatry settings spread across Sweden. The factor structure was examined using first-order, second-order and bifactor confirmatory factor analytic (CFA) models.

Results

Results suggested adequate fit for all CFA models. The EBPAS Total was strongly supported in the Swedish version. Support for the hierarchical second-order model was also strong, while the bifactor model gave mixed support for the subscales. The Openness and Requirements subscales came out best, while there were problems with both the Appeal (e.g. not different from the General Attitudes factor) and the Divergence subscales (e.g. low reliability).

Conclusions

Overall, the psychometric properties were on par with the English version and the total score appears to be a valid measure of general attitudes towards EBP. This is the first study supporting this General Attitudes factor based on a bifactor model. Although comparatively better supported in this Swedish sample, we conclude that the use of the EBPAS subscale scores may result in misleading conclusions. Practical implications and future directions are discussed.

How community therapists describe adapting evidence-based practices in sessions for youth: Augmenting to improve fit and reach

The study sought to (a) characterize the types and frequency of session-level adaptations made to multiple evidence-based practices (EBPs) and (b) identify therapist-, client-, and session-level predictors of adaptations. Within the community implementation of multiple EBPs, 103 community mental health therapists reported on 731 therapy sessions for 280 clients. Therapists indicated whether they adapted EBPs in specific sessions and described adaptations in open-ended responses. Responses were coded using the Augmenting and Reducing adaptations framework. Therapists reported making adaptations in 59% of sessions. Augmenting adaptations were reported more frequently than Reducing adaptations. Multilevel logistic regression analyses revealed that greater therapist openness to EBPs, younger child age, and presenting problems was associated with Augmenting adaptations. Child presenting problem of externalizing problems predicted fewer Reducing adaptations compared with internalizing problems. This study extends the growing research examining adaptations within the context of the system-driven implementation of multiple EBPs by applying the Augmenting and Reducing adaptation framework to the session-level.

Characterizing the heterogeneity of clinician practice use in community mental health using latent profile analysis

BACKGROUND

The behavioral health service provider population is highly heterogeneous. However, it is rarely treated as such within evidence-based practice implementation efforts. This study aimed to evaluate, as a proof of concept, the utility of latent profile analysis to identify distinct profiles of clinician practices in a large sample of youth-serving community mental health clinicians. This study also aimed to identify predictors of profile membership to inform implementation efforts.

METHODS

Participants were 484 practicing clinicians (79.4% female, 45.7% White, M age = 37.1 years). As part of a larger survey, clinicians reported on their use of cognitive, behavioral, family, and psychodynamic treatment techniques with a representative client on their caseload. Latent profile analysis was used to determine the presence of clinician practice profiles. Multilevel multinomial logistic regressions examined predictors of profile membership.

RESULTS

Latent profile analysis indicated a 4-profile solution best fit the data, with clinicians who: 1) used generally low levels of all examined techniques and preferred cognitive techniques (Low Eclectics, 16%), 2) delivered moderate levels of all techniques (Moderate Eclectics, 53%), 3) demonstrated preference for use of family techniques (Family Preferred, 11%), and 4) used high levels of all techniques (Super Users, 20%). Clinician discipline (e.g., social work), education, and years of experience predicted profile membership.

CONCLUSIONS

Findings from this proof of concept study underscore the utility of latent profile analysis to characterize the complex and heterogeneous makeup of community mental health. Results extend prior work highlighting the eclectic nature of community mental health practice. Predictor analyses underscore the important influence of clinician background characteristics on practice use.

A repeated cross-sectional study of clinicians' use of psychotherapy techniques during 5 years of a system-wide effort to implement evidence-based practices in Philadelphia

Background

Little work investigates the effect of behavioral health system efforts to increase use of evidence-based practices or how organizational characteristics moderate the effect of these efforts. The objective of this study was to investigate clinician practice change in a system encouraging implementation of evidence-based practices over 5 years and how organizational characteristics moderate this effect. We hypothesized that evidence-based techniques would increase over time, whereas use of non-evidence-based techniques would remain static.

Method

Using a repeated cross-sectional design, data were collected three times from 2013 to 2017 in Philadelphia’s public behavioral health system. Clinicians from 20 behavioral health outpatient clinics serving youth were surveyed three times over 5 years (n = 340; overall response rate = 60%). All organizations and clinicians were exposed to system-level support provided by the Evidence-based Practice Innovation Center from 2013 to 2017. Additionally, approximately half of the clinicians participated in city-funded evidence-based practice training initiatives. The main outcome included clinician self-reported use of cognitive-behavioral and psychodynamic techniques measured by the Therapy Procedures Checklist-Family Revised.

Results

Clinicians were 80% female and averaged 37.52 years of age (SD = 11.40); there were no significant differences in clinician characteristics across waves (all ps > .05). Controlling for organizational and clinician covariates, average use of CBT techniques increased by 6% from wave 1 (M = 3.18) to wave 3 (M = 3.37, p = .021, d = .29), compared to no change in psychodynamic techniques (p = .570). Each evidence-based practice training initiative in which clinicians participated predicted a 3% increase in CBT use (p = .019) but no change in psychodynamic technique use (p = .709). In organizations with more proficient cultures at baseline, clinicians exhibited greater increases in CBT use compared to organizations with less proficient cultures (8% increase vs. 2% decrease, p = .048).

Conclusions

System implementation of evidence-based practices is associated with modest changes in clinician practice; these effects are moderated by organizational characteristics. Findings identify preliminary targets to improve implementation.

Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field

BACKGROUND

Scientists have developed evidence-based interventions that improve the symptoms and functioning of youth with psychiatric disorders; however, these interventions are rarely used in community settings. Eliminating this research-to-practice gap is the purview of implementation science, the discipline devoted to the study of methods to promote the use of evidence-based practices in routine care.

METHODS

We review studies that have tested factors associated with implementation in child psychology and psychiatry, explore applications of social science theories to implementation, and conclude with recommendations to advance implementation science through the development and testing of novel, multilevel, causal theories.

RESULTS

During its brief history, implementation science in child psychology and psychiatry has documented the implementation gap in routine care, tested training approaches and found them to be insufficient for behavior change, explored the relationships between variables and implementation outcomes, and initiated randomized controlled trials to test implementation strategies. This research has identified targets related to implementation (e.g., clinician motivation, organizational culture) and demonstrated the feasibility of activating these targets through implementation strategies. However, the dominant methodological approach has been atheoretical and predictive, relying heavily on a set of variables from heuristic frameworks.

CONCLUSIONS

Optimizing the implementation of effective treatments in community care for youth with psychiatric disorders is a defining challenge of our time. This review proposes a new direction focused on developing and testing integrated causal theories. We recommend implementation scientists: (a) move from observational studies of implementation barriers and facilitators to trials that include causal theory; (b) identify a core set of implementation determinants; (c) conduct trials of implementation strategies with clear targets, mechanisms, and outcomes; (d) ensure that behaviors that are core to EBPs are clearly defined; and (e) agree upon standard measures. This agenda will help fulfill the promise of evidence-based practice for improving youth behavioral health.

Nurturing Practitioner-Researcher Partnerships to Improve Adoption and Delivery of Research-Based Social and Public Health Services Worldwide

Research-based practices—psychosocial, behavioral, and public health interventions—have been demonstrated to be effective and often cost-saving treatments, but they can take up to two decades to reach practitioners within the health and human services workforce worldwide. Practitioners often rely on anecdotal evidence and their “practice wisdom” rather than on research, and may thus unintentionally provide less effective or ineffective services. Worldwide, community engagement in research is recommended, particularly in low-resource contexts. However, practitioner involvement has not been adequately explored in its own right as an innovative community-engaged practice that requires a tailored approach. The involvement of practitioners in research has been shown to improve their use of research-based interventions, and thus the quality of care and client outcomes. Nevertheless, the literature is lacking specificity about when and how (that is, using which tasks and procedures) to nurture and develop practitioner–researcher partnerships. This paper offers theoretical and empirical evidence on practitioner–researcher partnerships as an innovation with potential to enhance each phase of the research cycle and improve services, using data from the United States, Brazil, and Spain. Recommendations for partnership development and sustainability are offered, and a case is made for involving practitioners in research in order to advance social justice by amplifying the local relevance of research, increasing the likelihood of dissemination to community settings, and securing the sustainability of research-based interventions in practice settings.

Transforming Mental Health Delivery Through Behavioral Economics and Implementation Science: Protocol for Three Exploratory Projects

BACKGROUND

Efficacious psychiatric treatments are not consistently deployed in community practice, and clinical outcomes are attenuated compared with those achieved in clinical trials. A major focus for mental health services research is to develop effective and cost-effective strategies that increase the use of evidence-based assessment, prevention, and treatment approaches in community settings.

OBJECTIVE

The goal of this program of research is to apply insights from behavioral economics and participatory design to advance the science and practice of implementing evidence-based practice (EBP) for individuals with psychiatric disorders across the life span.

METHODS

Project 1 (Assisting Depressed Adults in Primary care Treatment [ADAPT]) is patient-focused and leverages decision-making heuristics to compare ways to incentivize adherence to antidepressant medications in the first 6 weeks of treatment among adults newly diagnosed with depression. Project 2 (App for Strengthening Services In Specialized Therapeutic Support [ASSISTS]) is provider-focused and utilizes normative pressure and social status to increase data collection among community mental health workers treating children with autism. Project 3 (Motivating Outpatient Therapists to Implement: Valuing a Team Effort [MOTIVATE]) explores how participatory design can be used to design organizational-level implementation strategies to increase clinician use of EBPs. The projects are supported by a Methods Core that provides expertise in implementation science, behavioral economics, participatory design, measurement, and associated statistical approaches.

RESULTS

Enrollment for project ADAPT started in 2018; results are expected in 2020. Enrollment for project ASSISTS will begin in 2019; results are expected in 2021. Enrollment for project MOTIVATE started in 2018; results are expected in 2019. Data collection had begun for ADAPT and MOTIVATE when this protocol was submitted.

CONCLUSIONS

This research will advance the science of implementation through efforts to improve implementation strategy design, measurement, and statistical methods. First, we will test and refine approaches to collaboratively design implementation strategies with stakeholders (eg, discrete choice experiments and innovation tournaments). Second, we will refine the measurement of mechanisms related to heuristics used in decision making. Third, we will develop new ways to test mechanisms in multilevel implementation trials. This trifecta, coupled with findings from our 3 exploratory projects, will lead to improvements in our knowledge of what causes successful implementation, what variables moderate and mediate the effects of those causal factors, and how best to leverage this knowledge to increase the quality of care for people with psychiatric disorders.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03441399; https://www.clinicaltrials.gov/ct2/show/NCT03441399 (Archived by WebCite at http://www.webcitation.org/74dRbonBD).

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/12121.