Bridging the Gap Between Research and Practice in Mental Health Service Settings: An Overview of Developments in Implementation Theory and Research

Strategic use of resources to enhance colorectal cancer screening for patients with diabetes (SURE: CRC4D) in federally qualified health centers: a protocol for hybrid type ii effectiveness-implementation trial

BACKGROUND

Persons with diabetes have 27% elevated risk of developing colorectal cancer (CRC) and are disproportionately from priority health disparities populations. Federally qualified health centers (FQHCs) struggle to implement CRC screening programs for average risk patients. Strategies to effectively prioritize and optimize CRC screening for patients with diabetes in the primary care safety-net are needed.

METHODS

Guided by the Exploration, Preparation, Implementation and Sustainment Framework, we conducted a stakeholder-engaged process to identify multi-level change objectives for implementing optimized CRC screening for patients with diabetes in FQHCs. To identify change objectives, an implementation planning group of stakeholders from FQHCs, safety-net screening programs, and policy implementers were assembled and met over a 7-month period. Depth interviews (n = 18-20) with key implementation actors were conducted to identify and refine the materials, methods and strategies needed to support an implementation plan across different FQHC contexts. The planning group endorsed the following multi-component implementation strategies: identifying clinic champions, development/distribution of patient educational materials, developing and implementing quality monitoring systems, and convening clinical meetings. To support clinic champions during the initial implementation phase, two learning collaboratives and bi-weekly virtual facilitation will be provided. In single group, hybrid type 2 effectiveness-implementation trial, we will implement and evaluate these strategies in a in six safety net clinics (n = 30 patients with diabetes per site). The primary clinical outcomes are: (1) clinic-level colonoscopy uptake and (2) overall CRC screening rates for patients with diabetes assessed at baseline and 12-months post-implementation. Implementation outcomes include provider and staff fidelity to the implementation plan, patient acceptability, and feasibility will be assessed at baseline and 12-months post-implementation.

DISCUSSION

Study findings are poised to inform development of evidence-based implementation strategies to be tested for scalability and sustainability in a future hybrid 2 effectiveness-implementation clinical trial. The research protocol can be adapted as a model to investigate the development of targeted cancer prevention strategies in additional chronically ill priority populations.

TRIAL REGISTRATION

This study was registered in ClinicalTrials.gov (NCT05785780) on March 27, 2023 (last updated October 21, 2023).

Implementation Science and Practice-Oriented Research: Convergence and Complementarity

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

Navigating Social Cognitive Impairments in Schizophrenia Spectrum Disorders: Protocol for a Pilot Pre-Post Quasi-Experimental Study for Remote Avatar-Assisted Cognitive Remediation Therapy

BACKGROUND

Social cognitive impairments are prevalent in schizophrenia spectrum disorder (SSD) and have detrimental effects on functioning. Cognitive remediation (CR) has shown its efficacy in improving social cognitive impairments, although the transfer of these skills to daily life and the personalization of these interventions remain challenging. RC2S (Remédiation Cognitive de la Cognition Sociale dans la Schizophrénie; Cognitive remediation of social cognition in Schizophrenia) is a French CR that combines the learning of strategies and practice using paper-and-pencil exercises and digital relational simulations. This French program was designed as an in-person intervention.

OBJECTIVE

This project aims to culturally adapt the RC2S program, in French-Canadian and North American English and to assess the feasibility, acceptability, safety, and implementation of a remote version in people with SSD. An exploratory objective is to assess the preliminary effect of remote RC2S on goal attainment, social cognition, and psychosocial outcomes.

METHODS

We will use a pre-post quasi-experimental design. First, the translation and cultural adaptation in North American English and French-Canadian of RC2S is presented. Then, 20 participants aged ≥18 years with a diagnosis of SSD, presenting with a subjective or an objective impairment in social cognition, will be included to receive RC2S. In addition, 5 therapists will be included as research participants to assess their perspective on RC2S. Participants with SSD will undergo a baseline remote assessment of their social cognition, clinical symptoms, and functioning. They will then start remote RC2S for 24 biweekly individual 1-hour sessions with a therapist. Following the case formulation and goal setting, participants will complete personalized paper-and-pencil exercises to develop strategies and integrative digital relational simulations, during which they will help an avatar navigate through a variety of social contexts and relationships. The last 2 sessions are dedicated to the transfer to daily life. All participants will complete in-session questionnaires assessing therapeutic alliance, motivation, acceptability, feasibility, and implementation. Following RC2S, the participants with SSD will repeat the same assessment as the baseline. Descriptive statistics will be used to summarize the data about acceptability, feasibility, safety, and implementation. To assess the preliminary effect of RC2S, an intention-to-treat approach will be used with linear mixed models for repeated measures with fixed effects of time.

RESULTS

So far, 45% (9/20) of participants with SSD (mean age 37.9, SD 9.3 years) have completed the project. They received a mean of 20.5 out of 24 (SD 3.5) sessions of RC2S. A total of 5 therapists also completed the project.

CONCLUSIONS

Improving social cognitive impairments is an important target in SSD to promote functional recovery. Using digital technologies to address these impairments and deliver the intervention is a promising approach to increase the ecological validity of CR and access to the intervention.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05017532; https://classic.clinicaltrials.gov/ct2/show/NCT05017532.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/54251.

"What Do I Say? How Do I Say it?" Twitter as a Knowledge Dissemination Tool for Mental Health Research

This study aims to generate evidence-based guidelines for researchers regarding how to effectively disseminate mental health research via Twitter. Three hundred mental health research Tweets posted from September 2018 to September 2019 were sampled from two large Australian organizations. Twenty-seven predictor variables were coded for each Tweet across five thematic categories: messaging; research area; mental health area; external networks; and media features. Regression analyses were conducted to determine associations with engagement outcomes of Favourites, Retweets, and Comments. Less than half (n = 10) of predictor variables passed validity tests. Notably, conclusions could not reliably be drawn on whether a Tweet featured evidence-based information. Tweets were significantly more likely to be Retweeted if they contained a hyperlink or multimedia. Tweets were significantly more likely to receive comments if they focused on a specific population group. These associations remain significant when controlling for organization. These findings indicate that researchers may be able to maximize engagement on Twitter by highlighting the population groups that the research applies to and enriching Tweets with multimedia content. In addition, care should be taken to ensure users can infer which messages are evidence-based. Guidelines and an accompanying resource are proposed.

Implementation of a Stepped Care Program to Address Emotional Recovery among Traumatic Injury Patients

BACKGROUND

Annually, over 600,000 adults served in US trauma centers (≥20%) develop posttraumatic stress disorder (PTSD) and/or depression in the first year after injury. American College of Surgeons guidelines include screening and addressing mental health recovery in trauma centers. Yet, many trauma centers do not monitor and address mental health recovery, and it is a priority to learn how to implement evidence-informed mental health programs in trauma centers.

STUDY DESIGN

This report describes our application of the Exploration, Preparation, Implementation, Sustainment model to implement the Trauma Resilience and Recovery Program (TRRP) in 3 Level I and II trauma centers to address patients' mental health needs. TRRP is a scalable and sustainable stepped model of care-one of the few in the US-that provides early intervention and direct services after traumatic injury.

RESULTS

Trauma centers are well positioned to accelerate patients' mental health recovery via early identification, education, screening, and referrals to mental health agencies that provide best-practice care. We found that TRRP was acceptable to the 3 partnering trauma centers we studied. Early engagement of patient, provider, and hospital administration stakeholders enhanced buy-in during the early stages of the implementation process and promoted sustainability. Active processes to support monitoring, evaluation, and adaptation were critical.

CONCLUSIONS

Our work demonstrates the feasibility of implementing and adapting TRRP, a cost-efficient and sustainable stepped care intervention, in Level I and II trauma centers. Several factors should be carefully considered by trauma centers seeking to integrate behavioral health interventions into their trauma program.

Adapting and implementing breast cancer follow-up in primary care: protocol for a mixed methods hybrid type 1 effectiveness-implementation cluster randomized study

BACKGROUND

Advances in detection and treatment for breast cancer have led to an increase in the number of individuals managing significant late and long-term treatment effects. Primary care has a role in caring for patients with a history of cancer, yet there is little guidance on how to effectively implement survivorship care evidence into primary care delivery.

METHODS

This protocol describes a multi-phase, mixed methods, stakeholder-driven research process that prioritizes actionable, evidence-based primary care improvements to enhance breast cancer survivorship care by integrating implementation and primary care transformation frameworks: the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework and the Practice Change Model (PCM). Informed by depth interviews and a four round Delphi panel with diverse stakeholders from primary care and oncology, we will implement and evaluate an iterative clinical intervention in a hybrid type 1 effectiveness-implementation cluster randomized design in twenty-six primary care practices. Multi-component implementation strategies will include facilitation, audit and feedback, and learning collaboratives. Ongoing data collection and analysis will be performed to optimize adoption of the intervention. The primary clinical outcome to test effectiveness is comprehensive breast cancer follow-up care. Implementation will be assessed using mixed methods to explore how organizational and contextual variables affect adoption, implementation, and early sustainability for provision of follow-up care, symptom, and risk management activities at six- and 12-months post implementation.

DISCUSSION

Study findings are poised to inform development of scalable, high impact intervention processes to enhance long-term follow-up care for patients with a history of breast cancer in primary care. If successful, next steps would include working with a national primary care practice-based research network to implement a national dissemination study. Actionable activities and processes identified could also be applied to development of organizational and care delivery interventions for follow-up care for other cancer sites.

TRIAL REGISTRATION

Registered with ClinicalTrials.gov on June 2, 2022: NCT05400941.

What caregivers like the most (and least) about cognitive behavioral therapy for youth anxiety: A mixed methods approach

Cognitive behavioral therapy (CBT) is an efficacious therapy for youth anxiety disorders. Caregivers are key stakeholders in youth therapy, and their feedback on treatment can help to inform intervention personalization. This mixed-methods study applied a systematic inductive thematic analysis to identify themes among most- and least-liked CBT features reported by caregivers using open-ended responses on the Client Satisfaction Questionnaire (CSQ-8). The sample included 139 caregivers of youth ages 7-17 (M = 12.21, SD = 3.05; 59% female; 79.1% Caucasian, 5.8% Black, 2.9% Asian, 2.2% Hispanic, 7.9% Multiracial, 2.2% Other) with principal anxiety diagnoses who completed 16-sessions of CBT. CSQ-8 quantitative satisfaction scores (M = 29.18, SD = 3.30; range: 16-32) and survey-based treatment response rates (responders n = 93, 67%) were high. Most-liked treatment features included: coping skills (i.e., exposure, understanding/identifying anxiety, rewards, homework), therapist factors (interpersonal style/skill, relationship, accessibility), caregiver involvement, one-on-one time with a therapist, structure, consistency, and personally tailored treatment. Least-liked treatment features included: questionnaires, logistical barriers, telehealth, need for more sessions, non-anxiety concerns not addressed, insufficient caregiver involvement, and aspects of exposure tasks. Proportional frequencies of most- and least-liked themes differed by treatment responder status (e.g., responders cited exposure and homework as most-liked more frequently).

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity

Prominent theories within the field of implementation science contend that organizational leaders can improve providers' fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate's influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals' EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals' increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT-however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.

Implementing Evidence-Based Mental-Health Treatments: Attending to Training, Fidelity, Adaptation, and Context

This article provides a very high-level overview of some key considerations in the field of implementation science as it relates to clinical psychology. The article reviews recent findings regarding treatment fidelity, adaptation of treatments, and clinical outcomes. It then details some recent findings on training therapists to provide evidence-based therapies as they were designed to be delivered, with sufficient skill and adaptations if needed to ensure better fit for clients who receive treatments in different treatment settings. Finally, the article considers implications for implementing and sustaining new treatments and supporting their fidelity and adaptation, as well as key directions for future research.

The efficacy of transdiagnostic cognitive behavioral therapy on migraine headache: a pilot, feasibility study

Introduction

Psychological interventions are shown to be effective in migraine, but not utilized routinely yet. We aimed to evaluate the efficacy of transdiagnostic cognitive behavioral therapy (TCBT) on people with migraine (PwM).

Method

This study was conducted on 40 PwM aged 20–50 years. We randomly assigned participants to two groups of intervention, receiving 10 sessions of TCBT, and control, attending one session on relaxation and stress-management techniques. Days with headache, headache severity, migraine-related disability and effects on daily life, number of pain-relivers taken for headache, depression, and anxiety were assessed pre-intervention, post-intervention (three-month follow-up), and one-month after TCBT termination (four-month follow-up).

Results

Thirty-five participants suffering moderate to severe migraine completed the study (16 and 19 in TCBT and control groups, respectively). TCBT improved all measured items between study time-points (p < 0.05) in the intervention group, while such an improvement was not observed in the control group. Between group comparisons revealed superiority of TCBT group compared to the control group in most measured items at three- and four-month follow-ups (p < 0.05).

Conclusion

Ten sessions of TCBT improved migraine severity, associated disability, anxiety, and depression in PwM, with persistent effects after one month of therapy termination. However, the generalizability of these findings is limited due to the placebo effect in the intervention arm, given the more time each participant has spent with the therapist. TCBT could be an affordable, practical, and feasible intervention to be utilized for PwM and larger studies with equal number of sham therapy sessions are needed to further explore this.

Trial registration number: The study protocol was registered in clinicaltrial.gov (NCT03701477) prior to enrollment.

Implementation and scalability of a digital intervention to reduce depressive symptoms in people with diabetes, hypertension or both in Brazil and Peru: a qualitative study of health system's stakeholders' perspectives

Two randomized controlled trials (RCTs) in Brazil and Peru demonstrated the effectiveness of CONEMO, a digital intervention supported by trained nurses or nurse assistants (NAs), to reduce depressive symptoms in people with diabetes and/or hypertension. This paper extends the RCTs findings by reflecting on the conditions needed for its wider implementation in routine care services. A qualitative study using semi-structured interviews and content analysis was conducted with nurses/NAs, clinicians, healthcare administrators, and policymakers. Informants reported that CONEMO would be feasible to implement in their health services, but some conditions could be improved before its scale-up: reducing workloads of healthcare workers; raising mental health awareness among clinicians and administrators; being able to inform, deliver and accompany the intervention; assuring appropriate training and supervision of nurses/NAs; and supporting the use of technology in public health services and by patients, especially older ones. We discuss some suggestions on how to overcome these challenges.

Remote group therapies for cognitive health in schizophrenia-spectrum disorders: Feasible, acceptable, engaging

Severe cognitive impairments and cognitive distortions are core to schizophrenia-spectrum disorders (SSDs) and are associated with deteriorated social functioning. Despite well-established efficacy of group psychosocial therapies targeting cognitive health in SSDs, dissemination of these programs remains limited. Remote delivery offers a promising strategy for increasing the programs' accessibility. Yet, little research has evaluated group therapies for cognitive health delivered in this way. Thus, we aimed to assess, from participants' and therapists' perspectives, the feasibility, acceptability, as well as levels and process of engagement in a videoconference delivery of group psychosocial therapies for SSD patients' cognitive health. Participants, outpatients, attended Action Based Cognitive Remediation or Metacognitive Training, both adapted for videoconference. Then, participants and therapists completed post-therapy questionnaires. Of the 28 participants attending at least one session, 75% completed more than half of sessions and seven dropped out. Technology did not appear to significantly hinder participation in the programs. All completing participants reported a positive experience with therapy, 67% were not bothered by the distance from the therapist, and 77% trusted that the information shared was kept confidential. Therapist-rated levels of attention M = 7.5/9 (SD = 1.04), participation M = 6.91/9 (SD = 1.32), and social interactions M = 5.31/9 (SD = 1.96) were satisfactory. Nonetheless, participants indicated that they would have appreciated more social interactions with group members. These positive results validate the earliest stage in the implementation process for remote group therapies targeting cognitive health in SSDs. Remote delivery promises to improve access to therapies targeting cognitive health and, ultimately, facilitate functional recovery for SSD patients.

Building organizational readiness: initial field testing of an expert-informed typology of implementation strategies

BACKGROUND

Organizational readiness is a known barrier to implementing evidence-based practices (EBPs) in community mental health services. A robust methodology for enhancing organizational readiness for implementation (ORI) has the potential to improve implementation outcomes of EBPs and ensure better services for people with a psychiatric disability. Prior work established a framework of implementation strategies targeting ORI enhancement by asking a group of implementation experts from various fields to categorize strategies from the "Expert Recommendations for Implementing Change" (ERIC) Project into three readiness stages, consistent with the pre-action stages of the Transtheoretical Model of behavioral change: Pre-contemplation, Contemplation, and Preparation. The current study provides initial confirmation and refinement to this expert-driven typology based on community mental health field experiences.

METHODS

We conducted in-depth interviews with stakeholders involved in a recent EBP implementation project. Participants included staff (n=9) from four community mental health agencies and the implementation team who facilitated the project (n=3). Their pre-implementation experiences were compared with the experts' typology to identify consistencies and discrepancies.

RESULTS

The participants' experiences were congruent with two thirds of the strategies identified by the experts for specific ORI stages. The refinements included 12 strategies used in additional stages beyond the experts' classification, four strategies from the ERIC list that were not included in the ORI typology, and five new strategies.

CONCLUSIONS

This study provides initial confirmation and refinements to the previously published ORI typology. The results offer guidance as to how ORI could be enhanced in the community mental health field.

Applying implementation science in mental health services: Technical assistance cases from the Mental Health Technology Transfer Center (MHTTC) network

OBJECTIVE

Critical gaps exist between implementation of effective interventions and the actual services delivered to people living with mental disorders. Many technical assistance (TA) efforts rely on one-time trainings of clinical staff and printed guidelines that alone are not effective in changing clinical practice. The Mental Health Technology Transfer Center (MHTTC) Network uses implementation science to accelerate the use of evidence-based practices (EBPs), improve performance, and bring about systems-level change.

METHOD

Four case examples illustrate how MHTTCs employ the Exploration-Preparation-Implementation-Sustainment (EPIS) implementation framework and intensive implementation strategies to educate clinicians, manage change, and improve processes. These examples include implementing motivational interviewing, cognitive-behavioral therapy for people with psychosis, strategies to decrease the no show rate for virtual appointments, and school mental health systems development.

RESULTS

From Preparation through Sustainment, MHTTCs successfully employed implementation strategies including learning communities, audit and feedback, and coaching to bring about change. Each project attended to inner and outer contexts to eliminate barriers. The examples also show the benefit of integrating process improvement alongside implementation.

CONCLUSIONS

The MHTTCs are a model for using implementation science to design technical assistance that leads to more successful practical execution of EBPs; thus reducing the gap between research and practice.

Quantitative measures used in empirical evaluations of mental health policy implementation: A systematic review

Background

Mental health is a critical component of wellness. Public policies present an opportunity for large-scale mental health impact, but policy implementation is complex and can vary significantly across contexts, making it crucial to evaluate implementation. The objective of this study was to (1) identify quantitative measurement tools used to evaluate the implementation of public mental health policies; (2) describe implementation determinants and outcomes assessed in the measures; and (3) assess the pragmatic and psychometric quality of identified measures.

Method

Guided by the Consolidated Framework for Implementation Research, Policy Implementation Determinants Framework, and Implementation Outcomes Framework, we conducted a systematic review of peer-reviewed journal articles published in 1995-2020. Data extracted included study characteristics, measure development and testing, implementation determinants and outcomes, and measure quality using the Psychometric and Pragmatic Evidence Rating Scale.

Results

We identified 34 tools from 25 articles, which were designed for mental health policies or used to evaluate constructs that impact implementation. Many measures lacked information regarding measurement development and testing. The most assessed implementation determinants were readiness for implementation, which encompassed training (n  =  20, 57%) and other resources (n  =  12, 34%), actor relationships/networks (n  =  15, 43%), and organizational culture and climate (n  =  11, 31%). Fidelity was the most prevalent implementation outcome (n  =  9, 26%), followed by penetration (n  =  8, 23%) and acceptability (n  =  7, 20%). Apart from internal consistency and sample norms, psychometric properties were frequently unreported. Most measures were accessible and brief, though minimal information was provided regarding interpreting scores, handling missing data, or training needed to administer tools.

Conclusions

This work contributes to the nascent field of policy-focused implementation science by providing an overview of existing measurement tools used to evaluate mental health policy implementation and recommendations for measure development and refinement. To advance this field, more valid, reliable, and pragmatic measures are needed to evaluate policy implementation and close the policy-to-practice gap.

Plain Language Summary

Mental health is a critical component of wellness, and public policies present an opportunity to improve mental health on a large scale. Policy implementation is complex because it involves action by multiple entities at several levels of society. Policy implementation is also challenging because it can be impacted by many factors, such as political will, stakeholder relationships, and resources available for implementation. Because of these factors, implementation can vary between locations, such as states or countries. It is crucial to evaluate policy implementation, thus we conducted a systematic review to identify and evaluate the quality of measurement tools used in mental health policy implementation studies. Our search and screening procedures resulted in 34 measurement tools. We rated their quality to determine if these tools were practical to use and would yield consistent (i.e., reliable) and accurate (i.e., valid) data. These tools most frequently assessed whether implementing organizations complied with policy mandates and whether organizations had the training and other resources required to implement a policy. Though many were relatively brief and available at little-to-no cost, these findings highlight that more reliable, valid, and practical measurement tools are needed to assess and inform mental health policy implementation. Findings from this review can guide future efforts to select or develop policy implementation measures.

Behavioral Therapy Teams for Obsessive-Compulsive Disorder: Lessons Learned From a Pilot Randomized Trial in a Community Mental Health Center

Community mental health centers (CMHCs) provide the majority of mental health services for low-income individuals in the United States. Exposure and response prevention (ERP), the psychotherapy of choice for obsessive-compulsive disorder (OCD), is rarely delivered in CMHCs. This study aimed to establish the acceptability and feasibility of testing a behavioral therapy team (BTT) intervention to deliver ERP in CMHCs. BTT consisted of individual information-gathering sessions followed by 12 weeks of group ERP and concurrent home-based coaching sessions. The sample consisted of 47 low-income individuals with OCD who were randomized to receive BTT or treatment as usual (TAU). Symptom severity and quality-of-life measures were assessed at pretreatment, posttreatment, and 3- and 6-month posttreatment. Feasibility of training CMHC staff was partially successful. CMHC therapists successfully completed rigorous training and delivered ERP with high fidelity. However, training paraprofessionals as ERP coaches was more challenging. ERP was feasible and acceptable to patients. BTT participants were more likely than TAU participants to attend their first therapy session and attended significantly more treatment sessions. A large between-group effect size was observed for reduction in OCD symptoms at posttreatment but differences were not maintained across 3- and 6-month follow-ups. For BTT participants, within-group effect sizes reflecting change from baseline to posttreatment were large. For TAU participants, depression scores did not change during the active treatment phase but gradually improved during follow-up. Results support feasibility and acceptability of ERP for this patient population. Findings also underscore the importance of implementation frameworks to help understand factors that impact training professionals.

A Preliminary Investigation of Provider Attitudes Toward a Transdiagnostic Treatment: Outcomes from Training Workshops with the Unified Protocol

Evidence-based psychological treatments (EBPTs) for common mental health conditions are efficacious but remain underutilized in clinical service settings. Novel transdiagnostic and modular approaches that treat several disorders simultaneously promise to address common barriers to the dissemination and implementation of traditional EBPTs. Despite the promise that transdiagnostic treatments hold, the claims that these interventions can be more easily disseminated and implemented have not been widely tested. The present study examined whether a transdiagnostic treatment, the Unified Protocol (UP), addresses some barriers to dissemination and implementation for clinicians. Exploratory aims of the current study were to examine the effects of a UP introductory training workshop on clinician attitudes and behaviors by: (1) evaluating UP knowledge and treatment delivery, (2) determining relationships between clinician characteristics and their knowledge acquisition, satisfaction with UP, and UP penetration, and (3) exploring clinicians' perceptions of the UP's characteristics utilizing mixed methods. Workshop participants showed a good understanding of UP treatment concepts following training, and over a third of survey respondents reported use of the intervention 6-months after training. Positive attitudes toward EBPTs and fewer years of clinical practice were associated with greater satisfaction with the UP. Clinicians held positive views of the UP's flexibility and relative advantage over standard EBPTs but held negative views toward the manual's design and packaging. Overall, our findings suggest that clinicians may view transdiagnostic treatments such as the UP favorably and may consider them appealing over standard EBPTs. However, barriers associated with traditional EBPTs may extend to transdiagnostic treatments like the UP.

Continued capacity: Factors of importance for organizations to support continued Let's Talk practice - a mixed-methods study

Sustainability is a desired outcome of implementation. Understanding how organizations support new practices after implementation is important for sustainability. Let's Talk about Children (hereby referred to as 'Let's Talk'), a family-focused intervention with parents with a mental illness, improves family, parent, and child outcomes. Little is understood about how organizations support sustained practice. The study aimed to (i) understand the implementation process that occurred in eight adult mental health services during a previous randomized controlled trial; (ii) establish their continued capacity to embed Let's Talk; and (iii) explore links between organizational capacity and sustained delivery by practitioners. This mixed method study used a questionnaire and individual interviews to collect data on the implementation process and current organizational capacity to support Let's Talk 12months after the randomized controlled trial. Links between organizational capacity and the adult mental health services with practitioners' continuing to use Let's Talk in the past 12 months were explored. Services with higher current organizational capacity scores had practitioners currently delivering Let's Talk. These services had all made changes to their organizational structures to support Let's Talk practice. All services experienced significant changes during and after implementation, influencing sustainability of Let's Talk. Addressing organizational capacity appears to be important to enable sustainability of Let's Talk implementation endeavours. Real-world settings are constantly changing systems requiring ongoing tracking and adjustments to understand and support sustainability. Internal service development staff appear to support the shaping of organizational capacity to support Let's Talk; however, broader organizational support is needed for change within a complex system.

Changes in practitioners' attitudes, perceived training needs and self-efficacy over the implementation process of an evidence-based parenting program

BACKGROUND

Evidence-based family support programs such as the Triple P - Positive Parenting Program have the potential to enhance the well-being of children and families. However, they cannot achieve their expected outcomes if insufficient attention is paid to the implementation process. It has been demonstrated that practitioners' attitudes towards evidence-based programs (EBPs), perceived training needs and self-efficacy for working with parents influence implementation outcomes (e.g., program acceptability, adoption, adherence and sustainability). At the same time, the experience of being involved in the implementation process of an EBP could enhance practitioners' perceptions of the initiative. This study aimed to assess changes in practitioner's attitudes, perceived training needs and self-efficacy over a two-year EBP implementation process, in interaction with their appraisal of their organization's capacity to implement the EPB.

METHODS

In the province of Quebec, Canada, Triple P was implemented and evaluated in two communities. Ninety-nine practitioners from various organizations completed questionnaires shortly before their training in Triple P and two years later.

RESULTS

Findings show that practitioners who displayed more initial skepticism regarding their organization's capacity to implement the program reported greater improvements in attitudes over time, while practitioners who showed more optimism at baseline reported a greater decrease in their perceived training needs. Practitioners' self-efficacy increased moderately regardless of perceived organizational capacity.

CONCLUSIONS

These results are encouraging given that more positive perceptions of EBPs could foster the systematic use of these programs in communities, for the potential benefit of a greater number of families.

Factors impacting the implementation of a psychoeducation intervention within the mental health system: a multisite study using the consolidation framework for implementation research

BACKGROUND

Despite a strong evidence base and policy recommendation supporting the implementation of psychoeducation interventions within the mental health system, equitable access for many service users and family members has not been achieved. To enhance translation, developing an evidence-base around the factors that influence implementation of interventions is critical.

METHODS

The aim of the study was to explore the factors influencing implementation of a group cofacilitated recovery focused psychoeducation intervention. The study design was explorative qualitative descriptive, involving the collection of data through individual and focus group interviews with key stakeholders (n = 75) involved with the implementation within 14 mental health sites in the Republic of Ireland. The Consolidation Framework for Implementation Research (CFIR) was used as a conceptual framework to guide data collection and analysis.

RESULTS

Key enablers and barriers were identified across all CFIR domains of the framework with some factors (depending on context) being both an enabler and a barrier. Important factors in the outer setting domain included structural stability within national systems and the peer payment system, while the extent of a recovery-oriented culture, leadership, implementation readiness, and buy-in were influential factors in the inner setting. The characteristics of the intervention in terms of design, evidence-base and adaptability also shaped the intervention's implementation as did the knowledge, beliefs and self-efficacy of facilitators. In terms of processes, implementation was influenced by the degree of engagement of key individuals who championed and supported the programme. The results highlight that while some of the barriers were specific to the programme, many reflected systemic and structural challenges within health services more generally.

CONCLUSION

Findings from this study provide an enhanced understanding of the different layers of determinants to implementation of an intervention. Overcoming challenges will involve positive and ongoing engagement and collaboration across the full range of stakeholders that are active within each domain, including policy and operational levels. The quality of leadership at each domain level is of crucial importance to successful implementation.

Training During a Pandemic: Successes, Challenges, and Practical Guidance From a Virtual Facilitated Learning Collaborative Training Program for Written Exposure Therapy

In response to COVID-19, continued workforce training is essential to ensure that evidence-based treatments are available on the frontline to meet communities' ongoing and emerging mental health needs. However, training during a pandemic imposes many new challenges. This paper describes a multisite training and implementation pilot program, facets of which allowed for continued training despite the onset of the COVID-19 pandemic and subsequent social distancing guidelines. This virtual facilitated learning collaborative in Written Exposure Therapy, an evidence-based treatment for posttraumatic stress disorder, included virtual workshop training, phone-based clinical consultation, implementation-focused video calls for program leadership, and program evaluation. Data are presented about program enrollees and patient impact following the onset of COVID-19-related social distancing restrictions. Challenges, successes, and practical guidance are discussed to inform the field regarding training strategies likely to be durable in an uncertain, dynamic healthcare landscape.

Leadership perspectives on key elements influencing implementing a family-focused intervention in mental health services

WHAT IS KNOWN ON THE SUBJECT?: Family-focused interventions in Adult Mental Health Services (AMHS) address the needs of families where a parent is diagnosed with a mental illness. One of these interventions is the "Let's Talk about Children" programme (Let's Talk) (Solantaus & Toikka, 2006 International Journal of Mental Health Promotion, 8(3), 37). There is limited implementation knowledge on family-focused interventions. A body of research to better understand the transfer of evidence-based interventions into everyday practice has identified multiple influencing elements. The Consolidated Framework for Implementation Research (CFIR) has combined these known elements from research into five domains of influence. Elements that influence the implementation of evidence-based practice are inter-related and need to be understood in combination. Understanding different stakeholder perspectives on implementation in real-world settings helps to understand uptake, challenges and opportunities. WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: As the first study to document leadership's perspectives of implementing Let's Talk, this paper contributes to the evidence base on their role in implementing family-focused practice models in mental health. There are specific roles of leadership that need to be addressed to support implementing Let's Talk in changing environments. Leadership's knowledge of Let's Talk and approach to change influences implementation. Questions are raised about the role the readiness of the parent and the impact that the dynamic process between the practitioner and parent has on implementing Let's Talk. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Engaging leadership needs to address the influence of their different organizational roles in shaping implementation for Let's Talk. Further research is needed to understand the dynamic process between parent and practitioner that influences readiness for trialling Let's Talk. ABSTRACT: Introduction Different stakeholder's perspectives are needed to understand challenges and opportunities in implementing and sustaining evidence-based practices (EBP) in real-world settings. Aim/Question To identify leadership perspectives on key elements influencing the process of implementation of Let's Talk about Children (Let's Talk), a family-focused practice for practitioners working with parents diagnosed with a mental illness. Method Semi-structured interviews were conducted with 16 service managers and implementation leads, to establish their views on key elements influencing implementation of Let's Talk during a randomized controlled trial. A thematic analysis applied both inductive and deductive approaches, using the Consolidated Framework for Implementation Research (CFIR). Results Impacts to effective translation to practice were grouped into three broad themes with eight subthemes: inner and outer setting impacting organization, leadership affecting readiness and parent and practitioner readiness. Discussion The findings suggest that specific roles for leadership are vital to implementation within an environment of constant change, and more attention is needed to understand the dynamics of parent and practitioner readiness for delivering Let's Talk. Implications for practice Different leadership roles need to be engaged to sustain Let's Talk in changing real-world environments. The dynamic processes between parent and practitioner are suggested to influence readiness and need further research.

Program description and implementation findings of MyCare: enhancing community mental health care in Tasmania, Australia

Since 2014, Tasmania has experienced unprecedented rates of hospitalisations related to mental health issues. To address reliance on such acute-based care, government funding was invested to enhance community-based care, which, in turn, led to the development of MyCare. This paper represents the initial phase of a larger body of work (i.e. an effectiveness-controlled trial of MyCare) that describes the MyCare program and the successful implementation strategy underpinning the program. The implementation of MyCare was evaluated with 41 key stakeholders (staff, clients and senior executives) using semistructured interviews and focus groups, informed by the Consolidated Framework for Implementation Research (CFIR). According to stakeholders, three CFIR constructs that were directly addressed by the program, namely Tension for Change, Evidence Strength and Quality, and Available Resources for Implementation, facilitated the successful implementation of MyCare. In contrast, a feature of the program that impeded implementation was Patient Needs and Resources, which restricted program access to those with the most severe mental health issues. The reporting of implementation strategies underpinning mental health programs is rare. This study describes the implementation strategy underpinning a community-based mental health program that was successful in facilitating program uptake. We encourage other researchers to not only report on implementation findings, which may help avoid replication failure, but also to apply these innovative implementation processes (i.e. address the tension for change and ensure the program is evidence informed and that sufficient resources are available for implementation) within mental health programs to aid successful uptake.

An explanatory model of factors enabling sustainability of let's talk in an adult mental health service: a participatory case study

Background

While effective interventions have been developed to support families where a parent has a mental illness in Adult Mental Health Services, embedding and sustaining them is challenging resulting in families not having access to support. This study developed an explanatory model of influencers that had enabled sustainability of the Let’s Talk intervention in one service.

Methods

A participatory case study was used to build an explanatory model of sustainability at the service using theoretical frameworks. Qualitative and quantitative data was collected about practitioner’s practice and the organisation’s implementation process and capacity to support practice. A local research group worked with the researcher using a transforming data approach through description, analysis and interpretation.

Results

Influencers were grouped into four major categories: (1) External social, political and financial context, (2) Resources, (3) Prior organisational capacity and (4) Sustainability Factors. The last category, Sustainability factors, was divided into three subcategories: (4.1)Practitioner (4.2) Organisation and (4.3) Parent-Client. These categories form part of an explanatory model for the key influencers of continued practitioner practice and organisational capacity to support practice.

Conclusions and implications for practice

In this case study, the pre-existing organisational context along with practitioner, organisation and parent-client factors operated together to influence sustainability. The results suggest that sustainability is more likely to be supported by both linking Let’s Talk to existing organisational identity, capacity, structures and relationships and by supporting mutual adaptations to improve the fit. Additionally, by understanding that setbacks are common and ongoing adjustments are needed, implementers are able to have realistic expectations of sustainability.

Race and Equity in Statewide Implementation Programs: An Application of the Policy Ecology of Implementation Framework

Although the literature is growing regarding large-scale, system-wide implementation programs, the broader political and social contexts, including race and ethnicity, are frequently ignored. Using the Policy Ecology of Implementation framework (Raghavan et al., Implement Sci 3:26, 2008), Minnesota's CEMIG is examined to investigate the role of social and political contexts in the implementation process and the barriers they create. Data from 22 interview transcripts from DHS administrators, agency grant managers, university educators, advocacy group representatives, and mental health board members, along with more than 1000 grant documents were qualitatively analyzed using content analysis to reveal three themes concerning how the participants experienced program implementation: invisibility, isolation, and inequity. Findings demonstrate the participants perceived that the grant program perpetuated inequities by neglecting to promote the program, advocate for clinicians of color, and coordinate isolated policy ecology systems. Strategies for future large-scale, system-wide mental health program implementation are provided.

A systematic review of the clinician related barriers and facilitators to the use of evidence-informed interventions for post traumatic stress

BACKGROUND

A number of evidence-informed interventions for PTSD have been developed and recommended by clinical guidelines. Despite efforts to disseminate these approaches, there remains a gap between evidence and practice, and research has started to identify a number of barriers to the implementation of evidence-informed interventions.

METHODS

This systematic review aimed to synthesise the relevant literature, both quantitative and qualitative, relating to clinicians' perceived barriers and facilitators. Literature searches were conducted to identify relevant studies. Data were analysed using content analysis to categorise key barriers and facilitators.

RESULTS

A literature search identified 34 relevant studies. Four levels of barriers and facilitators were identified, covering intervention, client, clinician and system factors. The most commonly cited barriers identified include inflexibility of manualised approaches, fear of increasing client distress, working with comorbidities and a lack of training and support. Quality appraisal rated the majority of studies as strong, with five studies receiving an adequate rating.

LIMITATIONS

The review was limited to studies published in the English language, therefore introducing a risk of bias as perceived barriers and facilitators may be culturally influenced. Additionally the heterogeneity of studies may impact upon comparability, only allowing for a broad analysis and not exploring barriers and facilitators in more detail.

CONCLUSIONS

Lack of training, confidence and knowledge relating to the implementation of evidence-informed interventions for PTSD were commonly reported. A better-informed understanding into the challenges and facilitators experienced by clinicians can help inform implementation needs and should be considered in the development and implementation of training initiatives.

Outcomes Associated With Adapting a Research-Supported Treatment for Children With Behavior Disorders

PURPOSE

The aims of this study are to describe an adaptation process of a research-supported treatment (RST) for children with oppositional defiant disorder and to examine provider attitudes toward RSTs prior to and following this process.

METHOD

Providers from 14 agencies in New York State delivered the adapted RST, following training. Attitudes toward RSTs were measured by the Evidence-Based Practice Attitude Scale at baseline and posttest.

RESULTS

Openness toward RSTs decreased from baseline to posttest. The majority of providers reported modifications to the structure and process of the intervention.

DISCUSSION

To improve the uptake and usability of RSTs in practice, future research must further address adaptation processes and their relationships to attitudes toward RSTs.

Beyond checkboxes: A qualitative assessment of physicians' experiences providing care in a patient-centred medical home

RATIONALE, AIMS, AND OBJECTIVES

The patient-centred medical home (PCMH) is an innovative approach to health care reform. Despite a well-established process for recognizing PCMH practices, fidelity to, and/or adaptation of, the PCMH model can limit health care and population health improvements. This study explored the connection between fidelity/adaptation to the PCMH model with implementation successes and challenges through the experiences of family and internal medicine PCMH physicians.

METHODS

Interviews were conducted at two academic PCMH clinics with faculty and resident physicians. Data were transcribed and coded on the basis of an a priori code list. Together, the authors reviewed text and furthered the analysis process to reach final interpretation of the data.

RESULTS

Ten faculty and nine resident physicians from the Family Care Centre (FCC; n = 11) and the Internal Medicine Clinic (IMC; n = 8) were interviewed. Both FCC and IMC physicians spoke positively about their clinic's adherence to the PCMH model of enhanced access to care, coordinated/integrated care, and improvements in quality and safety through data collection and documentation. However, physicians highlighted inadequate staffing and clinic hours. FCC physicians also discussed the challenge of providing high-quality care amidst differences in coverage between payers.

CONCLUSION

There remains significant variability in PCMH characteristics across the United States and Canada. This qualitative analysis uncovered factors contributing to fidelity/adaptation to the PCMH model in two academic PCMH clinics. For the PCMH to achieve the Triple Aim promise of improved patient health and experience at a reduced cost, policy must support fidelity to core elements of the PCMH.

The effect of an online lecture on psychosocial cancer care providers' attitudes about hypnosis

Hypnosis has been shown to be efficacious in the control of the symptoms and side effects of cancer and its treatment across all stages of the cancer continuum. Yet, hypnosis has generally failed to widely disseminate to clinical cancer settings, potentially due in part to provider attitudes about hypnosis. In a sample of 340 trainees (psychosocial cancer care providers), we tested the effects of a 12-minute online video hypnosis lecture on provider attitudes (using the Attitudes Toward Hypnosis Questionnaire). We hypothesized that viewing the online video would improve attitudes about hypnosis. Using a repeated measures design, total attitudes toward hypnosis improved following the lecture [F(1,339) = 321.97, p < .0001], as did all hypnosis attitude subscales. Older age and ethnicity (Latino/a) were associated with more positive attitudes across assessment points (ps < .05). Those trainees without prior hypnosis experience had the most attitude improvement (p < .05). The results support the use of a brief, online hypnosis lecture to improve cancer care provider attitudes about hypnosis, and suggest a path forward to facilitate more widespread dissemination of hypnosis to cancer care.

Stepped Care as an Implementation and Service Delivery Model for Cognitive Behavioral Therapy for Psychosis

Cognitive behavioral therapy for schizophrenia spectrum disorders is an evidence-based treatment that is recommended by United States schizophrenia treatment guidelines. Based on recent estimates, only 0.3% of individuals with a primary psychotic disorder are able to access this treatment in the United States. Stepped care interventions have shown promise as an applied treatment delivery model in other settings and for other psychotherapeutic interventions. The current paper describes how the stepped care model can be applied to CBT for psychosis in the US to increase access to the intervention in community mental health settings by leveraging the multidisciplinary team.

A Quality Improvement Assessment of the Delivery of Mental Health Services among WTC Responders Treated in the Community

The World Trade Center Health Program (WTCHP) provides mental health services through diverse service delivery mechanisms, however there are no current benchmarks to evaluate utilization or quality. This quality improvement (QI) initiative sought to examine the delivery and effectiveness of WTCHP mental health services for World Trade Center (WTC) responders who receive care through the Northwell Health Clinical Center of Excellence (CCE), and to characterize the delivery of evidence-based treatments (EBT) for mental health (MH) difficulties in this population. Methods include an analysis of QI data from the Northwell CCE, and annual WTCHP monitoring data for all responders certified for mental health treatment. Nearly 48.9% of enrolled responders with a WTC-certified diagnosis utilized treatment. The majority of treatment delivered was focused on WTC-related conditions. There was significant disagreement between provider-reported EBT use and independently-evaluated delivery of EBT (95.6% vs. 54.8%, p ≤ 0.001). EBT delivery was associated with a small decrease in Posttraumatic Stress Disorder (PTSD) symptoms over time. Providers engaged in the process of data collection, but there were challenges with adherence to outcome monitoring and goal setting. Data from this report can inform continued QI efforts in the WTCHP, as well as the implementation and evaluation of EBT.

Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design

BACKGROUND

There is mounting evidence supporting the effectiveness of task-shifted mental health interventions in low- and middle-income countries (LMIC). However, there has been limited systematic scale-up or sustainability of these programs, indicating a need to study implementation. One barrier to progress is a lack of locally relevant and valid implementation measures. We adapted an existing brief dissemination and implementation (D&I) measure which includes scales for acceptability, appropriateness, feasibility and accessibility for local use and studied its validity and reliability among a sample of consumers in Ukraine.

METHODS

Local qualitative data informed adaptation of the measure and development of vignettes to test the reliability and validity. Participants were veterans and internally displaced persons (IDPs) recruited as part of a separate validity study of adapted mental health instruments. We examined internal consistency reliability, test-retest reliability, and construct and criterion validity for each scale on the measure. We randomly assigned half the participants to respond to a vignette depicting existing local psychiatric services which we knew were not well regarded, while the other half was randomized to a vignette describing a potentially more well-implemented mental health service. Criterion validity was assessed by comparing scores on each scale by vignette and by overall summary ratings of the programs described in the vignettes.

RESULTS

N = 169 participated in the qualitative study and N = 153 participated in the validity study. Qualitative findings suggested the addition of several items to the measure and indicated the importance of addressing professionalism/competency of providers in both the scales and the vignettes. Internal consistency reliabilities ranged from α = 0.85 for feasibility to α = 0.91 for appropriateness. Test-rest reliabilities were acceptable to good for all scales (rho: 0.61-0.79). All scales demonstrated substantial and significant differences in average scores by vignette assignment (ORs: 2.21-5.6) and overall ratings (ORs: 5.1-14.47), supporting criterion validity.

CONCLUSIONS

This study represents an innovative mixed-methods approach to testing an implementation science measure in contexts outside the United States. Results support the reliability and validity of most scales for consumers in Ukraine. Challenges included large amounts of missing data due to participants' difficulties responding to questions about a hypothetical program.

A Narrative Inquiry Into Global Systems Change to Support Families When a Parent Has a Mental Illness

The issues that confront families when a parent experiences mental illness are complex. This often means that multiple service systems must be engaged to meet families' needs, including those related to intergenerational experiences of mental health and illness. A multisystem approach to public mental health care is widely recommended as a form of preventative intervention to address the effects of mental illness and its social, psychological, and economic impact upon parents, children, and families. Globally, a multisystemic approach to care requires a change in the way systems are currently organized to support families, as well as the way systems are interacting with families, and with each other. This qualitative secondary analysis emerged from a primary study examining global systems change efforts to support families, including components of change that were common and considered successful in different countries. A narrative inquiry method was used to re-analyze the data by compiling the stories of change described by individuals from participant countries. The data were interrogated to ask questions about story content, and to identify who was telling the story and how they described important changes across different geographical and cultural contexts. The individual stories of 89 systems change experts from 16 countries were then compiled into a shared global narrative to demonstrate international progress that has occurred over time, toward multisystemic change to support families where parents experience mental illness. While the global narrative demonstrates considerable overlap between pathways toward change, it is also important to document individual stories, as change pertains differently in different contexts. The individual stories and the global narrative illustrate how countries begin a journey toward change at different time points and may have various outcomes in mind when they commence. Study findings raise questions about the extent to which systems change can be standardized across countries that have unique social, cultural, political, and economic features. This study provides several potential points of reference for countries considering, or currently undertaking systems change to support families where a parent has a mental illness. It also provides an important story about international efforts undertaken to improve outcomes for families.

A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes

This randomized controlled hybrid implementation/effectiveness trial aimed to compare the impact of three different models of training and consultation by examining the PTSD treatment outcomes achieved by therapists who were learning a front-line recommended psychotherapy for posttraumatic stress disorder (PTSD), Cognitive Processing Therapy (CPT; Resick, Monson, & Chard, 2017). Therapists (N = 134) were randomized into one of three conditions after attending a standard CPT training workshop: No Consultation with delayed feedback on CPT fidelity, Standard Consultation involving discussion and conceptualization of cases without session audio review, and Consultation Including Audio Review, which included a review of segments of audiorecorded CPT sessions. Across all training conditions, the patients treated by these therapists (N = 188) evidenced statistically significant reductions in PTSD symptoms, (d = -0.95 to -1.78), comorbid symptoms and functioning (d = -0.27 to -0.51). However, patients of therapists in the Standard Consultation condition (ΔPTSD = - 19.64, d = -1.78) experienced significantly greater improvement than those in the No Consultation condition (ΔPTSD = - 10.54, d = -0.95, ΔDEV = 6.30, ΔParms = 2, p = .043). This study demonstrates that patients who receive evidence-based psychotherapy for PTSD in routine care settings can experience significant symptom improvement. Our findings also suggest that to maximize patient benefit, therapist training should include consultation, but that audio review of sessions during consultation may not be necessary, at least for structured protocols. Implications for implementation, including the reduction of burden and cost of post-workshop support, are discussed.

Treatment utilization and barriers to treatment among individuals with olfactory reference syndrome (ORS)

OBJECTIVE

Olfactory reference syndrome (ORS) is characterized by a preoccupation that one is emitting a foul or offensive odor. Despite the profound psychosocial impact of ORS, many patients do not receive appropriate treatment, and there is no empirical research on treatment-seeking behavior in ORS. This study investigated treatment utilization patterns and barriers to treatment in individuals with ORS.

METHOD

253 subjects completed an online survey between January-March 2010. Data were obtained from the Yale-Brown Obsessive Compulsive Scale Modified for ORS (ORS-YBOCS), Depression Anxiety Stress Scales (DASS), Work and Social Adjustment Scale (WSAS), and questionnaires specific to treatment utilization and barriers.

RESULTS

The sample was ethnically diverse, predominately male (67%), with an average age of 33.7years, and moderately severe ORS symptoms. Most participants first sought care from a medical specialist (44%), and mental health services were underutilized (14%). Higher functional impairment was significantly correlated with seeking care from a mental health provider, compared to a medical specialist. Nearly all participants endorsed multiple barriers to treatment, including (a) logistical/financial, (b) stigma/discrimination, and (c) treatment perception barriers. ORS symptom severity was significantly, positively correlated with number of logistical/financial and stigma/discrimination barriers. Treatment barriers were significantly influenced by ethnic group, ORS symptom severity, and source of odor.

CONCLUSION

Results highlight the importance of increasing awareness and enhancing access to care for individuals with ORS.

A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration

Since 2006, the Veterans Health Administration (VHA) has instituted policy changes and training programs to support system-wide implementation of two evidence-based psychotherapies (EBPs) for posttraumatic stress disorder (PTSD). To assess lessons learned from this unprecedented effort, we used PubMed and the PILOTS databases and networking with researchers to identify 32 reports on contextual influences on implementation or sustainment of EBPs for PTSD in VHA settings. Findings were initially organized using the exploration, planning, implementation, and sustainment framework (EPIS; Aarons et al. in Adm Policy Ment Health Health Serv Res 38:4-23, 2011). Results that could not be adequately captured within the EPIS framework, such as implementation outcomes and adopter beliefs about the innovation, were coded using constructs from the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework (Glasgow et al. in Am J Public Health 89:1322-1327, 1999) and Consolidated Framework for Implementation Research (CFIR; Damschroder et al. in Implement Sci 4(1):50, 2009). We highlight key areas of progress in implementation, identify continuing challenges and research questions, and discuss implications for future efforts to promote EBPs in large health care systems.

VA mobile apps for PTSD and related problems: public health resources for veterans and those who care for them

Many public health agencies, including the U.S. Department of Veterans Affairs (VA), have identified the use of mobile technologies as an essential part of a larger strategy to address major public health challenges. The VA's National Center for PTSD (NCPTSD), in collaboration with VA's Office of Mental Health and Suicide Prevention and the Defense Health Agency inside the U.S. Department of Defense (DoD), has been involved in the development, evaluation, and testing of 15 mobile apps designed specifically to address the needs and concerns of veterans and others experiencing symptoms of posttraumatic stress disorder (PTSD). These applications include seven treatment-companion apps (designed to be used with a provider, in conjunction with an evidence-based therapy) and eight self-management apps (designed to be used independently or as an adjunct or extender of traditional care). There is growing evidence for the efficacy of several of these apps for reducing PTSD and other symptoms, and studies of providers demonstrate that the apps are engaging, easy-to-use, and provide a relative advantage to traditional care without apps. While publicly available apps do not collect or share personal data, VA has created research-enabled versions of many of its mental health apps to enable ongoing product enhancement and continuous measurement of the value of these tools to veterans and frontline providers. VA and DoD are also collaborating on provider-based implementation networks to enable clinicians to optimize implementation of mobile technologies in care. Although there are many challenges to developing and integrating mHealth into care, including cost, privacy, and the need for additional research, mobile mental health technologies are likely here to stay and have the potential to reach large numbers of those with unmet mental health needs, including PTSD-related concerns.

"Scaling-out" evidence-based interventions to new populations or new health care delivery systems

BACKGROUND

Implementing treatments and interventions with demonstrated effectiveness is critical for improving patient health outcomes at a reduced cost. When an evidence-based intervention (EBI) is implemented with fidelity in a setting that is very similar to the setting wherein it was previously found to be effective, it is reasonable to anticipate similar benefits of that EBI. However, one goal of implementation science is to expand the use of EBIs as broadly as is feasible and appropriate in order to foster the greatest public health impact. When implementing an EBI in a novel setting, or targeting novel populations, one must consider whether there is sufficient justification that the EBI would have similar benefits to those found in earlier trials.

DISCUSSION

In this paper, we introduce a new concept for implementation called "scaling-out" when EBIs are adapted either to new populations or new delivery systems, or both. Using existing external validity theories and multilevel mediation modeling, we provide a logical framework for determining what new empirical evidence is required for an intervention to retain its evidence-based standard in this new context. The motivating questions are whether scale-out can reasonably be expected to produce population-level effectiveness as found in previous studies, and what additional empirical evaluations would be necessary to test for this short of an entirely new effectiveness trial. We present evaluation options for assessing whether scaling-out results in the ultimate health outcome of interest.

CONCLUSION

In scaling to health or service delivery systems or population/community contexts that are different from the setting where the EBI was originally tested, there are situations where a shorter timeframe of translation is possible. We argue that implementation of an EBI in a moderately different setting or with a different population can sometimes "borrow strength" from evidence of impact in a prior effectiveness trial. The collection of additional empirical data is deemed necessary by the nature and degree of adaptations to the EBI and the context. Our argument in this paper is conceptual, and we propose formal empirical tests of mediational equivalence in a follow-up paper.

The Role of Context in the Implementation of Trauma-Focused Treatments: Effectiveness Research and Implementation in Higher and Lower Income Settings

In recent years, the implementation of trauma-focused treatments has expanded across settings that vary widely in the availability of resources, infrastructure, and personnel. The present review aims to inform researchers, policy makers, trainers, and administrators about this diverse range of research. Taking a global health perspective, this review of effectiveness trials and implementation studies compares strategies used in high-income countries to those in low- and medium-income countries. A primary difference between studies in high-income and low- and medium-income countries is the relative emphasis placed on fidelity or adaptation. Adaptations used in low- and medium-income countries might offer useful ideas for increasing the portability, impact, and accessibility of evidence-based interventions in high-income countries.

Honoring the Past and Looking to the Future: Updates on Seminal Behavior Therapy Publications on Current Therapies and Future Directions

This is the introduction to the second of two special issues in honor of the 50^th anniversary of the Association for Behavioral and Cognitive Therapies. The goal of this issue is to pay tribute to prior seminal Behavior Therapy publications on current therapies and future directions, to provide an updated review of important topics covered by these papers, and to make recommendations for the future. Each invited paper in this issue highlights a particular Behavior Therapy publication's contribution to our understanding and also provides an updated review or meta-analysis on the topic of the original paper. The topics covered here include review papers on current therapies such as cognitive and behavioral therapies, youth and family psychotherapy, unified protocols, and third-wave therapies. In addition, we include a review paper on implementation science, and meta-analyses on individualized psychotherapy, and culturally adapted interventions. With the two 50^th anniversary issues of Behavior Therapy, we hope to inspire additional research and discussion.