Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change

Therapeutic techniques and session impact: A practice-research network study in private practice

Objective: This study investigated the relationship between therapeutic techniques and session impact, by examining the replicability of findings observed in a university-based training clinic (Boswell et al., 2010) in another practice-oriented setting: private practice.

Method: N = 8 therapists completed session-level assessments of their technique use for N = 38 clients. The same client sample completed session-level assessments of session outcome. Technique-outcome associations were examined with multilevel models.

Results: As in Boswell et al., common factors were associated with positive session impact. For clients who received higher average common factor techniques (relative to their own therapist's caseload), session impact was the poorest in sessions with higher behavioral change techniques use (relative to the client's own average). Moreover, clients with the lowest average common factor techniques (relative to their therapist's caseload) reported better session impact in sessions that involved a higher degree of session-level behavioral change techniques (relative to their own average).

Conclusion: In line with Boswell et al., therapists should be mindful of the consistency of their routine technique use between- and within-clients, and this can be aided through collection of their own practice-oriented data.

Strategies for Implementing GlobalConsent to Prevent Sexual Violence in University Men (SCALE): study protocol for a national implementation trial

BACKGROUND

Globally, women 15-24 years are at heightened risk of sexual violence victimization, a risk factor for adverse mental, physical, and behavioral health outcomes. Sexual violence is common at universities and most often perpetrated by men, yet few evidence-based prevention strategies targeting men have been tested in low- and middle-income countries. GlobalConsent is a six-module, web-based educational program adapted from an efficacious U.S.-based program. Nine months post-treatment in a randomized trial in Vietnam, GlobalConsent reduced men's sexually violent behavior (odds ratio [OR] = 0.71, 95%CI 0.50-1.00) and increased prosocial intervening behavior (OR = 1.51, 1.00-2.28) relative to an attention-control. Evidence regarding optimal implementation strategies for scale up is needed.

METHODS

We will randomize six medical universities in North, Central, and South Vietnam to deliver GlobalConsent using two different packages of implementation strategies that vary in intensity. Higher-intensity strategies will include greater (1) pre- and post-implementation engagement with university leaders and faculty and (2) greater pre-implementation outreach, follow-up, and incentives for students to promote engagement and completion of GlobalConsent. Higher intensity universities will receive additional training and support for their added activities. We will compare implementation drivers and outcomes, intervention effectiveness, and cost-effectiveness across the two implementation bundles. Our mixed-methods comparative interrupted time series design includes (1) qualitative interviews and quantitative surveys with university leaders and implementation teams to assess implementation barriers and facilitators; (2) repeated surveys with leaders and faculty, implementation teams, and male students to assess multilevel implementation drivers and outcomes; (3) repeated surveys with male students to assess behavioral outcomes (sexual violence and intervening behavior) and mediating variables (knowledge, attitudes, affect, and capacities); and (4) time diaries and cost tracking to assess cost-effectiveness of the two implementation-strategies bundles.

DISCUSSION

This project is the first to assess packages of implementation strategies to deliver an efficacious web-based sexual violence prevention program for undergraduate men across all regions of Vietnam and synergizes with a violence-prevention training initiative (D43TW012188). This approach will produce rigorous evidence about how to disseminate GlobalConsent nationally, which holds promise to reduce gender-based health inequities linked to sexual violence as GlobalConsent is brought to scale.

TRIAL REGISTRATION

NCT06443541. Retrospectively registered with ClinicalTrials.gov. Registered on June 05, 2024.

Adaptations and early adoption of a family caregiver intervention in the Veterans Affairs Health Care System: A multimethod pragmatic approach for national scaling

OBJECTIVE

To examine the relationship between site-level adaptation and early adoption of Caregivers Finding Important Resources, Support, and Training (FIRST) training during national implementation across diverse Veteran Health Administration (VA) medical centers.

DATA SOURCES AND STUDY SETTING

We enrolled and evaluated 25 VA medical centers (VAMCs). Along with administrative data on site characteristics, we examined site-reported data on adaptations and intervention adoption, defined as ≥4 training classes delivered to ≥5 caregivers at 6 months from April through October 2022.

STUDY DESIGN

A type III hybrid implementation-effectiveness cluster randomized controlled trial, randomized VAMCs 1:1 to receive foundational (low-touch) implementation support (n = 12) or the addition of enhanced (high-touch) implementation support (n = 13).

DATA COLLECTION/EXTRACTION METHODS

At key implementation phases, VAMCs were asked to report adaptations including content, contextual modifications (format, setting, personnel, and population), and training of providers. We describe site-level adaptations by arm and by organizational characteristics that included VAMC complexity level, staffing, rurality, and organizational readiness to change. We used qualitative comparative analysis to identify unique adaptations that contributed to intervention adoption at 6 months.

PRINCIPAL FINDINGS

VAMCs randomized to receive enhanced support reported slightly more adaptations than those randomized to foundational support. At 6 months, VAMCs with two or more adaptations adopted Caregivers FIRST at a higher rate than those with fewer adaptations (90% vs. 44%). Staffing adaptations (e.g., who delivered the intervention), format and content (e.g., modified delivery pace), and referring provider training were unique adaptations to adopting sites.

CONCLUSIONS

Site-level adaptations were diverse and occurred more frequently in sites with early adoption of Caregivers FIRST. Future research should identify best practices of supporting and monitoring intervention adaptation. Understanding the role of adaptation in early adoption success could assist other healthcare systems in implementing interventions for caregivers.

Cost-effectiveness of train-the-trainer versus expert consultation training models for implementing interpersonal psychotherapy in college mental health settings: evidence from a national cluster randomized trial

BACKGROUND

This study is a cost-effectiveness study of two implementation strategies designed to train therapists in college and university counseling centers to deliver interpersonal psychotherapy. Costs of implementing a train-the-trainer (TTT) strategy versus an expert consultation strategy were estimated, and their relative effects upon therapist outcomes were calculated and compared.

METHODS

Twenty four counseling centers were recruited across the United States. These centers were randomized to either a TTT (experimental) condition, in which an in-house therapist trained other center therapists, or an expert consultation condition, in which center therapists participated in a workshop and received 12 months of ongoing supervision. The main outcome was therapist fidelity (adherence and competence) to interpersonal psychotherapy, assessed via audio recordings of therapy sessions, and analyzed using linear mixed models. Costs of each condition were quantified using time-driven activity-based costing methods, and involved a costing survey administered to center directors, follow up interviews and validation checks, and comparison of time tracking logs of trainers in the expert condition. Mean costs to produce one therapist were obtained for each condition. The costs to produce equivalent improvements in therapist-level outcomes were then compared between the two conditions.

RESULTS

Mean cost incurred by counseling centers to train one therapist using the TTT strategy was $3,407 (median = $3,077); mean cost to produce one trained therapist in the control condition was $2,055 (median = $1,932). Therapists in the TTT condition, on average, demonstrated a 0.043 higher adherence score compared to therapists in the control condition; however, this difference was not statistically significant. For the competence outcome, effect size for therapists in the TTT condition was in the large range (1.16; 95% CI: 0.85-1.46; p < .001), and therapists in this condition, on average, demonstrated a 0.073 higher competence score compared to those in the expert consultation condition (95% CI, 0.008-0.14; p = .03). Counseling centers that used the TTT model incurred $353 less in training costs to produce equivalent improvements in therapist competence.

CONCLUSIONS

Despite its higher short run costs, the TTT implementation strategy produces greater increases in therapist competence when compared to expert consultation. Expanding resources to support this platform for service delivery can be an effective way to enhance the mental health care of young people seeking care in college and university counseling centers.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02079142.

Provider Adherence to Modular Cognitive Behavioral Therapy for Children and Adolescents

This study explored predictors of community-based providers' adherence to MATCH, a modular cognitive behavioral therapy for children and adolescents. Provider-reported adherence to MATCH was measured using three increasingly strict criteria: (1) session content (whether the session covered MATCH content consistent with the client's target problem), (2) session content and sequencing (whether the session covered MATCH content in the expected sequence for the client's target problem), and (3) session content, sequencing, and participant (whether the session covered MATCH content in the expected sequence and with the expected participant(s) for the client's target problem). Session, client, provider, and organizational predictors of adherence to MATCH were assessed using multilevel modeling. Results revealed that nearly all providers delivered MATCH content that corresponded to the target problem, but only one-third of providers delivered MATCH content in the expected sequence and with the expected participant for the client's target problem. This difference underscores the need for nuanced adherence measurement to capture important implementation information that broad operationalizations of adherence miss. Regardless of the criteria used providers were most adherent to MATCH during sessions when clients presented with interfering comorbid mental health symptoms. This suggests that the design of MATCH, which offers flexibility and structured guidance to address comorbid mental health problems, may allow providers to personalize treatment to address interfering comorbidity symptoms while remaining adherent to evidence-based practices. Additional guidance for providers on managing other types of session interference (e.g., unexpected events) may improve treatment integrity in community settings.

The assessment of therapist responsiveness in psychotherapy research: a systematic review

Therapist responsiveness is an emerging construct in psychotherapy research that still lacks a clear definition and, consequently, a unique operationalization. Indeed, there is a great overlap between therapist responsiveness and other variables, such as attunement, flexibility, and empathy. This overlap inevitably hinders the assessment of the therapist's responsiveness, although it is crucial for the effectiveness of the treatments. Therefore, the current systematic review aims at exploring the different methodologies of measurement and analysis of therapist responsiveness, including both direct and indirect instruments. The results confirmed difficulties and divergences in the operationalization of the construct, as shown by the great heterogeneity found in the choice and use of the tools. Furthermore, this review provides guidance for future research, clinical practice, and training of therapists.

Implementation Science and Practice-Oriented Research: Convergence and Complementarity

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

The Content of Usual Clinical Care for Youth with Primary Anxiety Problems

The current study was designed to describe usual clinical care for youth with primary anxiety problems in community mental health centers. The observer-rated Therapy Process Observational Coding System for Child Psychotherapy - Revised Strategies scale (TPOCS-RS), designed to assess therapeutic techniques from five theory-based domains, was used to code sessions (N = 403) from the usual clinical care group of two randomized effectiveness trials: (a) Youth Anxiety Study (YAS) with 21 youth (M age = 10.44 years, SD = 1.91; 49.2% Latinx; 46.6%, 53.4% male) and 16 clinicians (77.5% female; 43.8% White), and (b) Child STEPS Multisite Trial with 17 youth (M age = 10.00 years, SD = 1.87; 58.8% male; 41.2% White) and 13 clinicians (M age = 40.00 years; SD = 9.18; 76.9% female; 61.5% White). The average number of TPOCS-RS items observed per treatment session was more than 10, and multiple techniques were used together in each session. All TPOCS-RS items were observed at least once throughout a clinical case, and most items reoccurred (i.e., observed in two or more sessions). The dosage of TPOCS-RS in all items was below 5 on a 7-point scale. In conclusion, clinicians in both usual care samples used a wide range of techniques from several theory-based domains at a low to medium dose. However, the type and dosage of the techniques used did vary across the two samples.

The relationship between treatment integrity and outcome in group psychotherapy: A systematic review

Treatment integrity is defined as the extent to which the treatment has been implemented according to a specific theoretical model. It consists of two components: adherence, that is, the degree to which the therapist implements the techniques prescribed by the theoretical model, and competence, that is, the degree to which the therapist skilfully and appropriately implements the techniques prescribed by the model. Recently, the issue of integrity is gaining increasing importance in psychotherapy research, especially in an attempt to clarify its role in influencing the effectiveness of treatments. However, most studies focus on the individual setting. Therefore, this systematic review aims at investigating the relationship between integrity and outcome in group clinical treatments. Results highlighted a positive relationship between group treatment integrity and outcome. Moreover, this review provided insights for implications for research, clinical practice, and training of therapists, identifying questions that still need to be answered and tracing possible future research directions.

The role of therapy delivery and clinic organizational factors in explaining therapist effects for trauma-focused psychotherapies in the Veterans Health Administration

OBJECTIVE

This study estimated the size of therapist effects (TEs) for dropout and clinical effectiveness of two trauma-focused psychotherapies (TFPs) and evaluated whether therapy delivery and clinic organizational factors explained observed TEs.

METHOD

Participants were 180 therapists (54.4% psychologists, 42.2% social workers) from 137 Veterans Health Administration facilities and 1,735 patients (24.7% women; 27.2% people of color) who completed at least two TFP sessions. Outcomes were dropout (< 8 TFP sessions) and for a subsample (n = 1,273), clinically meaningful improvement and recovery based on posttraumatic stress disorder checklist for DSM-5 (PCL-5) scores. Therapist-level predictors were ascertained through survey, manual chart review, and administrative data. Multilevel models estimated TEs.

RESULTS

Over half (51.2%) of patients dropped out and those who dropped out were less likely to meet criteria for clinically meaningful improvement or recovery (ps < .001). Adjusting for case-mix and TFP type, therapists accounted for 5.812% (p < .001) of the unexplained variance in dropout. The average dropout rate for the 45 therapists in the top performing quartile was 27.0%, while the average dropout rate for the 45 therapists in the bottom performing quartile was 78.8%. Variation between therapists was reduced to 2.031% (p = .140) when therapists' mean of days between sessions, adherence, implementation climate, and caseload were added to multilevel models. TEs were nonsignificant for clinically meaningful improvement and recovery.

CONCLUSIONS

Interventions targeting therapy delivery and clinic organization have the potential to reduce variation between therapists in TFP dropout, so that more patients stay engaged long enough to experience clinical benefit. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Feasibility of a community-adapted multi-domain intervention for dementia prevention among older adults: a research protocol

BACKGROUND

Multi-domain interventions effectively prevent dementia in clinical settings; however, their efficacy within local communities is unclear. This study assesses the feasibility of an adapted multi-domain intervention for dementia prevention in community-dwelling older adults.

METHODS

The single-arm trial enrolls 60 participants from two Obu City communities, Japan.

PRIMARY OUTCOME

participant retention in the adapted multi-domain intervention; secondary outcomes: health and implementation outcomes. Over 12 months, a team of researchers and public health nurse oversees the study in the first half, gradually shifting the management to public health nurses in the second half. Using the Framework for Reporting Adaptations and Modifications-Enhanced, the clinical programme is adjusted for the local community. It includes a 60-minute exercise and 30-minute group sessions, targeting lifestyle, diet, and social participation.

DISCUSSION

This pioneer study evaluates the feasibility of an adapted intervention programme for dementia prevention in a community setting. Challenges in disseminating dementia prevention programmes warrant further investigation into effective implementation as well as strategies and methods to appeal to the target population. Upon confirming this programme's feasibility, future studies can further evaluate its broader effectiveness.

TRIAL REGISTRATION

The protocol is registered with the Clinical Trials Registry (UMIN-CTR) of the University Hospital's Medical Information Network, under registration number UMIN000050581.

Is adherence to dialectic behaviour therapy for post-traumatic stress disorder (PTSD) and cognitive processing therapy related to treatment outcome in PTSD after childhood abuse?

Background: Literature on the association between therapist adherence and treatment success in the treatment of post-traumatic stress disorder (PTSD) is scarce, and the results are mixed.Objective: To examine the relationship between therapist adherence to dialectical behaviour therapy for PTSD (DBT-PTSD) and cognitive processing therapy (CPT) on treatment outcome in women with PTSD and emotion regulation difficulties after interpersonal childhood abuse.Method: Videotaped therapy sessions from 160 female participants of a large randomized controlled trial [Bohus, M., Kleindienst, N., Hahn, C., Müller-Engelmann, M., Ludäscher, P., Steil, R., Fydrich, T., Kuehner, C., Resick, P. A., Stiglmayr, C., Schmahl, C., & Priebe, K. (2020). Dialectical behavior therapy for posttraumatic stress disorder (DBT-PTSD) compared with cognitive processing therapy (CPT) in complex presentations of PTSD in women survivors of childhood abuse. JAMA Psychiatry, 77(12), 1235. jamapsychiatry.2020.2148] were rated. Adherence to CPT and DBT-PTSD was assessed using two specifically developed rating scales.Results: Higher therapist adherence was associated with a greater reduction of clinician-rated PTSD symptom severity. This effect was more pronounced in the CPT group than in the DBT-PTSD group. Adherence was also related to a greater reduction of self-rated PTSD symptoms, borderline symptoms, and dissociation intensity.Conclusion: Our results indicate that higher therapist adherence can lead to better treatment outcomes in PTSD treatments, especially in CPT.

Using the multiphase optimization strategy to adapt cognitive processing therapy (CPT MOST): study protocol for a randomized controlled factorial experiment

BACKGROUND

Approximately ten percent of US military veterans suffer from posttraumatic stress disorder (PTSD). Cognitive processing therapy (CPT) is a highly effective, evidence-based, first-line treatment for PTSD that has been widely adopted by the Department of Veterans Affairs (VA). CPT consists of discrete therapeutic components delivered across 12 sessions, but most veterans (up to 70%) never reach completion, and those who discontinue therapy receive only four sessions on average. Unfortunately, veterans who drop out prematurely may never receive the most effective components of CPT. Thus, there is an urgent need to use empirical approaches to identify the most effective components of CPT so CPT can be adapted into a briefer format.

METHODS

The multiphase optimization strategy (MOST) is an innovative, engineering-inspired framework that uses an optimization trial to assess the performance of individual intervention components within a multicomponent intervention such as CPT. Here we use a fractional factorial optimization trial to identify and retain the most effective intervention components to form a refined, abbreviated CPT intervention package. Specifically, we used a 16-condition fractional factorial experiment with 270 veterans (N = 270) at three VA Medical Centers to test the effectiveness of each of the five CPT components and each two-way interaction between components. This factorial design will identify which CPT components contribute meaningfully to a reduction in PTSD symptoms, as measured by PTSD symptom reduction on the Clinician-Administered PTSD Scale for DSM-5, across 6 months of follow-up. It will also identify mediators and moderators of component effectiveness.

DISCUSSION

There is an urgent need to adapt CPT into a briefer format using empirical approaches to identify its most effective components. A brief format of CPT may reduce attrition and improve efficiency, enabling providers to treat more patients with PTSD. The refined intervention package will be evaluated in a future large-scale, fully-powered effectiveness trial. Pending demonstration of effectiveness, the refined intervention can be disseminated through the VA CPT training program.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05220137. Registration date: January 21, 2022.

Supporting Emotionally Exhausted Community Mental Health Therapists in Appropriately Adapting EBPs for Children and Adolescents

Evidence-based practices (EBPs) are often adapted during community implementation to improve EBP fit for clients and the service context. Augmenting EBPs with additional dosing and content may improve fit. However, reducing EBP content can reduce EBP effectiveness. Using multilevel regression models, this study examined whether supportive program climate and program-furnished EBP-specific implementation strategies (e.g., materials, ongoing training, in-house experts) are associated with augmenting and reducing adaptations, and whether therapist emotional exhaustion moderated these associations. Data were collected from surveys completed by 439 therapists from 102 programs 9 years after a system-driven EBP implementation initiative. Supportive program climate was associated with more augmenting adaptations. Emotional exhaustion was a significant moderator. When organizations used more EBP-specific implementation strategies, more emotionally exhausted therapists reduced EBPs less and less emotionally exhausted therapists augmented EBPs more. Findings provide guidance on how organizations can support appropriate EBP adaptations in spite of therapist emotional exhaustion.

Does treatment specific-, disorder specific- or general therapeutic competence predict symptom reduction in posttraumatic stress disorder?

Background: Literature on the association between therapist competence and treatment success in posttraumatic stress disorder (PTSD) treatments is scarce and results are mixed.Aims/Objective: The relationship between different types of therapeutic competence, therapeutic alliance, and PTSD symptom reduction in patients treated with Dialectical Behaviour Therapy for PTSD (DBT-PTSD) or Cognitive Processing Therapy (CPT) was assessed. Competence types were PTSD-specific competence, treatment specific competence, and general competence in cognitive behaviour therapy (CBT).Method: Videotaped therapy sessions from N = 160 women with PTSD and emotion regulation difficulties after child abuse participating in a large randomised controlled trial (Bohus et al., 2020) were rated. Three therapeutic competence-types were assessed using specifically developed rating scales. Alliance was assessed via patient ratings with the Helping Alliance Questionnaire (HAQ). PTSD symptoms were assessed at pre- and post-treatment via clinician rating with the Clinician-Administered PTSD Scale for DSM-5 (CAPS-5) and via self-rating with the PTSD-Checklist for DSM-5 (PCL-5).Results: No significant association between competence and clinician or self-rated PTSD symptoms was found. PTSD specific competence predicted clinician rated PTSD symptom severity on a trend level. Alliance predicted both clinician and self-rated PTSD symptom reduction.Conclusion: Our results provide a starting point for future research on different competence types and their association with PTSD treatment gains. Therapists were highly trained and received weekly supervision, hence a restricted competence range is a possible explanation for non-existing associations between competence and PTSD symptom reduction in our sample. More research in naturalistic settings, such as dissemination studies, is needed.

Adapting family-based treatment for adolescent anorexia nervosa delivered in the home: A novel approach for improving access to care and generalizability of skill acquisition

BACKGROUND

Anorexia nervosa (AN) is a serious mental illness associated with high rates of morbidity and mortality. Family-based treatment (FBT) is a well-established treatment for adolescent AN, yet it is underutilized in community settings and is unavailable to many families, particularly those from lower income and racial and ethnic minority backgrounds. Furthermore, some families do not respond optimally to FBT, possibly because of challenges translating skills acquired in office-based treatment settings to naturalistic settings. Home-based treatment could reduce barriers to access and enhance generalization of newly learned treatment skills. Home-based models demonstrate initial feasibility, acceptability, and efficacy for adolescent AN, however, FBT principles have yet to be applied as a stand-alone intervention in a home-based level of care. This paper describes the rationale for and process of adapting FBT principles/interventions to improve fit within a home-based model delivered in the context of community mental health, and discusses potential strengths and opportunities associated with this approach.

RESULTS

Adaptations were made through consultation with collaborating community agencies and were guided by the complex interventions framework. The primary modifications included: (1) altered dose; (2) multiple family meals; (3) additional support for meal preparation and supervision; (4) clinician attendance at medical appointments; (5) cultural adaptation; and (6) introduction of distress tolerance and emotion regulation skills.

CONCLUSIONS

Implementing FBT in the home may present one promising and novel approach to enhance engagement and treatment outcomes for adolescents with restrictive eating disorders, particularly those who are underserved, but evaluation of efficacy/effectiveness is needed.

Effect of therapeutic competence, adherence, and alliance on treatment outcome in youth with PTSD treated with developmentally adapted cognitive processing therapy

BACKGROUND

Developmentally adapted cognitive processing therapy (D-CPT) is an effective treatment for posttraumatic stress disorder (PTSD) in adolescents and young adults. It is unclear if therapeutic adherence and competence in D-CPT are associated with higher PTSD treatment gains.

OBJECTIVE

To assess if higher therapeutic adherence and competence in D-CPT are associated with higher symptom reduction of PTSD in adolescents and young adults, while controlling for therapeutic alliance.

PARTICIPANTS AND SETTING

Participants were 38 patients (aged 14-21 years; M = 17.61 years, SD = 2.42 years) of a multicenter randomized controlled trial in which the efficacy of D-CPT was compared to a waitlist with treatment advice.

METHODS

Videotaped therapy sessions were rated using validated ratings scales to assess adherence and competence. Therapeutic alliance was assessed via weekly patient ratings. We used hierarchical linear modelling to assess the relationship of adherence and competence on PTSD symptoms being measured by both clinician and patient while controlling for alliance.

RESULTS

Neither adherence nor competence were related to treatment outcomes in clinician or patient rated PTSD symptom severity. Higher alliance was associated with a lower symptom severity at 12 months posttreatment in both clinician and patient rated PTSD symptoms.

CONCLUSIONS

In this study of young adults with PTSD, who were treated with D-CPT by well-trained therapists, therapeutic adherence and competence were not related to treatment outcome. This might be explained by a lack of range in therapist adherence and competence. Therapeutic alliance had a positive effect on PTSD symptom severity.

Assessing the Fidelity of an Affirmative Cognitive Behavioral Group Intervention

PURPOSE

Support implementation fidelity in intervention research with lesbian, gay, bisexual, transgender, queer, and sexual and gender diverse (LGBTQ+) populations, this study explores the systematic development of a fidelity process for AFFIRM, an evidence-based, affirmative cognitive behavioral therapy group intervention for LGBTQ+ youth and adults.

METHOD

As part of a clinical trial, the AFFIRM fidelity checklist was designed to assess clinician adherence. A total of 151 audio-recorded group sessions were coded by four trained raters.

RESULTS

Adherence was high with a mean fidelity score of 84.13 (SD = 12.50). Inter-rater reliability was 81%, suggesting substantial agreement. Qualitative thematic analysis of low-rated sessions identified deviations from the manual and difficulties in group facilitation, while high-rated sessions specified affirmative and effective clinical responses.

DISCUSSION

Findings were integrated into clinical training and coaching. The fidelity process provides insights into the challenges of implementing social work interventions effectively with LGBTQ+ populations in community settings.

Exploring the Association between Individual-Level Attributes and Fidelity to a Vocational Rehabilitation Intervention within a Randomised Controlled Trial

Understanding what attributes or characteristics of those delivering interventions affect intervention fidelity and patient outcomes is important for contextualising intervention effectiveness. It may also inform implementation of interventions in future research and clinical practice. This study aimed to explore the relationships between attributes of Occupational Therapists (OTs), their faithful delivery of an early stroke specialist vocational rehabilitation intervention (ESSVR), and stroke survivor return-to-work (RTW) outcomes. Thirty-nine OTs were surveyed about their experience and knowledge of stroke and vocational rehabilitation and were trained to deliver ESSVR. ESSVR was delivered across 16 sites in England and Wales between February 2018 and November 2021. OTs received monthly mentoring to support ESSVR delivery. The amount of mentoring each OT received was recorded in OT mentoring records. Fidelity was assessed using an intervention component checklist completed using retrospective case review of one randomly selected participant per OT. Linear and logistic regression analyses explored relationships between OT attributes, fidelity, and stroke survivor RTW outcome. Fidelity scores ranged from 30.8 to 100% (Mean: 78.8%, SD: 19.2%). Only OT engagement in mentoring was significantly associated with fidelity (b = 0.29, 95% CI = 0.05-0.53, p < 0.05). Increased fidelity (OR = 1.06, 95% CI = 1.01-1.1, p = 0.01) and increasing years of stroke rehabilitation experience (OR = 1.17, 95% CI = 1.02-1.35) was significantly associated with positive stroke survivor RTW outcomes. Findings of this study suggest that mentoring OTs may increase fidelity of delivery of ESSVR, which may also be associated with positive stroke survivor return-to-work outcomes. The results also suggest that OTs with more experience of stroke rehabilitation may be able to support stroke survivors to RTW more effectively. Upskilling OTs to deliver complex interventions, such as ESSVR, in clinical trials may require mentoring support in addition to training to ensure fidelity.

Study Protocol: Multi-level Determinants of Implementation and Sustainment in the Education Sector

Evidence-based programs (EBPs) delivered in elementary schools show great promise in reducing risk for emotional and behavioral disorders (EBDs). However, efforts to sustain EBPs in school face barriers. Improving EBP sustainment thus represents a priority, but little research exists to inform the development of sustainment strategies. To address this gap, the Sustaining Evidenced-Based Innovations through Multi-level Implementation Constructs (SEISMIC) project will: (a) Determine if malleable individual, intervention, and organizational factors predict EBP treatment fidelity and modifications during implementation, sustainment, or both; (b) Assess the impact of EBP fidelity and modifications on child outcomes during implementation and sustainment; and (c) Explore the mechanisms through which individual, intervention, and organizational factors influence sustainment outcomes. This protocol paper describes SEISMIC, which builds upon a federally-funded RCT evaluating BEST in CLASS, a teacher-delivered program for K-3rd grade children at risk for EBDs. The sample will include 96 teachers, 384 children, and 12 elementary schools. A multi-level, interrupted time series design will be used to examine the relationship between baseline factors, treatment fidelity, modifications, and child outcomes, followed by a mixed-method approach to elucidate the mechanisms that influence sustainment outcomes. Findings will be used to create a strategy to improve EBP sustainment in schools.

Mechanisms of change for a family intervention in Kenya: An Integrated Clinical and Implementation Mapping approach

To increase cultural relevance and maximize access for historically underserved populations, there is a need to explore mechanisms underlying treatment outcomes during piloting. We developed a mixed-method approach, Integrated Clinical and Implementation Mapping (ICIM), to explore clinical and implementation mechanisms to inform improvements in content and delivery. We applied ICIM in a pilot of Tuko Pamoja, a lay counselor-delivered family intervention in Kenya (10 families with adolescents ages 12-17). ICIM is a 3-phase process to triangulate data sources to analyze how and why change occurs within individual cases and across cases. We synthesized data from session and supervision transcripts, fidelity and clinical skills ratings, surveys, and interviews. Outputs included a comprehensive narrative and visual map depicting how content and implementation factors influenced change. For Tuko Pamoja, ICIM results showed common presenting problems, including financial strain and caregivers' distress, triggering negative interactions and adolescent distress. ICIM demonstrated that active treatment ingredients included communication skills and facilitated, prescribed time together. Families improved communication, empathy, and hope, facilitated improved family functioning and mental health. Key implementation mechanisms included provider clinical competencies, alliance-building, treatment-aligned adaptations, and consistent attendance. Results guided manual and training refinements and generated hypotheses about mechanisms to test in larger trials.

Assessment of modifications to evidence-based psychotherapies using administrative and chart note data from the US department of veterans affairs health care system

Background

The US Department of Veterans Affairs (VA) has over 15 years of experience in delivery of evidence-based psychotherapies (EBPs). This paper describes strategies for using clinical documentation and administrative data to understand adherence and modifications to EBPs for Posttraumatic Stress Disorder (PTSD).

Methods

This study focused on two EBPs for PTSD, Cognitive Processing Therapy (CPT) and Prolonged Exposure (PE). The sample included VA therapists from across the US who provided CPT and PE and the patients they treated over a 1-year period. The data sources for this study were templated EBP chart notes and VA administrative data. We used a manual review of note content and administrative data rules to code therapy adherence and modifications in 7,297 EBP sessions for 1,257 patients seen by 182 therapists. Two trained coders rated each therapy note and resolved discrepancies through consensus. To contextualize and explain variation in adherence and modifications, we conducted brief 30-45-min semi-structured interviews with a purposive subsample of these therapists (n = 32).

Findings

Combining manual chart review and administrative data allowed for identification of 11 types of modifications. Raters disagreed on adherence for 30% of notes. The disagreement stemmed from the presence of therapy modifications that were not clearly documented, necessitating the development of decision rules and strategies for modification coding. Both therapists and patients contributed to the variance in the extent to which different modifications occurred. Therapist interviews demonstrated therapist awareness of modifying the protocols in the ways identified through chart review.

Conclusion

Healthcare systems can use data collected as part of routine care to understand how and when EBPs are modified but need to develop scalable strategies to document adaptations and modifications to EBPs in routine care.

Testing a Theory of Implementation Leadership and Climate Across Autism Evidence-Based Interventions of Varying Complexity

Prominent theories within the field of implementation science contend that organizational leaders can improve providers' fidelity to evidence-based practices (EBPs) by using focused implementation leadership behaviors that create an organizational climate for EBP implementation. However, this work has been criticized for overreliance on nonspecific, self-report fidelity measures and poor articulation of the boundary conditions that may attenuate leadership and climate's influence. This study tests the predictions of EBP implementation leadership and climate theory on observed fidelity to three school-based EBPs for autism that vary in complexity: pivotal response training (PRT), discrete trial training (DTT), and visual schedules (VS). Educators in kindergarten to third-grade autism support classrooms in 65 schools assessed their principals' EBP implementation leadership and school EBP implementation climate prior to the school year. Mid-school year, trained observers rated educator fidelity to all three interventions. Expert raters confirmed PRT was significantly more complex than DTT or VS using the Intervention Complexity Assessment Tool for Systematic Reviews. Linear regression analyses at the school level indicated principals' increased frequency of EBP implementation leadership predicted a higher school EBP implementation climate, which in turn predicted higher educator fidelity to PRT-however, there was no evidence of a relationship between implementation climate and fidelity to DTT or VS. Comparing principals whose EBP implementation leadership was ±1 SD from the mean, there was a significant indirect association of EBP implementation leadership with PRT fidelity through EBP implementation climate (d = 0.49, 95% CI [0.04, 0.93]). Strategies that target EBP implementation leadership and climate may support fidelity to complex behavioral interventions.

Cognitive Processing Therapy Versus Medication for the Treatment of Comorbid Substance Use Disorder and Post-Traumatic Stress Disorder in Egyptian patients (Randomized Clinical Trial)

"Earlier research has established that posttraumatic stress disorder (PTSD) and substance use disorder (SUD) frequently coexist. Aims: Cognitive Processing Therapy was compared to Sertraline and a placebo in an RCT for treating patients with comorbid SUD and PTSD. Methods: 150 patients with SUD and PTSD were interviewed by clinicians and asked to fill out the Clinician-Administered PTSD Scale (CAPS-5), Posttraumatic Stress Disorder Checklist (PCL-5), Beck Depression Inventory (BDI-II), Timeline Follow Back Interview (TLFB), and Brief Addiction Monitor (BAM). Patients were randomly assigned to the following conditions: CPT (n=50), Sertraline (n=50), or Placebo (n=50). Pretreatment, posttreatment, six and, twelve-month follow-up assessments were conducted. Results: When compared to the sertraline group, CPT resulted in much higher reductions in CAPS scores at posttreatment assessment (d=0.93, p < .000). When compared to the control group, CPT considerably reduced PTSD symptoms (the effect size, d=1.9, p < .000). Sertraline resulted in many significant decreases in CAPS when compared to control groups (the effect size , d=1.11, p<.000). At posttreatment, SUD and depression severity were significantly reduced in both CPT and Sertraline groups. After six and twelve months of follow-up, these differences persisted. Conclusion: Comparatively to the control group, CPT and Sertraline significantly decreased PTSD, SUD, and depression."

Competence in Delivering Cognitive Processing Therapy and the Therapeutic Alliance Both Predict PTSD Symptom Outcomes

Cognitive Processing Therapy (CPT) is efficacious in treating PTSD, but there remains a need to improve outcomes for individuals who do not fully respond to treatment. Differences between patient-therapist dyads in the fidelity (i.e., adherence and competence) of CPT delivery and the quality of the therapeutic relationship may partly explain differential levels of symptom improvement. Sessions were sampled from a randomized trial comparing different consultation conditions in training therapists new to CPT. Among 69 patients, one session from Sessions 1-3 and one session from Sessions 4-7 were reliably rated for adherence and competence using the CPT Therapist Adherence and Competence Scale, and for therapeutic alliance using the Working Alliance Inventory-Observer scale. Mixed models, including detrending using a fixed effect of session, predicted self-reported Posttraumatic Stress Disorder Checklist (PCL-IV) scores in one session using process scores from the previous session. The statistical interaction between fidelity and alliance scores to predict outcome was also examined. Alliance had significant, positive correlations (rs = 0.18-0.21) with same-session adherence and competence. Higher competence scores and higher therapeutic alliance scores in one session were independently associated with lower PCL-IV scores in the subsequent session. Adherence scores, which tended to be very high with relatively less variability, did not significantly relate to subsequent-session PCL-IV scores. Competence significantly interacted with alliance, such that sessions high in both competence and alliance predicted especially lower subsequent-session PCL-IV scores. A strong therapeutic alliance may have a synergistic, salutary effect with the competent delivery of CPT.

Implementing Evidence-Based Mental-Health Treatments: Attending to Training, Fidelity, Adaptation, and Context

This article provides a very high-level overview of some key considerations in the field of implementation science as it relates to clinical psychology. The article reviews recent findings regarding treatment fidelity, adaptation of treatments, and clinical outcomes. It then details some recent findings on training therapists to provide evidence-based therapies as they were designed to be delivered, with sufficient skill and adaptations if needed to ensure better fit for clients who receive treatments in different treatment settings. Finally, the article considers implications for implementing and sustaining new treatments and supporting their fidelity and adaptation, as well as key directions for future research.

Phase 2 of family-based treatment: an exploratory assessment of clinician practices

PURPOSE

In manualized family-based treatment (FBT) for eating disorders, phase 1 of the 3-phase treatment-during which parents are put in control of eating-related issues-is perhaps the most critical phase, and is comprehensively addressed in the manual. Phase 2, during which control over eating is gradually returned to the patient, is more variable and the manual dedicates less space to this phase. The purpose of the current exploratory study was to assess Phase 2 practices of clinicians providing FBT and to compare these practices to the guidance offered in the manual.

METHODS

In the current study, a survey assessing Phase 2 practices was sent to clinicians. Twenty-seven providers responded. Two providers reported that they did not provide FBT in an outpatient setting. One reported not currently providing outpatient FBT but had in the past. The remaining providers were currently providing FBT in an outpatient setting.

RESULTS

No items addressing the core interventions of Phase 2, including encouraging age-appropriate independent eating, were endorsed by 100% of respondents as being addressed 100% of the time in Phase 2.

CONCLUSION

Responses reflected some adherence to the manual, along with examples of therapist drift and incorporation of therapeutic interventions that are not described in the FBT manual. Adherence to manualized treatments may improve outcome for some patients, while allowing for flexibility to address clinical situations that are not addressed in the manual.

LEVEL OF EVIDENCE

V. Opinions of respected authorities, based on descriptive studies, narrative reviews, clinical experience, or reports of expert committees.

Divergent experiences of U.S. veterans who did and did not complete trauma-focused therapies for PTSD: A national qualitative study of treatment dropout

Prolonged Exposure (PE) and Cognitive Processing Therapy (CPT) are first-line treatments for posttraumatic stress disorder (PTSD) and have been disseminated throughout the U.S. Veterans Health Administration. Treatment non-completion is common and lessens clinical effectiveness; however, prior work has failed to identify factors consistently associated with non-completion. Semi-structured interviews were conducted with a national sample of veterans who recently completed (n = 60) or did not complete (n = 66) PE or CPT. Non-completer interviews focused on factors that contributed to veterans' decisions to drop out and efforts undertaken to complete PE/CPT. Completer interviews focused on challenges faced in completing treatment and facilitators of completion. Transcripts were coded using a mixed deductive/inductive approach; constant comparison was used to identify differences between completers and non-completers. Completers and non-completers differed in the extent of treatment-specific therapist support received, therapists' flexibility in treatment delivery, the type of encouragement offered by the care team and social supports, their interpretation of symptom worsening, the perceived impact of treatment on functioning, and the impact of stressors on their treatment engagement. Treatment-specific therapist support, more patient-centered and flexible treatment delivery, leveraging the full care team, and addressing functional concerns are potential targets for PE and CPT engagement interventions.

A Mixed-Methods Study of Clinician Adaptations to Parent-Child Interaction Therapy - What about Culture?

Parent-Child Interaction Therapy (PCIT) is an evidence-based practice (EBP) for young children with challenging behaviors. PCIT has been adapted to treat varying presentations and culturally diverse families. Although efforts have been made to disseminate PCIT into community settings, which often serve clinically complex, socio-culturally diverse, and marginalized communities, barriers to disseminating adapted models remain. An alternative strategy to understanding how to increase access to appropriately adapted PCIT is to learn from community clinicians' practice-based adaptations to meet their clients' diverse needs related to clinical presentation, culture, and language. This mixed-method study investigated community clinician adaptations of PCIT. Clinicians (N = 314) were recruited via PCIT listservs to complete a survey collecting background information, and adaptations to PCIT. Most clinicians had a master's degree (72.1%), were licensed (74.2%), and were PCIT-certified (70.7%). Qualitative interviews were conducted with a purposeful sample of 23 community clinicians, who were 39% Spanish-speaking, were 30% Latinx, and 30% reported serving a ≥50% Latinx clientele. Clinicians reported engaging in adaptations aimed at augmenting PCIT more extensively than adaptations involving removing core components. Themes from qualitative interviews converged with quantitative findings, with clinicians most frequently describing augmenting adaptations, and highlighted reasons for adapting PCIT. Clinicians primarily augmented treatment to address clients' clinical presentations. Clinicians rarely adapted treatment specifically for culture, but when mentioned, clinicians discussed tailoring idioms and phrases to match clients' culture for Spanish-speaking clients. Implications for training PCIT clinicians in intervention adaptations will be discussed.

A National Survey of Patient Completion of Cognitive Behavioral Therapy for Chronic Pain: The Role of Therapist Characteristics, Attempt Rates, and Modification

The implementation of evidence-based psychotherapies, including patient-level measures such as penetration and rates of successfully completing a course of therapy, has received increasing attention. While much attention has been paid to the effect of patient-level factors on implementation, relatively little attention has been paid to therapist factors (e.g., professional training, experience).

Objective

The current study explores therapists' decisions to offer a particular evidence-based psychotherapy (cognitive behavioral therapy for chronic pain; CBT-CP), whether and how they modify CBT-CP, and the relationship between these decisions and patient completion rates.

Methods

The study utilized survey responses from 141 Veterans Affairs therapists certified in CBT-CP.

Results

Therapists reported attempting CBT-CP with a little less than one half of their patients with chronic pain (mean = 48.8%, s.d.=35.7). Therapist were generally split between reporting modifying CBT-CP for either very few or most of their patients. After controlling for therapist characteristics and modification, therapist-reported percentage of patients with attempted CBT-CP was positively associated with completion rates, t (111) = 4.57, p<.001.

Conclusions

Therapists who attempt CBT-CP more frequently may experience better completion rates, perhaps due to practice effects or contextual factors that support both attempts and completion. Future research should examine this relationship using objective measures of attempt rates and completion.

Can a Single Measure Estimate Protocol Adherence for Two Psychosocial Treatments for Youth Anxiety Delivered in Community Mental Health Settings?

Treatment adherence measurement can be time and resource-intensive in clinical trials, so the ability to measure protocol adherence for two distinct treatment programs with a single measure may benefit the field. The present study sought to determine if the Therapy Process Observational Coding System - Revised Strategies Scale (TPOCS-RS) could assess protocol adherence to two youth treatment programs. Treatment sessions (N = 796) from 55 youth (M age = 9.89 years, SD = 1.71; range 7-15 years; 55.0% White; 46.0% female) with primary anxiety problems treatment by 39 clinicians (M age = 40.54 years, SD = 9.56; 50.0% White; 80.0% female) were independently scored by coders using observational treatment adherence and alliance measures. The youth received one of three treatments: (a) Standard (i.e., cognitive-behavioral treatment program), (b) Modular (i.e., a program with cognitive-behavioral and parent training components), or (c) Usual Care. Consultants filled out a self-report measure of protocol adherence within the Standard and Modular conditions. Interrater reliability, ICC(2,2) for the various items for the full sample ranged from .17 to .92 (M ICC = .67; SD = .17). Scores from a TPOCS-RS subscale that mapped onto the specific content of the treatment protocols used in the Standard and Modular conditions evidenced convergent validity with the consultant-report adherence measure and discriminant validity with the alliance measure. The model-specific TPOCS-RS subscales also discriminated between the Standard and Modular treatments and Usual Care. This study provides initial evidence that (a) the TPOCS-RS has utility in estimating protocol adherence in different treatment programs and (b) support the score validity of the self-report consultation records.

Scales for assessing therapeutic adherence and competence in dialectical behaviour therapy for PTSD: development and analysis of psychometric properties

BACKGROUND

The assessment of therapeutic adherence and competence is essential to understand mechanisms that contribute to treatment outcome. Nevertheless, their assessment is often neglected in psychotherapy research.

AIMS/OBJECTIVE

To develop an adherence and a treatment-specific competence rating scale for Dialectical Behaviour Therapy for Posttraumatic Stress Disorder (DBT-PTSD), and to examine their psychometric properties. Global cognitive behavioural therapeutic competence and disorder-specific therapeutic competence were assessed using already existing scales to confirm their psychometric properties in our sample of patients with PTSD and emotion regulation difficulties.

METHOD

Two rating scales were developed using an inductive procedure. 155 videotaped therapy sessions from a multicenter randomised controlled trial were rated by trained raters using these scales, 40 randomly chosen videotapes involving eleven therapists and fourteen patients were doubly rated by two raters.

RESULTS

Both the adherence scale (Patient-level ICC = .98; α_s= .65; α _p= .75) and the treatment-specific competence scale (Patient-level ICC = .98; α_s= .78; α _p= .82) for DBT-PTSD showed excellent interrater - and good reliability on the patient level. Content validity, including relevance and appropriateness of all items, was confirmed by experts in DBT-PTSD for the new treatment-specific competence scale.

CONCLUSION

Our results indicate that both scales are reliable instruments. They will be useful to examine possible effects of adherence and treatment-specific competence on DBT-PTSD treatment outcome.

Therapist adaptations to evidence-based practices and associations with implementation outcomes in child therapy sessions

OBJECTIVE

Community therapists inevitably adapt evidence-based practices (EBPs) to meet the needs of their clients and practice settings. Yet, the implications of spontaneous, therapist-driven adaptations for EBP implementation outcomes are not well understood. We used a sequential QUAN → qual mixed-methods design to examine how different types of therapist-described adaptations were associated with observer-rated extensiveness of therapist delivery of EBP content and technique strategies at the session level.

METHOD

Data were drawn from an observational study of a system-driven implementation of multiple EBPs into public children's mental health services. Community therapists (n = 103) described adaptations they made in 680 sessions with 273 clients (50.92% female, 49.08% male, M_age = 9.72 years, 70.70% Hispanic/Latinx). Coders classified therapist-described adaptations into five types: (a) Modifying Presentation, (b) Integrating, (c) Extending, (d) Reducing, and (e) Generalizing. Independent observers rated the extensiveness of EBP strategy delivery from session recordings using the EBP Concordant Care Assessment (ECCA) Observational Coding System.

RESULTS

Quantitative analyses using multilevel regression revealed that Modifying Presentation adaptations were associated with higher extensiveness of EBP technique delivery, whereas Extending adaptations were associated with lower extensiveness of EBP content and technique delivery. Qualitative analysis of adaptation descriptions identified explanations for the quantitative findings.

CONCLUSIONS

Findings suggest that Modifying Presentation adaptations, associated with higher extensiveness, involved creative use of activities and materials, language modification, and personalization of EBP content to meet clients' diverse needs, whereas Extending adaptations, associated with lower extensiveness, involved slowing EBP pacing in response to client challenges. Implications for provider training are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Treatment Fidelity in Brief Versus Standard-Length School-Based Interventions for Youth with Anxiety

To examine treatment fidelity in a randomized controlled trial of indicated school-based cognitive-behavioral therapy (CBT) delivered in groups to youth with anxiety. We investigated whether adherence and competence (a) differed across brief and standard-length CBT, and (b) if adherence and competence predicted change in anxiety symptoms and impairment. Method: Sessions were observationally coded with the Competence and Adherence Scale for CBT for Anxiety Disorders in Youth. Coders (N = 7) rated 104 sessions from 52 groups delivered by 32 facilitators (M age = 43.2 years, SD = 8.1) to 295 youth (M age = 14.0 years, SD = 0.8). Outcomes were youth- and parent-reported anxiety symptoms and impairment at post-intervention and 1-year follow-up. Linear mixed effect models were used to analyze whether fidelity predicted clinical outcomes. Results: Levels of adherence and competence were adequate in both programs, but higher in brief compared to standard-length CBT p < .001 and p = .010, respectively). Neither adherence nor competence predicted clinical outcomes at any timepoints. Conclusion: Higher levels of adherence and competence in brief CBT suggest that it may be easier for novice CBT providers to achieve fidelity in simplified and less flexible interventions. Contrary to expectation, adherence and competence did not predict clinical outcomes.

Evaluating clinical outcomes of routinely delivered task-shared care for depression in rural Haiti

BACKGROUND

There is a growing literature in support of the effectiveness of task-shared mental health interventions in resource-limited settings globally. However, despite evidence that effect sizes are greater in research studies than actual care, the literature is sparse on the impact of such interventions as delivered in routine care. In this paper, we examine the clinical outcomes of routine depression care in a task-shared mental health system established in rural Haiti by the international health care organization Partners In Health, in collaboration with the Haitian Ministry of Health, following the 2010 earthquake.

METHODS

For patients seeking depression care betw|een January 2016 and December 2019, we conducted mixed-effects longitudinal regression to quantify the effect of depression visit dose on symptoms, incorporating interaction effects to examine the relationship between baseline severity and dose.

RESULTS

306 patients attended 2052 visits. Each visit was associated with an average reduction of 1.11 in depression score (range 0-39), controlling for sex, age, and days in treatment (95% CI -1.478 to -0.91; p < 0.001). Patients with more severe symptoms experienced greater improvement as a function of visits (p = 0.04). Psychotherapy was provided less frequently and medication more often than expected for patients with moderate symptoms.

CONCLUSIONS

Our findings support the potential positive impact of scaling up routine mental health services in low- and middle-income countries, despite greater than expected variability in service provision, as well as the importance of understanding potential barriers and facilitators to care as they occur in resource-limited settings.

A Novel Approach to the Assessment of Fidelity to a Cognitive Behavioral Therapy for PTSD Using Clinical Worksheets: A Proof of Concept With Cognitive Processing Therapy

Fidelity monitoring is a critical indicator of psychotherapy quality and is central to successful implementation. A major barrier to fidelity in routine care is the lack of feasible, scalable, and valid measurement strategies. A reliable, low-burden fidelity assessment would promote sustained implementation of cognitive behavioral therapies (CBTs). The current study examined fidelity measurement for cognitive processing therapy (CPT) for posttraumatic stress disorder (PTSD) using clinical worksheets. External raters evaluated patient worksheets done as a part of treatment, both guided by the therapist and completed independently as homework. Results demonstrated that fidelity ratings from CPT session worksheets were feasible and efficient. Notably, they were strongly correlated with observer ratings of the fidelity of CPT strategies that were present on the worksheets. Agreement among ratings conducted by individuals with a range of experience with CPT was acceptable to high. There was not a main effect of therapist-guided, in-session worksheet ratings on PTSD symptom change. However, patient competence in completing worksheets independently was associated with greater PTSD symptom decline and in-session, therapist-guided worksheet completion was associated with larger symptom decreases among patients with high levels of competence. With further research and refinement, rating of worksheets may be an efficient way to examine therapist and patient skill in key CPT elements, and their interactions, compared to the gold standard of observer ratings of therapy video-recordings. Additional research is needed to determine if worksheets are an accurate and scalable alternative to gold standard observer ratings in settings in which time and resources are limited.

A Stakeholder-Engaged Process for Adapting an Evidence-Based Intervention for Posttraumatic Stress Disorder for Peer Delivery

PURPOSE

Peer providers represent a growing sector of the U.S. workforce, yet guidance is needed on best practices for adapting behavioral health interventions for peer delivery.

METHODS

We utilized the Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME; Wiltsey Stirman et al. 2013, 2019) to describe how we systematically adapted Skills Training in Affective and Interpersonal Regulation (STAIR) for posttraumatic stress disorder (PTSD) for peer delivery. Our process was iterative and relied on engagement of multiple stakeholders, including a work group of organizational leaders (N = 5), peer interventionists (N = 4), intervention experts (N = 2), and trial participants (N = 18). The FRAME was used to guide rapid coding across multiple data sources, including researcher field notes, meeting minutes, and intervention manual documents, and content analysis of semi-structured interviews with peer interventionists and trial participants.

RESULTS

Phase 1 (pre-trial) focused on modifications for fit with the local context and peer model. Key modifications focused on improving intervention design and packaging, removing clinical and stigmatizing language, and addressing peer interventionist training gaps. We used a hybrid approach to delivery, whereby we integrated peer model principles (self-disclosure, mutuality) into a directive approach. Phase 2 (trial) included reactive fidelity-consistent adaptations, such as additional educational resources. Phase 3 (post-trial) focused on adaptations to support roll-out of the intervention at the peer organization (e.g., group format).

CONCLUSION

Our stakeholder-engaged process may serve as a helpful exemplar to others tailoring interventions for peer delivery. Future research is needed to understand the role of stakeholder engagement and adaptation in implementation success.

Ensuring the fit of an evidence-based curriculum for high-risk Latina young mothers using implementation science

Conduct a comprehensive needs assessment to evaluate the fit of a Cognitive Behavioral Theory (CBT) curriculum implemented within a community organization and inform possible adaptations to fit the mental health difficulties of high-risk Latina young mothers. The PRECEDE-PROCEED implementation framework guided the assessment and results. Focus groups were conducted with high-risk Latina young mothers and staff members to assess the priority mental health problems, environmental stressors and factors contributing and maintaining these difficulties, and existing resources that could be leveraged to address them. Latina young mothers experience a variety of mental health needs and immigration and interpersonal-related stressors. The organization's existing CBT curriculum was found to be feasible and a good fit for the target population. Proposed minor adaptations included a focus on parenting. Results support the robust effects of CBT interventions, including when delivered by paraprofessionals to a high-risk population in a low-resource community setting.

A Preliminary Investigation of Provider Attitudes Toward a Transdiagnostic Treatment: Outcomes from Training Workshops with the Unified Protocol

Evidence-based psychological treatments (EBPTs) for common mental health conditions are efficacious but remain underutilized in clinical service settings. Novel transdiagnostic and modular approaches that treat several disorders simultaneously promise to address common barriers to the dissemination and implementation of traditional EBPTs. Despite the promise that transdiagnostic treatments hold, the claims that these interventions can be more easily disseminated and implemented have not been widely tested. The present study examined whether a transdiagnostic treatment, the Unified Protocol (UP), addresses some barriers to dissemination and implementation for clinicians. Exploratory aims of the current study were to examine the effects of a UP introductory training workshop on clinician attitudes and behaviors by: (1) evaluating UP knowledge and treatment delivery, (2) determining relationships between clinician characteristics and their knowledge acquisition, satisfaction with UP, and UP penetration, and (3) exploring clinicians' perceptions of the UP's characteristics utilizing mixed methods. Workshop participants showed a good understanding of UP treatment concepts following training, and over a third of survey respondents reported use of the intervention 6-months after training. Positive attitudes toward EBPTs and fewer years of clinical practice were associated with greater satisfaction with the UP. Clinicians held positive views of the UP's flexibility and relative advantage over standard EBPTs but held negative views toward the manual's design and packaging. Overall, our findings suggest that clinicians may view transdiagnostic treatments such as the UP favorably and may consider them appealing over standard EBPTs. However, barriers associated with traditional EBPTs may extend to transdiagnostic treatments like the UP.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

A Glimpse into the "Black Box": Which Elements of Consultation in an EBP are Associated with Client Symptom Change and Therapist Fidelity?

Background: Consultation is an implementation strategy that improves delivery and clinical outcomes for Cognitive Processing Therapy (CPT), an evidence-based practice (EBP) for posttraumatic stress disorder (PTSD). However, little is known about the specific components of consultation that influence the fidelity of treatment delivery or clinical outcomes. Methods: The current study examined whether specific activities performed during CPT consultation meetings were associated with better fidelity to the CPT protocol among 60 newly trained therapists or improved clinical outcomes among 135 clients treated by these therapists. Consultation activities that fall under three broad categories (discussion of the application of CPT to individual cases, review/feedback on fidelity, and technical difficulties) were measured by consultant checklists for each consultation session. Treatment fidelity (adherence to the protocol and competence of delivery) was rated by trained observers for a random sample of therapists' CPT sessions following consultation. The self-reported PTSD Checklist-IV assessed PTSD symptom change. Results: Multilevel regression analyses indicated that higher therapist consultation attendance predicted a greater decrease in their clients' PTSD symptoms and that attendance was not associated with observer-rated treatment fidelity. Discussion of the application of specific CPT strategies was the only consultation activity that was significantly associated with greater improvement in PTSD symptoms. Lastly, no consultation activities were significantly associated with treatment fidelity. Conclusions: Our findings suggest that specific consultation strategies such as emphasizing the discussion of the application of specific CPT strategies to individual cases during consultation meetings may be effective in improving the clinical outcomes of CPT.

A Nonrandomized Trial of Prolonged Exposure and Cognitive Processing Therapy for Combat-Related Posttraumatic Stress Disorder in a Deployed Setting

For many decades, the U.S. military's general operational guideline has been to limit the use of trauma-focused treatments for combat and operational stress reactions in military service members until they have returned from deployment. Recently, published clinical trials have documented that active-duty military personnel with combat-related posttraumatic stress disorder (PTSD) can be treated effectively in garrison. However, there are limited data on the treatment of combat and operational stress reactions or combat-related PTSD during military deployments. This prospective, nonrandomized trial evaluated the treatment of active-duty service members (N = 12) with combat and operational stress reactions or combat-related PTSD while deployed to Afghanistan or Iraq. Service members were treated by deployed military behavioral health providers using modified Prolonged Exposure (PE; n = 6) or modified Cognitive Processing Therapy (CPT; n = 6), with protocol modifications tailored to individual mission requirements. The PTSD Checklist-Military Version (PCL-M) total score was the primary outcome measure. Results indicated that both groups demonstrated clinically significant change in PTSD symptoms as indicated by a reduction of 10 points or greater on the PCL-M. Participants treated with modified PE had significant reductions in PTSD symptoms, t = -3.83, p = .01; g = -1.32, with a mean reduction of 18.17 points on the PCL-M. Participants treated with modified CPT had a mean PCL-M reduction of 10.00 points, but these reductions were not statistically significant, t = -1.49, p = .12; g = -0.51. These findings provide preliminary evidence that modified forms of PE and CPT can be implemented in deployed settings for the treatment of combat and operational stress reactions and combat-related PTSD.

Implementing a transdiagnostic sleep and circadian intervention in a community mental health setting: A qualitative process evaluation with community stakeholders

The implementation of evidence-based psychological treatments (EBPTs) may be particularly challenging to accomplish in community mental health settings for individuals with severe mental illness (SMI). Transdiagnostic treatments, or treatments that target a mechanism that underpins multiple mental health problems, may be particularly well-suited to community mental health settings. This study examines community stakeholder perspectives (N = 22) of the Transdiagnostic Sleep and Circadian Intervention (TranS-C) implemented in a community mental health setting in the context of a randomized controlled trial of TranS-C for SMI. The present study aimed to identify barriers and facilitators to the implementation of TranS-C for SMI in a community mental health setting using (1) a deductive theory-based process based on the Framework for Dissemination in Health Services Intervention Research and (2) an inductive thematic analysis process. All deductive themes were identified as both barriers and facilitators to the implementation of EBPTs and TranS-C in this community mental health setting. Seven additional themes were identified through the inductive thematic analysis. A discussion of how the findings are related to prior research, other EBPT implementation, and future TranS-C implementation are included.

The relationship between posttraumatic stress symptoms of maternity professionals and quality of work life, cognitive status, and traumatic perinatal experiences

PURPOSE

The purpose of this study was to determine the relationship between posttraumatic stress symptoms of maternity nursing/midwife and their quality of work life, cognitive distortions, and traumatic perinatal experiences.

METHODS

A descriptive, cross-sectional survey design was used. Two hundred and sixty-six maternity nurses/midwives employed in maternity units of hospitals in a province located in the Central Anatolia Region of Turkey were included in the study.

RESULTS

37.2% of the maternity nurses/midwives met the criteria for posttraumatic stress disorder (% 95 CI [31.6, 43.2]). Previous birth-related traumatic experiences, transferring to another unit, and negative cognitions about the self-increase the risk of development of posttraumatic stress disorder by 63% (F = 7.638, P < 0.001). A positive correlation was found between the outcome variable PTS total score and the following predictors: the number of years in the profession, the number of traumatizing events, quality of work life, burnout symptoms, compassion fatigue, posttraumatic cognition, negative cognition about the world, and negative cognition about the self. It was found that those maternity nurses/midwives who were not happy with their profession, who witnessed a traumatic incident, who transferred to another unit, who considered to quit the profession, who had a history of a psychological disorder, and those lacked social life were more sensitive to posttraumatic stress symptoms.

CONCLUSION

These outcomes have significant consequences for both personal and professional well-being of the maternity nurses/midwives and the welfare of the workforce. To prepare maternity nurses/midwives for such exposures, to support maternity nurses/midwives following traumatic perinatal events, and to provide effective intervention for those with significant symptoms, organizational strategies are necessary.