Community mental health provider modifications to cognitive therapy: implications for sustainability

Mothers and Babies Virtual Group (MBVG) for perinatal Latina women: study protocol for a hybrid type-1 effectiveness-implementation randomized controlled trial

BACKGROUND

Immigrant Latinas (who are foreign-born but now reside in the USA) are at greater risk for developing postpartum depression than the general perinatal population, but many face barriers to treatment. To address these barriers, we adapted the Mothers and Babies Course-an evidence-based intervention for postpartum depression prevention-to a virtual group format. Additional adaptations are inclusion of tailored supplemental child health content and nutrition benefit assistance. We are partnering with Early Learning Centers (ELC) across the state of Maryland to deliver and test the adapted intervention.

METHODS

The design is a Hybrid Type I Effectiveness-Implementation Trial. A total of 300 participants will be individually randomized to immediate (N = 150) versus delayed (N = 150) receipt of the intervention, Mothers and Babies Virtual Group (MB-VG). The intervention will be delivered by trained Early Learning Center staff. The primary outcomes are depressive symptoms (measured via the Center for Epidemiologic Studies-Depression Scale), parenting self-efficacy (measured via the Parental Cognition and Conduct Towards the Infant Scale (PACOTIS) Parenting Self-Efficacy subscale), and parenting responsiveness (measured via the Maternal Infant Responsiveness Instrument) at 1-week, 3-month, and 6-month post-intervention. Depressive episodes (Structured Clinical Interview for DSM-V- Disorders Research Version) at 3-month and 6-month post-intervention will also be assessed. Secondary outcomes include social support, mood management, anxiety symptoms, perceived stress, food insecurity, and mental health stigma at 1-week, 3-month, and 6-month post-intervention. Exploratory child outcomes are dysregulation and school readiness at 6-month post-intervention. Intervention fidelity, feasibility, acceptability, and appropriateness will also be assessed guided by the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework.

DISCUSSION

This study will be one of the first to test the efficacy of a group-based virtual perinatal depression intervention with Latina immigrants, for whom stark disparities exist in access to health services. The hybrid effectiveness-implementation design will allow rigorous examination of barriers and facilitators to delivery of the intervention package (including supplemental components) which will provide important information on factors influencing intervention effectiveness and the scalability of intervention components in Early Learning Centers and other child-serving settings.

REGISTRATION

ClinicalTrials.gov NCT05873569.

Adapting family-based treatment for adolescent anorexia nervosa delivered in the home: A novel approach for improving access to care and generalizability of skill acquisition

BACKGROUND

Anorexia nervosa (AN) is a serious mental illness associated with high rates of morbidity and mortality. Family-based treatment (FBT) is a well-established treatment for adolescent AN, yet it is underutilized in community settings and is unavailable to many families, particularly those from lower income and racial and ethnic minority backgrounds. Furthermore, some families do not respond optimally to FBT, possibly because of challenges translating skills acquired in office-based treatment settings to naturalistic settings. Home-based treatment could reduce barriers to access and enhance generalization of newly learned treatment skills. Home-based models demonstrate initial feasibility, acceptability, and efficacy for adolescent AN, however, FBT principles have yet to be applied as a stand-alone intervention in a home-based level of care. This paper describes the rationale for and process of adapting FBT principles/interventions to improve fit within a home-based model delivered in the context of community mental health, and discusses potential strengths and opportunities associated with this approach.

RESULTS

Adaptations were made through consultation with collaborating community agencies and were guided by the complex interventions framework. The primary modifications included: (1) altered dose; (2) multiple family meals; (3) additional support for meal preparation and supervision; (4) clinician attendance at medical appointments; (5) cultural adaptation; and (6) introduction of distress tolerance and emotion regulation skills.

CONCLUSIONS

Implementing FBT in the home may present one promising and novel approach to enhance engagement and treatment outcomes for adolescents with restrictive eating disorders, particularly those who are underserved, but evaluation of efficacy/effectiveness is needed.

You never know what you are going to get: Large-scale assessment of therapists' supportive counseling skill use

Supportive counseling skills like empathy and active listening are critical ingredients of all psychotherapies, but most research relies on client or therapist reports of the treatment process. This study utilized machine-learning models trained to evaluate counseling skills to evaluate supportive skill use in 3,917 session recordings. We analyzed overall skill use and variation in practice patterns using a series of mixed effects models. On average, therapists scored moderately high on observer-rated empathy (i.e., 3.8 out of 5), 3.3% of the therapists' utterances in a session were open questions, and 12.9% of their utterances were reflections. However, there were substantial differences in skill use across therapists as well as across clients within-therapist caseloads. These findings highlight the substantial variability in the process of counseling that clients may experience when they access psychotherapy. We discuss findings in the context of both the need for therapists to be responsive and flexible with their clients, but also potential costs related to the lack of a more uniform experience of care. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Patient Responsiveness to a Sleep and Circadian Intervention in a Sample of Adults With Serious Mental Illness

Understanding patient responsiveness, a component of fidelity, is essential as it impacts treatment outcome and ongoing use of treatment elements. This study evaluated patient responsiveness-operationalized as receptivity to treatment modules and ratings of the usefulness and the utilization of treatment elements-to the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) in a sample of adults with serious mental illness (SMI) and sleep/circadian dysfunction. Adults with SMI and sleep/circadian dysfunction (N = 104) received TranS-C in a community mental health setting. Independent raters rated TranS-C sessions to assess receptivity. At posttreatment and 6-month follow-up, participants completed a usefulness scale, utilization scale, the PROMIS Sleep Disturbance (PROMIS-SD) and Sleep-Related Impairment (PROMIS-SRI) scales, DSM-5 Cross-Cutting Measure (DSM-5-CC), and Sheehan Disability Scale (SDS). Receptivity was rated as somewhat to fully understood, and predicted a reduction on the DSM-5-CC. On average, participants rated TranS-C as moderately useful and utilized treatment elements occasionally. Ratings of usefulness were associated with the PROMIS-SD, PROMIS-SRI, and DSM-5-CC at posttreatment, but not with the SDS. Ratings of utilization were not associated with outcome. The findings add to the literature on patient responsiveness, an implementation outcome, and provide data on the utility of TranS-C within a community mental health setting.

Assessment of modifications to evidence-based psychotherapies using administrative and chart note data from the US department of veterans affairs health care system

Background

The US Department of Veterans Affairs (VA) has over 15 years of experience in delivery of evidence-based psychotherapies (EBPs). This paper describes strategies for using clinical documentation and administrative data to understand adherence and modifications to EBPs for Posttraumatic Stress Disorder (PTSD).

Methods

This study focused on two EBPs for PTSD, Cognitive Processing Therapy (CPT) and Prolonged Exposure (PE). The sample included VA therapists from across the US who provided CPT and PE and the patients they treated over a 1-year period. The data sources for this study were templated EBP chart notes and VA administrative data. We used a manual review of note content and administrative data rules to code therapy adherence and modifications in 7,297 EBP sessions for 1,257 patients seen by 182 therapists. Two trained coders rated each therapy note and resolved discrepancies through consensus. To contextualize and explain variation in adherence and modifications, we conducted brief 30-45-min semi-structured interviews with a purposive subsample of these therapists (n = 32).

Findings

Combining manual chart review and administrative data allowed for identification of 11 types of modifications. Raters disagreed on adherence for 30% of notes. The disagreement stemmed from the presence of therapy modifications that were not clearly documented, necessitating the development of decision rules and strategies for modification coding. Both therapists and patients contributed to the variance in the extent to which different modifications occurred. Therapist interviews demonstrated therapist awareness of modifying the protocols in the ways identified through chart review.

Conclusion

Healthcare systems can use data collected as part of routine care to understand how and when EBPs are modified but need to develop scalable strategies to document adaptations and modifications to EBPs in routine care.

Performance of a Supervisor Observational Coding System and an Audit and Feedback Intervention

Workplace-based clinical supervision is common in community based mental health care for youth and families and could be a leveraged to scale and improve the implementation of evidence-based treatment (EBTs). Accurate methods are needed to measure, monitor, and support supervisor performance with limited disruption to workflow. Audit and Feedback (A&F) interventions may offer some promise in this regard. The study-a randomized controlled trial with 60 clinical supervisors measured longitudinally for 7 months-had two parts: (1) psychometric evaluation of an observational coding system for measuring adherence and competence of EBT supervision and (2) evaluation of an experimental Supervisor Audit and Feedback (SAF) intervention on outcomes of supervisor adherence and competence. All supervisors recorded and uploaded weekly supervision sessions for 7 months, and those in the experimental condition were provided a single, monthly web-based feedback report. Psychometric performance was evaluated using measurement models based in Item Response Theory, and the effect of the SAF intervention was evaluated using mixed-effects regression models. The observational instrument performed well across psychometric indicators of dimensionality, rating scale functionality, and item fit; however, coder reliability was lower for competence than for adherence. Statistically significant A&F effects were largely in the expected directions and consistent with hypotheses. The observational coding system performed well, and a monthly electronic feedback report showed promise in maintaining or improving community-based clinical supervisors' adherence and, to a lesser extent, competence. Limitations discussed include unknown generalizability to the supervision of other EBTs.

Implementation case study: Multifamily group intervention in first-episode psychosis programs

AIM

Family interventions are a core component of first-episode psychosis (FEP) treatment; however, low implementation rates are consistently reported. As such, work is needed to understand the factors impacting real-world treatment delivery. The present paper describes the implementation of the McFarlane-model multifamily psychoeducational groups (MFG) in established FEP early intervention programs within a single state. The aims were to examine (a) training participation and implementation of MFG, (b) barriers and facilitators to implementation, and (c) modifications made to MFG.

METHODS

Practitioners from six established FEP early intervention programs received in-person training and ongoing consultation in MFG. Training participation data were obtained via attendance and implementation outcomes were obtained from practitioner reports. Fifteen months following the initial training, practitioners reported on clinic-specific barriers, facilitators, and modifications across four categories (context, intervention, practitioner, and recipient).

RESULTS

Twenty-three practitioners across six clinics received in-person training and were offered ongoing consultation to support implementation. Difficulties in starting MFG were salient as the earliest group was run 7 months after the initial training, thereby resulting in low overall frequency of groups. A number of barriers spanning context, intervention, practitioner, and recipient domains were noted, the majority of which were clinic-specific. Despite challenges, practitioners identified several facilitators and made modifications to the intervention and its delivery in service of implementation.

CONCLUSIONS

Results from this implementation case study highlighted the challenges of delivering MFG in real-world FEP early intervention programs. Further, this paper emphasizes the value in identifying and addressing clinic-specific factors when implementing MFG.

A Systematic Review of Mental Health Interventions for ASD: Characterizing Interventions, Intervention Adaptations, and Implementation Outcomes

Youth with autism spectrum disorder (ASD) have high rates of co-occurring mental health needs that necessitate mental health interventions. Given the unique clinical characteristics of youth with ASD, there have been significant efforts to adapt and test mental health interventions for this population. Yet, characterization of the nature and types of interventions adaptations is limited, especially across the wide range of interventions tested for youth with ASD with a focus on implementation factors. Additionally, understanding how these interventions may be implemented in community services is limited. The aims of this systematic review are to characterize the (1) types of interventions tested for co-occurring mental health conditions for youth with ASD; (2) adaptations to mental health interventions for use with youth with ASD; and (3) implementation strategies, outcomes, and determinants of mental health interventions to inform their translation to community service settings. Eighty-three articles testing interventions targeting mental health symptoms in youth with ASD that included implementation factors in analyses were reviewed. The Stirman et al. (2013; 2019) FRAME adaptation, Powell et al. (2012;2015) implementation strategies, and Proctor et al. (2011) implementation outcomes taxonomies were applied to characterize the nature and types of adaptations for use with youth with ASD and types of implementation strategies, outcomes, and determinants used, when available, respectively. Of the interventions examined, the majority (64.1%) were originally designed to target youth mental health concerns and were then adapted to be used with ASD. The most common adaptations included those to the intervention content, particularly adding elements with tailoring or refining aspects of the intervention while maintaining core functions. Half of the articles described at least one implementation strategy used during intervention testing. Fidelity and acceptability were the most frequently examined implementation outcomes, with some examination of appropriateness and feasibility. Nineteen percent of articles described implementation determinants (i.e. barriers/facilitators) of these implementation outcomes. The common adaptations for ASD provide direction for future intervention development and for training community therapists. Further examination, specification, and reporting of implementation strategies and outcomes within ongoing efforts to adapt and interventions to meet the co-occurring mental health needs of youth ASD are needed to facilitate their translation to community settings. Areas for future research as well as clinical implications are discussed.

Correction to: A Systematic Review of Mental Health Interventions for ASD: Characterizing Interventions, Intervention Adaptations, and Implementation Outcomes

Due to the errors occurred in the originally published version, this article is being reprinted in its entirety as Correction. All errors have been corrected. It is the correct version.

Concordance between Community Supervisor and Provider Ratings of Fidelity: Examination of Multi-Level Predictors and Outcomes

Fidelity is conceptualized as a key mechanism impacting treatment outcomes, yet community examination of fidelity is limited, partly due to limited feasible training methods and tools. Provider-report tools represent a feasible method for improving routine fidelity monitoring. Additional work examining the effectiveness of these methods and concordance with other fidelity sources is needed. Further, provider and client factors impact both intervention implementation and concordance, but their impact on fidelity measurement is poorly understood. Using a train-the-trainer methodology, we examine concordance between three methods of assessing fidelity (trained independent coders, supervisor evaluation and provider self-report) using a fidelity assessment tool adapted for community use. Multilevel models examined predictors (provider- and child- level factors) and outcomes (provider average fidelity) of concordance. Results suggest supervisors and providers are able to use the fidelity tool, but demonstrated variable concordance, with higher concordance with trained coders for supervisors than providers. Provider credentials and child language were marginally predictive of rater concordance. Higher supervisor accuracy was associated with higher provider fidelity. Findings inform broader efforts to improve the development and implementation of feasible fidelity tools for routine use in community settings and highlight multi-level factors impacting the adoption and implementation of such tools.

Trauma services for youth victims of sexual abuse- does one size fit all? A qualitative study among service providers in Ontario, Canada

BACKGROUND

Despite a range of interventions available to treat mental health symptoms experienced by youth with a history of child sexual abuse (CSA), limited empirical work has examined practitioner delivery of these interventions in real-world practice.

OBJECTIVE

This paper aimed to qualitatively explore the delivery of trauma-based interventions in community settings in Ontario, Canada.

PARTICIPANTS AND SETTINGS

Using qualitative description, a purposeful sample of service providers (N = 51; 92 % female) were recruited from nine community-based organizations located in Southern Ontario, Canada providing psychotherapeutic trauma-based interventions to youth with a history of child sexual abuse.

METHODS

Semi-structured one-on-one (n = 17), joint (n = 3) and focus group (n = 5) interviews elicited provider descriptions of their strategies and approaches for addressing trauma-related symptoms in this population. Data were interpreted using conventional content analyses.

RESULTS

Eclectic delivery of interventions and multifactorial decision-making processes were identified as core elements of treatment planning and intervention delivery among providers. Eclectic treatment was described to involve the consideration of four core elements (provider judgement; youth voice; youth characteristics; and clinical team discussion) of intervention and three key principles (meeting youth needs; providing client-centered care; addressing safety and stability).

CONCLUSIONS

Research capable of characterizing the efficacy of client-centered, eclectic approaches to treat symptoms experienced by youth with a history of CSA is needed.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Common paraverbal errors during hypnosis intervention training

There is growing literature to support the use of hypnosis as an evidence-based behavioral medicine intervention to manage a wide variety of symptoms and side effects associated with cancer and its treatment (e.g., pain, nausea, fatigue). However, formal training in hypnosis is often lacking among cancer care providers. The purpose of this study is to identify common paraverbal errors among hypnosis trainees in order to inform future training efforts. In a sample of 196 hypnosis trainees, paraverbal errors (i.e., tone, pacing, and phrasing) were tracked across hypnotic intervention components. Results revealed that trainees had most difficulty with hypnotic tone, particularly during the Induction, Deepening, and Alerting components. Individual trainee characteristics were unrelated to paraverbal errors.

Systematic review to examine the methods used to adapt evidence-based psychological treatments for adults diagnosed with a mental illness

QUESTION

The context for the implementation of evidence-based psychological treatments (EBPTs) often differs from the context in which the treatment was developed, which necessitates adaptations. In this systematic review we build on, and add to, prior approaches by examining the method used to guide such adaptations. In particular, we sought to elucidate the extent to which an empirical process is used.

STUDY SELECTION AND ANALYSIS

We focused on publications describing adaptations made to EBPTs for adults diagnosed with a mental illness. We searched PubMed, PsycINFO, Embase and Web of Science from database inception to July 2018. Two raters independently coded the articles for the method used to conduct the adaptation, the reason for and nature of the adaptation, and who made the adaptation.

FINDINGS

The search produced 20 194 citations, which yielded 152 articles after screening. The most commonly used methods for planned adaptations were literature review (57.7%), clinical intuition (47.0%) and theory (38.9%). The use of data from stakeholder interviews ranked fourth (21.5%) and the use of other types of data (eg, pilot study, experiment, survey, interview) ranked last at fifth (12.1%). Few publications reporting ad hoc adaptations were identified (n=3).

CONCLUSIONS

This review highlights a need to (a) educate providers and researchers to carefully consider the methods used for the treatment adaptation process, and to use empirical methods where possible and where appropriate, (b) improve the quality of reporting of stakeholder interviews and (c) develop reporting standards that articulate optimal methods for conducting treatment adaptations.

The Validation of a Provider-Reported Fidelity Measure for the Transdiagnostic Sleep and Circadian Intervention in a Community Mental Health Setting

Monitoring treatment fidelity is essential to check if patients receive adequate doses of treatment and to enhance our theoretical understanding of how psychosocial treatments work. Developing valid and efficient measures to assess fidelity is a priority for dissemination and implementation efforts. The present study reports on the psychometric properties of the Provider-Rated TranS-C Checklist-a provider-reported fidelity measure for the Transdiagnostic Sleep and Circadian Intervention (TranS-C). Adults with severe mental illness (SMI; N = 101) seeking treatment in a community mental health setting received eight sessions of TranS-C. Therapists completed the Provider-Rated TranS-C Checklist at the end of each treatment session (N = 808) to indicate which modules they delivered during that session. To assess convergent validity, independent raters scored modules delivered from audio recordings of a subset of sessions (n = 257) for the modules delivered using the Independent-Rater TranS-C Checklist. Using exploratory factor analysis, a unidimensional scale composed of TranS-C's modules was identified. Provider-Rated TranS-C Checklist scores were positively associated with the Independent-Rater TranS-C Checklist scores demonstrating convergent validity. Results indicate that the Provider-Rated TranS-C Checklist yields reliable and valid scores of providers' delivery of TranS-C.

Mental Health Therapy Protocols and eHealth Design: Focus Group Study

Background

Electronic health (eHealth) programs are often based on protocols developed for the original face-to-face therapies. However, in practice, therapists and patients may not always follow the original therapy protocols. This form of personalization may also interfere with the intended implementation and effects of eHealth interventions if designers do not take these practices into account.

Objective

The aim of this explorative study was to gain insights into the personalization practices of therapists and patients using cognitive behavioral therapy, one of the most commonly applied types of psychotherapy, in a youth addiction care center as a case context.

Methods

Focus group discussions were conducted asking therapists and patients to estimate the extent to which a therapy protocol was followed and about the type and reasons for personalization of a given therapy protocol. A total of 7 focus group sessions were organized involving therapists and patients. We used a commonly applied protocol for cognitive behavioral therapy as a therapy protocol example in youth mental health care. The first focus group discussions aimed at assessing the extent to which patients (N=5) or therapists (N=6) adapted the protocol. The second focus group discussions aimed at estimating the extent to which the therapy protocol is applied and personalized based on findings from the first focus groups to gain further qualitative insight into the reasons for personalization with groups of therapists and patients together (N=7). Qualitative data were analyzed using thematic analysis.

Results

Therapists used the protocol as a “toolbox” comprising different therapy tools, and personalized the protocol to enhance the therapeutic alliance and based on their therapy-provision experiences. Therapists estimated that they strictly follow 48% of the protocol, adapt 30%, and replace 22% by other nonprotocol therapeutic components. Patients personalized their own therapy to conform the assignments to their daily lives and routines, and to reduce their levels of stress and worry. Patients estimated that 29% of the provided therapy had been strictly followed by the therapist, 48% had been adjusted, and 23% had been replaced by other nonprotocol therapeutic components.

Conclusions

A standard cognitive behavioral therapy protocol is not strictly and fully applied but is mainly personalized. Based on these results, the following recommendations for eHealth designers are proposed to enhance alignment of eHealth to therapeutic practice and implementation: (1) study and copy at least the applied parts of a protocol, (2) co-design eHealth with therapists and patients so they can allocate the components that should be open for user customization, and (3) investigate if components of the therapy protocol that are not applied should remain part of the eHealth applied. To best generate this information, we suggest that eHealth designers should collaborate with therapists, patients, protocol developers, and mental health care managers during the development process.

Iterative Decision-making for Evaluation of Adaptations (IDEA): A decision tree for balancing adaptation, fidelity, and intervention impact

BACKGROUND

Evidence-based practices (EBPs) are frequently adapted to maximize outcomes while maintaining fidelity to core EBP elements. Many step-by-step frameworks for adapting EBPs have been developed, but these models may not account for common complexities in the adaptation process. In this paper, we introduce the Iterative Decision-making for Evaluation of Adaptations (IDEA), a tool to guide adaptations that addresses these issues.

FRAMEWORK DESIGN AND USE

Adapting EBPs requires attending to key contingencies incorporated into the IDEA, including: the need for adaptations; fidelity to core EBP elements; the timeframe in which to make adaptations; the potential to collect pilot data; key clinical and implementation outcomes; and stakeholder viewpoints. We use two examples to illustrate application of the IDEA.

CONCLUSIONS

The IDEA is a practical tool to guide EBP adaptation that incorporates important decision points and the dynamism of ongoing adaptation. Its use may help implementation scientists, clinicians, and administrators maximize EBP impact.

How community therapists describe adapting evidence-based practices in sessions for youth: Augmenting to improve fit and reach

The study sought to (a) characterize the types and frequency of session-level adaptations made to multiple evidence-based practices (EBPs) and (b) identify therapist-, client-, and session-level predictors of adaptations. Within the community implementation of multiple EBPs, 103 community mental health therapists reported on 731 therapy sessions for 280 clients. Therapists indicated whether they adapted EBPs in specific sessions and described adaptations in open-ended responses. Responses were coded using the Augmenting and Reducing adaptations framework. Therapists reported making adaptations in 59% of sessions. Augmenting adaptations were reported more frequently than Reducing adaptations. Multilevel logistic regression analyses revealed that greater therapist openness to EBPs, younger child age, and presenting problems was associated with Augmenting adaptations. Child presenting problem of externalizing problems predicted fewer Reducing adaptations compared with internalizing problems. This study extends the growing research examining adaptations within the context of the system-driven implementation of multiple EBPs by applying the Augmenting and Reducing adaptation framework to the session-level.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Provider Perspectives on Choosing Prolonged Exposure or Cognitive Processing Therapy for PTSD: A National Investigation of VA Residential Treatment Providers

As part of a longitudinal mixed-methods investigation on implementation of two evidence-based psychotherapies (EBPs) for Posttraumatic Stress Disorder, 164 mental health providers from 38 Department of Veterans Affairs (VA) residential treatment programs across the U.S. were asked questions about their decision-making for using Prolonged Exposure and Cognitive Processing Therapy. Many providers viewed both EBPs as equally efficacious and encouraged veterans to decide for themselves which treatment they wished to engage in. Some providers said that it was hard to know which EBP would be the most effective for a given patient, and that occasionally they started work with a veteran thinking that a particular EBP would work and were surprised when the veteran did not receive the full potential benefit of the intervention. Other providers noted that their decision-making regarding which EBP to use depended on the type and nature of the veterans' index trauma, memory of the trauma, and traumatic stress symptoms (e.g., fear versus guilt). Additional factors that impacted the choice of EBP included whether the patient already had one of the treatments before or if a provider deemed one as more compatible with their previous training. Implications for clinical practice as well as the design and improvement of training and implementation efforts are discussed.

Disseminating and implementing a lifestyle-based healthy weight program for mothers in a national organization: a study protocol for a cluster randomized trial

Background

Excessive weight gain among young adult women age 18–45 years is an alarming and overlooked trend that must be addressed to reverse the epidemics of obesity and chronic disease. During this vulnerable period, women tend to gain disproportionally large amounts of weight compared to men and to other life periods. Healthy Eating and Active Living Taught at Home (HEALTH) is a lifestyle modification intervention developed in partnership with Parents as Teachers (PAT), a national home visiting, community-based organization with significant reach in this population. HEALTH prevented weight gain, promoted sustained weight loss, and reduced waist circumference. PAT provides parent–child education and services free of charge to nearly 170,000 families through up to 25 free home visits per year until the child enters kindergarten.

Methods

This study extends effectiveness findings with a pragmatic cluster randomized controlled trial to evaluate dissemination and implementation (D&I) of HEALTH across three levels (mother, parent educator, PAT site). The trial will evaluate the effect of HEALTH and the HEALTH training curriculum (implementation strategy) on weight among mothers with overweight and obesity across the USA (N = 252 HEALTH; N = 252 usual care). Parent educators from 28 existing PAT sites (14 HEALTH, 14 usual care) will receive the HEALTH training curriculum through PAT National Center, using PAT’s existing training infrastructure, as a continuing education opportunity. An extensive evaluation, guided by RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance), will determine implementation outcomes (acceptability, adoption, appropriateness, feasibility, fidelity, and adaptation) at the parent educator level. The Conceptual Framework for Implementation Research will characterize determinants that influence HEALTH D&I at three levels: mother, parent educator, and PAT site to enhance external validity (reach and maintenance).

Discussion

Embedding intervention content within existing delivery channels can help expand the reach of evidence-based interventions. Interventions, which have been adapted, can still be effective even if the effect is reduced and can still achieve population impact by reaching a broader set of the population. The current study will build on this to test not only the effectiveness of HEALTH in real-world PAT implementation nationwide, but also elements critical to D&I, implementation outcomes, and the context for implementation.

Trial registration

https://ClinicalTrials.gov, NCT03758638. Registered 29 November 2018

Electronic supplementary material

The online version of this article (10.1186/s13012-019-0916-0) contains supplementary material, which is available to authorized users.

The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions

BACKGROUND

This paper describes the process and results of a refinement of a framework to characterize modifications to interventions. The original version did not fully capture several aspects of modification and adaptation that may be important to document and report. Additionally, the earlier framework did not include a way to differentiate cultural adaptation from adaptations made for other reasons. Reporting additional elements will allow for a more precise understanding of modifications, the process of modifying or adapting, and the relationship between different forms of modification and subsequent health and implementation outcomes.

DISCUSSION

We employed a multifaceted approach to develop the updated FRAME involving coding documents identified through a literature review, rapid coding of qualitative interviews, and a refinement process informed by multiple stakeholders. The updated FRAME expands upon Stirman et al.'s original framework by adding components of modification to report: (1) when and how in the implementation process the modification was made, (2) whether the modification was planned/proactive (i.e., an adaptation) or unplanned/reactive, (3) who determined that the modification should be made, (4) what is modified, (5) at what level of delivery the modification is made, (6) type or nature of context or content-level modifications, (7) the extent to which the modification is fidelity-consistent, and (8) the reasons for the modification, including (a) the intent or goal of the modification (e.g., to reduce costs) and (b) contextual factors that influenced the decision. Methods of using the framework to assess modifications are outlined, along with their strengths and weaknesses, and considerations for research to validate these measurement strategies.

CONCLUSION

The updated FRAME includes consideration of when and how modifications occurred, whether it was planned or unplanned, relationship to fidelity, and reasons and goals for modification. This tool that can be used to support research on the timing, nature, goals and reasons for, and impact of modifications to evidence-based interventions.

Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change

OBJECTIVE

The purpose of this study is to examine associations between therapist adherence, competence, and modifications of an evidence-based protocol (EBP) delivered in routine clinical care and client outcomes.

METHOD

Data were derived from a NIMH-funded implementation-effectiveness hybrid study of Cognitive Processing Therapy (CPT) for PTSD in a diverse community health center. Providers (n = 19) treated clients (n = 58) as part of their routine clinical care. Clients completed the PCL-S and PHQ-9 at baseline, after each CPT session, and posttreatment. CPT sessions were rated for treatment fidelity and therapist modifications.

RESULTS

Overall, therapist adherence was high, although it decreased across sessions suggesting potential drift. Therapist competence ratings varied widely. Therapists made on average 1.6 fidelity-consistent and 0.4 fidelity-inconsistent modifications per session. Results show that higher numbers of fidelity-consistent modifications were associated with larger reductions in posttraumatic stress and depressive symptoms. High adherence ratings were associated with greater reductions in depressive symptoms, whereas higher competence ratings were associated with greater reduction in posttraumatic stress symptoms.

CONCLUSIONS

The results highlight the importance of differentially assessing therapist adherence, competence, and modifications to EBP in usual care settings. The findings also suggest that effective EBP delivery in routine care may require minor adaptations to meet client needs, consistent with previous studies. Greater attention to fidelity and adaptation can enhance training so providers can tailor while retaining core components of the intervention. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Therapists' Adaptations to an Intervention to Reduce Challenging Behaviors in Children with Autism Spectrum Disorder in Publicly Funded Mental Health Services

Publicly funded mental health services play an important role in serving children with autism spectrum disorder (ASD). Previous research indicates a high likelihood of adaptations when therapists deliver evidence based practices to non-ASD populations, though less is known about therapists' use of adaptations for children with ASD receiving mental health services. The current study uses a mixed quantitative and qualitative approach to characterize the types and reasons therapists adapted a clinical intervention [An Individualized Mental Health Intervention for Children with ASD (AIM HI)] for delivery with clinically complex children with ASD served in publicly funded mental health settings and identify therapist characteristics that predict use of adaptations. The most common adaptations were characterized as augmenting AIM HI and were done to individualize the intervention to fit with therapeutic style, increase caregiver participation, and address clients' and caregivers' needs and functioning. No therapist characteristics emerged as significant predictors of adaptations. Results suggest that therapists' adaptations were largely consistent with the AIM HI protocol while individualizing the model to address the complex needs of youth with ASD.

Ethnic minority community therapists' acculturation and reported adaptations to children's evidence-based practices

OBJECTIVE

This study examined associations between ethnic minority therapists' reports of acculturation and adaptations made to multiple evidence-based practices (EBPs) in children's community mental health services. Multilevel modeling was used to analyze therapist- and practice-level predictors of Augmenting and Reducing/Reordering adaptations, the two subscales of the Adaptations to Evidence-Based Practices Scale (AES; Lau et al., 2017).

METHOD

An online survey was completed by 235 therapists (86% women, M_age = 34.82 years, 68.1% Hispanic/Latino) as part of a larger study examining EBP sustainment in Los Angeles County, California. Acculturation was measured through therapist reports of cultural identity and language use using the Abbreviated Multidimensional Acculturation Scale (Zea, Asner-Self, Birman, & Buki, 2003).

RESULTS

Analyses showed that the effect of Heritage Cultural Identity on Augmenting adaptations was moderated by Heritage Language Use. There was a significant interaction between Heritage and United States Cultural Identity dimensions in predicting Reducing/Reordering adaptations. Therapists who reported higher levels of Heritage Cultural Identity and lower levels of United States Cultural Identity reported the fewest Reducing/Reordering adaptations, whereas therapists who reported higher levels of affiliation with both their Heritage Culture and United States Culture reported making the most Reducing/Reordering adaptations. Language acculturation and other cultural factors such as Ethnicity and Generational Status did not predict either adaptation type. Therapists who reported more favorable perceptions of the EBP reported making fewer Reducing/Reordering adaptations.

CONCLUSION

Findings suggest that cultural identity is linked to the likelihood that ethnic minority therapists may adapt EBPs. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Best practices in supervising cognitive behavioral therapy with youth

Clinical supervision of cognitive behavioral therapy (CBT) with youth ensures better patient care and fosters trainees' professional development. However, often insufficient attention is directed toward disseminating best practices in supervision of CBT with youth. This Therapeutic Advances contribution aims to communicate the core content of supervision. Additionally, the key supervisory practices associated with CBT with youth are described. Supervisory outcomes are summarized and recommendations for supervisory practices are made.

Empirical Examinations of Modifications and Adaptations to Evidence-Based Psychotherapies: Methodologies, Impact, and Future Directions

This review describes methods used to examine the modifications and adaptations to evidence-based psychological treatments (EBPTs), assesses what is known about the impact of modifications and adaptations to EBPTs, and makes recommendations for future research and clinical care. One hundred eight primary studies and three meta-analyses were identified. All studies examined planned adaptations, and many simultaneously investigated multiple types of adaptations. With the exception of studies on adding or removing specific EBPT elements, few studies compared adapted EBPTs to the original protocols. There was little evidence that adaptations in the studies were detrimental, but there was also limited consistent evidence that adapted protocols outperformed the original protocols, with the exception of adding components to EBPTs. Implications for EBPT delivery and future research are discussed.

Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children's mental health services

OBJECTIVE

This study examined clinical adaptations reported by community therapists to multiple evidence-based practices (EBPs) currently implemented in children's mental health services. Based on an item set informed by Stirman and colleagues' model (2015), 2 factors emerged describing Augmenting adaptations and Reducing/Reordering adaptations. We used multilevel modeling to examine therapist- and practice-level predictors of therapist reports of each type of adaptation.

METHOD

Data were drawn from an online survey, including a novel therapist report measure of EBP adaptations, completed by 572 therapists (89.2% female, Mage = 37.08 years, 33.4% non-Hispanic White) delivering EBPs in the context of a system-driven, fiscally mandated implementation effort.

RESULTS

Analyses revealed that the 2 types of therapist adaptations (Augmenting and Reducing/Reordering) could be readily discriminated, with therapists reporting significantly more Augmenting than Reducing/Reordering adaptations. Therapists of Hispanic/Latino ethnicity and with fewer years of experience reported more extensive Augmenting adaptations, but no therapist background characteristics were associated with Reducing/Reordering adaptations. Therapists' general attitudes that EBPs diverged from their personal approach to therapy were associated with reporting more Augmenting and Reducing/Reordering adaptations. In contrast, negative perceptions toward the specific EBP predicted Reducing/Reordering adaptations, but not Augmenting adaptations.

CONCLUSIONS

Community therapist reports suggest that most adaptations undertaken involve engaging with the practice to augment the fit of the EBPs for local contexts; however, when practices were perceived negatively, therapists were more likely to make adaptations reducing or rearranging components. (PsycINFO Database Record

Modifications to ART service delivery models by health facilities in Uganda in promotion of intervention sustainability: a mixed methods study

BACKGROUND

In November 2015, WHO released new treatment guidelines recommending that all diagnosed as HIV positive be enrolled on antiretroviral therapy (ART). Sustaining and expanding ART scale-up programs in resource-limited settings will require adaptations and modifications to traditional ART delivery models to meet the rapid increase in demand. We identify modifications to ART service delivery models by health facilities in Uganda to sustain ART interventions over a 10-year period (2004-2014).

METHODS

A mixed methods approach involving two study phases was adopted. In the first phase, a survey of a nationally representative sample of health facilities (n = 195) in Uganda which were accredited to provide ART between 2004 and 2009 was conducted. The second phase involved semi-structured interviews (n = 18) with ART clinic managers of 6 of the 195 health facilities purposively selected from the first study phase. We adopted a thematic framework consisting of four categories of modifications (format, setting, personnel, and population).

RESULTS

The majority of health facilities 185 (95%) reported making modifications to ART interventions between 2004 and 2014. Of the 195 health facilities, 157 (81%) rated the modifications made to ART as "major." Modifications to ART were reported under all the four themes. The quantitative and qualitative findings are integrated and presented under four themes. Format: Reducing the frequency of clinic appointments and pharmacy-only refill programs was identified as important strategies for decongesting ART clinics.

SETTING

Home-based care programs were introduced to reduce provider ART delivery costs. Personnel: Task shifting to non-physician cadre was reported in 181 (93%) of the health facilities.

POPULATION

Visits to the ART clinic were rationalized in favor of the sub-population deemed to have more clinical need. Two health facilities focused on patients living nearer the health facilities to align with targets set by external donors.

CONCLUSIONS

Over the study period, health facilities made several modifications ART interventions to improve fit with their resource-constrained settings thereby promoting long-term sustainability. Further research evaluating the effect of these modifications on patient outcomes and ART delivery costs is recommended. Our findings have implications for the sustainability of ART scale-up programs in Uganda and other resource-limited settings.

Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial

BACKGROUND

Large-scale implementation of evidence-based psychotherapies (EBPs) such as cognitive processing therapy (CPT) for posttraumatic stress disorder can have a tremendous impact on mental and physical health, healthcare utilization, and quality of life. While many mental health systems (MHS) have invested heavily in programs to implement EBPs, few eligible patients receive EBPs in routine care settings, and clinicians do not appear to deliver the full treatment protocol to many of their patients. Emerging evidence suggests that when CPT and other EBPs are delivered at low levels of fidelity, clinical outcomes are negatively impacted. Thus, identifying strategies to improve and sustain the delivery of CPT and other EBPs is critical. Existing literature has suggested two competing strategies to promote sustainability. One emphasizes fidelity to the treatment protocol through ongoing consultation and fidelity monitoring. The other focuses on improving the fit and effectiveness of these treatments through appropriate adaptations to the treatment or the clinical setting through a process of data-driven, continuous quality improvement. Neither has been evaluated in terms of impact on sustained implementation.

METHODS

To compare these approaches on the key sustainability outcomes and provide initial guidance on sustainability strategies, we propose a cluster randomized trial with mental health clinics (n = 32) in three diverse MHSs that have implemented CPT. Cohorts of clinicians and clinical managers will participate in 1 year of a fidelity oriented learning collaborative or 1 year of a continuous quality improvement-oriented learning collaborative. Patient-level PTSD symptom change, CPT fidelity and adaptation, penetration, and clinics' capacity to deliver EBP will be examined. Survey and interview data will also be collected to investigate multilevel influences on the success of the two learning collaborative strategies. This research will be conducted by a team of investigators with expertise in CPT implementation, mixed method research strategies, quality improvement, and implementation science, with input from stakeholders in each participating MHS.

DISCUSSION

It will have broad implications for supporting ongoing delivery of EBPs in mental health and healthcare systems and settings. The resulting products have the potential to significantly improve efforts to ensure ongoing high quality implementation and consumer access to EBPs.

TRIAL REGISTRATION

NCT02449421 . Registered 02/09/2015.

Treating Posttraumatic Stress Disorder in Diverse Settings: Recent Advances and Challenges for the Future

Racial and ethnic minorities are at high risk for developing posttraumatic stress disorder (PTSD) after experiencing a traumatic event and are less likely to receive evidence-based treatment for their symptoms. There is a growing body of literature showing that culturally appropriate interventions result in greater uptake, symptom reduction, and sustained treatment gains. This article review explores new findings in the cultural understanding of PTSD among racial and ethnic minorities. We first review recent advances in the understanding of PTSD symptomotology. Next, we provide overview of trials demonstrating efficacy and effectiveness of cognitive processing therapy (CPT), prolonged exposure (PE), and trauma-focused cognitive-behavioral therapy (TF-CBT) in diverse communities. Then, we discuss specific implementation strategies common across intervention trials used to increase feasibility, acceptability, adoption, and sustainability. Last, we discuss areas for future research and dissemination efforts.

Integrity of evidence-based practice: are providers modifying practice content or practice sequencing?

This study examined patterns of evidence-based treatment (EBT) implementation within community settings by evaluating integrity along separate dimensions of practice content (PC; a session included the prescribed procedure) and practice sequencing (a session occurred in the prescribed sequence) within a recent randomized effectiveness trial. We measured whether sessions showed integrity to PC and to flexible or linear practice sequences. Findings revealed that providers tended to incorporate content from the EBT protocol in most treatment sessions, but that the sequencing of the sessions was often modified, suggesting that providers are amenable to evidence-based procedures, but not necessarily their prescribed arrangement.

Supporting our supervisors: a Summary and Discussion of the Special Issue on CBT supervision

Contributors to this Special Issue of the Cognitive Behaviour Therapist have considered the kind of infrastructure that should be in place to best support and guide CBT supervisors, providing practical advice and extensive procedural guidance. Here we briefly summarize and discuss in turn the 10 papers within this Special Issue, including suggestions for further enhancements. The first paper, by Milne and Reiser, conceptualized this infrastructure in terms of an ‘SOS’ (supporting our supervisors) framework, from identifying supervision competencies, to training, evaluation and feedback strategies. The next nine papers illustrate this framework with specific technical innovations, educational enhancements and procedural issues, or through comprehensive quality improvement systems, all designed to support supervisors. These papers suggest an assortment of workable infrastructure developments: two large-scale and comprehensive initiatives, some promising proposals and technologies, and a series of local, exploratory work. Collectively, they provide us with models for further developing evidence-based cognitive-behavioural supervision, and offer practical suggestions for giving supervisors the tools and support to maximize their supervisees’ learning, and to improve the associated client outcomes. Much research and development work remains to be done, and successful implementation will require institutional and political support, as well as cross-cultural adaptations. We conclude with an optimistic assessment of progress toward addressing some of the infrastructure improvements required to adequately support supervisors.

Supporting our supervisors: sending out an SOS

In this Introduction to the Special Issue of the Cognitive Behaviour Therapist on clinical supervision we start by highlighting the unmet and overdue need for coherent organizational systems to support, guide and develop clinical supervisors. We identify a seven-step, cyclical model that describes how such a system might work, with particular reference to CBT supervision. These steps start with conceptualization (e.g. definition of CBT supervision) and complete the problem-solving cycle with evaluation (e.g. corrective feedback). We provide an overview of typical research and development activity for each part of this model to illustrate how a sound supervision infrastructure might best be developed. The SOS model provides a systematic approach to indicate the organizational conditions under which CBT supervision might flourish.

The 4KEEPS study: identifying predictors of sustainment of multiple practices fiscally mandated in children's mental health services

Background

Research to date has largely focused on predictors of adoption and initial implementation of evidence-based practices (EBPs), yet sustained implementation is crucial to deliver a return on investments in dissemination. Furthermore, most studies focus on single EBPs, limiting opportunities to study the fit between practice characteristics EBPs and implementation contexts.

Methods/design

This observational study will characterize implementation sustainment and identify organizational and therapist characteristics that predict sustainment of multiple practices being implemented within a fiscal mandate in the largest public mental health system in the USA. Specific aims are to (1) characterize sustainment outcomes (volume/penetration, EBP concordant care); (2) use mixed methods to characterize inner context (agency- and therapist-level) factors and early implementation conditions; and (3) identify inner context factors and early implementation conditions that predict sustainment outcomes. This study will undertake original data collection and analysis of existing data sources to achieve its aims. Archived reports and documents will be used to characterize early implementation conditions in 102 agencies. Administrative claims data will be used to characterize volume and penetration outcomes over 8 years. Therapist and program manager surveys will be administered to characterize sustained EBP concordant care and inner context determinants of sustainment. An in-depth study in a subset of agencies will yield interview data and recordings of treatment sessions for validation of the EBP concordant care scale.

Discussion

This project will yield new understanding of whether and how multiple EBPs can be sustained in public mental health systems undergoing a policy-driven community implementation effort. We will produce generalizable models for characterizing sustainment, including feasible and flexible measurement of practice across multiple EBPs. The findings will inform the development of implementation interventions to promote sustained delivery of EBPs to maximize their public health impact.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-016-0388-4) contains supplementary material, which is available to authorized users.

Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy

BACKGROUND

Clinicians often modify evidence-based psychotherapies (EBPs) when delivering them in routine care settings. There has been little study of factors associated with or implications of modifications to EBP protocols. This paper differentiates between fidelity-consistent and fidelity-inconsistent modifications and it examines the potential influence of two clinician characteristics, training outcomes, and attitudes toward EBPs on fidelity-consistent and fidelity-inconsistent modifications of cognitive behavioral therapy in a sample of clinicians who had been trained to deliver these treatments for children or adults.

METHODS

Survey and coded interview data collected 2 years after completion of training programs in cognitive behavioral therapy were used to examine associations between successful or unsuccessful completion of training, clinician attitudes, and modifications. Modifications endorsed by clinicians were categorized as fidelity-consistent or fidelity-inconsistent and entered as outcomes into separate regression models, with training success and attitudes entered as independent variables.

RESULTS

Successful completion of a training program was associated with subsequent fidelity-inconsistent modifications but not fidelity-consistent modifications. Therapists who reported greater openness to using EBPs prior to training reported more fidelity-consistent modifications at follow-up, and those who reported greater willingness to adopt EBPs if they found them appealing were more likely to make fidelity-inconsistent modifications.

CONCLUSIONS

Implications of these findings for training, implementation, EBP sustainment, and future studies are discussed. Research on contextual and protocol-related factors that may impact decisions to modify EBPs will be an important future direction of study to complement to this research.