Evaluating the effectiveness and implementation of evidence-based treatment: A multisite hybrid design

The relationship between treatment integrity and outcome in group psychotherapy: A systematic review

Treatment integrity is defined as the extent to which the treatment has been implemented according to a specific theoretical model. It consists of two components: adherence, that is, the degree to which the therapist implements the techniques prescribed by the theoretical model, and competence, that is, the degree to which the therapist skilfully and appropriately implements the techniques prescribed by the model. Recently, the issue of integrity is gaining increasing importance in psychotherapy research, especially in an attempt to clarify its role in influencing the effectiveness of treatments. However, most studies focus on the individual setting. Therefore, this systematic review aims at investigating the relationship between integrity and outcome in group clinical treatments. Results highlighted a positive relationship between group treatment integrity and outcome. Moreover, this review provided insights for implications for research, clinical practice, and training of therapists, identifying questions that still need to be answered and tracing possible future research directions.

Oncology mental health providers' adaptation of an evidence-based intervention: A mixed-methods study

BACKGROUND

Adaptations are intentional modifications maximizing the fit of an evidence-based intervention (EBI) in new context. Little is known about EBI adaptation within psychosocial oncology. Guided by the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME), this mixed-methods study describes oncology mental health providers' planned adaptations to a psychosocial oncology EBI and examines the relationship between planned adaptations and longitudinal EBI usage.

METHODS

Providers (N = 128) were social workers (47%) and psychologists (40%) practicing in community settings (44%) or academic medical centers (41%). They attended a 3-day training on a multicomponent psychosocial oncology EBI, the Biobehavioral Intervention (BBI). During training, providers prepared an "adaptation plan" describing necessary adaptations to BBI and rationales for change. Qualitative data from adaptation plans were analyzed using directed content analysis. Linear mixed models examined the relationship between adaptation characteristics (number, similarity to the manualized BBI) and EBI usage across 12 months post-training.

RESULTS

Three sets of qualitative themes reflecting FRAME elements emerged: (1) content modifications (e.g., shortening/condensing, selecting elements, adding/removing elements); (2) contextual changes (e.g., alternative group formats); and (3) reasons for adaptations (e.g., organization/setting, provider, and recipient factors). Neither number of adaptations nor adaptation similarity were associated with BBI usage across 12 months post-training.

CONCLUSIONS

To our knowledge, this study is the first to characterize oncology mental health providers' planned adaptations to a psychosocial oncology EBI. Planned adaptations did not increase usage, but importantly they did not decrease usage. The adaptation process enabled providers to make thoughtful adaptation choices, with implementation successful irrespective of setting constraints.

Replicating dissemination and identifying mechanisms of implementation of an empirically supported treatment

OBJECTIVE

Implementation research is needed in cancer control. Replication of the dissemination of empirically supported treatments (ESTs) is important as is the identification of mechanisms by which dissemination leads to implementation. Addressing these gaps, Study 1 (Cohorts 3-6, N = 104) tests for replication of a successful dissemination to community providers (Brothers et al., 2015; Cohorts 1-2; N = 62) and Study 2 (Cohorts 1-6) tests providers' changes on dissemination outcomes as mechanisms of EST usage.

METHOD

The Biobehavioral Intervention (BBI), a psychological EST in cancer control, was disseminated to oncology mental health providers using manual provision, didactics, roleplays, and other strategies. Study 1 tested for pre/post changes in dissemination outcomes (BBI knowledge/skills and attitudes toward and self-efficacy to deliver ESTs/BBI) between cohorts (1-2 vs. 3-6) with repeated measures ANOVAs. In Study 2, the implementation outcome was providers' (N = 166) BBI usage with patients (percent treated). Structural equation models tested dissemination outcome changes as predictors of usage at 2- and 4-months.

RESULTS

Study 1 replicated high dissemination outcomes and significant gains in BBI knowledge (p < .001) in Cohorts 3-6. Unlike Cohorts 1-2, significant gains were observed in self-efficacy (ps < .001) but not attitudes toward ESTs (p = .523) in Cohorts 3-6. In Study 2, gains in providers' self-efficacy (ps < .05) and EST attitudes (p = .008) predicted greater 2-month (58.4% ± 35.5%) and 4-month (66.2% ± 35.0%) usage of the BBI with patients, respectively.

CONCLUSIONS

This is the only replication of a dissemination for a psychological EST in cancer control. Results reliably show disseminations enhancing providers' self-efficacy to use and positive attitudes toward ESTs as mechanisms for EST implementation. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Sustainability of a biobehavioral intervention implemented by therapists and sustainment in community settings

The ultimate aim of dissemination and implementation of empirically supported treatments (ESTs) in behavioral medicine is (a) sustainability of the therapist/provider's EST usage and (b) sustainment of EST delivery in the setting. Thus far, sustainability has been understudied, and the therapist and setting variables that may be influential are unclear. The purpose of the study was to test the therapists' sustainability of a cancer-specific EST using a prospective longitudinal design and examine its predictors. Oncology mental health therapists (N = 134) from diverse settings (N = 110) completed training in the biobehavioral intervention (BBI) and were provided with 6 months of support for implementation, with no support thereafter. BBI usage (percent of patients treated) was reported at 2, 4, 6, and 12 months. Using a generalized estimating equation with a logistic link function, 12-month sustainability (a nonsignificant change in usage from 6 to 12 months) was studied along with therapist, supervisor, and setting variables as predictors. BBI usage increased through 6 months and, importantly, usage was sustained from 6 (68.4% [95% CI = 62.2%-73.9%]) to 12 months (70.9% [95% CI = 63.6%-77.3%]), with sustainment in 66 settings (60.0%). Predictors of implementation-to-sustainability usage were therapists' early intentions to use the BBI (p < .001) and from the setting, supervisors' positive attitudes toward ESTs (p = .016). Adding to the DI literature, a health psychology intervention was disseminated, implemented, and found sustainable across diverse therapists and settings. Therapists and setting predictors of usage, if modified, might facilitate future sustainability/sustainment of ESTs.

Achieving oncology mental health providers' usage of an empirically supported treatment: Lessons learned

OBJECTIVE

There is a need for oncology mental health providers to receive training to use empirically supported psychological treatments (ESTs) with their patients. The purpose of this editorial is to describe "lessons learned" from disseminating-conducting EST trainings-and supporting providers' capacity and confidence to use the EST.

METHOD

Processes and outcomes from conducting six, 3-days (18 h) EST training institutes from 2012-2016 are discussed. Institutes trained 166 full time oncology mental health providers from more than 100 different settings. The dissemination was intentionally designed to achieve EST implementation, i.e., therapists' sustained usage of the EST for at least 12 months post training.

RESULTS

Previously published discussion and findings show the effort was successful in achieving positive EST dissemination outcomes and sustained EST implementation by providers. Thus, "lessons learned" include discussions of (1) orientation to design education/training to achieve EST usage using theory based aims and outcomes of training efficacy; (2) multimodal, educational strategies used to achieve therapists' positive attitudes toward and self-efficacy to implement the EST; (3) guidance to therapists for adapting the EST to their practice settings while maintaining fidelity; (4) assistance to therapists to identify and problem solve implementation challenges; and (5) using patient reported outcome measures to determine clinical change.

CONCLUSION

Our discussion of the plan, methods, and goals of EST training contributes to the science of dissemination/implementation by providing support for (1) theory-informed EST dissemination, and (2) mechanisms of EST implementation. For researchers, our experience may guide future EST dissemination/implementation efforts in psycho-oncology. For therapists, lessons learned provide criteria for evaluating future continuing education options.

Lemons to lemonade: Effects of a biobehavioral intervention for cancer patients on later life changes

OBJECTIVE

The sustainment of gains for cancer patients provided psychosocial interventions is unclear. Furthermore, it is unknown whether interventions also yield long-term positive changes. The present study experimentally tests if an intervention delivered at cancer diagnosis could yield broad, long-term, changes in domains such as relationships, worldview, priorities, and goals. It was hypothesized that the intervention group would report more positive and fewer negative life changes during survivorship versus the control group.

METHOD

Patients with Stage II/III breast cancer were randomized to biobehavioral intervention (BBI) or assessment only. At randomization, patients completed measures of cancer stress (Impact of Events Scale [IES]) and depressive symptoms (Center for Epidemiological Studies Depression scale [CES-D]). At the 24-month follow-up, survivors (N = 160) completed a thought listing task with 7 prompts (e.g., "relationships"). Patients listed thoughts about change since diagnosis and rated each for valence. Groups were compared on the frequency of positive/negative thoughts across prompts. Listed thoughts were content analyzed.

RESULTS

BBI survivors reported significantly more positive changes (p < .05), controlling for IES and CES-D. Groups did not differ on negative changes. Patients with higher IES/CES-D scores reported more negative changes at 24 months (ps < .05). Content analysis revealed a predominance (13/23) of positive thought categories.

CONCLUSIONS

Adding support for efficacy, BBI survivors reported significantly more positive life changes since diagnosis than survivors not receiving BBI. More generally, heightened stress/depressive symptoms at diagnosis foretold survivors' reporting of more negative changes. Thought listing is a strategy to obtain personalized accounts of life changes after breast cancer. (PsycINFO Database Record (c) 2019 APA, all rights reserved).