A hybrid effectiveness-implementation cluster randomized trial of group CBT for anxiety in urban schools: rationale, design, and methods

A hybrid effectiveness-implementation trial of application-based tiered care (Mom's Good Mood) in treating perinatal anxiety within a primary health care system in China

INTRODUCTION

Perinatal anxiety (PNA) is a major public health concern.

METHODS

A hybrid effectiveness-implementation trial was conducted in two antenatal clinics in Hefei, China, to assess the effectiveness and cost-effectiveness of application-based tiered care (Mom's Good Mood, MGM) in treating PNA and to understand how well it fits into routine practices. Pregnant women who scored at least 5 points on the 7-Item Generalised Anxiety Disorder Scale (GAD-7) scale were successively assigned to the control group or the intervention group, which were given the usual care and MGM on usual care, respectively. At 6 months post partum, anxiety, depression and life satisfaction were assessed. Intention-to-treat analysis and the Reach, Effectiveness, Adoption, Implementation and Maintenance framework were adopted.

RESULTS

A total of 214 women were assigned to the control group and 341 to the intervention group. The mean changes in GAD-7 scores (Least-squares means, LSM, -1.42, 95% CI -2.18 to -0.66) and the risk of anxiety (adjusted odds ratio, aOR 0.30, 95% CI 0.18 to 0.51) were decreased, and the anxiety remission rate (aOR 2.72, 95% CI 1.69 to 4.40) were improved in the intervention group. Similar findings were observed regarding the change in Edinburgh Postnatal Depression Scale scores (LS -1.92, 95% CI -2.85 to -0.99), depression remission rate (aOR 2.24, 95% CI 1.39 to 3.63) and the risk of depression (aOR 0.57, 95% CI 0.33 to 0.98). MGM only costs ¥1.88 (US$0.27) per pregnant woman to boost the postpartum anxiety remission rate by 1% and was revealed to have a high reach rate of 78.3%, an adoption rate of 51.3%-80.8%.

CONCLUSION

MGM is a cost-effective and accessible tool in coping with PNA.

TRIAL REGISTRATION NUMBER

ChiCTR2100053419.

Therapist and supervisor perspectives about two train-the-trainer implementation strategies in schools: A qualitative study

Background

Train-the-trainer (TT) implementation strategies (in which designated clinicians are trained to then train others in an intervention) are promising approaches to support mental health clinician use of evidence-based interventions in school contexts. However, there is little evidence to date examining clinicians' perceptions of the acceptability and feasibility of TT strategies, or comparing clinicians' perceptions of different types of TT strategies.

Methods

The current study was conducted as part of a larger hybrid effectiveness-implementation trial, in which school-based therapists and supervisors received one of two different types of implementation support to implement cognitive behavioral therapy (CBT) groups for anxiety: TT (i.e., initial training for therapists and supervisors) or enhanced TT (TT+; i.e., initial training for therapists and supervisors, and ongoing external consultation for supervisors). We used applied thematic analysis to compare qualitative interview transcripts from 28 therapist interviews and 33 supervisor interviews from therapists and supervisors who received TT or TT+ support and report themes that were similar and different across the two groups.

Results

Most themes were similar across the TT and TT+ conditions: therapists and supervisors in both conditions perceived the group anxiety intervention as acceptable and viewed supervision as acceptable, helpful, and feasible. Therapists and supervisors in both conditions had mixed impressions of the contextual appropriateness of the group anxiety intervention, and some reported logistical challenges with weekly supervision. Some unique themes were identified among the TT+ condition, including supervisors experiencing professional growth, and therapists and supervisors perceiving supervision as critically important and enjoyable.

Conclusions

These results suggest that TT implementation support, using a model in which an internal supervisor receives initial training and then provides ongoing supervision, is acceptable and feasible to support a group CBT intervention in schools. The results also highlight additional benefits that therapists and supervisors perceived when supervisors received ongoing consultation.

Clinical Trial Registration Information

The clinical trial from which these data were derived was registered at ClinicalTrials.gov (https://clinicaltrials.gov/) prior to the time of first patient enrollment. The registration number is: NCT02651402.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Predicting implementation: comparing validated measures of intention and assessing the role of motivation when designing behavioral interventions

BACKGROUND

Behavioral intention (which captures one's level of motivation to perform a behavior) is considered a causal and proximal mechanism influencing the use of evidence-based practice (EBP). Implementation studies have measured intention differently, and it is unclear which is most predictive. Some use items referring to "evidence-based practice" in general, whereas others refer to a specific EBP. There are also unresolved debates about whether item stems should be worded "I intend to," "I will," or "How likely are you to" and if a single-item measure can suffice. Using each stem to refer to either a specific EBP or to "evidence-based practice," this study compares the ability of these commonly used measures to predict future EBP implementation. The predictive validity is important for causal model testing and the development of effective implementation strategies.

METHODS

A longitudinal study enrolled 70 teachers to track their use of two EBPs and compare the predictive validity of six different items measuring teachers' intention. The measures differ by whether an item refers to a specific EBP, or to "evidence-based practices" in general, and whether the stem is worded in one of the three ways: "I intend to," "I will," or "How likely are you to." For each item, linear regressions estimated the variance in future behavior explained. We also compared the predictive validity of a single item versus an aggregate of items by inter-correlating the items using different stems and estimating the explained variance in EBP implementation.

RESULTS

Depending on the EBP and how intention was measured, the explained variance in implementation ranged from 3.5 to 29.0%. Measures that referred to a specific EBP, rather than "evidence-based practices" in general, accounted for more variance in implementation (e.g., 29.0% vs. 8.6%, and 11.3% vs. 3.5%). The predictive validity varied depending on whether stems were worded "I intend to," "I will," or "How likely are you to."

CONCLUSIONS

The observed strength of the association between intentions and EBP use will depend on how intention is measured. The association was much stronger if an item referred to a specific EBP, rather than EBP in general. To predict implementation, the results support using an aggregate of two or three intention items that refer to the specific EBP. An even more pragmatic measure of intention consisting of a single item can also predict implementation. As discussed, the relationship will also vary depending on the EBP, which has direct implications for causal model testing and the design of implementation strategies.

Using stakeholder perspectives to guide systematic adaptation of an autism mental health intervention for Latinx families: A qualitative study

Embedded within a Hybrid Type 1 randomized effectiveness-implementation trial in publicly funded mental health services, the current study identified stakeholder recommendations to inform cultural adaptations to An Individualized Mental Health Intervention for Autism Spectrum Disorder (AIM HI) for Latinx and Spanish-speaking families. Recommendations were collected through focus groups with therapists (n = 17) and semi-structured interviews with Latinx parents (n = 29). Relevant themes were identified through a rapid assessment analysis process and thematic coding of interviews. Adaptations were classified according to the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) to facilitate fit, acceptability, and sustained implementation of AIM HI and classify the content, nature, and goals of the adaptations. Recommended adaptations were classified through FRAME as tailoring training and intervention materials, changing packaging or materials, extending intervention pacing, and integrating supplemental training strategies. Goals for adaptations included improving fit for stakeholders, increasing parent engagement, and enhancing intervention effectiveness. The current study illustrates the process of embedding an iterative process of intervention adaptation within a hybrid effectiveness-implementation trial. The next steps in this study are to integrate findings with implementation process data from the parent trial to develop a cultural enhancement to AIM HI and test the enhancement in a Hybrid Type 3 implementation-effectiveness trial.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.