Effectiveness and Implementation of Evidence-Based Practices in Residential Care Settings

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 3: study protocol to evaluate sustainment in a hybrid type 2 effectiveness-implementation cluster-randomized trial

BACKGROUND

Although research on the implementation of evidence-based psychological treatments (EBPTs) has advanced rapidly, research on the sustainment of implemented EBPTs remains limited. This is concerning, given that EBPT activities and benefits regularly decline post-implementation. To advance research on sustainment, the present protocol focuses on the third and final phase-the Sustainment Phase-of a hybrid type 2 cluster-randomized controlled trial investigating the implementation and sustainment of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for patients with serious mental illness and sleep and circadian problems in community mental health centers (CMHCs). Prior to the first two phases of the trial-the Implementation Phase and Train-the-Trainer Phase-TranS-C was adapted to fit the CMHC context. Then, 10 CMHCs were cluster-randomized to implement Standard or Adapted TranS-C via facilitation and train-the-trainer. The primary goal of the Sustainment Phase is to investigate whether adapting TranS-C to fit the CMHC context predicts improved sustainment outcomes.

METHODS

Data collection for the Sustainment Phase will commence at least three months after implementation efforts in partnering CMHCs have ended and may continue for up to one year. CMHC providers will be recruited to complete surveys (N = 154) and a semi-structured interview (N = 40) on sustainment outcomes and mechanisms. Aim 1 is to report the sustainment outcomes of TranS-C. Aim 2 is to evaluate whether manipulating EBPT fit to context (i.e., Standard versus Adapted TranS-C) predicts sustainment outcomes. Aim 3 is to test whether provider perceptions of fit mediate the relation between treatment condition (i.e., Standard versus Adapted TranS-C) and sustainment outcomes. Mixed methods will be used to analyze the data.

DISCUSSION

The present study seeks to advance our understanding of sustainment predictors, mechanisms, and outcomes by investigating (a) whether the implementation strategy of adapting an EBPT (i.e., TranS-C) to the CMHC context predicts improved sustainment outcomes and (b) whether this relation is mediated by improved provider perceptions of treatment fit. Together, the findings may help inform more precise implementation efforts that contribute to lasting change.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT05956678 . Registered on July 21, 2023.

A qualitative study on the implementation of a transdiagnostic cognitive behavioral therapy for children in a child welfare residential treatment program

BACKGROUND

Youth with severe emotional or behavioral issues who are involved with child welfare authorities are sometimes placed in intensive care services in a residential treatment program. Evidence-based psychotherapies are often used in residential treatments, but there is very little research on how to adapt psychotherapy for residential treatment.

OBJECTIVE

To describe the implementation of a transdiagnostic cognitive behavioral therapy (the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Children) in a residential treatment program for children.

PARTICIPANTS AND SETTING

Staff (n = 20) at a residential facility in Calgary, Canada.

METHODS

A combination of qualitative interviews and focus groups were conducted before and after therapy to identify barriers and facilitators to implementation. Data were analyzed and reported using the Consolidated Framework for Implementation Research and the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies.

RESULTS

Modifications were made to the program including creating inclusive language, integrating relevant content targeting pediatric irritability, delivering sessions online for caregivers, and using additional staff to support youth to learn and practice the application of the content and behavioral interventions. Key barriers to implementation of the Unified Protocol included staff turnover and the difficulty of sustaining a critical mass of knowledge surrounding the Unified Protocol. The major facilitators to implementation were the perceived quality of the program and advantages of the program to children and their caregivers.

CONCLUSIONS

This study supports the feasibility and acceptability of providing transdiagnostic cognitive behavioral therapies for children in residential treatment and provides a template for how to implement evidence-based practice in residential treatment.

The Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for serious mental illness in community mental health part 3: Study protocol to evaluate sustainment in a hybrid type 2 effectiveness-implementation cluster-randomized trial

treatments (EBPTs) has advanced rapidly, research on the sustainment of implemented EBPTs remains limited. This is concerning, given that EBPT activities and benefits regularly decline post-implementation. To advance research on sustainment, the present protocol focuses on the third and final phase - the Sustainment Phase - of a hybrid type 2 cluster-randomized controlled trial investigating the implementation and sustainment of the Transdiagnostic Intervention for Sleep and Circadian Dysfunction (TranS-C) for patients with serious mental illness and sleep and circadian problems in community mental health centers (CMHCs). Prior to the first two phases of the trial - the Implementation Phase and Train-the-Trainer Phase - TranS-C was adapted to fit the CMHC context. Then, 10 CMHCs were cluster-randomized to implement Standard or Adapted TranS-C via facilitation and train-the-trainer. The primary goal of the Sustainment Phase is to investigate whether adapting TranS-C to fit the CMHC context predicts improved sustainment outcomes.

Methods

Data collection for the Sustainment Phase will commence at least three months after implementation efforts in partnering CMHCs have ended and may continue for up to one year. CMHC providers will be recruited to complete surveys (N = 154) and a semi-structured interview (N = 40) on sustainment outcomes and mechanisms. Aim 1 is to report the sustainment outcomes of TranS-C. Aim 2 is to evaluate whether manipulating EBPT fit to context (i.e., Standard versus Adapted TranS-C) predicts sustainment outcomes. Aim 3 is to test whether provider perceptions of fit mediate the relation between treatment condition (i.e., Standard versus Adapted TranS-C) and sustainment outcomes. Mixed methods will be used to analyze the data.

Discussion

The present study seeks to advance our understanding of sustainment predictors, mechanisms, and outcomes by investigating (a) whether the implementation strategy of adapting an EBPT (i.e., TranS-C) to the CMHC context predicts improved sustainment outcomes and (b) whether this relation is mediated by improved provider perceptions of treatment fit. Together, the findings may help inform more precise implementation efforts that contribute to lasting change.

Trial Registration

ClinicalTrials.gov identifier: NCT05956678. Registered on July 21, 2023. https://classic.clinicaltrials.gov/ct2/show/NCT05956678?term=NCT05956678&draw=2&rank=1.

Management of Emotion Dysregulation and Outbursts in Children and Adolescents

PURPOSE OF REVIEW

Emotion dysregulation and outbursts are very common reasons for referral to child and adolescent mental health services and a frequent cause of admission to hospitals and residential programs. Symptoms of emotion dysregulation and outburst are transdiagnostic, associated with many disorders, have the potential to cause severe impairment and their management presents a major challenge in clinical practice.

RECENT FINDINGS

There are an increasing number of psychosocial interventions that demonstrate promise in improving emotion dysregulation and outbursts. Acute care systems to manage the most severely ill patients have limited best practice guidelines but program advancements indicate opportunities to improve care models. Pharmacotherapy may be of assistance to psychosocial interventions but must be used with caution due to potential adverse effects. Much remains to be discovered however evidence informed, targeted treatments for specific populations show potential for future improvements in outcomes.

Treatment of Childhood Emotion Dysregulation in Inpatient and Residential Settings

Children hospitalized in inpatient and residential treatment facilities often present with severe emotion dysregulation, which is the result of a wide range of psychiatric diagnoses. Emotion dysregulation is not a diagnosis but is a common but inconsistently described set of symptoms and behaviors. With no agreed upon way of measuring emotion dysregulation, the authors summarize the existing contemporary treatment focusing on proxy measures of emotion dysregulation in inpatient and residential settings. Interventions are summarized and categorized into individual- and systems-level interventions in addressing aggressive behaviors. Going forward, dysregulation will need to be operationalized in a standard way.

An Emotion Regulation and Impulse Control (ERIC) Intervention for Vulnerable Young People: A Multi-Sectoral Pilot Study

Objective: There is a demonstrated link between the mental health and substance use comorbidities experienced by young adults, however the vast majority of psychological interventions are disorder specific. Novel psychological approaches that adequately acknowledge the psychosocial complexity and transdiagnostic needs of vulnerable young people are urgently needed. A modular skills-based program for emotion regulation and impulse control (ERIC) addresses this gap. The current one armed open trial was designed to evaluate the impact that 12 weeks exposure to ERIC alongside usual care had on young people's ability to regulate emotions, as well as examine potential moderating mechanisms. Methods: Seventy nine young people (50.6% male; M = 19.30; SD = 2.94) were enrolled to the 12 week intervention period. Twenty one practitioners from youth and community health services delivered relevant ERIC modules adjunct to usual care. Linear mixed effects regression (with random intercept) was used to examine change over time across the primary outcome of emotion dysregulation and secondary outcomes of depression, anxiety, stress, experiential avoidance and mindfulness. Moderation analyses were conducted to test whether the magnitude of change in emotion dysregulation moderated change over time in secondary outcomes. Results: Analyses revealed significant improvement in the primary outcome of emotion dysregulation with a moderate effect size (Mean Change = -10.24, 95% CI (-14.41, -6.06; Cohen's dav = -0.53), in addition to decreases in the secondary outcomes of depression, anxiety, stress and experiential avoidance. No improvements in mindfulness were reported. Moderation analyses revealed that the residualised change over time in emotion dysregulation moderated the change over time in symptoms of distress, depression, anxiety, stress, experiential avoidance, and mindfulness. Conclusion: Reductions in the severity of emotion dysregulation, depression, anxiety, stress and experiential avoidance are promising, and were evident despite the complexity of the participants and the diversity of the service setting. The improvements found in each outcome were only observed for those young people whose emotion regulation also improved, providing preliminary evidence for the role of emotion regulation as a key treatment target in this population.

Key features of an innovative sub-acute residential service for young people experiencing mental ill health

BACKGROUND

Numerous studies across international settings have highlighted a need to improve the appropriateness and continuity of services for young people experiencing mental ill health. This paper examines key features of a sub-acute youth mental health residential service model, Youth Prevention and Recovery Care (Y-PARC) service. Y-PARC provides up to 4 weeks care to 16 to 25 year-olds at risk of hospitalisation and to those transitioning out of hospital inpatient units. The research was conducted at one of three Y-PARCs located in Victoria, Australia.

METHODS

This paper presents findings from analysis of two data sources collected during evaluation of a Y-PARC service in 2015-17. Routinely collected administrative data of Y-PARC residents (n = 288) were analysed and semi-structured interviews were conducted with 38 participants: a) former residents (n = 14); b) family members of group a) (n = 5); key stakeholders (n = 9); and, Y-PARC staff (n = 10 respondents in 3 group interviews). Analysis of the qualitative data was thematic and structured by the interview guide, which covered the key service aims.

RESULTS

Consistent with the aims of the service, respondents described practice at Y-PARC that aligns with recovery-oriented care. Key features emphasised were: a safe and welcoming environment for residents and families; provision of person-centred care; promotion of autonomy and self-help; informal interactions with staff allowing for formation of naturalistic relationships; time spent with other young people with similar experiences; and, assurance upon exit that the 'door is always open.' High levels of satisfaction were reported. Outcomes described included: improved resilience; better understanding of mental health; the importance of seeking help; and, stronger connections to therapeutic services. Longer and multiple stays were associated with progressive and sustained change. Family members and stakeholders widely reported that the service fills a gap between community services and acute inpatient mental health hospital wards. Some challenging areas of practice identified included: integration of evidence-based psychosocial interventions; provision of care within a model that blends clinical and psychosocial support services; and, negotiation of family-inclusive practice.

CONCLUSIONS

The Y-PARC service model shows promise with young people experiencing mental ill health, particularly in improving the range and availability of options across a spectrum of need.

The SCIA Questionnaire: standards for communities for children and adolescents – a tool for the evaluation of good practices

Purpose

The purpose of this paper is to present the Italian validation of the standards for communities for children and adolescents (SCIA) Questionnaire, an evaluation tool of communities quality standards, based on the “Service Standards for Therapeutic Communities for Children and Young People – 2nd edition” of the Community of Communities (2009), that enables an empirical, multidimensional and complex evaluation of the therapeutic community (TC) “system”. It is a self-report that sets out and measures variables that allow to get an overview of organisational models and the possible development areas to improve the effectiveness of the protection of child and adolescents in community treatment. The validation and a preliminary analysis to develop a short version of the SCIA are presented.

Design/methodology/approach

The questionnaire (composed, in the extended form, by 143 items) was administered to 101 community workers, 20 males (19.8 per cent) and 81 females (81.2 per cent) aged between 24 and 61 years (M=36.20, SD=8.4). The analysis of reliability (Cronbach’s α) and a series of exploratory factor analysis allowed to eliminate redundant or less significant items.

Findings

The short form of the self-report consists of 67 items, divided into seven subscales, which explore different areas of intervention in TCs. Despite the limitations due to the small sample size, the utility of this tool remains confirmed by its clinical use and the development of good operating practices.

Originality/value

The SCIA Questionnaire responds to the need to adopt empirical variables in the process of evaluation of the communities. The SCIA is also a useful tool for clinical evaluation, as it allows a detailed observation of residential community treatment with children and adolescents that allows to analyse and monitor the structural and organisational aspects and the quality of practices that guide the interventions.

Measuring Youth Residential Care Provider Attitudes

Abstract. In this study the 15-item Evidence-Based Practices Attitude Scale (EBPAS), a measure designed to assess attitudes toward the adoption of EBPs, was collected from administrators of residential care facilities for youth in the United States. As the EBPAS was administered to a different sample for which it was originally developed (i.e., community mental health), we conducted a Confirmatory Factor Analysis (CFA) to investigate if its factor structure was maintained. Results confirm the factor structure of the EBPAS as a valid measure of attitude toward evidence-based practice among youth residential care providers. Limitations and areas of future research are discussed.

Implementation of Dialectical Behavior Therapy in Residential Treatment Programs: A Process Evaluation Model for a Community-Based Agency

Dialectical behavior therapy (DBT) can be challenging to implement in community-based settings. Little guidance is available on models to evaluate the effectiveness or sustainability of training and implementation efforts. Residential programs have much to gain from introduction of evidence-based practices, but present their own challenges in implementation. This paper presents a low-cost process evaluation model to assess DBT training piloted in residential programs. The model targets staff and organizational factors associated with successful implementation of evidence-based practices and matches data collection to the four stages of the DBT training model. The strengths and limitations of the evaluation model are discussed.

Implementing Evidence-Based Practice in Residential Care - How Far Have We Come?

Residential care agencies have been making efforts to provide better quality care through the implementation of evidence-based program models and evidence-based treatments. This paper retraces the developments that led to such efforts. It further aims to answer two questions based on the available conceptual and empirical literature: (1) What is the current status on milieu-based program models that were developed for residential care settings with a therapeutic focus? (2) What is known about the implementation of client- or disorder-specific evidence-based treatments into residential care settings? Findings from this review will be integrated to provide recommendations to residential care providers about the integration of evidence-based treatments into their agencies and to point to the challenges that remain for the field.

Animal-assisted psychotherapy for young people with behavioural problems in residential care

The aim of this study was to evaluate the impact of an animal-assisted psychotherapy (AAP) programme on clinical symptoms, personal adjustment, and adaptive skills in a group of adolescents in residential care who had experienced childhood trauma and who presented mental health problems and difficulties adapting to the care home environment. The 87 participants (M_age  = 15.17, SD = 1.53) were divided into two groups: a treatment group (25 girls and 27 boys; M_age  = 15.00, SD = 1.55) and a control group (9 girls and 26 boys; M_age  = 15.42, SD = 1.50). The programme consisted of 34 sessions involving both group (23 sessions) and individual (11 sessions) AAP. The Behaviour Assessment System for Children was used to evaluate clinical and adaptive dimensions of behaviour and personality. The results indicated that, in comparison with controls, the young people who took part in the AAP programme reported a significant improvement on two measures of internalizing symptoms, namely, depression and sense of inadequacy. Although no significant differences were observed in relation to externalizing symptoms, the adolescents who received the AAP programme showed improved social skills in terms of their ability to interact satisfactorily with peers and adults in the care home environment, as well as a more positive attitude towards teachers at school. These results suggest that AAP may be a promising treatment for young people who have experienced childhood trauma and who subsequently find it difficult to adapt to the residential care setting.

Promoting psychosocial adaptation of youths in residential care through animal-assisted psychotherapy

The goal of this study was to examine the influence of animal-assisted psychotherapy (AAP) on the psychosocial adaptation of a group of adolescents in residential care who had suffered traumatic childhood experiences and who presented with mental health problems. This study recruited 63 youths (mean age=15.27, SD=1.63) who were divided into two groups: a treatment group of 39 youths (19 female and 20 male; mean age=15.03, SD=0.51) and a control group of 24 (five female and 19 male; mean age=15.67, SD=1.63). The youths who underwent the AAP program had higher school adjustment in comparison to their peers who did not receive treatment. Their hyperactive behavior decreased, and they showed better social skills, more leadership, and fewer attention problems. They also showed a more positive attitude toward their teachers in comparison to controls. No differences were observed in other variables associated with clinical symptoms or personal adjustment. These results suggest that AAP can be effective with teenagers who have suffered childhood traumas and who present with problems of psychosocial adaptation.

Attitudes, Perceptions, and Utilization of Evidence-Based Practices in Residential Care

This study reports on results of a national survey conducted in the United States about the attitudes, perceptions and utilization of evidence-based practices (EBPs) in residential care settings. Seventy-five of 118 member agencies (63.6% response rate) of a voluntary national residential care association responded to a web-administered structured survey, which included the Evidence-Based Practices Attitude Scale (Aarons, 2004). Results show overwhelmingly positive attitudes toward EBPs. Concerns were reported mainly with regard to cost and impeding a client-driven practice approach. The study also showed a high degree of utilization of EBPs with over 88 percent of programs reporting the use of at least one practice they considered to be evidence-based. Altogether 53 different practices were reported although it is unknown at this point whether practices were delivered with fidelity. Behaviorally-based and trauma-focused interventions constituted the most common interventions used by residential care agencies. Practices were subsequently validated against four national clearinghouse sites, indicating that only slightly over half of all reported practices had been evaluated by at least one clearinghouse and rated as having some research evidence for effectiveness. Divergent views about what practices are evidence-based point to the need for continued discussion between the practice and research fields about conceptualizations of evidence.