Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study

A National Snapshot of Training and Technical Assistance Needs Within the Mental Health Workforce

OBJECTIVE

This report summarizes results from a national survey that aimed to assess the training and technical assistance needs of individuals who work in mental health.

METHODS

A survey was distributed to mental health workers by 10 regional centers of a large, nationwide, federally funded training and technical assistance network during January-October 2021.

RESULTS

A total of 2,321 individuals from 58 states and territories responded to the survey. The three training and technical assistance needs they indicated most frequently were equitable and culturally responsive services, co-occurring mental and substance use disorders, and mental health awareness and literacy.

CONCLUSIONS

The survey findings reflect the continued need to address inequities in mental health services, particularly for communities of color. In addition, a cluster of topics (i.e., mental health awareness and literacy, trauma-informed care, crisis services, grief, and provider well-being) stemmed from the COVID-19 pandemic and its effects on the nation's mental health.

Postcrisis Follow-Up and Linkage to Community Services

During the postcrisis period, many individuals struggle to transition to available care, often falling through the cracks. This article discusses effective postcrisis approaches that provide rapid access to transitional team-based care using critical time intervention strategies. It also highlights the development of state, county, and funder models for "care-traffic control" to ensure swift linkage to follow-up services, along with new funding models that support intensive community crisis stabilization during the postcrisis period. Emerging crisis systems can leverage these emerging services and approaches to facilitate successful transitions for individuals in need.

Fidelity and Clinical Competence in Providing Illness Management and Recovery: An Explorative Study

Illness Management and Recovery (IMR) is a psychosocial intervention supporting people with serious mental illnesses. In this study, 15 IMR groups were assessed for fidelity and clinician competency to establish the implementation level of all IMR elements and explore complementarity of the IMR Treatment Integrity Scale (IT-IS) to the standard IMR Fidelity Scale. Use of the IT-IS was adapted, similar to the IMR Fidelity Scale. Descriptive statistics were applied. Implementation success of IMR elements varied widely on the IMR Fidelity Scale and IT-IS (M = 3.94, SD = 1.13, and M = 3.29, SD = 1.05, respectively). Twelve IMR elements (60%) were well-implemented, whereas eight (40%) were implemented insufficiently, including some critical cognitive-behavioral techniques (e.g., role-playing). The scales appeared largely complementary, though strongly correlated (r (13) = 0.74, p = 0.002). Providing all IMR elements adequately requires a variety of clinical skills. Specific additional training and supervision may be necessary.

Implementation of early intervention clinical services within the National Health System in Italy: Third wave survey with focus on structures, resources, and fidelity to the evidence-based model

BACKGROUND

Early intervention in psychosis (EIP) is a well-established approach aimed at detecting and treating early signs and symptoms of psychosis to prevent its long-term consequences. The present study aimed at detailing the current status of EIP services in Italy, covering all the Departments of Mental Health (DMHs) operating in 2018.

METHODS

All directors of public DMHs operating in Italy in 2018 (n = 127) were invited to fill in a Census form about EIP structure and activities. The first episode psychosis services fidelity scale (FEPS-FS) was used to investigate fidelity to the EIP model of the centre.

RESULTS

An active EIP service was reported by 41 DMHs (32% of the total DMHs; 56% of those who took part in the survey). Most EIP services had an autonomous team. The large majority of the Italian EIP centres provided psychosocial interventions to their patients, principally psychotherapy, family support, and psychoeducation. Among those with an active EIP, 29 DMHs filled in the FEPS-FS. Internal consistency was good when based on the replies of the respondents, but reliability was weak when measured on the basis of an independent evaluation (Cohen's kappa = 0.571). The fidelity to the guidelines for early intervention was uneven, with some criteria met by most centres, especially those peculiar to the Italian community psychiatry.

CONCLUSION

A further spreading of the early intervention model across the Italian DMHs was found. A lack of resources might limit the use of specific psychosocial treatments, such as cognitive-behavioural therapy or manualized family support.

Psychiatric Boarding in Emergency Departments and the COVID-19 First Wave: The New Hampshire Response

The COVID-19 pandemic forced unprecedented challenges for emergency department operations during the spring of 2020. Before the COVID-19 pandemic, psychiatric boarding in emergency departments required a substantial amount of staffing and administrative resources. This case study describes one state's efforts to rapidly decrease psychiatric boarding by 93% in 2 weeks with a multipronged approach, and simultaneously minimal effects observed on outcome measures of psychiatric hospital readmissions and suicide rates. Lessons learned are discussed regarding workflow adaptations and leadership implications.

Exploring the Association between Individual-Level Attributes and Fidelity to a Vocational Rehabilitation Intervention within a Randomised Controlled Trial

Understanding what attributes or characteristics of those delivering interventions affect intervention fidelity and patient outcomes is important for contextualising intervention effectiveness. It may also inform implementation of interventions in future research and clinical practice. This study aimed to explore the relationships between attributes of Occupational Therapists (OTs), their faithful delivery of an early stroke specialist vocational rehabilitation intervention (ESSVR), and stroke survivor return-to-work (RTW) outcomes. Thirty-nine OTs were surveyed about their experience and knowledge of stroke and vocational rehabilitation and were trained to deliver ESSVR. ESSVR was delivered across 16 sites in England and Wales between February 2018 and November 2021. OTs received monthly mentoring to support ESSVR delivery. The amount of mentoring each OT received was recorded in OT mentoring records. Fidelity was assessed using an intervention component checklist completed using retrospective case review of one randomly selected participant per OT. Linear and logistic regression analyses explored relationships between OT attributes, fidelity, and stroke survivor RTW outcome. Fidelity scores ranged from 30.8 to 100% (Mean: 78.8%, SD: 19.2%). Only OT engagement in mentoring was significantly associated with fidelity (b = 0.29, 95% CI = 0.05-0.53, p < 0.05). Increased fidelity (OR = 1.06, 95% CI = 1.01-1.1, p = 0.01) and increasing years of stroke rehabilitation experience (OR = 1.17, 95% CI = 1.02-1.35) was significantly associated with positive stroke survivor RTW outcomes. Findings of this study suggest that mentoring OTs may increase fidelity of delivery of ESSVR, which may also be associated with positive stroke survivor return-to-work outcomes. The results also suggest that OTs with more experience of stroke rehabilitation may be able to support stroke survivors to RTW more effectively. Upskilling OTs to deliver complex interventions, such as ESSVR, in clinical trials may require mentoring support in addition to training to ensure fidelity.

Substance use outcomes among individuals with severe mental illnesses receiving assertive community treatment: A systematic review

Assertive Community Treatment (ACT) is a multidisciplinary treatment approach to support people with severe mental illnesses (SMI) in their recovery. While the majority of ACT recipients report co-morbid substance use issues, limited reviews have evaluated the impact of receiving ACT services on substance use outcomes. The purpose of this systematic review was to evaluate the impact of ACT involvement on substance use outcomes among people with SMI. A systematic literature search was conducted including articles published prior to April 2021. Twenty-nine studies were included in this review. Of them, 15 studies implemented a controlled design (six studies demonstrated high quality) and 14 studies implemented a cohort design. From a synthesis of the reviewed studies, five areas of changes associated with substance use emerged including reduced alcohol and drug use severity, lower prevalence of alcohol and drug use, increased stage of change in substance use treatment, and fewer days of hospitalization and intoxication. Thus, future studies should examine the integration of substance use treatment services as part of ACT interventions for opportunities to enhance recovery outcomes among individuals with SMI.

An observational comparison of FACT and ACT in the Netherlands and the US

Assertive Community Treatment (ACT) is a well-defined service delivery model for the care and treatment of the most severely mentally ill in the community with American origins. The Dutch have adapted the model in order to accommodate a broader range of needs and allow more flexible implementation. Functional Assertive Community Treatment (FACT) provides the intensity of care needed to help participants sustain life in the community as well as continuity of care over time for many vulnerable client populations.

Essential Elements of Forensic Assertive Community Treatment

LEARNING OBJECTIVE

After participating in this activity, learners should be better able to:• Assess characteristics of forensic assertive community treatment programs.

ABSTRACT

Forensic assertive community treatment (FACT) has emerged internationally as an intervention strategy for people with serious mental disorders who are involved with the criminal justice system. Studies to date have shown marked variability, however, in FACT program design and operation. Based upon a literature review and relevant experience, the authors present their perspective on the essential elements of FACT. Given that FACT is an adaptation of the evidence-based assertive community treatment (ACT) model, it is recommended that FACT programs maintain a high-fidelity ACT component. FACT programs should also have both mental health and criminal justice admission criteria because service recipients are involved in both service systems. For optimal effectiveness, FACT team clinicians must partner with criminal justice agencies that provide community-based supervision to their patients. Prospective FACT enrollees should receive a clear explanation of the program, including how their respective mental health and criminal justice service providers will work collaboratively with them to prevent incarceration. FACT programs should also use risk/need assessment to inform treatment planning, evidence-based mental health and community correctional practices to promote both wellness and public safety, and shared training to promote effective collaboration. Additional elements to consider include housing, medical care, and transitional services. These elements are presented and discussed, including a rationale and evidence to support each component. The article concludes with introduction of a FACT fidelity scale, the Rochester Forensic Assertive Community Treatment Scale (R-FACTS). By operationalizing essential FACT elements, the R-FACTS is designed to support FACT program development, implementation, and dissemination in a more consistent and measurable manner.

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians' willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

Effects of Illness Management and Recovery: A Multicenter Randomized Controlled Trial

There have been inconsistent findings in the literature with respect to the efficacy of Illness Management and Recovery (IMR) in the psychosocial treatment of people with schizophrenia or other severe mental illnesses. This study aimed to comprehensively investigate the effectiveness of IMR, including the impact of completion and fidelity. In this randomized controlled trial (RCT), 187 outpatients received either IMR plus care as usual (CAU) or only CAU. Multilevel modeling was implemented to investigate group differences over an 18-month period, comprising 12 months of treatment and six months of follow-up. The primary outcome was overall illness management, which was assessed using the client version of the IMR scale. Secondary outcomes included measures regarding illness management, clinical, personal, and functional recovery, and hospitalizations. The interviewers were blinded to group allocation. This clinical trial was registered with the Netherlands Trial Register (NL4931, NTR5033). Patients who received IMR showed statistically significant improvement in self-reported overall illness management (the primary outcome). Moreover, they showed an improvement in self-esteem, which is a component of personal recovery. There were no effects within the other questionnaires. There were also no statistically significant between-group differences in terms of hospitalizations. Patients in both groups showed statistically significant improvement in clinician-rated overall illness management, social support, clinical and functional recovery, and self-stigma over time. IMR completion was associated with stronger effects. High IMR fidelity was associated with self-esteem. This study confirms the efficacy of IMR in overall illness self-management. To our knowledge, this is the first RCT on IMR to explore the impact of fidelity on treatment efficacy. Future studies should further establish efficacy in personal recovery. To improve efficacy, it appears important to promote IMR completion and fidelity.

The Family Psychoeducation Fidelity Scale: Psychometric Properties

This study examined psychometric properties and feasibility of the Family Psychoeducation (FPE) Fidelity Scale. Fidelity assessors conducted reviews using the FPE fidelity scale four times over 18 months at five sites in Norway. After completing fidelity reviews, assessors rated feasibility of the fidelity review process. The FPE fidelity scale showed excellent interrater reliability (.99), interrater item agreement (88%), and internal consistency (mean = .84 across four time points). By the 18-month follow-up, all five sites increased fidelity and three reached adequate fidelity. Fidelity assessors rated feasibility as excellent. The FPE fidelity scale has good psychometric properties and is feasible for evaluating the implementation of FPE programs. Trial registration ClinicalTrials.gov Identifier: NCT03271242.

Investigating the critical elements and psychosocial outcomes of Youth Flexible Assertive Community Treatment: a study protocol for an observational prospective cohort study

INTRODUCTION

When adolescents experience complex psychiatric and social problems, numerous healthcare services usually become involved. In these cases, fragmentation of care services is a risk that often results in both ineffective care and in patients disengaging from care services. To address these issues, Youth Flexible Assertive Community Treatment (Youth Flexible ACT) was developed in the Netherlands. This client-centred service delivery model aims to tackle the fragmented care system by providing psychiatric treatment and support in a flexible and integrated manner. While Youth Flexible ACT is gaining in popularity, the effectiveness of the care model remains largely unexamined.

METHODS AND ANALYSIS

Here, we present an observational prospective cohort (2017-2021) in which a broad range of treatment outcomes will be monitored. The primary aim of the study is to examine change in treatment outcomes over the course of the Flexible ACT care. The secondary aim is to examine the association between (elements of) Youth Flexible ACT model fidelity and treatment outcomes. An estimated total number of 200 adolescents who receive care from one of the 16 participating Youth Flexible ACT teams will be included in the study. Participants will be asked to complete assessments at four time points in 6-month intervals, resulting in a study duration of 18 months. Latent growth curve analysis will be conducted to examine change in psychosocial functioning over time and its relation to model fidelity.

ETHICS AND DISSEMINATION

This study received ethical approval from Trimbos Ethics Committee (201607_75-FACT2). This approval applies for all participating institutions. The results of the study will be reported in accordance with the Strengthening the Reporting of Observational Studies in Epidemiology statement. Results will be disseminated via peer-reviewed academic journals and presentations at conferences. In addition, results will be made available for participating sites, funders and researchers.

Alcohol Use Disorder and Schizophrenia or Schizoaffective Disorder

Schizophrenia and schizoaffective disorder are schizophrenia spectrum disorders that cause significant disability. Among individuals who have schizophrenia or schizoaffective disorder, alcohol use disorder (AUD) is common, and it contributes to worse outcomes than for those who do not have co-occurring substance use disorder. Common neurobiological mechanisms, including dysfunction in brain reward circuitry, may explain the high rates of co-occurrence of schizophrenia and AUD or other substance use disorders. Optimal treatment combines pharmacologic intervention and other therapeutic modalities to address both the psychotic disorder and AUD. Further research on the etiology of these co-occurring disorders and on treatment of affected individuals is needed.

Psychosocial interventions for people with both severe mental illness and substance misuse

BACKGROUND

Even low levels of substance misuse by people with a severe mental illness can have detrimental effects.

OBJECTIVES

To assess the effects of psychosocial interventions for reduction in substance use in people with a serious mental illness compared with standard care.

SEARCH METHODS

The Information Specialist of the Cochrane Schizophrenia Group (CSG) searched the CSG Trials Register (2 May 2018), which is based on regular searches of major medical and scientific databases.

SELECTION CRITERIA

We included all randomised controlled trials (RCTs) comparing psychosocial interventions for substance misuse with standard care in people with serious mental illness.

DATA COLLECTION AND ANALYSIS

Review authors independently selected studies, extracted data and appraised study quality. For binary outcomes, we calculated standard estimates of risk ratio (RR) and their 95% confidence intervals (CIs) on an intention-to-treat basis. For continuous outcomes, we calculated the mean difference (MD) between groups. Where meta-analyses were possible, we pooled data using a random-effects model. Using the GRADE approach, we identified seven patient-centred outcomes and assessed the quality of evidence for these within each comparison.

MAIN RESULTS

Our review now includes 41 trials with a total of 4024 participants. We have identified nine comparisons within the included trials and present a summary of our main findings for seven of these below. We were unable to summarise many findings due to skewed data or because trials did not measure the outcome of interest. In general, evidence was rated as low- or very-low quality due to high or unclear risks of bias because of poor trial methods, or inadequately reported methods, and imprecision due to small sample sizes, low event rates and wide confidence intervals. 1. Integrated models of care versus standard care (36 months) No clear differences were found between treatment groups for loss to treatment (RR 1.09, 95% CI 0.82 to 1.45; participants = 603; studies = 3; low-quality evidence), death (RR 1.18, 95% CI 0.39 to 3.57; participants = 421; studies = 2; low-quality evidence), alcohol use (RR 1.15, 95% CI 0.84 to 1.56; participants = 143; studies = 1; low-quality evidence), substance use (drug) (RR 0.89, 95% CI 0.63 to 1.25; participants = 85; studies = 1; low-quality evidence), global assessment of functioning (GAF) scores (MD 0.40, 95% CI -2.47 to 3.27; participants = 170; studies = 1; low-quality evidence), or general life satisfaction (QOLI) scores (MD 0.10, 95% CI -0.18 to 0.38; participants = 373; studies = 2; moderate-quality evidence). 2. Non-integrated models of care versus standard care There was no clear difference between treatment groups for numbers lost to treatment at 12 months (RR 1.21, 95% CI 0.73 to 1.99; participants = 134; studies = 3; very low-quality evidence). 3. Cognitive behavioural therapy (CBT) versus standard care There was no clear difference between treatment groups for numbers lost to treatment at three months (RR 1.12, 95% CI 0.44 to 2.86; participants = 152; studies = 2; low-quality evidence), cannabis use at six months (RR 1.30, 95% CI 0.79 to 2.15; participants = 47; studies = 1; very low-quality evidence) or mental state insight (IS) scores by three months (MD 0.52, 95% CI -0.78 to 1.82; participants = 105; studies = 1; low-quality evidence). 4. Contingency management versus standard care We found no clear differences between treatment groups for numbers lost to treatment at three months (RR 1.55, 95% CI 1.13 to 2.11; participants = 255; studies = 2; moderate-quality evidence), number of stimulant positive urine tests at six months (RR 0.83, 95% CI 0.65 to 1.06; participants = 176; studies = 1) or hospitalisations (RR 0.21, 95% CI 0.05 to 0.93; participants = 176; studies = 1); both low-quality evidence. 5. Motivational interviewing (MI) versus standard care We found no clear differences between treatment groups for numbers lost to treatment at six months (RR 1.71, 95% CI 0.63 to 4.64; participants = 62; studies = 1). A clear difference, favouring MI, was observed for abstaining from alcohol (RR 0.36, 95% CI 0.17 to 0.75; participants = 28; studies = 1) but not other substances (MD -0.07, 95% CI -0.56 to 0.42; participants = 89; studies = 1), and no differences were observed in mental state general severity (SCL-90-R) scores (MD -0.19, 95% CI -0.59 to 0.21; participants = 30; studies = 1). All very low-quality evidence. 6. Skills training versus standard care At 12 months, there were no clear differences between treatment groups for numbers lost to treatment (RR 1.42, 95% CI 0.20 to 10.10; participants = 122; studies = 3) or death (RR 0.15, 95% CI 0.02 to 1.42; participants = 121; studies = 1). Very low-quality, and low-quality evidence, respectively. 7. CBT + MI versus standard care At 12 months, there was no clear difference between treatment groups for numbers lost to treatment (RR 0.99, 95% CI 0.62 to 1.59; participants = 327; studies = 1; low-quality evidence), number of deaths (RR 0.60, 95% CI 0.20 to 1.76; participants = 603; studies = 4; low-quality evidence), relapse (RR 0.50, 95% CI 0.24 to 1.04; participants = 36; studies = 1; very low-quality evidence), or GAF scores (MD 1.24, 95% CI -1.86 to 4.34; participants = 445; studies = 4; very low-quality evidence). There was also no clear difference in reduction of drug use by six months (MD 0.19, 95% CI -0.22 to 0.60; participants = 119; studies = 1; low-quality evidence).

AUTHORS' CONCLUSIONS

We included 41 RCTs but were unable to use much data for analyses. There is currently no high-quality evidence to support any one psychosocial treatment over standard care for important outcomes such as remaining in treatment, reduction in substance use or improving mental or global state in people with serious mental illnesses and substance misuse. Furthermore, methodological difficulties exist which hinder pooling and interpreting results. Further high-quality trials are required which address these concerns and improve the evidence in this important area.

Assessing the Fidelity of Evidence-Based Practices: History and Current Status of a Standardized Measurement Methodology

Evidence-based practices are effective only when implemented faithfully. This paper explicates the history, standardization, and methods for developing and validating measures of fidelity. We overviewed the past 20 years of developing fidelity measures, summarized standardization of the development procedures, and described needed psychometric assessments. Fidelity assessment has become the sine qua non of implementation, technical assistance, and research on evidence-based practices. Researchers have established standardized procedures for scale development and psychometric testing. Widescale use of fidelity measurement remains challenging. The implementation of evidence-based practice and the development and validation of fidelity measures are interdependent. International improvements of mental health care will require attention to both.

A site visit protocol for assessing recovery promotion at the program level: An example from the Veterans Health Administration

OBJECTIVE

A site visit protocol was developed to assess recovery promotion in the organizational climate and culture of programs for veterans with serious mental illnesses.

METHOD

The protocol was pilot-tested in 4 programs: 2 that had scored high on the pilot version of a staff survey measure of program-level recovery promotion and 2 that had scored low. Two-person teams conducted onsite visits and assigned global and organizational domain ratings. Interrater agreement was assessed by examining adjacent agreement and computing weighted kappa.

RESULTS

The on-site protocol had good interrater agreement and discriminated between sites that scored high and low on the staff survey.

CONCLUSIONS AND IMPLICATIONS FOR PRACTICE

This site visit protocol and procedure shows promise for evaluating recovery promotion in milieu-based programs. After further refinement of this tool, adaptations could be developed for accreditation protocols or for program self-assessment and quality improvement efforts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Predictive Associations Among the Repeated Measurements of Anxiety, Depression, and Craving in a Dual Diagnosis Program

Objective: Anxiety and depression commonly co-occur with substance use disorders. Conceptual models would presume that changes in anxiety and depression should lead to changes in drug and alcohol craving during treatment for co-occurring disorders, but no longitudinal investigation has explored this assumption. This study examined the associations among craving, anxiety, and depression in a dual diagnosis program. Methods: In all, 93 adult patients at a community-based dual diagnosis program for substance use disorders and comorbid anxiety and mood disorders provided daily ratings of anxiety and depression. We examined whether these ratings predicted changes in craving and vice versa. Results: Using hierarchical linear modeling to examine day-to-day change over time, we observed that anxiety and depression ratings uniquely and independently predicted subsequent craving ratings, and craving ratings also predicted subsequent anxiety and depression ratings. Conclusions: These preliminary findings support mutual maintenance models of substance use and psychiatric comorbidity, thus providing preliminary support for integrated programs that simultaneously address both problems. Implications and future directions are discussed.

Distribution and Correlates of Assertive Community Treatment (ACT) and ACT-Like Programs: Results From the 2015 N-MHSS

OBJECTIVE

The study examined the availability and characteristics of assertive community treatment (ACT) programs across mental health treatment facilities in the United States.

METHODS

Prevalence and correlates of facilities that reported offering ACT, broadly defined as intensive community services for serious mental illness provided by multidisciplinary teams in the clients' natural settings and including both ACT and "ACT-like" programs, were examined by using data from the National Mental Health Services Survey. Availability of services essential to the ACT model in these facilities was also examined.

RESULTS

Of the 12,826 surveyed facilities, 13.4% reported offering ACT, with significant variability among states. Of the facilities with ACT, 19.2% reported offering all core ACT services. Few facilities offered peer support, employment, and housing services. Compared with programs at facilities that did not offer all core ACT services, facilities with ACT programs that offered these services had higher odds of being publicly owned (odds ratio [OR]=2.12, 95% confidence interval [CI]=1.64-2.74) and of receiving federal (OR=3.60, CI=2.17-5.98) or grant funding (OR=1.87, CI=1.45-2.41). Facilities with ACT that offered all core services also had higher odds of offering other services important to individuals with serious mental disorders.

CONCLUSIONS

Substantial differences existed in availability of ACT and ACT-like programs among states, with evidence of a large unmet need overall, even when a very broad and inclusive definition of ACT was used. Few ACT programs offered all core services. Legislative, administrative, and funding differences may explain some of the variability.

Implementation and fidelity assessment of the NAVIGATE treatment program for first episode psychosis in a multi-site study

The NAVIGATE program was developed for the Recovery After Initial Schizophrenia Episode-Early Treatment Program (RAISE-ETP) study, which compared NAVIGATE to usual Community Care in a cluster randomized design involving 34 sites and 404 patients. This article describes the approach to training and implementing the NAVIGATE program at the 17 sites (including 134 practitioners) randomized to provide it, and to evaluating the fidelity of service delivery to the NAVIGATE model. Fidelity was evaluated to five different components of the program, all of which were standardized in manuals in advance of implementation. The components included four interventions (Individualized Resiliency Training, Family Education Program, Supported Employment and Education, Personalized Medication Management) and the overall organization (staffing and structure) of the NAVIGATE team. Most of the sites demonstrated acceptable or higher levels of fidelity in their implementation of the four interventions and the organization of the program, with all 17 sites demonstrating at least acceptable overall fidelity to the NAVIGATE program. The results indicate that the NAVIGATE program can be implemented with good fidelity to the treatment model in a diverse array of community mental health care settings serving persons with a first episode psychosis.

Relationship Between Self-Assessed Fidelity and Self-Reported Employment in the Individual Placement and Support Model of Supported Employment

OBJECTIVE

A growing body of literature demonstrates that high-fidelity implementation of the individual placement and support (IPS) model of supported employment increases the chances of achieving desired outcomes. This study examined the relationship between IPS fidelity, as self-reported by program sites, and employment outcomes and determined whether this relationship was maintained over time.

METHODS

A total of 78 outpatient programs in New York State provided data on self-reported IPS fidelity and employment outcomes. Pearson correlations were used to determine the relationship between fidelity scores and competitive employment rates. A mixed-effects model examined the relationship between repeated fidelity and employment measures over time.

RESULTS

A significant positive relationship was found between better self-reported IPS fidelity and greater employment. The relationship between IPS fidelity and employment was sustained over time (up to one year).

CONCLUSIONS

Higher-fidelity implementation of the IPS model, as self-assessed by program sites, was associated with higher employment rates, which were sustained over time.

The Efficacy of an American Indian Culturally-Based Risk Prevention Program for Upper Elementary School Youth Residing on the Northern Plains Reservations

Culturally-based risk behavior prevention programs for American Indian elementary school children are sparse. Thus a group of American Indian educators collaborated in the creation of a program that helps children make healthy decisions based on their cultural and traditional value system. In this paper the effectiveness of Lakota Circles of Hope (LCH), an elementary school culturally-based prevention program was studied and evaluated. Three cohorts of fourth and fifth graders participated in a mixed methods quasi-experimental evaluative research design that included focus groups and surveys prior to and following the intervention. Five research questions regarding the program's impact on students' self-esteem and self-efficacy, Lakota identity, communication, conflict resolution and risk behaviors were addressed in this study. Participants were compared to non-participants in three American Indian reservation school sites. Educators completed a survey to record their observations and feedback regarding the implementation of the program within their respective school sites. The study provides preliminary evidence that, when delivered with fidelity, LCH contributes to statistically significant changes in risk behaviors, Lakota identity, respect for others, and adult and parent communication. A two-way multivariate analysis of variance with post hoc analysis of data collected from the LCH participants (N = 1392) were used to substantiate a significant increase in respect for others and a decrease in risk behaviors which included alcohol, tobacco, and substance use at the 0.10 alpha level. Significant positive improvements in parent and adult communication and an increased Lakota identity at the 0.01 alpha level were obtained. There were no significant differences in self-esteem and conflict resolution from pre to post intervention and in comparison with non LCH participating students.

Critical Time Intervention for People Leaving Shelters in the Netherlands: Assessing Fidelity and Exploring Facilitators and Barriers

International dissemination of evidence-based interventions calls for rigorous evaluation. As part of an evaluation of critical time intervention (CTI) for homeless people and abused women leaving Dutch shelters, this study assessed fidelity in two service delivery systems and explored factors influencing model adherence. Data collection entailed chart review (n = 70) and two focus groups with CTI workers (n = 11). The intervention obtained an overall score of three out of five (fairly implemented) for compliance fidelity and chart quality combined. Fidelity did not differ significantly between service systems, supporting its suitability for a range of populations. The eight themes that emerged from the focus groups as affecting model adherence provide guidance for future implementation efforts.

The effectiveness of critical time intervention for abused women leaving women's shelters: a randomized controlled trial

Objectives

To examine the effectiveness of critical time intervention (CTI)—an evidence-based intervention—for abused women transitioning from women’s shelters to community living.

Methods

A randomized controlled trial was conducted in nine women’s shelters across the Netherlands. 136 women were assigned to CTI (n = 70) or care-as-usual (n = 66). Data were analyzed using intention-to-treat three-level mixed-effects models.

Results

Women in the CTI group had significant fewer symptoms of post-traumatic stress (secondary outcome) (adjusted mean difference − 7.27, 95% CI − 14.31 to − 0.22) and a significant fourfold reduction in unmet care needs (intermediate outcome) (95% CI 0.06–0.94) compared to women in the care-as-usual group. No differences were found for quality of life (primary outcome), re-abuse, symptoms of depression, psychological distress, self-esteem (secondary outcomes), family support, and social support (intermediate outcomes).

Conclusions

This study shows that CTI is effective in a population of abused women in terms of a reduction of post-traumatic stress symptoms and unmet care needs. Because follow-up ended after the prescribed intervention period, further research is needed to determine the full long-term effects of CTI in this population.

Electronic supplementary material

The online version of this article (10.1007/s00038-017-1067-1) contains supplementary material, which is available to authorized users.

Dual diagnosis: management within a psychosocial context

Recent developments in UK government policy have highlighted the unmet needs of people with dual diagnosis (comorbidity of substance misuse and psychiatric disorder, particularly severe mental illness). Advances in assessment techniques and diagnostic practice have informed the treatment of comorbidity and improved its outcome. There is growing evidence for the effectiveness of psychosocial interventions such as motivational interviewing and cognitive–behavioural therapy, mostly from US studies. However, within the secondary care provided by addiction and general psychiatric services there are serious implementation barriers related to service organisation, staffing levels, training and – most importantly – the difficulties of engaging people with severe mental illness and comorbid substance misuse in treatment. The evidence for the effectiveness of psychosocial treatments and models of service is reviewed and challenges for optimal practice in the UK are highlighted.

The effect of youth assertive community treatment: a systematic PRISMA review

BACKGROUND

During the past decades deinstitutionalisation policies have led to a transition from inpatient towards community mental health care. Many European countries implement Assertive Community Treatment (ACT) as an alternative for inpatient care for "difficult to reach" children and adolescents with severe mental illness. ACT is a well-organized low-threshold treatment modality; patients are actively approached in their own environment, and efforts are undertaken to strengthen the patient's motivation for treatment. The assumption is that ACT may help to avoid psychiatric hospital admissions, enhance cost-effectiveness, stimulate social participation and support, and reduce stigma. ACT has been extensively investigated in adults with severe mental illness and various reviews support its effectiveness in this patient group. However, to date there is no review available regarding the effectiveness of youth-ACT. It is unknown whether youth-ACT is as effective as it is in adults. This review aims to assess the effects of youth-ACT on severity of psychiatric symptoms, general functioning, and psychiatric hospital admissions.

METHOD

A systematic literature search was conducted in PubMed, Cochrane Library, PsychINFO and CINAHL published up to March 2017. To assess methodological quality of the included studies, the Oxford Centre of Evidence-Based Medicine grading system was used.

RESULTS

Thirteen studies were included in this review. There are indications that youth-ACT is effective in reducing severity of psychiatric symptoms, improving general functioning, and reducing duration and frequency of psychiatric hospital admissions.

CONCLUSIONS

The current literature on youth-ACT is limited but promising. There are indications that youth-ACT is effective in reducing severity of psychiatric symptoms, improving general functioning, and reducing duration and frequency of psychiatric hospital admissions. The effect of youth-ACT may be comparable with the effect of ACT in adults. Similar as in adult ACT, the studies on youth-ACT found effects that vary from small to large. Randomized experimental research designs are needed to further corroborate effectiveness.

Integrated Dual Disorder Treatment Implementation in a Large State Sample

Individuals with co-occurring illnesses are at risk for poor outcomes related to criminal justice, hospitalization, housing, and employment. High fidelity evidence-based models, including integrated dual disorder treatment (IDDT), are associated with significant outcome improvements. A descriptive analysis of secondary datasets including the full sample of IDDT fidelity reviews completed from 2006 to 2012 in one state was completed. Total IDDT fidelity significantly improved from baseline fidelity review (68) to second review (40) [t(38) = 35.00, p < .001], and from second review to third review (13) [t(12) = 22.60, p < .001], with adequate inner-rater reliability by the second review. Individual items that were lower across reviews included practice penetration and family interventions, and higher individual items included multi-disciplinary team, integrated treatment specialist, and time-unlimited services, and treatment measures are higher than organizational measures in baseline and subsequent reviews. In this large state-wide sample, IDDT took time to implement, and improved fidelity occurred from baseline to third review, and variance between components of the practice was significant.

Intensive case management for severe mental illness

BACKGROUND

Intensive Case Management (ICM) is a community-based package of care aiming to provide long-term care for severely mentally ill people who do not require immediate admission. Intensive Case Management evolved from two original community models of care, Assertive Community Treatment (ACT) and Case Management (CM), where ICM emphasises the importance of small caseload (fewer than 20) and high-intensity input.

OBJECTIVES

To assess the effects of ICM as a means of caring for severely mentally ill people in the community in comparison with non-ICM (caseload greater than 20) and with standard community care. We did not distinguish between models of ICM. In addition, to assess whether the effect of ICM on hospitalisation (mean number of days per month in hospital) is influenced by the intervention's fidelity to the ACT model and by the rate of hospital use in the setting where the trial was conducted (baseline level of hospital use).

SEARCH METHODS

We searched the Cochrane Schizophrenia Group's Trials Register (last update search 10 April 2015).

SELECTION CRITERIA

All relevant randomised clinical trials focusing on people with severe mental illness, aged 18 to 65 years and treated in the community care setting, where ICM is compared to non-ICM or standard care.

DATA COLLECTION AND ANALYSIS

At least two review authors independently selected trials, assessed quality, and extracted data. For binary outcomes, we calculated risk ratio (RR) and its 95% confidence interval (CI), on an intention-to-treat basis. For continuous data, we estimated mean difference (MD) between groups and its 95% CI. We employed a random-effects model for analyses.We performed a random-effects meta-regression analysis to examine the association of the intervention's fidelity to the ACT model and the rate of hospital use in the setting where the trial was conducted with the treatment effect. We assessed overall quality for clinically important outcomes using the GRADE approach and investigated possible risk of bias within included trials.

MAIN RESULTS

The 2016 update included two more studies (n = 196) and more publications with additional data for four already included studies. The updated review therefore includes 7524 participants from 40 randomised controlled trials (RCTs). We found data relevant to two comparisons: ICM versus standard care, and ICM versus non-ICM. The majority of studies had a high risk of selective reporting. No studies provided data for relapse or important improvement in mental state.1. ICM versus standard careWhen ICM was compared with standard care for the outcome service use, ICM slightly reduced the number of days in hospital per month (n = 3595, 24 RCTs, MD -0.86, 95% CI -1.37 to -0.34,low-quality evidence). Similarly, for the outcome global state, ICM reduced the number of people leaving the trial early (n = 1798, 13 RCTs, RR 0.68, 95% CI 0.58 to 0.79, low-quality evidence). For the outcome adverse events, the evidence showed that ICM may make little or no difference in reducing death by suicide (n = 1456, 9 RCTs, RR 0.68, 95% CI 0.31 to 1.51, low-quality evidence). In addition, for the outcome social functioning, there was uncertainty about the effect of ICM on unemployment due to very low-quality evidence (n = 1129, 4 RCTs, RR 0.70, 95% CI 0.49 to 1.0, very low-quality evidence).2. ICM versus non-ICMWhen ICM was compared with non-ICM for the outcome service use, there was moderate-quality evidence that ICM probably makes little or no difference in the average number of days in hospital per month (n = 2220, 21 RCTs, MD -0.08, 95% CI -0.37 to 0.21, moderate-quality evidence) or in the average number of admissions (n = 678, 1 RCT, MD -0.18, 95% CI -0.41 to 0.05, moderate-quality evidence) compared to non-ICM. Similarly, the results showed that ICM may reduce the number of participants leaving the intervention early (n = 1970, 7 RCTs, RR 0.70, 95% CI 0.52 to 0.95,low-quality evidence) and that ICM may make little or no difference in reducing death by suicide (n = 1152, 3 RCTs, RR 0.88, 95% CI 0.27 to 2.84, low-quality evidence). Finally, for the outcome social functioning, there was uncertainty about the effect of ICM on unemployment as compared to non-ICM (n = 73, 1 RCT, RR 1.46, 95% CI 0.45 to 4.74, very low-quality evidence).3. Fidelity to ACTWithin the meta-regression we found that i.) the more ICM is adherent to the ACT model, the better it is at decreasing time in hospital ('organisation fidelity' variable coefficient -0.36, 95% CI -0.66 to -0.07); and ii.) the higher the baseline hospital use in the population, the better ICM is at decreasing time in hospital ('baseline hospital use' variable coefficient -0.20, 95% CI -0.32 to -0.10). Combining both these variables within the model, 'organisation fidelity' is no longer significant, but the 'baseline hospital use' result still significantly influences time in hospital (regression coefficient -0.18, 95% CI -0.29 to -0.07, P = 0.0027).

AUTHORS' CONCLUSIONS

Based on very low- to moderate-quality evidence, ICM is effective in ameliorating many outcomes relevant to people with severe mental illness. Compared to standard care, ICM may reduce hospitalisation and increase retention in care. It also globally improved social functioning, although ICM's effect on mental state and quality of life remains unclear. Intensive Case Management is at least valuable to people with severe mental illnesses in the subgroup of those with a high level of hospitalisation (about four days per month in past two years). Intensive Case Management models with high fidelity to the original team organisation of ACT model were more effective at reducing time in hospital.However, it is unclear what overall gain ICM provides on top of a less formal non-ICM approach.We do not think that more trials comparing current ICM with standard care or non-ICM are justified, however we currently know of no review comparing non-ICM with standard care, and this should be undertaken.

Effectiveness of wraparound versus case management for children and adolescents: results of a randomized study

In this study, we compared service experiences and outcomes for youths with serious emotional disorder (SED) randomly assigned to care coordination via a defined wraparound process (n = 47) versus more traditional intensive case management (ICM; n = 46) The wraparound group received more mean hours of care management and services; however, there ultimately were no group differences in restrictiveness of residential placement, emotional and behavioral symptoms, or functioning. Wraparound implementation fidelity was found to be poor. Organizational culture and climate, and worker morale, were poorer for the wraparound providers than the ICM group. Results suggest that, for less-impaired youths with SED, less intensive options such as ICM may be equally effective to poor-quality wraparound delivered in the absence of wraparound implementation supports and favorable system conditions.

Illness Management & Recovery (IMR) in the Netherlands; a naturalistic pilot study to explore the feasibility of a randomized controlled trial

BACKGROUND

Illness Management & Recovery (IMR) is a curriculum-based program for people with severe and persistent mental illness. To date, four randomized controlled trials (RCTs) have been published on it. As these produced mixed results, we conducted a pilot study to test the feasibility of conducting a new RCT in a Dutch psychiatric institute. Because our primary objective was to evaluate support for implementing IMR on a broader scale, we examined participant recruitment, client outcomes, and clients' and clinicians' satisfaction. Secondary objectives were to evaluate fidelity, trainers' training and supervision, and to explore program duration, dropout, and client characteristics related to dropout. For reporting, we used the checklist for pilot studies adopted from the CONSORT Statement.

METHODS

This program evaluation included a process-evaluation and an outcome evaluation with a One Group Pre-Posttest Design (N = 81). Interviews and internal reports were used to monitor participant numbers, program duration, dropout, and completers' characteristics. Clients' and clinicians' satisfaction and provision of trainers' training and supervision were assessed through interviews. Fidelity was assessed on the IMR Fidelity Scale; client outcomes were assessed on the IMR scale (client and clinician versions) and the Recovery Markers Questionnaire (RMQ).

RESULTS

Eighty-one participants were recruited of 167 people who were assessed for eligibility. Completers and clinicians were satisfied, and scores for completers improved significantly on the IMR scale (clinician version) (d = 0.84) and RMQ (d = 0.52), and not significantly on the IMR scale client version (d = 0.41). Mean fidelity was good, but three groups had only moderate fidelity. Our feasibility criterion for trainers' education and supervision was partly attained. Dropout from treatment was 51 %; female participants and people who scored higher on both IMR-scales at baseline had a significantly lower chance of dropping out. The duration of IMR varied (M = 12.7 months, SD = 2.87).

CONCLUSIONS

Results suggested that feasibility of conducting an RCT on IMR was good. Special attention is required to fidelity, IMR duration, trainers' education and supervision, and dropout, especially of men. One study limitation was our inability to conduct follow-up measurements of non-completers.

Occupational Therapy and Evidence-Based Practice in Mental Health

Evidence-based practice (EBP) represents a paradigm shift in health care. This review has two aims. The first is to consider the merits of EBP, especially in respect of its use in mental health settings. The second is both to identify psychosocial interventions that have an established evidence base for effectiveness and to provide an analysis of the quality of this evidence and its implications for occupational therapy. Supported employment, family psychoeducation, assertive case management and integrated substance use treatment are examined in detail.

It is proposed that occupational therapists working in mental health give priority to psychosocial interventions that are based on evidence and incorporate these into their practice. It is further proposed that, in implementing EBP, practitioners take an active evaluating position in relation to published evidence, paying particular attention to the evidence of effectiveness in equivalent clinical environments.

Assertive community treatment and associations with delinquency

This article draws on a prospective longitudinal study in which Assertive Community Treatment (ACT) model fidelity and patient outcomes were assessed in twenty outpatient treatment teams. 530 severely mentally ill patients participated in the study. Delinquency outcomes were assessed three times during a two-year follow-up period. At baseline, 49% of the patients had a recent criminal history, meaning that they had at least one reported contact with the police and/or the justice system in the past year. Patients with a recent criminal history had more serious psychosocial problems at baseline compared to those without a recent criminal history. Delinquency outcomes showed improvement over time, but this was not associated with ACT model fidelity. The study shows an association for homelessness and criminal activity. The persistent criminal activities of some of the patients showed that for this group extra interventions are needed that specifically target reduction of criminal behavior.

Psychosocial interventions for cannabis use disorder

BACKGROUND

Cannabis use disorder is the most commonly reported illegal substance use disorder in the general population; although demand for assistance from health services is increasing internationally, only a minority of those with the disorder seek professional assistance. Treatment studies have been published, but pressure to establish public policy requires an updated systematic review of cannabis-specific treatments for adults.

OBJECTIVES

To evaluate the efficacy of psychosocial interventions for cannabis use disorder (compared with inactive control and/or alternative treatment) delivered to adults in an out-patient or community setting.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL; 2015, Issue 6), MEDLINE, EMBASE, PsycINFO, the Cumulaive Index to Nursing and Allied Health Literature (CINAHL) and reference lists of articles. Searched literature included all articles published before July 2015.

SELECTION CRITERIA

All randomised controlled studies examining a psychosocial intervention for cannabis use disorder (without pharmacological intervention) in comparison with a minimal or inactive treatment control or alternative combinations of psychosocial interventions.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures as expected by The Cochrane Collaboration.

MAIN RESULTS

We included 23 randomised controlled trials involving 4045 participants. A total of 15 studies took place in the United States, two in Australia, two in Germany and one each in Switzerland, Canada, Brazil and Ireland. Investigators delivered treatments over approximately seven sessions (range, one to 14) for approximately 12 weeks (range, one to 56).Overall, risk of bias across studies was moderate, that is, no trial was at high risk of selection bias, attrition bias or reporting bias. Further, trials included a large total number of participants, and each trial ensured the fidelity of treatments provided. In contrast, because of the nature of the interventions provided, participant blinding was not possible, and reports of researcher blinding often were unclear or were not provided. Half of the reviewed studies included collateral verification or urinalysis to confirm self report data, leading to concern about performance and detection bias. Finally, concerns of other bias were based on relatively consistent lack of assessment of non-cannabis substance use or use of additional treatments before or during the trial period.A subset of studies provided sufficient detail for comparison of effects of any intervention versus inactive control on primary outcomes of interest at early follow-up (median, four months). Results showed moderate-quality evidence that approximately seven out of 10 intervention participants completed treatment as intended (effect size (ES) 0.71, 95% confidence interval (CI) 0.63 to 0.78, 11 studies, 1424 participants), and that those receiving psychosocial intervention used cannabis on fewer days compared with those given inactive control (mean difference (MD) 5.67, 95% CI 3.08 to 8.26, six studies, 1144 participants). In addition, low-quality evidence revealed that those receiving intervention were more likely to report point-prevalence abstinence (risk ratio (RR) 2.55, 95% CI 1.34 to 4.83, six studies, 1166 participants) and reported fewer symptoms of dependence (standardised mean difference (SMD) 4.15, 95% CI 1.67 to 6.63, four studies, 889 participants) and cannabis-related problems compared with those given inactive control (SMD 3.34, 95% CI 1.26 to 5.42, six studies, 2202 participants). Finally, very low-quality evidence indicated that those receiving intervention reported using fewer joints per day compared with those given inactive control (SMD 3.55, 95% CI 2.51 to 4.59, eight studies, 1600 participants). Notably, subgroup analyses found that interventions of more than four sessions delivered over longer than one month (high intensity) produced consistently improved outcomes (particularly in terms of cannabis use frequency and severity of dependence) in the short term as compared with low-intensity interventions.The most consistent evidence supports the use of cognitive-behavioural therapy (CBT), motivational enhancement therapy (MET) and particularly their combination for assisting with reduction of cannabis use frequency at early follow-up (MET: MD 4.45, 95% CI 1.90 to 7.00, four studies, 612 participants; CBT: MD 10.94, 95% CI 7.44 to 14.44, one study, 134 participants; MET + CBT: MD 7.38, 95% CI 3.18 to 11.57, three studies, 398 participants) and severity of dependence (MET: SMD 4.07, 95% CI 1.97 to 6.17, two studies, 316 participants; MET + CBT: SMD 7.89, 95% CI 0.93 to 14.85, three studies, 573 participants), although no particular intervention was consistently effective at nine-month follow-up or later. In addition, data from five out of six studies supported the utility of adding voucher-based incentives for cannabis-negative urines to enhance treatment effect on cannabis use frequency. A single study found contrasting results throughout a 12-month follow-up period, as post-treatment outcomes related to overall reduction in cannabis use frequency favoured CBT alone without the addition of abstinence-based or treatment adherence-based contingency management. In contrast, evidence of drug counselling, social support, relapse prevention and mindfulness meditation was weak because identified studies were few, information on treatment outcomes insufficient and rates of treatment adherence low. In line with treatments for other substance use, abstinence rates were relatively low overall, with approximately one-quarter of participants abstinent at final follow-up. Finally, three studies found that intervention was comparable with treatment as usual among participants in psychiatric clinics and reported no between-group differences in any of the included outcomes.

AUTHORS' CONCLUSIONS

Included studies were heterogeneous in many aspects, and important questions regarding the most effective duration, intensity and type of intervention were raised and partially resolved. Generalisability of findings was unclear, most notably because of the limited number of localities and homogeneous samples of treatment seekers. The rate of abstinence was low and unstable although comparable with treatments for other substance use. Psychosocial intervention was shown, in comparison with minimal treatment controls, to reduce frequency of use and severity of dependence in a fairly durable manner, at least in the short term. Among the included intervention types, an intensive intervention provided over more than four sessions based on the combination of MET and CBT with abstinence-based incentives was most consistently supported for treatment of cannabis use disorder.

The CORE Service Improvement Programme for mental health crisis resolution teams: study protocol for a cluster-randomised controlled trial

BACKGROUND

As an alternative to hospital admission, crisis resolution teams (CRTs) provide intensive home treatment to people experiencing mental health crises. Trial evidence supports the effectiveness of the CRT model, but research suggests that the anticipated reductions in inpatient admissions and increased user satisfaction with acute care have been less than hoped for following the scaling up of CRTs nationally in England, as mandated by the National Health Service (NHS) Plan in 2000. The organisation and service delivery of the CRTs vary substantially. This may reflect the lack of a fully specified CRT model and the resources to enhance team model fidelity and to improve service quality. We will evaluate the impact of a CRT service improvement programme over a 1-year period on the service users' experiences of care, service use, staff well-being, and team model fidelity.

METHODS/DESIGN

Twenty-five CRTs from eight NHS Trusts across England will be recruited to this cluster-randomised trial: 15 CRTs will be randomised to receive the service improvement programme over a 1-year period, and ten CRTs will not receive the programme. Data will be collected from 15 service users and all clinical staff from each participating CRT at baseline and at the end of the intervention. Service use data will be collected from the services' electronic records systems for two 6-month periods: the period preceding and the period during months 7-12 of the intervention. The study's primary outcome is service user satisfaction with CRT care, measured using a client satisfaction questionnaire. Secondary outcomes include the following: perceived continuity of care, hospital admission rates and bed use, rates of readmission to acute care following CRT support, staff morale, job satisfaction, and general health. The adherence of the services to a model of best practice will be assessed at baseline and follow-up. Outcomes will be compared between the intervention and control teams, adjusting for baseline differences and participant characteristics using linear random effects modelling. Qualitative investigations with participating CRT managers and staff and programme facilitators will explore the experiences of the service improvement programme.

DISCUSSION

Our trial will show whether a theoretically underpinned and clearly defined package of resources are effective in supporting service improvement and improving outcomes for mental health crisis resolution teams.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN47185233.

Development and Pilot Evaluation of a Tablet-Based Application to Improve Quality of Care in Child Mental Health Treatment

Background

Children need access to high quality mental health care. Effective treatments now exist for a wide range of mental health conditions. However, these interventions are delivered with variable effectiveness in traditional mental health service settings. Innovative solutions are needed to improve treatment delivery quality and effectiveness.

Objective

The aim of this study was to develop a scalable, sustainable technology-based approach to improve the quality of care in child mental health treatment.

Methods

A tablet-based resource was developed with input from mental health training experts, mental health providers, and patients. A series of qualitative data collection phases (ie, expert interviews, patient and provider focus groups, usability testing) guided the initial concept and design of the resource, and then its refinement. The result was an iPad-based “e-workbook” designed to improve child engagement and provider fidelity in implementation of a best-practice treatment. We are currently conducting a small scale randomized controlled trial to evaluate the feasibility of e-workbook facilitated child mental health treatment with 10 providers and 20 families recruited from 4 local community-based mental health clinics.

Results

Usability and focus group testing yielded a number of strong, favorable reactions from providers and families. Recommendations for refining the e-workbook also were provided, and these guided several improvements to the resource prior to initiating the feasibility trial, which is currently underway.

Conclusions

This study aimed to develop and preliminarily evaluate a tablet-based application to improve provider fidelity and child engagement in child mental health treatment. If successful, this approach may serve as a key step toward making best-practice treatment more accessible to children and families. As various technologies continue to increase in popularity worldwide and within the health care field more specifically, it is essential to rigorously test the usability, feasibility, acceptability, and effectiveness of novel health technology solutions. It is also essential to ensure that patients and providers drive decision making that supports the development of these resources to ensure that they can be seamlessly integrated into practice.

Trial Registration

Clinicaltrials.gov NCT01915160; https://clinicaltrials.gov/ct2/show/NCT01915160 (Archived by WebCite at http://www.webcitation.org/6cPIiQDpu)

Development and Evaluation of a Fidelity Instrument for PEARLS

Purpose

This manuscript describes the development and the preliminary evaluation of a fidelity instrument for the Program for Encouraging Active and Rewarding Lives (PEARLS), an evidence-based depression care management (DCM) program. The objective of the study was to find an effective, practical, multidimensional approach to measure fidelity of PEARLS programs to the original, research-driven PEARLS protocol in order to inform program implementation at various settings nationwide.

Methods

We conducted key informant interviews with PEARLS stakeholders, and held focus groups with former PEARLS clients, to identify core program components. These components were then ranked using a Q-sort process, and incorporated into a brief instrument. We tested the instrument at two time points with PEARLS counselors, other DCM program counselors, and non-DCM program counselors (n = 56) in six states. Known-groups method was used to compare findings from PEARLS programs, other DCM programs, and non-DCM programs. We asked supervisors of the counselors to complete the fidelity instrument on behalf of their counselors to affirm the validity of the results. We examined the association of PEARLS program fidelity with individual client outcomes.

Results

Program for Encouraging Active and Rewarding Lives providers reported the highest fidelity scores compared to DCM program providers and non-DCM program providers. The sample size was too small to yield significant results on the comparison between counselor experience and fidelity. Scores varied between PEARLS counselors and their supervisors. PEARLS program fidelity was not significantly correlated with client outcomes, suggesting that other implementation factors may have influenced the outcomes and/or that the instrument needs refinement.

Conclusion

Our findings suggest that providers may be able to use the instrument to assess PEARLS program fidelity in various settings across the country. However, more rigorous research is needed to evaluate instrument effectiveness.

Engagement in assertive community treatment as experienced by recovering clients with severe mental illness and concurrent substance use

BACKGROUND

Clients with severe mental illness (SMI) who use substances are less engaged in treatment than those who do not use substances, and assertive community treatment (ACT) engages and retains clients with SMI and concurrent substance use at a higher rate compared with traditional treatment. This qualitative study aimed to explore the experiences of being recruited to, and remaining in, ACT among recovering clients diagnosed with SMI and concurrent substance use.

METHODS

Twenty semi-structured interviews were undertaken among 11 clients with SMI and concurrent substance use who were included in ACT teams. The inclusion criteria were SMI and concurrent substance use and improvement after a minimum of 12 months in treatment regarding one or several of the following parameters: quality of life, general functioning and substance use. Systematic text condensation was applied in the analyses.

RESULTS

The experiences of building trust through enduring involvement and receiving benefits were most important for the acceptance of ACT by clients. A feeling of exclusiveness, perceiving ACT as a safety net and the clients' own personal responsibility for taking part in the treatment were stated as the most important factors for remaining in treatment.

CONCLUSIONS

The implications of the results of the present study are that service providers have to prove that they can be trusted in the initial phase of the clients' contact with the team. The feeling by clients with SMI and concurrent substance use that service providers in ACT believe they can improve their client's quality of life, is of importance for feeling exclusive, having hope for the future and remaining in treatment.

Avaliando a fidelidade de intervenções psicossociais: uma revisão sistemática da literatura

Objetivo Intervenções psicossociais têm tido impacto positivo na vida das pessoas com transtorno mental grave, porém tais intervenções devem ser implementadas fielmente ao protocolo. A fidelidade refere-se à medida que uma intervenção adere ao modelo original e sua avaliação é essencial para que os desfechos possam ser creditados à intervenção. O objetivo deste estudo foi realizar uma revisão sistemática da literatura mundial das intervenções psicossociais destinadas a pacientes com transtornos mentais que possuem um instrumento ou método de avaliação de fidelidade ao modelo original. Métodos Pesquisas bibliográficas sistemáticas foram realizadas para encontrar estudos relevantes ao tema nas seguintes bases de dados: Embase, Medline, Scopus e SciELO. Foram incluídos estudos de intervenções psicossociais, realizados na comunidade, dirigidos a pacientes diagnosticados com transtornos mentais. Intervenções de comparação poderiam incluir tanto o tratamento-padrão como uma intervenção de comparação ativa. A qualidade dos estudos foi avaliada de forma independente por dois revisores, utilizando critérios adaptados de instrumentos validados. Resultados Trinta estudos preencheram os critérios de inclusão. Os estudos mostraram a eficácia da avaliação da fidelidade em diferenciar diferentes modelos de tratamento, sua validade preditiva para os desfechos e a confiabilidade dos instrumentos utilizados, bem como os fatores facilitadores e os obstáculos para a obtenção de alta fidelidade nas intervenções avaliadas. Conclusão Além de documentar a adesão ao modelo original, a fidelidade fornece informações relativas à população-alvo e aos desfechos esperados, o que contribui para que seja alcançada excelência no processo de implementação das intervenções psicossociais.

Que serait une oeuvre sans son cadre ?

Une réforme ne peut voir le jour et atteindre ses objectifs sans être soutenue de diverses façons. Au Québec, le Plan d’action en santé mentale 2005-2010 – La force des liens a introduit de nombreuses réformes de fond et de forme dans le réseau de services en santé mentale. Cet article voudra explorer quelles formes d’encadrement peuvent soutenir cette réforme et à quel point ces formes ont été exploitées ou devraient l’être. Il pourra ainsi soutenir la réflexion sur les moyens d’encadrement qu’il faudra utiliser pour soutenir le prochain plan d’action actuellement en rédaction au ministère de la Santé et des Services sociaux.

National trainers' perspectives on challenges to implementation of an empirically-supported mental health treatment

This study examined perceived challenges to implementation of an empirically supported mental health treatment for youth (Trauma-Focused Cognitive Behavioral Therapy; TF-CBT) and explored the potential use of technology-based resources in treatment delivery. Thematic interviews were conducted with 19 approved national TF-CBT trainers to assess their perspectives about challenges to implementation of TF-CBT and to explore their perceptions about the potential value of innovative, technology-based solutions to enhance provider fidelity and improve quality of care. These data offer some important insights and implications for training in evidence-based treatments, provider fidelity and competence, and patient engagement, particularly for those interventions targeting trauma-related symptoms among youth.

The Gloucester assertive community treatment team: A description and comparison with other services

Assertive Community Treatment (ACT) has developed globally as a model of community care for the severely mentally ill. However, in the United Kingdom there is mixed evidence regarding improvements in outcome and concerns about ACT teams having poor fidelity to the original ACT model.

Objective: This study presents the fidelity characteristics of an established ACT team serving Gloucester City. It describes service user demographic and illness data and compares these findings to other important studies in the United Kingdom.

Method: The Dartmouth Assertive Community Treatment Scale was applied to rate the Gloucester ACT team's fidelity characteristics. The Gloucester Caseload Project Demographic Pro-Forma was collected from all of the team's 79 service users.

Results: The population of severely mentally ill ACT service users in Gloucester City were an older and more “disabled” group compared to the classic ACT studies. Furthermore, although findings indicate a high level of fidelity to the original ACT model, the team it is still associated with high levels of inpatient treatment.

Conclusion: High fidelity ACT services appear to be associated with high admission rates. Therefore teams should not be viewed as alternatives to hospital admission but have goals of improving engagement and social functioning. Furthermore, findings have allowed the team to benchmark its service and target areas for further service development. More consistent reporting of fidelity data on ACT research would facilitate comparison across different services.

Assertive community treatment and associations with substance abuse problems

This study examined the associations between substance abuse problems in severely mentally ill patients, outcome and Assertive Community Treatment (ACT) model fidelity. In a prospective longitudinal study, ACT model fidelity and patient outcomes were assessed in 20 outpatient treatment teams using the Health of the Nation Outcome Scales, Camberwell Assessment of Needs short appraisal schedule and measures of service use. Five hundred and thirty severely mentally ill patients participated in the study. Substance abuse problems were assessed three times during a 2-year follow-up period. This study found that among patients with severe mental illness, patients with an addiction problem had more serious psychosocial problems at baseline. Substance abuse problems showed improvement over time, but this was not associated with ACT model fidelity. The study indicates that investment by teams to improve a patient's psychosocial situation can lead to improvements on substance problems.