The IAPSRS toolkit: development, utility, and relation to other performance measurement systems. Members of the IAPSRS Research Committee. International Association of Psychological Rehabilitation Services

Peer specialists deliver cognitive behavioral social skills training compared to social skills training and treatment as usual to veterans with serious mental illness: study protocol for a randomized controlled trial

BACKGROUND

Serious mental illness (SMI) affects 4.6% of the American population. While treatments are available, adherence to specific regimens is often suboptimal. Multiple organizations, such as the Substance Abuse and Mental Health Services Administration (SAMHSA), have called for more options that improve accessibility and engagement to treatment among individuals with SMI. This study protocol answers such calls by testing the effectiveness of peer specialists-individuals with SMI trained to use their experience to help others with SMI-in delivering social skills training (SST) and cognitive behavioral social skills training (CBSST), evidence-based treatments effective at engaging individuals with SMI to make behavioral and cognitive changes. Peer specialists have been shown to be adept at engaging those with SMI in treatment; however, their ability to deliver these structured treatments is unknown.

METHODS

This study is a randomized, hybrid 1, research assistant-blinded, superiority trial. A total of 252 veterans with SMI will be recruited and randomized to one of three arms: CBSST-Peer vs. SST-Peer vs. treatment as usual. Participants randomized to CBSST-Peer or SST-Peer will participate in a 20-week group-based intervention that meets weekly for a 60-min class. All participants will complete 4 study assessments at baseline, 10 weeks, 20 weeks, and 32 weeks. A multidimensional battery of functional outcomes will be used with the Independent Living Skills Survey (ILSS) as the primary outcome measure. Post-study completion, veterans who participated in the CBSST-Peer or SST-Peer arms will randomly be invited to participate in focus groups, and peer specialists will complete interviews to further assess the effectiveness of each intervention.

DISCUSSION

Improving care and outcomes for individuals with SMI is a national priority. To improve care, it is imperative to think about new ways to improve engagement and accessibility to care. This study provides an innovative solution to this problem by evaluating how two different types of treatment, delivered by peer specialists, compare to usual care. The results of the study will allow for the expansion of treatment options that improve access and engagement among veterans with SMI.

Reducing negative symptoms in schizophrenia: Feasibility and acceptability of a combined cognitive-behavioral social skills training and compensatory cognitive training intervention

The current study examined the feasibility and acceptability of an integrated Cognitive-Behavioral Social Skills Training and Compensatory Cognitive Training (CBSST-CCT) intervention compared with Goal-Focused Supportive Contact (SC) in a pilot randomized controlled trial for people with schizophrenia with high negative symptom severity. The sample included 55 participants from five community settings; masters-level study clinicians delivered interventions on-site. Participants completed assessments of cognitive, functional, and psychiatric symptoms at baseline, mid-treatment, post-treatment (12.5 weeks), and 6-month follow-up. Enrollment goals were not initially met, necessitating the addition of a fifth site; however, all groups and assessments were completed on-site. Study procedures were acceptable, as evidenced by 100% enrollment and completion of baseline assessments following informed consent; however, over 1/3rd of participants dropped out. No modifications were necessary to the intervention procedures and CBSST-CCT fidelity ratings were acceptable. The intervention was deemed acceptable among participants who attended ≥1 session, as evidenced by similar attendance rates in CBSST-CCT compared to SC. Among CBSST-CCT participants, lower positive symptoms were significantly associated with better attendance. Overall, we found mixed evidence for the feasibility and acceptability of the CBSST-CCT protocol in people with schizophrenia with high negative symptoms. Challenges are highlighted and recommendations for future investigations are provided.

Narrative development and supported employment of persons with severe mental illness

Background: While the relationship between objective recovery and work among persons with severe mental illness (SMI) is well-established, few studies have examined the link between subjective recovery and employment.Aims: The study investigated the prospective relationship between narrative development at the start of supported employment (SE) and positive work outcomes.Methods: The authors employed a time-limited, mixed-method longitudinal design to examine the relationship between the baseline narrative development of 38 SE participants with SMI and employment outcomes eight months later, as well as whether narratives evolved over the course of the study.Results: While narrative development was unrelated to work for the 59% of participants who were employed at the end of the study, unemployed individuals showed more developed baseline narratives overall, as well as enriched baseline emotional connectedness and social worth. Higher emotional connectedness at the start of SE programs was predictive of fewer hours worked eight months later, controlling for executive functioning, negative symptoms and self-esteem. Although workers showed no narrative changes over time, those without work demonstrated increased agency over the eight months of the study.Conclusion: Further research is warranted to clarify the relationship between richer personal narratives and unemployment.

Randomized clinical trial of cognitive behavioral social skills training for schizophrenia: improvement in functioning and experiential negative symptoms

OBJECTIVE

Identifying treatments to improve functioning and reduce negative symptoms in consumers with schizophrenia is of high public health significance.

METHOD

In this randomized clinical trial, participants with schizophrenia or schizoaffective disorder (N = 149) were randomly assigned to cognitive behavioral social skills training (CBSST) or an active goal-focused supportive contact (GFSC) control condition. CBSST combined cognitive behavior therapy with social skills training and problem-solving training to improve functioning and negative symptoms. GFSC was weekly supportive group therapy focused on setting and achieving functioning goals. Blind raters assessed functioning (primary outcome: Independent Living Skills Survey [ILSS]), CBSST skill knowledge, positive and negative symptoms, depression, and defeatist performance attitudes.

RESULTS

In mixed-effects regression models in intent-to-treat analyses, CBSST skill knowledge, functioning, amotivation/asociality negative symptoms, and defeatist performance attitudes improved significantly more in CBSST relative to GFSC. In both treatment groups, comparable improvements were also found for positive symptoms and a performance-based measure of social competence.

CONCLUSIONS

The results suggest CBSST is an effective treatment to improve functioning and experiential negative symptoms in consumers with schizophrenia, and both CBSST and supportive group therapy actively focused on setting and achieving functioning goals can improve social competence and reduce positive symptoms.

Empirical testing of criteria for dissociative schizophrenia

This study examined the validity of dissociative schizophrenia diagnostic criteria. In the first phase, 50 participants with a psychotic disorder were administered the Dissociative Experiences Scale and the Childhood Trauma Questionnaire to identify those with dissociative characteristics. In the second phase, we selected those who had a score of 15 or above on the Dissociative Experiences Scale. Fifteen of these participants were evaluated thoroughly with the Structured Clinical Interview for DSM-IV Axis I, Structured Clinical Interview for DSM-IV Axis II, and Structured Clinical Interview for DSM-IV Dissociative Disorders to determine whether they met the criteria for dissociative schizophrenia and to generate a clinical description. Our results indicated that 24% of the individuals we tested met these criteria. We propose making mandatory 1 of the 3 dissociative symptoms of the criteria to eliminate people with only nonspecific symptoms (e.g., extensive comorbidity). According to this modified criterion, 14% of our sample would receive a diagnosis of dissociative schizophrenia. However, a more comprehensive look at the clinical picture begs the question of whether dissociative schizophrenia is truly present in every person meeting the criteria. We discuss the relevance of creating a new schizophrenia subtype and offer recommendations for clinicians.

Implementing and Evaluating Goal Setting in a Statewide Psychiatric Rehabilitation Program

Although the idea of people with psychiatric disabilities determining their own treatment and rehabilitation goals is increasingly accepted, its relationship to service outcomes has rarely been evaluated programmatically. A statewide, Medicaid-funded psychiatric rehabilitation program incorporated a systematic goal setting procedure conducted by practitioners trained in helping people set their own individual rehabilitation goals. Individuals who successfully set either residential or employment goals were followed for up to 18 months to assess progress on these goals. Participants were grouped by type of goal (residential or employment) and by level of participation in the intervention (enrolled, completed 18 months, or graduated). Residential functioning for those who set residential goals increased significantly, independent of level of participation. For people who had set employment goals, only graduates of the intervention showed significant employment gains. Furthermore, employment functioning changed significantly when a goal was set in the residential area; in contrast, residential functioning did not change significantly when goals were set in the employment area. This study suggests that the programmatic effect of goal setting procedures can be evaluated, even when the person’s goals are tailored to an individual’s unique preference. Implications for rehabilitation counseling will be discussed.

Training to recognise the early signs of recurrence in schizophrenia

BACKGROUND

Schizophrenia has a lifetime prevalence of less than one per cent. Studies have indicated that early symptoms that are idiosyncratic to the person with schizophrenia (early warning signs) often precede acute psychotic relapse. Early warning signs interventions propose that learning to detect and manage early warning signs of impending relapse might prevent or delay acute psychotic relapse.

OBJECTIVES

To compare the effectiveness of early warning signs interventions plus treatment as usual involving and not involving a psychological therapy on time to relapse, hospitalisation, functioning, negative and positive symptomatology.

SEARCH METHODS

Search databases included the Cochrane Schizophrenia Group Trials Register (July 2007 and May 2012) which is based on regular searches of BIOSIS, CENTRAL, CINAHL, EMBASE, MEDLINE and PsycINFO. References of all identified studies were reviewed for inclusion. We inspected the UK National Research Registe and contacted relevant pharmaceutical companies and authors of trials for additional information.

SELECTION CRITERIA

We included all randomised clinical trials (RCTs) comparing early warning signs interventions plus treatment as usual to treatment as usual for people with schizophrenia or other non-affective psychosis

DATA COLLECTION AND ANALYSIS

We assessed included studies for quality and extracted data. If more than 50% of participants were lost to follow-up, the study was excluded. For binary outcomes, we calculated standard estimates of risk ratio (RR) and the corresponding 95% confidence intervals (CI), for continuous outcomes, we calculated mean differences (MD) with standard errors estimated, and for time to event outcomes we calculated Cox proportional hazards ratios (HRs) and associated 95 % CI. We assessed risk of bias for included studies and assessed overall study quality using the GRADE approach.

MAIN RESULTS

Thirty-two RCTs and two cluster-RCTs that randomised 3554 people satisfied criteria for inclusion. Only one study examined the effects of early warning signs interventions without additional psychological interventions, and many of the outcomes for this review were not reported or poorly-reported. Significantly fewer people relapsed with early warning signs interventions than with usual care (23% versus 43%; RR 0.53, 95% CI 0.36 to 0.79; 15 RCTs, 1502 participants; very low quality evidence). Time to relapse did not significantly differ between intervention groups (6 RCTs, 550 participants; very low quality evidence). Risk of re-hospitalisation was significantly lower with early warning signs interventions compared to usual care (19% versus 39%; RR 0.48, 95% CI 0.35 to 0.66; 15 RCTS, 1457 participants; very low quality evidence). Time to re-hospitalisation did not significantly differ between intervention groups (6 RCTs; 1149 participants; very low quality evidence). Participants' satisfaction with care and economic costs were inconclusive because of a lack of evidence.

AUTHORS' CONCLUSIONS

This review indicates that early warning signs interventions may have a positive effect on the proportions of people re-hospitalised and on rates of relapse, but not on time to recurrence. However, the overall quality of the evidence was very low, indicating that we do not know if early warning signs interventions will have similar effects outside trials and that it is very likely that further research will alter these estimates. Moreover, the early warning signs interventions were used along side other psychological interventions, and we do not know if they would be effective on their own. They may be cost-effective due to reduced hospitalisation and relapse rates, but before mental health services consider routinely providing psychological interventions involving the early recognition and prompt management of early warning signs to adults with schizophrenia, further research is required to provide evidence of high or moderate quality regarding the efficacy of early warning signs interventions added to usual care without additional psychological interventions, or to clarify the kinds of additional psychological interventions that might aid its efficacy. Future RCTs should be adequately-powered, and designed to minimise the risk of bias and be transparently reported. They should also systematically evaluate resource costs and resource use, alongside efficacy outcomes and other outcomes that are important to people with serious mental illness and their carers.

Statewide initiative of intensive psychiatric rehabilitation: outcomes and relationship to other mental health service use

OBJECTIVE

This study examines the outcomes of a statewide implementation of Intensive Psychiatric Rehabilitation (IPR) for improving residential and employment status and earnings among individuals with severe mental illnesses and also examines its implementation with respect to mental health service utilization and costs.

METHODS

This study employs a pre-post design with participants acting as their own controls for rehabilitation outcomes (residential status, vocational outcomes and earnings) comparing those who "completed" or had a sufficiently intense dose of IPR (one year) to those who dropped out early (before six months of service) and those who dropped out later in service (6-12 months). A separate analysis was conducted examining the relationship of IPR to other mental service use and costs using a quasi-experimental design that contrasted IPR completers with a control group matched via propensity scores.

RESULTS

The results suggested significant improvement in residential status, employment status and gross monthly earnings for IPR completers relative to other groups. IPR completers also tended to use more mental health services or have more shallow decreases in use and cost of services relative to matched controls.

CONCLUSIONS AND IMPLICATIONS FOR PRACTICE

Gains in rehabilitation outcomes can be expected for those who engage in and complete IPR services, but IPR cannot be expected to result in reduced overall mental health service use and costs. Rather, IPR may improve service access or perhaps ameliorate any containment effect of managed care on service use.

Results of an innovative university-based recovery education program for adults with psychiatric disabilities

This study examined the effectiveness of an educational approach to psychiatric rehabilitation called the Recovery Center. Using a quasi-experimental design we recruited 97 intervention and 81 comparison participants and examined the intervention's impact on health, mental health, subjective, and role functioning outcomes. Results suggested that this intervention was effective in improving subjective outcomes, especially empowerment and recovery attitudes, both of which received primary emphasis in the intervention. The Recovery Center, which integrates a bio-psychosocial framework with psycho-educational interventions shows promise as a complement to traditional mental health services in developing readiness for rehabilitation and promoting recovery among individuals with severe psychiatric disabilities.

Assessment of community functioning in people with schizophrenia and other severe mental illnesses: a white paper based on an NIMH-sponsored workshop

People with schizophrenia frequently have significant problems in community functioning. Progress in developing effective interventions to ameliorate these problems has been slowed by the absence of reliable and valid measures that are suitable for use in clinical trials. The National Institute of Mental Health convened a workgroup in September 2005 to examine this issue and make recommendations to the field that would foster research in this area. This article reports on issues raised at the meeting. Many instruments have been developed to assess community functioning, but overall insufficient attention has been paid to psychometric issues and many instruments are not suitable for use in clinical trials. Consumer self-report, informant report, ratings by clinicians and trained raters, and behavioral assessment all can provide useful and valid information in some circumstances and may be practical for use in clinical trials. However, insufficient attention has been paid to when and how different forms of assessment and sources of information are useful or how to understand inconsistencies. A major limiting factor in development of reliable and valid instruments is failure to develop a suitable model of functioning and its primary mediators and moderators. Several examples that can guide thinking are presented. Finally, the field is limited by the absence of an objective gold standard of community functioning. Hence, outcomes must be evaluated in part by "clinical significance." This criterion is problematic because different observers and constituencies often have different opinions about what types of change are clinically important and how much change is significant.

Applicability of a toolkit for geriatric rehabilitation outcomes

PURPOSE

To field test the applicability of a multidimensional toolkit for geriatric rehabilitation outcomes which includes nine standardized tools. Applicability is defined as context- and population-specific pragmatic qualities of an assessment tool such as respondent and examiner burden, score distribution and format compatibility.

METHOD

A sample of 48 older adults representing four diagnostic groups, as well as 26 caregivers, were assessed at home in the first month after discharge from intensive rehabilitation (T1) and 2 months later (T2). Pre-determined qualitative and quantitative applicability criteria were coded and compared at T1 and T2, as well as responsiveness.

RESULTS

A higher respondent burden was found for three self-report tools, as well as a ceiling effect on social functioning tools. Respondent burden, examiner burden and score distribution remained stable or diminished at T2. Format compatibility deteriorated only for the mobility test due to a higher proportion of non ambulatory participants (17%). Low to moderate associations between the tools corroborated that they were not redundant (rPearson <or= 0.77). Responsiveness estimates confirmed that mean scores were stable between T1 and T2.

CONCLUSION

Overall, the toolkit was found to be applicable at home after geriatric rehabilitation. Modifications are proposed to further improve its applicability. This study highlighted practical aspects that could alleviate the burden on research participants and facilitate the use of those tools for community follow-up for clinical and research purposes.

Making it better: building evaluation capacity in community mental health

This paper describes a province-wide initiative aimed at building the capacity of community mental health programs to participate in program evaluation and development by transferring knowledge, promoting discussion and developing resources. Active involvement of stakeholders and evaluation of the current capacity of the field informed the ongoing development of the initiative. Recovery served as a guiding framework for formulating and understanding community mental health outcomes. Despite the interest of the field in evaluation activities, programs were constrained by limited resources and accountability structures. Sustainability of the project would be enhanced by direct work with programs to facilitate application of Continuous Improvement.