Program fidelity in assertive community treatment: development and use of a measure

Intensive case management: a critical re-appraisal of the scientific evidence for effectiveness

Intensive Case Management (ICM) is widely claimed to be an evidence-based and cost effective program for people with high levels of disability as a result of mental illness. However, the findings of recent randomized controlled trials comparing ICM with 'usual services' suggest that both clinical and cost effectiveness of ICM may be weakening. Possible reasons for this, including fidelity of implementation, researcher allegiance effects and changes in the wider service environment within which ICM is provided, are considered. The implications for service delivery and research are discussed.

Dissemination of evidence-based mental health interventions: importance to the trauma field

Randomized controlled trials have established the efficacy of psychotherapy and medication treatments for posttraumatic stress disorder (PTSD). Despite these advancements, many individuals do not receive guideline-concordant PTSD care. In an effort to advance dissemination of evidence-based PTSD treatments, the authors review several examples of dissemination efforts of mental health interventions. The first examples describe the dissemination of multifaceted collaborative care interventions for patients with depressive disorders and evidence-based interventions for patients with severe mental illness. The final example explores evolving efforts to adapt and disseminate interventions to acutely injured trauma survivors. For each example, the authors describe the problem with prior clinical approaches, the program to be disseminated, the barriers and levers to implementation and the progress in overcoming these barriers.

Treating homeless clients with severe mental illness and substance use disorders: costs and outcomes

This study compared the costs and outcomes associated with three treatment programs that served 149 individuals with dual disorders (i.e., individuals with co-occurring severe mental illness and substance use disorders) who were homeless at baseline. The three treatment programs were: Integrated Assertive Community Treatment (IACT), Assertive Community Treatment only (ACTO), and standard care (Control). Participants were randomly assigned to treatment and followed for a period of 24 months. Clients in the IACT and ACTO programs were more satisfied with their treatment program and reported more days in stable housing than clients in the Control condition. There were no significant differences between treatment groups on psychiatric symptoms and substance use. The average total costs associated with the IACT and Control conditions were significantly less than the average total costs for the ACTO condition.

Ten-year recovery outcomes for clients with co-occurring schizophrenia and substance use disorders

The long-term courses of people with schizophrenia and of those with substance use disorder have been studied separately and extensively. The long-term course of clients with co-occurring schizophrenic and substance use disorders has, however, not been examined. This article reports 10-year outcomes for 130 clients with co-occurring schizophrenic and substance use disorders in the New Hampshire Dual Diagnosis Study. In addition, we report on 6 "recovery outcomes," identified by dual diagnosis clients, as examples of positive coping behaviors. Longitudinal data were modeled using generalized estimating equation (GEE) methods. Participants improved steadily over 10 years in the outcome domains of symptoms, substance abuse, institutionalization, functional status, and quality of life. Further, at the 10-year follow-up, substantial proportions were above cutoffs selected by dual diagnosis clients as indicators of recovery: 62.7% were controlling symptoms of schizophrenia; 62.5% were actively attaining remissions from substance abuse; 56.8% were in independent living situations; 41.4% were competitively employed; 48.9% had regular social contacts with non-substance abusers; and 58.3% expressed overall life satisfaction. These 6 outcomes were only weakly interrelated over time, suggesting that recovery, as defined by clients, is a multidimensional concept. Overall, the 10-year findings on recovery outcomes provide a hopeful long-term perspective for dual diagnosis clients.

The REACT study: randomised evaluation of assertive community treatment in north London

OBJECTIVE

To compare outcomes of care from assertive community treatment teams with care by community mental health teams for people with serious mental illnesses.

DESIGN

Non-blind randomised controlled trial.

SETTING

Two inner London boroughs.

PARTICIPANTS

251 men and women under the care of adult secondary mental health services with recent high use of inpatient care and difficulties engaging with community services.

INTERVENTIONS

Treatment from assertive community treatment team (127 participants) or continuation of care from community mental health team (124 participants).

MAIN OUTCOME MEASURES

Primary outcome was inpatient bed use 18 months after randomisation. Secondary outcomes included symptoms, social function, client satisfaction, and engagement with services.

RESULTS

No significant differences were found in inpatient bed use (median difference 1, 95% confidence interval -16 to 38) or in clinical or social outcomes for the two treatment groups. Clients who received care from the assertive community treatment team seemed better engaged (adapted homeless engagement acceptance schedule: difference in means 1.1, 1.0 to 1.9), and those who agreed to be interviewed were more satisfied with services (adapted client satisfaction questionnaire: difference in means 7.14, 0.9 to 13.4).

CONCLUSIONS

Community mental health teams are able to support people with serious mental illnesses as effectively as assertive community treatment teams, but assertive community treatment may be better at engaging clients and may lead to greater satisfaction with services.

Predictors of the working alliance in assertive community treatment

Past research has found that a positive working alliance between clients and their case managers is modestly correlated with client outcomes. The current study tried to identify the predictors of the working alliance in a sample of 115 clients who were receiving services from Assertive Community Treatment (ACT) teams. All of the clients suffered from severe mental illness, had a substance use disorder and were homeless at baseline. Both the client's rating and the case manager's rating of the working alliance were assessed at 3 months and 15 months post baseline. Client characteristics, particularly motivation to change, explained more of the variance of the client's rating of the alliance than treatment variables or client change on the outcome variables. On the other hand, treatment variables (e.g., the amount of transportation services provided) and client change on the outcome variables explained more of the variance of the case manager's rating of the alliance.

Effect of Social Security payments on substance abuse in a homeless mentally ill cohort

OBJECTIVES

To determine whether receipt of social supplemental security income (SSI) or Social Security disability income (SSDI) disability payments is associated with increased drug and alcohol use.

DATA SOURCES/STUDY SETTING

Secondary analysis of data from 6,199 participants in the Access to Community Care and Effective Social Supports and Services demonstration for the homeless mentally ill.

DESIGN

Observational, 12-month, cohort study completed over 4 years. Substance abuse and other outcomes were compared between the participants who did not receive SSI or SSDI during the 12-month study, those newly awarded benefits, and those without benefits throughout the 12 months.

DATA COLLECTION METHODS

Social Security administrative records were used to corroborate Social Security benefit status. Drug and alcohol use were measured by self-report and clinician ratings.

PRINCIPAL FINDINGS

Participants who did not receive benefits significantly reduced their substance use over time. In generalized estimating equations models that adjusted for potentially confounding covariates, participants who newly received Social Security benefits showed no greater drug use than those without benefits but had significantly more days housed and fewer days employed. Participants whose benefits antedated the demonstration and continued during the 12 months had more clinician-rated drug use over time than those without benefits.

CONCLUSIONS

In this vulnerable population, participants with newly awarded benefits did not have any different drug use changes than those without benefits, and had relatively more days housed. The hypothesis that Social Security benefits facilitate drug use was not supported by longitudinal data in this high-risk population.

Collaborative recovery: an integrative model for working with individuals who experience chronic and recurring mental illness

OBJECTIVES

Recovery is an emerging movement in mental health. Evidence for recovery-based approaches is not well developed and approaches to implement recovery-oriented services are not well articulated. The collaborative recovery model (CRM) is presented as a model that assists clinicians to use evidence-based skills with consumers, in a manner consistent with the recovery movement. A current 5 year multisite Australian study to evaluate the effectiveness of CRM is briefly described.

CONCLUSION

The collaborative recovery model puts into practice several aspects of policy regarding recovery-oriented services, using evidence-based practices to assist individuals who have chronic or recurring mental disorders (CRMD). It is argued that this model provides an integrative framework combining (i) evidence-based practice; (ii) manageable and modularized competencies relevant to case management and psychosocial rehabilitation contexts; and (iii) recognition of the subjective experiences of consumers.

Three-year recovery outcomes for long-term patients with co-occurring schizophrenic and substance use disorders

Little is known about the expected treatment outcomes of patients with co-occurring schizophrenic and substance use disorders. This paper reports 3-year outcomes for 152 patients with schizophrenia or schizoaffective disorder and substance use disorders, all of whom received integrated dual disorders treatments in the New Hampshire Dual Diagnosis Study. Outcomes are defined as positive coping behaviors identified by consumers as indicators of recovery. Participants improved steadily in terms of controlling symptoms of schizophrenia, actively attaining remissions from substance abuse, increasing competitive employment, increasing social contacts with non-substance abusers, and improving life satisfaction. Though successful in reducing hospitalization and homelessness, they did not increase time in independent living situations. Outcomes were only weakly interrelated, suggesting that recovery is a multidimensional concept. Neither psychotic diagnosis (schizophrenia vs. schizoaffective disorder) nor substance abuse diagnosis (alcohol vs. other drug disorder vs. both) was related to outcomes. However, these patients with co-occurring schizophrenic and substance use disorders did significantly less well than patients with co-occurring bipolar and substance use disorders in terms of hospitalization, independent living, and quality of life. Overall, the findings provide a hopeful long-term perspective for dual diagnosis patients.

Towards quality indicators for assertive outreach programmes for severely impaired substance abusers: concept mapping with Dutch experts

OBJECTIVE

We investigated the concept of 'quality of assertive outreach programmes for severely impaired substance abusers' with the aim of developing a conceptual framework as the basis for an assessment instrument.

DESIGN

We held a concept-mapping session with 13 experts in 2003. Fifty measurable elements of quality were mentioned and rated in terms of relative importance on a Likert-type response scale. Subsequently, the experts grouped the statements that were similar in content. The resulting concept map and additional interpretation made up the final quality framework. SETTING/STUDY PARTICIPANTS: Theoretical sampling was used to select Dutch managers, team leaders, and service providers from different assertive outreach delivery systems for substance abusers. Variation in both perspective and region was reflected in the sample.

RESULTS

Nine aspects of quality were formulated: preconditions for care, preconditions for service providers' work, relationship to regular care, service providers' activities and goals, service providers' skills, the role of repression, optimal care for the client, goals of assertive outreach, and nuisance reduction to society. Each aspect was presented using a selection of measurable elements.

CONCLUSIONS

According to the experts, optimal assertive outreach depends on a broad range of aspects that were later classified in three regions: structure, process, and outcomes. Saturation of the elements has not been proved so far. Nevertheless, it is promising that the framework's regions are supported by theory and that it is largely in accordance with clients' perspectives on assertive community treatment.

Impact of assertive community treatment and client characteristics on criminal justice outcomes in dual disorder homeless individuals

BACKGROUND

People with severe mental illness and substance use disorders (dual disorder) often have considerable contact with the criminal justice system.

AIMS

To test the effects of client characteristics on six criminal justice outcomes among homeless (at intake) people with mental illness and substance misuse disorders.

METHODS

The sample was of participants in a randomized controlled trial comparing standard treatment, assertive community treatment (ACT) and integrated treatment (IT). Data were analysed using hierarchical logistic regression.

RESULTS

Half the sample was arrested and a quarter incarcerated during the two-year follow-up period. The regression models explained between 22% and 35% of the variance of the following criminal justice measures: (1) major offences, (2) minor offences, (3) substance-use-related offences, (4) incarcerations, (5) arrests, and (6) summons. Prior criminal behaviour was the strongest predictor of all of the dependent variables; in general, demographic and diagnostic variables were not. Similarly, neither the type nor the amount of mental health treatment received predicted subsequent criminal behaviour.

CONCLUSION

Elsewhere the authors have shown that ACT and IT had advantages for health and stability of accommodation but these analyses suggest that more specialized interventions are needed to reduce criminal behaviour in dual disorder individuals.

Prediction of outcome from the Dartmouth assertive community treatment fidelity scale

BACKGROUND

Assertive community treatment (ACT) is an intensive and comprehensive treatment for clients with severe mental illness (SMI) who do not readily benefit from clinic-based services. Monitoring the implementation of such programs is critical, because better-implemented programs have been found to be effective in improving client outcomes.

OBJECTIVE

We tested the hypothesis that fidelity to the ACT model would be positively correlated with improved client outcomes, as measured by reduction in psychiatric hospital use.

METHODS

A scale measuring fidelity of program implementation, the Dartmouth ACT Scale, was examined in 10 newly formed ACT teams. Using the team as the unit of measure, the mean reduction in state hospital days for a 1-year period before and after program admission was calculated. Mean effect size in reduction in hospital days was used as the outcome measure in a correlational design.

RESULTS

Pre/post comparisons showed a 43 percent reduction in hospital days for 317 clients (t=8.61, P<.001). The Pearson correlation between DACTS fidelity and reduction of state hospital days was .49, P=.08, one-tailed.

CONCLUSION

Several possible reasons are offered for why the study hypothesis was not confirmed. However, even if predictive validity of the Dartmouth ACT Scale is limited, it continues to be a useful tool for program monitoring and for providing corrective feedback.

Implementing evidence-based psychosocial practices: lessons learned from statewide implementation of two practices

OBJECTIVE

As part of this national project, we examined barriers and strategies to implementation of two evidence-based practices (EBPs) in Indiana.

BACKGROUND

Despite many advances in the knowledge base regarding mental health treatment, the implementation of EBPs in real-world setting remains poorly understood. The National EBP Project is a multi-state study of factors influencing implementation of EBPs.

METHODS

Over a 15-month period we observed eight assertive community treatment (ACT) programs and six integrated dual disorders treatment (IDDT) programs and noted pertinent actions taken by the state mental health agency influencing implementation. We created a database containing summaries of monthly visits to each program and interviews with key leaders. Using this database and clinical impressions, we rated barriers and strategies at each site on seven factors: Attitudes, Mastery, Leadership, Staffing, Policies, Workflow, and Program Monitoring.

RESULTS

At the site level, the most frequently observed barriers were in the areas of leadership, staffing and policies for ACT, and mastery and leadership for IDDT. Overall, barriers were more evident for IDDT than for ACT. Strategies were less frequently noted but generally paralleled the areas noted for barriers. However, our central finding was that ACT was generally more successfully implemented than IDDT throughout the state, and that this difference could be traced in large part to state-level factors relating to historical preparation for the practice, establishment of standards, formation of a technical assistance center, and funding.

CONCLUSION

In this case study, both state-level and site-specific factors influenced success of implementation of EBPs. To address these factors, the field needs systematic strategies to anticipate and overcome these barriers if full implementation is to be realized.

Three-year outcomes of long-term patients with co-occurring bipolar and substance use disorders

Little is known about the long-term outcomes of patients in the public mental health system who are disabled by co-occurring bipolar and substance use disorders. This article reports on the 3-year course of 51 patients with co-occurring bipolar and substance use disorders in the New Hampshire Dual Diagnosis Study. Participants received integrated dual disorders treatments in the state mental health system and were independently assessed with standardized measures at baseline and every 6 months for 3 years. Though psychiatric symptoms improved only modestly, participants improved steadily in terms of remission from substance abuse (61% in full remission at 3 years); they also achieved greater independent living (average 239 days in third year), competitive employment (49% in third year), regular social contacts with nonsubstance abusers (46% at 3 years), and quality of life (56% satisfied with life at 3 years). Different domains of outcome were only weakly related to each other. Long-term, disabled patients with co-occurring bipolar and substance use disorders have potential for remission from substance abuse and substantial improvements in functioning and quality of life.

Substantial decrease of psychiatric comorbidity in chronic alcoholics upon integrated outpatient treatment - results of a prospective study

It is far from clear how comorbidity changes during alcoholism treatment. This study investigates: (1) the course of comorbid Axis I disorders in chronic alcoholics over 2 years of controlled abstinence in the outpatient long-term intensive therapy for alcoholics (OLITA) and (2) the effect of comorbid Axis I and II disorders in this group of patients on subsequent drinking outcome over a four-year follow-up. This prospective treatment study evaluates psychiatric variables of 89 severely affected chronic alcohol dependent patients on admission (t(1)), month 6 (t(2)), 12 (t(3)) and 24 (t(4)). Drinking outcomes have been analyzed from 1998 to 2002. On admission, 61.8% of the patients met criteria for a comorbid Axis I disorder, 63.2% for a comorbid personality disorder. Axis I disorders remit from t(1) (59.0% ill), t(2) (38.5%), t(3) (28.2%) to t(4) (12.8%) (p < 0.0001). Anxiety disorders remit more slowly from t(1) (43.6%) to t(3) (20.5%, p = 0.0086), whereas mood disorders remit early between t(1) (23.1%) and t(2) (5.1%, p = 0.0387) with a slight transient increase at t(3) (10.3%). During the four-year follow-up, the cumulative probability of not having relapsed amounts to 0.59. Two predictors have a strong negative impact on abstinence probability: number of inpatient detoxifications (p = 0.0013) and personality disorders (p = 0.0106). The present study demonstrates a striking remission of comorbid Axis I disorders upon abstinence during comprehensive long-term outpatient alcoholism treatment. The presence of an Axis II rather than an Axis I disorder on admission strongly predicts drinking outcome over a four-year follow-up.

Components of a modern mental health service: a pragmatic balance of community and hospital care: overview of systematic evidence

BACKGROUND

There is controversy about whether mental health services should be provided in community or hospital settings. There is no worldwide consensus on which mental health service models are appropriate in low-, medium- and high-resource areas.

AIMS

To provide an evidence base for this debate, and present a stepped care model.

METHOD

Cochrane systematic reviews and other reviews were summarised.

RESULTS

The evidence supports a balanced approach, including both community and hospital services. Areas with low levels of resources may focus on improving primary care, with specialist back-up. Areas with medium resources may additionally provide out-patient clinics, community mental health teams (CMHTs), acute in-patient care, community residential care and forms of employment and occupation. High-resource areas may provide all the above, together with more specialised services such as specialised out-patient clinics and CMHTs, assertive community treatment teams, early intervention teams, alternatives to acute in-patient care, alternative types of community residential care and alternative occupation and rehabilitation.

CONCLUSIONS

Both community and hospital services are necessary in all areas regardless of their level of resources, according to the additive and sequential stepped care model described here.

A systematic review of home treatment services--classification and sustainability

BACKGROUND

In view of the plethora of different community-based mental health services, there is a clear need for a classification based on service components rather than labels. Moreover, the sustainability of experimental services beyond their research studies is rarely reported.

METHODS

As part of a systematic review of home treatment for mental health problems, authors of all included studies were followed up for data on service components and sustainability. Associations between components were explored.

RESULTS

There was evidence of a core group of components co-occurring in home treatment services: regularly visiting at home, taking responsibility for health and social care, having smaller caseloads, multidisciplinary teams, integrated psychiatrists and a high proportion of contacts at home. Fifty-four per cent of services no longer existed, of which almost half had ended by the study's publication date. There was a significant association between sustainability and the study's hospitalisation outcome.

CONCLUSIONS

Some of the related service components presented here were associated with reducing hospitalisation. This group cannot, however, be used to provide a new taxonomy of services. It is imperative that future studies prospectively record and report service components to enable better classification. It is of concern that policy is currently predicated on research findings regardless of whether or not the experimental service was sustainable.

The development and implementation of case management for substance use disorders in North America and Europe

Because of the multifaceted, chronic, and relapsing nature of substance use disorders, case management has been adapted to work with persons who have these disorders. Deliberate implementation has been identified as a powerful determinant of successful case management. This article focuses on six key questions about implementation of case management services on the basis of a comparison of experiences from the United States, the Netherlands, and Belgium. It was found that case management has been applied in various populations with substance use disorders, and distinct models have been associated with positive effects, such as increased treatment participation and retention, greater use of services, and beneficial drug-related outcomes. Program fidelity, robust implementation, extensive training and supervision, administrative support, a team approach, integration in a comprehensive network of services, and minimal continuity have all been linked to successful implementation.

Housing First, consumer choice, and harm reduction for homeless individuals with a dual diagnosis

OBJECTIVES

We examined the longitudinal effects of a Housing First program for homeless, mentally ill individuals' on those individuals' consumer choice, housing stability, substance use, treatment utilization, and psychiatric symptoms.

METHODS

Two hundred twenty-five participants were randomly assigned to receive housing contingent on treatment and sobriety (control) or to receive immediate housing without treatment prerequisites (experimental). Interviews were conducted every 6 months for 24 months.

RESULTS

The experimental group obtained housing earlier, remained stably housed, and reported higher perceived choice. Utilization of substance abuse treatment was significantly higher for the control group, but no differences were found in substance use or psychiatric symptoms.

CONCLUSIONS

Participants in the Housing First program were able to obtain and maintain independent housing without compromising psychiatric or substance abuse symptoms.

Housing First, consumer choice, and harm reduction for homeless individuals with a dual diagnosis

OBJECTIVES

We examined the longitudinal effects of a Housing First program for homeless, mentally ill individuals' on those individuals' consumer choice, housing stability, substance use, treatment utilization, and psychiatric symptoms.

METHODS

Two hundred twenty-five participants were randomly assigned to receive housing contingent on treatment and sobriety (control) or to receive immediate housing without treatment prerequisites (experimental). Interviews were conducted every 6 months for 24 months.

RESULTS

The experimental group obtained housing earlier, remained stably housed, and reported higher perceived choice. Utilization of substance abuse treatment was significantly higher for the control group, but no differences were found in substance use or psychiatric symptoms.

CONCLUSIONS

Participants in the Housing First program were able to obtain and maintain independent housing without compromising psychiatric or substance abuse symptoms.

Critical ingredients of consumer run services: results of a national survey

Fidelity criteria are increasingly used in program monitoring and evaluation, but are difficult to derive for emerging models (i.e., those not based on theory or a research demonstration project). We describe steps used to develop and operationalize fidelity criteria for consumer-run (CR) mental health services: articulating and operationalizing criteria based on published literature, then revising and validating the criteria through expert judgments using a modified Delphi method. Respondents rated highest those structural and process components emphasizing the value of consumerism: consumer control, consumer choices and opportunities for decision-making, voluntary participation (and the absence of coercion), and respect for members by staff.

Employment outcomes for hard-to-reach persons with chronic and severe substance use disorders receiving assertive community treatment

Many persons with chronic and severe substance use disorders (SUDs) enter and exit public substance dependence treatment systems with limited benefit, but continue overuse of high-cost health and human services. Less than a third holds jobs, earning income below U.S. federal poverty levels. Long-term integrated substance dependency treatment, rehabilitation, and support services will be essential to resolve substance dependence and employment problems. This single-group program evaluation reports adaptation of Assertive Community Treatment (ACT), a multi-component, team-based service model originally designed for persons with severe mental illnesses and multiple disabilities, for effectiveness with persons with severe SUDs. The ACT model delivers an integrated package of treatment, rehabilitation, and support to reduce substance misuse and increase employment. Of the 35 clients admitted 12 months prior to conclusion of this 2-year service demonstration, only one left treatment prematurely. Generally, clients modestly reduced substance misuse and increased employment. However, the evaluation design and small sample limit inferences of causation and generalizability of these promising outcomes. Persuading states to adopt expensive team-based approaches for this population will require firm evidence of favorable cost-benefit ratios.

Supported employment: evidence for an evidence-based practice

Supported employment for people with severe mental illnesses is an evidence-based practice, based on converging findings from 4 studies of the conversion of day treatment to supported employment and 9 randomized controlled trials comparing supported employment to a variety of alternative approaches. These two lines of research suggest that between 40% and 60% of consumers enrolled in supported employment obtain competitive employment while less than 20% of similar consumers do so when not enrolled in supported employment. Consumers who hold competitive jobs for a sustained period of time show benefits such as improved self-esteem and better symptom control, although by itself, enrollment in supported employment has no systematic impact on nonvocational outcomes, either on undesirable outcomes, such as rehospitalization, or on valued outcomes, such as improved quality of life. The psychiatric rehabilitation field has achieved consensus on a core set of principles of supported employment, although efforts continue to develop enhancements. A review of the evidence suggests strong support for 4 of 7 principles of supported employment, while the evidence for the remaining 3 is relatively weak. Continued innovation and research on principles is recommended.

Development of the DPA Fidelity Scale: using fidelity to define an existing vocational model

Psychiatric rehabilitation practices are often poorly defined, hindering implementation, research, and dissemination efforts. Documentation of adherence to a specific psychiatric rehabilitation approach is particularly important in conducting randomized controlled trials. This paper outlines steps taken to define and measure the Diversified Placement Approach (DPA), a well-regarded vocational program for people with severe mental illnesses. Details of scale development are described, and the scale's utility for model clarification and detection of experimental drift are discussed.

A modified ESID approach to studying mental illness and homelessness

This paper describes 15 years of research on homelessness using a modified ESID approach. The article summarizes the results of several needs assessment studies; describes the development and evolution of alternative treatment models to assist homeless individuals with severe mental illness; summarizes results of three outcome evaluation studies; and discusses issues of treatment implementation, treatment diffusion, and dissemination.

Consumer preference programs for individuals who are homeless and have psychiatric disabilities: a drop-in center and a supported housing program

We illustrate Fairweather's approach to Experimental Social Innovation and Dissemination with two experimental studies of programs to reduce homelessness for 168 and 225 people with mental illness and often substance abuse. Literally homeless participants were randomly assigned to programs that emphasized consumer choice or to the usual continuum of care, in which housing and services are contingent on sobriety and progress in treatment. A drop-in center that eliminated barriers to access to services was more successful than control programs in reducing homelessness, but after 24 months only 38% of participants had moved to community housing. A subsequent apartment program, in which individuals in the experimental condition moved to subsidized apartments directly from the street, with services under their control, had 79% in stable housing (compared to 27% in the control group) at the end of 6 months. Groups in this study did not differ on substance abuse or psychosocial outcomes.

Assertive outreach teams in London: models of operation. Pan-London Assertive Outreach Study, part 1

BACKGROUND

Assertive outreach teams have been introduced in the UK, based on the assertive community treatment (ACT) model. It is unclear how models of community care translate from one culture to another or the degree of adaptation that may result.

AIMS

To characterise London assertive outreach teams and determine whether there are distinct groups within them.

METHOD

Semi-structured interviews with team managers plus one month's prospective process of care data collection were used to test for 'model fidelity' to ACT and, by cluster analysis, to identify groupings.

RESULTS

Fidelity varied widely, with four teams (out of 24 studied) rated 'high fidelity' and three teams rated 'low fidelity' by US standards and 17 rated 'ACT-like'. Three clusters were identified, with voluntary sector teams being the most distinct group.

CONCLUSIONS

There is wide variation in the practice of assertive outreach in London. The role of the voluntary sector requires increased attention. Heterogeneity in practice is a clinical challenge but a research opportunity in distinguishing effective from redundant components of the approach.

Improving the vocational status of patients with long-term mental illness: a randomised controlled trial of staff training

OBJECTIVE

To investigate the impact of training CMHT members in the practice of Individual Placement and Support on the vocational status of long-term patients.

METHOD

Six CMHTs received vocational training by a work co-ordinator; four continued with standard care. The best vocational status of the 1037 subjects was ascertained after one year. Factors associated with improvement in vocational status were identified.

RESULTS

There was no difference in change of vocational status. Age, previous employment and diagnosis influenced outcome.

CONCLUSION

Training in IPS at team level did not improve employment status. A dedicated, vocational worker appears to be essential for successful IPS.

Case management models and the care programme approach: how to make the CPA effective and credible

The care programme approach (CPA), a form of case management, is a key mental health policy in England. Yet after over 10 years, it remains poorly and unevenly implemented with few benefits for service users, carers or mental health staff. This paper reviews the wider literature on case management and identifies and considers the principal models that might have informed the development of the CPA. After discussing the evidence for each of the clinical, strengths, intensive and assertive case management models, the paper identifies the key components that appear to be central to effective case management across these models. These components are then considered in relation to the CPA. It is argued that the CPA has been undermined by a failure to incorporate and build on certain important features of the major models of case management. The paper concludes by suggesting the key developments required to make the CPA more effective and to underpin the policy with a unifying philosophy while endorsing it with much needed credibility among both clinicians and service users.

Is it ACT yet? Real-world examples of evaluating the degree of implementation for assertive community treatment

Despite growing interest in assessment of program implementation, little is known about the best way to evaluate whether a particular program has implemented the intended service to a level that is minimally acceptable to a funding source, such as a state mental health authority. Such is the case for assertive community treatment (ACT), an evidence-based practice being widely disseminated. Using an exploratory, actuarial approach to defining program standards, this study applies different statistical criteria for determining whether or not a program meets ACT standards using the 28-item Dartmouth Assertive Community Treatment Scale. The sample consists of 51 ACT programs, 25 intensive case management programs, and 11 brokered case management programs which were compared to identify levels of fidelity that discriminated between programs, but were still attainable by the majority of ACT programs. A grading system based on mean total score for a reduced set of 21 items appeared to be most attainable, but still discriminated ACT programs from other forms of case management. Implications for setting and evaluating ACT program standards are discussed.

Impact of public support payments, intensive psychiatric community care, and program fidelity on employment outcomes for people with severe mental illness

This study explored the relationship of public support payments, intensive psychiatric community care (IPCC), and fidelity of implementation to 1-year employment outcomes for 520 veterans with severe mental illness (SMI) in a clinical trial of IPCC. At study entry, 455 (87.5%) participants received public support. At 1 year, 46 (8.8%) participants met criteria to be classified as workers. A multivariate analysis indicated that baseline public support was significantly associated with a lower likelihood of employment, and baseline work was positively associated with employment at 1 year. IPCC patients were three times more likely to be working than control subjects, and a significant interaction favored well-implemented IPCC programs over others. This study points out not only the inhibiting effect of public support payment on employment but also the value of IPCC and the special importance of fidelity to program models for employment for people with SMI.

Assertive community treatment across the Atlantic: comparison of model fidelity in the UK and USA

BACKGROUND

The significant reductions in hospital admission demonstrated in US assertive community treatment (ACT) studies have not been replicated in the UK. Explanations cite poor UK 'model fidelity' and/or better UK standard care. No international model-fidelity comparisons exist.

AIMS

To compare high-fidelity US ACT teams with a UK team.

METHOD

The UK 700's ACT team (n=97) was compared with high-fidelity US ACT teams (n=73) by using two measures: a forerunner of the Dartmouth Assertive Community Treatment schedule (to assess adherence to ACT principles) and 2-year prospective activity data.

RESULTS

The UK and US teams had similar high-fidelity scores. Although significant differences were found in the amount and type of activity, practice differences in areas central to ACT were not great.

CONCLUSIONS

The failure of UK ACT studies to demonstrate the outcome differences of early US studies cannot be attributed entirely to the lack of ACT fidelity.

Connection and autonomy in the case management relationship

This study examines the effects of connection and autonomy in the client-case manager relationship on treatment participation, satisfaction with case management, and satisfaction with social life. Three-month case manager ratings of connection were positively correlated with 9-month treatment participation. Six-month client and case manager ratings of connection were positively correlated with improvements in all three outcomes at nine months. Within this time frame, autonomy was positively correlated with treatment participation and satisfaction with case management and negatively correlated with satisfaction with social life. These findings suggest that balancing connection and autonomy in different ways is important in the case management relationship.

A comparison of patient clinical and social outcomes before and after the introduction of an extended-hours community mental health team

OBJECTIVE

The aim of this study was to assess the effectiveness of the addition of standard community treatment to a hospital-based service in a regional district of Australia.

METHOD

The study was a naturalistic investigation of a routine clinical service and utilized a longitudinal panel design. Two matched groups of seriously mentally ill patients were recruited,one before the addition of the community mental health team (CMHT)and one after. Each sample was followed up for one year using a semistructured questionnaire and instruments including the Brief Psychiatric Rating Scale, the Global Assessment Scale, the Life Skills Profile and the Rosenberg Self-Esteem Scale as well as hospital records.

RESULTS

Patients in both groups showed similar patterns of improvements. Although the aims of the new service included reducing in-patient utilization and improving social functioning,there were few significant differences between the two groups. While the number of admissions and length of stay were lower in the post-CMHTsample most were admitted rather than treated in their homes by the CMHT.

CONCLUSION

The study concludes that better outcomes might have been achieved if the aims of the CMHT had been limited to either crisis or rehabilitation interventions, but not both. More attention needs to be paid to the service context in which model programmes are introduced so that new developments can be more closely tailored to the realities of what is likely to be achievable.

Assertive community treatment: development of the team, selection of clients, and impact on length of hospital stay

Mental health services have been criticized for the lack of focus and response to people suffering from a serious mental illness (SMI). Assertive community treatment (ACT) offers the potential for greater partnership working between the user and provider of mental health services. The author describes one approach in developing ACT in the UK. Four criteria were developed to identify the most appropriate service users for ACT: those with SMI, illness instability, illness disability and risk to self or others. Fifty-five clients were identified using these criteria and tracked for their length of hospital stay and frequency of admission 2 years before acceptance to an ACT team and for 12 months after. Duration of hospital stay was unchanged although both the frequency and total numbers of bed days were reduced.

Hispanic client-case manager matching: differences in outcomes and service use in a program for homeless persons with severe mental illness

Mental health professionals have responded to ethnic and racial disparities in mental health care by advocating increasing cultural relevancy in treatment. A central component of cultural relevancy is ethnic and racial pairing of clients and providers. This study examined the effects of client-case manager ethnic and racial matching among white and Hispanic clients who received assertive community treatment in the Access to Community Care and Effective Services and Supports Program. Twelve-month outcomes and service use were examined among 242 Hispanic and 2333 white clients seen in the first 3 years of the program. Analysis of covariance was used to evaluate the association of client-case manager ethnic and racial matching with changes in health status and service use from baseline to 12 months after program entry. At baseline, Hispanics had more serious problems than whites on several measures of psychiatric and substance abuse domains, and they also showed less improvement than whites over the next year on several measures of psychiatric status and service use. One significant association with ethnic matching was found: when treated by a Hispanic clinician, Hispanic clients showed less improvement in symptoms of psychosis. These results do not support the hypothesis that ethnic and racial matching improves outcomes or service use. Several explanations are offered for the results.

Beyond components: using fidelity scales to measure and assure choice in program implementation and quality assurance

Fidelity scales have become an accepted part of intervention research. Initially, fidelity scales focused on critical components of an intervention. In this paper we argue that the next generation of fidelity scales should include key process variables such as choice. Since choice is an essential element in all empowerment and recovery driven intervention models, a fidelity scale for an enhanced version of the Individual Placement and Support (IPS) supported employment model that incorporates choice as a fundamental component was developed as part of a SAMHSA community action grant. The process for developing the choice component and the dimensions measured are also described.

Does case management work? The evidence and the abuse of evidence-based medicine

OBJECTIVES

This study reviews typologies of psychiatric case management and then discusses the efficacy, effectiveness and cost effectiveness of psychiatric case management, with particular focus on evidence from Australia and the UK. Subsequently, it aims to examine the way such evidence has been interpreted in the context of UK psychiatric research and services. Finally it examines the ways in which, by the selective reviewing or editorializing of evidence, case management has been brought into disrepute in the UK.

METHOD

This study reviews literature of the recent evidence for case management, and asks three questions of case management: has it been shown to be efficacious in controlled research, is it effective in applied settings, and is it cost effective? An examination is then made of the concurrent representations of the UK evidence in both the academic literature and the media.

RESULTS

There is strong evidence for the efficacy effectiveness and cost-effectiveness of case management in psychiatry, the closer it conforms to active and assertive community treatment models. It appears, however, that studies and evidence-based reviews of case management have possibly been misused and misrepresented in a highly charged atmosphere of professional media debate. The potential for this abuse is not limited to psychiatry and remains a challenge for all evidence-based practice.

CONCLUSION

On the evidence, assertive community treatment case management is one of the most effective interventions in psychiatry today. Despite improving the evidence base for practice (e.g. as has occurred for case-management in psychiatry), evidence-based medicine (EBM) is still susceptible to compromise and misrepresentation, due to unexamined or undeclared bias. Unless this potential for abuse is recognized and checked, EBM in psychiatry is in danger of being discredited at the hand of some of its own proponents. There is a need for more rigorous pursuit of evidence-based psychiatry, including more systematic declaration of bias in all research, whether quantitative or qualitative in design.

Stages in the implementation of innovative clinical programs in complex organizations

Organizational processes can have an important impact on the introduction of innovative treatments into practice. Conceptual frameworks from organization theory and experiences implementing several hundred specialized mental health programs in the Department of Veterans Affairs (VA) over the past 15 years are used to illustrate stages and processes in the implementation of new treatment models. Four phases in the implementation of new treatments in complex organizational settings are described: a) the decision to implement, b) initial implementation, c) sustained implementation, and d) termination or transformation. Key strategies for moving research into practice include constructing decision-making coalitions, linking new initiatives to legitimate goals and values, quantitative monitoring of implementation and performance, and the development of self-sustaining communities of practice as well as learning organizations. Effective dissemination of new treatment methods requires different organizational strategies at different phases of implementation.

An exploratory analysis of racial factors in staff burnout among assertive community treatment workers

We examined racial differences in burnout among case managers working with people with severe mental illness, using the Maslach Burnout Inventory. Compared to Caucasians, African Americans reported significantly less Emotional Exhaustion and Depersonalization, but did not differ on levels of Personal Accomplishment. These differences could not be explained by geographic location or perceptions of the work environment; however, age accounted for group differences in Depersonalization. Racial incongruence with caseload appeared to be one factor in burnout, particularly for Emotional Exhaustion. Race of both staff and clients may be important to consider in understanding staff burnout.