Policy implications for implementing evidence-based practices

Barriers and Facilitators to Staff Recruitment and Retention for ACT Teams: Perspectives of Staff and Participants

The behavioral health workforce has been experiencing deepening problems with recruitment and retention, particularly in publicly funded settings serving individuals with serious mental illnesses. This quality improvement project gathered Assertive Community Treatment (ACT) participant (service user) and provider perspectives on workforce challenges. The authors conducted 8 interviews with ACT participants and 9 focus groups with ACT current staff, team leaders, and former staff. Interviewees discussed barriers to recruitment and retention, including inadequate compensation, work becoming more task-oriented during periods of short staffing, a lack of understanding of what ACT work entails, and elements of the team-based model of care; and facilitators of recruitment and retention, including other aspects of the team-based model of care, connections with colleagues and ACT participants, and flexibility. ACT participants had variable experiences regarding availability of their teams. Recommendations from focus groups and interviews include increasing flexibility, improving awareness of ACT work, optimizing team functioning, addressing staff wellness, and attending to risk. Findings include key insights that may help address the critical workforce shortages in public behavioral health settings.

Perspectives on implementing Individual Placement and Support (IPS) within primary health care settings for adults living in British Columbia, Canada

BACKGROUND

Individual placement and support (IPS) is an evidence-based practice (EBP) designed to help people with severe mental illness re-enter the labour market. Implementing an IPS program within a new context (e.g., primary health care setting) to support populations that are complex and multi-barriered presents a set of unique challenges and considerations. This paper provides community-based perspectives that identify implementation strengths and challenges and highlights potential strategies aimed at addressing emergent barriers.

METHODS

A case study was conducted across three community health centres in British Columbia (BC), Canada, where a novel IPS program was embedded within primary care services. Data collection consisted of open-ended surveys and focus groups with service providers directly involved in program implementation and their associated clinical and managerial support teams (n = 15). Using the updated Consolidated Framework for Implementation Research (CFIR) as a guide, we performed deductive thematic analysis to identify key areas impacting IPS implementation.

RESULTS

Integration with existing health care systems and primary health care teams and support from leadership across all levels were identified as both key facilitators and barriers to implementation. Facilitators and barriers were identified across all domains, with those within innovation and process most easily addressed. Four cross-cutting themes emerged for promoting more integrated and sustainable program implementation: investing in pre-implementation activities, supporting a dynamic and flexible program, building from community experiences, and developing a system for shared knowledge.

CONCLUSIONS

Implementing an IPS program embedded within primary health care settings is complex and requires extensive planning and consultation with community-based service providers and decision-makers to achieve full integration. Future practice and policy decisions aimed at supporting employment and well-being should be made in collaboration with communities.

Proactive versus Reactive: Strategies in the Implementation of School-based Services for Students with ASD

Autism spectrum disorder (ASD) is increasingly prevalent, intervention costs are high, and long-term outcomes are poor. Proactive implementation of evidence-based practices (EBPs; Steinbrenner et al., Evidence-Based Practices for Children, Youth, and Young Adults with Autism, 2020) through an assessment or planning process can lead to more effective services (Rubin et al., Admin Policy Mental Health Mental Health Serv Res 43(6), 1023-1028, 2016). The objective of this study is (a) to identify factors associated with the use of proactive versus reactive strategies for school-based services for students with ASD and (b) to examine school personnel perceptions of the use of proactive versus reactive strategies. Data were from a larger project in which 6 semi-structured focus groups were conducted to understand school personnel perceptions of how school districts implement new programs for ASD. Transcripts were coded using an iterative coding and review process. In the present study, primary themes were identified and classified as proactive or reactive. Participants reported both proactive and reactive allocation of district resources for intervention implementation. Reactive implementation was associated with litigation or due process, escalated student behavior, and non-public school placement, whereas proactive implementation was associated with ASD-specific programming, grants, personnel experience with EBPs, and prospective needs assessment. Participants perceived the reactive strategies as disadvantageous, and yet these strategies were sometimes still employed. Understanding the role of proactive and reactive strategies and the factors that influence their use could enable more effective planning for EBP use to improve both cost savings and student outcomes. This study is an important first step to explore resource allocation for school-based services for students with ASD.

The Legitimacy of Change: Adopting/Adapting, Implementing and Sustaining Reforms within Community Corrections Agencies

Many criminal justice institutions implement evidence-based reforms. While most scholars are aware of implementation challenges, we still know relatively little about sustainability. Using longitudinal data from criminal legal staff implementing an evidence-based reform, this paper considers: What happens during the implementation of an organizational reform that affects continued use of these reforms? Guided by an organizational change framework, findings suggest sustainability aligns with key organizational goals including legitimacy, efficiency and effectiveness. While all sites saw the reformed practices as legitimate enough to initially consider adoption, two sites never adopted, four sites toyed with reform, and two sites continued to use the reform after the study was over. This paper explores sustainability and identifies legitimacy as an important factor that affects the routinization of new practices. Transformation of organizational change initiatives into routine practices should consider efforts to build legitimacy in lieu of primarily rationalizing on the values of efficiency and effectiveness.

Community-based behavioral health administrator perspectives on sustainability of Dialectical Behavior Therapy: a qualitative evaluation

BACKGROUND

Substantial resources have been invested in evidence-based practice (EBP) implementation in community settings; however, research suggests that EBPs do not always sustain over time.

METHOD

This qualitative study explored the perspectives of 13 community behavioral health agency leaders regarding the sustainability of an EBP 25 to 28 months following the original training period. Administrators from 10 agencies were interviewed to understand the complexities of the implementation process, sustainability of Dialectical Behavior Therapy, and their recommendations to enhance implementation and sustainability.

RESULTS

A content analysis revealed five emergent themes: treatment model opinions, resource concerns, staff selection/ turnover, population characteristics, and recommendations for future implementation.

CONCLUSIONS

These themes likely would be helpful in informing the design of future implementation and sustainability initiatives sensitive to the challenges of integrating EBPs in community settings.

An Overlapping Systems Conceptual Framework to Evaluate Implementation of a Behavioral Health Intervention for Justice-Involved Youth

Background:

Nearly 65% of justice–involved youth have a substance use and/or mental health disorder. Although evidence–based practices have been established for adolescents with co–occurring mental health and substance use disorders, these practices are not widely used in juvenile justice agencies due to environmental and organizational complexities.

Methods:

Our study builds on Juvenile Justice—Translational Research on Interventions for Adolescents in the Legal System (JJ–TRIALS), a multi–site cooperative research initiative of juvenile justice and partnering behavioral health agencies. We also integrate state and county–level data to support broader assessment of key drivers of implementation success.

Results:

We present an economics/systems conceptual model describing how the environmental context, systems organization, and economic costs of implementation can affect implementation outcomes. Comparison of intervention condition (Core vs Enhanced) and pre–implementation costs (High vs Low) found differences in insurance reimbursements and types, as well as agency staffing characteristics.

Discussion:

Implementing new procedures or policies at a systems level must consider implementation outcomes in a broad context. Factors such as population demographics, primary care and behavioral health treatment capacity, unemployment rates, and public funding for treatment and other services are important in determining intervention success and sustainability.

Implementation Science in Perioperative Care

There is a 17-year gap between the initial publication of scientific evidence and its uptake into widespread practice in health care. The field of implementation science (IS) emerged in the 1990s as an answer to this "evidence-to-practice gap." In this article, we present an overview of implementation science, focusing on the application of IS principles to perioperative care. We describe opportunities for additional training and discuss strategies for funding and publishing IS work. The objective is to demonstrate how IS can improve perioperative patient care, while highlighting perioperative IS studies and identifying areas in need of additional investigation.

Enhancing policy implementation to improve healthcare practices: The role and strategies of hybrid national-local support structures

BACKGROUND

In this study, we followed a national initiative to enhance the use of quality indicators gathered in national quality registries (NQRs) for improvement of clinical practices in Swedish healthcare, more specifically by investigating the support strategies of regional support centers with national and local missions. The aim was to increase knowledge on the role, challenges, and strategies of support structures with mixed and complex missions in the healthcare system.

METHODS

Documents and 25 semistructured interviews with staff at 6 regional support centers, ie, quality registry centers, formed this multiple case study. Data were analyzed using conventional content analysis.

RESULTS

The centers' strategies varied from developing the NQRs to become more suitable for improvement to supporting healthcare's use of NQRs, from the use of task to process-oriented support strategies, and from taking on national responsibilities to responding to local initiatives. All quality registry centers engaged in initiatives inspired by the Breakthrough Series approach. Some used preexisting change concepts or collaborated with local development units. A main challenge was to overcome a lack of formal mandate to act in the healthcare organizations they served.

CONCLUSIONS

Support functions with mixed and complex missions have to use a variation of strategies to reach relevant actors and achieve changes. This study provides valuable input for policy and decision-makers on the support strategies used and challenges of support functions with complex missions situated in-between national and local levels of the healthcare system, here denoted hybrid national-local support structures.

Economic Evaluation of the Juvenile Drug Court/Reclaiming Futures (JDC/RF) Model

Juvenile drug court (JDC) programs are an increasingly popular option for rehabilitating juvenile offenders with substance problems, but research has found inconsistent evidence regarding their effectiveness and economic impact. While assessing client outcomes such as reduced substance use and delinquency is necessary to gauge program effectiveness, a more comprehensive understanding of program success and sustainability can be attained by examining program costs and economic benefits. As part of the National Cross-Site Evaluation of JDC and Reclaiming Futures (RF), an economic analysis of five JDC/RF programs was conducted from a multisystem and multiagency perspective. The study highlights the direct and indirect costs of JDC/RF and the savings generated from reduced health problems, illegal activity, and missed school days. Results include the average (per participant) cost of JDC/RF, the total economic benefits per JDC/RF participant, and the net savings of JDC/RF relative to standard JDC.

The Impact Of Medicare ACOs On Improving Integration And Coordination Of Physical And Behavioral Health Care

The accountable care organization (ACO) model holds the promise of reducing costs and improving the quality of care by realigning payment incentives to focus on health outcomes instead of service volume. One key to managing the total cost of care is improving care coordination for and treatment of people with behavioral health disorders. We examined qualitative data from ninety organizations participating in Medicare ACO demonstration programs from 2012 through 2015 to determine whether and how they focused on behavioral health care. These ACOs had mixed degrees of engagement in improving behavioral health care for their populations. The biggest challenges included a lack of behavioral health care providers, data availability, and sustainable financing models. Nonetheless, we found substantial interest in integrating behavioral health care into primary care across a majority of the ACOs.

Placement and Delinquency Outcomes Among System-Involved Youth Referred to Multisystemic Therapy: A Propensity Score Matching Analysis

Multisystemic therapy (MST) was developed to help youth with serious social, emotional, and behavioral problems. Research on the efficacy and effectiveness of MST has shown positive outcomes in different domains of development and functioning among various populations of youth. Nonetheless, even with a large body of literature investigating the treatment effects of MST, few studies have focused on the effectiveness of MST through large-scale dissemination efforts. Utilizing a large sample of youth involved in a statewide dissemination of MST (n = 740; 43% females; 14% Black; 29% Hispanic; 49% White; Mage = 14.9 years), propensity score matching was employed to account for baseline differences between the treatment (n = 577) and comparison (n = 163) groups. Treatment effects were examined based on three outcomes: out-of-home placement, adjudication, and placement in a juvenile training school over a 6-year period. Significant group differences remained after adjusting for baseline differences, with youth who received MST experiencing better outcomes in offending rates than youth who did not have an opportunity to complete MST due to non-clinical or administrative reasons. Survival analyses revealed rates of all three outcomes were approximately 40% lower among the treatment group. Overall, this study adds to the body of literature supporting the long-term effectiveness of MST in reducing offending among high-risk youth. The findings underscore the potential benefits of taking evidence-based programs such as MST to scale to improve the well-being and functioning of high-risk youth. However, strategies to effectively deliver the program in mental health service settings, and to address the specific needs of high-risk youth are necessary.

Use of Pooled State Administrative Data for Mental Health Services Research

State systems are a rich, albeit challenging, laboratory for policy-relevant services research studies. State mental health authorities routinely devote resources to collect data for state planning and reporting purposes. However, these data are rarely used in cross-state comparisons to inform state or federal policy development. In 2008, in response to key recommendations from the National Institute of Mental Health (NIMH) Advisory Council's "The Road Ahead: Research Partnership to Transform Services," (http://www.nimh.nih.gov/about/advisory-boards-and-groups/namhc/reports/road-ahead.pdf), NIMH issued a request for applications (RFA) to support studies on the impact of state policy changes on access, cost, quality and outcomes of care for individuals with mental disorders. The purpose of the RFA was to bridge the divide between research and policy by encouraging research that used state administrative data across states, and to address significant state-defined health policy initiatives. Five projects involving eight states were selected through peer review for funding. Projects began in 2009 and were funded for 3 years. This report provides a brief description of the five projects, followed by an analysis of the impact, challenges, and lessons learned from these policy-partnered studies. We conclude by offering suggestions on ways to use state administrative data for informing state health policies, which is especially timely given national and state changes in the structure and financing of healthcare.

Quality of care for Medicaid-enrolled youth with bipolar disorders

This study examined conformance to clinical practice guidelines for children and adolescents with bipolar disorders and identified patient and provider factors associated with guideline concordant care. Administrative records were examined for 4,047 Medicaid covered youth aged 5-18 years with new episodes of bipolar disorder during 2006-2010. Main outcome measures included 5 claims-based quality of care measures reflecting national treatment guidelines. Measures addressed appropriate pharmacotherapy, therapeutic drug monitoring, and psychosocial treatment. The results indicated that current treatment practices for youth diagnosed with bipolar disorder typically fall short of recommended practice guidelines. Although the majority of affected youth are treated with recommended first-line pharmacotherapy, only a minority receive therapeutic drug monitoring and/or psychotherapy of recommended duration, underscoring the need for quality improvement initiatives.

How Can Research-Based Findings Be Used to Improve Practice? Perspectives from Participants in a Statewide Outcomes Monitoring Study

This paper reports on the perspectives of substance abuse treatment providers and administrators who participated in a collaborative project to implement a statewide outcome monitoring system, the California Treatment Outcome Project (CalTOP). Program providers and county administrators were invited to discuss their perceptions regarding the relationship of research to treatment practice following completion of the project. Themes identified from this research-practice meeting were augmented by observations from program site visits and focus groups conducted with project participants during start-up. Participants articulated a range of actual and potential applications for using outcome data to improve treatment practice and to inform policy development, stressed several ways in which they could build upon the data-collection infrastructure developed for the project, and identified potential areas for continued program and staff development based on outcome findings. Future steps include identifying the organizational and workforce characteristics related to a program's readiness to incorporate research-based practices.

Instruments of Policy and Administration for Improving Substance Abuse Treatment Practice and Program Outcomes

The call for practice improvement in substance abuse treatment is motivated by the ultimate goal of achieving consistently positive post-treatment outcomes. A central hypothesis of the empirical investigation in this study is that consumer-level outcomes are affected either directly or indirectly through clinical practice, by factors originating at the policy and organizational level. Four broad categories of policy and program administration (funding, service technology and delivery, organizational structure, and leadership) that facilitate or hinder the implementation of practice improvements are investigated. Models hypothesizing that the effects of policy and program administration will vary according to the treatment goals and corresponding measurement of outcomes are tested. Using newly available data that link program- and consumer-level measures, the empirical analysis shows statistically significant direct effects of program and policy factors on outcomes as well as effects of these variables on treatment practices that have significant implications for treatment outcomes.

Individual and contextual-level factors associated with continuity of care for adults with schizophrenia

This retrospective cohort study examined rates of conformance to continuity of care treatment guidelines and factors associated with conformance for persons with schizophrenia. Subjects were 8,621 adult Ohio Medicaid recipients, aged 18-64, treated for schizophrenia in 2004. Information on individual-level (demographic and clinical characteristics) and contextual-level variables (county socio-demographic, economic, and health care resources) were abstracted from Medicaid claim files and the Area Resource File. Outcome measures captured four dimensions of continuity of care: (1) regularity of care; (2) transitions; (3) care coordination, and (4) treatment engagement. Multilevel modeling was used to assess the association between individual and contextual-level variables and the four continuity of care measures. The results indicated that conformance rates for continuity of care for adults with schizophrenia are below recommended guidelines and that variations in continuity of care are associated with both individual and contextual-level factors. Efforts to improve continuity of care should target high risk patient groups (racial/ethnic minorities, the dually diagnosed, and younger adults with early onset psychosis), as well as community-level risk factors (provider supply and geographic barriers of rural counties) that impede access to care.

Psychosocial functioning of individuals with schizophrenia in community housing facilities and the psychiatric hospital in Zurich

Individuals with severe mental illness frequently have difficulties in obtaining and maintaining adequate accommodation. If they are not willing or able to adapt to requirements of traditional supported housing institutions they may live in sheltered and emergency accommodation. Adequate mental health services are rarely available in these facilities. The aim of the present study was to evaluate mental health, functional and social status of individuals living in community sheltered housing facilities. A cross-sectional survey of n=338 individuals in sheltered housing compared to a sample of patients at intake in acute inpatient psychiatry (n=619) concerning clinical and social variables was carried out in the catchment area of Zurich. Matched subsamples of individuals with schizophrenia (n=168) were compared concerning functioning and impairments on the Health of the Nation Outcome Scales (HoNOS). Individuals with schizophrenia in sheltered housing (25% of the residents) have significantly more problems concerning substance use, physical illness, psychopathological symptoms other than psychosis and depression, and relationships, daily activities and occupation than patients with schizophrenia at intake on an acute psychiatric ward. Community sheltered accommodation although conceptualized to prevent homelessness in the general population de facto serve as housing facilities for individuals with schizophrenia and other severe mental illness.

Fostering Healthy Futures for Teens: Adaptation of an Evidence-Based Program

OBJECTIVE

This article describes the process of adapting and implementing a complex, multicomponent intervention for a new population. Specifically, the article delineates the development and implementation of the Fostering Healthy Futures for Teens (FHF-T) program, which is an adaptation and extension of the Fostering Healthy Futures^® (FHF) preventive intervention. FHF is a 9-month mentoring and skills group program for 9 to 11 year olds recently placed in foster care. Following the designation of FHF as an evidence-based intervention, there was increasing demand for the program. However, the narrow population for which FHF had demonstrated efficacy limited broader implementation of the existing intervention. FHF-T was designed to extend the reach of the program by adapting the FHF intervention for adolescents in the early years of high school who have a history of out-of-home care. Specifically, this adaptation recognizes key developmental differences between preadolescent and adolescent populations.

METHOD

After designing a program model and adapting the program components, the FHF-T mentoring program was implemented with 42 youth over 2 program years.

RESULTS

Of the teens who were offered the program, 75% chose to enroll, and 88% of those graduated 9 months later. Although the program evidenced high rates of uptake and participant satisfaction, some unexpected challenges were encountered that will need to be addressed in future iterations of the program.

CONCLUSIONS

Too often program adaptations are made without careful consideration of important contextual issues, and too infrequently, these adapted programs are studied. Our process of program adaptation with rigorous measurement of program implementation provides a useful model for other evidence-based programs seeking thoughtful adaptation.

Examining implementation of a patient activation and self-management intervention within the context of an effectiveness trial

This qualitative study examines factors important for delivering a patient activation/self-management intervention in 13 mental health clinics within the context of an effectiveness trial to inform understanding of real-world implementation. Eighteen key personnel were interviewed about the following factors relative to the intervention and its delivery: alignment with organization values/patient needs; buy-in/support from leaders and providers; roles played by leaders and key personnel; and availability of organizational resources. Where supportive, these factors facilitated the delivery of the intervention; elsewhere, they presented as impediments. Findings from this study could help anticipate challenges to implementation that could be examined in a full-scale implementation study.

"If it's worth my time, i will make the time": school-based providers' decision-making about participating in an evidence-based psychotherapy consultation program

This study evaluated influences on school-based clinicians' decision-making surrounding participation in a modular psychotherapy training and consultation program lasting one academic year. Clinicians were recruited from three participation groups: those who never engaged, those who engaged and then discontinued, and those who participated fully. Qualitative interviews explored influences on initial and continued participation, as well as differences in decision-making by participation group, knowledge about evidence-based practices, and attitudes toward evidence-based practices. Eight major themes were identified: time, practice utility, intervention/training content, training process, attitudes toward training, social influences, commitment to training, and expectations. Some themes were discussed universally across all comparison groups, while others varied in frequency or content. Recommendations for increasing participation are presented, based on the findings.

Recovery and severe mental illness: description and analysis

The notion of recovery has been embraced by key stakeholders across Canada and elsewhere. This has led to a proliferation of definitions, models, and research on recovery, making it vitally important to examine the data to disentangle the evidence from the rhetoric. In this paper, first we ask, what do people living with severe mental illness (SMI) say about recovery in autobiographical accounts? Second, what do they say about recovery in qualitative studies? Third, from what we have uncovered about recovery, can we learn anything from quantitative studies about proportions of people leading lives of recovery? Finally, can we identify interventions and approaches that may be consistent or inconsistent with the grounded notions of recovery unearthed in this paper? We found that people with mental illness frequently state that recovery is a journey, characterized by a growing sense of agency and autonomy, as well as greater participation in normative activities, such as employment, education, and community life. However, the evidence suggests that most people with SMI still live in a manner inconsistent with recovery; for example, their unemployment rate is over 80%, and they are disproportionately vulnerable to homelessness, stigma, and victimization. Research stemming from rehabilitation science suggests that recovery can be enhanced by various evidence-based services, such as supported employment, as well as by clinical approaches, such as shared decision making and peer support. But these are not routinely available. As such, significant systemic changes are necessary to truly create a recovery-oriented mental health system.

Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies

Objective. In recent years, New Mexico has prioritized integrated treatment for cooccurring mental health and substance use disorders within its public behavioral health system. This report describes factors likely to be important when implementing evidence-based practices (EBPs) in community agencies. Methods. Our mixed-method research design consisted of observations, semistructured interviews, and surveys undertaken with employees at 14 agencies at baseline and after 18 months. We developed four-agency typologies based on iterative coding and analysis of observations and interviews. We then examined survey data from employees at the four exemplar agencies to validate qualitative findings. Results. Financial resources and strong leadership impacted agency capacity to train providers and implement EBPs. Quantitative analysis of service provider survey responses from these agencies (N = 38) supported qualitative findings and demonstrated significant mean score differences in leadership, organizational climate, and attitudes toward EBPs in anticipated directions. Conclusion. The availability of strong leadership and financial resources were key components to initial implementation success in this study of community agencies in New Mexico. Reliance only on external funding poses risks for sustainment when demoralizing work climates precipitate employee turnover. Strong agency leadership does not always compensate for deficient financial resources in vulnerable communities.

Adoption and diffusion of evidence-based addiction medications in substance abuse treatment

OBJECTIVE

To examine the roles of facility- and state-level factors in treatment facilities' adoption and diffusion of pharmaceutical agents used in addiction treatment.

DATA SOURCES

Secondary data from the National Survey of Substance Abuse Treatment Services (N-SSATS), Substance Abuse and Mental Health Services Administration (SAMHSA), Centers for Medicare and Medicaid Services, Alcohol Policy Information System, and Kaiser Family Foundation.

STUDY DESIGN

We estimate ordered logit and multinomial logit models to examine the relationship of state and treatment facility characteristics to the adoption and diffusion of three pharmaceutical agents over 4 years when each was at a different stage of adoption or diffusion.

DATA COLLECTION

N-SSATS data with facility codes, obtained directly from SAMHSA, were linked by state identifiers to the other publicly available, secondary data.

PRINCIPAL FINDINGS

The analysis confirms the importance of awareness and exposure to the adoption behavior of others, dissemination of information about the feasibility and effectiveness of innovations, geographical clustering, and licensing and accreditation in legitimizing facilities' adoption and continued use of pharmacotherapies in addiction treatment.

CONCLUSIONS

Policy and administrative levers exist to increase the availability of pharmaceutical technologies and their continued use by substance abuse treatment facilities.

Recovery from schizophrenia and the role of evidence-based psychosocial interventions

Recovery is the new vision for mental health services, in which two definitions of recovery dominate. Firstly, recovery is an outcome; research suggests that many people with serious mental illness learn to cope with their disabilities so they can achieve major life goals related to independent living. Secondly, recovery is a process; it reintroduces such important values as hope, empowerment and goal orientation into the service system. Both definitions have data that support its assertions, suggesting that an integration of the two offers the most complete and effective picture of recovery. Psychosocial interventions integrated with psychopharmacological strategies have been shown to most effectively help individuals recover. Effective interventions are those that are evidence based and include, illness management, supported employment, assertive community treatment, services to families and dually diagnosed services.

Implementation Science

The field of implementation research is remarkable in many ways and, even as a young discipline, it has expanded well beyond the expectations of even its most optimistic supporters and stakeholders. In this overview we provide a selective rather than systematic review to serve as a relevant introduction to the field of implementation science. We highlight central concepts, strategies, frameworks, and research outcomes. These highlights draw heavily on the seminal systematic reviews from Brownson, Colditz, and Proctor (2012) , Fixsen, Naoom, Blase, Friedman, and Wallace (2005) , and Greenhalgh, Robert, MacFarlane, Bate, and Kyriakidou (2004) and on a thorough comparative review of implementation frameworks conducted by Meyers, Durlak, and Wandersman (2012) . Looking ahead to future implementation research, we consider research challenges related to the scaling up of programs, striking a good balance between treatment integrity and local adaptation, measuring implementation quality, and program sustainability.

Addiction treatment centers' progress in preparing for health care reform

The Patient Protection and Affordable Care Act (PPACA) is expected to significantly alter addiction treatment service delivery. Researchers designed the Health Reform Readiness Index (HRRI) for addiction treatment organizations to assess their readiness for the PPACA. Four-hundred twenty-seven organizations completed the HRRI throughout a 3-year period, using a four-point scale to rank their readiness on 13 conditions. HRRI results completed during two different time periods (between 10/1/2010-6/30/2011 and 9/1/2011-9/30/2012) were analyzed and compared. Most respondents self-assessed as being in the early stages of preparation for 9 of the 13 conditions. Survey results showed that organizations with annual budgets < $5 million (n=295) were less likely to be prepared for the PPACA than organizations with annual budgets > $5 million (n=132). The HRRI results suggest that the addiction field, and in particular smaller organizations, is not preparing adequately for health care reform; organizations that are making preparations are making only modest gains.

Facilitating factors in implementing four evidence-based practices: reports from addiction treatment staff

In this Robert Wood Johnson Foundation-funded study (2009-2011), treatment staff (n = 178) from 330 federally funded U.S. addiction treatment programs provided data through semistructured telephone interviews about factors that facilitated their implementation of four evidence-based practices (EBPs). Such studies can assist the addiction field in improving EBP implementation and ultimately, client care.

RESEARCH QUESTIONS

What factors were identified as facilitating implementation of the four EBPs? And, Do facilitating factors vary by EBP? Coders classified facilitating factors (n = 518) using a six-category schema. Results showed that although facilitating factors varied by EBP, organization-related factors dominated. Study implications and limitations are described.

Individual Worker-Level Attitudes Toward Empirically Supported Treatments

OBJECTIVES: There is a growing literature indicating that organizational and individual worker-level factors affect decisions about whether or not empirically supported treatments (ESTs) are adopted within health care agencies. The purpose of this pilot study is to further investigate and measure worker's attitudes within a community organization. METHOD: A small organization participated in the study due to their diversity in services offered. Of the 92 workers eligible for participation in the study, 66 (72%) completed the Evidence-Based Practice Attitude scale survey. RESULTS: Multivariate analyses revealed that female workers scored higher on both Openness and total score; workers with nursing, education, or psychology majors scored lower than workers with other (excluding social work) majors on both Divergence and total score; and that older workers scored higher on Divergence. CONCLUSION: Although small, this study identifies individual characteristics that are most likely to fit the profile of an EST adopter.

Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation

OBJECTIVE

Leadership is important in practice change, yet there are few studies addressing this issue in mental health and social services. This study examined the differential roles of transformational (i.e., charismatic) leadership and leader-member exchange (i.e., the relationship between a supervisor and their direct service providers) on team innovation climate (i.e., openness to new innovations) and provider attitudes toward adopting evidence-based practice (EBP) during a statewide evidence-based practice implementation (EBPI) of an intervention to reduce child neglect.

METHOD

Participants were 140 case-managers in 30 teams providing home-based services to families in a statewide child-welfare system. Teams were assigned by region to EBPI or services as usual (SAU) conditions. Multiple group path analysis was used to examine associations of transformational leadership and leader-member exchange with innovation climate and attitudes toward adoption and use of EBP.

RESULTS

Transformational leadership predicted higher innovation climate during implementation, whereas leader-member exchange predicted higher innovation climate during SAU. Innovation climate was, in turn, associated with more positive attitudes toward EBP for the EBPI group.

CONCLUSIONS

Strategies designed to enhance supervisor transformational leadership have the potential to facilitate implementation efforts by promoting a strong climate for EBPI and positive provider attitudes toward adoption and use of EBP.

Improvement in symptoms versus functioning: how do our best treatments measure up?

We examined the effects of redefining standards of evidence for treatments targeting childhood mental health problems by expanding outcomes beyond symptom reduction to include functioning. Over 750 treatment protocols from 435 randomized controlled trials were rated based on empirical evidence. Nearly two-thirds (63.9%) demonstrated at least a minimum level of evidence for reducing symptoms; however, only 18.8% of treatments demonstrated evidence for reducing functional impairment. Of those treatments with empirical support for symptom reduction, the majority did not demonstrate empirical support for improvement in functioning because measures of functioning were not included in the studies in which these treatments were tested. However, even when measures of functioning were included, it was much more difficult for treatments to achieve improvement. Among treatments that achieved improvement in functioning, the most notable were Collaborative Problem Solving for disruptive behavior and Cognitive Behavioral Therapy plus Medication for traumatic stress because they demonstrated no support for symptom reduction but good support for improvement in functioning. Results are discussed within the context of evaluating the standards of evidence for treatments and the opportunity to move towards a multidimensional framework whose utility has the potential to exceed the sum of its parts.

Evidence-based practice implementation in Kansas

Over the last 8 years, Kansas has been successful in the implementation of evidence-based practices. This paper describes the strategies used at multiple levels of the mental health system including: state policy, provider agency management, fidelity and outcome monitoring, supervisor training and support, and practitioner training. The challenges going forth are described.

Organizational and clinical implications of integrating an alcohol screening and brief intervention within non-substance abuse serving agencies

Although there have been efforts to advance evidenced-based practices into community-based organizations the limited successes of dissemination and poor implementation of efficacious treatments within these organizations are beginning to be documented. This article builds on the knowledge gained from organizational research and those internal structures (e.g., culture and climate), which possibly impede or enhance evidenced-based practice implementation within community-based organizations. While there are many evidenced-based practices available to human services organizations, there seems to be a gap between research and the implementation of these clinical practices. Recommendations are provided to better enable community-based organizations to integrate evidenced-based practice into its existing service structures.

Barriers to evidence-based practice implementation: results of a qualitative study

This study reports on a qualitative study of barriers to EBP implementation in one state that sought to implement supported employment and integrated dual diagnosis treatment. The study found that the most significant obstacles emanated from the behavior of supervisors, front-line staff and other professionals in the agency. A lack of synergy profoundly impeded implementation.

The sustainability of evidence-based practices in routine mental health agencies

The research presented here reports on sustainability of the practices within the National Implementing Evidence Based Practices Project for people with serious mental illness. Forty-nine sites completed the initial 2-year implementation phase and were the focus of our study. Our aims were to discern the number of sites that sustained practices 2 years after implementation, the reasons for sustaining or not sustaining, differences in characteristics between the two groups, and the extent and nature of practice adaptations. We used a mixed-methods approach, based on a telephone survey that gathered qualitative and quantitative data from site representatives and others familiar with the sites and practices during the follow-up period. We found that 80% of sites sustained their practices for 2 years post-implementation, that sustainers differed from non-sustainers in several domains: financing, training, fidelity and agency leadership, and that most sites adapted practices moderately to meet state and local needs.

A pan-Canadian evaluation of supported employment programs dedicated to people with severe mental disorders

Supported employment (SE) is an evidence-based practice that helps people with severe mental disorders obtain competitive employment. The implementation of SE programs in different social contexts has led to adaptations of the SE components, therefore impacting the fidelity/quality of these services. The objective of this study was to assess the implementation of SE services in three Canadian provinces by assessing the fidelity and describing components of SE services using the Quality of Supported Employment Implementation Scale. About 23 SE programs participated in this study. Cluster analyses revealed six profiles of SE programs that varied from high to low level of fidelity with a stronger focus on a particular component, and reflected the reality of service delivery settings. Future investigations are warranted to evaluate relationships between the levels of implementation of SE components and work outcomes while considering individual characteristics of people registered in SE programs.

Implementation of evidence-based practices for treatment of alcohol and drug disorders: the role of the state authority

The current climate of increasing performance expectations and diminishing resources, along with innovations in evidence-based practices (EBPs), creates new dilemmas for substance abuse treatment providers, policymakers, funders, and the service delivery system. This paper describes findings from baseline interviews with representatives from 49 state substance abuse authorities (SSAs). Interviews assessed efforts aimed at facilitating EBP adoption in each state and the District of Columbia. Results suggested that SSAs are concentrating more effort on EBP implementation strategies such as education, training, and infrastructure development, and less effort on financial mechanisms, regulations, and accreditation. The majority of SSAs use EBPs as a criterion in their contracts with providers, and just over half reported that EBP use is tied to state funding. To date, Oregon remains the only state with legislation that mandates treatment expenditures for EBPs; North Carolina follows suit with legislation that requires EBP promotion within current resources.

Understanding community mental health administrators' perspectives on dialectical behavior therapy implementation

In this study, key informant interviews were conducted with 13 administrators from nine community-based mental health agencies implementing dialectical behavior therapy in order to assess their perspectives on implementation. Four major themes were identified. They include opinions about dialectical behavior therapy and its fit with existing practices, resource concerns (for example, reimbursement issues, time commitment, and staff training), staff selection for training and staff turnover, and ongoing client referrals. Understanding agency administrators' unique perspectives and addressing their concerns is critical to treatment implementation given administrators' role in determining whether and how a treatment will be implemented. Better understanding of the fit between dialectical behavior therapy and existing service structures, the impact of staff turnover on implementation, and the resources required for implementation are all needed to ensure successful implementation and sustainability.

What gets noticed: how barrier and facilitator perceptions relate to the adoption and implementation of innovative mental health practices

This mixed-method study examined the facilitators and barriers discussed by 166 informants interviewed from 78 innovative mental health projects. Facilitator and barrier coding reflected two dimensions: the topic of the comment (e.g., funding); and the time phase of the issue's influence (e.g., pre-decision). Proportions of facilitators to the sum of facilitator and barrier comments made by project informants were calculated. Overall, facilitator proportions were higher for projects that proceeded with implementation than those that did not adopt the practice. In addition, facilitator proportions were generally highest at pre-decision and lowest at full implementation for implementing projects.

Filling service gaps: Providing intensive treatment services for offenders

Consistent with the few studies that have previously examined treatment prevalence and access in the adult and juvenile justice systems, the recent National Criminal Justice Treatment Practices (NCJTP) survey indicated that there is a particular need to expand intensive treatment modalities for offenders in both institutional and community corrections settings. Applying multilevel modeling techniques to NCJTP survey data, this study explores conditions and factors that may underlie the wide variation among states in the provision of intensive treatment for offenders. Results indicate that states' overall rates of substance abuse and dependence, funding resources, and the state governor's political party affiliation were significantly associated with intensive treatment provision. Numerous factors that have been implicated in recent studies of evidence-based practice adoption, including state agency executives' views regarding rehabilitation, agency culture and climate, and other state-level measures (e.g., household income, crime rates, expenditures on treatment for the general population) were not associated with treatment provision. Future research should examine further variations in offenders' service needs, the role of legislators' political affiliations, and how other factors may interact with administrator characteristics in the adoption and expansion of intensive treatment services for offenders.

An evaluation of an initiative to improve coordination and service delivery of homeless services networks

This study examines system changes associated with the implementation of the Collaborative Initiative to Help End Chronic Homelessness, an 11-site multi-agency intervention for chronically homeless adults. Data obtained from key informants on community-level interventions and interorganizational relationships were gathered from an average of 6.6 agencies at each site in four yearly waves. Hierarchical linear modeling was used to examine time trends and bivariate relationships between measures. There were significant increases over the full study period in the use of practices designed to encourage system integration, as well as in interorganizational measures of joint planning and coordination, and of trust and respect, although in later waves of the study these measures leveled off. There were also highly significant and positive cross-sectional associations between the use of practices designed to encourage system integration and direct measures of service system integration as well as between measures of change in these system characteristics.

What gets noticed: how barrier and facilitator perceptions relate to the adoption and implementation of innovative mental health practices

This mixed-method study examined the facilitators and barriers discussed by 166 informants interviewed from 78 innovative mental health projects. Facilitator and barrier coding reflected two dimensions: the topic of the comment (e.g., funding); and the time phase of the issue's influence (e.g., pre-decision). Proportions of facilitators to the sum of facilitator and barrier comments made by project informants were calculated. Overall, facilitator proportions were higher for projects that proceeded with implementation than those that did not adopt the practice. In addition, facilitator proportions were generally highest at pre-decision and lowest at full implementation for implementing projects.

Role of state policies in the adoption of naltrexone for substance abuse treatment

OBJECTIVE

To examine state policies associated with adoption of a pharmaceutical agent-naltrexone-by substance abuse treatment facilities to treat alcohol-dependent clients.

DATA SOURCES

Facility-level data from the 2003 National Survey of Substance Abuse Treatment Services, and state-level data on policy and environmental factors from publicly available sources.

STUDY DESIGN

We use facility- and state-level data in a cross-sectional, multilevel model to analyze state-level policies that are associated with treatment facilities' naltrexone adoption.

DATA COLLECTION/EXTRACTION METHODS

The analysis uses survey data.

PRINCIPAL FINDINGS

State Medicaid policies supporting the use of generic drugs, reducing drug costs, and permitting managed care organizations to establish policies encouraging use of generics were associated with higher odds of naltrexone adoption (by up to 96 percent). State policies limiting access to pharmaceutical technologies through Medicaid preferred drug lists, restricting access to pharmacy networks, and imposing general limitations on use of Medicaid benefits for rehabilitation for substance abuse treatment were associated with reduced odds of naltrexone adoption.

CONCLUSIONS

Policy levers that are available to state governments are associated with the adoption of pharmaceutical technologies such as naltrexone that could help meet widespread need for access to clinically proven and cost-effective treatments for substance abuse.