A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions

Achieving successful evidence-based practice implementation in juvenile justice: The importance of diagnostic and evaluative capacity

Evidence-based programs (EBPs) are an increasingly visible aspect of the treatment landscape in juvenile justice. Research demonstrates that such programs yield positive returns on investment and are replacing more expensive, less effective options. However, programs are unlikely to produce expected benefits when they are not well-matched to community needs, not sustained and do not reach sufficient reach and scale. We argue that achieving these benchmarks for successful implementation will require states and county governments to invest in data-driven decision infrastructure in order to respond in a rigorous and flexible way to shifting political and funding climates. We conceptualize this infrastructure as diagnostic capacity and evaluative capacity: Diagnostic capacity is defined as the process of selecting appropriate programing and evaluative capacity is defined as the ability to monitor and evaluate progress. Policy analyses of Washington State, Pennsylvania and Louisiana's program implementation successes are used to illustrate the benefits of diagnostic and evaluate capacity as a critical element of EBP implementation.

A review of diabetes prevention program translations: use of cultural adaptation and implementation research

The Diabetes Prevention Program (DPP) has been shown to prevent type 2 diabetes through lifestyle modification. The purpose of this study was to describe the literature on DPP translation, synthesizing studies using cultural adaptation and implementation research. A systematic search was conducted. Original studies evaluating DPP implementation and/or cultural adaptation were included. Data about cultural adaptation, implementation outcomes, and translation strategies was abstracted. A total of 44 were included, of which 15 reported cultural adaptations and 38 explored implementation. Many studies shortened the program length and reported a group format. The most commonly reported cultural adaptation (13 of 15) was with content. At the individual level, the most frequently assessed implementation outcome (n = 30) was adoption. Feasibility was most common (n = 32) at the organization level. The DPP is being tested in a variety of settings and populations, using numerous translational strategies and cultural adaptations. Implementation research that identifies, evaluates, and reports efforts to translate the DPP into practice is crucial.

COSMOS--improving the quality of life in nursing home patients: protocol for an effectiveness-implementation cluster randomized clinical hybrid trial

BACKGROUND

Nursing home patients have complex mental and physical health problems, disabilities and social needs, combined with widespread prescription of psychotropic drugs. Preservation of their quality of life is an important goal. This can only be achieved within nursing homes that offer competent clinical conditions of treatment and care. COmmunication, Systematic assessment and treatment of pain, Medication review, Occupational therapy, Safety (COSMOS) is an effectiveness-implementation hybrid trial that combines and implements organization of activities evidence-based interventions to improve staff competence and thereby the patients' quality of life, mental health and safety. The aim of this paper is to describe the development, content and implementation process of the COSMOS trial.

METHODS/DESIGN

COSMOS includes a 2-month pilot study with 128 participants distributed among nine Norwegian nursing homes, and a 4-month multicenter, cluster randomized effectiveness-implementation clinical hybrid trial with follow-up at month 9, including 571 patients from 67 nursing home units (one unit defined as one cluster). Clusters are randomized to COSMOS intervention or current best practice (control group). The intervention group will receive a 2-day education program including written guidelines, repeated theoretical and practical training (credited education of caregivers, physicians and nursing home managers), case discussions and role play. The 1-day midway evaluation, information and interviews of nursing staff and a telephone hotline all support the implementation process. Outcome measures include quality of life in late-stage dementia, neuropsychiatric symptoms, activities of daily living, pain, depression, sleep, medication, cost-utility analysis, hospital admission and mortality.

DISCUSSION

Despite complex medical and psychosocial challenges, nursing home patients are often treated by staff possessing low level skills, lacking education and in facilities with a high staff turnover. Implementation of a research-based multicomponent intervention may improve staff's knowledge and competence and consequently the quality of life of nursing home patients in general and people with dementia in particular.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02238652.

Methods to Improve the Selection and Tailoring of Implementation Strategies

Implementing behavioral health interventions is a complicated process. It has been suggested that implementation strategies should be selected and tailored to address the contextual needs of a given change effort; however, there is limited guidance as to how to do this. This article proposes four methods (concept mapping, group model building, conjoint analysis, and intervention mapping) that could be used to match implementation strategies to identified barriers and facilitators for a particular evidence-based practice or process change being implemented in a given setting. Each method is reviewed, examples of their use are provided, and their strengths and weaknesses are discussed. The discussion includes suggestions for future research pertaining to implementation strategies and highlights these methods' relevance to behavioral health services and research.

The Consolidated Framework for Implementation Research (CFIR): a useful theoretical framework for guiding and evaluating a guideline implementation process in a hospital-based nursing practice

Background

Implementing clinical practice guidelines (CPGs) in healthcare settings is a complex intervention involving both independent and interdependent components. Although the Consolidated Framework for Implementation Research (CFIR) has never been evaluated in a practical context, it appeared to be a suitable theoretical framework to guide an implementation process. The aim of this study was to evaluate the comprehensiveness, applicability and usefulness of the CFIR in the implementation of a fall-prevention CPG in nursing practice to improve patient care in an Austrian university teaching hospital setting.

Methods

The evaluation of the CFIR was based on (1) team-meeting minutes, (2) the main investigator’s research diary, containing a record of a before-and-after, mixed-methods study design embedded in a participatory action research (PAR) approach for guideline implementation, and (3) an analysis of qualitative and quantitative data collected from graduate and assistant nurses in two Austrian university teaching hospital departments. The CFIR was used to organise data per and across time point(s) and assess their influence on the implementation process, resulting in implementation and service outcomes.

Results

Overall, the CFIR could be demonstrated to be a comprehensive framework for the implementation of a guideline into a hospital-based nursing practice. However, the CFIR did not account for some crucial factors during the planning phase of an implementation process, such as consideration of stakeholder aims and wishes/needs when implementing an innovation, pre-established measures related to the intended innovation and pre-established strategies for implementing an innovation. For the CFIR constructs reflecting & evaluating and engaging, a more specific definition is recommended. The framework and its supplements could easily be used by researchers, and their scope was appropriate for the complexity of a prospective CPG-implementation project. The CFIR facilitated qualitative data analysis and provided a structure that allowed project results to be organised and viewed in a broader context to explain the main findings.

Conclusions

The CFIR was a valuable and helpful framework for (1) the assessment of the baseline, process and final state of the implementation process and influential factors, (2) the content analysis of qualitative data collected throughout the implementation process, and (3) explaining the main findings.

Electronic supplementary material

The online version of this article (doi:10.1186/s12912-015-0088-4) contains supplementary material, which is available to authorized users.

Life Balance - a mindfulness-based mental health promotion program: conceptualization, implementation, compliance and user satisfaction in a field setting

Background

Mental health disorders account for a large percentage of the total burden of illness and constitute a major economic challenge in industrialized countries. Several prevention programs targeted at high-risk or sub-clinical populations have been shown to decrease risk, to increase quality of life, and to be cost-efficient. However, there is a paucity of primary preventive programs aimed at the general adult population. “Life Balance” is a program that employs strategies borrowed from well-established psychotherapeutic approaches, and has been made available to the public in one federal German state by a large health care insurance company. The data presented here are the preliminary findings of an ongoing field trial examining the outcomes of the Life Balance program with regard to emotional distress, life satisfaction, resilience, and public health costs, using a matched control group design.

Methods

Life Balance courses are held at local health-care centers, in groups of 12 to 15 which are led by laypeople who have been trained on the course materials. Participants receive instruction on mindfulness and metacognitive awareness, and are assigned exercises to practice at home. Over an 8-month period in 2013–2014, all individuals who signed up for the program were invited at the time of enrollment to take part in a study involving the provision of psychometric data and of feedback on the course. A control group of subjects was invited to complete the questionnaires on psychometric data but did not receive any intervention.

Results

Of 4,898 adults who attended Life Balance courses over the specified period, 1,813 (37.0 %) provided evaluable study data. The average age of study participants was 49.5 years, and 83 % were female. At baseline, participants’ self-reported symptoms of depression and anxiety, life satisfaction, and resilience were significantly higher than those seen in the general German population. Overall, evaluations of the course were positive, and 83 % of participants attended at least at 6 of the 7 sessions. Some sociodemographic correlations were noted: men carried out the assigned exercises less often than did women, and younger participants practiced mindfulness less frequently than did older ones. However, satisfaction and compliance with the program were similar across all sociodemographic categories.

Conclusions

While the Life Balance program is publicized as a primary prevention course that is not directed at a patient population, the data indicate that it was utilized by people with a significant mental health burden, and that the concept can be generalized to a broad population. As data from the control group are not yet available, conclusions about effectiveness cannot yet be drawn.

Trial registration

German Clinical Trials Registration ID: DRKS00006216

Identifying priorities in knowledge translation from the perspective of trainees: results from an online survey

Background

The need to identify priorities to help shape future directions for research and practice increases as the knowledge translation (KT) field advances. Since many KT trainees are developing their research programs, understanding their concerns and KT research and practice priorities is important to supporting the development and advancement of KT as a field. Our purpose was to identify research and practice priorities in the KT field from the perspectives of KT researcher/practitioner trainees.

Findings

Survey response rate was 62 % (44/71). Participants were mostly Canadian graduate students, post-doctoral fellows, residents, and learners from various disciplines; the majority was from Ontario (44 %) and Quebec (20 %). Seven percent (5/71) were from other countries including USA, UK, and Switzerland. Seven main KT priority themes were identified: determining the effectiveness of KT strategies, technology use, increased key stakeholder involvement, context, theory, expand ways of inquiry, and sustainability.

Conclusions

Overall, the priorities identified by the trainees correspond with KT literature and with KT experts’ views. The trainees appeared to push the boundaries of current KT literature with respect to creative use of communication technologies research.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0282-5) contains supplementary material, which is available to authorized users.

Building Agency Capacity for Trauma-Informed Evidence-Based Practice and Field Instruction

Through this article the authors describe how schools of social work offering a child and adolescent trauma specialization actively partnered with their community-based field placement agencies to achieve a dual purpose: help agencies sustain the capacity for evidence-based trauma treatment (EBTT) and provide sufficient EBTT MSW student field placement sites that support preparation of trauma-informed practitioners by schools of social work. Development and description of the specific conceptual framework used to inform the trauma-informed organizational change initiative is described. Results of an Organizational Readiness assessment undertaken at six agencies reflect a strong alignment between implementation drivers identified in the literature (Fixsen, Blase, Naoom, & Wallace, 2009) and the conceptual framework. The manner in which these results are being used by schools of social work and their agency partners in sustaining the implementation of evidence-based trauma treatment is reviewed, and implications for future research, education, and practice is discussed.

Cultural Adaptation and Implementation of Evidence-Based Parent-Training: A Systematic Review and Critique of Guiding Evidence

With advances in knowledge regarding efficacious evidence-based interventions, there have been significant attempts to culturally adapt, implement, and disseminate parent training interventions broadly, especially across ethnic and cultural groups. We sought to examine the extent to which researchers and developers of evidence-based parent training programs have used cultural adaptation models, tested implementation strategies, and evaluated implementation outcomes when integrating the interventions into routine care by conducting a systematic review of the literature for four evidence-based parent training interventions: Parent-Child Interaction Therapy (PCIT), The Incredible Years (IY), Parent Management Training-Oregon Model (PMTO™), and the Positive Parenting Program (Triple P). A total of 610 articles across the four programs were identified. Of those, only eight documented a rigorous cultural adaptation process, and only two sought to test the effectiveness of implementation strategies by using rigorous research designs. Our findings suggest that there is much work to be done to move parent-training intervention research towards a more rigorous examination of cultural adaptation and implementation practices.

Practitioner perspectives of implementing check & connect

While there is a growing reserve of evidence-based practices (EBPs) available to practitioners, much can be learned about how to implement EBPs in real-world settings. Evidence of the effects of a widely disseminated student engagement intervention, Check & Connect (C&C), is emerging yet little is known about the implementation of C&C in community-based settings. The purpose of the authors in this study was to examine practitioner attitudes and perspectives related to the C&C intervention and implementation to gain an understanding of core implementation components that facilitated or impeded implementation. A researcher-developed survey instrument was used to assess practitioner attitudes related to the C&C model and implementation among 14 school-based practitioners working in a dropout prevention program. Findings indicate that practitioners were highly positive about the C&C intervention and in their attitudes about implementing EBPs. Benefits of C&C identified by practitioners included increased relationship building with students, tracking students on a consistent and timely basis, and addressing attendance issues as a main focus of treatment. The most common implementation challenges were time constraints, paperwork, and targeting absentee students. These findings contribute to the emerging literature on C&C and the implementation of EBPs in schools and community-based settings.

Expert Recommendations for Implementing Change (ERIC): protocol for a mixed methods study

BACKGROUND

Identifying feasible and effective implementation strategies that are contextually appropriate is a challenge for researchers and implementers, exacerbated by the lack of conceptual clarity surrounding terms and definitions for implementation strategies, as well as a literature that provides imperfect guidance regarding how one might select strategies for a given healthcare quality improvement effort. In this study, we will engage an Expert Panel comprising implementation scientists and mental health clinical managers to: establish consensus on a common nomenclature for implementation strategy terms, definitions and categories; and develop recommendations to enhance the match between implementation strategies selected to facilitate the use of evidence-based programs and the context of certain service settings, in this case the U.S. Department of Veterans Affairs (VA) mental health services.

METHODS/DESIGN

This study will use purposive sampling to recruit an Expert Panel comprising implementation science experts and VA mental health clinical managers. A novel, four-stage sequential mixed methods design will be employed. During Stage 1, the Expert Panel will participate in a modified Delphi process in which a published taxonomy of implementation strategies will be used to establish consensus on terms and definitions for implementation strategies. In Stage 2, the panelists will complete a concept mapping task, which will yield conceptually distinct categories of implementation strategies as well as ratings of the feasibility and effectiveness of each strategy. Utilizing the common nomenclature developed in Stages 1 and 2, panelists will complete an innovative menu-based choice task in Stage 3 that involves matching implementation strategies to hypothetical implementation scenarios with varying contexts. This allows for quantitative characterizations of the relative necessity of each implementation strategy for a given scenario. In Stage 4, a live web-based facilitated expert recommendation process will be employed to establish expert recommendations about which implementations strategies are essential for each phase of implementation in each scenario.

DISCUSSION

Using a novel method of selecting implementation strategies for use within specific contexts, this study contributes to our understanding of implementation science and practice by sharpening conceptual distinctions among a comprehensive collection of implementation strategies.