A conceptual framework for transferring research to practice

Adaptability, Scalability and Sustainability (ASaS) of complex health interventions: a systematic review of theories, models and frameworks

BACKGROUND

Complex health interventions (CHIs) are increasingly used in public health, clinical research and education to reduce the burden of disease worldwide. Numerous theories, models and frameworks (TMFs) have been developed to support implementation of CHIs. This systematic review aims to identify and critique theoretical frameworks concerned with three features of implementation; adaptability, scalability and sustainability (ASaS). By dismantling the constituent theories, analysing their component concepts and then exploring factors that influence each theory the review team hopes to offer an enhanced understanding of considerations when implementing CHIs.

METHODS

This review searched PubMed MEDLINE, CINAHL, Web of Science, and Google Scholar for research investigating the TMFs of complex health interventions. Narrative synthesis was employed to examine factors that may influence the adaptability, scalability and sustainability of complex health interventions.

RESULTS

A total of 9763 studies were retrieved from the five databases (PubMed, MEDLINE, CINAHL, Web of Science, and Google Scholar). Following removal of duplicates and application of the eligibility criteria, 35 papers were eligible for inclusion. Influencing factors can be grouped within outer context (socio-political context; leadership funding, inter-organisational networks), inner context; (client advocacy; organisational characteristics), intervention characteristics (supervision, monitoring and evaluation), and bridging factors (individual adopter or provider characteristics).

CONCLUSION

This review confirms that identified TMFS do not typically include the three components of adaptability, scalability, and sustainability. Current approaches focus on high income countries or generic "whole world" approaches with few frameworks specific to low- and middle-income countries. The review offers a starting point for further exploration of adaptability, scalability and sustainability, within a low- and middle-income context.

TRIAL REGISTRATION

Not registered.

Addressing adverse social determinants of health in pediatric primary care: Study protocol for a hybrid type 2 effectiveness-implementation randomized controlled trial in two national pediatric practice-based research networks

BACKGROUND

Growing evidence linking social determinants of health (SDOH) to child health outcomes has prompted widespread recommendations for pediatricians to screen and refer for adverse SDOH at primary care visits. Yet there is little evidence to date demonstrating the effectiveness of practice-based SDOH screening and referral interventions on increasing family engagement with resources. This hybrid type 2 effectiveness-implementation trial aims to demonstrate the non-inferiority of a low-touch implementation strategy in order to facilitate dissemination of an existing SDOH screening and referral system (WE CARE) and demonstrate its effectiveness and sustainability in various pediatric practices.

METHODS

We recruited eighteen pediatric practices in fourteen US states through two pediatric practice-based research networks. For this stepped wedge cluster RCT, practices serve as their own controls during the Usual Care phase and implement WE CARE during the intervention phase via one of two randomized implementation strategies: self-directed, pre-recorded webinar vs. study team-facilitated, live webinar. We collect data at practice, clinician/staff, and parent levels to assess outcomes grounded in the Proctor Conceptual Model of Implementation Research. We use generalized mixed effects models and differences in proportions to compare rates of resource referrals by implementation strategy, and intention-to-treat analysis to compare odds of engagement with new resources among families enrolled in the Usual Care vs. WE CARE phases.

DISCUSSION

Findings from this trial may inform decisions about broader dissemination of SDOH screening systems into a diverse spectrum of pediatric practices across the US and potentially minimize the impact of adverse SDOH on children and families.

An unexplored equity factor: differential beliefs and attitudes toward contingency management by providers' ethnicity

BACKGROUND

Although considered one of the most effective interventions for substance use disorders (SUD), the widespread implementation of contingency management (CM) has remained limited. In more recent years there has been surge in the implementation of CM to address increasing rates of substance use. Prior studies at the provider-level have explored beliefs about CM among SUD treatment providers and have tailored implementation strategies based on identified barriers and training needs, to promote implementation of CM. However, there have been no implementation strategies that have actively sought to identify or address potential differences in the beliefs about CM that could be influenced by the cultural background (e.g., ethnicity) of treatment providers. To address this knowledge gap, we examined beliefs about CM among a sample of inpatient and outpatient SUD treatment providers.

METHODS

A cross-sectional survey of SUD treatment providers was completed by 143 respondents. The survey asked respondents about their attitudes toward CM using the Contingency Management Beliefs Questionnaire (CMBQ). Linear mixed models examined the effect of ethnicity (non-Hispanic White and Hispanic) on CMBQ subscale (general barriers, training-related barriers, CM positive-statements) scores.

RESULTS

Fifty-nine percent of respondents to the CMBQ self-identified as non-Hispanic White and 41% as Hispanic. Findings revealed that treatment providers who identified as Hispanic had significantly higher scores on the general barriers (p < .001) and training-related barriers (p = .020) subscales compared to the non-Hispanic White treatment providers. Post-hoc analyses identified differences in the endorsement of specific individual scale items on the general barriers (e.g., CM interventions create extra work for me) and training-related (e.g., I want more training before implementing CM) subscales.

CONCLUSIONS

Dissemination and implementation strategies for CM need to consider equity-related factors at the provider-level that may be associated with the adoption and uptake of CM.

An Exploration of Organizational Characteristics and Training Adoption in Irish Community Drug Treatment Services

BACKGROUND

Changes in patterns of drug use and population needs necessitate the adoption of new technologies. Despite high failure rates in adopting new technologies acquired in training, little is known about the process that can support successful change. This study explores the impact that staff and service characteristics have on the process of training adoption in Irish opiate substitution therapy services, with a specific focus on the concept of organizational readiness to change.

METHODS

A cross-sectional survey was conducted on a convenience sample of 132 staff members across 12 services in Ireland. The relationship between staff demographics, their perceptions of organizational readiness to change, burnout, and a four-stage process of training adoption were considered.

RESULTS

Discipline, job tenure, and educational levels are important predictors of engagement in the adoption process. Staff in services with higher institutional needs, greater pressures for change, and poorer resources were less likely to be exposed to, or adopt, training. Having lower levels of stress and more influence with peers was associated with better adoption of training.

CONCLUSIONS

Planners and service managers need to carefully consider the composition or dynamics of services when initiating change. Organizational readiness to change and staff characteristics as measured by instruments used in this study are important determinants of the process of innovation or training adoption and provide a good basis for developing further understanding of how treatment services work. This article expands on results from previous studies conducted in the United States to a European context.

An Unexplored Equity Factor During Pre-Implementation of Contingency Management: Differential Beliefs and Attitudes by Providers' Ethnicity

Background Although considered one of the most effective interventions for substance use disorders (SUD), the widespread uptake of contingency management (CM) has remained limited. Prior studies at the provider-level have explored beliefs about CM among SUD treatment providers and have tailored implementation strategies based on identified barriers and training needs. However, there have been no implementation strategies that have actively sought to identify or address potential differences in the beliefs about CM that could be influenced by the cultural background (e.g., ethnicity) of treatment providers. To address this knowledge gap, we examined beliefs about CM among a sample of inpatient and outpatient SUD treatment providers. Methods A cross-sectional survey of SUD treatment providers was completed by 143 respondents. The survey asked respondents about their attitudes toward CM using the Contingency Management Beliefs Questionnaire (CMBQ). Linear mixed models were used to examine the effect of ethnicity on CMBQ subscale (general barriers, training-related barriers, CM positive-statements) scores. Results Fifty-nine percent of respondents self-identified as non-Hispanic White and 41% as Hispanic. Findings revealed that SUD providers who identified as Hispanic had significantly higher scores on the general barriers (p < .001) and training-related barriers (p = .020) subscales compared to the non-Hispanic White SUD providers. Post-hoc analyses identified differences in the endorsement of specific individual scale items on the general barriers and training-related subscales. Conclusions Dissemination and implementation strategies for CM among treatment providers need to consider equity-related factors at the provider-level that may be associated with the adoption and uptake CM.

Improving community readiness among Iranian local communities to prevent childhood obesity

BACKGROUND

Community Readiness Intervention for Tackling Childhood Obesity (CRITCO) is a theory-based intervention being developed to improve the readiness of an Iranian urban population to engage in childhood obesity prevention programs. This study aimed to explore changes in readiness of intervention and control local communities from diverse socio-economic areas of Tehran.

METHODS

This study was a seven-month quasi-experimental intervention implemented in four intervention communities and compared with four controls. Aligned strategies and action plans were developed around the six dimensions of community readiness. The Food and Nutrition Committee was established in each intervention community to make collaborative efforts among different sectors and assess the fidelity of the intervention. The pre-and post- readiness change was explored through interviews with 46 community key informants.

RESULTS

The total readiness of intervention sites increased by 0.48 units (p < 0.001) and shifted to the next higher level, from preplanning to the preparation stage. At the same time, the readiness of control communities decreased by 0.39 units (p < 0.001), although their readiness stage remained unchanged, reflecting the fourth stage. Also, a sex-dependent CR change was observed, such that the girls' schools showed a more remarkable improvement in interventions and less decline in controls. The readiness stages of interventions significantly improved for four dimensions related to community efforts, knowledge of the efforts, knowledge of childhood obesity issue, and leadership. Furthermore, the readiness of control communities significantly decreased on three of six dimensions related to community effort, knowledge of efforts, and resources.

CONCLUSIONS

The CRITCO successfully improved the readiness of intervention sites for addressing childhood obesity. It is hoped that the present study can be a spark for developing readiness-based childhood obesity prevention programs in Middle Eastern and other developing countries.

TRIAL REGISTRATION

The CRITCO intervention was registered at Iran Registry for Clinical Trials ( http://irct.ir ; IRCT20191006044997N1) on 11/11/2019.

Continuous quality improvement at the frontline: One interdisciplinary clinical team's four-year journey after completing a virtual learning program

Background

The Veterans Health Administration (VHA) is the largest integrated health system in the U.S. and has identified the learning health system as a strategic priority. Clinicians and staff engaging in active learning through continuous quality improvement (QI) is a key pillar for learning system maturity. An interdisciplinary frontline team at a VHA medical center participated in the Learn. Engage. Act. Process. (LEAP) virtual coaching program to learn how to conduct multidisciplinary team-based QI cycles of change. These clinicians lead and deliver the MOVE! weight management program, an evidence-based comprehensive lifestyle intervention. The team worked to continuously improve patient weight loss by engaging in incremental learning cycles of change. The aim of this study is to tell the story of this team's learning experience and the resulting positive reinforcing loop with patient outcomes.

Methods

This is a mixed methods case study description of one team that participated in the LEAP Program that provides hands-on QI learning for frontline teams with virtual coaching and a structured curriculum. Autoethnographic qualitative descriptions of team experiences over time illustrate this team's continued engagement in learning loops. Multilevel linear modeling was used to assess patient outcomes before vs after the team's participation in LEAP.

Results

The team's participation in LEAP provided a set of fundamental QI skills and established a commitment to continual learning. Incremental improvements led to significant weight loss for patients who participated in MOVE! after the team completed LEAP (mean = 9.80 pounds; SD 10.43) compared to the pre-LEAP time period (mean = -6.83 pounds; SD 9.63).

Conclusions

Despite competing priorities and time limitations, this team's experiences provide a positive vision of how team engagement in data-driven continuous learning is feasible at the frontline and can lead to higher job satisfaction and stronger teams. These types of team activities provide much-needed backbone to being a mature learning health system.

Relationship between clinician-level attributes and implementation outcomes from the Pathways to Comorbidity Care training program

BACKGROUND

The process of determining the best strategy for increasing the uptake of evidence-based practice might be improved through an understanding of relevant clinician-level factors. The Pathways to Comorbidity Care (PCC) training program (Louie E, et al., J Dual Diagnosis 17:304-12, 2021) aimed to facilitate integrated management of comorbid drug and alcohol and mental disorders amongst drug and alcohol clinicians. We hypothesised that uptake of integrated management of comorbidity following the implementation of the PCC program would be associated with clinician-level: (i) demographics (gender, education, experience), (ii) attitudes (evidence-based practice, therapist manuals, counselling self-efficacy), and (iii) organisational readiness to change.

METHODS

Twenty clinicians participated in the 9-month PCC training program. Attitudes towards evidence-based practices and psychotherapist manuals, self-efficacy, and organisational readiness to change, along with demographics, were measured at baseline. At follow-up, change in Comorbidity Practice (CoP) scores related to integrated comorbidity management were obtained using a file audit checklist and categorised into high (at least 60% increase in CoP), medium or low (a decrease of - 20% or less in CoP). Clinician-level characteristics were examined across the implementation categories.

RESULTS

There were no significant differences found between implementation groups on sociodemographic variables (p's > 0.30), attitudes to evidence-based practices, attitudes to therapist manuals, and self-efficacy (p's > 0.52). The high implementation group demonstrated significantly higher scores on leadership practices aspect of organisational readiness to change relative to the low and medium implementation group ((F(2, 16) = 3.63, p = 0.05; Cohen's d = .31) but not on the other subscales (p's > 0.07).

CONCLUSIONS

Confidence that leadership will play a positive role in the implementation process may improve effectiveness of comorbidity training programs for drug and alcohol clinicians. On the other hand, contrary to our hypothesis, counselling self-efficacy, evidence-based practice attitudes, attitudes towards therapist manuals, gender, education and experience were not distinguishing factors.

Measuring Organizational Readiness for Change in Michigan's Home and Community-based Services Program: Instrument Adaptation and Psychometric Testing

Short, valid, and reliable tools that measure organizational readiness are needed in practice. This study adapted and tested a previously developed instrument for measuring organizational readiness in a Medicaid Home and Community-Based Services (HCBS) program. The Texas Christian University Organizational Readiness for Change (TCU-ORC) scale was adapted and tested for validity and reliability in a sample of 522 registered nurses and social workers employed at 18 program sites. Structural validity was established using the exploratory factor analysis. Convergent validity was evaluated via correlations with the Implementation Leadership Scale (ILS) score. The adapted ORC scale consisted of 23 items. Cronbach's alphas for 5 subscales, Climate, Culture, Training, Motivation, and Pressure to Change exceeded .70. Convergent validity was supported by significant moderate correlations with the ILS. The adapted 23-item TCU-ORC scale is a valid and reliable instrument for measuring the organizational readiness for change in the Medicaid Home and Community-Based Services programs.

Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale

Plain Language Summary

Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.

Tools for assessing the scalability of innovations in health: a systematic review

BACKGROUND

The last decade has seen growing interest in scaling up of innovations to strengthen healthcare systems. However, the lack of appropriate methods for determining their potential for scale-up is an unfortunate global handicap. Thus, we aimed to review tools proposed for assessing the scalability of innovations in health.

METHODS

We conducted a systematic review following the COSMIN methodology. We included any empirical research which aimed to investigate the creation, validation or interpretability of a scalability assessment tool in health. We searched Embase, MEDLINE, CINAHL, Web of Science, PsycINFO, Cochrane Library and ERIC from their inception to 20 March 2019. We also searched relevant websites, screened the reference lists of relevant reports and consulted experts in the field. Two reviewers independently selected and extracted eligible reports and assessed the methodological quality of tools. We summarized data using a narrative approach involving thematic syntheses and descriptive statistics.

RESULTS

We identified 31 reports describing 21 tools. Types of tools included criteria (47.6%), scales (33.3%) and checklists (19.0%). Most tools were published from 2010 onwards (90.5%), in open-access sources (85.7%) and funded by governmental or nongovernmental organizations (76.2%). All tools were in English; four were translated into French or Spanish (19.0%). Tool creation involved single (23.8%) or multiple (19.0%) types of stakeholders, or stakeholder involvement was not reported (57.1%). No studies reported involving patients or the public, or reported the sex of tool creators. Tools were created for use in high-income countries (28.6%), low- or middle-income countries (19.0%), or both (9.5%), or for transferring innovations from low- or middle-income countries to high-income countries (4.8%). Healthcare levels included public or population health (47.6%), primary healthcare (33.3%) and home care (4.8%). Most tools provided limited information on content validity (85.7%), and none reported on other measurement properties. The methodological quality of tools was deemed inadequate (61.9%) or doubtful (38.1%).

CONCLUSIONS

We inventoried tools for assessing the scalability of innovations in health. Existing tools are as yet of limited utility for assessing scalability in health. More work needs to be done to establish key psychometric properties of these tools. Trial registration We registered this review with PROSPERO (identifier: CRD42019107095).

Mini-Residencies to Improve Care for Women Veterans: A Decade of Re-Educating Veterans Health Administration Primary Care Providers

Background: Many primary care providers (PCPs) in the Veterans Health Administration need updated clinical training in women's health. The objective was to design, implement, and evaluate a training program to increase participants' comfort with and provision of care to women Veterans, and foster practice changes in women's health care at their local institutions. Methods: The Women's Health Mini-Residency was developed as a multi-day training program, based on principles of adult learning, wherein knowledge gleaned through didactic presentations was solidified during small-group case study discussions and further enhanced by hands-on training and creation of a facility-specific action plan to improve women Veterans' care. Pre, post, and 6-month surveys assessed attendees' comfort with and provision of care to women. The 6-month survey also queried changes in practice, promulgation of program content, and action plan progress. Results: From 2008 to 2019, 2912 PCPs attended 26 programs. A total of 2423 (83.2%) completed pretraining and 2324 (79.3%) completed post-training surveys. The 6-month survey was sent to the 645 attendees from the first 14 programs; 297 (46.1%) responded. Comparison of pre-post responses indicated significant gains in comfort managing all 19 content areas. Six-month data showed some degradation, but comfort remained significantly improved from baseline. At 6 months, participants also reported increases in providing care to women, including performing more breast and pelvic examinations, dissemination of program content to colleagues, and progress on action plans. Conclusions: This interactive program appears to have been successful in improving PCPs' comfort in providing care for women Veterans and empowering them to implement institutional change.

The Action Plan and Strategy Development for the Community Readiness Improvement for Tackling Childhood Obesity (CRITCO) Study

BACKGROUND

Community Readiness Improvement for Tackling Childhood Obesity (CRITCO) study has been developed based on the community readiness model (CRM) to improve the readiness of targeted local communities from two diverse socioeconomic districts of Tehran for tackling childhood obesity (CO) of late primary school children (10 - 12 years of age).

OBJECTIVES

This study aimed to describe the rationale and process of developing the fourth phase of CRITCO study by developing an intervention package.

METHODS

The readiness level data was used to analyze strengths, weaknesses, opportunities, and threats (SWOT) of four intervention sites to guide proper strategies in partnership with key community members. Then, the action plan was developed as a living document to guide a 6-month quasi-experimental community-based intervention around the six dimensions of CRM. Finally, the community engagement process, outcome, and evaluation process were explained.

RESULTS

The current report described the action plan and strategy development of the CRITCO study. Expectedly, this study can provide valuable information to guide the public health policymakers in planning and executing relevant interventions.

Practice change in community health centers: A qualitative study of leadership attributes

Introduction

This paper explores leadership attributes important for practice change in community health centers (CHCs) and assesses attributes' fit with the Full-Range Leadership Theory (FRLT).

Methods

We conducted four focus groups and 15 in-depth interviews with 48 CHC leaders from several U.S. states using a modified appreciative inquiry approach. Thematic analysis was used to review transcripts for leadership concepts and code with a priori FRLT-derived and inductive codes.

Results

CHC leaders most often noted attributes associated with transformational leadership as essential for practice change. Important attributes included emphasizing a collective sense of mission and a compelling, achievable vision; expressing enthusiasm about what needs to be done; and appealing to employees' analytical reasoning and challenging others to think creatively to problem solve. Few expressions of leadership fit with the transactional typology, though some did mention active vigilance to ensure standards are met, clarifying role and task requirements, and rewarding followers. Passive-avoidant attributes were rarely mentioned.

Conclusions

Our results enhance understanding of leadership attributes supportive of successful practice change in CHCs.

Beliefs related to health care incentives: Comparison of substance use disorder treatment providers, medical treatment providers, and a public sample

This study surveyed substance use disorder (SUD) treatment providers, medical treatment providers, and a public sample about beliefs regarding health care incentives to explore differences among the groups and across health disorders for which research has demonstrated incentives improve outcomes. Six hundred participants (n = 200/group) completed the Provider Survey of Incentives. The study found between group differences for positive and negative beliefs. The public sample was highest on the positive beliefs subscale (M = 3.81), followed by SUD (M = 3.63) and medical treatment providers (M = 3.48; F(2, 597) = 20.09, p < .001). The medical treatment providers were highest on the negative beliefs subscale (M = 2.91), compared to the public sample (M = 2.77) and SUD treatment providers (M = 2.65; F(2, 597) = 7.521, p < .001). Endorsement of incentives to treat medical disorders was similar across the groups, with obesity the most endorsed disorder. In contrast, endorsement of incentives to treat SUDs differed across groups, except for smoking. The SUD treatment providers were almost twice as likely as the public sample (OR = 1.81, 95% CI = 1.27-2.59) and the public sample almost twice as likely as the medical treatment providers (OR = 1.74, 95% CI = 1.24-2.47) to endorse the use of incentives to treat more SUDs. Medical treatment providers were also the least likely to endorse incentives to treat both legal and illicit substance use. These findings suggest that incentive programs have good acceptability among SUD treatment providers and the public, but medical treatment providers are less accepting of incentive programs. This study provides evidence that incentive-based interventions are acceptable to the public and is the first to document specific objections that individuals disseminating incentive interventions will most likely face when introducing them in medical settings.

Efficacy and sustainability of dialectical behaviour therapy for inpatient adolescents: a follow-up study

Background

Dialectical behaviour therapy (DBT) is an evidence-based treatment for adolescents targeting suicidal and non-suicidal self-injurious behaviours. Research supports DBT's efficacy in inpatient settings, but implementation and sustainability are understudied.

Aims

This study is a follow-up of a previous study by Tebbett-Mock et al and examines the efficacy and sustainability of an adolescent DBT inpatient unit within a psychiatric hospital in the Northeast. We hypothesised that adolescents who received DBT in our follow-up group (DBT Group 2) would not have statistical difference (ie, greater or fewer) of the following compared with the first group of patients who received DBT on the unit the year prior (DBT Group 1) and would have significantly fewer of the following compared with the treatment as usual (TAU) group: (1) constant observation hours for suicidal ideation, self-injury and aggression; (2) incidents of suicide attempts, self-injury and aggression; (3) restraints; (4) seclusions; (5) days hospitalised; (6) times readmitted to the unit within 30 days of discharge.

Methods

We conducted a retrospective chart review for adolescents receiving inpatient DBT (DBT Group 1, n=425; DBT Group 2, n=393) and a historical control group (TAU, n=376). The χ² tests and one-way analysis of variance were conducted as preliminary analyses to examine group differences on diagnosis, gender and age. Kruskal-Wallis H tests were conducted to examine group differences on outcomes. Mann-Whitney U tests were used as post hoc analyses.

Results

Patients in DBT Group 2 were comparable to DBT Group 1 for the number of constant observation hours for self-injury (U=83 432.50, p=0.901), restraints (U=82 109, p=0.171) and days hospitalised (U=83 438.5, p=0.956). Patients in DBT Group 2 had a significantly greater number of incidents of suicide attempts compared with DBT Group 1 (U=82 662.5, p=0.037) and of self-injury compared with patients in DBT Group 1 (U=71724.5, p<0.001) and TAU (U=65649.0, p<0.001).

Conclusions

Results provide support for adolescent inpatient DBT compared with TAU and highlight staff turnover and lack of training as potential barriers to sustainability and efficacy.

Community readiness for childhood obesity prevention programs: findings from an urban population in Iran

This study aimed to examine the Iranian local communities' readiness stage to engage with childhood obesity prevention programs for late primary school children in districts 2 and 16 of Tehran as the representatives of high and low socio-economic districts, respectively. First, a Delphi approach was conducted to assess the socio-cultural necessity/appropriateness and adequacy of the community readiness model and its dimensions as a planning basis for childhood obesity prevention program(s) in Iran. Then, the community readiness interview guide's translation, modification, content and face validity were performed. Finally, 66 interviews with key informants were conducted and scored to assess community readiness. The socio-cultural necessity/appropriateness and adequacy of community readiness model and its dimensions were confirmed by Delphi participants and two questions were added to the interview guide. Content and face validity of the interview guide were at acceptable levels. Assessment of the community readiness based on the key informants' perspective showed that the overall mean readiness score of targeted local communities was 4.61 ± 0.54 and 4.22 ± 0.26 in high and low socio-economic districts, respectively, corresponded to 'preplanning stage'. The highest score was 5.00 ± 0.48 correspond to the 'preparation stage', which belonged to girls' schools in district 2. Small differences were found in the readiness stage of local communities by sex and socio-economic status of schools. The results highlight the need to increase community awareness, gain their support to recognize childhood obesity as a priority, address cultural misconceptions and improve the obesity prevention programs to achieve a higher level of readiness.

Advancing implementation frameworks with a mixed methods case study in child behavioral health

Despite a growing policy push for the provision of services based on evidence, evidence-based treatments for children and youth with mental health challenges have poor uptake, yielding limited benefit. With a view to improving implementation in child behavioral health, we investigated a complementary implementation approach informed by three implementation frameworks in the context of implementing motivational interviewing in four child and youth behavioral health agencies: the Active Implementation Frameworks (AIF) (process), the Consolidated Framework for Implementation Research (factors), and the Implementation Outcomes Framework (evaluation). The study design was mixed methods with embedded interrupted time series and motivational interviewing (MI) fidelity was the primary outcome. Focus groups and field notes informed perspectives on the implementation approach, and a questionnaire explored the salience of Consolidated Framework for Implementation Research (CFIR) factors. Findings validate the process guidance provided by the AIF and highlight CIFR factors related to implementation success. Novel CFIR factors, not elsewhere reported in the literature, are identified that could potentially extend the framework if validated in future research. Introducing fidelity measurement in practice proved challenging and was not sustained beyond the study. A complementary implementation approach was successful in implementing MI in child behavioral health agencies. In contrast with the typical train and hope approach to implementation, practice change did not occur immediately post-training but emerged over a 7 month period of consultation and practice following a discrete interactive training period. The saliency of CFIR constructs aligned with findings from studies conducted in other contexts, demonstrating external validity and highlighting common factors that can focus planning and measurement.

Yoga for hypertensive patients: a study on barriers and facilitators of its implementation in primary care

Background

International guidelines for hypertension treatment recommend the use of yoga, particularly among low-risk patients. However, evidence is lacking on the implementation potential of health-worker-led yoga interventions in low-resource, primary care settings.

Objective

To assess barriers to and facilitators of the implementation of a yoga intervention for hypertensive patients in primary care in Nepal.

Methods

The study was conducted using focus group discussions, in-depth interviews, key informant interviews, and telephone interviews. Data were collected from the ‘Yoga and Hypertension’ (YoH) trial participants, YoH intervention implementers, and officials from the Ministry of Health and Population in Nepal.

Results

Most YoH trial participants stated that: (1) it was easy to learn yoga during a five-day training period and practise it for three months at home; (2) practising yoga improved their health; and (3) group yoga sessions in a community centre would help them practise yoga more regularly. Most YoH intervention implementers stated that: (1) they were highly motivated to implement the intervention; (2) the cost of implementation was acceptable; (3) they did not need additional staff to effectively implement the intervention; (4) providing remuneration to the staff involved in the intervention would increase their motivation; and (5) the yoga programme was ‘simple and easy to follow’ and ‘easily performed by participants of any age’. The government officials stated that: (1) yoga is considered as a key health promotional activity in Nepal; and (2) the integration of the yoga intervention into the existing health care programme would not be too challenging, because the existing personnel and other resources can be utilised.

Conclusion

While there is a good potential that a yoga intervention can be implemented in primary care, capacity development for health workers and the involvement of community yoga centres in the delivery of the interventions may be required to facilitate this implementation.

Engaging faculty in a workshop intervention on overcoming the influence of implicit bias

INTRODUCTION

To study the effectiveness of any educational intervention for faculty requires first that they attend the training. Using attendance as a measure of faculty engagement, this study examined factors associated with the percentage of faculty in divisions of departments of medicine who attended a workshop as part of a multisite study.

METHODS

Between October 2018 and March 2020, 1675 of 4767 faculty in 120 divisions of 14 departments of medicine attended a 3-hour in-person workshop as part of the Bias Reduction in Internal Medicine (BRIM) initiative. This paper describes the workshop development and study design. The number of faculty per division ranged from 5 to 296. Attendance rates varied from 2.7% to 90.1%. Taking a quality improvement approach, the study team brainstormed factors potentially related to variations in workshop attendance, constructed several division- and institution-level variables, and assessed the significance of factors on workshop attendance with hierarchical linear models.

RESULTS

The following were positively associated with workshop attendance rate: the division head attended the workshop, the BRIM principal investigator gave Medical Grand Rounds, and the percentage of local workshop presenters who completed training. Workshop attendance rates fell when departments identified more than five on-site study leaders.

CONCLUSIONS

Factors associated with higher workshop attendance may have increased the perceived status and value of attending the workshop, leading faculty to choose the workshop over other competing demands. For future investigators studying educational interventions that require participation of faculty in clinical departments at multiple sites, this work offers several valuable lessons.

Cross-cultural adaption and psychometric investigation of the German version of the Evidence Based Practice Attitude Scale (EBPAS-36D)

BACKGROUND

The implementation of evidence-based practice (EBP) in mental health care confers many benefits to patients, and research into factors facilitating the implementation of EBP is needed. As an important factor affecting the implementation of EBP, service providers' attitudes toward EBP emerged. The Evidence-Based Practice Attitude Scale (EBPAS-36) is an instrument with good psychometric characteristics that measures positive and ambivalent attitudes toward EBP. However, a German version is missing. The present study therefore aims to provide a validated German translation of the EBPAS-36.

METHODS

The scale was translated and back-translated as recommended by standard procedures. German psychotherapists were recruited to participate in an online survey. They provided demographic and professional information, completed the EBPAS-36, the Implementation Climate Scale (ICS) and the Intention Scale for Providers (ISP). Standard item and reliability analyses were conducted. Construct validity was evaluated with exploratory (EFA) and confirmatory factor analyses (CFA) in two subsamples (random split). Convergent validity was tested by predicting a high positive correlation of the EBPAS-36D with two scores of attitudes of the ISP and an interest in EBP score. It was tested whether the EBPAS-36D predicts the intention to use EBP.

RESULTS

N = 599 psychotherapists participated in the study. The item analyses showed a mean item difficulty of p_i = 0.64, a mean inter-item correlation of r = 0.18, and a mean item-total correlation of r_itc = 0.40. The internal consistency was very good for the total scale (α = 0.89) and ranged from adequate to very good for the subscales (0.65-0.89), indicating high reliability. The original factor structure showed an acceptable model fit (RMSEA = 0.064 (90% CI = 0.059-0.068); SRMR = 0.0922; AIC = 1400.77), confirming the 12-factor structure of the EBPAS-36. However, a second-order factor structure derived by the EFA had an even better model fit (RMSEA = 0.057 (90% CI = 0.052-0.062); SRMR = 0.0822; AIC = 1274.56). When the EBPAS-36D was entered in a hierarchical regression model with the criterion Intention to use EBP, the EBPAS-36D contributed significantly to the prediction (Change in R² = 0.28, p < 0.001) over and above gender, age and participants' report of ever having worked in a university context.

CONCLUSIONS

The present study confirms good psychometric properties and validity of a German version of the EBPAS-36 in a sample of psychotherapists.

Core Correctional Practices in Community Supervision: An Evaluation of a Policy Mandate to Increase Probation Officer Use of Skills

Community supervision officer training programs aim to translate core correctional practices into routine practice. These training programs emphasize skill-building designed to shift supervision strategies from law enforcement/compliance-oriented to a focus on promoting and supporting behavior change. Despite evidence of their effectiveness, research finds trained officers use newly learned skills infrequently. The current study examined the impact of a policy, implemented post-training, designed to encourage trained officers to use skills emphasized by the Staff Training Aimed at Reducing Rearrest (STARR) training program more frequently. The current study examined the effectiveness of this policy on the frequency and type of skills used by officers in their interactions with individuals on their caseload. Analyses suggested the policy mandate was effective in increasing skill use, however officers still used trained skills in less than half of their interactions. Implications and considerations for increasing the use of skills are discussed.

A systematic review of evidence-based practice implementation in drug and alcohol settings: applying the consolidated framework for implementation research framework

Background

There is a paucity of translational research programmes to improve implementation of evidence-based care in drug and alcohol settings. This systematic review aimed to provide a synthesis and evaluation of the effectiveness of implementation programmes of treatment for patients with drug and alcohol problems using the Consolidated Framework for Implementation Research (CFIR).

Methods

A comprehensive systematic review was conducted using five online databases (from inception onwards). Eligible studies included clinical trials and observational studies evaluating strategies used to implement evidence-based psychosocial treatments for alcohol and substance use disorders. Extracted data were qualitatively synthesised for common themes according to the CFIR. Primary outcomes included the implementation, service system or clinical practice. Risk of bias of individual studies was appraised using appropriate tools. A protocol was registered with (PROSPERO) (CRD42019123812) and published previously (Louie et al. Systematic 9:2020).

Results

Of the 2965 references identified, twenty studies were included in this review. Implementation research has employed a wide range of strategies to train clinicians in a few key evidence-based approaches to treatment. Implementation strategies were informed by a range of theories, with only two studies using an implementation framework (Baer et al. J Substance Abuse Treatment 37:191-202, 2009) used Context-Tailored Training and Helseth et al. J Substance Abuse Treatment 95:26-34, 2018) used the CFIR). Thirty of the 36 subdomains of the CFIR were evaluated by included studies, but the majority were concerned with the Characteristics of Individuals domain (75%), with less than half measuring Intervention Characteristics (45%) and Inner Setting constructs (25%), and only one study measuring the Outer Setting and Process domains. The most common primary outcome was the effectiveness of implementation strategies on treatment fidelity. Although several studies found clinician characteristics influenced the implementation outcome (40%) and many obtained clinical outcomes (40%), only five studies measured service system outcomes and only four studies evaluated the implementation.

Conclusions

While research has begun to accumulate in domains such as Characteristics of Individuals and Intervention Characteristics (e.g. education, beliefs and attitudes and organisational openness to new techniques), this review has identified significant gaps in the remaining CFIR domains including organisational factors, external forces and factors related to the process of the implementation itself. Findings of the review highlight important areas for future research and the utility of applying comprehensive implementation frameworks.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01090-7.

Improving quality and performance in substance use treatment programs: What is being done and why is it so hard?

SUMMARY

As states plan to implement system-wide change of any kind, it is important to understand program directors' perspectives on challenges they face. This is especially true with quality improvement reforms. Much research has focused on quality improvement in medicine, but there is a gap in our knowledge about programs that treat individuals with drug or alcohol use. From 2007 to 2016, Maine contracted with selected substance use treatment programs using financial incentives to improve quality, with focus on treatment access, engagement, retention, and completion as measures of quality. Using surveys and in-depth interviews, this research documents strategies that programs used to improve performance and challenges faced in implementing reforms. Only programs that received federal block grant funding through the state to provide substance use treatment were eligible for an incentive contract, creating a natural experiment with non-block grant programs (non-incentive). Directors were interviewed in incentive (n=13) and non-incentive programs (n=12).

FINDINGS

Thematic analysis revealed that: 1) programs focused on QI, but those eligible for incentives focused on different quality measures, 2) most of the reforms in both groups targeted improving treatment access and retention, and 3) programs faced substantial challenges in undertaking reforms. Despite efforts, many programs could not meet quality measures consistently over time and faced barriers over which they had little control.

APPLICATIONS

Policy makers and program administrators will benefit from knowing the challenges of undertaking QI initiatives and provide support for the programs.

The LEAP Program: Quality Improvement Training to Address Team Readiness Gaps Identified by Implementation Science Findings

BACKGROUND

Integrating evidence-based innovations (EBIs) into sustained use is challenging; most implementations in health systems fail. Increasing frontline teams' quality improvement (QI) capability may increase the implementation readiness and success of EBI implementation.

OBJECTIVES

Develop a QI training program ("Learn. Engage. Act. Process." (LEAP)) and evaluate its impact on frontline obesity treatment teams to improve treatment delivered within the Veterans Health Administration (VHA).

DESIGN

This was a pre-post evaluation of the LEAP program. MOVE! coordinators (N = 68) were invited to participate in LEAP; 24 were randomly assigned to four starting times. MOVE! coordinators formed teams to work on improvement aims. Pre-post surveys assessed team organizational readiness for implementing change and self-rated QI skills. Program satisfaction, assignment completion, and aim achievement were also evaluated.

PARTICIPANTS

VHA facility-based MOVE! teams.

INTERVENTIONS

LEAP is a 21-week QI training program. Core components include audit and feedback reports, structured curriculum, coaching and learning community, and online platform.

MAIN MEASURES

Organizational readiness for implementing change (ORIC); self-rated QI skills before and after LEAP; assignment completion and aim achievement; program satisfaction.

KEY RESULTS

Seventeen of 24 randomized teams participated in LEAP. Participants' self-ratings across six categories of QI skills increased after completing LEAP (p< 0.0001). The ORIC measure showed no statistically significant change overall; the change efficacy subscale marginally improved (p < 0.08), and the change commitment subscale remained the same (p = 0.66). Depending on the assignment, 35 to 100% of teams completed the assignment. Nine teams achieved their aim. Most team members were satisfied or very satisfied (81-89%) with the LEAP components, 74% intended to continue using QI methods, and 81% planned to continue improvement work.

CONCLUSIONS

LEAP is scalable and does not require travel or time away from clinical responsibilities. While QI skills improved among participating teams and most completed the work, they struggled to do so amid competing clinical priorities.

The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial

A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians' willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.

Measures of organizational culture, organizational climate, and implementation climate in behavioral health: A systematic review

Background

Organizational culture, organizational climate, and implementation climate are key organizational constructs that influence the implementation of evidence-based practices. However, there has been little systematic investigation of the availability of psychometrically strong measures that can be used to assess these constructs in behavioral health. This systematic review identified and assessed the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs as defined by the Consolidated Framework for Implementation Research (CFIR) and Ehrhart and colleagues.

Methods

Data collection involved search string generation, title and abstract screening, full-text review, construct assignment, and citation searches for all known empirical uses. Data relevant to nine psychometric criteria from the Psychometric and Pragmatic Evidence Rating Scale (PAPERS) were extracted: internal consistency, convergent validity, discriminant validity, known-groups validity, predictive validity, concurrent validity, structural validity, responsiveness, and norms. Extracted data for each criterion were rated on a scale from -1 ("poor") to 4 ("excellent"), and each measure was assigned a total score (highest possible score = 36) that formed the basis for head-to-head comparisons of measures for each focal construct.

Results

We identified full measures or relevant subscales of broader measures for organizational culture (n = 21), organizational climate (n = 36), implementation climate (n = 2), tension for change (n = 2), compatibility (n = 6), relative priority (n = 2), organizational incentives and rewards (n = 3), goals and feedback (n = 3), and learning climate (n = 2). Psychometric evidence was most frequently available for internal consistency and norms. Information about other psychometric properties was less available. Median ratings for psychometric properties across categories of measures ranged from "poor" to "good." There was limited evidence of responsiveness or predictive validity.

Conclusion

While several promising measures were identified, the overall state of measurement related to these constructs is poor. To enhance understanding of how these constructs influence implementation research and practice, measures that are sensitive to change and predictive of key implementation and clinical outcomes are required. There is a need for further testing of the most promising measures, and ample opportunity to develop additional psychometrically strong measures of these important constructs.

Plain Language Summary

Organizational culture, organizational climate, and implementation climate can play a critical role in facilitating or impeding the successful implementation and sustainment of evidence-based practices. Advancing our understanding of how these contextual factors independently or collectively influence implementation and clinical outcomes requires measures that are reliable and valid. Previous systematic reviews identified measures of organizational factors that influence implementation, but none focused explicitly on behavioral health; focused solely on organizational culture, organizational climate, and implementation climate; or assessed the evidence base of all known uses of a measure within a given area, such as behavioral health-focused implementation efforts. The purpose of this study was to identify and assess the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs that have been used in behavioral health-focused implementation research. We identified 21 measures of organizational culture, 36 measures of organizational climate, 2 measures of implementation climate, 2 measures of tension for change, 6 measures of compatibility, 2 measures of relative priority, 3 measures of organizational incentives and rewards, 3 measures of goals and feedback, and 2 measures of learning climate. Some promising measures were identified; however, the overall state of measurement across these constructs is poor. This review highlights specific areas for improvement and suggests the need to rigorously evaluate existing measures and develop new measures.

Changes in practitioners' attitudes, perceived training needs and self-efficacy over the implementation process of an evidence-based parenting program

BACKGROUND

Evidence-based family support programs such as the Triple P - Positive Parenting Program have the potential to enhance the well-being of children and families. However, they cannot achieve their expected outcomes if insufficient attention is paid to the implementation process. It has been demonstrated that practitioners' attitudes towards evidence-based programs (EBPs), perceived training needs and self-efficacy for working with parents influence implementation outcomes (e.g., program acceptability, adoption, adherence and sustainability). At the same time, the experience of being involved in the implementation process of an EBP could enhance practitioners' perceptions of the initiative. This study aimed to assess changes in practitioner's attitudes, perceived training needs and self-efficacy over a two-year EBP implementation process, in interaction with their appraisal of their organization's capacity to implement the EPB.

METHODS

In the province of Quebec, Canada, Triple P was implemented and evaluated in two communities. Ninety-nine practitioners from various organizations completed questionnaires shortly before their training in Triple P and two years later.

RESULTS

Findings show that practitioners who displayed more initial skepticism regarding their organization's capacity to implement the program reported greater improvements in attitudes over time, while practitioners who showed more optimism at baseline reported a greater decrease in their perceived training needs. Practitioners' self-efficacy increased moderately regardless of perceived organizational capacity.

CONCLUSIONS

These results are encouraging given that more positive perceptions of EBPs could foster the systematic use of these programs in communities, for the potential benefit of a greater number of families.

Development of a comprehensive measure of organizational readiness (motivation × capacity) for implementation: a study protocol

BACKGROUND

Organizational readiness is important for the implementation of evidence-based interventions. Currently, there is a critical need for a comprehensive, valid, reliable, and pragmatic measure of organizational readiness that can be used throughout the implementation process. This study aims to develop a readiness measure that can be used to support implementation in two critical public health settings: federally qualified health centers (FQHCs) and schools. The measure is informed by the Interactive Systems Framework for Dissemination and Implementation and R = MC2 heuristic (readiness = motivation × innovation-specific capacity × general capacity). The study aims are to adapt and further develop the readiness measure in FQHCs implementing evidence-based interventions for colorectal cancer screening, to test the validity and reliability of the developed readiness measure in FQHCs, and to adapt and assess the usability and validity of the readiness measure in schools implementing a nutrition-based program.

METHODS

For aim 1, we will conduct a series of qualitative interviews to adapt the readiness measure for use in FQHCs. We will then distribute the readiness measure to a developmental sample of 100 health center sites (up to 10 staff members per site). We will use a multilevel factor analysis approach to refine the readiness measure. For aim 2, we will distribute the measure to a different sample of 100 health center sites. We will use multilevel confirmatory factor analysis models to examine the structural validity. We will also conduct tests for scale reliability, test-retest reliability, and inter-rater reliability. For aim 3, we will use a qualitative approach to adapt the measure for use in schools and conduct reliability and validity tests similar to what is described in aim 2.

DISCUSSION

This study will rigorously develop a readiness measure that will be applicable across two settings: FQHCs and schools. Information gained from the readiness measure can inform planning and implementation efforts by identifying priority areas. These priority areas can inform the selection and tailoring of support strategies that can be used throughout the implementation process to further improve implementation efforts and, in turn, program effectiveness.

Staff-perceived barriers to nutrition intervention in substance use disorder treatment

OBJECTIVE

While organisational change in substance use disorder (SUD) treatment has been extensively studied, there is no research describing facility-wide changes related to nutrition interventions. This study evaluates staff-perceived barriers to change before and after a wellness initiative.

DESIGN

A pre-intervention questionnaire was administered to participating staff prior to facility-wide changes (n 40). The questions were designed to assess barriers across five domains: (1) provision of nutrition-related treatment; (2) implementation of nutrition education; (3) screening, detecting and monitoring (nutrition behaviours); (4) facility-wide collaboration and (5) menu changes and client satisfaction. A five-point Likert scale was used to indicate the extent to which staff anticipate difficulty or ease in implementing facility-wide nutrition changes, perceived as organisational barriers. Follow-up questionnaires were identical to the pre-test except that it examined barriers experienced, rather than anticipated (n 50).

SETTING

A multisite SUD treatment centre in Northern California which began implementing nutrition programming changes in order to improve care.

PARTICIPANTS

Staff members who consented to participate.

RESULTS

From pre to post, we observed significant decreases in perceived barriers related to the provision of nutrition-related treatment (P = 0·019), facility-wide collaboration (P = 0·036), menu changes and client satisfaction (P = 0·024). Implementation of nutrition education and the domain of screening, detecting and monitoring did not reach statistical significance.

CONCLUSIONS

Our results show that staff training, food service changes, the use of targeted curriculum for nutrition groups and the encouragement of discussing self-care in individual counselling sessions can lead to positive shifts about nutrition-related organisational change among staff.

Reducing Infant Mortality Using Telemedicine and Implementation Science

Optimal perinatal regionalization is a proven evidence-based strategy to lower infant mortality. Telemedicine can engage community stakeholders, providers, and patients to facilitate optimal perinatal regionalization leading to lower infant mortality. Rural community caregivers and administrators can participate in forming optimal perinatal guidelines without leaving their community. The visual picture created by telemedicine facilitates better transport decisions; ensuring infants who are transferred to larger centers truly need it while supporting smaller nurseries by providing better consultation services and back transport of patients when appropriate. Telemedicine can also provide educational opportunities to community practices, leading to better evidence-based care.

What influences evidence-based treatment sustainment after implementation support ends? A mixed method study of the adolescent-community reinforcement approach

BACKGROUND

Little is known about clinician perspectives regarding the factors that support or hinder the long-term delivery (i.e., sustainment) of evidence-based treatments in community-based treatment settings.

METHODS

Clinical staff from 82 community-based treatment organizations that received federal grant funding to support the delivery of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment for adolescent substance use, were asked to participate in interviews focused on understanding their perspectives about the sustainment of A-CRA. Qualitative themes were identified using inductive and deductive approaches. Then the themes were dichotomized (present/absent) so that quantitative comparisons could be made between staff from organizations that sustained and did not sustain delivery of A-CRA. Administrative data about each organization in relation to federal funding support and their primary focus was also examined to explore whether these characteristics were associated with A-CRA sustainment.

RESULTS

Staff (n = 134) representing 78 organizations participated in the interviews. Staff from organizations that had received multiple federal grants to support the delivery of A-CRA and whose primary focus was substance use rather than other conditions (mental health or primary care) were more likely to report sustaining A-CRA. Staff from sustaining organizations were more likely to report positive grant experiences and success with maintaining both organizational and external support in comparison to staff from non-sustaining organizations. Staff from non-sustaining organizations were more likely to report barriers to sustaining A-CRA, including more challenges with intervention delivery, and lack of internal support and external funding.

CONCLUSIONS

Our findings lend empirical support for implementation theories in that multiple factors appear to be associated with long-term delivery of an evidence-based treatment. Although A-CRA was generally perceived positively by staff from both organizations that sustained A-CRA and organizations that did not sustain A-CRA, inner setting factors (e.g., structural policies, leadership support and staff retention) along with outer setting factors (e.g., external funding support) were reported as key to A-CRA sustainment.

Individual and organizational characteristics predicting intervention use for children with autism in schools

LAY ABSTRACT

Several interventions or treatment programs have been shown through research to improve social outcomes for children with autism, but they often are not used in schools. This study examined individual (school personnel) and organizational (school level) factors associated with the use of a research-informed social engagement intervention, Remaking Recess, for children with autism in elementary schools. A total of 28 school personnel from 12 schools in 5 districts in the northeastern United States participated. Schools were randomly assigned to (1) training in Remaking Recess only or (2) training in Remaking Recess with implementation support (tailored strategies to remove barriers to increase use of Remaking Recess). School personnel rated their attitudes about research-informed interventions, organizational readiness (school's readiness to use a research-informed intervention), and fidelity or the degree to which an intervention is used as it was originally designed. Observers rated school personnel's fidelity at baseline (pre-intervention training) and exit (post-intervention training). The results suggest that self-rated fidelity was lower when staff perceived the use of Remaking Recess was required; however, observer-rated fidelity was lower when staff rated Remaking Recess as appealing. In addition, self-rated fidelity was higher when there was a sufficient number of staff, positive individual growth, and organizational adaptability. The results also indicated higher observer-rated fidelity when staff perceived positive influence over their coworkers. The results suggest that both individual (attitudes) and organizational (influence, staffing, growth, adaptability) characteristics may affect implementation success in schools. A collaborative decision-making approach for evidence-based practice use is recommended.

A synthesis of implementation science frameworks and application to global health gaps

Background

Implementation science has been growing as discipline in the past decades, producing an increasing number of models in the area. On the other hand, most frameworks are intended to guide the implementation of programs, focusing on identifying elements and stages that increase their success. This article aims to structure this discussion, proposing a simplified tool that synthesizes common elements of other frameworks, and highlight the usefulness to use implementation science not only in identifying successful implementation strategies but as a tool to assess gaps in global health initiatives.

Methods

The study was carried out through a combined methodology that included an initial search of implementation science frameworks, experts’ opinions, and the use of references in frameworks to elaborate a list of articles to be reviewed. A total of 52 articles were analyzed, identifying their definitions of implementation science and the elements of different frameworks.

Results

The analysis of articles allowed identifying the main goals and definitions of implementation science. In a second stage, frameworks were classified into “time-based”, “component-based” and “mixed”, and common elements of each type of model were used to propose a synthetic framework with six elements: Diagnosis, Intervention provider/ system, Intervention, Recipient, Environment, and Evaluation. Finally, this simplified framework was used to identify gaps in global health was using The Lancet Global Health Series. Potential areas of intervention arise for five different global health issues: malaria, non-communicable diseases, maternal and child health, HIV/AIDS, and tuberculosis. Prioritization strategies differ for the different health issues, and the proposed framework can help identify and classify all these different proposals.

Conclusions

There is a huge variety of definitions and models in implementation science. The analysis showed the usefulness of applying an implementation science approach to identify and prioritize gaps in implementation strategies in global health.

Electronic supplementary material

The online version of this article (10.1186/s41256-019-0115-1) contains supplementary material, which is available to authorized users.

Provider Attitudes, Organizational Readiness for Change, and Uptake of Research Supported Treatment

PURPOSE

As implementation and evaluation of research supported treatment (RST) expands across diverse mental health settings, it is essential to understand the facilitators and inhibitors of uptake. The current study examined the relationships between organizational readiness for change, attitudes toward RST, and use of RST among a sample primarily of social workers.

METHODS

Participants included 158 providers from public child mental health outpatient clinics in the New York metropolitan area. Data were analyzed using structural equation modeling.

RESULTS

Use of RST was greater among providers who were younger and had fewer years of professional experience. Both organizational need for change and climate directly and indirectly related to use of RST through attitudes toward RST (partial mediator).

DISCUSSION

The organizational context is an important factor that relates to attitudes toward and use of RST in practice. Future research is needed to continue examining factors of RST uptake and sustainability.

Development and psychometric testing of an instrument for measuring social participation of adolescents: study protocol of a prospective mixed-methods study

INTRODUCTION

Social participation is an important part of a young person's life. It influences the social experience, social-emotional development and dimensions of competence experience. This applies to people with or without physical disabilities or chronic diseases. Currently, there is no reliable assessment tool for measuring social participation of adolescents in Germany although social participation is a central goal of rehabilitation. The aim of this study is to develop, test and pilot an instrument that assesses social participation for adolescents between the ages of 12 and 17 years and to start a psychometric test.

METHODS AND ANALYSIS

In a sequential mixed-methods study, adolescents with and without physical disabilities or chronic diseases are asked about their experiences with social participation as well as the individual significance of self-determination through semistructured interviews. The perspective of adolescents is supplemented by focus groups that will be conducted first with experts from social paediatric care and second with legal guardians. Based on this, an assessment instrument will be developed, evaluated and implemented in exemplary social paediatric centres (SPCs) and rehabilitation clinics and psychometrically tested in a pilot study.

ETHICS AND DISSEMINATION

The study will be conducted in accordance with the principles of the revised Helsinki Declaration. The study was approved by the Ethics Review Committee at the Martin-Luther-University Halle-Wittenberg. The developed assessment instrument can be used in science to identify disadvantaged groups and to compensate for the disadvantages that could impair development. For this purpose, the results will be presented at scientific conferences and published in international peer-reviewed journals. In practice, the instrument can be used to determine the goals of rehabilitation together with the adolescents and to evaluate the achievement of these goals. For this, implementation workshops and further training will be organised and carried out in children's rehabilitation clinics and SPCs.

TRIAL REGISTRATION NUMBER

DRKS00014739; Pre-results.

Message in a bottle: How evidence-based medicine and a programme change model improved asthma management in a low-income emergency department in Papua New Guinea

OBJECTIVE

To improve asthma care in a complex, low resource, developing country setting. This observational study was carried out in a challenging low-income real-life setting in the ED at Modilon Hospital, Papua New Guinea. The only government hospital in Madang Province, with 258 beds, it provides medical care to a population of nearly 700 000 people of whom 40% live on less than US$1.25/day.

METHODS

An asthma management analysis questionnaire followed by action research, with a four-step programme change model (exposure, adoption, implementation and practice), were used to develop and implement new department asthma guidelines. Staff perceptions were gathered via discussion groups and questionnaire.

RESULTS

Asthma management initially involved frequent antibiotics, intravenous steroids, multiple short acting bronchodilators (oral, inhaled and nebulised) and limited oral steroids. No spacers, preventative inhaled steroid therapy or asthma action plans were used. On review after new guideline implementation staff felt antibiotic dispensing and concurrent use of multiple short acting oral bronchodilators decreased and spacer, preventer therapy and action plan use increased.

CONCLUSION

This project highlights the difficulties experienced with change management, both in general and in a limited resource setting. Lack of data limits conclusions about asthma management improvement. However, positive trends were apparent and make this approach reasonable for those considering change management strategies in a similar setting.

Implementing Patient-Reported Outcomes to Improve the Quality of Care for Weight of Patients with Schizophrenia

"Enhancing QUality of Care In Psychosis" (EQUIP) was an eight-site clustered controlled trial of the implementation and effectiveness of patient-reported outcomes to support evidence-based practice and improve care for schizophrenia. Implementation sites chose to improve care for weight. Implementation included monitoring patient-reported outcomes using kiosks, patient and staff education, quality improvement teams, and phone care management. Qualitative and quantitative methods compared implementation and effectiveness between sites for 13 months. Eighty percent of 801 randomly selected patients were overweight. Two hundred one clinicians varied in competency. Baseline use of behavioral weight services was low. At implementation sites, patients became 2.3 times more likely to use weight services compared with control sites (95% CI, 1.5-3.6; χ² = 14.4; p < 0.01). There was no effect on the weight gain liability of medications prescribed. Controlling for baseline, patients' final weight at control sites was 5.9 ± 2.7 kg heavier than at implementation sites (F = 4.8, p = 0.03). Patient-reported outcomes can inform implementation of evidence-based practice and improvement in outcomes.

Pilot to policy: statewide dissemination and implementation of evidence-based treatment for traumatized youth

BACKGROUND

A model for statewide dissemination of evidence-based treatment (EBT) for traumatized youth was piloted and taken to scale across North Carolina (NC). This article describes the implementation platform developed, piloted, and evaluated by the NC Child Treatment Program to train agency providers in Trauma-Focused Cognitive Behavioral Therapy using the National Center for Child Traumatic Stress Learning Collaborative (LC) Model on Adoption & Implementation of EBTs. This type of LC incorporates adult learning principles to enhance clinical skills development as part of training and many key implementation science strategies while working with agencies and clinicians to implement and sustain the new practice.

METHODS

Clinicians (n = 124) from northeastern NC were enrolled in one of two TF-CBT LCs that lasted 12 months each. During the LC clinicians were expected to take at least two clients through TF-CBT treatment with fidelity and outcomes monitoring by trainers who offered consultation by phone and during trainings. Participating clinicians initiated treatment with 281 clients. The relationship of clinician and client characteristics to treatment fidelity and outcomes was examined using hierarchical linear regression.

RESULTS

One hundred eleven clinicians completed general training on trauma assessment batteries and TF-CBT. Sixty-five clinicians met all mastery and fidelity requirements to meet roster criteria. One hundred fifty-six (55%) clients had fidelity-monitored assessment and TF-CBT. Child externalizing, internalizing, and post-traumatic stress symptoms, as well as parent distress levels, decreased significantly with treatment fidelity moderating child PTSD outcomes. Since this pilot, 11 additional cohorts of TF-CBT providers have been trained to these roster criteria.

CONCLUSION

Scaling up or outcomes-oriented implementation appears best accomplished when training incorporates: 1) practice-based learning, 2) fidelity coaching, 3) clinical assessment and outcomes-oriented treatment, 4) organizational skill-building to address barriers for agencies, and 5) linking clients to trained clinicians via an online provider roster. Demonstrating clinician performance and client outcomes in this pilot and subsequent cohorts led to legislative support for dissemination of a service array of EBTs by the NC Child Treatment Program.

Impact of a brief intervention programs in clinical practice: Barriers and adaptations

Introduction:

The present study analyzes the main barriers and adaptations to brief interventions that focus on addictive behavior treatments carried out in clinical settings by 756 health professionals during their adoption process in 350 Primary Attention Units in Mexico.

Method:

A descriptive cross-sectional study was conducted and consisted in the application of an instrument that explored diverse aspects, such as knowledge about evidence based brief intervention (BI) programs, barriers during the execution, and adaptations of the BI.

Results:

the main barriers were related to the implementation of sessions and the user’s characteristics such as educational level. As a consequence, the main adaptations were related to the increase in the number of sessions, modifying their length and changing the sequence as well as the proposed material in the manuals.

Conclusions:

We discuss the possibility of systematizing the adaptations made by health professionals in order to evaluate their effectiveness.

Using NIATx strategies to implement integrated services in routine care: a study protocol

Background

Access to integrated services for individuals with co-occurring substance use and mental health disorders is a long-standing public health issue. Receiving integrated treatment services are both more effective and preferred by patients and families versus parallel or fragmented care. National policy statements and expert consensus guidelines underscore the benefits of integrated treatment. Despite decades of awareness, adequate treatment for individuals with co-occurring substance use and mental health disorders occurs infrequently. The underlying disease burden associated with alcohol, illicit and prescription drug problems, as well as mental health disorders, such as depression, posttraumatic stress disorder and schizophrenia, is substantial.

Methods

This cluster randomized controlled trial (RCT) is designed to determine if the multi-component Network for the Improvement of Addiction Treatment (NIATx) strategies are effective in implementing integrated services for persons with co-occurring substance use and mental health disorders. In this study, 50 behavioral health programs in Washington State will be recruited and then randomized into one of two intervention arms: 1) NIATx implementation strategies, including coaching and learning sessions over a 12-month intervention period to implement changes targeting integrated treatment services; or 2) wait-list control. Primary outcome measures include: 1) fidelity - a standardized organizational assessment of integrated services (Dual Diagnosis in Addiction Treatment [DDCAT] Index); and 2) penetration - proportion of patients screened and diagnosed with co-occurring disorders, proportion of eligible patients receiving substance use and mental health services, and psychotropic or substance use disorder medications. Barriers and facilitators, as determinants of implementation outcomes, will be assessed using the Consolidated Framework for Implementation Research (CFIR) Index. Fidelity to and participation in NIATx strategies will be assessed utilizing the NIATx Fidelity Scale and Stages of Implementation Completion (SIC).

Discussion

This study addresses an issue of substantial public health significance: the gap in access to an evidence-based practice for integrated treatment for individuals with co-occurring mental health and substance use disorders. The study utilizes rigorous and reproducible quantitative approaches to measuring implementation determinants and strategies, and may address a longstanding gap in the quality of care for persons with co-occurring disorders.

Trial registration

ClinicalTrials.gov NCT03007940. Registered 02 January 2017 – Retrospectively Registered

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3241-4) contains supplementary material, which is available to authorized users.

Perceived importance of substance use prevention in juvenile justice: a multi-level analysis

BACKGROUND

Youth under juvenile justice (JJ) supervision are at high-risk of adverse outcomes from substance use, making prevention important. Few studies have examined prevention-related attitudes of JJ employees, yet such attitudes may be important for implementing prevention programs. Attitudes toward prevention may reflect individual characteristics and organizational contexts.

METHODS

Mixed effects regression was used to analyze data from 492 employees in 36 sites participating in the Juvenile Justice-Translational Research on Interventions for Adolescents in the Legal System (JJ-TRIALS) cooperative agreement. JJ employees' perceived importance of substance use prevention was measured. Staff-level variables included attitudes, job type, and demographic characteristics. Site-level variables focused on use of evidence-based screening tools, prevention programs, and drug testing.

RESULTS

On average, JJ employees rated substance use prevention as highly important (mean = 45.9, out of 50). JJ employees generally agreed that preventing substance use was part of their agency's responsibility (mean = 3.8 on scale ranging from 1 to 5). At the site level, 72.2% used an evidence-based screening tool, 22.2% used one or more evidence-based prevention program, and 47.2% used drug testing. Reported importance of prevention was positively associated with site-level use of screening tools and drug testing as well as staff-level attitudes regarding prevention being consistent with the agency's mission.

CONCLUSIONS

The associations between screening and prevention attitudes suggest that commitment to identifying youth needs may result in greater openness to preventing substance use. Future efforts to implement substance use prevention within JJ agencies charged with supervising youth in the community may benefit from highlighting the fit between prevention and the agency's mission.

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation

An evaluation measure of enablers and inhibitors to sustained evidence-based program (EBP) implementation may provide a useful tool to enhance organizations' capacity. This paper outlines preliminary validation of such a measure. An expert informant and consumer feedback approach was used to tailor constructs from two existing measures assessing key domains associated with sustained implementation. Validity and reliability were evaluated for an inventory composed of five subscales: Program benefits, Program burden, Workplace support, Workplace cohesion, and Leadership style. Exploratory and confirmatory factor analysis with a sample of 593 Triple P-Positive Parenting Program-practitioners led to a 28-item scale with good reliability and good convergent, discriminant, and predictive validity. Practitioners sustaining implementation at least 3 years post-training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support, and positive leadership style, and lower program burden compared to practitioners who were non-sustainers.

Organizational Factors and Probation Officer Use of Evidence-Based Practices: A Multilevel Examination

Growing evidence pointing to the ineffectiveness of control-oriented supervision practices has led to an emphasis on evidence-based practices (EBPs), or practices that are empirically tied to recidivism reduction. Research on EBPs in probation highlights the importance of case management-oriented supervision and provision of proactive, appropriate program referrals. Despite research support, challenges exist regarding implementing EBPs in real-world practice. Utilizing survey data from 813 adult probation officers across 43 agencies, the current study examined variation in use of case management and proactive referral practices. Findings highlight the important role organizational commitment plays in supporting implementation efforts. Implications suggest a need for probation agencies to promote and sustain staff commitment to their agency before embarking on significant reform efforts.

Mindfulness-based treatment of addiction: current state of the field and envisioning the next wave of research

Contemporary advances in addiction neuroscience have paralleled increasing interest in the ancient mental training practice of mindfulness meditation as a potential therapy for addiction. In the past decade, mindfulness-based interventions (MBIs) have been studied as a treatment for an array addictive behaviors, including drinking, smoking, opioid misuse, and use of illicit substances like cocaine and heroin. This article reviews current research evaluating MBIs as a treatment for addiction, with a focus on findings pertaining to clinical outcomes and biobehavioral mechanisms. Studies indicate that MBIs reduce substance misuse and craving by modulating cognitive, affective, and psychophysiological processes integral to self-regulation and reward processing. This integrative review provides the basis for manifold recommendations regarding the next wave of research needed to firmly establish the efficacy of MBIs and elucidate the mechanistic pathways by which these therapies ameliorate addiction. Issues pertaining to MBI treatment optimization and sequencing, dissemination and implementation, dose–response relationships, and research rigor and reproducibility are discussed.

Translating Evidence-Based Practice for Managing Comorbid Substance Use and Mental Illness Using a Multimodal Training Package

OBJECTIVE

Comorbid mental health and substance use problems are highly prevalent in substance use treatment settings and generally lead to poorer treatment outcomes. Pathways to Comorbidity Care (PCC) is a multimodal training program developed to encourage an integrated service approach to improve clinicians capacity to identify and manage comorbid substance use and mental health outcomes within public drug and alcohol treatment settings.

METHODS

In this paper we describe the concepts underlying the PCC package and the use of implementation science to assess and overcome potential barriers, including clinicians preferences, knowledge about best practice, and professional culture.

RESULTS

The training components include didactic seminars, group workshops run by a local clinical champion on relevant subjects such as motivational interviewing and cognitive behavioral therapy, individual clinical consultation, and feedback with a senior clinical psychologist. The PCC also includes an online portal containing comorbidity resources including manuals, guidelines, and booster webinars. Finally, we describe the evaluation of PCC implementation.

CONCLUSIONS

Drug and alcohol services need to be equipped to treat the majority of comorbid mental health conditions in their clients. We anticipate that this multimodal training package, which applies the principles of implementation science, will facilitate effective and integrated care for these vulnerable clients.

Implementation of an evidence-based biobehavioral treatment for cancer patients

One aim of dissemination and implementation (DI) research is to study the translation of evidence-based treatments (EBTs) from the research environments of their development and testing to broader communities where they are needed. There are few behavioral medicine DI studies and none in cancer survivorship. A determinant model (Setting, Therapist, Education, imPlementation, and Sustainability (STEPS)) was used to conceptualize DI of mental health treatment and frame a longitudinal study of implementation of a behavioral medicine EBT-a biobehavioral intervention (BBI) for cancer patients. Using effective dissemination strategies, therapists were trained in the BBI and followed to determine if implementation occurred. Participants (N = 108) were psychologists, social workers, and other oncology mental health providers from diverse settings to whom the BBI had been disseminated. BBI trainers then provided 6 months of support for implementation (e.g., monthly conference calls). Therapists reported number of patients treated, with or without the BBI, at 2, 4, and 6 months; use of support strategies was tracked. Generalized linear mixed models show that the proportion of patients treated with BBI ranged from 58 to 68%, with a 2% increase across follow-ups. Therapist and setting characteristics did not predict usage. Implementation of a behavioral medicine EBT provides a "real-world" demonstration of a BBI moved from the research setting to diverse communities. As the first study in cancer, it is an encouraging example of training and supporting mental health providers to deliver evidence-based psychological treatment and finding their success in doing so.