Community implementation of a brief parent mediated intervention for toddlers with probable or confirmed autism spectrum disorder: feasibility, acceptability, and drivers of success (IE Drmic et al.)

Background

Social ABCs is a caregiver-mediated Naturalistic Developmental Behavioral Intervention for toddlers with confirmed/suspected Autism Spectrum Disorder (ASD), with evidence in controlled research settings. Information is lacking on implementation in community settings. We reported on the treatment effectiveness of this program within a community setting, and the current paper describes the implementation phase of this work. Distinguishing between treatment and implementation effectiveness is critical for transporting interventions from laboratory to community.

Objectives

Describe the implementation of Social ABCs through a large public autism service, supported by a research-community partnership.

Methods

We describe this project through the Exploration, Preparation, Implementation, Sustainment (EPIS) framework as it focuses on implementation of evidence-based practices in publicly funded services. We apply this framework to the reporting stage. This project took place in the context of a 3-year government-funded pilot at a hospital-based publicly funded autism service. Participants: Program developers; Autism Service team; toddlers with suspected/confirmed ASD aged 14-34 months (M = 25.18 months) and their caregivers. Training/supervision: Provided by program developers at tapering intensity. Evaluation: Caregivers completed the Caregiver Diary and satisfaction surveys. We explored training processes, intervention uptake, acceptability, adaptations to fit community context, appropriateness, perceived impact, and facilitators/barriers.

Results

Six coaches were trained to fidelity, and three of these were further trained as Site Trainers. 183 clinically referred families enrolled and 89.4% completed the 12-week program. Caregivers reported increases in adherence and competence, high satisfaction and perceived benefits for their children. Coaches reported high satisfaction. Toddlers were appropriately identified to receive the intervention. Referral processes improved, including decreased referral age, and increased family readiness for diagnostic assessment and subsequent services.

Conclusions

Social ABCs was successfully implemented in a community service through a research-community partnership. The program was feasible, acceptable, and appropriate within a community context. Drivers of success included funding, institutional support, shared decision-making, adaptations to fit context, leadership support, perceived positive impact, and commitment to evaluation.

A Longitudinal Mixed-Methods Examination of Positive Health Check: Implementation Results From a Type 1 Effectiveness-Implementation Hybrid Trial

BACKGROUND

Positive Health Check is an evidence-based video doctor intervention developed for improving the medication adherence, retention in care, and viral load suppression of people with HIV receiving clinical care.

SETTING

Four HIV primary care clinics within the United States.

METHODS

As part of a type 1 hybrid trial, a mixed-methods approach was used to longitudinally assess the following 3 key implementation constructs over a 23-month period: innovation-values fit (ie, the extent to which staff perceive innovation use will foster the fulfillment of their values), organizational readiness for change (ie, the extent to which organizational members are psychologically and behaviorally prepared to implement organizational change), and implementation climate (ie, the extent to which implementation is expected, supported, and rewarded). Quantitative mixed-effects regression analyses were conducted to assess changes over time in these constructs. Qualitative analyses were integrated to help provide validation and understanding.

RESULTS

Innovation-values fit and organizational readiness for change were found to be high and relatively stable. However, significant curvilinear change over time was found for implementation climate. Based on the qualitative data, implementation climate declined toward the end of implementation because of decreased engagement from clinic champions and differences in priorities between research and clinic staff.

CONCLUSIONS

The Positive Health Check intervention was found to fit within HIV primary care service settings, but there were some logistical challenges that needed to be addressed. Additionally, even within the context of an effectiveness trial, significant and nonlinear change in implementation climate should be expected over time.

Nursing home performance in a trial to reduce hospitalizations: Implications for future trials

BACKGROUND

Experience in trials of implementing quality improvement (QI) programs in nursing homes (NHs) has been variable. Understanding the characteristics of NHs that demonstrate improvements during these trials is critical to improving NH care.

DESIGN

Secondary analysis of a randomized controlled trial of implementation of a QI program to reduce hospital transfers.

PARTICIPANTS

Seventy-one NHs that completed the 12-month trial INTERVENTION: Implementation included distance-learning strategies, involvement of a champion, regular submission of data on hospitalizations and root cause analyses of transfers, and training, feedback and support.

MEASUREMENTS

Primary outcomes included all-cause and potentially avoidable hospitalizations and emergency department (ED) visits per 1000 NH resident days, and the percentage of residents readmitted in 30-days. We compared multiple other variables that could influence effective program implementation in NHs in the highest versus lowest quartile of changes in the primary outcomes.

RESULTS

The 18 high-performing NHs had significant reductions in hospitalization and ED visits, whereas the 18 NHs in the low-performing group had increases. The difference in changes in each outcome varied between a reduction of 0.75 and 2.30 events relative to a NH with a census of 100; the absolute difference in 30-day readmissions was 19%. None of the variables we examined reached significance after adjustment for multiple comparisons between the groups. There was no consistent pattern of differences in nonprofit status, nursing staffing, and quality ratings.

CONCLUSION

Our experience and reviews of other NH trials suggest that key factors contributing to successful implementation QI programs in NHs remain unclear. To improve NH care, implementation trials should account for intervention fidelity and factors that have not been examined in detail, such as degree and nature of leadership support, financial and regulatory incentives, quality measures, resident and family perspectives, and the availability of onsite high-quality medical care and support of the medical director.

Implementation effectiveness of health interventions with Māori communities: a cross-sectional survey of health professional perspectives

OBJECTIVE

To identify factors that New Zealand health professionals rate as important for implementation effectiveness for health interventions with Māori communities.

METHODS

Health professionals (N=200) participated in an online cross-sectional survey. The survey was organised in three sections: a) participants' general perceptions of key features for implementation effectiveness; b) participants' direct experience of implementing health interventions with Māori communities, and c) general demographic information.

RESULTS

Paired sample t-tests revealed four levels of importance for implementation effectiveness with teamwork and community autonomy as being most important. Only 24% of participants had experience with a previous health intervention in Māori communities. A multiple regression model identified two key overall factors that were associated with participants' rating of implementation effectiveness in these previous interventions: process (B=0.29 p<0.01), and community (B=0.14, p<0.05).

CONCLUSIONS

Key areas of implementation effectiveness were community engagement and participatory process; this contributes to the body of literature that challenges traditional top-down approaches of implementation. Implications for public health: This study provides the perspectives of health professionals on implementation effectiveness when working with Māori/Indigenous communities. These professionals often lead the implementation of health interventions to address health equity. The study supports the inclusion of community voice in implementing community health interventions.

Using the Consolidated Framework for Implementation Research (CFIR) to evaluate implementation effectiveness of a facilitated approach to an asthma shared decision making intervention

OBJECTIVE

To describe the evaluation of implementation effectiveness of an asthma shared decision making (SDM) intervention at the 10 individual facilitator-led primary care practices in the ADAPT-NC Study using the Consolidated Framework for Implementation Research (CFIR).

METHODS

Practices were scored across 40 CFIR constructs within 5 domains using a previously published scoring system of -2 to +2. Based on overall construct scores, practices were then classified as high, medium, or low adopters. To evaluate clinical outcomes, changes in asthma exacerbations were assessed for emergency department (ED) visits, hospitalizations, and oral steroid prescription orders. Using regression analysis, the absolute change in percent for each outcome relative to the CFIR score for each practice was analyzed. (Trial registration #NCT02047929).

RESULTS

Implementation effectiveness was reflected in CFIR score differences with 7 high, 1 medium, and 2 low adopter practices. High adopters mostly scored well across all domains. Weaknesses were consistent amongst the 2 low adopters with lower scores in the Inner Setting, Characteristics of Individuals, and Process domains. While no significant correlations were seen between the practices' CFIR scores and the absolute change in ED visits, hospitalizations, or oral steroid prescription orders, practices with higher percentages of children had greater improvements in clinical outcomes.

CONCLUSIONS

The CFIR was used to evaluate the asthma SDM intervention implementation at 10 facilitator-led practices. While there was no significant correlation between higher implementation effectiveness and greater improvement in clinical outcomes, practices with a higher proportion of pediatric patients did experience a significant reduction in overall exacerbations post-implementation.

The implementation of integrated emotion-oriented care: did it actually change the attitude, skills and time spent of trained caregivers?

BACKGROUND

Successful implementation is a vital precondition for investigating the outcome of care innovation. This study concerned the evaluation of the implementation of integrated emotion-oriented care (IEOC) in psychogeriatric nursing home wards. The main question was whether the trained caregivers actually applied the knowledge and techniques of IEOC during their daily work.

METHODS

The study was conducted within the framework of a randomized clinical trial into the effectiveness of IEOC in 16 wards. Preceding the experimental period, staff from 16 wards were educated and trained to work with a standardized care plan, resulting in a similar level of quality of care at the start of the trial. On the experimental wards IEOC was then implemented by training on the job in addition to training courses for personnel. To examine the implementation effectiveness, a self-report questionnaire, 'Emotion-oriented Skills in the Interaction with Elderly People with Dementia', was administered at baseline and after 7 months to a sample of caregivers from the experimental and the control wards. In addition, participant observation was conducted on four experimental and four control wards, and time spent by care personnel on different type of care tasks was registered.

RESULTS

The implementation of IEOC resulted in increased emotion-oriented skills and more knowledge of the residents among the caregivers. Providing IEOC was not more time consuming for the caregivers than providing usual care.

CONCLUSION

This study shows that the implementation of IEOC was effective. It is recommended that in intervention studies the correct application of a new intervention or care approach is examined before jumping to conclusions about the effectiveness of the intervention or care approach itself.