Therapists' attitudes toward evidence-based practices and implementation of parent-child interaction therapy

Healthcare providers' perceived acceptability of a warning signs intervention for rural hospital-to-home transitional care: A cross-sectional study

INTRODUCTION

There is a pressing need for transitional care that prepares rural dwelling medical patients to identify and respond to the signs of worsening health conditions. An evidence-based warning signs intervention has the potential to address this need. While the intervention is predominantly delivered by nurses, other healthcare providers may be required to deliver it in rural communities where human health resources are typically limited. Understanding the perspectives of other healthcare providers likely to be involved in delivering the intervention is a necessary first step to avert consequences of low acceptability, such as poor intervention implementation, uptake, and effectiveness. This study examined and compared nurses' and other healthcare providers' perceived acceptability of an evidence-based warning signs intervention proposed for rural transitional care.

METHODS

A cross-sectional design was used. The convenience sample included 45 nurses and 32 other healthcare providers (e.g., physical and occupational therapists, physicians) who self-identified as delivering transitional care to patients in rural Ontario, Canada. In an online survey, participants were presented with a description of the warning signs intervention and completed established measures of intervention acceptability. The measures captured 10 intervention acceptability attributes (effectiveness, appropriateness, risk, convenience, relevance, applicability, usefulness, frequency of current use, likelihood of future use, and confidence in ability to deliver the intervention). Ratings ≥ 2 indicated acceptability. Data analysis included descriptive statistics, independent samples t-tests, as well as effect sizes to quantify the magnitude of any differences in acceptability ratings between nurses and other healthcare providers.

RESULTS

Nurses and other healthcare providers rated all intervention attributes > 2, except the attributes of convenience and frequency of current use. Differences between the two groups were found for only three attributes: nurses' ratings were significantly higher than other healthcare providers on perceived applicability, frequency of current use, and the likelihood of future use of the intervention (all p's < .007; effect sizes .58 - .68, respectively).

DISCUSSION

The results indicate that both participant groups had positive perspectives of the intervention on most of the attributes and suggest that initiatives to enhance the convenience of the intervention's implementation are warranted to support its widespread adoption in rural transitional care. However, the results also suggest that other healthcare providers may be less receptive to the intervention in practice. Future research is needed to explore and mitigate the possible reasons for low ratings on perceived convenience and frequency of current use of the intervention, as well as the between group differences on perceived applicability, frequency of current use, and the likelihood of future use of the intervention.

CONCLUSIONS

The intervention represents a tenable option for rural transitional care in Ontario, Canada, and possibly other jurisdictions emphasizing transitional care.

Implementation leadership and implementation climate in context: A single organization intrinsic case study for implementation of digital measurement-based care

Background

Although studies have demonstrated that implementation leadership and climate are important constructs in predicting evidence-based practice (EBP) implementation, concrete descriptions of how they operate during organizational implementation efforts are lacking. This case study fills that gap through an in-depth description of an organization with effective implementation leadership that successfully built a strong implementation climate. This case study provides an illustration of implementation leadership and climate in tangible, replicable terms to assist managers, practitioners, and researchers in addressing the organizational context in their own implementation projects.

Method

A single organization, intrinsic case study was employed to paint a multifaceted picture of how one organization leveraged implementation leadership to strengthen a climate for the successful implementation of digital measurement-based care. The case was drawn from a cluster-randomized trial designed to test the effects of a leadership-focused implementation strategy on youth-level fidelity and clinical outcomes of digital measurement-based care. Following the completion of the trial, case study activities commenced. Descriptive summaries of multiple data sources (including quantitative data on implementation leadership and climate, coaching call and organizational alignment meeting recordings and notes, and development plans) were produced and revised iteratively until consensus was reached. Leadership actions were analyzed for corresponding dimensions of implementation leadership and climate.

Results

Specific actions organizational leaders took, as well as the timing specific strategies were enacted, to create a climate for implementation are presented, along with lessons learned from this experience.

Conclusion

This case study offers concrete steps organizational leaders took to create a consistent and aligned message that the implementation of a specific EBP was a top priority in the agency. The general approach taken to create an implementation climate provides several lessons for leaders, especially for EBPs that have broad implications across an organization.

The Interaction Between General and Strategic Leadership and Climate on Their Multilevel Associations with Implementer Attitudes Toward Universal Prevention Programs for Youth Mental Health: A Cross-Sectional Study

Emerging literature has highlighted the importance of discerning general and strategic organizational context (OC) factors (e.g., leadership and climate) and their interaction effect on individual implementation behaviors (e.g., attitudes toward evidence-based practices; EBPs) in youth mental healthcare. This study aimed to examine how leadership and climate (general and strategic) are associated with implementer attitudes toward EBPs across the individual and organizational levels and their interaction effect in schools. A series of multilevel models (MLMs) were fitted on a diverse sample of schools actively implementing universal prevention programs for youth mental health (441 implementers from 52 schools). The organization-level aggregates and individual educators' perceptions of general and strategic leadership and climate, and their interaction terms, were entered as level-2 and level-1 predictors of four attitudinal dimensions (Requirement, Openness, Appeal, and Divergence) based on their level of measurement. At the organizational level, higher levels of strategic leadership and climate, but not their general counterparts, were consistently associated with more favorable attitudes in all four dimensions. At the individual/within-school level, higher levels of perceived general and strategic leadership and climate were associated with more favorable attitudes of Requirement and Openness. At the organizational/between-school level, general climate moderated the positive effect of strategic climate on implementers' perception of appeal and divergence of EBPs. Our findings indicate that leaders should make data-based decisions to allocate resources on strategic and/or general leadership and climate to foster favorable staff attitudes toward EBPs based on the level of measurement, implementation-specificity, and attitudinal dimensions.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

How do Lay Health Worker Engage Caregivers? A Qualitative Study to Enhance Equity in Evidence-Based Parenting Programs

Engaging caregivers in their children's mental health treatment is critical for delivering high quality, evidence-based care, particularly for young children with externalizing behaviors. Lay health workers (LHWs), including peer providers and promotoras de salud, have been identified as important workforces in addressing structural and stigma-related barriers to engagement in mental health services. Importantly, research has suggested that LHWs may be integral in efforts to address engagement disparities in evidence-based behavioral parent training programs (BPTs) for Latinx caregivers. The purpose of the study was to understand how different LHW workforces engage caregivers within their usual services, in order to inform strategies that improve access to and engagement in BPTs. Qualitative interviews were conducted with two different LHW workforces: volunteer LHWs (i.e., promotoras de salud) (n = 14), who were part of a community-embedded network, and paid LHWs (i.e., parent support partners, home visitors) (n = 9) embedded within children's mental health agencies. Participants were predominately Latinx (79%) and female (96%). Qualitative analyses revealed three primary themes related to engagement strategies used by LHWs to address barriers to care: 1.) Building Trust, 2.) Empowerment, 3.) Increasing Access. Although the majority of themes and sub-themes were consistent across the two LHW workforces, agency-embedded LHWs often discussed having the means to provide resources through their organizations, whereas community-embedded LHWs discussed acting as a bridge to services by providing information and conducting outreach. Findings have implications for partnering with different workforces of LHWs to increase equity in access to BPTs.

Community providers' experiences with evidence-based practices: The role of therapist race/ethnicity

OBJECTIVES

Examining therapists' experiences implementing evidence-based practices (EBPs) is fundamental to understanding how these interventions are perceived, adapted, and delivered in community settings. However, little is known about racial/ethnic variation in the experiences of therapists serving racial/ethnic minority youth and their families. Through an innovative QUAN → qual → QUAN mixed-methods approach, we examined differences in therapists' perceptions, adaptations performed, and client-engagement challenges in the largest county-operated department of mental health in the United States.

METHOD

Surveys were completed by 743 therapists (Latinx [44%], White [34%], other ethnic minority [22%]), most of whom were female (88%), master's level (85%), and unlicensed (58%). A subset of therapists (n = 60) completed semistructured interviews.

RESULTS

Latinx therapists reported more positive experiences implementing EBPs, making more adaptations to EBPs, and encountering fewer client-engagement challenges than therapists from other racial/ethnic groups. Qualitative analyses expanded on these results, revealing that Latinx therapists commonly described adapting EBPs in terms of language and culture to improve fit and promote client engagement. Informed by these qualitative themes, a refined statistical model revealed that the ability to deliver EBPs in languages other than English might have accounted for differences in therapist-reported EBP adaptations and client-engagement challenges.

CONCLUSIONS

The findings suggest that racial/ethnic minority therapists have positive experiences in implementing EBPs in community settings. In the case of Latinx therapists, bilingual/bicultural competence may facilitate adapting EBPs in ways that reduce perceptions of engagement challenges with racially/ethnically diverse clients. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Train-to-Sustain: Predictors of Sustainment in a Large-Scale Implementation of Parent-Child Interaction Therapy

Sustainment of evidence-based practices is necessary to ensure their public health impact. The current study examined predictors of sustainment of Parent-Child Interaction Therapy (PCIT) within a large-scale system-driven implementation effort in Los Angeles County. Data were drawn from PCIT training data and county administrative claims between January 2013 and March 2018. Participants included 241 therapists from 61 programs. Two sustainment outcomes were examined at the therapist- and program-levels: 1) PCIT claim volume and 2) PCIT claim discontinuation (discontinuation of claims during study period; survival time of claiming in months). Predictors included therapist- and program-level caseload, training, and workforce characteristics. On average, therapists and programs continued claiming to PCIT for 17.7 and 32.3 months, respectively. Across the sustainment outcomes, there were both shared and unshared significant predictors. For therapists, case-mix fit (higher proportions of young child clients with externalizing disorders) and participation in additional PCIT training activities significantly predicted claims volume. Furthermore, additional training activity participation was associated with lower likelihood of therapist PCIT claim discontinuation in the follow-up period. Programs with therapists eligible to be internal trainers were significantly less likely to discontinue PCIT claiming. Findings suggest that PCIT sustainment may be facilitated by implementation strategies including targeted outreach to ensure eligible families in therapist caseloads, facilitating therapist engagement in advanced trainings, and building internal infrastructure through train-the-trainer programs.

Changes in provider Fidelity after introducing a new model of intervention

Given the impact of implementation fidelity on community-based outcomes, it is important to understand how fidelity may change over time as providers learn an intervention. Attachment and Biobehavioral Catch-up is an evidence-based early intervention that assesses fidelity during weekly supervision. Providers are first trained in the infant model, with toddler model training considered to be a separate, specialized opportunity. The current study examined changes in fidelity, measured by “in-the-moment” commenting, as providers moved from infant to toddler certification. An initial drop, with a subsequent increase, in commenting fidelity over the training year was expected. Results were consistent with our hypotheses, demonstrating a main effect of time, with most indices of commenting data initially decreasing and then increasing. These findings are consistent with research suggesting that fluctuation in fidelity is typical within community dissemination and suggests that ongoing supervision after the initial training is useful in facilitating successful skill development.

Preaching to the Choir? Predictors of Engagement in a Community-Based Learning Collaborative

This study examined predictors of engagement among 283 professionals from 34 agencies participating in three community-based learning collaboratives (CBLCs) on trauma-focused cognitive-behavioral therapy (TF-CBT). Only 50.2% of participants completed the CBLC, primarily due to not attending consultation calls or completing training cases. While higher engagement was associated with being trauma-informed and using more of the TF-CBT components prior to the CBLC, most predictors were not significant, perhaps due to ceiling effects. Positive attitudes and high organizational support were not sufficient to ensure engagement. Future research using longitudinal measurement of a wider range of predictors is needed.

Therapist Reports of EBP Client Engagement Challenges in Sessions with Diverse Youth and Families in Community Mental Health Settings

BACKGROUND

The implementation of evidence-based practices (EBPs) in community settings appears to result in reduced benefit relative to controlled trials. This difference in outcomes may be attributable in part to engagement challenges therapists encounter when delivering EBPs to low-income ethnic minority youth and families.

OBJECTIVE

The current study sought to identify therapist, client, and session characteristics associated with therapist-reported engagement challenges in therapy sessions, as well the associations between two types of client engagement challenges and therapists' self-reported ability to deliver the EBP in sessions within a system-driven implementation in public children's mental health services.

METHOD

One hundred and three therapists reported on two types of engagement challenges-Limited Client Engagement and Expressed Client Concerns-in 702 sessions with 274 clients.

RESULTS

Results indicated that therapists reported a higher frequency of Limited Client Engagement in sessions with male clients and in sessions where the youth was present, and by therapists with smaller caseloads. No variables significantly predicted Expressed Client Concerns. Both types of engagement challenges were negatively associated with therapists' report of their ability to carry out intended activities in the same session.

CONCLUSIONS

Findings suggest that therapists may benefit from learning strategies to address these two distinct types of engagement challenges encountered in implementation of EBPs with diverse families in community settings.

How Intervention and Implementation Characteristics Relate to Community Therapists' Attitudes Toward Evidence-Based Practices: A Mixed Methods Study

Therapists' perceptions toward evidence-based practices (EBPs) are important in implementation efforts, however little is known about characteristics of EBPs associated with more positive attitudes. This mixed-methods study examined how intervention and implementation characteristics of six EBPs related to therapist attitudes. Quantitative analysis of 793 cross-sectional surveys revealed that therapists endorsed more positive attitudes toward EBPs with (1) prescribed session content and order and (2) required consultation. Associations between these intervention and implementation characteristics and attitudes were not moderated by therapist experience or emotional exhaustion. Qualitative analyses complemented quantitative findings, indicating that "structure" was appealing for interventions and that therapists felt supported by consultation.

Factors Associated with Clinician Participation in TF-CBT Post-workshop Training Components

For proficiency in an evidence-based treatment (EBT), mental health professionals (MHPs) need training activities extending beyond a one-time workshop. Using data from 178 MHPs participating in a statewide TF-CBT dissemination project, we used five variables assessed at the workshop, via multiple and logistic regression, to predict participation in three post-workshop training components. Perceived in-workshop learning and client-treatment mismatch were predictive of consultation call participation and case presentation respectively. Attitudes toward EBTs were predictive of trauma assessment utilization, although only with non-call participants removed from analysis. Productivity requirements and confidence in TF-CBT skills were not associated with participation in post-workshop activities.

Parent-Child Interaction Therapy: current perspectives

Parent-Child Interaction Therapy (PCIT) is an empirically supported intervention originally developed to treat disruptive behavior problems in children between the ages of 2 and 7 years. Since its creation over 40 years ago, PCIT has been studied internationally with various populations and has been found to be an effective intervention for numerous behavioral and emotional issues. This article summarizes progress in the PCIT literature over the past decade (2006-2017) and outlines future directions for this important work. Recent PCIT research related to treatment effectiveness, treatment components, adaptations for specific populations (age groups, cultural groups, military families, individuals diagnosed with specific disorders, trauma survivors, and the hearing-impaired), format changes (group and home-based), teacher-child interaction training (TCIT), intensive PCIT (I-PCIT), treatment as prevention (for externalizing problems, child maltreatment, and developmental delays), and implementation are discussed.

Use of evidence-based interventions in child welfare: Do attitudes matter?

Implementation of evidence-based programs in progressed slowly, with the majority of services in child welfare settings lacking empirical evidence for effectiveness. In other settings, research has identified providers' attitudes about evidence-based practices (EBPs) as a potential barrier to adoption of EBPs. As little research has focused on the role of attitudes in influencing use after training in an EBP in child welfare, the potential for attitudes to impede implementation efforts in child welfare is unclear. This study addressed this question in a sample of 55 caseworkers and therapists randomly assigned to enhanced support to use an EBP following training or a training-only condition. Information on providers' use of the intervention after training and their attitudes about EBPs were measured for up to five time points. Results indicate that attitudes did not predict providers' use of the EBP, and attitudes did not change overall or in the enhanced condition that provided greater exposure to the intervention. Providers perceived of requirements to use a practice as more influential in their use than their openness to EBPs. However, those who were more open to EBPs were more likely to participate in implementation support after the training, suggesting that openness facilitates participation in activities that support use of a new intervention.

Nurses' Perceptions of Interventions for the Management of Patient-Oriented Outcomes: A Key Factor for Evidence-Based Practice

BACKGROUND

Various barriers and facilitators to implementing evidence-based interventions in practice have been acknowledged. Nurses' perspectives on these interventions were overlooked as potential factors that influence their uptake in practice. The purpose of this study was to explore nurses' perception of evidence-based interventions targeting patient-oriented outcomes.

METHODS

A mixed method design involving concurrent application of quantitative and qualitative approaches was used. Nurses (n = 56) working in acute and rehabilitation care settings completed the Intervention Acceptability scale and responded to open-ended questions. The scale presented information on the components, activities, dose, and mode of delivering evidence-based interventions targeting each patient-oriented outcome (fatigue, nausea and vomiting, dyspnea, pain, physical function, self-care) and items to rate the interventions on five attributes (relevance, applicability, frequency of use, likelihood, and comfort in implementation). The open-ended questions inquired about the appropriateness and resources needed to use the interventions in practice.

RESULTS

The quantitative results indicated favorable perceptions of most interventions. Nurses rated acupressure, guided imagery, massage, and relaxation as having limited appropriateness and they reported low levels of comfort in applying them. The qualitative themes clarified the reasons underlying nurses' ratings.

LINKING EVIDENCE TO ACTION

This study's findings highlight the importance of examining nurses' perceptions of evidence-based interventions as an initial step toward promoting the adoption of interventions in practice. Effective interventions that are considered of limited relevance are unlikely to be implemented in practice. Nurses' perceptions can guide the design or selection of dissemination strategies to clarify any misconception about the effectiveness and risk of evidence-based interventions.

Building an evidence-base for the training of evidence-based treatments in community settings: Use of an expert-informed approach

In order to make EBTs available to a large number of children and families, developers and expert therapists have used their experience and expertise to train community-based therapists in EBTs. Understanding current training practices of treatment experts may be one method for establishing best practices for training community-based therapists prior to comprehensive empirical examinations of training practices. A qualitative study was conducted using surveys and phone interviews to identify the specific procedures used by treatment experts to train and implement an evidence-based treatment in community settings. Twenty-three doctoral-level, clinical psychologists were identified to participate because of their expertise in conducting and training Parent-Child Interaction Therapy. Semi-structured qualitative interviews were completed by phone, later transcribed verbatim, and analyzed using thematic coding. The de-identified data were coded by two independent qualitative data researchers and then compared for consistency of interpretation. The themes that emerged following the final coding were used to construct a training protocol to be empirically tested. The goal of this paper is to not only understand the current state of training practices for training therapists in a particular EBT, Parent-Child Interaction Therapy, but to illustrate the use of expert opinion as the best available evidence in preparation for empirical evaluation.

Preventing Maltreatment with a Community-Based Implementation of Parent-Child Interaction Therapy

The purpose of this study was to examine rates of child abuse and neglect reports following a community implementation of Parent-Child Interaction Therapy (PCIT), an evidence-supported intervention for the prevention of maltreatment. Among a group of families receiving PCIT, predictors of reports were examined including family demographics, course of treatment, changes in clinical measures, and caregiver report for prior maltreatment victimization and perpetration. Participants (n=120) included families at-risk for future maltreatment with and without prior maltreatment history. Agency case records were linked with state administrative records of child welfare reports. Time to follow-up ranged from 13-40 months. Bivariate and multivariate survival analyses are used to model risk for a later report. During the follow-up period, 12.5% of families had a report for physical abuse or neglect. Reports of prior victimization as a child and prior perpetration as an adult were strong predictors of a report of perpetration after PCIT. Dosage of PCIT and change in clinical measures did not increase risk for a later report. PCIT can be an effective intervention for preventing maltreatment. Family history of child welfare involvement is a prominent factor in assessing risk for future involvement.

The organizational social context of mental health services and clinician attitudes toward evidence-based practice: a United States national study

ABSTBACKGROUND: Evidence-based practices have not been routinely adopted in community mental health organizations despite the support of scientific evidence and in some cases even legislative or regulatory action. We examined the association of clinician attitudes toward evidence-based practice with organizational culture, climate, and other characteristics in a nationally representative sample of mental health organizations in the United States.

METHODS

In-person, group-administered surveys were conducted with a sample of 1,112 mental health service providers in a nationwide sample of 100 mental health service institutions in 26 states in the United States. The study examines these associations with a two-level Hierarchical Linear Modeling (HLM) analysis of responses to the Evidence-Based Practice Attitude Scale (EBPAS) at the individual clinician level as a function of the Organizational Social Context (OSC) measure at the organizational level, controlling for other organization and clinician characteristics.

RESULTS

We found that more proficient organizational cultures and more engaged and less stressful organizational climates were associated with positive clinician attitudes toward adopting evidence-based practice.

CONCLUSIONS

The findings suggest that organizational intervention strategies for improving the organizational social context of mental health services may contribute to the success of evidence-based practice dissemination and implementation efforts by influencing clinician attitudes.