Furthering Our Understanding of Therapist Knowledge and Attitudinal Measurement in Youth Community Mental Health

Attitudes Toward and Usage of Evidence-Based Mental Health Practices for Autistic Youth in Bangladesh and Germany: A Cross-Cultural Comparison

The implementation of evidence-based practices (EBPs) for autistic youth is a critical concern worldwide. Research examining factors facilitating the implementation of EBPs found that providers' attitudes are an important factor. In this study, we evaluated cross-cultural differences in attitudes toward and use of EBPs. We tested socio-demographic factors as predictors of attitudes, and attitudes as predictors of EBPs use among mental health professionals working with autistic youth in Bangladesh and Germany. We used purposeful sampling. Two-hundred-ninety-two professionals who worked in a clinical setting responded to the survey and fulfilled the inclusion criteria (101 in Bangladesh, 191 in Germany). Participants were asked to respond to nine subscales of the Evidence-Based Practice Attitude Scale-36 (EBPAS-36), to indicate which of nine types of treatments they used, and to provide sociodemographic data. Measurement invariance across countries could be established for four subscales of the EBPAS-36. Comparative analyses of attitudes showed that professionals in both countries were open to using EBPs, but German practitioners were more likely to use EBPs when they appealed to them. By contrast, Bangladeshi professionals claimed to be more likely to adopt an EBP when required and to be more willing to learn EBPs to enhance job security. The relationship between caseload and attitudes varied between countries. A broader variety of EBPs was used in Germany. The findings highlight the importance of considering country-specific factors when implementing EBPs. Directions for conducting comparative studies on mental health professionals' attitudes towards EBP including methodological considerations are discussed.

Attitudes Towards Evidence-Based Practice of Professionals Working with Children and Adolescents with Autism Spectrum Disorder in Bangladesh

Like in many lower-middle-income countries (LMIC), progress in implementing evidence-based practices (EBPs) for children with autism spectrum disorder (ASD) has been slow in Bangladesh. This cross-sectional study examined professionals' attitudes towards evidence-based practice (EBP) for children and adolescents with ASD and explored how providers' demographic factors are related to attitudes to and adoption of EBPs in Bangladesh. The sample consisted of 150 mental health professionals and special teachers from the urban area of Dhaka. Attitudes were assessed by the Evidence-based Practice Attitude Scale-36. Findings indicated that professionals have favorable attitudes towards EBP. Their attitudes varied depending on service settings (public clinical, private clinical, and special school) and caseload per year. Professionals who work in private and special school settings claimed to be more willing to adopt an EBP when required and perceived a higher fit of EBPs and their work than those in public clinical settings. The number of different EBPs used also differed by service setting. Every type of intervention (except medication) was used by more professionals in special schools than in private and public clinical settings. Many professionals reported few barriers to the implementation of EBPs. These findings indicate conditions that are often conducive to the implementation of EBPs. However, these results do not reflect the situation in rural areas, in which poverty is more widespread and the number of specialized professionals is low.

The Cognitive Behavioral Therapy Competence Scale (CCS): initial development and validation

Background:

Nearly one-third of youth are affected by a mental health disorder, and the majority do not receive adequate care. To improve clinical outcomes among youth, efforts have been made to train providers in evidence-based mental health practices, such as cognitive behavioral therapy (CBT). Such efforts call for valid assessment measures that can inform and evaluate training activities.

Aims:

This study presents the development and validation of the CBT Competence Scale (CCS), a brief self-report measure to assess provider competence for CBT delivery.

Method:

Participants were 387 school mental health professionals (SMHPs) working with students in Michigan, USA. Initial items (n=59) were developed to evaluate competence in delivering common elements of CBT, with competence conceptualized as covering domains of knowledge, perception, and use of CBT techniques. CCS validation proceeded in three steps: using item response theory to select the most important items for assessing knowledge, evaluating the factor structure using exploratory and then confirmatory factor analyses, and examining reliability and validity of the resultant measure.

Results:

The validated CCS measure consists of four dimensions of CBT competence across 33 items: Non-behavioral skills, Behavioral skills, Perceptions, and Knowledge. The CCS demonstrated excellent internal consistency and good construct-based validity.

Conclusions:

The CCS holds promise as a valid, informative measure of CBT competence appropriate for the school setting, with potential for application in other environments such as mental health clinics.

Key learning aims

(1)

Exploring attitudes about evidence-based practice among speech-language pathologists: A survey of Japan and Malaysia

Purpose: To investigate speech-language pathologists' current perceptions, previous training experiences, resources, barriers, and training needs in terms of evidence-based practices (EBPs) in two Asian countries.Method: Their knowledge and attitudes about EBP were explored using an online questionnaire. A descriptive analysis was conducted with consideration of the effect of demographic variables on knowledge and attitudes about EBP.Result: Malaysian speech-language pathologists (n = 98) displayed more positive attitudes toward EBPs, with a significantly higher (t (143) = 5.91, p < .01) total mean score (Mean = 120.7, SD = 11) compared to the Japanese speech-language pathologists (n = 47, Mean = 107.8, SD = 13.5). Malaysian practitioners who were female, worked full-time, and worked in government settings reported higher motivation to develop EBP skills. Japanese practitioners who worked in private sectors reported higher EBPs training needs than those in government settings. In both countries, speech-language pathologists with higher education levels tended to express fewer perceived barriers towards EBP.Conclusion: Findings could help local governance and speech-language pathologist associations to understand the current practices and professional development needs of speech-language pathologists, leading to more effective training programs and educating employers and managers who can reinforce EBP among practitioners.

Cross-cultural adaption and psychometric investigation of the German version of the Evidence Based Practice Attitude Scale (EBPAS-36D)

BACKGROUND

The implementation of evidence-based practice (EBP) in mental health care confers many benefits to patients, and research into factors facilitating the implementation of EBP is needed. As an important factor affecting the implementation of EBP, service providers' attitudes toward EBP emerged. The Evidence-Based Practice Attitude Scale (EBPAS-36) is an instrument with good psychometric characteristics that measures positive and ambivalent attitudes toward EBP. However, a German version is missing. The present study therefore aims to provide a validated German translation of the EBPAS-36.

METHODS

The scale was translated and back-translated as recommended by standard procedures. German psychotherapists were recruited to participate in an online survey. They provided demographic and professional information, completed the EBPAS-36, the Implementation Climate Scale (ICS) and the Intention Scale for Providers (ISP). Standard item and reliability analyses were conducted. Construct validity was evaluated with exploratory (EFA) and confirmatory factor analyses (CFA) in two subsamples (random split). Convergent validity was tested by predicting a high positive correlation of the EBPAS-36D with two scores of attitudes of the ISP and an interest in EBP score. It was tested whether the EBPAS-36D predicts the intention to use EBP.

RESULTS

N = 599 psychotherapists participated in the study. The item analyses showed a mean item difficulty of p_i = 0.64, a mean inter-item correlation of r = 0.18, and a mean item-total correlation of r_itc = 0.40. The internal consistency was very good for the total scale (α = 0.89) and ranged from adequate to very good for the subscales (0.65-0.89), indicating high reliability. The original factor structure showed an acceptable model fit (RMSEA = 0.064 (90% CI = 0.059-0.068); SRMR = 0.0922; AIC = 1400.77), confirming the 12-factor structure of the EBPAS-36. However, a second-order factor structure derived by the EFA had an even better model fit (RMSEA = 0.057 (90% CI = 0.052-0.062); SRMR = 0.0822; AIC = 1274.56). When the EBPAS-36D was entered in a hierarchical regression model with the criterion Intention to use EBP, the EBPAS-36D contributed significantly to the prediction (Change in R² = 0.28, p < 0.001) over and above gender, age and participants' report of ever having worked in a university context.

CONCLUSIONS

The present study confirms good psychometric properties and validity of a German version of the EBPAS-36 in a sample of psychotherapists.

Knowledge of Evidence-Based Services Questionnaire: Development and Validation of a Short Form

The Knowledge of Evidence-Based Services Questionnaire (KEBSQ) is an objective measure of therapist knowledge of practices derived from the evidence base for the treatment of youth psychopathology. However, the length of this measure (i.e., 40 items) and respondent demands associated with each item makes it burdensome for researchers and clinicians. This study developed and validated a Short Form of the KEBSQ using Item Response Theory measurement models. The Short Form consists of 17 items and generates two separate scores: Correct Endorsements and Correct Rejections. The Short Form was found to correlate highly with and perform similarly to the Full Form, providing preliminary validity evidence.

Making Implementation Last: The Impact of Training Design on the Sustainability of an Evidence-Based Treatment in a Randomized Controlled Trial

Although advances have been made in facilitating the implementation of evidence-based treatments, little is known about the most effective way to sustain their use over time. The current study examined the sustainability of one evidence-based treatment, Parent-Child Interaction Therapy (PCIT), following a statewide implementation trial testing three training methods: Cascading Model, Learning Collaborative, and Distance Education. Participants included 100 clinicians and 50 administrators from 50 organizations across Pennsylvania. Clinicians and administrators reported on sustainability at 24-months, as measured by the number of clients receiving PCIT and the continued use of the PCIT protocol. Multi-level path analysis was utilized to examine the role of training on sustainability. Clinicians and administrators reported high levels of sustainability at 24-months. Clinicians in the Cascading Model reported greater average PCIT caseloads at 24-months, whereas clinicians in the Learning Collaborative reported greater full use of the PCIT protocol at 24-months. Attending consultation calls was associated with delivering PCIT to fewer families. Implications for the sustainable delivery of PCIT beyond the training year as well as for the broader field of implementation science are discussed.

Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS-ROM

Implementation of routine outcome monitoring (ROM) in mental health care is progressing slowly. Knowledge about factors influencing ROM implementation, including health providers' attitudes towards ROM, is necessary. Based on a survey of 662 psychologists and nurses, this article describes (1) the development of a short instrument measuring provider attitudes towards ROM, derived from the Evidence-based Practice Attitude Scale (EBPAS), and (2) how attitudinal domains relate to clinicians' current use of standardized instruments for treatment evaluation. The EBPAS-ROM showed concurrent validity in predicting aspects important for the implementation of ROM, including perceived limitations and the value of organizational support.

Therapist and Youth Predictors of Specific Practices Derived from the Evidence-Base in Community Mental Health

Over the past several years, youth treatment research has moved toward understanding the dissemination and implementation of evidence-based practices (EBPs). As a result, studies have focused on identifying predictors that aid in successful adoption and sustainment of EBPs. Theories of behavior change posit that therapist knowledge and attitudes play a fundamental role in EBP adoption; however, studies have produced mixed findings, which may be an artifact of broad definitions of both EBP knowledge and EBP itself. The current study was an examination of 46 youth community therapists and the extent to which varying types of knowledge and attitudes as well as youth characteristics predicted specific practices derived from the evidence-base. Results suggested that specific EBP knowledge predicted specific practices, highlighting the need for more specificity when examining predictors of EBP use. Therapists' attitudes, demographic characteristics, and youth characteristics were also significant predictors of EBP use. Future research should consider examining discrete and specific practices to better understand and predict therapists' future behavior.

Clinicians' attitudes toward standardized assessment and diagnosis within child and adolescent psychiatry

BACKGROUND

There is a strong call for clinically useful standardized assessment tools in everyday child and adolescent psychiatric practice. The attitudes of clinicians have been raised as a key-facilitating factor when implementing new methods. An explorative study was conducted aimed to investigate the clinicians' attitudes regarding standardized assessments and usefulness of diagnoses in treatment planning.

METHODS

411 mental health service personnel working with outpatient and inpatient assessment and treatment within the specialist child and adolescent mental health services, Stockholm County Council were asked to participate in the study, of which 345 (84%) agreed answer a questionnaire. The questionnaire included questions regarding Attitudes toward Standardized Assessment and Utility of Diagnosis. Descriptive analyses were performed and four subscales were compared with information from a similar study in US using the same instruments. The demographic and professional characteristics (age, working years, gender, education, profession, management position, involvement in assessment, level of service) in terms of prediction of attitudes were studied by univariate and multivariate linear regressions.

RESULTS

Overall, the clinicians had quite positive attitudes and were more positive compared to a similar study conducted in the US earlier. There were differences in attitudes due to several characteristics but the only characteristic predicting all subscales was type of profession (counselor, nurse, psychiatrist, psychologist, other), with counselors being less positive than other groups.

CONCLUSION

The overall positive attitudes toward standard assessment are of importance in the development of evidence-based practice and our study implies that clinicians in general value and are willing to use standardized assessment. Nevertheless, there are specific issues such as adequate training and available translated assessment instrument that need to be addressed. When implementing new methods in practice, there are general as well as specific resistances that need to be overcome. Studies in different cultural settings are of importance to further extend the knowledge of what is general and what is specific barriers.

Attitudes of mental health providers towards adoption of evidence-based interventions: relationship to workplace, staff roles and social and psychological factors at work

Background

Gaining insight into factors influencing the adoption of evidence-based interventions (EBI) is essential to ensuring their sustainability in the mental healthcare setting. This article describes 1) differences between professional staff roles in attitudes towards EBI and 2) individual and organizational predictors of attitudes towards adopting EBI.

Methods

The participants were psychologists and psychiatric nurses (N = 792). Student t-tests were used to investigate group differences of global attitude scores on the Evidence-based Practice Attitude Scale-36 (EBPAS-36). A confirmatory factor analysis (CFA) of the EBPAS-36 measurement model, and a principal component analysis (PCA) of the factor scores were used to obtain attitudinal components for the subsequent hierarchical regression analyses.

Results

Three second-order attitudinal components were retained and named: professional concern, attitudes related to work conditions and requirements, and attitudes related to fit and preferences. Nurses’ global attitudinal scores were more positive than those of psychologists, while clinicians had less positive global attitudinal scores than non-clinicians. Hierarchical regression analysis showed that provider demographic, social and psychological factors in the workplace and staff role predicted attitudes towards adopting EBI, e.g. male gender, older age and working in private practice predicted more negative global attitudes, while working in academia, experiencing social support from colleagues and empowering leadership predicted more positive global attitudes to adopt EBI. The prediction outcomes for the specific attitudinal components are presented, as well.

Conclusion

The findings suggest that implementation efforts may benefit from being tailored to the different needs and values of the affected professionals, including the role of the context they operate within. Implications with a special emphasis on training efforts and organizational development are discussed.