Clinician use of standardized assessments following a common elements psychotherapy training and consultation program

Definition and Assessment of Paediatric Breakthrough Pain: A Qualitative Interview Study

Infants, children and young people with life-limiting or life-threatening conditions often experience acute, transient pain episodes known as breakthrough pain. There is currently no established way to assess breakthrough pain in paediatric palliative care. Anecdotal evidence suggests that it is frequently underdiagnosed and undertreated, resulting in reduced quality of life. The development of a standardised paediatric breakthrough pain assessment, based on healthcare professionals' insights, could improve patient outcomes. This study aimed to explore how healthcare professionals define and assess breakthrough pain in paediatric palliative care and their attitudes towards a validated paediatric breakthrough pain assessment. This was a descriptive qualitative interview study. Semi-structured interviews were conducted with 29 healthcare professionals working in paediatric palliative care across the UK. An inductive thematic analysis was conducted on the data. Five themes were generated: 'the elusive nature of breakthrough pain', 'breakthrough pain assessment', 'positive attitudes towards', 'reservations towards' and 'features to include in' a paediatric breakthrough pain assessment. The definition and assessment of breakthrough pain is inconsistent in paediatric palliative care. There is a clear need for a validated assessment questionnaire to improve assessment, diagnosis and management of breakthrough pain followed by increased healthcare professional education on the concept.

Consultation as an Implementation Strategy to Increase Fidelity of Measurement-Based Care Delivery in Community Mental Health Settings: An Observational Study

Regularly administering outcome measures to clients to inform clinical decision making, referred to as measurement-based care (MBC), has the potential to improve mental health treatment due to its applicability across disorders and treatment settings. Given the utility of MBC, understanding predictors of high-fidelity MBC implementation is important. Training and consultation are widely used implementation strategies to increase the fidelity of evidence-based practice delivery but have rarely been studied with MBC. The current study will examine the relationship between time clinicians spent discussing a case in consultation ("dosage") and MBC fidelity. Thirty clinicians and 56 youth were in the MBC condition of a randomized controlled trial and completed baseline questionnaires. Consultation dosage was extracted from call notes. MBC fidelity was measured using the implementation index, which combines rates of administering and viewing questionnaires, using objective data from the online MBC system. Multi-level modeling was used. Greater consultation dosage significantly predicted a higher implementation index (ß = 0.27, SE = 0.06, p < .001). For every 30 min spent discussing a case in consultation, the case's MBC fidelity increased by 8.1%. Greater consultation dosage significantly predicted higher rates of administration (ß = 0.07, SE = 0.03, p = 0.033) and feedback report viewing (ß = 0.24, SE = 0.06, p < .001). More consultation at the case level predicts greater MBC fidelity using objective measures. The greatest impact was increasing the clinician feedback report viewing rate. The results of this study can help inform future efforts to increase the fidelity with which MBC is delivered and to make consultation as efficient and effective as possible.

Clinicians' perceptions and practices of diagnostic assessment in psychiatric services

BACKGROUND

Diagnostic assessment in psychiatric services typically involves applying clinical judgment to information collected from patients using multiple sources, including anamnesis and structured diagnostic interviews. Research shows that clinicians' perceptions of diagnostic assessment are associated with their diagnostic practices, and that perceptions and practices may vary according to clinician characteristics. Examining clinicians' perceptions and practices of diagnostic assessment is important for quality improvement in psychiatric services, including implementation of evidence-based practice procedures. The purpose of the present study was to evaluate clinicians' perceptions and practices of diagnostic assessment in psychiatric services and examine whether these perceptions and practices varied according to profession and age, with the aim of providing a basis for quality improvement.

METHODS

A total of 183 (53.2%) clinicians in community-based adult psychiatric services in Stockholm, Sweden participated in an online survey. Differences between professions were analyzed using Kruskal-Wallis tests and effect sizes were calculated. Associations of clinicians' perceptions with their age were examined using Spearman correlations.

RESULTS

Overall, clinicians had positive attitudes toward diagnostic assessment, and they considered themselves as competent. Differences were as most pronounced between nurses and other professions. Nursed had conducted fewer assessments, perceived themselves as less competent, and reported to a smaller extent to be able to determine which diagnosis should be the target for treatment in patients with multiple diagnoses. There were no associations of clinicians' perceptions with their age. Some potential areas of improvement were identified, including clinician qualifications, education in diagnostic assessment, and contents of diagnostic assessment.

CONCLUSIONS

The results of the present study may provide a basis for quality improvement in psychiatric services. For example, it may be important to pay attention to potential differences in perceptions and practices between professions in efforts to improve quality of assessment and care.

Organization-level variation in therapists' attitudes toward and use of measurement-based care

PURPOSE

Despite significant interest in improving behavioral health therapists' implementation of measurement-based care (MBC)-and widespread acknowledgment of the potential importance of organization-level determinants-little is known about the extent to which therapists' use of, and attitudes toward, MBC vary across and within provider organizations or the multilevel factors that predict this variation.

METHODS

Data were collected from 177 therapists delivering psychotherapy to youth in 21 specialty outpatient clinics in the USA. Primary outcomes were use of MBC for progress monitoring and treatment modification, measured by the nationally-normed Current Assessment of Practice Evaluation-Revised. Secondary outcomes were therapist attitudes towards MBC. Linear multilevel regression models tested the association of theory-informed clinic and therapist characteristics with these outcomes.

RESULTS

Use of MBC varied significantly across clinics, with means on progress monitoring ranging from values at the 25th to 93rd percentiles and means on treatment modification ranging from the 18th to 71st percentiles. At the clinic level, the most robust predictor of both outcomes was clinic climate for evidence-based practice implementation; at the therapist level, the most robust predictors were: attitudes regarding practicality, exposure to MBC in graduate training, and prior experience with MBC. Attitudes were most consistently related to clinic climate for evidence-based practice implementation, exposure to MBC in graduate training, and prior experience with MBC.

CONCLUSIONS

There is important variation in therapists' attitudes toward and use of MBC across clinics. Implementation strategies that target clinic climate for evidence-based practice implementation, graduate training, and practicality may enhance MBC implementation in behavioral health.

Standardized Versus Tailored Implementation of Measurement-Based Care for Depression in Community Mental Health Clinics

Objective

Measurement-based care (MBC) is an evidence-based practice that is rarely integrated into psychotherapy. The authors sought to determine whether tailored MBC implementation can improve clinician fidelity and depression outcomes compared with standardized implementation.

Methods

This cluster-randomized trial enrolled 12 community behavioral health clinics to receive 5 months of implementation support. Clinics randomized to the standardized implementation received electronic health record data captured with the nine-item Patient Health Questionnaire (PHQ-9), a needs assessment, clinical training, guidelines, and group consultation in MBC fidelity. Tailored implementation support included these strategies, but the training content was tailored to clinics’ barriers to MBC, and group consultation centered on overcoming these barriers. Clinicians (N=83, tailored; N=71, standardized) delivering individual psychotherapy to 4,025 adults participated. Adult patients (N=87, tailored; N=141, standardized) contributed data for depression outcome analyses.

Results

The odds of PHQ-9 completion were lower in the tailored group at baseline (odds ratio [OR]=0.28, 95% CI=0.08–0.96) but greater at 5 months (OR=3.39, 95% CI=1.00–11.48). The two implementation groups did not differ in full MBC fidelity. PHQ-9 scores decreased significantly from baseline (mean±SD=17.6±4.4) to 12 weeks (mean=12.6±5.9) (p<0.001), but neither implementation group nor MBC fidelity significantly predicted PHQ-9 scores at week 12.

Conclusions

Tailored MBC implementation outperformed standardized implementation with respect to PHQ-9 completion, but discussion of PHQ-9 scores in clinician-patient sessions remained suboptimal. MBC fidelity did not predict week-12 depression severity. MBC can critically inform collaborative adjustments to session or treatment plans, but more strategic system-level implementation support or longer implementation periods may be needed.

Characterizing measurement-based care implementation using therapist report

The effectiveness of measurement-based care (MBC), an evidence-based practice that uses regularly collected assessment data to guide clinical decision-making, is impacted by whether and how therapists use information from MBC tools in treatment. Improved characterization of how therapists use MBC in treatment sessions with youth is needed to guide implementation and understand variability in MBC effectiveness. To meet this need, this study examined therapists' sharing and discussion of MBC in treatment sessions. Thirty therapists were randomly assigned to the MBC condition as part of a comparative effectiveness trail of treatments for adolescent anxiety and depression. A qualitative content analysis was conducted on therapists' written explanations of changes made to the session based on the MBC data. Therapists reported sharing data with youth and caregivers in an average of 34.6% and 27.4% of sessions, respectively. Therapists reported incorporating MBC data in an average of 21.1% of sessions. When data were used, therapists predominately focused changes on short-term (e.g., current symptoms, treatment skill) rather than long-term (e.g., symptom progress, treatment goals) decision-making. Therapists inconsistently used MBC data, highlighting the need for improved training in and monitoring of how therapists use MBC in session to guide collaborative treatment decision-making with youth and caregivers.

Implementation of Evidence-Based Practices within Treatment-As-Usual and Evidence-Based Practice Initiatives

Publicly funded initiatives are underway to improve implementation of evidence-based practices (EBP) in youth mental health services. However, we know little about the success of these initiatives or about EBP implementation independent of such initiatives. We examined EBP implementation in a treatment as usual (TAU) state and in six states with publicly funded EBP initiatives (EBPIs). In Study 1, we examined providers' use of practices derived from the evidence base (PDEB) and their predictors among 780 providers in a TAU state. In Study 2, we conducted a systematic review of implementation strategies, outcomes, and predictors of EBP use in six state funded EBPIs. Study 1 suggests TAU providers use PDEB alongside practices without consistent research support; provider racial/ethnic minority status, learning theory orientation, and manual use predict greater PDEB use. Study 2 indicates EBPIs employ multiple recommended implementation strategies with variable outcomes across studies and measurement approaches. Predictors of EBP use in EBPIs also varied, though training, setting, and youth age were consistent predictors across studies. While sample differences and inconsistent measurement across studies made direct comparisons somewhat tenuous, rates of PDEB use in the TAU sample appeared similar to those in publicly funded EBPIs. However, two states reported comparisons with TAU samples and found higher EBP implementation under EBPI. Different predictors impacted EBP use in TAU versus EBPIs. Our findings highlight the need for improved evaluation of EBPIs including clear reporting standards for outcomes and more consistent, standardized measurement of EBP use in order to better understand and improve EBPIs.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Implementation facilitation strategies to promote routine progress monitoring among community therapists

Despite substantial support for the importance of routine progress monitoring (RPM) as part of evidence-based practice, few providers utilize measurement-based care. This study sought to identify the relative importance of facilitation strategies viewed as most helpful for increasing intention to use RPM among 388 ethnically diverse community therapists serving children and families. Four types of facilitation strategies were examined: language/interpretability, automation, staffing/access, and requirements. Mixed analyses of variance found that therapists' reported intentions to use RPM were more influenced by strategies of automating assessment administration, provision of clerical assistance, and agency requirements than by making linguistically appropriate measures available. However, the importance of strategies differed depending on therapist race/ethnicity and current RPM use. Language/interpretability of RPM assessments was less emphasized for non-Hispanic White therapists and therapists who have not yet or only minimally adopted RPM compared with ethnic minority therapists and therapists who regularly use RPM, respectively. Furthermore, therapists who were not current RPM users emphasized automation more than staffing/access. Results may inform prioritization of implementation facilitation strategies for agencies to encourage RPM. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Applying behaviour change theory to understand the barriers to implementing routine outcome monitoring

BACKGROUND

Routine outcome monitoring (ROM) is a valuable tool for monitoring client progress and pre-empting deterioration, however, there is considerable variation in how data are collected and recorded and uptake in clinical practice remains low. The aim of this study was to develop a self-report measure of practitioner attitudes to ROM in order to better understand the barriers to successful implementation in Child and Adolescent Mental Health Services (CAMHS).

METHODS

An anonymous survey was completed by 184 CAMHS practitioners in the United Kingdom. The survey was designed using the Capability, Opportunity, and Motivation Model of Behaviour (COM-B). Practitioners who reported using ROM frequently in their clinical work (53%) were compared to those who used ROM infrequently (47%) across dimensions of the COM-B survey subscales.

RESULTS

Confirmatory factor analysis confirmed the proposed four-factor structure, showing acceptable model fit, with high factor loadings and good reliability for all subscales. Frequent users of ROM exhibited significantly higher psychological capability, physical opportunity, social opportunity, and motivation, compared to infrequent users F (4, 140) = 14.76, p < .0001; Pillai's Trace = .297, partial η²  = .30. Results highlight several barriers to ROM, including the belief that there is not a strong evidence base for ROM, not receiving external training, and not discussing feedback and outcome data in supervision.

IMPLICATIONS

In the hope of improving the successful implementation of ROM, this research provides an evidence-based tool for assessing practitioners' attitudes to ROM, which map on to intervention functions and represent targets for future implementation efforts.

PRACTITIONER POINTS

The value of routine outcome monitoring (ROM) as a means to measure client progress and to elevate the efficiency and quality of mental health care is well-documented in the research literature, however, uptake in practice remains relatively low. This study applied behaviour change theory to develop a psychometrically sound self-report measure of practitioners' perspectives and practices to understand the barriers to implementation in child and adolescent mental health services in the United Kingdom. The complex and multifaceted nature of the barriers to implementation requires multilevel behaviour change strategies at the client, clinician, and organisational level. Recommendations for practice include the need for integrated, multilevel strategies aimed at improving practitioners' capabilities and motivations, strong organisational leadership and a culture of data gathering and sharing, and implementation interventions, which are tailored to target local barriers.

Middle and High School Student Perspectives on Digitally-Delivered Mental Health Assessments and Measurement Feedback Systems

Implementation of measurement-based care (MBC) by child-serving community mental health providers, particularly school-based providers, is low. To inform user-centered design of measurement feedback systems (MFSs) and MBC implementation more broadly, semi-structured interviews were conducted with 61 middle and high school students. Interviews explored student preferences for and perceived helpfulness of different assessment methods and use of MFS in counseling. Results indicate that student preference for digitally-administered assessment is equivocal, with preferences being influenced by student perceptions of the ease of use, impersonalization, and confidentiality. Students with exposure to the MFS found it helpful when used by their provider to share assessment feedback.

MFA and ASA-MF: A Psychometric Analysis of Attitudes Towards Measurement-Based Care

Measurement based care (MBC) improves client outcomes by providing clinicians with routine mental health outcome data that can be used to inform treatment planning but is rarely used in practice. The Monitoring and Feedback Attitudes Scale (MFA) and Attitudes Towards Standardized Assessment Scales-Monitoring and Feedback (ASA-MF) (Jensen-Doss et al., 2016) may identify attitudinal barriers to MBC, which could help trainings and implementation strategies. This study examines the psychometric properties of the MFA and ASA-MF, including the factor structure, longitudinal invariance, and indicators of validity, in a sample of community mental health clinicians (N = 164). The measures demonstrate adequate fit to their factor structures across time and predict MBC use as captured in a client's electronic health record. Given that clinician attitudes are associated with MBC use, using instruments with psychometric support to assess attitudes fills a research to practice gap.

Exploration, Preparation, and Implementation of Standardized Assessment in a Multi-agency School Behavioral Health Network

School mental health treatment services offer broad public health impact and could benefit from more widespread implementation and sustainment of standardized assessments (SA). This demonstration study describes one approach to increase SA use in a large school behavioral health network using the Exploration, Preparation, Implementation and Sustainment (EPIS) framework. Mental health administrator interviews with four participating agencies and a multidisciplinary planning team informed SA measure selection and implementation supports. The SA initiative was implemented during one school year, including system-wide training and ongoing implementation supports for 95 clinicians. Linear mixed effect models revealed improvements in clinician attitudes about the SA for clinical utility and treatment planning immediately following the half-day training (N = 95, p < .001). Clinicians self-reported a significant increase in use of SA for new clients during intakes (p < .001) over time and 71.4% of expected SA data were submitted. Qualitative feedback, including recommendations to offer more SA choices and beginning new SA data collection earlier in the school year, was integrated to inform quality improvements and future sustainment efforts.

Use of effective training and quality assurance strategies is associated with high-fidelity EBI implementation in practice settings: a case analysis

High-quality implementation of evidence-based interventions is important for program effectiveness and is influenced by training and quality assurance (QA). However, gaps in the literature contribute to a lack of guidance on training and supervision in practice settings, particularly when significant adaptations in programs occur. We examine training and QA in relationship to program fidelity among organizations delivering a widely disseminated HIV counseling and testing EBI in which significant adaptations occurred due to new testing technology. Using a maximum variation case study approach, we examined training and QA in organizations delivering the program with high- and low-fidelity (agencies: 3 = high; 3 = low). We identified themes that distinguished high- and low-fidelity agencies. For example, high-fidelity agencies more often employed a team approach to training; demonstrated use of effective QA strategies; leveraged training and QA to identify and adjust for fit problems, including challenges related to adaptations; and understood the distinctions between RESPECT and other testing programs. The associations between QA and fidelity were strong and straightforward, whereas the relationship between training and fidelity was more complex. Public health needs high-quality training and QA approaches that can address program fit and program adaptations. The study findings reinforced the value of using effective QA strategies. Future work should address methods of increasing program fit through training and QA, identify a set of QA strategies that maximize program fidelity and is feasible to implement, and identify low-cost supplemental training options.

Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes

A lack of effective therapist training is a major barrier to evidence-based intervention (EBI) delivery in the community. Systematic reviews published nearly a decade ago suggested that traditional EBI training leads to higher knowledge but not more EBI use, indicating that more work is needed to optimize EBI training and implementation. This systematic review synthesizes the training literature published since 2010 to evaluate how different training models (workshop, workshop with consultation, online training, train-the-trainer, and intensive training) affect therapists' knowledge, beliefs, and behaviors. Results and limitations for each approach are discussed. Findings show that training has advanced beyond provision of manuals and brief workshops; more intensive training models show promise for changing therapist behavior. However, methodological issues persist, limiting conclusions and pointing to important areas for future research.

What Motivates Mental Health Clinicians-in-Training to Implement Evidence-Based Assessment? A Survey of Social Work Trainees

Mental health clinicians do not consistently use evidence-based assessment (EBA), a critical component of accurate case conceptualization and treatment planning. The present study used the Unified Theory of Behavior to examine determinants of intentions to use EBA in clinical practice among a sample of Masters' level social work trainees (N = 241). Social norms had the largest effect on intentions to use EBA. Injunctive norms in reference to respected colleagues accounted for the most variance in EBA intentions. Findings differed for respondents over 29 years of age versus younger respondents. Implications for implementation strategies and further research are discussed.

Evidence Base Update for Brief, Free, and Accessible Youth Mental Health Measures

Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.

Attitudes toward standardized assessment tools and their use among clinicians in a public mental health service

The aim of the present study was to investigate the use and attitudes toward standardized assessment tools among clinicians in a public mental health service in Norway. A total of 606 clinicians provided feedback on their use and attitudes regarding psychometric qualities of such tools, their practicality, and their benefit over clinical judgment alone using the Attitudes toward Standardized Assessment (ASA) Scales. Clinicians working in the adult mental health field scored significantly higher on use of diagnostic interviews, pre-post evaluations, and ongoing evaluations, whereas clinicians working in the child/adolescent mental health field scored significantly higher on use of screening instruments and held more positive attitudes towards using standardized assessment tools. Attitudes toward standardized assessment tools predicted use of such tools, and results were found to be similar to a study on US clinicians. Whereas the US study only found attitudes regarding the practicality of using such instrument as an independent predictor of assessment use, the current study found that attitudes regarding psychometric qualities of such tools, their practicality, and their benefit over clinical judgment alone were independent predictors of use.

Perspektiven einer evidenzbasierten und personalisierten Psychotherapie

Zusammenfassung. Theoretischer Hintergrund: Der Diskurs um eine evidenz-basierte und personalisierte (bzw. „Precision“) Medizin sowie zur Umsetzung von Evaluation und Qualitätssicherung hat in den letzten Jahren auch Einfluss auf die Psychotherapieforschung genommen. Dies gilt in Bezug auf die patientenspezifische Auswahl von Behandlungen (u. a. personalisierte Vorhersagen) als auch für die dynamische Anpassung von Interventionen im Therapieverlauf (adaptive Indikation, Feedback, Problemlösetools). Fragestellung und Methode: Im Bereich der differentiellen Indikation sind mittlerweile unterschiedliche Algorithmen („machine learning“) und Netzwerkmodelle zur Vorhersage erprobt worden. Für eine empirisch gestützte adaptive Indikation bilden insbesondere die Studien zum psychometrischen Feedback sowie die Entwicklung von Problemlösetools für Risikopatient_innen die Grundlage. Ergebnisse: Diese Grundlagenforschung war die Basis für die Entwicklung eines Entscheidungssystems (Trierer Therapie Navigator, TTN) zur Vorhersage der optimalen Behandlungsstrategie und des Abbruchrisikos. Darüber hinaus enthält der TTN ein adaptives Modellierungselement des Behandlungsverlaufs. Es können damit Risikopatienten für einen Behandlungsmisserfolg identifiziert und Behandlungsoptimierungen über Problemlösetools unterstützt werden. Schlussfolgerungen: In vorliegender Arbeit werden zentrale neue Ansätze einer evidenz-basierten und personalisierten Psychotherapie zusammenfassend dargestellt sowie die Anwendung in der klinischen Praxis diskutiert.

Clinicians' attitudes toward standardized assessment and diagnosis within child and adolescent psychiatry

BACKGROUND

There is a strong call for clinically useful standardized assessment tools in everyday child and adolescent psychiatric practice. The attitudes of clinicians have been raised as a key-facilitating factor when implementing new methods. An explorative study was conducted aimed to investigate the clinicians' attitudes regarding standardized assessments and usefulness of diagnoses in treatment planning.

METHODS

411 mental health service personnel working with outpatient and inpatient assessment and treatment within the specialist child and adolescent mental health services, Stockholm County Council were asked to participate in the study, of which 345 (84%) agreed answer a questionnaire. The questionnaire included questions regarding Attitudes toward Standardized Assessment and Utility of Diagnosis. Descriptive analyses were performed and four subscales were compared with information from a similar study in US using the same instruments. The demographic and professional characteristics (age, working years, gender, education, profession, management position, involvement in assessment, level of service) in terms of prediction of attitudes were studied by univariate and multivariate linear regressions.

RESULTS

Overall, the clinicians had quite positive attitudes and were more positive compared to a similar study conducted in the US earlier. There were differences in attitudes due to several characteristics but the only characteristic predicting all subscales was type of profession (counselor, nurse, psychiatrist, psychologist, other), with counselors being less positive than other groups.

CONCLUSION

The overall positive attitudes toward standard assessment are of importance in the development of evidence-based practice and our study implies that clinicians in general value and are willing to use standardized assessment. Nevertheless, there are specific issues such as adequate training and available translated assessment instrument that need to be addressed. When implementing new methods in practice, there are general as well as specific resistances that need to be overcome. Studies in different cultural settings are of importance to further extend the knowledge of what is general and what is specific barriers.

Associations between cultural identity and attitudes toward routine progress monitoring in a sample of ethnically diverse community therapists

Community mental health services are increasingly embracing evidence-based interventions (EBIs), and the professional workforce is diversifying to meet the needs of historically underserved groups. As such, it is increasingly important to understand how psychotherapist cultural factors may be associated with attitudes toward EBIs. The use of standardized assessments within routine progress monitoring is a cornerstone of EBIs, yet therapist attitudes remain an obstacle to implementation. The current study examines the associations between therapist cultural identity and attitudes toward and use of routine progress monitoring. An online survey was used to gather data from 229 ethnic minority community therapists delivering EBIs in a large public mental health system serving children and families. Therapists had an average age of 35.2 years (SD = 7.7), 86.5% were female, 69.9% were Hispanic/Latinx and 30.2% were other ethnic minority, 36.2% were licensed, 90.8% held a master's degree, and 76.4% reported ability to deliver services in a non-English language. Hierarchical multiple regression analyses revealed that stronger heritage cultural identity was related to perceptions of potential harm with routine progress monitoring. In addition, more favorable views of standardized assessment instructions were associated with positive attitudes toward routine progress monitoring. We discuss how findings point to the need for additional user-centered research with diverse community therapists to learn how assessment and progress monitoring can be better designed to address their cultural and racial-based concerns. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Évaluation du Plan d’action en santé mentale (2005-2015) : intégration et performance des réseaux de services

Cet article présente les résultats d’un programme de recherche visant à : 1) évaluer l’implantation de la réforme en santé mentale (SM) et ses facteurs favorisant ou entravant dans 11 réseaux locaux de services et la performance d’équipe en SM ; 2) cerner dans quatre réseaux les processus influençant la qualité des services d’équipe ; 3) analyser dans ces mêmes réseaux les effets des structures et des processus d’équipe sur les usagers. Les objectifs de la réforme en SM n’ont été que partiellement atteints dans les réseaux. Les résultats montrent qu’une plus grande utilisation d’outils et d’approches cliniques et des interactions fréquentes entre les équipes et les organisations améliorent la performance. De même, divers processus d’équipe comme l’autonomie, la participation aux processus décisionnels et le partage des connaissances incitent à la performance des professionnels et à la qualité des services. L’intensité des besoins des usagers réduit la capacité des services à répondre aux besoins. Enfin, le rétablissement et la qualité de vie sont fortement corrélés à la continuité et à la diversité des services offerts. Différentes recommandations sont formulées afin d’améliorer les services dont la promotion de cultures organisationnelles plus orientées sur les résultats et la collaboration, le soutien et la formation des professionnels sur l’intégration de pratiques basées sur les données probantes, l’augmentation de l’autonomie des professionnels et leur implication dans les décisions, ainsi que la formalisation de stratégies d’intégration. Enfin, un soutien biopsychosocial diversifié et continu d’intensité variable est recommandé pour améliorer le rétablissement et la qualité de vie des usagers.

Provider-Associated Measurement Error in Routine Outcome Monitoring in Community Mental Health

Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54% of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.

Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

BACKGROUND

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

METHODS

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

RESULTS

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

CONCLUSIONS

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

TRIAL REGISTRATION

NCT01800266 , Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results]).

Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice

Numerous trials demonstrate that monitoring client progress and using feedback for clinical decision-making enhances treatment outcomes, but available data suggest these practices are rare in clinical settings and no psychometrically validated measures exist for assessing attitudinal barriers to these practices. This national survey of 504 clinicians collected data on attitudes toward and use of monitoring and feedback. Two new measures were developed and subjected to factor analysis: The monitoring and feedback attitudes scale (MFA), measuring general attitudes toward monitoring and feedback, and the attitudes toward standardized assessment scales-monitoring and feedback (ASA-MF), measuring attitudes toward standardized progress tools. Both measures showed good fit to their final factor solutions, with excellent internal consistency for all subscales. Scores on the MFA subscales (Benefit, Harm) indicated that clinicians hold generally positive attitudes toward monitoring and feedback, but scores on the ASA-MF subscales (Clinical Utility, Treatment Planning, Practicality) were relatively neutral. Providers with cognitive-behavioral theoretical orientations held more positive attitudes. Only 13.9 % of clinicians reported using standardized progress measures at least monthly and 61.5 % never used them. Providers with more positive attitudes reported higher use, providing initial support for the predictive validity of the ASA-MF and MFA. Thus, while clinicians report generally positive attitudes toward monitoring and feedback, routine collection of standardized progress measures remains uncommon. Implications for the dissemination and implementation of monitoring and feedback systems are discussed.

Relations between mental health team characteristics and work role performance

Effective mental health care requires a high performing, interprofessional team. Among 79 mental health teams in Quebec (Canada), this exploratory study aims to 1) determine the association between work role performance and a wide range of variables related to team effectiveness according to the literature, and to 2) using structural equation modelling, assess the covariance between each of these variables as well as the correlation with other exogenous variables. Work role performance was measured with an adapted version of a work role questionnaire. Various independent variables including team manager characteristics, user characteristics, team profiles, clinical activities, organizational culture, network integration strategies and frequency/satisfaction of interactions with other teams or services were analyzed under the structural equation model. The later provided a good fit with the data. Frequent use of standardized procedures and evaluation tools (e.g. screening and assessment tools for mental health disorders) and team manager seniority exerted the most direct effect on work role performance. While network integration strategies had little effect on work role performance, there was a high covariance between this variable and those directly affecting work role performance among mental health teams. The results suggest that the mental healthcare system should apply standardized procedures and evaluation tools and, to a lesser extent, clinical approaches to improve work role performance in mental health teams. Overall, a more systematic implementation of network integration strategies may contribute to improved work role performance in mental health care.

Variables associated with work performance in multidisciplinary mental health teams

OBJECTIVES

This study investigates work performance among 79 mental health teams in Quebec (Canada). We hypothesized that work performance was positively associated with the use of standardized clinical tools and clinical approaches, integration strategies, "clan culture," and mental health funding per capita.

METHODS

Work performance was measured using an adapted version of the Work Role Questionnaire. Variables were organized into four key areas: (1) team attributes, (2) organizational culture, (3) inter-organizational interactions, and (4) external environment.

RESULTS

Work performance was associated with two types of organizational culture (clan and hierarchy) and with two team attributes (use of standardized clinical tools and approaches).

DISCUSSION AND CONCLUSION

This study was innovative in identifying associations between work performance and best practices, justifying their implementation. Recommendations are provided to develop organizational cultures promoting a greater focus on the external environment and integration strategies that strengthen external focus, service effectiveness, and innovation.

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess "analogue fidelity" in a children's mental health quality improvement initiative. Results indicated low-but representative-clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

A Digital Feedback System to Support Implementation of Measurement-Based Care by School-Based Mental Health Clinicians

Evidence supports the utility of measurement-based care (MBC) to improve youth mental health outcomes, but clinicians rarely engage in MBC practices. Digital measurement feedback systems (MFS) may reflect a feasible strategy to support MBC adoption and sustainment. This pilot study was initiated to evaluate the impact of a MFS and brief consultation supports to facilitate MBC uptake and sustainment among mental health clinicians in the education sector, the most common mental health service delivery setting for youth. Following an initial training in MBC, 14 clinicians were randomized to either a digital MFS and brief consultation supports or control. Baseline ratings of MBC attitudes, skill, and use were collected. In addition, daily assessment ratings tracked 2 core MBC practices (i.e., assessment tool administration, provision of feedback) over a 6-month follow-up period. Clinicians in the MFS condition demonstrated rapid increases in both MBC practices, whereas the control group did not significantly change. For clinicians in the MFS group, consultation effects were significant for feedback and approached significance for administration. Over the follow-up period, average decreases in the current study were moderate with only 1 of the 2 outcome variables (administration) decreasing significantly. Inspection of individual clinician trajectories revealed substantial within-group trend variation. MFS may represent an effective MBC implementation strategy beyond initial training, although individual clinician response is variable. Identifying feasible and impactful implementation strategies is critical given the ability of MBC to support precision health care.

Determinants and Functions of Standardized Assessment Use Among School Mental Health Clinicians: A Mixed Methods Evaluation

The current study evaluated why and how school mental health clinicians use standardized assessment tools in their work with youth and families. Quantitative and qualitative (focus group) data were collected prior to and following a training and consultation sequence as part of a trial program to assess school clinician's (n = 15) experiences administering standardized tools to youth on their caseloads (n = 191). Findings indicated that, although assessment use was initially somewhat low, clinicians used measures to conduct initial assessments with the bulk of their caseloads (average = 62.2%) during the implementation period. Clinicians also reported on factors influencing their use of assessments at the client, provider, and system levels; perceived functions of assessment; student responses to assessment use; and use of additional sources of clinically-relevant information (primarily educational data) for the purposes of assessment and progress monitoring. Implications for the contextual appropriateness of standardized assessment and training in assessment tools are discussed.

The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems

Health information technologies have become a central fixture in the mental healthcare landscape, but few frameworks exist to guide their adaptation to novel settings. This paper introduces the contextualized technology adaptation process (CTAP) and presents data collected during Phase 1 of its application to measurement feedback system development in school mental health. The CTAP is built on models of human-centered design and implementation science and incorporates repeated mixed methods assessments to guide the design of technologies to ensure high compatibility with a destination setting. CTAP phases include: (1) Contextual evaluation, (2) Evaluation of the unadapted technology, (3) Trialing and evaluation of the adapted technology, (4) Refinement and larger-scale implementation, and (5) Sustainment through ongoing evaluation and system revision. Qualitative findings from school-based practitioner focus groups are presented, which provided information for CTAP Phase 1, contextual evaluation, surrounding education sector clinicians' workflows, types of technologies currently available, and influences on technology use. Discussion focuses on how findings will inform subsequent CTAP phases, as well as their implications for future technology adaptation across content domains and service sectors.

Assessment Practices of Child Clinicians

Assessment is an integral component of treatment. However, prior surveys indicate clinicians may not use standardized assessment strategies. We surveyed 1,510 clinicians and used multivariate analysis of variance to explore group differences in specific measure use. Clinicians used unstandardized measures more frequently than standardized measures, although psychologists used standardized measures more frequently than nonpsychologists. We also used latent profile analysis to classify clinicians based on their overall approach to assessment and examined associations between clinician-level variables and assessment class or profile membership. A four-profile model best fit the data. The largest profile consisted of clinicians who primarily used unstandardized assessments (76.7%), followed by broad-spectrum assessors who regularly use both standardized and unstandardized assessment (11.9%), and two smaller profiles of minimal (6.0%) and selective assessors (5.5%). Compared with broad-spectrum assessors, unstandardized and minimal assessors were less likely to report having adequate standardized measures training. Implications for clinical practice and training are discussed.