1
|
Louie E, Giannopoulos V, Baillie A, Uribe G, Wood K, Teesson M, Haber PS, Morley KC. Relationship between clinician-level attributes and implementation outcomes from the Pathways to Comorbidity Care training program. BMC MEDICAL EDUCATION 2022; 22:605. [PMID: 35931994 PMCID: PMC9354347 DOI: 10.1186/s12909-022-03671-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Accepted: 07/26/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND The process of determining the best strategy for increasing the uptake of evidence-based practice might be improved through an understanding of relevant clinician-level factors. The Pathways to Comorbidity Care (PCC) training program (Louie E, et al., J Dual Diagnosis 17:304-12, 2021) aimed to facilitate integrated management of comorbid drug and alcohol and mental disorders amongst drug and alcohol clinicians. We hypothesised that uptake of integrated management of comorbidity following the implementation of the PCC program would be associated with clinician-level: (i) demographics (gender, education, experience), (ii) attitudes (evidence-based practice, therapist manuals, counselling self-efficacy), and (iii) organisational readiness to change. METHODS Twenty clinicians participated in the 9-month PCC training program. Attitudes towards evidence-based practices and psychotherapist manuals, self-efficacy, and organisational readiness to change, along with demographics, were measured at baseline. At follow-up, change in Comorbidity Practice (CoP) scores related to integrated comorbidity management were obtained using a file audit checklist and categorised into high (at least 60% increase in CoP), medium or low (a decrease of - 20% or less in CoP). Clinician-level characteristics were examined across the implementation categories. RESULTS There were no significant differences found between implementation groups on sociodemographic variables (p's > 0.30), attitudes to evidence-based practices, attitudes to therapist manuals, and self-efficacy (p's > 0.52). The high implementation group demonstrated significantly higher scores on leadership practices aspect of organisational readiness to change relative to the low and medium implementation group ((F(2, 16) = 3.63, p = 0.05; Cohen's d = .31) but not on the other subscales (p's > 0.07). CONCLUSIONS Confidence that leadership will play a positive role in the implementation process may improve effectiveness of comorbidity training programs for drug and alcohol clinicians. On the other hand, contrary to our hypothesis, counselling self-efficacy, evidence-based practice attitudes, attitudes towards therapist manuals, gender, education and experience were not distinguishing factors.
Collapse
Affiliation(s)
- Eva Louie
- Sydney Medical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia
- Edith Collins Centre (Translational Centre in Alcohol, Drugs & Toxicology), Sydney Local Health District & Royal Prince Alfred Hospital, Camperdown, NSW, Australia
| | - Vicki Giannopoulos
- Edith Collins Centre (Translational Centre in Alcohol, Drugs & Toxicology), Sydney Local Health District & Royal Prince Alfred Hospital, Camperdown, NSW, Australia
| | - Andrew Baillie
- School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia
| | - Gabriela Uribe
- Menzies Centre for Health Policy, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia
| | - Katie Wood
- Sydney Medical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia
| | - Maree Teesson
- The Matilda Centre for Research in Mental Health and Substance Use, The University of Sydney, Camperdown, NSW, Australia
| | - Paul S Haber
- Sydney Medical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia
- Edith Collins Centre (Translational Centre in Alcohol, Drugs & Toxicology), Sydney Local Health District & Royal Prince Alfred Hospital, Camperdown, NSW, Australia
| | - Kirsten C Morley
- Sydney Medical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia.
- Edith Collins Centre (Translational Centre in Alcohol, Drugs & Toxicology), Sydney Local Health District & Royal Prince Alfred Hospital, Camperdown, NSW, Australia.
- Addiction Medicine, Central Clinical School, Sydney Medical School, University of Sydney, Camperdown, NSW, 2006, Australia.
| |
Collapse
|
2
|
Haneveld J, Rosner R, Vogel A, Mäkitalo S, Treml J, Steil R, Rief W, Comtesse H. Introduction and evaluation of a therapeutic adherence and competence scale for grief-focused cognitive behavioural therapy. Eur J Psychotraumatol 2022; 13:2079873. [PMID: 35759325 PMCID: PMC9225790 DOI: 10.1080/20008198.2022.2079873] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND There is no therapeutic competence and adherence scale for grief-focused cognitive behavioural therapy (grief-focused CBT). However, given the growing body of evidence for the efficacy of grief-focused CBT, such a scale is needed both to ensure the internal validity of clinical trials and to facilitate psychotherapy process research. OBJECTIVE To develop and undertake a psychometric evaluation of a therapeutic adherence and competence scale for grief-focused CBT. METHOD The scale was developed in two steps. (I) Five experts on the treatment of prolonged grief disorder provided feedback on the relevance and appropriateness of the items. The scale was revised to reflect their feedback. The final therapeutic adherence and competence scale for grief (TACs-G) consisted of 15 adherence and 16 competence items. (II) Psychometric evaluation of the TACs-G was based on the rating of 48 randomly selected PG-CBT sessions by two independent raters. The videos were recorded in the context of a randomized controlled trial (RCT; DRKS00012317.) ICC was used to calculate inter-rater reliability and TACs-G stability over time (re-evaluation of 10 sessions after 12 months). RESULTS The five experts confirmed the relevance and appropriateness of the items. Interrater reliability was found to be high for the total adherence and competence scores (ICC = 0.889 and 0.782, respectively) and moderate to excellent for individual items (ICC = 0.509-1.00). The TACs-G stability over time was found to be strong for both adherence (ICC = 0.970) and competence total scores (ICC = 0.965). CONCLUSIONS The TACs-G for CBT is a reliable instrument that can be used not only to ensure internal validity but is also suited for psychotherapy process studies. Additionally, it provides a valuable database for targeted feedback in training settings. HIGHLIGHTS This is the first study to report on the development and psychometrical evaluation of a grief-focused adherence and competence scale.Although an increasing number of clinical trials do report the efficacy of grief-focused cognitive-behavioural therapy, none of these studies used a standardized adherence and competence scale to control internal validity.In the present study, we introduced a therapeutic adherence and competence scale for grief (TACs-G) that can be applied efficiently across different research settings (e.g. manipulation check, dissemination), and report results of good to excellent psychometric properties.The scale itself could prove useful beyond the research setting as it could possibly serve as a basis for feedback in training settings.
Collapse
Affiliation(s)
- Julia Haneveld
- Department of Psychology, Catholic University Eichstaett-Ingolstadt, Ingolstadt, Germany
| | - Rita Rosner
- Department of Psychology, Catholic University Eichstaett-Ingolstadt, Ingolstadt, Germany
| | - Anna Vogel
- Department of Psychology, Catholic University Eichstaett-Ingolstadt, Ingolstadt, Germany
| | - Svenja Mäkitalo
- Department of Psychology, Catholic University Eichstaett-Ingolstadt, Ingolstadt, Germany
| | - Julia Treml
- Department für Psychische Gesundheit, Klinik und Poliklinik für Psychosomatische Medizin und Psychotherapie, Universitätsklinikum Leipzig, Leipzig, Germany
| | - Regina Steil
- Goethe Universität Frankfurt, Frankfurt, Germany
| | | | - Hannah Comtesse
- Department of Psychology, Catholic University Eichstaett-Ingolstadt, Ingolstadt, Germany
| |
Collapse
|
3
|
McGuier EA, Rothenberger SD, Friedman A, Kolko DJ. An equivalence analysis of provider education in youth mental health care. Health Serv Res 2021; 56:440-452. [PMID: 33844276 PMCID: PMC8143690 DOI: 10.1111/1475-6773.13659] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023] Open
Abstract
OBJECTIVE To test for equivalence between providers with and without advanced degrees in multiple domains related to delivery of evidence-based treatment. DATA SOURCE Provider and client data from an effectiveness trial of Alternatives for Families: A Cognitive Behavioral Therapy (AF-CBT) in a major metropolitan area in the United States. STUDY DESIGN We tested for equivalence between providers (N = 182) with and without advanced degrees in treatment-related knowledge, practices, and attitudes; job demands and stress; and training engagement and trainer-rated competence in AF-CBT. We also conducted exploratory analyses to test for equivalence in family clinical outcomes. DATA COLLECTION Providers completed measures prior to randomization and at 6-month follow-up, after completion of training and consultation in AF-CBT. Children and caregivers completed assessments at 0, 6, 12, and 18 months. PRINCIPAL FINDINGS Providers without advanced degrees were largely non-inferior to those with advanced degrees in treatment-related knowledge, practices, and attitudes, while findings for job demands and stress were mixed. Providers without advanced degrees were non-inferior to providers with advanced degrees in consultation attendance (B = -1.42; confidence interval (CI) = -3.01-0.16; margin of equivalence (Δ) = 2), number of case presentations (B = 0.64; CI = -0.49-1.76; Δ = 2), total training hours (B = -4.57; CI = -10.52-1.37; Δ = 3), and trainer-rated competence in AF-CBT (B = -0.04; CI = -3.04-2.96; Δ = 4), and they were significantly more likely to complete training (odds ratio = 0.66; CI = 0.10-0.96; Δ = 30%). Results for clinical outcomes were largely inconclusive. CONCLUSIONS Provider-level outcomes for those with and without advanced degrees were generally comparable. Additional research is needed to examine equivalence in clinical outcomes. Expanding evidence-based treatment training to individuals without advanced degrees may help to reduce workforce shortages and improve reach of evidence-based treatments.
Collapse
Affiliation(s)
- Elizabeth A. McGuier
- Department of PsychiatryUniversity of Pittsburgh School of MedicinePittsburghPennsylvaniaUSA
| | - Scott D. Rothenberger
- Department of MedicineUniversity of Pittsburgh School of MedicinePittsburghPennsylvaniaUSA
| | - Abbey Friedman
- Western Psychiatric HospitalUniversity of Pittsburgh Medical CenterPittsburghPennsylvaniaUSA
| | - David J. Kolko
- Department of PsychiatryUniversity of Pittsburgh School of MedicinePittsburghPennsylvaniaUSA
- Western Psychiatric HospitalUniversity of Pittsburgh Medical CenterPittsburghPennsylvaniaUSA
| |
Collapse
|
4
|
Louie E, Barrett EL, Baillie A, Haber P, Morley KC. A systematic review of evidence-based practice implementation in drug and alcohol settings: applying the consolidated framework for implementation research framework. Implement Sci 2021; 16:22. [PMID: 33663523 PMCID: PMC7931583 DOI: 10.1186/s13012-021-01090-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 02/11/2021] [Indexed: 12/31/2022] Open
Abstract
Background There is a paucity of translational research programmes to improve implementation of evidence-based care in drug and alcohol settings. This systematic review aimed to provide a synthesis and evaluation of the effectiveness of implementation programmes of treatment for patients with drug and alcohol problems using the Consolidated Framework for Implementation Research (CFIR). Methods A comprehensive systematic review was conducted using five online databases (from inception onwards). Eligible studies included clinical trials and observational studies evaluating strategies used to implement evidence-based psychosocial treatments for alcohol and substance use disorders. Extracted data were qualitatively synthesised for common themes according to the CFIR. Primary outcomes included the implementation, service system or clinical practice. Risk of bias of individual studies was appraised using appropriate tools. A protocol was registered with (PROSPERO) (CRD42019123812) and published previously (Louie et al. Systematic 9:2020). Results Of the 2965 references identified, twenty studies were included in this review. Implementation research has employed a wide range of strategies to train clinicians in a few key evidence-based approaches to treatment. Implementation strategies were informed by a range of theories, with only two studies using an implementation framework (Baer et al. J Substance Abuse Treatment 37:191-202, 2009) used Context-Tailored Training and Helseth et al. J Substance Abuse Treatment 95:26-34, 2018) used the CFIR). Thirty of the 36 subdomains of the CFIR were evaluated by included studies, but the majority were concerned with the Characteristics of Individuals domain (75%), with less than half measuring Intervention Characteristics (45%) and Inner Setting constructs (25%), and only one study measuring the Outer Setting and Process domains. The most common primary outcome was the effectiveness of implementation strategies on treatment fidelity. Although several studies found clinician characteristics influenced the implementation outcome (40%) and many obtained clinical outcomes (40%), only five studies measured service system outcomes and only four studies evaluated the implementation. Conclusions While research has begun to accumulate in domains such as Characteristics of Individuals and Intervention Characteristics (e.g. education, beliefs and attitudes and organisational openness to new techniques), this review has identified significant gaps in the remaining CFIR domains including organisational factors, external forces and factors related to the process of the implementation itself. Findings of the review highlight important areas for future research and the utility of applying comprehensive implementation frameworks. Supplementary Information The online version contains supplementary material available at 10.1186/s13012-021-01090-7.
Collapse
Affiliation(s)
- Eva Louie
- Sydney School of Medicine, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, 2006, Australia.,Edith Collins Centre (Alcohol, Drugs and Toxicology), Sydney Local Health District, Sydney, NSW, Australia
| | - Emma L Barrett
- The Matilda Centre for Research in Mental Health and Substance Use, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia
| | - Andrew Baillie
- Faculty of Health Sciences, The University of Sydney, Sydney, NSW, Australia
| | - Paul Haber
- Sydney School of Medicine, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, 2006, Australia.,Edith Collins Centre (Alcohol, Drugs and Toxicology), Sydney Local Health District, Sydney, NSW, Australia.,Drug Health Services, Royal Prince Alfred Hospital, Sydney, NSW, Australia
| | - Kirsten C Morley
- Sydney School of Medicine, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, 2006, Australia. .,Edith Collins Centre (Alcohol, Drugs and Toxicology), Sydney Local Health District, Sydney, NSW, Australia.
| |
Collapse
|
5
|
Sijercic I, Lane JEM, Gutner CA, Monson CM, Stirman SW. The Association Between Clinician and Perceived Organizational Factors with Early Fidelity to Cognitive Processing Therapy for Posttraumatic Stress Disorder in a Randomized Controlled Implementation Trial. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2021; 47:8-18. [PMID: 31463667 DOI: 10.1007/s10488-019-00966-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
A common metric for determining implementation success is the measurement of clinician adherence to, and competence in, delivering a psychotherapy. The present study examined clinician and organizational factors as predictors of early adherence and competence among 78 clinicians delivering cognitive processing therapy (CPT), an evidence-based psychotherapy (EBP) for posttraumatic stress disorder, in a randomized controlled implementation trial. Results indicated that clinicians' willingness to adopt an EBP if required to do so was significantly associated with early adherence and competence in CPT delivery. Level of clinician education was significantly associated with early competence in delivering CPT. Organizational factors did not predict early adherence or competence. Implications of the findings are discussed.
Collapse
Affiliation(s)
| | | | | | | | - Shannon Wiltsey Stirman
- National Center for PTSD, VA Palo Alto Healthcare System & Stanford University, 795 Willow Road, NC-PTSD 334, Menlo Park, CA, 94025, USA.
| |
Collapse
|
6
|
Ford JH, Kaur A, Rao D, Gilson A, Bolt DM, Garneau HC, Saldana L, McGovern MP. Improving Medication Access within Integrated Treatment for Individuals with Co-Occurring Disorders in Substance Use Treatment Agencies. IMPLEMENTATION RESEARCH AND PRACTICE 2021; 2:26334895211033659. [PMID: 34988462 PMCID: PMC8726008 DOI: 10.1177/26334895211033659] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND The best approach to provide comprehensive care for individuals with co-occurring disorders (CODs) related to substance use and mental health is to address both disorders through an integrated treatment approach. However, only 25% of behavioral health agencies offer integrated care and less than 7% of individuals who need integrated treatment receive it. A project used a cluster-randomized waitlist control group design to evaluate the effectiveness of Network for the Improvement of Addiction Treatment (NIATx) implementation strategies to improve access to addiction and psychotropic medications. METHODS This study represents a secondary analysis of data from the NIATx project. Forty-nine agencies were randomized to Cohort1 (active implementation group, receiving the NIATx strategy [n=25]) or Cohort2 (waitlist control group [n=24]). Data were collected at three time points (Baseline, Year1 and Year2). A two-level (patient within agency) multinomial logistic regression model investigated the effects of implementation strategy condition on one of four medication outcomes: both medication types, only psychotropic medication, only addiction medication, or neither medication type. A per-protocol analysis included time, NIATx fidelity, and agency focus as predictors. RESULTS The intent-to-treat analysis found a statistically significant change in access to addiction versus neither medication, but Cohort1 compared to Cohort2 at Year1 showed no differences. Changes were associated with the experimental intervention and occurred in the transition from Year 1 to Year 2, where greater increases were seen for agencies in Cohort2 versus Cohort1. The per-protocol analysis showed increased access to both medications and addiction medications from pre- to post-intervention for agencies in both cohorts; however, differences in change between high- and low-implementation agencies were not significant. CONCLUSIONS Access to integrated services for people with CODs is a long-standing problem. NIATx implementation strategies had limited effectiveness in improving medication access for individuals with CODs. Implementation strategy adherence is associated with increased medication access.
Collapse
Affiliation(s)
- James H Ford
- School of Pharmacy, Social and Administrative Sciences Division, University of
Wisconsin–Madison, USA
| | - Arveen Kaur
- School of Pharmacy, Social and Administrative Sciences Division, University of
Wisconsin–Madison, USA
| | - Deepika Rao
- School of Pharmacy, Social and Administrative Sciences Division, University of
Wisconsin–Madison, USA
| | - Aaron Gilson
- School of Pharmacy, Social and Administrative Sciences Division, University of
Wisconsin–Madison, USA
| | - Daniel M Bolt
- School of Education, Educational Psychology Division, University of
Wisconsin–Madison, USA
| | - Helene Chokron Garneau
- Center for Behavioral Health Services and Implementation Research,
Division of Public Health & Population Sciences, Department of Psychiatry and
Behavioral Sciences, Stanford University School of
Medicine, USA
| | | | - Mark P McGovern
- Center for Behavioral Health Services and Implementation Research,
Division of Public Health & Population Sciences, Department of Psychiatry and
Behavioral Sciences, Stanford University School of
Medicine, USA
- Division of Primary Care and Population Health, Department of
Medicine, Stanford University School of
Medicine, USA
| |
Collapse
|