The Effectiveness and Cost of Clinical Supervision for Motivational Interviewing: A Randomized Controlled Trial

Effects of Training in Cognitive Behavioural Therapy and Motivational Interviewing on Mental Health Practitioner Behaviour: A Systematic Review and Meta-Analysis

Effective training of mental health professionals is crucial for bridging the gap between research and practice when delivering cognitive behavioural therapy (CBT) and motivational interviewing (MI) within community settings. However, previous research has provided inconclusive evidence regarding the impact of training efforts. The current study aimed to systematically search, review and synthesize the literature on CBT and MI training to assess its effect on practitioner behavioural outcomes. Following prospective registration, a literature search was conducted for studies where mental health practitioners were exposed to training in face-to-face CBT or MI, reporting on at least one quantitative practitioner behavioural outcome. A total of 116 studies were eligible for the systematic review, and 20 studies were included in four meta-analyses. The systematic review highlights the need to establish psychometrically valid outcome measures for practitioner behaviour. Results of the meta-analyses suggest that training has a greater effect on practitioner behaviour change compared to receiving no training or reading a treatment manual. Training combined with consultation/supervision was found to be more effective than training alone, and no differences were found between face-to-face and online training. Results should be interpreted with caution due to methodological limitations in the primary studies, large heterogeneity, and small samples in the meta-analyses. Future directions are discussed.

Psychosocial interventions for stimulant use disorder

BACKGROUND

Stimulant use disorder is a continuously growing medical and social burden without approved medications available for its treatment. Psychosocial interventions could be a valid approach to help people reduce or cease stimulant consumption. This is an update of a Cochrane review first published in 2016.

OBJECTIVES

To assess the efficacy and safety of psychosocial interventions for stimulant use disorder in adults.

SEARCH METHODS

We searched the Cochrane Drugs and Alcohol Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, three other databases, and two trials registers in September 2023. All searches included non-English language literature. We handsearched the references of topic-related systematic reviews and the included studies.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) comparing any psychosocial intervention with no intervention, treatment as usual (TAU), or a different intervention in adults with stimulant use disorder.

DATA COLLECTION AND ANALYSIS

We used the standard methodological procedures expected by Cochrane.

MAIN RESULTS

We included a total of 64 RCTs (8241 participants). Seventy-three percent of studies included participants with cocaine or crack cocaine use disorder; 3.1% included participants with amphetamine use disorder; 10.9% included participants with methamphetamine use disorder; and 12.5% included participants with any stimulant use disorder. In 18 studies, all participants were in methadone maintenance treatment. In our primary comparison of any psychosocial treatment to no intervention, we included studies which compared a psychosocial intervention plus TAU to TAU alone. In this comparison, 12 studies evaluated cognitive behavioural therapy (CBT), 27 contingency management, three motivational interviewing, one study looked at psychodynamic therapy, and one study evaluated CBT plus contingency management. We also compared any psychosocial intervention to TAU. In this comparison, seven studies evaluated CBT, two contingency management, two motivational interviewing, and one evaluated a combination of CBT plus motivational interviewing. Seven studies compared contingency management reinforcement related to abstinence versus contingency management not related to abstinence. Finally, seven studies compared two different psychosocial approaches. We judged 65.6% of the studies to be at low risk of bias for random sequence generation and 19% at low risk for allocation concealment. Blinding of personnel and participants was not possible for the type of intervention, so we judged all the studies to be at high risk of performance bias for subjective outcomes but at low risk for objective outcomes. We judged 22% of the studies to be at low risk of detection bias for subjective outcomes. We judged most of the studies (69%) to be at low risk of attrition bias. When compared to no intervention, we found that psychosocial treatments: reduce the dropout rate (risk ratio (RR) 0.82, 95% confidence interval (CI) 0.74 to 0.91; 30 studies, 4078 participants; high-certainty evidence); make little to no difference to point abstinence at the end of treatment (RR 1.15, 95% CI 0.94 to 1.41; 12 studies, 1293 participants; high-certainty evidence); make little to no difference to point abstinence at the longest follow-up (RR 1.22, 95% CI 0.91 to 1.62; 9 studies, 1187 participants; high-certainty evidence); probably increase continuous abstinence at the end of treatment (RR 1.89, 95% CI 1.20 to 2.97; 12 studies, 1770 participants; moderate-certainty evidence); may make little to no difference in continuous abstinence at the longest follow-up (RR 1.14, 95% CI 0.89 to 1.46; 4 studies, 295 participants; low-certainty evidence); reduce the frequency of drug intake at the end of treatment (standardised mean difference (SMD) -0.35, 95% CI -0.50 to -0.19; 10 studies, 1215 participants; high-certainty evidence); and increase the longest period of abstinence (SMD 0.54, 95% CI 0.41 to 0.68; 17 studies, 2118 participants; high-certainty evidence). When compared to TAU, we found that psychosocial treatments reduce the dropout rate (RR 0.79, 95% CI 0.65 to 0.97; 9 studies, 735 participants; high-certainty evidence) and may make little to no difference in point abstinence at the end of treatment (RR 1.67, 95% CI 0.64 to 4.31; 1 study, 128 participants; low-certainty evidence). We are uncertain whether they make any difference in point abstinence at the longest follow-up (RR 1.31, 95% CI 0.86 to 1.99; 2 studies, 124 participants; very low-certainty evidence). Compared to TAU, psychosocial treatments may make little to no difference in continuous abstinence at the end of treatment (RR 1.18, 95% CI 0.92 to 1.53; 1 study, 128 participants; low-certainty evidence); probably make little to no difference in the frequency of drug intake at the end of treatment (SMD -1.17, 95% CI -2.81 to 0.47, 4 studies, 479 participants, moderate-certainty evidence); and may make little to no difference in the longest period of abstinence (SMD -0.16, 95% CI -0.54 to 0.21; 1 study, 110 participants; low-certainty evidence). None of the studies for this comparison assessed continuous abstinence at the longest follow-up. Only five studies reported harms related to psychosocial interventions; four of them stated that no adverse events occurred.

AUTHORS' CONCLUSIONS

This review's findings indicate that psychosocial treatments can help people with stimulant use disorder by reducing dropout rates. This conclusion is based on high-certainty evidence from comparisons of psychosocial interventions with both no treatment and TAU. This is an important finding because many people with stimulant use disorders leave treatment prematurely. Stimulant use disorders are chronic, lifelong, relapsing mental disorders, which require substantial therapeutic efforts to achieve abstinence. For those who are not yet able to achieve complete abstinence, retention in treatment may help to reduce the risks associated with stimulant use. In addition, psychosocial interventions reduce stimulant use compared to no treatment, but they may make little to no difference to stimulant use when compared to TAU. The most studied and promising psychosocial approach is contingency management. Relatively few studies explored the other approaches, so we cannot rule out the possibility that the results were imprecise due to small sample sizes.

Improving the quality of counseling and clinical supervision in opioid treatment programs: how can technology help?

BACKGROUND

The opioid epidemic has resulted in expanded substance use treatment services and strained the clinical workforce serving people with opioid use disorder. Focusing on evidence-based counseling practices like motivational interviewing may be of interest to counselors and their supervisors, but time-intensive adherence tasks like recording and feedback are aspirational in busy community-based opioid treatment programs. The need to improve and systematize clinical training and supervision might be addressed by the growing field of machine learning and natural language-based technology, which can promote counseling skill via self- and supervisor-monitoring of counseling session recordings.

METHODS

Counselors in an opioid treatment program were provided with an opportunity to use an artificial intelligence based, HIPAA compliant recording and supervision platform (Lyssn.io) to record counseling sessions. We then conducted four focus groups-two with counselors and two with supervisors-to understand the integration of technology with practice and supervision. Questions centered on the acceptability of the clinical supervision software and its potential in an OTP setting; we conducted a thematic coding of the responses.

RESULTS

The clinical supervision software was experienced by counselors and clinical supervisors as beneficial to counselor training, professional development, and clinical supervision. Focus group participants reported that the clinical supervision software could help counselors learn and improve motivational interviewing skills. Counselors said that using the technology highlights the value of counseling encounters (versus paperwork). Clinical supervisors noted that the clinical supervision software could help meet national clinical supervision guidelines and local requirements. Counselors and clinical supervisors alike talked about some of the potential challenges of requiring session recording.

CONCLUSIONS

Implementing evidence-based counseling practices can help the population served in OTPs; another benefit of focusing on clinical skills is to emphasize and hold up counselors' roles as worthy. Machine learning technology can have a positive impact on clinical practices among counselors and clinical supervisors in opioid treatment programs, settings whose clinical workforce continues to be challenged by the opioid epidemic. Using technology to focus on clinical skill building may enhance counselors' and clinical supervisors' overall experiences in their places of work.

Job Satisfaction of Nurses in the Context of Clinical Supervision: A Systematic Review

The purpose of this systematic review is to gather and analyze data from existing research on the effects of clinical supervision (CS) intervention on nurses' job satisfaction and related outcomes such as stress levels, burnout, and care quality. Using the PRISMA (preferred reporting items for systematic reviews and meta-analysis) criteria, a systematic review of the research available in the databases PubMed, PsycInfo, Cochrane Library, and CINAHL, well as Google Scholar, between January 2010 and May 2023 was carried out. Out of the 760 studies assessed, only 8 met the criteria for inclusion in the review based on Hawker's assessment tool. The results indicate that CS has a positive impact on nurses' job satisfaction and related outcomes such as reduced burnout, stress levels, and the quality of care. The study also found that the effectiveness of CS in enhancing job satisfaction was most evident during the 6-month follow-up period. However, nurses who did not receive CS did not show any noticeable improvement in their knowledge or practice. Additionally, nurses who required more efficient clinical oversight reported little to no positive impact on their practice or training. The review also highlighted gaps in knowledge regarding the frequency and number of sessions required for the impact of CS on nurses' job satisfaction and other outcomes. Due to the limited number of studies included in this review, further research is recommended to evaluate the influence of CS on nurses' job satisfaction.

A Prospective Biopsychosocial Repeated Measures Study of Stress and Dropout from Substance Addiction Treatment

Introduction

This prospective, repeated-measures observational study tested biopsychosocial variables as risk factors for dropping out of inpatient substance addiction treatment. Substance use disorder (SUD) is viewed as a chronic relapsing disease caused by an interaction between biological, psychological, and social factors. However, there is a lack of prospective studies that combine biopsychosocial variables when assessing dropout. The aims of this study were to investigate whether there was 1) An association between biopsychosocial factors and dropping out of inpatient substance addiction treatment, 2) An interaction with SUD diagnosis and cortisol, and 3) Different dropout rates between short-term and long-term institutions.

Materials and Methods

Patients (n = 173) were recruited from two inpatient treatment centers in Norway between 2018 and 2021. The following biopsychosocial variables were measured at four timepoints: ward atmosphere (Ward Atmosphere Scale, WAS), psychological distress (Hopkins Symptom Checklist 10, HSCL-10), motivation (M-scale of the Circumstances, Motivation, Readiness, and Suitability questionnaire), and concentration of salivary cortisol (CORT- nmol/L). Cortisol levels were measured for two consecutive days at each timepoint and calculated by two cortisol indices, daytime cortisol slope (DCS) and area under the curve with respect to the ground (AUC_G). A multivariate logistic regression analysis was performed to find an association between dropout rates and the biopsychosocial variables.

Results

The results suggest a lower dropout odds for patients with high motivation (OR = 0.76, p = 0.022) and patients admitted to short-term treatment (OR = 0.06, p = 0.005). An interaction with stimulant SUD and DCS (OR = 13.74, p = 0.024) also revealed higher dropout odds. No statistical significance was found for psychological distress, WAS, and cortisol AUC_G.

Conclusion

The results support monitoring motivation during treatment and further investigating biopsychosocial variables when assessing dropout risk together with SUD diagnosis.

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

PURPOSE

Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address.

METHODS

The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session.

RESULTS

Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care.

CONCLUSION

Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

Training Male Sexual Abuse Survivors as Peer Leaders to Deliver Motivational Interviewing and Trauma-Informed Affirmative Care

This paper provides a description and evaluation of training male sexual abuse survivors to deliver Motivational Interviewing (MI) and Motivational Interviewing with Trauma-Informed Affirmative Care (MI-AC) online to sexual and gender minority (SGM) men with sexual assault histories and depression. After a search and selection process, 26 men with lived experience of sexual abuse received MI training that included the use of role-playing, video demonstrations, and practice followed by weekly supervision while co-leading groups. Peer leaders completed several measures pre and post training, including beliefs about MI and self-reported learning of MI and satisfaction with the training. A sample of MI and MI-AC audio sessions were independently rated for adherence and competence. Peer leaders' beliefs about MI changed over time, while self-rated skill level stayed consistent. Peer leaders demonstrated good adherence to the MI and MI-AC conditions. Results suggest that men with lived experience of sexual trauma effectively learned to deliver MI and/or MI-AC to SGM male survivors in online groups. These interventions have the potential to expand the reach of limited services for this population as well as reduce their depression and assist in SGM men with histories of sexual abuse entering into formal mental health services.

Systematic review of training in cognitive-behavioral therapy: Summarizing effects, costs and techniques

With the steadily growing importance of psychotherapeutic care, there is also an increasing need for high-quality training. We analyze the literature published between 2009 and 2022 on the effectiveness of training in cognitive behavioral therapy. The review addresses current gaps in the literature by focusing on the description of specific training components and their associated costs, as well as examining therapist-level predictors of training effectiveness. Our findings confirm the effect of additional supervision on both therapist competence and patient outcomes. Instructor-led training and self-guided web-based training seem to moderately increase competence, especially when targeting specific and highly structured treatments or skills. The level of prior training and experience of a therapist appears to predict the strength of training-related gains in competence. Few studies analyzed the differential effect of certain elements of training (e.g., the amount of active learning strategies) and training costs were generally not reported. Future studies should replicate or expand the existing evidence on active ingredients and therapist-level predictors of training effectiveness. Costs should be systematically reported to enhance the comparability of different training strategies.

Efficacy of Cognitive Behavioral Therapy for Alcohol and Other Drug Use Disorders: Is a One-Size-Fits-All Approach Appropriate?

Purpose

We provide an overview of Cognitive Behavioral Therapy (CBT) efficacy for adult alcohol or other drug use disorders (AOD) and consider some key variations in application as well as contextual (ie, moderators) or mechanistic (ie, mediators) factors related to intervention outcomes.

Methods

This work is a narrative overview of the review literature on CBT for AOD.

Results

Robust evidence suggests the efficacy of classical/traditional CBT compared to minimal and usual care control conditions. CBT combined with another evidence-based treatment such as Motivational Interviewing, Contingency Management, or pharmacotherapy is also efficacious compared to minimal and usual care control conditions, but no form of CBT consistently demonstrates efficacy compared to other empirically-supported modalities. CBT and integrative forms of CBT have potential for flexible application such as use in a digital format. Data on mechanisms of action, however, are quite limited and this is despite preliminary evidence that shows that CBT effect sizes on mechanistic outcomes (ie, secondary measures of psychosocial adjustment) are moderate and typically larger than those for AOD use.

Conclusion

CBT for AOD is a well-established intervention with demonstrated efficacy, effect sizes are in the small-to-moderate range, and there is potential for tailoring given the modular format of the intervention. Future work should consider mechanisms of CBT efficacy and key conditions for dissemination and implementation with fidelity.

A Behavior-based Coding Tool for Assessing Supervisors' Adherence and Competence: Findings From a Motivational Interviewing Implementation Study

Supervision seems to be an essential part of therapist training, and thus also of implementing evidence-based practices. However, there is a shortage of valid and reliable instruments for objective assessment of supervision competence that include both global measures and frequency counts of behavior - two essential aspects of supervisory competence. This study tests the internal consistency and inter-rater reliability of an assessment tool that includes both these measures. Additionally, strategies and techniques used by ten supervisors in 35 Motivational interviewing supervision sessions are described. Codings were conducted after two separate coding training sessions. The internal consistency across the global measures was acceptable (α = 0.70; 0.71). After the second training, the inter-rater reliabilities for all frequency counts were in the moderate to good range, except for two that were in the poor range; inter-rater reliability for one of the four global measures was in the moderate range, and three were in the poor range. A prerequisite for identifying specific supervisor skills central to the development of therapist skills, teaching these skills to supervisors, and performing quality assurance of supervision, is to create instruments that can measure these behaviors. This study is a step in that direction.

Motivational Interviewing to Improve the Uptake of Colorectal Cancer Screening: A Systematic Review and Meta-Analysis

Introduction

Colorectal cancer screening when done early can significantly reduce mortality. However, screening compliance is still lower than expected even in countries with established screening programs. Motivational interviewing is an approach that has been explored to promote behavioral change including screening compliance. This review synthesizes the efficacy of motivational interviewing in promoting uptake of colorectal screening modalities and is the only review so far that examines motivational interviewing for colorectal cancer screening alone.

Methods

A systematic review and meta-analysis was conducted to examine the effects of motivational interviewing for colorectal cancer screening. PubMed, EMBASE, CENTRAL, PsycINFO, and CINAHL were searched to identify eligible studies from inception to June 2021 and selection criteria was defined. Risk of bias was assessed using the Cochrane Risk of Bias 2.0 tool. The DerSimonian and Laird random effects model was used in the statistical analysis for studies included in the meta-analysis.

Results

Fourteen studies from 14 randomized-controlled trials with a low to moderate risk of bias were analyzed. 8 studies in the systematic review showed that motivational interviewing is superior to a control group. Meta-analysis was conducted on 11 studies and showed that motivational interviewing is statistically significant in increasing colorectal cancer screening rates in both intention-to-treat and per-protocol analysis. Timing of data collection of colorectal cancer screening rates did not make a significant difference to the efficacy of motivational interviewing. Studies that offered and accepted a mixture of colorectal screening modalities such as colonoscopy and fecal immunochemical tests were significantly more likely to have favorable colorectal screening outcomes. Heterogeneity in intervention was noted between studies, specifically differences in the training of interventionists, intervention delivery and comparator components.

Conclusion

Motivational interviewing is a tailored intervention demonstrating mixed evidence in improving colorectal cancer screening attendance amongst individuals. More research is needed to rigorously compare the effect of motivational interviewing alone vs. in combination with other screening promotion strategies to enhance colorectal cancer screening compliance.

Self-Coding of Fidelity as a Potential Active Ingredient of Consultation to Improve Clinicians' Fidelity

A key goal for implementation science is the identification of evidence-based consultation protocols and the active ingredients within these protocols that drive clinician behavior change. The current study examined clinicians' self-coding of fidelity as a potential active ingredient of consultation for the Attachment and Biobehavioral Catch-up (ABC) intervention. It also examined two other potential predictors of clinician fidelity in response to consultation: dosage of consultation and working alliance. Twenty-nine clinicians (97% female, 62% White, M age = 34 years) participated in a year of weekly fidelity-focused ABC consultation sessions, for which clinicians self-coded fidelity and received consultant feedback on both their coding and their fidelity. Data from the ABC fidelity measure were available for 1067 sessions coded by consultants, and clinicians' self-coding accuracy was calculated from 1044 sessions coded by both clinicians and consultants. Alliance was measured with the Working Alliance Inventory-Trainee and Supervisor Versions. The study was observational, and fidelity and self-coding accuracy were modeled across time using hierarchical linear modeling. Clinicians' ABC fidelity, as well as their self-coding accuracy, increased over the course of consultation. Clinicians' self-coding accuracy predicted their initial fidelity and growth in fidelity. Working alliance was also linked to fidelity and self-coding accuracy. These results suggest that clinician self-coding should be further examined as an active ingredient of consultation. The study has important implications for the design of consultation procedures and fidelity assessments.

Paraprofessional Youth Mentoring: A Framework for Integrating Youth Mentoring with Helping Institutions and Professions

The demand for child mental health services, including those provided by psychologists, counselors, and social workers, exceeds the supply. This trend is expected to continue or worsen unless there are substantial structural changes in how mental health services are provided. We propose a framework for paraprofessional youth mentors, defined as a subgroup of professionally supervised, non-expert volunteer or paid mentors to whom aspects of professional helping tasks are delegated. Our proposal is aligned with historical and modern solutions to scaling mental health services, and this framework could simultaneously increase the number of youth receiving evidence-based mental health services and reduce the burden on existing systems of care. The framework defines three plausible tasks for paraprofessional mentors: (1) reducing barriers to mental health service, (2) increasing engagement in services, and (3) providing direct services. The safety and effectiveness of these task-shifting efforts will hinge on competency-based training and evaluation, supervision by professionals, and documentation of services rendered, all of which the field of youth mentoring currently lacks. We describe several requisite scientific, institutional, and regulatory advances that will be necessary to realize this variant of youth mentoring for a subgroup of youth who are presenting for assistance with mental health problems.

In Search of the Common Elements of Clinical Supervision: A Systematic Review

The importance of clinical supervision for supporting effective implementation of evidence-based treatments (EBTs) is widely accepted; however, very little is known about which supervision practice elements contribute to implementation effectiveness. This systematic review aimed to generate a taxonomy of empirically-supported supervision practice elements that have been used in treatment trials and shown to independently predict improved EBT implementation. Supervision practice elements were identified using a two-phase, empirically-validated distillation process. In Phase I, a systematic review identified supervision protocols that had evidence of effectiveness based on (a) inclusion in one or more EBT trials, and (b) independent association with improved EBT implementation in one or more secondary studies. In Phase II, a hybrid deductive-inductive coding process was applied to the supervision protocols to characterize the nature and frequency of supervision practice elements across EBTs. Twenty-one of the 876 identified articles assessed the associations of supervision protocols with implementation or clinical outcomes, representing 13 separate studies. Coding and distillation of the supervision protocols resulted in a taxonomy of 21 supervision practice elements. The most frequently used elements were: reviewing supervisees' practice (92%; n = 12), clinical suggestions (85%; n = 11), behavioral rehearsal (77%; n = 10), elicitation (77%; n = 10), and fidelity assessment (77%; n = 10). This review identified supervision practice elements that could be targets for future research testing which elements are necessary and sufficient to support effective EBT implementation. Discrepancies between supervision practice elements observed in trials as compared to routine practice highlights the importance of research addressing supervision-focused implementation strategies.

Clinical supervision approach predicts evidence-based trauma treatment delivery in children's mental health

OBJECTIVE

Observational studies of practices used in clinical supervision-as-usual can be leveraged to advance the limited research on workplace-based supervision as an evidence-based treatment (EBT) implementation strategy. This exploratory observational study examined the presence of supervision approaches (comprised of supervision techniques) and whether these predicted clinicians' EBT technique delivery.

METHODS

Participants included 28 supervisors, 70 clinician supervisees, and 60 youth clients and guardians from 17 public mental health organizations. Data included audio recorded supervision-as-usual sessions over 1 year, audio recorded Trauma-focused Cognitive Behavioral Therapy (TF-CBT) treatment sessions with youth for 6 months, and youth-reported post-traumatic stress severity scores. Audio recordings of 438 supervision sessions were coded for session duration and the presence of 13 supervision techniques and intensity of their coverage. Audio recordings of 465 treatment sessions were coded for presence and intensity of coverage of TF-CBT practice elements. Agglomerative hierarchical cluster analysis examined the presence of clusters of supervision technique use, termed supervision approaches. Generalized estimating equations estimated the relation between supervision approaches and delivery of TF-CBT elements.

RESULTS

Two supervision approaches were identified- Supportive-Directive and Supportive- that discriminated between use of five supervision techniques. Clinicians who received a higher proportion of supportive-directive supervision sessions had greater odds of delivering the trauma narrative with a client.

CONCLUSION

Findings suggest that patterns of supervision techniques can be identified and may shape EBT delivery. Supervision approaches show some evidence of being tailored to individual clinicians. Implications for the development of supervision implementation strategies and future directions are discussed.

Community Implementation of MI-Enhanced Behavior Therapy for Adolescent ADHD: Linking Fidelity to Effectiveness

Evidence-based behavior therapy for adolescent ADHD faces implementation challenges in real-world settings. The purpose of this trial was to investigate the relationship between implementation fidelity and outcomes among adolescents receiving services in the active treatment arm (N = 114; Motivational Interviewing [MI]-enhanced parent-teen behavior therapy) of a community-based randomized trial of adolescent ADHD treatment. Participants received therapy from community clinicians (N = 44) at four agencies in a large, ethnically diverse metropolitan setting. Therapists provided self-report of session-by-session adherence to content fidelity checklists and audio recordings of sample sessions that were coded for MI integrity. Parents provided report of ADHD symptoms and family impairment at baseline, posttreatment, and follow-up, while academic records were obtained directly from the local school district. Results indicated that content fidelity significantly waned across the 10 manualized sessions (d = -1.23); these trends were steepest when therapy was delivered outside the office-setting and parent attendance was low. Community therapist self-report of content fidelity predicted significantly greater improvements in academic impairment from baseline to follow-up. MI delivery quality was not associated with improved outcomes; contrary to hypotheses, lower MI relational scores predicted significantly greater improvements in family impairment over time. Findings indicate that community-based outcomes for evidence-based ADHD treatment are enhanced when treatment is implemented with fidelity. Future work should revise community-based implementation strategies for adolescent ADHD treatment to prevent declines in fidelity over time, thereby improving outcomes.

Advancing Motivational Interviewing Training with Artificial Intelligence: ReadMI

BACKGROUND

Motivational interviewing (MI) is an evidence-based, brief interventional approach that has been demonstrated to be highly effective in triggering change in high-risk lifestyle behaviors. MI tends to be underutilized in clinical settings, in part because of limited and ineffective training. To implement MI more widely, there is a critical need to improve the MI training process in a manner that can provide prompt and efficient feedback. Our team has developed and tested a training tool, Real-time Assessment of Dialogue in Motivational Interviewing (ReadMI), that uses natural language processing (NLP) to provide immediate MI metrics and thereby address the need for more effective MI training.

METHODS

Metrics produced by the ReadMI tool from transcripts of 48 interviews conducted by medical residents with a simulated patient were examined to identify relationships between physician-speaking time and other MI metrics, including the number of open- and closed-ended questions. In addition, interrater reliability statistics were conducted to determine the accuracy of the ReadMI's analysis of physician responses.

RESULTS

The more time the physician spent talking, the less likely the physician was engaging in MI-consistent interview behaviors (r = -0.403, p = 0.007), including open-ended questions, reflective statements, or use of a change ruler.

CONCLUSION

ReadMI produces specific metrics that a trainer can share with a student, resident, or clinician for immediate feedback. Given the time constraints on targeted skill development in health professions training, ReadMI decreases the need to rely on subjective feedback and/or more time-consuming video review to illustrate important teaching points.

Clinical Supervision of Mental Health Services: A Systematic Review of Supervision Characteristics and Practices Associated with Formative and Restorative Outcomes

In this review, the authors examined supervision characteristics and practices associated with formative (e.g., skill development) and restorative (e.g., well-being) provider outcomes. We used qualitative review to summarize supervision characteristics associated with desired outcomes. Then, we applied a distillation approach (Chorpita et al., 2005) to identify practices associated with formative and restorative outcomes. The most common practices for promoting formative outcomes were corrective feedback, discussing intervention, and role play. Findings indicate several supervision strategies have demonstrated empirical support for improving formative outcomes. However, more rigorous research is needed in community settings, particularly for understanding which strategies improve restorative outcomes.

Clinical Supervision in Community Mental Health: Characterizing Supervision as Usual and Exploring Predictors of Supervision Content and Process

Clinical supervision can be leveraged to support implementation of evidence-based practices in community mental health settings, though it has been understudied. This study focuses on 32 supervisors at 23 mental health organizations in Philadelphia. We describe characteristics of supervisors and organizations and explore predictors of supervision content and process. Results highlight a low focus on evidence-based content and low use of active supervision processes. They underscore the need for further attention to the community mental health context when designing supervision-targeted implementation strategies. Future work should assess whether supervision models specific to community mental health are needed.

A systematic review of evidence-based practice implementation in drug and alcohol settings: applying the consolidated framework for implementation research framework

Background

There is a paucity of translational research programmes to improve implementation of evidence-based care in drug and alcohol settings. This systematic review aimed to provide a synthesis and evaluation of the effectiveness of implementation programmes of treatment for patients with drug and alcohol problems using the Consolidated Framework for Implementation Research (CFIR).

Methods

A comprehensive systematic review was conducted using five online databases (from inception onwards). Eligible studies included clinical trials and observational studies evaluating strategies used to implement evidence-based psychosocial treatments for alcohol and substance use disorders. Extracted data were qualitatively synthesised for common themes according to the CFIR. Primary outcomes included the implementation, service system or clinical practice. Risk of bias of individual studies was appraised using appropriate tools. A protocol was registered with (PROSPERO) (CRD42019123812) and published previously (Louie et al. Systematic 9:2020).

Results

Of the 2965 references identified, twenty studies were included in this review. Implementation research has employed a wide range of strategies to train clinicians in a few key evidence-based approaches to treatment. Implementation strategies were informed by a range of theories, with only two studies using an implementation framework (Baer et al. J Substance Abuse Treatment 37:191-202, 2009) used Context-Tailored Training and Helseth et al. J Substance Abuse Treatment 95:26-34, 2018) used the CFIR). Thirty of the 36 subdomains of the CFIR were evaluated by included studies, but the majority were concerned with the Characteristics of Individuals domain (75%), with less than half measuring Intervention Characteristics (45%) and Inner Setting constructs (25%), and only one study measuring the Outer Setting and Process domains. The most common primary outcome was the effectiveness of implementation strategies on treatment fidelity. Although several studies found clinician characteristics influenced the implementation outcome (40%) and many obtained clinical outcomes (40%), only five studies measured service system outcomes and only four studies evaluated the implementation.

Conclusions

While research has begun to accumulate in domains such as Characteristics of Individuals and Intervention Characteristics (e.g. education, beliefs and attitudes and organisational openness to new techniques), this review has identified significant gaps in the remaining CFIR domains including organisational factors, external forces and factors related to the process of the implementation itself. Findings of the review highlight important areas for future research and the utility of applying comprehensive implementation frameworks.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01090-7.

Clinical supervision in frontline health care: A survey of social workers in Ontario, Canada

Researchers have documented diminishing staff supervision in health care settings, while noting the complexity and dynamic nature of health care systems. A secondary data analysis of a survey of the Ontario Association of Social Workers (N=666) explored the contemporary receipt of different types of supervision in frontline health care. Most social worker participants were involved in supervision, receiving administrative and supportive supervision. Only 52% engaged in clinical supervision, even though most spent over 50% of work time with clients with complex needs. Factors related to the receipt of clinical supervision included setting, experience, gender, and availability of clinical practice leaders.

Strategies that Promote Therapist Engagement in Active and Experiential Learning: Micro-Level Sequential Analysis

Therapists' active learning increases treatment fidelity, but research is needed on supervisory strategies to engage therapists in active learning. This study used sequential analysis to examine consultant behaviors associated with increased and decreased probability of eliciting therapists' active learning. The study included 162 consultation sessions from 27 community therapists implementing Attachment and Biobehavioral Catch-up. Consultants' client discussion, information provision, and modeling were associated with reduced likelihood of active learning. Consultants' questions, engagement in active learning strategies, use of video, and silence were associated with greater likelihood of therapist active learning. These findings inform supervisors' attempts to encourage active learning.

Standardized patients in psychotherapy training and clinical supervision: study protocol for a randomized controlled trial

Background

Psychotherapy is highly effective and widely acknowledged for treating various mental disorders. Nevertheless, in terms of methods for teaching effective psychotherapeutic approaches and competencies, there has been a lack of investigation. Training and supervision are the main strategies for teaching therapist competencies, and standardized role-plays with simulated patients (i.e., trained individuals playing someone with a mental disorder) seem useful for evaluating training approaches. In medical education, this procedure is now internationally established. However, so far, little use has been made of standardized role-playing to evaluate training and supervision in the area of clinical psychology and psychotherapy.

Methods

In this study, standardized role-plays are used to evaluate methods for training and supervision. Central cognitive behavioral approaches for treating depression are taught in the training. The first experiment compares an active training approach (i.e., model learning) with a passive one (i.e., reading manual-based instructions). The second experiment compares a direct supervision technique (i.e., supervision based on video analysis) with an indirect one (i.e., supervision based on verbal reporting). In each experiment, 68 bachelor’s and master’s students of psychology will be randomly assigned to the experimental and control groups. Each student takes part in three role-plays (baseline, post and 3-month follow-up), which are all videotaped. Two independent raters assess therapist competencies in each role-play on the basis of a standardized competence scale.

Discussion

The research project aims to contribute to the development of specific training and supervision methods in order to improve psychotherapy training and patient care.

Trial registration

ISRCTN Registry, ISRCTN19173895. Registered on 10 December 2019.

Economic Evaluation of Brief Cognitive Behavioral Therapy vs Treatment as Usual for Suicidal US Army Soldiers

Importance

Brief cognitive behavioral therapy (BCBT) is a clinically effective intervention for reducing risk of suicide attempts among suicidal US Army soldiers. However, because specialized treatments can be resource intensive, more information is needed on costs and benefits of BCBT compared with existing treatments.

Objective

To evaluate the cost-effectiveness of BCBT compared with treatment as usual for suicidal soldiers in the US Army.

Design, Setting, and Participants

A decision analytic model compared effects and costs of BCBT vs treatment as usual from a US Department of Defense (DoD) perspective. Model input data were drawn from epidemiologic data sets and a clinical trial among suicidal soldiers conducted from January 31, 2011, to April 3, 2014. Data were analyzed from July 3, 2018, to March 25, 2019.

Interventions

The strategies compared were treatment as usual alone vs treatment as usual plus 12 individual BCBT sessions. Treatment as usual could include a range of pharmacologic and psychological treatment options.

Main Outcomes and Measures

Costs in 2017 US dollars, suicide attempts averted (self-directed behavior with intent to die, but with nonfatal outcome), suicide deaths averted, and incremental cost-effectiveness ratios, assuming a 2-year time horizon for treatment differences but including lifetime costs.

Results

In the base-case analysis, BCBT was expected to avert approximately 23 to 25 more suicide attempts and 1 to 3 more suicide deaths per 100 patients treated than treatment as usual. Sensitivity analyses assuming a range of treatment effects showed BCBT to be cost saving in most scenarios. Using the federal discount rate, the DoD was estimated to save from $15 000 to $16 630 per patient with BCBT vs treatment as usual. In a worst-case scenario (ie, assuming the weakest plausible BCBT effect sizes), BCBT cost an additional $1910 to $2250 per patient compared with treatment as usual.

Conclusions and Relevance

Results suggest BCBT may be a cost-saving intervention for suicidal active-duty soldiers. The costs of ensuring treatment fidelity would also need to be considered when assessing the implications of disseminating BCBT across the entire DoD.

Assessing competence in health professionals' use of motivational interviewing: A systematic review of training and supervision tools

OBJECTIVE

To conduct a systematic review of instruments for assessing the competency of therapists in motivational interviewing (MI) for training purposes.

METHODS

A search of Medline, Emcare, CINAHL, Scopus, Proquest, and Web of Science databases yielded 20,313 articles, of which 105 were included in the review. Data were summarised in terms of the instruments' development, adherence to MI principles, administration characteristics, psychometric properties, advantages, and disadvantages.

RESULTS

Twelve instruments were identified. Tools tended to be better at covering simpler MI techniques. Differences in administration burden allow users to choose between briefer but cheaper and more detailed yet costly tools. Psychometric testing was often limited, and even if more extensive, the quality was often inconsistent. Although each tool tended to have relatively unique advantages (e.g. use of client ratings), they shared common disadvantages (e.g. lack of psychometric testing).

CONCLUSION

A number of tools can be used to assess MI competency, each with their own strengths but notable weaknesses that should be considered by potential users.

PRACTICE IMPLICATIONS

There is a need to further test existing tools before creating new ones, due to the repetition of the same limitations. Standardised guidelines should also be created to ensure each tool meets the same quality standards.

Empirical research in clinical supervision: a systematic review and suggestions for future studies

BACKGROUND

Although clinical supervision is considered to be a major component of the development and maintenance of psychotherapeutic competencies, and despite an increase in supervision research, the empirical evidence on the topic remains sparse.

METHODS

Because most previous reviews lack methodological rigor, we aimed to review the status and quality of the empirical literature on clinical supervision, and to provide suggestions for future research. MEDLINE, PsycInfo and the Web of Science Core Collection were searched and the review was conducted according to current guidelines. From the review results, we derived suggestions for future research on clinical supervision.

RESULTS

The systematic literature search identified 19 publications from 15 empirical studies. Taking into account the review results, the following suggestions for further research emerged: Supervision research would benefit from proper descriptions of how studies are conducted according to current guidelines, more methodologically rigorous empirical studies, the investigation of active supervision interventions, from taking diverse outcome domains into account, and from investigating supervision from a meta-theoretical perspective.

CONCLUSIONS

In all, the systematic review supported the notion that supervision research often lags behind psychotherapy research in general. Still, the results offer detailed starting points for further supervision research.

TRIAL REGISTRATION

PROSPERO; CRD42017072606 , registered on June 20, 2017.

Clinical Supervision of Mental Health Professionals Serving Youth: Format and Microskills

Clinical supervision is an element of quality assurance in routine mental health care settings serving children; however, there is limited scientific evaluation of its components. This study examines the format and microskills of routine supervision. Supervisors (n = 13) and supervisees (n = 20) reported on 100 supervision sessions, and trained coders completed observational coding on a subset of recorded sessions (n = 57). Results indicate that microskills shown to enhance supervisee competency in effectiveness trials and experiments were largely absent from routine supervision, highlighting potential missed opportunities to impart knowledge to therapists. Findings suggest areas for quality improvement within routine care settings.

A Descriptive Analysis of the Interactions During Clinical Supervision

This study intends to analyze some skills trained during supervision. In it we describe sets of interactions (based on the American Psychological Association [APA], 2006; competency domains) happened between the supervisor and the supervisee during the supervision process. Interactions from twelve supervisor-supervisee dyads during asynchronous and direct, and individual and group supervision sessions were video recorded for this purpose. The recordings helped to determine, classify, and define behavioral response classes in each dyad's interactions. Percentages of time spent in each behavior class were computed. A reliability of 95% CI [0.91, 0.95] among observers was obtained. The behavior classes in which more time was spent were assessment, intervention, and conceptualization skills. Behavior classes in which less time was spent were related to emotional and interpersonal processes. These findings are discussed by linking the evidence-based theory on supervision with the time spent in each behavior class.

Motivational interviewing training of substance use treatment professionals: A systematic review

Background: Through evaluations of training programs, systematic reviews, and meta-analyses, advances in identifying best practices for disseminating motivational interviewing (MI) have emerged. To advance this work further, inclusion of thorough descriptions of the following is needed in research publications: study (design, trainee characteristics, setting characteristics), training and coaching methods (if applicable), trainer qualifications, and evaluation of MI skills. Methods: The purpose of this study was to systematically evaluate the research on MI training of substance use treatment professionals for the inclusion of such descriptions. Twenty-five studies were reviewed using a scoring rubric developed by the authors. Results: Just over two thirds of the studies (68%) were randomized controlled trials of MI training. The majority of studies provided information about (a) trainee characteristics (professional background = 76%, education = 60%, experience = 56%); (b) setting characteristics (80%); (c) training methods (format = 96%, length = 92%); (d) coaching (76%); and (e) evaluation of MI skills (92%). Conclusion: Findings suggest advancements in MI training studies since previous reviews, especially in regards to the inclusion of feedback and coaching. However, this review also found that inconsistencies in methods and reporting of training characteristics, as well as limited follow-up assessment of trainees' skill, continue to limit knowledge of effective training methods.

Proposing a Mechanistic Model of Clinician Training and Consultation

To make evidence-based treatments deliverable, effective, and scalable in community settings, it is critical to develop a workforce that can deliver evidence-based treatments as designed with skill. However, the science and practice of clinician training and consultation lags behind other areas of implementation science. In this paper, we present the Longitudinal Education for Advancing Practice (LEAP) model designed to help span this gap. The LEAP model is a mechanistic model of clinician training and consultation that details how training inputs, training and consultation strategies, and mechanisms of learning influence training outcomes. We first describe the LEAP model and then discuss how key implications of the model can be used to develop effective training and consultation strategies.

Increasing engagement in advance care planning using a behaviour change model: study protocol for the STAMP randomised controlled trials

INTRODUCTION

Advance care planning (ACP) is a key component of high-quality end-of-life care but is underused. Interventions based on models of behaviour change may fill an important gap in available programmes to increase ACP engagement. Such interventions are designed for broad outreach and flexibility in delivery. The purpose of the Sharing and Talking about My Preferences study is to examine the efficacy of three behaviour change approaches to increasing ACP engagement through two related randomised controlled trials being conducted in different settings (Veterans Affairs (VA) medical centre and community).

METHODS AND ANALYSIS

Eligible participants are 55 years or older. Participants in the community are being recruited in person in primary care and specialty outpatient practices and senior living sites, and participants in the VA are recruited by telephone. In the community, randomisation is at the level of the practice or site, with all persons at a given practice/site receiving either computer-tailored feedback with a behaviour stage-matched brochure (computer-tailored intervention (CTI)) or usual care. At the VA, randomisation is at the level of the participant and is stratified by the number of ACP behaviours completed at baseline. Participants are randomised to one of four groups: CTI, motivational interviewing, motivational enhancement therapy or usual care. The primary outcome is completion of four key ACP behaviours: identification of a surrogate decision maker, communication about goals, completing advance directives and ensuring documents are in the medical record. Analysis will be conducted using mixed effects models, taking into account the clustered randomisation for the community study.

ETHICS AND RANDOMISATION

The studies have been approved by the appropriate Institutional Review Boards and are being overseen by a Safety Monitoring Committee. The results of these studies will be disseminated to academic audiences and leadership in in the community and VA sites.

TRIAL REGISTRATION NUMBERS

NCT03137459 and NCT03103828.

Increasing the Availability of Psychological Treatments: A Multinational Study of a Scalable Method for Training Therapists

BACKGROUND

One of the major barriers to the dissemination and implementation of psychological treatments is the scarcity of suitably trained therapists. A highly scalable form of Web-centered therapist training, undertaken without external support, has recently been shown to have promise in promoting therapist competence.

OBJECTIVE

The aim of this study was to conduct an evaluation of the acceptability and effectiveness of a scalable independent form of Web-centered training in a multinational sample of therapists and investigate the characteristics of those most likely to benefit.

METHODS

A cohort of eligible therapists was recruited internationally and offered access to Web-centered training in enhanced cognitive behavioral therapy, a multicomponent, evidence-based, psychological treatment for any form of eating disorder. No external support was provided during training. Therapist competence was assessed using a validated competence measure before training and after 20 weeks.

RESULTS

A total of 806 therapists from 33 different countries expressed interest in the study, and 765 (94.9%) completed a pretraining assessment. The median number of training modules completed was 15 out of a possible 18 (interquartile range, IQR: 4-18), and 87.9% (531/604) reported that they treated at least one patient during training as recommended. Median pretraining competence score was 7 (IQR: 5-10, range: 0-19; N=765), and following training, it was 12 (IQR: 9-15, range: 0-20; N=577). The expected change in competence scores from pretraining to posttraining was 3.5 (95% CI 3.1-3.8; P<.001). After training, 52% (300/574) of therapists with complete competence data met or exceeded the competence threshold, and 45% (95% CI 41-50) of those who had not met this threshold before training did so after training. Compliance with training predicted both an increase in competence scores and meeting or exceeding the competence threshold. Expected change in competence score increased for each extra training module completed (0.19, 95% CI 0.13-0.25), and those who treated a suitable patient during training had an expected change in competence score 1.2 (95% CI 0.4-2.1) points higher than those who did not. Similarly, there was an association between meeting the competence threshold after training and the number of modules completed (odds ratio, OR=1.11, 95% CI 1.07-1.15), and treating at least one patient during training was associated with competence after training (OR=2.2, 95% CI 1.2-4.1).

CONCLUSIONS

Independent Web-centered training can successfully train large numbers of therapists dispersed across a wide geographical area. This finding is of importance because the availability of a highly scalable method of training potentially increases the number of people who might receive effective psychological treatments.

Variability in motivational interviewing adherence across sessions, providers, sites, and research contexts

Providers' adherence in the delivery of behavioral interventions for substance use disorders is not fixed, but instead can vary across sessions, providers, and intervention sites. This variability can substantially impact the quality of intervention that clients receive. However, there has been limited work to systematically evaluate the extent to which substance use intervention adherence varies from session-to-session, provider-to-provider, and site-to-site. The present study quantifies the extent to which adherence to Motivational Interviewing (MI) for alcohol and drug use varies across sessions, providers, and intervention sites and compares the extent of this variability across three common MI research contexts that evaluate MI efficacy, MI effectiveness, and MI training. Independent raters coded intervention adherence to MI from 1275 sessions delivered by 216 providers at 15 intervention sites. Multilevel models indicated that 57%-94% of the variance in MI adherence was attributable to variability between sessions (i.e., within providers), while smaller proportions of variance were attributable to variability between providers (3%-26%) and between intervention sites (0.1%-28%). MI adherence was typically lowest and most variable within contexts evaluating MI training (i.e., where MI was not protocol-guided and delivered by community treatment providers) and, conversely, adherence was typically highest and least variable in contexts evaluating MI efficacy and effectiveness (i.e., where MI was highly protocolized and delivered by trained therapists). These results suggest that MI adherence in efficacy and effectiveness trials may be substantially different from that obtained in community treatment settings, where adherence is likely to be far more heterogeneous.

Cognitive behavioral interventions for alcohol and drug use disorders: Through the stage model and back again

Cognitive-behavioral therapy (CBT) approaches have among the highest level of empirical support for the treatment of drug and alcohol use disorders. As Psychology of Addictive Behaviors marks its 30th anniversary, we review the evolution of CBT for the addictions through the lens of the Stage Model of Behavioral Therapies Development. The large evidence base from Stage II randomized clinical trials indicates a modest effect size with evidence of relatively durable effects, but limited diffusion in clinical practice, as is the case for most empirically validated approaches for mental health and addictive disorders. Technology may provide a means for CBT interventions to circumvent the "implementation cliff" in Stages III-V by offering a flexible, low-cost, standardized means of disseminating CBT in a range of novel settings and populations. Moreover, returning to Stage I to reconnect clinical applications of CBT to recent developments in cognitive science and neuroscience holds great promise for accelerating understanding of mechanisms of action. It is critical that CBT not be considered as a static intervention, but rather 1 that constantly evolves and is refined through the stage model until the field achieves a maximally powerful intervention that addresses core features of the addictions. (PsycINFO Database Record

Does clinical supervision of healthcare professionals improve effectiveness of care and patient experience? A systematic review

BACKGROUND

To ensure quality of care delivery clinical supervision has been implemented in health services. While clinical supervision of health professionals has been shown to improve patient safety, its effect on other dimensions of quality of care is unknown. The purpose of this systematic review is to determine whether clinical supervision of health professionals improves effectiveness of care and patient experience.

METHODS

Databases MEDLINE, PsychINFO, CINAHL, EMBASE and AMED were searched from earliest date available. Additional studies were identified by searching of reference lists and citation tracking. Two reviewers independently applied inclusion and exclusion criteria. The quality of each study was rated using the Medical Education Research Study Quality Instrument. Data were extracted on effectiveness of care (process of care and patient health outcomes) and patient experience.

RESULTS

Seventeen studies across multiple health professions (medical (n = 4), nursing (n = 7), allied health (n = 2) and combination of nursing, medical and/or allied health (n = 4)) met the inclusion criteria. The clinical heterogeneity of the included studies precluded meta-analysis. Twelve of 14 studies investigating 38,483 episodes of care found that clinical supervision improved the process of care. This effect was most predominant in cardiopulmonary resuscitation and African health settings. Three of six studies investigating 1756 patients found that clinical supervision improved patient health outcomes, namely neurological recovery post cardiopulmonary resuscitation (n = 1) and psychological symptom severity (n = 2). None of three studies investigating 1856 patients found that clinical supervision had an effect on patient experience.

CONCLUSIONS

Clinical supervision of health professionals is associated with effectiveness of care. The review found significant improvement in the process of care that may improve compliance with processes that are associated with enhanced patient health outcomes. While few studies found a direct effect on patient health outcomes, when provided to mental health professionals clinical supervision may be associated with a reduction in psychological symptoms of patients diagnosed with a mental illness. There was no association found between clinical supervision and the patient experience.

REVIEW REGISTRATION

CRD42015029643 .

Testing the effectiveness of a motivational interviewing-based brief intervention for substance use as an adjunct to usual care in community-based AIDS service organizations: study protocol for a multisite randomized controlled trial

Background

In 2010, the first comprehensive National HIV/AIDS Strategy for the United States was released and included three goals: (1) reducing the number of people who become infected with HIV, (2) increasing access to care and improving health outcomes for people living with HIV, and (3) reducing HIV-related health disparities and health inequities. In 2013, as part of its effort to help address the National HIV/AIDS Strategy, the National Institute on Drug Abuse (NIDA) funded a type 2 effectiveness-implementation hybrid trial titled the Substance Abuse Treatment to HIV Care (SAT2HIV) Project. Aim 1 of the SAT2HIV Project tests the effectiveness of a motivational interviewing-based brief intervention (MIBI) for substance use as an adjunct to usual care within AIDS Service Organizations (ASOs) as part of its MIBI Experiment. Aim 2 of the SAT2HIV Project tests the effectiveness of implementation and sustainment facilitation (ISF) as an adjunct to the Addiction Technology Transfer Center (ATTC) model for training staff in motivational interviewing as part of its ISF Experiment. The current paper describes the study protocol for the ISF Experiment.

Methods

As part of a multisite randomized controlled trial, individuals with comorbid HIV/AIDS and problematic substance use are randomized to receive either the ASOs’ usual care (control condition) or usual care plus a MIBI for substance use (experimental condition) delivered by trained ASO case-management staff. Primary outcome measures are reductions in days of primary substance use, number of substance-related problems, times engaging in risky behaviors, days of non-adherence to HIV medications, and increases in substance use treatment. As part of this paper, we describe the trial protocol in accordance with the Standard Protocol Items: Recommendations for Interventional Trials guidelines.

Discussion

If successfully able to implement MIBI as an effective adjunct to usual care, the current trial may have a significant impact on increasing the capacity of ASOs to address problematic substance use among individuals living with HIV/AIDS. Reducing the prevalence of problematic substance use among individuals living with HIV/AIDS within the United States may lead to significant improvements on key performance measures (i.e., the HIV Care Continuum and the 90-90-90 target).

Trial registration ClinicalTrials.gov: NCT02495402

Electronic supplementary material

The online version of this article (10.1186/s13722-017-0095-8) contains supplementary material, which is available to authorized users.

Assessing Therapist Competence: Development of a Performance-Based Measure and Its Comparison With a Web-Based Measure

BACKGROUND

Recent research interest in how best to train therapists to deliver psychological treatments has highlighted the need for rigorous, but scalable, means of measuring therapist competence. There are at least two components involved in assessing therapist competence: the assessment of their knowledge of the treatment concerned, including how and when to use its strategies and procedures, and an evaluation of their ability to apply such knowledge skillfully in practice. While the assessment of therapists' knowledge has the potential to be completed efficiently on the Web, the assessment of skill has generally involved a labor-intensive process carried out by clinicians, and as such, may not be suitable for assessing training outcome in certain circumstances.

OBJECTIVES

The aims of this study were to develop and evaluate a role-play-based measure of skill suitable for assessing training outcome and to compare its performance with a highly scalable Web-based measure of applied knowledge.

METHODS

Using enhanced cognitive behavioral therapy (CBT-E) for eating disorders as an exemplar, clinical scenarios for role-play assessment were developed and piloted together with a rating scheme for assessing trainee therapists' performance. These scenarios were evaluated by examining the performance of 93 therapists from different professional backgrounds and at different levels of training in implementing CBT-E. These therapists also completed a previously developed Web-based measure of applied knowledge, and the ability of the Web-based measure to efficiently predict competence on the role-play measure was investigated.

RESULTS

The role-play measure assessed performance at implementing a range of CBT-E procedures. The majority of the therapists rated their performance as moderately or closely resembling their usual clinical performance. Trained raters were able to achieve good-to-excellent reliability for averaged competence, with intraclass correlation coefficients ranging from .653 to 909. The measure was also sensitive to change, with scores being significantly higher after training than before as might be expected (mean difference 0.758, P<.001) even when taking account of repeated data (mean difference 0.667, P<.001). The major shortcoming of the role-play measure was that it required considerable time and resources. This shortcoming is inherent in the method. Given this, of most interest for assessing training outcome, scores on the Web-based measure efficiently predicted therapist competence, as judged by the role-play measure (with the Web-based measure having a positive predictive value of 77% and specificity of 78%).

CONCLUSIONS

The results of this study suggest that while it was feasible and acceptable to assess performance using the newly developed role-play measure, the highly scalable Web-based measure could be used in certain circumstances as a substitute for the more labor-intensive, and hence, more costly role-play method.

Using the Internet to Train Therapists: Randomized Comparison of Two Scalable Methods

Background

One of the major barriers to the dissemination and implementation of psychological treatments is the scarcity of suitably trained therapists. The currently accepted method of training is not scalable. Recently, a scalable form of training, Web-centered training, has been shown to have promise.

Objective

The goal of our research was to conduct a randomized comparison of the relative effects of independent and supported Web-centered training on therapist competence and investigate the persistence of the effects.

Methods

Eligible therapists were recruited from across the United States and Canada. They were randomly assigned to 1 of 2 forms of training in enhanced cognitive behavior therapy (CBT-E), a multicomponent evidence-based psychological treatment for any form of eating disorder. Independent training was undertaken autonomously, while supported training was accompanied by support from a nonspecialist worker. Therapist competence was assessed using a validated competence measure before training, after 20 weeks of training, and 6 months after the completion of training.

Results

A total of 160 therapists expressed interest in the study, and 156 (97.5%) were randomized to the 2 forms of training (81 to supported training and 75 to independent training). Mixed effects analysis showed an increase in competence scores in both groups. There was no difference between the 2 forms of training, with mean difference for the supported versus independent group being –0.06 (95% Cl –1.29 to 1.16, P=.92). A total of 58 participants (58/114, 50.9%) scored above the competence threshold; three-quarters (43/58, 74%) had not met this threshold before training. There was no difference between the 2 groups in the odds of scoring over the competence threshold (odds ratio [OR] 1.02, 95% CI 0.52 to 1.99; P=.96). At follow-up, there was no significant difference between the 2 training groups (mean difference 0.19, 95% Cl –1.27 to 1.66, P=.80). Overall, change in competence score from end of training to follow-up was not significant (mean difference –0.70, 95% CI –1.52 to 0.11, P=.09). There was also no difference at follow-up between the training groups in the odds of scoring over the competence threshold (OR 0.95, 95% Cl 0.34 to 2.62; P=.92).

Conclusions

Web-centered training was equally effective whether undertaken independently or accompanied by support, and its effects were sustained. The independent form of Web-centered training is particularly attractive as it provides a means of training large numbers of geographically dispersed therapists at low cost, thereby overcoming several obstacles to the widespread dissemination of psychological treatments.

The effects of clinical supervision on supervisees and patients in cognitive behavioral therapy: a systematic review

Clinical supervision is a central part of psychotherapist training but the empirical support for specific supervision theories or features is unclear. The aims of this study were to systematically review the empirical research literature regarding the effects of clinical supervision on therapists' competences and clinical outcomes within Cognitive Behavior Therapy (CBT). A comprehensive database search resulted in 4103 identified publications. Of these, 133 were scrutinized and in the end 5 studies were included in the review for data synthesis. The five studies were heterogeneous in scope and quality and only one provided firm empirical support for the positive effects of clinical supervision on therapists' competence. The remaining four studies suffered from methodological weaknesses, but provided some preliminary support that clinical supervision may be beneficiary for novice therapists. No study could show benefits from supervision for patients. The research literature suggests that clinical supervision may have some potential effects on novice therapists' competence compared to no supervision but the effects on clinical outcomes are still unclear. While bug-in-the-eye live supervision may be more effective than standard delayed supervision, the effects of specific supervision models or features are also unclear. There is a continued need for high-quality empirical studies on the effects of clinical supervision in psychotherapy.

Supervision in Motivational Interviewing: An Exploratory Study

BACKGROUND

Although supervision is believed to be an important strategy for training practitioners in evidence-based practice, little is known about how it should be organized and conducted to promote implementation fidelity.

AIMS

To explore supervisor behaviours that might facilitate supervisees' proficiency in motivational interviewing.

METHOD

In this exploratory study, ten supervisors from a primary prevention intervention of childhood obesity responded to semi-structured interviews about their supervision behaviours. A mixed method approach was used; both qualitative and quantitative data were collected and analysed.

RESULTS

The supervisors reported using several sources of information for evaluating and providing systematic feedback on supervisees' performance. However, the majority did not use the available objective measures of proficiency as the primary source. Moreover, half of the supervisors argued that objective feedback might have a punishing effect on the supervisees.

CONCLUSIONS

Variation in the use of supervision components that previous research has proposed to be potentially influential to the process and outcome may lead to less efficient supervision. Findings suggest that appropriate supervision activities conducted in each supervision session require clear supervision principles that specify the content and procedure of the supervision, as well as regular adherence monitoring of the supervision sessions.