Lessons learned from measuring fidelity with the Motivational Interviewing Treatment Integrity code (MITI 4)

Assessing REflective simulation-based e-Training on motivational interviewing among multidisciplinary healthcare practitioners [RESeT-MI]: a mixed methods pilot study

BACKGROUND

Many health science curricula have integrated behavioral modification techniques in their plans. Motivational Interviewing is one such technique. Educational interventions to promote Motivational Interviewing have had limited success. Integrating simulation-based learning in health science curricula might offer a platform whereby students can train in well controlled environments with increased authenticity, provision of standardized experiences and the capacity for immediate feedback to participants. Using motivational interviewing as an exemplar, the purpose of this study was to assess the impact of a simulation-based reflective e-training program on knowledge, attitudes, and confidence in Motivational Interviewing among healthcare practitioners from diverse healthcare disciplines. A secondary aim was to explore whether self-reflection can promote reflective learning.

METHODS

This was a mixed-method study design. Fifteen participants from different health disciplines were included in the quantitative phase of the study, the simulated interview, and the reflective assignments while five participated in the focus group. Pre and post tests were used to examine the effect of training on knowledge, attitudes, and confidence in Motivational Interviewing. Assessment of Motivational Interviewing Treatment Integrity [MITI] scores in a simulation-based scenario was used. A qualitative content analysis of a focus group provided a more in-depth understanding of the participants experiences. Excerpts from reflective assignments were analyzed using Transformative Learning Theory concepts.

RESULTS

A Wilcoxon test showed that the training elicited a change in confidence in performing Motivational Interviewing [Z= -2.766, p = 0.006], median scores increased from 29 to 34. A quarter of technical scores and half of the relational scores indicated good competence. Participants reflected content transformation through feelings of empowerment and satisfaction when they were successful in engaging and motivating clients. Process transformation was evident in reflections on how to improve core skills specifically reflective listening. Reflections on Motivational Interviewing spirit related values showed premise transformation, which may indicate attitude changes.

CONCLUSION

A simulation-based e-training program on Motivational Interviewing represents an important educational modality for training in the health disciplines. Results of this study provide evidence supporting the integration of reflective simulation-based e-training into the education curricula of health disciplines in MI and beyond.

Randomized trial of the leadership and organizational change for implementation (LOCI) strategy in substance use treatment clinics

INTRODUCTION

Evidence-based practice (EBP) implementation represents a strategic change that requires alignment of leadership and support throughout organizations. Leadership and Organizational Change for Implementation (LOCI) is a multifaceted implementation strategy that aims to improve implementation leadership and climate within organizations through iterative cycles of leadership and climate assessment and feedback, leadership training and coaching, and strategic planning with upper-level leaders. This study tested the effects of LOCI on transformational and implementation leadership, implementation climate, implementation citizenship behavior, and EBP reach.

METHODS

A multiple cohort, cluster randomized trial tests the effect of LOCI in 60 clinics across nine behavioral health organizations in California and Arizona, USA. The study randomized clinics within organizations to either LOCI or a leadership training webinar control condition in three consecutive cohorts. Repeated web-based surveys of direct service providers (nLOCI = 201, nControl = 179) assessed leadership, implementation climate, and implementation citizenship over time. Multilevel autoregressive modeling was the primary statistical analysis such that providers (level-1) were nested within clinics (level-2). The study predicted between-condition differences at 4-, 8-, and 12-month follow-up assessments. Provider engagement in a fidelity monitoring process assessed reach of motivational interviewing (i.e., number of sessions recorded/submitted for fidelity coding). An independent sample t-test explored between condition differences in motivational interviewing reach.

RESULTS

Results indicated between condition differences at 4 months for implementation leadership, implementation climate, and implementation citizenship behavior such that greater improvements were evidenced in the LOCI condition compared to the control condition. Reach of MI was significantly greater in the LOCI vs control condition such that LOCI providers were significantly more likely to engage in the fidelity monitoring process (chi-square (1, n = 370) = 5.59, p = .018).

CONCLUSIONS

LOCI was developed based on organizational theories of strategic leadership and climate to affect organizational change processes that communicate that innovation implementation is expected, supported, and recognized as a value of the organization. The LOCI implementation strategy resulted in more positive hypothesized outcomes compared to the control condition. Organizational change strategies have utility for implementing health innovations in complex, multilevel contexts and for greater sustainment of facilitative leader behaviors, strategic implementation climate, and improved implementation outcomes.

TRIAL REGISTRATION

This study is registered with Clinicaltrials.gov gov (NCT03042832, 2 February 2017; retrospectively registered).

Preliminary evaluation of a novel group-based motivational interviewing intervention with adolescents: a feasibility study

Drinking is closely intertwined with social life among many adolescents, particularly in Europe. Group-based interventions, such as group-based motivational interviewing (group MI), have shown the capacity to prevent and reduce hazardous drinking and related problems among adolescents, but few examinations have been conducted in a European high school setting. This study examines the preliminary outcomes of a pilot group MI intervention among Danish adolescents. High school students (ages 15-18 years) were randomly allocated to two 1-h group MI sessions delivered in a school setting (N = 65) or an assessment only control condition (N = 67). Data were collected in August and November 2020 using online self-administrated questionnaires regarding the acceptability of the intervention and past month alcohol use. The pilot group MI intervention showed high feasibility and acceptability in this setting and with this age group. Group MI adolescents significantly reduced peak drinks per drinking day compared to assessment only adolescents (-2.7 drinks, p < 0.05). Results are discussed in relation to the metrics being evaluated during COVID-19 lockdown, including increased social restrictions at follow-up compared to baseline. Group MI shows promise for reducing hazardous alcohol use among Danish adolescents. In addition, the findings indicate the importance of building on and extending this work in future larger, better-powered randomized controlled trials.

Evaluating the impact of motivational interviewing on engagement and outcomes in a web-based self-help intervention for gambling disorder: A randomised controlled trial

Background

Self-paced internet interventions for gambling problems offer cost-effective, accessible, and private alternatives to traditional psychotherapy for a population that rarely seeks help. However, these interventions have been relatively slow to develop, evaluate, and deploy at scale relative to those for other addictive behaviors. Moreover, user engagement remains low despite the high interest. Motivational interviews have improved the effectiveness gambling bibliotherapy but have not been augmented with an analogous web-based self-guided program.

Objectives

This trial aimed to replicate and extend prior work by translating a paperback workbook to the internet and pairing it with a single motivational interview. It was hypothesized that the motivational interview would enhance program engagement and gambling outcomes.

Methods

A two-arm randomised controlled trial was conducted. Treatment-seeking Canadian adults recruited solely via social media received one year of access to a web-based self-guided program, either alone (N = 158) or in combination with a virtual motivational interview completed upon enrolment (N = 155). The program was based on principles of cognitive-behavioral therapy and motivational interviewing. Gambling severity, expenditures, frequency, and duration were assessed via online questionnaires at baseline and 3-, 6-, and 12-months post-baseline, along with secondary outcomes (i.e., depression, anxiety, nonspecific psychological distress, alcohol consumption).

Results

Baseline characteristics were indicative of severe gambling problems and concurrent mental health problems but not problematic alcohol consumption in this sample. Both treatment groups demonstrated roughly equal improvements across all gambling outcomes and most secondary outcomes over time, except alcohol consumption, which did not meaningfully change. Changes were most prominent by 3 months, followed by more gradual change by 6 and 12 months. Only 57 % of gamblers who were assigned to receive a motivational interview completed that interview. About 40 % of users did not complete any program modules and 11 % completed all four. No group differences in program engagement were observed, although the number of modules completed was associated with greater reductions in gambling behaviors in both groups.

Discussion

The problem of user engagement with web-based self-help programs remains. There is a dose-response relationship between engagement and outcomes when engagement is measured in terms of therapeutic content completed.

Conclusions

The addition of a motivational interview to a web-based self-help program for gambling problems was unsuccessful in improving engagement or outcomes. Future work should aim to make self-guided programs more engaging rather than solely making users more engaged.

Trial registration

Registered on 7 July 2020 (ISRCTN13009468).

Use of Motivational Interviewing in Older Patients with Multiple Chronic Conditions and Their Informal Caregivers: A Scoping Review

The use of motivational interviewing is relatively new in multiple chronic conditions (MCCs). A scoping review was conducted according to JBI methodology to identify, map and synthesize existing evidence on the use of motivational interviewing to support self-care behavior changes in older patients with MCCs and to support their informal caregivers in promoting patient self-care changes. Seven databases were searched, from database inception to July 2022, for studies that used motivational interviewing in interventions for older patients with MCCs and their informal caregivers. We identified 12 studies, reported in 15 articles, using qualitative, quantitative, or mixed-method designs, conducted between 2012 and 2022, describing the use of motivational interviewing for patients with MCCs. We could not locate any study regarding its application for informal caregivers. The scoping review showed that the use of motivational interviewing is still limited in MCCs. It was used mainly to improve patient medication adherence. The studies provided scant information about how the method was applied. Future studies should provide more information about the application of motivational interviewing and should address self-care behavior changes relevant to patients and healthcare providers. Informal caregivers should also be targeted in motivational interviewing interventions, as they are essential for the care of older patients with MCCs.

Designing Practical Motivational Interviewing Training for Mental Health Practitioners Implementing Behavioral Lifestyle Interventions: Protocol for 3 Pilot Intervention Studies

BACKGROUND

Motivational interviewing (MI) is an evidence-based, patient-centered communication method shown to be effective in helping persons with serious mental illness (SMI) to improve health behaviors. In clinical trials where study staff conducted lifestyle interventions incorporating an MI approach, cardiovascular disease (CVD) risk profiles of participants with SMI showed improvement. Given the disproportionate burden of CVD in this population, practitioners who provide somatic and mental health care to persons with SMI are ideally positioned to deliver patient-centered CVD risk reduction interventions. However, the time for MI training (traditionally 16-24 hours), follow-up feedback, and the coaching required to develop and maintain patient-centered skills are significant barriers to incorporating MI when scaling up these evidence-based practices.

OBJECTIVE

We describe the design and development of the following 2 scalable MI training approaches for community mental health practitioners: real-time brief workshops and follow-up asynchronous avatar training. These approaches are being used in 3 different pilot implementation research projects that address weight loss, smoking cessation, and CVD risk reduction in people with SMI who are a part of ALACRITY Center, a research-to-practice translation center funded by the National Institute of Mental Health.

METHODS

Clinicians and staff in community mental health clinics across Maryland were trained to deliver 3 distinct evidence-based physical health lifestyle interventions using an MI approach to persons with SMI. The real-time brief MI workshop training for ACHIEVE-D weight loss coaches was 4 hours; IMPACT smoking cessation counselors received 2-hour workshops and prescribers received 1-hour workshops; and RHYTHM CVD risk reduction program staff received 4 hours of MI. All workshop trainings occurred over videoconference. The asynchronous avatar training includes 1 common didactic instructional module for the 3 projects and 1 conversation simulation unique to each study's target behavior. Avatar training is accessible on a commercial website. We plan to assess practitioners' attitudes and beliefs about MI and evaluate the impact of the 2 MI training approaches on their MI skills 3, 6, and 12 months after training using the MI Treatment Integrity 4.2.1 coding tool and the data generated by the avatar-automated scoring system.

RESULTS

The ALACRITY Center was funded in August 2018. We have implemented the MI training for 126 practitioners who are currently delivering the 3 implementation projects. We expect the studies to be complete in May 2023.

CONCLUSIONS

This study will contribute to knowledge about the effect of brief real-time training augmented with avatar skills practice on clinician MI skills. If MI Treatment Integrity scoring shows it to be effective, brief videoconference trainings supplemented with avatar skills practice could be used to train busy community mental health practitioners to use an MI approach when implementing physical health interventions.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/44830.

Collective Motivational Interviewing for Individuals with Drug Use Problems: A Pre-Post-Follow-Up, Uncontrolled Pilot Study

Collective motivational interviewing (CMI) is a novelty motivational approach which optimises the motivational interviewing (MI) for individuals from collectivistic cultures. While MI has been empirically tested as an effective intervention for addictive disorders and has had a positive effect on facilitating lifestyle changes, CMI has retained the potency of MI as an individualistic intervention, and it further invites the social network resources to strengthen the level of motivation and cultivate a joint change partnership. This pilot study was the first clinical study of CMI to work with individuals with drug use problems (IDUPs) by involving concerned significant others (CSOs) in the three-session intervention, and the fidelity control was assessed by the Collective Motivational Interviewing Treatment Integrity (CMITI) scale. This pre-post−follow-up and uncontrolled feasibility study was conducted between 2017 and 2019, with dyads of 20 IDUPs and their CSOs. The potential impacts of CMI were examined by measures at baseline, post-intervention, and 1-month and 3-month post-intervention. All clinical sessions were audio-recorded, and four cases were randomly selected for fidelity review by two trained coders. The normality of data at the baseline was checked by a Shapiro−Wilk test. Non-parametric Wilcoxon-signed-rank test and repeated-measures ANOVA were employed for quantitative analysis. The results showed that six IDUPs had reduced drug use, and ten maintained drug abstinence with the support of CSOs, whereas four IDUPs remained unchanged or increased drug use. Overall, at the 3-month follow-up, drug use was reduced (p > 0.05), social support was strengthened (p < 0.05), and the IDUPs’ motivation for change was enhanced (p < 0.05). However, the small sample sizes, non-random sampling, and lack of control group may limit the generalizability and confirmation of the outcomes and of the “real effects”. This finding of the study suggests that the CMI is a feasible and acceptable therapeutic tool to motivate IDUPs with the support of CSOs to achieve mutually agreed-upon goals. Further development and evaluation with robust methodology are warranted.

Best shot: A motivational interviewing approach to address vaccine hesitancy in pediatric outpatient settings

BACKGROUND

Vaccine hesitancy in parents and childhood vaccine refusal is increasing. A standard of care to address this problem has not been identified.

PURPOSE

To identify if the use of motivational interviewing by pediatric providers during routine well child visits, when compared to standard of care, would increase vaccine rates in children 0-12 months of age. Factors associated with vaccine hesitancy were also investigated.

METHODS

A quasi-experimental study was completed on a convenience sample of pediatric providers (N = 6) and caregivers of children 0-12 months of age (N = 66). Four providers were trained to use motivational interviewing. During the well child visit the Parent Attitudes About Childhood Vaccines survey was completed, and the motivational interviewing intervention was implemented. Clinic's data were compared with other clinic data of non-trained providers.

FINDINGS

Vaccine refusal/delays rate was 11.4% among caregivers. Vaccine refusal rate decreased after the intervention (9.00% pre-intervention and 6.40% post-intervention). An ordinal regression identified caregivers with higher vaccine hesitancy scores and more children were more likely to delay or refuse vaccines, while caregivers ≥30 years or with high income were less likely to delay/refuse vaccines. A difference in difference analysis identified that an additional 2.6% of children received vaccines when seen by trained providers compared to non-trained (β = -0.330, OR = 0.719, p = 0.470).

DISCUSSION

Findings indicate a condensed motivational interviewing education session may be clinically significant in decreasing vaccine hesitancy among this population.

APPLICATIONS TO PRACTICE

A more robust study to confirm these findings is recommended prior to practice implementation.

A Rubric to Assess the Design and Intervention Quality of Randomized Controlled Trials in Health and Wellness Coaching

Objective

To collect health and wellness coaching (HWC) literature related to treatment of obesity and Type 2 Diabetes (T2D) for systematic assessment using a novel rubric.

Data Source

Pubmed, CINAHL, and PsychInfo

Study Inclusion and Exclusion

Given 282 articles retrieved, only randomized and controlled trials meeting a HWC criteria-based definition were included; studies with intervention <4 months or <4 sessions were excluded.

Data Extraction

Rubric assessment required details of two theoretical frameworks (i.e., study design and HWC intervention design) be extracted from each included paper.

Data Synthesis

Data were derived from a 28-item rubric querying items such as sampling characteristics, statistical methods, coach characteristics, HWC strategy, and intervention fidelity.

Results

29 articles were reviewed. Inter-rater rubric scoring yielded high intraclass correlation (r = .85). Rubric assessment of HWC literature resulted in moderate scores (56.7%), with study design scoring higher than intervention design; within intervention design, T2D studies scored higher than obesity.

Conclusions

A novel research design rubric is presented and successfully applied to assess HWC research related to treatment of obesity and T2D. Most studies reported beneficial clinical findings; however, rubric results revealed moderate scores for study and intervention design. Implications for future HWC research are discussed.

A Behavior-based Coding Tool for Assessing Supervisors' Adherence and Competence: Findings From a Motivational Interviewing Implementation Study

Supervision seems to be an essential part of therapist training, and thus also of implementing evidence-based practices. However, there is a shortage of valid and reliable instruments for objective assessment of supervision competence that include both global measures and frequency counts of behavior - two essential aspects of supervisory competence. This study tests the internal consistency and inter-rater reliability of an assessment tool that includes both these measures. Additionally, strategies and techniques used by ten supervisors in 35 Motivational interviewing supervision sessions are described. Codings were conducted after two separate coding training sessions. The internal consistency across the global measures was acceptable (α = 0.70; 0.71). After the second training, the inter-rater reliabilities for all frequency counts were in the moderate to good range, except for two that were in the poor range; inter-rater reliability for one of the four global measures was in the moderate range, and three were in the poor range. A prerequisite for identifying specific supervisor skills central to the development of therapist skills, teaching these skills to supervisors, and performing quality assurance of supervision, is to create instruments that can measure these behaviors. This study is a step in that direction.

Automated evaluation of psychotherapy skills using speech and language technologies

With the growing prevalence of psychological interventions, it is vital to have measures which rate the effectiveness of psychological care to assist in training, supervision, and quality assurance of services. Traditionally, quality assessment is addressed by human raters who evaluate recorded sessions along specific dimensions, often codified through constructs relevant to the approach and domain. This is, however, a cost-prohibitive and time-consuming method that leads to poor feasibility and limited use in real-world settings. To facilitate this process, we have developed an automated competency rating tool able to process the raw recorded audio of a session, analyzing who spoke when, what they said, and how the health professional used language to provide therapy. Focusing on a use case of a specific type of psychotherapy called "motivational interviewing", our system gives comprehensive feedback to the therapist, including information about the dynamics of the session (e.g., therapist's vs. client's talking time), low-level psychological language descriptors (e.g., type of questions asked), as well as other high-level behavioral constructs (e.g., the extent to which the therapist understands the clients' perspective). We describe our platform and its performance using a dataset of more than 5000 recordings drawn from its deployment in a real-world clinical setting used to assist training of new therapists. Widespread use of automated psychotherapy rating tools may augment experts' capabilities by providing an avenue for more effective training and skill improvement, eventually leading to more positive clinical outcomes.

Physiotherapy informed by Acceptance and Commitment Therapy for chronic low back pain: A mixed-methods treatment fidelity evaluation

OBJECTIVES

A randomized controlled trial of a new type of Physiotherapy informed by Acceptance and Commitment Therapy (PACT), found that it improved functioning in people with chronic low back pain compared to usual physiotherapy care. Fidelity evaluation is necessary to understand trial processes and outcomes. This study evaluated PACT treatment fidelity including delivery, receipt, and enactment.

DESIGN

A mixed-methods study nested within a randomized controlled trial was conducted.

METHODS

A total of 72 (20% of total) PACT treatment audio files were independently assessed by two raters, according to a novel framework developed to measure PACT treatment content adherence, therapeutic alliance, ACT competence, and treatment enactment. Interview transcripts from 19 trial participants randomized to PACT were analysed thematically for evidence of treatment receipt and enactment.

RESULTS

PACT physiotherapists delivered treatment as intended with high content adherence and satisfactory therapeutic alliance, but ACT competence was low. Qualitative findings indicated participant receipt of 11/17 and enactment of 3/17 components; 89% (n = 17) and 47% (n = 9) of participants reported treatment receipt and enactment of at least one component, respectively.

CONCLUSIONS

This mixed-methods study of PACT treatment demonstrated high fidelity reflecting treatment content delivery and receipt, and therapeutic alliance. There was some evidence of treatment enactment in participants with chronic low back pain. Low ACT competence could be addressed through additional support and adaptations to therapeutic processes for delivery by physiotherapists.

Augmenting an online self-directed intervention for gambling disorder with a single motivational interview: study protocol for a randomized controlled trial

BACKGROUND

Despite the success of gold standard cognitive-behavioral therapy for problem and disordered gambling, the majority of individuals with gambling problems do not seek or receive professional treatment. Thus, the development of less intrusive self-directed interventions has been encouraged. Bibliotherapy for problem gambling has shown promise, both alone and in combination with motivational interviews, but there is still a lack of online self-directed intervention research. The current randomized controlled trial proposes to assess the additive benefit of a single digital motivational interview delivered in conjunction with an online self-directed treatment program for problem gambling and gambling disorder.

METHODS

A two-arm randomized controlled trial will be conducted, wherein eligible participants (N=270) will be recruited across Canada via internet advertisements posted to several platforms. All participants will receive access to an online self-directed gambling intervention program. Participants will be randomly assigned to either complete the online program alone or receive a digital motivational interview, conducted through an online audioconferencing platform (i.e., Microsoft Teams) to supplement the online program. The primary outcomes of gambling severity, frequency, and expenditures will be tracked along with secondary outcomes (i.e., depression, anxiety, general distress, alcohol use, and online program user data) over a 24-month period. It is expected that participants in both groups will experience a reduction in symptoms across the board, but more substantial improvements will be observed in the group that receives a supplemental motivational interview.

DISCUSSION

The results of this trial will expand upon prior gambling intervention research by informing best practices for the provision of online self-help for problem gambling.

TRIAL REGISTRATION

ISRCTN ISRCTN13009468 . Registered on 7 July 2020.

A pilot trial of collaborative care with motivational interviewing to reduce opioid risk and improve chronic pain management

BACKGROUND AND AIMS

Opioid use and chronic pain are prevalent in the veteran population. Collaborative care enhances coordination between patients and their care teams, and motivational interviewing (MI) is a communication style designed to facilitate behavior change. This study evaluated the use of collaborative care with MI (CCMI) with patients with chronic pain and high-risk prescription opioid use.

DESIGN

Small pilot study of a randomized controlled trial.

SETTING

An urban Veterans Affairs (VA) Medical Center in the United States.

PARTICIPANTS

One hundred adult veterans with chronic pain currently enrolled into primary care and receiving long-term opioid therapy.

INTERVENTION AND COMPARATOR

During an initial 1-hour visit with a study primary-care physician (PCP), all veterans (n = 100) developed a personalized pain care plan, after which they were randomized to receive four sessions (at 4, 6, 8 and 12 weeks) of either CCMI (n = 51) or attention control psychoeducation (ACP; n = 49). Subsequently, participants had 30-minute follow-up visits with study PCPs and post-treatment assessment at 12 weeks.

MEASUREMENTS

Co-primary outcomes measures assessed opioid risk and pain interference; secondary measures assessed pain severity, PCP rating of opioid risk and pain management goals.

FINDINGS

At 12 weeks, intent-to-treat (ITT) analyses using multivariate mixed-effects linear regression were inconclusive regarding the between-group differences in primary and secondary outcomes at post-intervention (12 weeks). Bayes factors for opioid risk, pain interference, pain severity and PCP ratings were 1.96, 1.36, 0.45 and 0.82, respectively. Veterans in the CCMI group reported implementing more complementary integrative health (CIH) goals (e.g. yoga) than did those in the ACP group (d = 0.54).

CONCLUSIONS

US veterans with chronic pain who received collaborative care with motivational interviewing reduced their high-risk opioid use and showed improved pain interference and severity after an intake with a primary-care provider involving shared decision-making and the creation of a personalized pain care plan.

Differences in the delivery of motivational interviewing across three countries

We do not know if the delivery of Motivational Interviewing (MI) differs across countries. In an international study targeting Elderly people with Alcohol Use Disorder, The Elderly Study, MI was part of the treatment applied. Treatment delivery was measured by means of the Motivational Interviewing Treatment Integrity code version 4 (MITI 4). Mixed effects models explored potential differences in delivery of MI between the countries. Delivery of MI differed significantly between participating countries: Denmark, Germany and the US. These findings are important to consider when comparing measures of MI integrity across studies from different cultures.

Evaluation of adding the community reinforcement approach to motivational enhancement therapy for adults aged 60 years and older with DSM-5 alcohol use disorder: a randomized controlled trial

AIM

To examine whether adding the Community Reinforcement Approach for Seniors (CRA-S) to Motivational Enhancement Therapy (MET) increases the probability of treatment success in people aged ≥ 60 years with alcohol use disorder (AUD).

DESIGN

A single blind multi-centre multi-national randomized (1 : 1) controlled trial.

SETTING

Out-patient settings (municipal alcohol treatment clinics in Denmark, specialized addiction care facilities in Germany and a primary care clinic in the United States).

PARTICIPANTS

Between January 2014 and May 2016, 693 patients aged 60+ years and fulfilling DSM-5 criteria for AUD participated in comparing MET (n = 351) and MET + CRA-S (n = 342).

INTERVENTION AND COMPARATOR

MET (comparator) included four manualized sessions aimed at increasing motivation to change and establishing a change plan. CRA-S (intervention) consisted of up to eight further optional, manualized sessions aimed at helping patients to implement their change plan. CRA-S included a specially designed module on coping with age and age-related problems.

MEASUREMENTS

The primary outcome was either total alcohol abstinence or an expected blood alcohol concentration of ≤ 0.05% during the 30 days preceding the 26 weeks follow-up (defined as success) or blood alcohol concentration of > 0.05% during the follow-up period (defined as failure). This was assessed by self-report using the Form 90 instrument. The main analysis involved complete cases.

FINDINGS

The follow-up rate at 26 weeks was 76.2% (76.9% in the MET group and 76.0% in the MET + CRA-S group). The success rate in the MET group was 48.9% [95% confidence interval (CI) = 42.9-54.9%] versus 52.3% (95% CI = 46.2-58.3%) in the MET + CRA-S group. The odds of success in the two conditions did not differ (odds ratio = 1.22. 95% CI = 0.86-1.75, P = 0.26, Bayes factor = 0.10). Sensitivity analyses involving alternative approaches to missing values did not change the results.

CONCLUSIONS

In older adults with an alcohol use disorder diagnosis, adding the 'community reinforcement approach for seniors' intervention to brief out-patient motivational enhancement therapy treatment did not improve drinking outcome.

Can we agree on the quality of clinical supervision? Inter-rater reliability of the Short–SAGE (Supervision: Adherence and Guidance Evaluation) scale

Clinical supervision is a cornerstone in psychotherapist training, but research in this area is hampered by a lack of validated tools for assessing supervision quality. Short–SAGE (Supervision: Adherence and Guidance Evaluation) is an observational instrument designed for evaluating supervision in cognitive behavioural therapy. The aim of this study was to evaluate the inter-rater reliability of Short–SAGE. Four experienced clinical psychologists participated in three 3-hour Short–SAGE coding training sessions, followed by an additional meeting and coding instructions. In a cross-over design, codings of 20 supervision sessions were then assessed with intraclass correlations (ICC), for both the 3- and 7-point scales of the instrument. In the single measure analyses for both scales, only one item showed ICC in the good range, and the rest of the 14 item ICCs were in the poor to fair range. Moreover, on the 3-point scale, five of the 14 inter-rater correlations were non-significant. For research and training purposes, validated tools to assess supervision quality are highly needed. However, instruments for measuring adherence and/or competence are of little value if the coders do not attain inter-rater reliability. Whether quality of supervision is associated with improvements in supervisees’ competencies is not yet clear. Short–SAGE provides a tool that may enable empirical research in this area. Further studies are needed to assess whether extensive training can improve the inter-rater reliability of Short–SAGE.

Key learning aims

(1)

Is fidelity to motivational interviewing associated with alcohol outcomes in treatment-seeking 60+ year-old citizens?

BACKGROUND

Part of the variability in treatment outcomes for Motivational Interviewing (MI) may be explained by differences in the fidelity to MI. The Motivational Interviewing Treatment Integrity manual version 4 (MITI 4) is an improved measure of fidelity to elements of MI. It is not known whether the fidelity to MI, as measured by the MITI 4, is related to treatment outcome.

OBJECTIVES

To examine whether fidelity to MI is associated with alcohol use outcomes - predictive validity of the MITI 4.

METHOD

Twenty percent of the recorded sessions at the Danish sites of the Elderly Study were randomly drawn and coded for fidelity to MI with the MITI 4. The Elderly Study was an international, randomized controlled trial, in which people 60 years or older with Alcohol Use Disorders received either four weeks of Motivational Enhancement Therapy (MET) or four weeks of MET combined with up to eight additional sessions of the Community Reinforcement Approach- Senior (MET+CRA-S). Elements of MI and summary scores of the MITI 4 were used as predictors in a mixed effects regression analysis. Treatment outcomes were use of alcohol and consequences of drinking at 26-weeks follow-up.

RESULTS

In total, 423 sessions representing 238 participants were randomly drawn and coded for fidelity to MI. Mean values of the treatment elements indicated high fidelity to MI, with higher fidelity to MI in the MET sessions, as compared to CRA-S sessions. None of the predictors in the multilevel model analyses were associated with outcome at follow-up. Exploratory analysis indicated reverse associations between one measure of MI-fidelity and drinking outcomes in the combined treatment (CRAS).

CONCLUSION

The fidelity of the MI intervention, received by participants in this study, did not predict better treatment outcomes. MI may be less effective in populations which are already committed to change behavior. As expected and validating for the MITI 4, fidelity to MI-elements was lower in the combination of MI with other treatment approaches. Additionally, the timing of MI in these combined settings might be important for effectiveness.