Motivational interviewing quality assurance: A systematic review of assessment tools across research contexts

Automated Behavioral Coding to Enhance the Effectiveness of Motivational Interviewing in a Chat-Based Suicide Prevention Helpline: Secondary Analysis of a Clinical Trial

BACKGROUND

With the rise of computer science and artificial intelligence, analyzing large data sets promises enormous potential in gaining insights for developing and improving evidence-based health interventions. One such intervention is the counseling strategy motivational interviewing (MI), which has been found effective in improving a wide range of health-related behaviors. Despite the simplicity of its principles, MI can be a challenging skill to learn and requires expertise to apply effectively.

OBJECTIVE

This study aims to investigate the performance of artificial intelligence models in classifying MI behavior and explore the feasibility of using these models in online helplines for mental health as an automated support tool for counselors in clinical practice.

METHODS

We used a coded data set of 253 MI counseling chat sessions from the 113 Suicide Prevention helpline. With 23,982 messages coded with the MI Sequential Code for Observing Process Exchanges codebook, we trained and evaluated 4 machine learning models and 1 deep learning model to classify client- and counselor MI behavior based on language use.

RESULTS

The deep learning model BERTje outperformed all machine learning models, accurately predicting counselor behavior (accuracy=0.72, area under the curve [AUC]=0.95, Cohen κ=0.69). It differentiated MI congruent and incongruent counselor behavior (AUC=0.92, κ=0.65) and evocative and nonevocative language (AUC=0.92, κ=0.66). For client behavior, the model achieved an accuracy of 0.70 (AUC=0.89, κ=0.55). The model's interpretable predictions discerned client change talk and sustain talk, counselor affirmations, and reflection types, facilitating valuable counselor feedback.

CONCLUSIONS

The results of this study demonstrate that artificial intelligence techniques can accurately classify MI behavior, indicating their potential as a valuable tool for enhancing MI proficiency in online helplines for mental health. Provided that the data set size is sufficiently large with enough training samples for each behavioral code, these methods can be trained and applied to other domains and languages, offering a scalable and cost-effective way to evaluate MI adherence, accelerate behavioral coding, and provide therapists with personalized, quick, and objective feedback.

Monitoring Motivational Interviewing Strategies: Creating Provider and Client Reports to Encourage Implementation

BACKGROUND

Motivational interviewing (MI) is an evidence-based practice that has been successfully applied to at-risk youth. Well-validated measures that track MI integrity may not be used in practice settings due to the time to complete them, recording requirements and training involved. A simpler, less resource-intensive instrument may encourage programs and providers to attend more to the quality of MI use during implementation.

PURPOSE

To validate a method involving two measures, Youth and Provider Logs, to assist in monitoring MI use.

METHODS

Clients and providers reported on provider behaviors consistent and inconsistent with MI during the session. Factor analyses were conducted to examine whether measures showed clear scales assessing MI use and analyses were conducted to assess validity of these measures.

RESULTS

Both Youth and Provider Logs showed a clear and consistent 3-factor structure assessing MI-consistent behavior, MI-inconsistent behavior, and alcohol-related topics. Significant correlations were found between Youth Logs and youth reports of rapport with providers, and satisfaction with services. Provider MI-inconsistent scores were significantly inversely predictive of observer fidelity scores over time.

CONCLUSION

This study offers provider and client measures for tracking use of MI in sessions, which are a simpler, less resource-intensive method for monitoring MI, and may encourage fidelity during implementation.

Development and validation of the adolescent behavioural change Counselling Assessment Tool in Indonesia

BACKGROUND

Primary care provides an important context to engage adolescents and their families in healthy lifestyles with the goal of reducing future behaviour-related health problems. Developing a valid tool to assess health professionals' skills in behavioural change counselling is integral to improving the quality of clinical care provided to adolescents in Indonesia.

METHODS

This work was nested within a project to develop a training program to enhance the behaviour-change counselling of adolescents and their parents by Indonesian primary care professionals. Initial item development was based on the content of the training module and the domain structure of the Behavioral Change Counselling Index (BECCI), a commonly used tool to assess counselling quality in healthcare settings. Expert panels were used to test content validity, while face validity was assessed by a group of trained psychologists. Inter-rater agreement was calculated prior to tests of construct validity and reliability, which involved psychologists rating 125 audio-taped counselling sessions between the health professional and adolescent patients, together with a parent.

RESULTS

An initial 13-item tool was developed using a 1-5 Likert scale. Validity and reliability testing resulted in the decision to use a 14-item tool with a 0-3 Likert scale. The scale was found to have a Cronbach's α coefficient of 0.839 (internal consistency), and there was strong inter-rater agreement (0.931).

CONCLUSION

The assessment tool known as the Adolescent Behavioural Change Counselling Assessment Tool, is a valid and reliable instrument to measure Indonesian health professionals' behavioural-change counselling skills with adolescent patients. The tool provides an evaluation framework for future interventions that aim to improve health professionals' skills in addressing adolescent behaviour-related health problems.

Motivational interviewing for substance use reduction

BACKGROUND

Substance use is a global issue, with around 30 to 35 million individuals estimated to have a substance-use disorder. Motivational interviewing (MI) is a client-centred method that aims to strengthen a person's motivation and commitment to a specific goal by exploring their reasons for change and resolving ambivalence, in an atmosphere of acceptance and compassion. This review updates the 2011 version by Smedslund and colleagues.

OBJECTIVES

To assess the effectiveness of motivational interviewing for substance use on the extent of substance use, readiness to change, and retention in treatment.

SEARCH METHODS

We searched 18 electronic databases, six websites, four mailing lists, and the reference lists of included studies and reviews. The last search dates were in February 2021 and November 2022.

SELECTION CRITERIA

We included randomised controlled trials with individuals using drugs, alcohol, or both. Interventions were MI or motivational enhancement therapy (MET), delivered individually and face to face. Eligible control interventions were no intervention, treatment as usual, assessment and feedback, or other active intervention.

DATA COLLECTION AND ANALYSIS

We used standard methodological procedures expected by Cochrane, and assessed the certainty of evidence with GRADE. We conducted meta-analyses for the three outcomes (extent of substance use, readiness to change, retention in treatment) at four time points (post-intervention, short-, medium-, and long-term follow-up).

MAIN RESULTS

We included 93 studies with 22,776 participants. MI was delivered in one to nine sessions. Session durations varied, from as little as 10 minutes to as long as 148 minutes per session, across included studies. Study settings included inpatient and outpatient clinics, universities, army recruitment centres, veterans' health centres, and prisons. We judged 69 studies to be at high risk of bias in at least one domain and 24 studies to be at low or unclear risk. Comparing MI to no intervention revealed a small to moderate effect of MI in substance use post-intervention (standardised mean difference (SMD) 0.48, 95% confidence interval (CI) 0.07 to 0.89; I2 = 75%; 6 studies, 471 participants; low-certainty evidence). The effect was weaker at short-term follow-up (SMD 0.20, 95% CI 0.12 to 0.28; 19 studies, 3351 participants; very low-certainty evidence). This comparison revealed a difference in favour of MI at medium-term follow-up (SMD 0.12, 95% CI 0.05 to 0.20; 16 studies, 3137 participants; low-certainty evidence) and no difference at long-term follow-up (SMD 0.12, 95% CI -0.00 to 0.25; 9 studies, 1525 participants; very low-certainty evidence). There was no difference in readiness to change (SMD 0.05, 95% CI -0.11 to 0.22; 5 studies, 1495 participants; very low-certainty evidence). Retention in treatment was slightly higher with MI (SMD 0.26, 95% CI -0.00 to 0.52; 2 studies, 427 participants; very low-certainty evidence). Comparing MI to treatment as usual revealed a very small negative effect in substance use post-intervention (SMD -0.14, 95% CI -0.27 to -0.02; 5 studies, 976 participants; very low-certainty evidence). There was no difference at short-term follow-up (SMD 0.07, 95% CI -0.03 to 0.17; 14 studies, 3066 participants), a very small benefit of MI at medium-term follow-up (SMD 0.12, 95% CI 0.02 to 0.22; 9 studies, 1624 participants), and no difference at long-term follow-up (SMD 0.06, 95% CI -0.05 to 0.17; 8 studies, 1449 participants), all with low-certainty evidence. There was no difference in readiness to change (SMD 0.06, 95% CI -0.27 to 0.39; 2 studies, 150 participants) and retention in treatment (SMD -0.09, 95% CI -0.34 to 0.16; 5 studies, 1295 participants), both with very low-certainty evidence. Comparing MI to assessment and feedback revealed no difference in substance use at short-term follow-up (SMD 0.09, 95% CI -0.05 to 0.23; 7 studies, 854 participants; low-certainty evidence). A small benefit for MI was shown at medium-term (SMD 0.24, 95% CI 0.08 to 0.40; 6 studies, 688 participants) and long-term follow-up (SMD 0.24, 95% CI 0.07 to 0.41; 3 studies, 448 participants), both with moderate-certainty evidence. None of the studies in this comparison measured substance use at the post-intervention time point, readiness to change, and retention in treatment. Comparing MI to another active intervention revealed no difference in substance use at any follow-up time point, all with low-certainty evidence: post-intervention (SMD 0.07, 95% CI -0.15 to 0.29; 3 studies, 338 participants); short-term (SMD 0.05, 95% CI -0.03 to 0.13; 18 studies, 2795 participants); medium-term (SMD 0.08, 95% CI -0.01 to 0.17; 15 studies, 2352 participants); and long-term follow-up (SMD 0.03, 95% CI -0.07 to 0.13; 10 studies, 1908 participants). There was no difference in readiness to change (SMD 0.15, 95% CI -0.00 to 0.30; 5 studies, 988 participants; low-certainty evidence) and retention in treatment (SMD -0.04, 95% CI -0.23 to 0.14; 12 studies, 1945 participants; moderate-certainty evidence). We downgraded the certainty of evidence due to inconsistency, study limitations, publication bias, and imprecision.

AUTHORS' CONCLUSIONS

Motivational interviewing may reduce substance use compared with no intervention up to a short follow-up period. MI probably reduces substance use slightly compared with assessment and feedback over medium- and long-term periods. MI may make little to no difference to substance use compared to treatment as usual and another active intervention. It is unclear if MI has an effect on readiness to change and retention in treatment. The studies included in this review were heterogeneous in many respects, including the characteristics of participants, substance(s) used, and interventions. Given the widespread use of MI and the many studies examining MI, it is very important that counsellors adhere to and report quality conditions so that only studies in which the intervention implemented was actually MI are included in evidence syntheses and systematic reviews. Overall, we have moderate to no confidence in the evidence, which forces us to be careful about our conclusions. Consequently, future studies are likely to change the findings and conclusions of this review.

Measuring a motivational interviewing practice orientation in criminal justice practitioners: initial validation of the response style screening questionnaire

Introduction

The use of collaborative communication techniques by criminal justice practitioners has been identified as a component of core correctional practices (CCPs). Criminal justice agencies and programs are investing in motivational interviewing (MI) training for their staff with varying intensity, follow-up coaching, and expectations for integration into practice. The present article describes the development and initial validation of the Response Style Screening Questionnaire (RSSQ), a practitioner completed tool assessing an MI-consistent practice orientation. Over three studies, we examined the factor structure, reliability, and correlations between the scale and self-reported and behavioral validity indicators.

Method

Study 1 examined the factor structure of the RSSQ with a sample of 825 criminal justice practitioners. In Study 2, data from 350 probation officers completing the RSSQ alongside measures of work-orientation and attitudes was used to conduct a confirmatory factor analysis and an initial assessment of its construct validity. In Study 3, correlations between the RSSQ and audio recorded office visits of 33 probation officers coded for MI and relationship building skills examined the scale's criterion validity.

Results

In Study 1, an exploratory factor analysis with an oblique rotation yielded 18 items on four factors. In Study 2, four and five factor models were tested, with the 4-factor model of Study 1 yielding the best fit. Two of the 4 factor-derived subscales reflect styles inconsistent with MI: (1) Confrontational style, and (2) Sustain Talk style; while the remaining two reflect styles consistent with MI: (3) Eliciting style, and (4) Change Talk style. Confrontational style scores were correlated with a work-orientation reflecting probation as a law enforcement endeavor, while Eliciting and Change Talk scores were correlated with a behavior change and resource broker work-orientations. In Study 3, Confrontational and Sustain Talk style scores were negatively correlated with a variety of MI skills and CCPs displayed on audio recordings, while Change Talk style scores were positively correlated with use of such skills.

Discussion

Overall, the findings suggest the RSSQ is a potentially useful new practitioner self-report tool for assessing an MI practice orientation.

Adapted motivational interviewing for brief healthcare consultations: A systematic review and meta-analysis of treatment fidelity in real-world evaluations of behaviour change counselling

BACKGROUND

Behaviour change counselling (BCC) is an adaptation of motivational interviewing (MI) designed to maximize the effectiveness of time-limited health behaviour change consultations. To improve intervention quality and understanding of treatment effects, it is recommended that evaluations of health behaviour change interventions incorporate existing fidelity frameworks (e.g. The National Institutes of Health [NIH] Behaviour Change Consortium) and ensure that treatment fidelity is assessed and reported.

PURPOSE

This systematic review was designed to examine (a) adherence to NIH fidelity recommendations, (b) provider fidelity to BCC and (c) impact of these variables on the real-world effectiveness of BCC for adult health behaviours and outcomes.

METHODS AND RESULTS

Searches of 10 electronic databases yielded 110 eligible publications describing 58 unique studies examining BCC delivered within real-world healthcare settings by existing providers. Mean study adherence to NIH fidelity recommendations was 63.31% (Range 26.83%-96.23%). Pooled effect size (Hedges g) for short-term and long-term outcomes was .19 (95% CI [.11, .27]) and .09 (95% CI [.04, .13]), respectively. In separate, random-effects meta-regressions, neither short-term nor long-term effect sizes were significantly modified by adherence to NIH fidelity recommendations. For the subgroup of short-term alcohol studies (n = 10), a significant inverse relationship was detected (Coefficient = -.0114, 95% CI [-.0187, -.0041], p = .0021). Inadequate and inconsistent reporting within the included studies precluded planned meta-regression between provider fidelity and BCC effect size.

CONCLUSIONS

Further evidence is needed to clarify whether adherence to fidelity recommendations modifies intervention effects. Efforts to promote transparent consideration, evaluation and reporting of fidelity are urgently needed. Research and clinical implications are discussed.

Motivational interviewing-an evidence-based, collaborative, goal-oriented communication approach in lifestyle medicine: A comprehensive review of the literature

The global threat of noncommunicable diseases (NCDs) is alarmingly increasing. The health and economic burden of improper lifestyle choices is immense. Reducing modifiable risk factors has been demonstrated to significantly prevent chronic diseases. At this crucial time, lifestyle medicine (LM) has been recognized as an evidence-based medical domain applicable to NCDs. Among the tools used in LM, motivational interviewing (MI) is a patient-centered, collaborative counseling approach. In this evidence-based review article, we discuss recent literature on the application of MI in the six LM pillars defined by the British Society of LM (BSLM): healthy eating, mental wellbeing, healthy relationships, physical activity, minimizing harmful substances, and sleep. MI helps strengthen patients' motivation to ameliorate behaviorally influenced health problems, improve treatment adherence, and optimize medical interventions. Technically correct, theoretically congruent, and psychometrically sound MI interventions yield satisfactory outcomes and help improve patient quality of life. Lifestyle change is often a gradual process involving multiple efforts and setbacks. MI is based on the idea that change is a process rather than an event. Extensive literature evidence supports the benefits of MI treatment, and interest in research on MI application is increasing across all BSLM pillars. MI helps people alter their thoughts and feelings about making changes by recognizing obstacles to change. Even interventions of short duration have been reported to yield better outcomes. Healthcare professionals must understand the relevance and importance of MI in clinical practice.

Measuring the active elements of cognitive-behavioral therapies

Understanding how and for whom cognitive-behavioral therapies work is central to the development and improvement of mental health interventions. Suboptimal quantification of the active elements of cognitive-behavioral therapies has hampered progress in elucidating mechanisms of change. To advance process research on cognitive-behavioral therapies, we describe a theoretical measurement framework that focuses on the delivery, receipt, and application of the active elements of these interventions. We then provide recommendations for measuring the active elements of cognitive-behavioral therapies aligned with this framework. Finally, to support measurement harmonization and improve study comparability, we propose the development of a publicly available repository of assessment tools: the Active Elements of Cognitive-Behavioral Therapies Measurement Kit.

Training medical students in motivational interviewing using a blended learning approach: a proof-of-concept study

Background

Difficulties in implementing behavior change in patients with chronic diseases are common in clinical practice. Motivational interviewing (MI) helps clinicians to support patients in overcoming ambivalence while maintaining self-determination. The inclusion of MI in German medical training curricula is still rare. Furthermore, the effects of systematic teaching of MI, especially via blended learning, have hardly been investigated.

Methods

Medical students participated in three curricular events related to MI, consisting of instructional videos and theoretical and practical components in a blended learning format. The aim of the study was to investigate the effect of teaching MI in students' medical education. A controlled, non-randomized study was conducted with an intervention group and a control group. Both groups completed questionnaires on their experience and knowledge related to MI, completed a knowledge test and rated their satisfaction with the course. MI was taught in the 6th semester of medical coursework as part of a psychosomatic course, in the 8th semester during a psychiatry course and in the 9th semester during a weekly psychiatry clerkship.

Results

Data from the intervention group (n = 35) and control group (n = 14) were analyzed, with 65.7% of students participating in all three parts of the curriculum. Overall interest in learning MI was high, with M = 2.92 (SD = 1.00). The results indicate a greater increase in knowledge over time in the intervention group. The majority (62.86%) stated that the curriculum was relevant to their future career. Free-form text responses indicated a high level of satisfaction with practical relevance.

Conclusion

This study demonstrates the usefulness of an MI curriculum for medical students. The integration of MI into medical curricula is a promising curricular addition to improve doctor-patient communication. Future research should address patient perceptions of MI competencies and the persistence of acquired competencies.

Efficient and effective measurement of provider competence in community-based substance use treatment settings: Performance of the Motivational Interviewing Coach Rating Scale (MI-CRS)

OBJECTIVE

Efficient and effective fidelity measurement is necessary to improve rigor and reduce burden of motivational interviewing (MI) implementation studies for both fidelity outcomes and quality improvement strategies. This article reports on such a measure developed with rigorous methodology and tested in community-based substance abuse treatment settings.

METHODS

This scale development study analyzed data from a National Institute on Drug Abuse study testing the Leadership and Organizational Change for Implementation (LOCI) strategy. Utilizing item response theory (IRT) methods and Rasch modeling, we analyzed coded recordings (N = 1089) of intervention sessions of 238 providers from 60 substance use treatment clinics across nine agencies in an implementation trial focusing on MI.

RESULTS

These methods yielded a reliable and valid 12-item scale representing single construct dimensionality, strong item-session maps, good rating scale functionality, and item fit. Separation reliability and absolute agreement for adjacent categories was high. No items were significantly misfitting, though one was borderline. The LOCI community providers were less likely to be scored in the advanced competence range and items were more difficult compared to the original development sample.

CONCLUSIONS

The 12-item Motivational Interviewing Coach Rating Scale (MI-CRS) showed excellent performance in a large sample of community-based substance use treatment providers using real recordings. The MI-CRS is the first efficient and effective fidelity measure appropriate for diverse ethnic groups, with interventions that are MI only or interventions that integrate MI with other treatments, and with adolescents and adults. Follow-up coaching by trained supervisors may be needed for community-based providers to achieve the highest level of MI competence.

Analysis of Patient Cues in Asynchronous Health Interactions: Pilot Study Combining Empathy Appraisal and Systemic Functional Linguistics

BACKGROUND

Lifestyle-related diseases are among the leading causes of death and disability. Their rapid increase worldwide has called for low-cost, scalable solutions to promote health behavior changes. Digital health coaching has proved to be effective in delivering affordable, scalable programs to support lifestyle change. This approach increasingly relies on asynchronous text-based interventions to motivate and support behavior change. Although we know that empathy is a core element for a successful coach-user relationship and positive patient outcomes, we lack research on how this is realized in text-based interactions. Systemic functional linguistics (SFL) is a linguistic theory that may support the identification of empathy opportunities (EOs) in text-based interactions, as well as the reasoning behind patients' linguistic choices in their formulation.

OBJECTIVE

This study aims to determine whether empathy and SFL approaches correspond and complement each other satisfactorily to study text-based communication in a health coaching context. We sought to explore whether combining empathic assessment with SFL categories can provide a means to understand client-coach interactions in asynchronous text-based coaching interactions.

METHODS

We retrieved 148 text messages sent by 29 women who participated in a randomized trial of telecoaching for the prevention of gestational diabetes mellitus (GDM) and postnatal weight loss. We conducted a pilot study to identify users' explicit and implicit EOs and further investigated these statements using the SFL approach, focusing on the analysis of transitivity and thematic analysis.

RESULTS

We identified 164 EOs present in 42.37% (3478/8209) of the word count in the corpus. These were mainly negative (n=90, 54.88%) and implicit (n=55, 60.00%). We distinguished opening, content and closing messages structures. Most of the wording was found in the content (n=7077, 86.21%) with a declarative structure (n=7084, 86.30%). Processes represented 22.4% (n=1839) of the corpus, with half being material (n=876, 10.67%) and mostly related to food and diet (n=196, 54.92%), physical activity (n=96, 26.89%), and lifestyle goals (n=40, 11.20%).

CONCLUSIONS

Our findings show that empathy and SFL approaches are compatible. The results from our transitivity analysis reveal novel insights into the meanings of the users' EOs, such as their seek for help or praise, often missed by health care professionals (HCPs), and on the coach-user relationship. The absence of explicit EOs and direct questions could be attributed to low trust on or information about the coach's abilities. In the future, we will conduct further research to explore additional linguistic features and code coach messages.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ANZCTR) ACTRN12620001240932; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=380020.

Increasing Access to Care for the Underserved: Voices of Riders, Drivers, & Staff of a Rural Transportation Program

The qualitative data presented in this paper was part of a larger concurrent mixed methods study evaluating the effectiveness of a transportation program (Project TRIP) for low-income residents in rural eastern North Carolina. Twenty stakeholders involved in TRIP were interviewed, including riders (n = 12) of which 83% were over 50 years old, program staff including the program coordinator and 5 case managers (n = 6), and transportation providers (n = 2). Due to the COVID-19 pandemic, interviews were completed by phone with each participant. Themes from the qualitative data included the: (1) Emotional, health, & financial impacts of TRIP, (2) Changes that should be implemented into TRIP when replicating the program, and (3) Unique aspects of how TRIP operates that could inform other rural transportation programs. Thematic analysis was used to analyze the transcript data. The findings are couched in the context of how TRIP potentially defrays the impacts of cumulative disadvantage that residents experience over the life course by increasing access to healthcare.

The Status of SBIRT Training in Health Professions Education: A Cross-Discipline Review and Evaluation of SBIRT Curricula and Educational Research

PURPOSE

To assess the quality of curricular research on the Screening Brief Intervention and Referral to Treatment (SBIRT) approach and determine the presence of useful training modalities, particularly motivational interviewing (MI) training, across health care training curricula.

METHOD

The authors conducted a systematic review of published, peer-reviewed studies in PubMed, ERIC, CINAHL, Ovid HealthSTAR, and PsycINFO databases through March 2021 for English-language studies describing SBIRT, a curriculum for health care trainees, and curricular intervention outcomes. After the records were independently assessed, data were extracted and 20% of the studies were double-coded for interrater reliability.

RESULTS

Of 1,856 studies, 95 were included in the review; 22 had overlapping samples and were consolidated into 10 nested studies, leaving 83 total. Interrater reliability ranged from moderate (κ = .74, P < .001) to strong (κ = .91, P < .001) agreement. SBIRT training was delivered to trainees across many professions, including nursing (n = 34, 41%), medical residency (n = 28, 34%), and social work (n = 24, 29%). Nearly every study described SBIRT training methods (n = 80, 96%), and most reported training in MI (n = 54, 65%). On average, studies reported 4.06 (SD = 1.64) different SBIRT training methods and 3.31 (SD = 1.59) MI training methods. Their mean design score was 1.92 (SD = 0.84) and mean measurement score was 1.89 (SD = 1.05). A minority of studies measured SBIRT/MI skill (n = 23, 28%), and 4 studies (5%) set a priori benchmarks for their curricula.

CONCLUSIONS

SBIRT training has been delivered to a wide range of health care trainees and often includes MI. Rigor scores for the studies were generally low due to limited research designs and infrequent use of objective skill measurement. Future work should include predefined training benchmarks and validated skills measurement.

Can Outcomes of a Chat-Based Suicide Prevention Helpline Be Improved by Training Counselors in Motivational Interviewing? A Non-randomized Controlled Trial

Objective

To examine whether the outcomes of a chat-based suicide-prevention helpline could be improved by training counselors in motivational interviewing (MI).

Methods

In a pre- and post-test design, visitors of a chat-based suicide prevention helpline received either the Five-Phase Model (treatment as usual [TAU]) or MI. They completed a pre- and post-chat questionnaire on several suicide-related risk factors. Linear mixed modeling was used to estimate the effect of the condition. Furthermore, the treatment proficiency of newly trained counselors was assessed using MI-Scope.

Results

A total of 756 visitors and 55 counselors were included in this study. The visitors showed an improvement in suicidal ideation and psychological risk factors after a chat conversation. However, there were no significant differences between the MI and TAU conditions (β = 0.03, 95% CI [−0.23–0.30], p = 0.80). The treatment integrity indices showed that the counselors mostly used MI-consistent techniques but were unable to strategically employ these techniques to evoke enough change talk.

Conclusions

MI and TAU led to comparable outcomes in a chat-based suicide prevention helpline. The effectiveness of MI might improve by intensifying or improving the training of counselors, keeping the process of engaging more concise or offering visitors multiple sessions of MI.

Efficacy of Motivational Interviewing to Improve Utilization of Mental Health Services Among Youths With Chronic Medical Conditions: A Cluster Randomized Clinical Trial

IMPORTANCE

Despite the high prevalence of anxiety and depression in youths with chronic medical conditions (CMCs), physicians encounter substantial barriers in motivating these patients to access mental health care services.

OBJECTIVE

To determine the efficacy of motivational interviewing (MI) training for pediatricians in increasing youths' use of mental health care.

DESIGN, SETTING, AND PARTICIPANTS

The COACH-MI (Chronic Conditions in Adolescents: Implementation and Evaluation of Patient-Centered Collaborative Healthcare-Motivational Interviewing) study was a single-center cluster randomized clinical trial at the University Children's Hospital specialized outpatient clinics in Düsseldorf, Germany. Treating pediatricians were cluster randomized to a 2-day MI workshop or treatment as usual (TAU). Patient recruitment and MI conversations occurred between April 2018 and May 2020 with 6-month follow-up and 1-year rescreening. Participants were youths aged 12 to 20 years with CMCs and comorbid symptoms of anxiety and depression; they were advised by their MI-trained or untrained physicians to access psychological counseling services. Statistical analysis was performed from October 2020 to April 2021.

INTERVENTIONS

MI physicians were trained through a 2-day, certified MI training course; they recommended use of mental health care services during routine clinical appointments.

MAIN OUTCOMES AND MEASURES

The primary outcome of uptake of mental health care services within the 6-month follow-up was analyzed using a logistic mixed model, adjusted for the data's cluster structure. Uptake of mental health services was defined as making at least 1 appointment by the 6-month follow-up.

RESULTS

Among 164 youths with CMCs and conspicuous anxiety or depression screening, 97 (59%) were female, 94 (57%) had MI, and 70 (43%) had TAU; the mean (SD) age was 15.2 (1.9) years. Compared with patients receiving TAU, the difference in mental health care use at 6 months among patients whose physicians had undergone MI training was not statistically significant (odds ratio [OR], 1.96; 95% CI, 0.98-3.92; P = .06). The effect was moderated by the subjective burden of disease (F2,158 = 3.42; P = .04). Counseling with an MI-trained physician also led to lower anxiety symptom scores at 1-year rescreening (F1,130 = 4.11; P = .045). MI training was associated with longer conversations between patients and physicians (30.3 [16.7] minutes vs 16.8 [12.5] minutes; P < .001), and conversation length significantly influenced uptake rates across conditions (OR, 1.03; 95% CI, 1.01-1.06; P = .005).

CONCLUSIONS AND RELEVANCE

In this study, use of MI in specialized pediatric consultations did not increase the use of mental health care services among youths with CMCs but did lead to longer patient-physician conversations and lower anxiety scores at 1 year. Additional research is required to determine whether varying scope and duration of MI training for physicians could encourage youths with CMCs to seek counseling and thus improve integrated care models.

TRIAL REGISTRATION

German Trials Registry: DRKS00014043.