A qualitative evaluation of Veterans Health Administration's implementation of measurement-based care in behavioral health

Measuring Patient Well-Being During Whole-Person Clinical Care: Lessons From the Veterans Health Administration Well-Beings Signs Implementation Pilot

BACKGROUND

Measuring patient well-being during clinical care may enhance patient-centered communication and treatment planning. The Veterans Health Administration (VHA) piloted the use of the Well-Being Signs (WBS), a self-report measure of psychosocial well-being, in clinical care.

OBJECTIVE

To understand early WBS implementation and health care team member experiences with its use before developing detailed support materials and finalizing the measure.

METHODS

We conducted a mixed-methods evaluation of the WBS implementation pilot at 4 VHA facilities, including surveys of (n=4) Whole Health (WH) leaders/clinical leads, and semi-structured interviews with (n=11) clinical leads and team members. Survey data were characterized using descriptive statistics; interview data were analyzed using rapid qualitative analysis.

RESULTS

Facilities supported WBS implementation by disseminating information to clinical team members, primarily during staff meetings (3/4 facilities), individual discussions (3/4), and email (3/4); only half provided training sessions. In interviews, some care team members expressed the need for more training on using the WBS in clinical care. Some interviewees also provided suggestions for changes to the draft measure, including response option format and question look-back period.

CONCLUSIONS

Although there have been growing calls for attention to patient well-being in clinical care, our results suggest barriers to the implementation of well-being measures in this context. Findings were used to inform the development of enhanced training materials and make modifications to enhance the acceptability of the WBS to providers. Other identified barriers will need to be addressed in future implementation efforts, including bolstering leadership support and easing the added time and burden of administration.

Veterans' Experiences of and Preferences for Patient-Centered, Measurement-Based PTSD Care

BACKGROUND

Up to 50% of veterans drop out of trauma-focused evidence-based psychotherapies (TF-EBP) without completing treatment or recovering; evidence suggests this is in part because their posttraumatic stress disorder (PTSD) care is insufficiently patient-centered. There is also evidence that measurement-based care (MBC) for mental health should be personalized to the patient, yet this is not common practice in VA PTSD care.

OBJECTIVES

To explore veterans' experiences and preferences for aligning measurement-based PTSD care with their own treatment goals.

METHOD

Qualitative interviews were conducted with veterans (n=15) with PTSD who had received at least 2 sessions of a TF-EBP.

MEASURES

Survey on the administration of outcomes questionnaires and demographics and an interview about their most recent TF-EBP episode.

RESULTS

Half of veterans had symptom-focused goals and half did not; all had at least one treatment goal that was not symptom-focused. They typically met their goals about functioning and coping skills but not their symptom reduction goals. We found veterans overall were receptive to MBC but preferred patient-reported outcomes measures about functioning, wellbeing, coping skills, and understanding their trauma more than the commonly used PTSD symptom scale (the PCL-5).

CONCLUSIONS

Many veterans in this sample disliked the PCL-5 because it reinforced their maladaptive cognitions. Such veterans might be more receptive to MBC if offered patient-report outcomes measures that better align with their functional and wellbeing goals. For many goal/outcome areas, psychometrically sound measures exist and require better implementation in PTSD care. For some areas, scale development is needed.

Psychotherapists' Experience with In-Session Use of Routine Outcome Monitoring: A Qualitative Meta-analysis

Routine outcome monitoring (ROM) has become an increasingly utilized tool in therapeutic practice that has the potential to improve therapy outcomes. This study aimed to synthesize the findings of existing qualitative studies investigating how clinicians use ROM in their work with clients. A systematic search of qualitative studies on clinicians' experience with the use of ROM in mental health services was conducted via PsycInfo, PsycArticles, Medline, Web of Science, and Scopus databases. Qualitative meta-analysis was used to synthesize the finding of the primary studies. Forty-seven studies met the inclusion criteria. The analysis resulted in 21 meta-categories organized into six clusters, namely (1) obtaining clinically relevant information, (2) adapting treatment, (3) facilitating communication, (4) enhancing the therapeutic relationship, (5) facilitating change in clients, and (6) personalized usage of ROM. The meta-analysis revealed that clinicians utilized ROM in diverse ways, including both informational and communicational functions. From the clinicians' perspective, ROM was an element that, on the one hand, introduced additional structure and standardization in treatment and, on the other hand, allowed for greater flexibility and tailoring of treatment.

Therapists' and patients' experiences of using patients' self-reported data in ongoing psychotherapy processes-A systematic review and meta-analysis of qualitative studies

OBJECTIVE

Using patient-generated quantitative data in psychotherapy (feedback) appears to enhance treatment outcome, but there is variability in its effect. Different ways and reasons to implement routine outcome measurement might explain such variability. The goal of this review is to address the insufficient knowledge on how these data are used by therapists and patients.

METHODS

The present study is a systematic review and meta-analysis of qualitative reports of therapists' and patients' experiences using patient-generated quantitative data during ongoing psychotherapy.

RESULTS

Four main categories of use were identified: (1) uses of patients' self-reported data as nomothetic/objective markers for assessment, process monitoring, and treatment planning; (2) intrapersonal uses that enhance self-awareness, initiate reflection, and influence patients' mood or responses; (3) uses that prompt interactional processes by facilitating communication, supporting exploration, creating ownership in patients, changing treatment focus, enhancing therapeutic alliance, or disturbing the psychotherapy process; and (4) patients responding for specific purposes due to uncertainty and interpersonal motives, or strategic responding to achieve a desired result.

CONCLUSION

These results demonstrate that patient-reported data, when used in active psychotherapy, is very clearly not just an objective measurement of client functioning: the inclusion of patient-data has the potential to influence psychotherapy in numerous ways.

The role of depression and anxiety symptom severity in remotely delivered mental health care

This study examined differences in mental health characteristics of Veterans who received VA Video Connect (VVC) or audio-only care during initial phases of the COVID-19 pandemic. A cohort of Veterans with primary diagnoses of depressive or anxiety disorders (diagnosed between March 2019 and February 2020) was identified, and data were obtained for Veterans who engaged in virtual care from April to December 2020. Two groups were created: Veterans receiving audio-only care (n = 161,071) and Veterans receiving two or more VVC visits (n = 84,505). Multiple logistic regression models examined symptom severity in the year before COVID as a predictor of treatment modality during COVID. Chi-square tests examined associations between modality and the number of assessments. Symptom severity as evaluated by the nine-item Patient Health Questionnaire and Generalized Anxiety Disorder-7 significantly predicted modality of encounters during the pandemic such that those who had moderate or severe symptoms prior to COVID-19 were more likely than those with low or no symptoms to have two or more VVC encounters during the pandemic. Of those who received VVC, 55.62% had no Patient Health Questionnaire-9 assessments compared to 68.96% of those who received audio-only. In the VVC group, 70.36% had no Generalized Anxiety Disorder-7 assessments compared to 81.02% in the audio-only group. Taken together, these findings suggest that VVC, when compared to audio-only, was used during the pandemic to reach Veterans with more severe mental health symptomatology and to engage in administration of measurement-based care. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

A Survey of Behavioral Health Care Providers on Use and Barriers to Use of Measurement-Based Care

OBJECTIVE

Despite robust evidence for efficacy of measurement-based care (MBC) in behavioral health care, studies suggest that adoption of MBC is limited in practice. A survey from Blue Cross-Blue Shield of North Carolina was sent to behavioral health care providers (BHCPs) about their use of MBC, beliefs about MBC, and perceived barriers to its adoption.

METHODS

The authors distributed the survey by using professional networks and snowball sampling. Provider and clinical practice characteristics were collected. Numerical indices of barriers to MBC use were created. Ordered logistic regression models were used to identify associations among practice and provider characteristics, barriers to MBC use, and level of MBC use.

RESULTS

Of the 922 eligible BHCPs who completed the survey, 426 (46%) reported using MBC with at least half of their patients. Providers were more likely to report MBC use if they were part of a large group practice, had MBC training, had more weekly care hours, or practiced in nonmetropolitan settings. Physicians, self-reported generalists, more experienced providers, and those who did not accept insurance were less likely to report MBC use. Low perceived clinical utility was the barrier most strongly associated with less frequent use of MBC.

CONCLUSIONS

Although evidence exists for efficacy of MBC in behavioral health care, less than half of BHCPs reported using MBC with at least half of their patients, and low perceived clinical utility of MBC was strongly associated with lower MBC use. Implementation strategies that attempt to change negative attitudes toward MBC may effectively target this barrier to use.

Enhancing Implementation of Measurement-Based Mental Health Care in Primary Care: A Mixed-Methods Study

OBJECTIVE

The complex practice of measurement-based care (MBC) for mental health conditions has proven challenging to implement. This study aimed to evaluate an intensive strategy to implement MBC in U.S. Department of Veterans Affairs (VA) Primary Care Mental Health Integration clinics.

METHODS

Ten paired sites were randomly assigned to receive national MBC resources alone or with an intensive implementation strategy (external facilitation plus quality improvement teams) between May 2018 and June 2020. The intervention occurred over 12-18 months; two site pairs completed participation before the COVID-19 pandemic. Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, the authors conducted qualitative interviews and used administrative data to evaluate the implementation, adoption, reach, and effectiveness of MBC.

RESULTS

All sites improved during the study, suggesting the effectiveness of the VA's national MBC initiative. Sites with facilitation improved more than comparison sites in implementation, adoption, and reach of MBC. The effectiveness of MBC (i.e., clinician responsiveness to high patient-reported outcome measure [PROM] scores) was demonstrated at all sites both before and after facilitation. After the COVID-19 pandemic began, facilitation sites maintained or improved on their implementation gains, whereas comparison sites uniformly reported decreased emphasis on MBC.

CONCLUSIONS

Implementation facilitation resulted in greater gains in outcomes of interest and helped sites retain focus on MBC implementation. Regardless of study condition, clinicians were responsive to elevated PROM scores, but MBC had a larger impact on care at facilitation sites because of increased uptake. Multiple technological and contextual challenges remain, but MBC holds promise for improving routine mental health care.

The Implementation of Measurement-Based Care in the Context of Telemedicine: Qualitative Study

BACKGROUND

The Measurement Based Care in Mental Health Initiative launched by the Department of Veterans Affairs in 2016 is an example of an evidence-based practice that uses patient-reported outcome measures (PROMs) to improve patient outcomes. The acceptance of measurement-based care (MBC) among Veterans Affairs providers is relatively high. However, there are barriers to MBC for telehealth providers. Health information technologies might afford opportunities to address some of the barriers related to the uptake of MBC.

OBJECTIVE

This paper reports on an implementation effort to integrate MBC into mental health care telehealth practice using eHealth solutions.

METHODS

Qualitative data were generated from 22 semistructured interviews with psychiatrists (n=4), psychologists (n=3), social workers (n=3), nurses (n=6), a pharmacist (n=1), and administrative staff (n=5) who provide telemental health care through a community-based outpatient clinic in the rural Midwestern United States. The interviews were conducted during the pilot phase of an implementation initiative to increase the adoption of MBC by revising clinic workflows to integrate the use of eHealth technologies. Data were analyzed using thematic analysis.

RESULTS

Time burden and workflow issues were the most common barrier to provider adoption of MBC; sharing and reviewing pencil-and-paper measures and results in the same room was no longer possible in novel telehealth workflows necessitated by the COVID-19 pandemic. Providers voiced concerns about how long it would take to collect, adequately score, interpret, share, and document the PROMs during the telehealth visit. Concerns about time might also correspond to a gap in providers' familiarity with these assessments, greater comfort in assessing symptoms through clinical interviews, and being accustomed to using the assessments as screening tools more so than longitudinal outcome measures. Capacities associated with eHealth technologies may address workflow concerns and promote providers' understanding and use of the measures as tracking tools.

CONCLUSIONS

The need to use limited appointment time well was a top priority for telemental health providers. eHealth technologies provided operative supports that protect time in appointments by shifting when and how PROMs are collected. Bolstering providers' familiarity with how to use PROMs in the course of treatment may impact providers' buy-in by encouraging them to reconsider how sharing and acting on PROMs could be time well spent.

Engaging frontline workers in policy development to support the implementation of measurement-based care: Lessons learned from a field-based workgroup

Measurement-Based Care (MBC) is the use of patient-reported outcome measures repeatedly over the course of treatment to track progress and empower both providers and patients to collaboratively set goals and plan treatment. The Measurement-Based Care in Mental Health Initiative within the Department of Veterans Affairs' Office of Mental Health and Suicide Prevention partnered with the Post Traumatic Stress Disorder (PTSD) Mentoring Program to create an interdisciplinary field-based workgroup. The workgroup included psychologists, clinical social workers, and mental health counselors from PTSD Clinical Teams. The task of the workgroup was to create guidelines for best practice in delivery of MBC in PTSD Clinical Teams given anticipated policy requiring MBC to be used in PTSD Clinical Teams. Framed in the Strategic Action Field Framework for Policy Implementation Research, the current paper evaluates this hybrid top-down and bottom-up process of policy development. Major barriers included difficulty with the workgroup as an authentic bottom-up process, inability to reach the entire field (e.g., focus groups not widely attended by providers), and limited diversity in the workgroup. Facilitators included using consensus to make decisions, support provided to workgroup members by national operations partners, and collaboration and mutual respect among workgroup members. Workgroup members noted an equal, respectful partnership between operations partners and the workgroup; they reported feeling empowered and believed the viewpoints of the field were included in the guidelines. Further, due to the COVID-19 pandemic, the workgroup included more guidelines specific to telehealth into the guidelines. This hybrid model provides a process through which frontline workers can inform policy development and implementation.

Patient, family and provider views of measurement-based care in an early-psychosis intervention programme

Background

Measurement-based care (MBC) in mental health improves patient outcomes and is a component of many national guidelines for mental healthcare delivery. Nevertheless, MBC is not routinely integrated into clinical practice. Several known reasons for the lack of integration exist but one lesser explored variable is the subjective perspectives of providers and patients about MBC. Such perspectives are critical to understand facilitators and barriers to improve the integration of MBC into routine clinical practice.

Aims

This study aimed to uncover the perspectives of various stakeholders towards MBC within a single treatment centre.

Method

Researchers conducted qualitative semi-structured interviews with patients (n = 15), family members (n = 7), case managers (n = 8) and psychiatrists (n = 6) engaged in an early-psychosis intervention programme. Data were analysed using thematic analysis, informed by critical realist theory.

Results

Analysis converged on several themes. These include (a) implicit negative assumptions; (b) relevance and utility to practice; (c) equity versus flexibility; and (d) shared decision-making. Providers assumed patients’ perspectives of MBC were negative. Patients’ perspectives of MBC were actually favourable, particularly if MBC was used as an instrument to engage patients in shared decision-making and communication rather than as a dogmatic and rigid clinical decision tool.

Conclusions

This qualitative study presents the views of various stakeholders towards MBC, providing an in-depth examination of the barriers and facilitators to MBC through qualitative investigation. The findings from this study should be used to address the challenges organisations have experienced in implementing MBC.

Discussing measurement-based care with patients: An analysis of clinician-patient dyads

Abstract Measurement-based care (MBC) refers to the use of three integrated strategies to improve effectiveness of behavioral health care: routine outcomes monitoring using symptom measures; regularly sharing these data with patients; and using these data to inform treatment decisions. This study examined how clinicians discuss MBC data with patients, including identifying what aspects of these discussions contribute to clinician-patient agreement on the value of MBC, and how clinicians use MBC data to inform treatment decisions. Twenty-six clinician-patient dyads participated in semi-structured interviews and provided a treatment session recording in which MBC data were discussed. Qualitative data analyses revealed four subtypes of dyads: clinician and patient both valued MBC; clinician valued MBC, patient passively participated in MBC; clinician valued MBC, patient had mixed perceptions of MBC; clinician and patient reported moderate or low value for MBC. In dyads for whom both the clinician and patient valued MBC, the clinician provided clear and repeated rationale for MBC, discussed data with patients at every administration, and connected observed scores to patient skills or strategies. Emerging best practices for discussing MBC include providing a strong rationale, discussing results frequently, actively engaging patients in discussions, and using graphs to visualize progress.

Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings

Objective: Measurement feedback systems provide clinicians with regular snapshots of a client's mental health status, which can be used in treatment planning and client feedback. There are numerous barriers to clinicians using outcome measures routinely. This study aimed to investigate factors affecting the use of a measurement feedback system across youth mental health settings. Methods: The participants were 210 clinicians from headspace youth mental health services across Australia. They were surveyed on predictors and use of MyLifeTracker, a routine outcome measure. This was explored through three processes: looking at MyLifeTracker before session, using MyLifeTracker in treatment planning, and providing feedback of MyLifeTracker scores to clients. Results: Clinicians were more likely to look at MyLifeTracker before session, less likely to use it in treatment planning, and least likely to provide MyLifeTracker scores to clients. Each measurement feedback system process had a distinct group of predictors. Perceptions of MyLifeTracker's practicality was the only significant predictor of all three processes. Conclusion: Practically, organisations and supervisors can increase the use of measurement feedback systems through targeted supports.