1
|
Jensen-Doss A, Casline E, Woodard GS, Phillips DA, Lane E, Palafu T, Waye C, Ramirez V, Cheron DM, Okamura K. Provider Use of, Attitudes Towards, and Self-efficacy with Key Measurement-based Care Practices in Youth Mental Health Treatment: A Multi-site Examination. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024:10.1007/s10488-024-01354-6. [PMID: 38334881 DOI: 10.1007/s10488-024-01354-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/02/2024] [Indexed: 02/10/2024]
Abstract
Measurement-based care (MBC) is an underutilized evidence-based practice, and current implementation efforts demonstrate limited success in increasing MBC use. A better understanding of MBC implementation determinants is needed to improve these efforts, particularly from studies examining the full range of MBC practices and that span multiple samples of diverse providers using different MBC systems. This study addressed these limitations by conducting a multi-site survey examining MBC predictors and use in youth treatment. Participants were 159 clinicians and care coordinators working in youth mental health care settings across the United States. Participants were drawn from three program evaluations of MBC implementation. Providers completed measures assessing use of five MBC practices (administering measures, viewing feedback, reviewing feedback in supervision, sharing feedback with clients in session, and using feedback to plan treatment), MBC self-efficacy, and MBC attitudes. Despite expectations that MBC should be standard care for all clients, providers reported only administering measures to 40-60% of clients on average, with practices related to the use of feedback falling in the 1-39% range. Higher MBC self-efficacy and more positive views of MBC practicality predicted higher MBC use, although other attitude measures were not significant predictors. Effects of predictors were not moderated by site, suggesting consistent predictors across implementation settings. Implications of study findings for future research and for the implementation of MBC are discussed.
Collapse
Affiliation(s)
| | - Elizabeth Casline
- Center for Dissemination and Implementation Science, Northwestern University Feinberg School of Medicine, Chicago, IL, US
| | - Grace S Woodard
- Department of Psychology, University of Miami, Coral Gables, FL, USA
| | | | - Elizabeth Lane
- Department of Psychology, University of Miami, Coral Gables, FL, USA
| | - Tessa Palafu
- The Baker Center for Children and Families, Boston, MA, USA
| | - Catherine Waye
- The Baker Center for Children and Families, Boston, MA, USA
| | | | | | - Kelsie Okamura
- The Baker Center for Children and Families, Boston, MA, USA
| |
Collapse
|
2
|
van Sonsbeek MAMS, Hutschemaekers GJM, Veerman JW, Vermulst A, Tiemens BG. The results of clinician-focused implementation strategies on uptake and outcomes of Measurement-Based Care (MBC) in general mental health care. BMC Health Serv Res 2023; 23:326. [PMID: 37005612 PMCID: PMC10067297 DOI: 10.1186/s12913-023-09343-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 03/27/2023] [Indexed: 04/04/2023] Open
Abstract
BACKGROUND Measurement-Based Care (MBC) is the routine administration of measures, clinicians' review of the feedback and discussion of the feedback with their clients, and collaborative evaluation of the treatment plan. Although MBC is a promising way to improve outcomes in clinical practice, the implementation of MBC faces many barriers, and its uptake by clinicians is low. The purpose of this study was to investigate whether implementation strategies that were developed with clinicians and aimed at clinicians had an effect on (a) clinicians' uptake of MBC and (b) clients' outcomes of MBC. METHODS We used an effectiveness-implementation hybrid design based on Grol and Wensing's implementation framework to assess the impact of clinician-focused implementation strategies on both clinicians' uptake of MBC and outcomes obtained with MBC for clients in general mental health care. We hereby focused on the first and second parts of MBC, i.e., the administration of measures and use of feedback. Primary outcome measures were questionnaire completion rate and discussion of the feedback with clients. Secondary outcomes were treatment outcome, treatment length, and satisfaction with treatment. RESULTS There was a significant effect of the MBC implementation strategies on questionnaire completion rate (one part of clinicians' uptake), but no significant effect on the amount of discussion of the feedback (the other part of clinicians' uptake). Neither was there a significant effect on clients' outcomes (treatment outcome, treatment length, and satisfaction with treatment). Due to various study limitations, the results should be viewed as exploratory. CONCLUSIONS Establishing and sustaining MBC in real-world general mental health care is complex. This study helps to disentangle the effects of MBC implementation strategies on differential clinician uptake, but the effects of MBC implementation strategies on client outcomes need further examination.
Collapse
Affiliation(s)
| | - Giel J M Hutschemaekers
- Pro Persona Research, Pro Persona, Postbus 27, 6870 AA, Renkum, The Netherlands
- Indigo Gelderland, Indigo Service Organisatie BV, Utrecht, The Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands
| | - Jan W Veerman
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands
| | - Ad Vermulst
- GGZ (Mental Health Care) Oost Brabant, Boekel, The Netherlands
| | - Bea G Tiemens
- Pro Persona Research, Pro Persona, Postbus 27, 6870 AA, Renkum, The Netherlands
- Indigo Gelderland, Indigo Service Organisatie BV, Utrecht, The Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
3
|
Sichel CE, Connors EH. Measurement feedback system implementation in public youth mental health treatment services: a mixed methods analysis. Implement Sci Commun 2022; 3:119. [PMID: 36415009 PMCID: PMC9682849 DOI: 10.1186/s43058-022-00356-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Accepted: 09/28/2022] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Prior studies indicate the effectiveness of measurement-based care (MBC), an evidence-based practice, in improving and accelerating positive outcomes for youth receiving behavioral health services. MBC is the routine collection and use of client-reported progress measures to inform shared decision-making and collaborative treatment adjustments and is a relatively feasible and scalable clinical practice, particularly well-suited for under-resourced community mental health settings. However, uptake of MBC remains low, so information on determinants related to MBC practice patterns is needed. METHODS Quantitative and qualitative data from N = 80 clinicians who implemented MBC using a measurement feedback system (MFS) were merged to understand and describe determinants of practice over three study phases. Quantitative, latent class analysis identified clinician groups based on participants' ratings of MFS acceptability, appropriateness, and feasibility and describes similarities/differences between classes in clinician-level characteristics (e.g., age; perceptions of implementation climate; reported MFS use; phase I). Qualitative analyses of clinicians' responses to open-ended questions about their MFS use and feedback about the MFS and implementation supports were conducted separately to understand multi-level barriers and facilitators to MFS implementation (phase II). Mixing occurred during interpretation, examining clinician experiences and opinions across groups to understand the needs of different classes of clinicians, describe class differences, and inform selection of implementation strategies in future research (phase III). RESULTS We identified two classes of clinicians: "Higher MFS" and "Lower MFS," and found similarities and differences in MFS use across groups. Compared to Lower MFS participants, clinicians in the Higher MFS group reported facilitators at a higher rate. Four determinants of practice were associated with the uptake of MBC and MFS in youth-serving community mental health settings for all clinicians: clarity, appropriateness, and feasibility of the MFS and its measures; clinician knowledge and skills; client preferences and behaviors; and incentives and resources (e.g., time; continuing educational support). Findings also highlighted the need for individual-level implementation strategies to target clinician needs, skills, and perceptions for future MBC and MFS implementation efforts. CONCLUSION This study has implications for the adoption of evidence-based practices, such as MBC, in the context of community-based mental health services for youth.
Collapse
Affiliation(s)
- Corianna E Sichel
- Division of Child and Adolescent Psychiatry, Department of Psychiatry, Columbia University, 1051 Riverside Drive, Mail Unit 78, New York, NY, 10032, USA.
| | - Elizabeth H Connors
- Division of Prevention and Community Research, Department of Psychiatry, Yale University School of Medicine, 389 Whitney Avenue, New Haven, CT, 06511, USA
| |
Collapse
|
4
|
Kwan B, Rickwood DJ, Brown PM. Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings. Psychother Res 2020; 31:171-183. [PMID: 33040708 DOI: 10.1080/10503307.2020.1829738] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Objective: Measurement feedback systems provide clinicians with regular snapshots of a client's mental health status, which can be used in treatment planning and client feedback. There are numerous barriers to clinicians using outcome measures routinely. This study aimed to investigate factors affecting the use of a measurement feedback system across youth mental health settings. Methods: The participants were 210 clinicians from headspace youth mental health services across Australia. They were surveyed on predictors and use of MyLifeTracker, a routine outcome measure. This was explored through three processes: looking at MyLifeTracker before session, using MyLifeTracker in treatment planning, and providing feedback of MyLifeTracker scores to clients. Results: Clinicians were more likely to look at MyLifeTracker before session, less likely to use it in treatment planning, and least likely to provide MyLifeTracker scores to clients. Each measurement feedback system process had a distinct group of predictors. Perceptions of MyLifeTracker's practicality was the only significant predictor of all three processes. Conclusion: Practically, organisations and supervisors can increase the use of measurement feedback systems through targeted supports.
Collapse
Affiliation(s)
- Benjamin Kwan
- Faculty of Health, University of Canberra, Bruce, ACT, Australia
| | - Debra J Rickwood
- Faculty of Health, University of Canberra, Bruce, ACT, Australia.,Headspace National Youth Mental Health Foundation National Office, Melbourne, VIC, Australia
| | - Patricia M Brown
- Faculty of Health, University of Canberra, Bruce, ACT, Australia
| |
Collapse
|
5
|
Rye M, Rognmo K, Aarons GA, Skre I. Attitudes Towards the Use of Routine Outcome Monitoring of Psychological Therapies Among Mental Health Providers: The EBPAS-ROM. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:833-846. [PMID: 31485816 DOI: 10.1007/s10488-019-00968-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Implementation of routine outcome monitoring (ROM) in mental health care is progressing slowly. Knowledge about factors influencing ROM implementation, including health providers' attitudes towards ROM, is necessary. Based on a survey of 662 psychologists and nurses, this article describes (1) the development of a short instrument measuring provider attitudes towards ROM, derived from the Evidence-based Practice Attitude Scale (EBPAS), and (2) how attitudinal domains relate to clinicians' current use of standardized instruments for treatment evaluation. The EBPAS-ROM showed concurrent validity in predicting aspects important for the implementation of ROM, including perceived limitations and the value of organizational support.
Collapse
Affiliation(s)
- Marte Rye
- Department of Psychology, UIT The Arctic University of Norway, 9037, Tromsö, Norway.
- Department of General Psychiatry and Addiction, University Hospital of North Norway, 9038, Tromsö, Norway.
- Regional Centre for Child and Youth Mental Health and Child Welfare, UIT The Arctic University of Norway, 9037, Tromsö, Norway.
| | - Kamilla Rognmo
- Department of Psychology, UIT The Arctic University of Norway, 9037, Tromsö, Norway
| | - Gregory A Aarons
- Department of Psychiatry, University of California, San Diego, CA, USA
| | - Ingunn Skre
- Department of Psychology, UIT The Arctic University of Norway, 9037, Tromsö, Norway
- Department of General Psychiatry and Addiction, University Hospital of North Norway, 9038, Tromsö, Norway
| |
Collapse
|
6
|
Brooks Holliday S, Hepner KA, Farmer CM, Ivany C, Iyiewuare P, McGee-Vincent P, McCaslin S, Rosen CS. A qualitative evaluation of Veterans Health Administration's implementation of measurement-based care in behavioral health. Psychol Serv 2020; 17:271-281. [PMID: 31424241 PMCID: PMC7028496 DOI: 10.1037/ser0000390] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Measurement-based care (MBC) in behavioral health involves the repeated collection of patient-reported data that is used to track progress, inform care, and engage patients in shared decision making about their treatment. Research suggests that MBC increases the quality and effectiveness of mental health care. However, there can be challenges to implementing MBC, such as time burden, lack of resources to support MBC, and clinician attitudes. The Veterans Health Administration (VHA) is currently undertaking a multiphase MBC roll-out, the first phase of which included 59 sites across the country. The present study examined implementation of this initiative in an effort to learn more about the process of implementation, including best practices, challenges, and innovations. Semistructured interviews were conducted with 20 MBC site champions and 60 staff members from 25 VHA medical centers across the country. Qualitative data analysis was conducted to identify key themes related to MBC implementation. Results were described for 3 components of MBC implementation: preparing for implementation, administering measures, and using and sharing data. Training and staff buy-in were key to the preparation phase. Staff members reported a variety of methods and frequencies for the collection of MBC data, with many staff members identifying a need to streamline the collection process. Staff members reported using data to track progress and adjust treatment with patients. Efforts to use data on a programmatic level were identified as a next step. Innovative solutions across clinics and sites are described in an effort to inform future MBC implementation, both within and outside of VHA. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
Affiliation(s)
| | | | | | | | | | | | | | - Craig S Rosen
- National Center for PTSD Dissemination and Training Division
| |
Collapse
|
7
|
Lambert MJ, Harmon KL. The merits of implementing routine outcome monitoring in clinical practice. ACTA ACUST UNITED AC 2018. [DOI: 10.1111/cpsp.12268] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
8
|
Powell BJ, Beidas RS. Advancing Implementation Research and Practice in Behavioral Health Systems. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2018; 43:825-833. [PMID: 27591772 DOI: 10.1007/s10488-016-0762-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Affiliation(s)
- Byron J Powell
- Department of Health Policy and Management, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, 1105C McGavran-Greenberg Hall, Campus Box 7411, Chapel Hill, NC, 27599-7411, USA.
| | - Rinad S Beidas
- Center for Mental Health Policy and Services Research, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3015, Philadelphia, PA, 19104, USA
| |
Collapse
|
9
|
Rubin RM, Hurford MO, Hadley T, Matlin S, Weaver S, Evans AC. Synchronizing Watches: The Challenge of Aligning Implementation Science and Public Systems. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2018; 43:1023-1028. [PMID: 27511103 DOI: 10.1007/s10488-016-0759-9] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
This special issue of Administration and Policy in Mental Health explores the complexities of the outer system context in implementation science research. In this commentary, we highlight areas of asynchrony between implementation science research and policy realities of public systems. Timing is a critical factor for many aspects of system-level implementation including when and how evidence-based practice initiatives are launched, short and inconsistent timeframes for funding and support, need for early indicators of success and demonstrating return on investment. Greater consideration for the timing that drives change in public systems will strengthen efforts to implement and sustain EBPs in community settings.
Collapse
Affiliation(s)
- Ronnie M Rubin
- Department of Behavioral Health and Intellectual disAbility Services, Philadelphia, PA, USA. .,Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA. .,Community Behavioral Health, 801 Market Street, 7th Floor, Philadelphia, PA, 19107, USA.
| | - Matthew O Hurford
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA.,Community Care Behavioral Health, Pittsburgh, PA, USA
| | - Trevor Hadley
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Samantha Matlin
- Thomas Scattergood Behavioral Health Foundation, Philadelphia, PA, USA.,The Consultation Center, Yale University School of Medicine, New Haven, CT, USA
| | - Shawna Weaver
- Community Behavioral Health, 801 Market Street, 7th Floor, Philadelphia, PA, 19107, USA
| | - Arthur C Evans
- Department of Behavioral Health and Intellectual disAbility Services, Philadelphia, PA, USA.,Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|