1
|
Frontini R, Costa C, Baptista S, Garcia CDC, Vian-Lains A. Measurement-Based Care in Youth: An Opportunity for Better Clinical Outcomes? Healthcare (Basel) 2024; 12:910. [PMID: 38727467 PMCID: PMC11083159 DOI: 10.3390/healthcare12090910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 04/16/2024] [Accepted: 04/18/2024] [Indexed: 05/13/2024] Open
Abstract
Measurement-based care (MBC) is a procedure in which systematic and routine assessments are performed. Through this practice, clinicians can verify the progress of the symptomatology of the patient and adapt the appointments and the intervention to the current symptoms. Studies have reflected on the importance and the benefits of this type of procedure in the adult population, and have shown positive results. However, there is a lack of evidence concerning the remaining populations. Regarding youth, for instance, few articles have evaluated the benefits of using this procedure in clinical practice. However, research focused on this topic has revealed positive results, especially when clinicians were loyal to the MBC procedures. Still, further research is needed. This letter aims to share the methodology used by our multidisciplinary team, composed of psychologists and psychiatrists, in a clinical context at the Hospital Cruz Vermelha, Lisboa, applied to the adult population; the objective is to share and discuss some alterations that could be made to our evaluation protocol to enable the same to be used with the youth population. We believe that implementing MBC for youth is crucial for several reasons, including enhanced treatment efficacy, more personalized treatment, a reduced reliance on subjectivity, and empowerment not only of patients but also families.
Collapse
Affiliation(s)
- Roberta Frontini
- Clínica de Neurociências e Saúde Mental, Hospital Cruz Vermelha, 1500-048 Lisboa, Portugal; (C.C.); (S.B.); (A.V.-L.)
- Faculdade de Ciências Humanas, Universidade Católica Portuguesa, 1649-023 Lisboa, Portugal;
| | - Catarina Costa
- Clínica de Neurociências e Saúde Mental, Hospital Cruz Vermelha, 1500-048 Lisboa, Portugal; (C.C.); (S.B.); (A.V.-L.)
| | - Sílvia Baptista
- Clínica de Neurociências e Saúde Mental, Hospital Cruz Vermelha, 1500-048 Lisboa, Portugal; (C.C.); (S.B.); (A.V.-L.)
| | | | - António Vian-Lains
- Clínica de Neurociências e Saúde Mental, Hospital Cruz Vermelha, 1500-048 Lisboa, Portugal; (C.C.); (S.B.); (A.V.-L.)
| |
Collapse
|
2
|
Woodard GS, Casline E, Ehrenreich-May J, Ginsburg GS, Jensen-Doss A. Consultation as an Implementation Strategy to Increase Fidelity of Measurement-Based Care Delivery in Community Mental Health Settings: An Observational Study. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2023:10.1007/s10488-023-01321-7. [PMID: 38052929 DOI: 10.1007/s10488-023-01321-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/01/2023] [Indexed: 12/07/2023]
Abstract
Regularly administering outcome measures to clients to inform clinical decision making, referred to as measurement-based care (MBC), has the potential to improve mental health treatment due to its applicability across disorders and treatment settings. Given the utility of MBC, understanding predictors of high-fidelity MBC implementation is important. Training and consultation are widely used implementation strategies to increase the fidelity of evidence-based practice delivery but have rarely been studied with MBC. The current study will examine the relationship between time clinicians spent discussing a case in consultation ("dosage") and MBC fidelity. Thirty clinicians and 56 youth were in the MBC condition of a randomized controlled trial and completed baseline questionnaires. Consultation dosage was extracted from call notes. MBC fidelity was measured using the implementation index, which combines rates of administering and viewing questionnaires, using objective data from the online MBC system. Multi-level modeling was used. Greater consultation dosage significantly predicted a higher implementation index (ß = 0.27, SE = 0.06, p < .001). For every 30 min spent discussing a case in consultation, the case's MBC fidelity increased by 8.1%. Greater consultation dosage significantly predicted higher rates of administration (ß = 0.07, SE = 0.03, p = 0.033) and feedback report viewing (ß = 0.24, SE = 0.06, p < .001). More consultation at the case level predicts greater MBC fidelity using objective measures. The greatest impact was increasing the clinician feedback report viewing rate. The results of this study can help inform future efforts to increase the fidelity with which MBC is delivered and to make consultation as efficient and effective as possible.
Collapse
Affiliation(s)
- Grace S Woodard
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33146, USA.
| | - Elizabeth Casline
- Northwestern University Feinberg School of Medicine, 420 E. Superior Street, Chicago, IL, 60611, USA
| | - Jill Ehrenreich-May
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33146, USA
| | - Golda S Ginsburg
- University of Connecticut School of Medicine, 65 Kane Street Room 3022, West Hartford, CT, 06119, USA
| | - Amanda Jensen-Doss
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33146, USA
| |
Collapse
|
3
|
Cho E, Cook JR, Hawley KM. A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2023; 50:876-887. [PMID: 37458956 PMCID: PMC11056910 DOI: 10.1007/s10488-023-01286-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/02/2023] [Indexed: 10/01/2023]
Abstract
Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.
Collapse
Affiliation(s)
- Evelyn Cho
- University of Missouri, Columbia, USA
- Harvard University, Cambridge, USA
| | - Jonathan R Cook
- University of Missouri, Columbia, USA
- Pacific Anxiety Group, Belmont, USA
| | | |
Collapse
|
4
|
Marriott BR, Walker MR, Howard J, Puspitasari A, Scott K, Albright K, Lewis CC. Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle? ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2023; 50:366-378. [PMID: 36542316 PMCID: PMC10201798 DOI: 10.1007/s10488-022-01244-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Accepted: 12/03/2022] [Indexed: 12/24/2022]
Abstract
PURPOSE Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address. METHODS The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session. RESULTS Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care. CONCLUSION Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.
Collapse
Affiliation(s)
- Brigid R Marriott
- Department of Psychiatry, Indiana University School of Medicine, 410 W. 10th St, 46202, Indianapolis, IN, USA.
| | - Madison R Walker
- University of North Carolina, 135 Dauer Dr, 27599, Chapel Hill, NC, USA
| | | | - Ajeng Puspitasari
- Rogers Behavioral Health, 576 Bielenberg Dr Ste 180, 55125, Woodbury, MN, USA
| | - Kelli Scott
- Brown University, 121 S. Main Street, 02903, Providence, RI, USA
| | - Karen Albright
- Division of General Internal Medicine, University of Colorado School of Medicine, 12631 East 17th Ave, 80045, Aurora, CO, USA
| | - Cara C Lewis
- MacColl Center for Healthcare Innovation, Kaiser Permanente Washington Health Research Institute, 1730 Minor Ave, 98101, Seattle, WA, USA
| |
Collapse
|
5
|
van Sonsbeek MAMS, Hutschemaekers GJM, Veerman JW, Vermulst A, Tiemens BG. The results of clinician-focused implementation strategies on uptake and outcomes of Measurement-Based Care (MBC) in general mental health care. BMC Health Serv Res 2023; 23:326. [PMID: 37005612 PMCID: PMC10067297 DOI: 10.1186/s12913-023-09343-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Accepted: 03/27/2023] [Indexed: 04/04/2023] Open
Abstract
BACKGROUND Measurement-Based Care (MBC) is the routine administration of measures, clinicians' review of the feedback and discussion of the feedback with their clients, and collaborative evaluation of the treatment plan. Although MBC is a promising way to improve outcomes in clinical practice, the implementation of MBC faces many barriers, and its uptake by clinicians is low. The purpose of this study was to investigate whether implementation strategies that were developed with clinicians and aimed at clinicians had an effect on (a) clinicians' uptake of MBC and (b) clients' outcomes of MBC. METHODS We used an effectiveness-implementation hybrid design based on Grol and Wensing's implementation framework to assess the impact of clinician-focused implementation strategies on both clinicians' uptake of MBC and outcomes obtained with MBC for clients in general mental health care. We hereby focused on the first and second parts of MBC, i.e., the administration of measures and use of feedback. Primary outcome measures were questionnaire completion rate and discussion of the feedback with clients. Secondary outcomes were treatment outcome, treatment length, and satisfaction with treatment. RESULTS There was a significant effect of the MBC implementation strategies on questionnaire completion rate (one part of clinicians' uptake), but no significant effect on the amount of discussion of the feedback (the other part of clinicians' uptake). Neither was there a significant effect on clients' outcomes (treatment outcome, treatment length, and satisfaction with treatment). Due to various study limitations, the results should be viewed as exploratory. CONCLUSIONS Establishing and sustaining MBC in real-world general mental health care is complex. This study helps to disentangle the effects of MBC implementation strategies on differential clinician uptake, but the effects of MBC implementation strategies on client outcomes need further examination.
Collapse
Affiliation(s)
| | - Giel J M Hutschemaekers
- Pro Persona Research, Pro Persona, Postbus 27, 6870 AA, Renkum, The Netherlands
- Indigo Gelderland, Indigo Service Organisatie BV, Utrecht, The Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands
| | - Jan W Veerman
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands
| | - Ad Vermulst
- GGZ (Mental Health Care) Oost Brabant, Boekel, The Netherlands
| | - Bea G Tiemens
- Pro Persona Research, Pro Persona, Postbus 27, 6870 AA, Renkum, The Netherlands
- Indigo Gelderland, Indigo Service Organisatie BV, Utrecht, The Netherlands
- Behavioural Science Institute, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
6
|
Developing an Implementation Model for ADHD Intervention in Community Clinics: Leveraging Artificial Intelligence and Digital Technology. COGNITIVE AND BEHAVIORAL PRACTICE 2023. [DOI: 10.1016/j.cbpra.2023.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
|
7
|
Roche AI, Savitz ST, Kelpin SS, Lebow J, Lombardi N, Bogucki OE, Kurtzhals AA, Drews MS, Trane ST, Allen JS, Williams MD, Sawchuk CN. Study What You Do: Developing a Psychotherapy Tracking Database in a Large-Scale Integrated Behavioral Health Service. Ann Fam Med 2023; 21:S49-S55. [PMID: 36849471 PMCID: PMC9970678 DOI: 10.1370/afm.2927] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 09/12/2022] [Accepted: 10/27/2022] [Indexed: 03/01/2023] Open
Abstract
PURPOSE Many individuals with behavioral health challenges receive services in primary care, and integrated behavioral health (IBH) programs can help increase access to evidence-based interventions. IBH programs can benefit substantially from integrating standardized tracking databases that allow for the implementation of measurement-based care to evaluate patient-, clinician-, and practice-level outcomes. We describe the development and integration of Mayo Clinic's pediatric and adult primary care psychotherapy tracking database. METHODS IBH practice leaders directed the development of a large psychotherapy tracking database that continuously populates from Mayo Clinic's electronic health record system. The database captures numerous patient variables including demographics, behavioral health and substance use issues, psychotherapy principles used, and self-reported symptoms. We retrieved current data for patients empaneled in Mayo Clinic's pediatric and adult primary care psychotherapy programs from June 2014 to June 2022. RESULTS The tracking database contained data for 16,923 adult patients and 6,298 pediatric patients. The mean age of adult patients was 43.2 years (SD 18.3), 88.1% were non-Latine White, and 66.7% identified as female. The mean age of pediatric patients was 11.6 years (SD 4.2), 82.5% were non-Latine White, and 56.9% identified as female. We provide examples of practical applications of the database across clinical, educational, research, and administrative domains. CONCLUSIONS The development and integration of a psychotherapy tracking database supports clinician communication, examination of patient outcomes, practice quality improvement efforts, and clinically relevant research. Our description of Mayo Clinic's IBH database may serve as a model for other IBH practices.
Collapse
Affiliation(s)
- Anne I Roche
- Division of Integrated Behavioral Health, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota
| | - Samuel T Savitz
- Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota.,Division of Health Care Delivery Research, Mayo Clinic, Rochester, Minnesota
| | - Sydney S Kelpin
- Division of Integrated Behavioral Health, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota
| | - Jocelyn Lebow
- Division of Integrated Behavioral Health, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota.,Department of Pediatrics, Mayo Clinic, Rochester, Minnesota
| | - Nathaniel Lombardi
- Division of Integrated Behavioral Health, Mayo Clinic Health System, Albert Lea, Minnesota
| | - Olivia E Bogucki
- Division of Integrated Behavioral Health, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota.,Department of Psychiatry, Massachusetts General Hospital, Boston, Massachusetts
| | | | - Maureen S Drews
- Research Application Solutions, Mayo Clinic, Rochester, Minnesota
| | - Sarah T Trane
- Division of Integrated Behavioral Health, Mayo Clinic Health System, La Crosse, Wisconsin
| | - Jay-Sheree Allen
- Department of Family Medicine, Mayo Clinic, Rochester, Minnesota
| | - Mark D Williams
- Division of Integrated Behavioral Health, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota
| | - Craig N Sawchuk
- Division of Integrated Behavioral Health, Department of Psychiatry and Psychology, Mayo Clinic, Rochester, Minnesota
| |
Collapse
|
8
|
Connors EH, Lyon AR, Garcia K, Sichel CE, Hoover S, Weist MD, Tebes JK. Implementation strategies to promote measurement-based care in schools: evidence from mental health experts across the USA. Implement Sci Commun 2022; 3:67. [PMID: 35729657 PMCID: PMC9210728 DOI: 10.1186/s43058-022-00319-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 06/12/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Despite an established taxonomy of implementation strategies, minimal guidance exists for how to select and tailor strategies to specific practices and contexts. We employed a replicable method to obtain stakeholder perceptions of the most feasible and important implementation strategies to increase mental health providers' use of measurement-based care (MBC) in schools. MBC is the routine use of patient-reported progress measures throughout treatment to inform patient-centered, data-driven treatment adjustments. METHODS A national sample of 52 school mental health providers and researchers completed two rounds of modified Delphi surveys to rate the relevance, importance, and feasibility of 33 implementation strategies identified for school settings. Strategies were reduced and definitions refined using a multimethod approach. Final importance and feasibility ratings were plotted on "go-zone" graphs and compared across providers and researchers to identify top-rated strategies. RESULTS The initial 33 strategies were rated as "relevant" or "relevant with changes" to MBC in schools. Importance and feasibility ratings were high overall for both survey rounds; on a scale of 1 to 5, importance ratings (3.61-4.48) were higher than feasibility ratings (2.55-4.06) on average. Survey 1 responses resulted in a reduced, refined set of 21 strategies, and six were rated most important and feasible on Survey 2: (1) assess for readiness and identify barriers and facilitators; (2) identify and prepare champions; (3) develop a usable implementation plan; (4) offer a provider-informed menu of free, brief measures; (5) develop and provide access to training materials; and (6) make implementation easier by removing burdensome documentation tasks. Provider and researcher ratings were not significantly different, with a few exceptions: providers reported higher feasibility and importance of removing burdensome paperwork than researchers, providers reported higher feasibility of train-the trainer approaches than researchers, and researchers reported higher importance of monitoring fidelity than providers. CONCLUSIONS The education sector is the most common setting for child and adolescent mental health service delivery in the USA. Effective MBC implementation in schools has the potential to elevate the quality of care received by many children, adolescents, and their families. This empirically derived, targeted list of six implementation strategies offers potential efficiencies for future testing of MBC implementation in schools.
Collapse
Affiliation(s)
- Elizabeth H. Connors
- grid.47100.320000000419368710Department of Psychiatry, Yale University, 389 Whitney Avenue, Office 106, New Haven, CT 06511 USA
| | - Aaron R. Lyon
- grid.34477.330000000122986657Department of Psychiatry and Behavioral Sciences, University of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA 98115 USA
| | - Kaylyn Garcia
- grid.47100.320000000419368710Department of Psychiatry, Yale University, 389 Whitney Avenue, Office 106, New Haven, CT 06511 USA
- grid.254567.70000 0000 9075 106XDepartment of Psychology, University of South Carolina, 1512 Pendelton Street, Columbia, SC 29208 USA
| | - Corianna E. Sichel
- grid.47100.320000000419368710Department of Psychiatry, Yale University, 389 Whitney Avenue, Office 106, New Haven, CT 06511 USA
- grid.21729.3f0000000419368729Division of Child/Adolescent Psychiatry, Department of Psychiatry, Columbia University, 1051 Riverside Drive, New York, NY 10032 USA
| | - Sharon Hoover
- grid.411024.20000 0001 2175 4264Department of Psychiatry, University of Maryland, 737 West Lombard Street, 4th Floor, Baltimore, MD 21201 USA
| | - Mark D. Weist
- grid.254567.70000 0000 9075 106XDepartment of Psychology, University of South Carolina, 1512 Pendelton Street, Columbia, SC 29208 USA
| | - Jacob K. Tebes
- grid.47100.320000000419368710Department of Psychiatry, Yale University, 389 Whitney Avenue, Office 106, New Haven, CT 06511 USA
| |
Collapse
|
9
|
Middle and High School Student Perspectives on Digitally-Delivered Mental Health Assessments and Measurement Feedback Systems. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2021; 47:531-544. [PMID: 31938974 DOI: 10.1007/s10488-020-01010-9] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Implementation of measurement-based care (MBC) by child-serving community mental health providers, particularly school-based providers, is low. To inform user-centered design of measurement feedback systems (MFSs) and MBC implementation more broadly, semi-structured interviews were conducted with 61 middle and high school students. Interviews explored student preferences for and perceived helpfulness of different assessment methods and use of MFS in counseling. Results indicate that student preference for digitally-administered assessment is equivocal, with preferences being influenced by student perceptions of the ease of use, impersonalization, and confidentiality. Students with exposure to the MFS found it helpful when used by their provider to share assessment feedback.
Collapse
|
10
|
Connors E, Lawson G, Wheatley-Rowe D, Hoover S. Exploration, Preparation, and Implementation of Standardized Assessment in a Multi-agency School Behavioral Health Network. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2021; 48:464-481. [PMID: 32940885 PMCID: PMC7965785 DOI: 10.1007/s10488-020-01082-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/09/2020] [Indexed: 10/23/2022]
Abstract
School mental health treatment services offer broad public health impact and could benefit from more widespread implementation and sustainment of standardized assessments (SA). This demonstration study describes one approach to increase SA use in a large school behavioral health network using the Exploration, Preparation, Implementation and Sustainment (EPIS) framework. Mental health administrator interviews with four participating agencies and a multidisciplinary planning team informed SA measure selection and implementation supports. The SA initiative was implemented during one school year, including system-wide training and ongoing implementation supports for 95 clinicians. Linear mixed effect models revealed improvements in clinician attitudes about the SA for clinical utility and treatment planning immediately following the half-day training (N = 95, p < .001). Clinicians self-reported a significant increase in use of SA for new clients during intakes (p < .001) over time and 71.4% of expected SA data were submitted. Qualitative feedback, including recommendations to offer more SA choices and beginning new SA data collection earlier in the school year, was integrated to inform quality improvements and future sustainment efforts.
Collapse
Affiliation(s)
- Elizabeth Connors
- Department of Psychiatry, Yale University, 389 Whitney Avenue, Office 106, New Haven, CT, 06511, USA.
| | - Gwendolyn Lawson
- Children's Hospital of Philadelphia, Roberts Center for Pediatric Research, 2716 South Street, 8th Floor, Philadelphia, PA, 19146, USA
| | - Denise Wheatley-Rowe
- Behavioral Health System Baltimore, 100 South Charles Street, Tower 2, 8th Floor, Baltimore, MD, 20201, USA
| | - Sharon Hoover
- Division of Child and Adolescent Psychiatry, National Center for School Mental Health, University of Maryland School of Medicine, 737 West Lombard Street, 4th Floor, Baltimore, MD, 21201, USA
| |
Collapse
|
11
|
Kwan B, Rickwood DJ, Brown PM. Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings. Psychother Res 2020; 31:171-183. [PMID: 33040708 DOI: 10.1080/10503307.2020.1829738] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Objective: Measurement feedback systems provide clinicians with regular snapshots of a client's mental health status, which can be used in treatment planning and client feedback. There are numerous barriers to clinicians using outcome measures routinely. This study aimed to investigate factors affecting the use of a measurement feedback system across youth mental health settings. Methods: The participants were 210 clinicians from headspace youth mental health services across Australia. They were surveyed on predictors and use of MyLifeTracker, a routine outcome measure. This was explored through three processes: looking at MyLifeTracker before session, using MyLifeTracker in treatment planning, and providing feedback of MyLifeTracker scores to clients. Results: Clinicians were more likely to look at MyLifeTracker before session, less likely to use it in treatment planning, and least likely to provide MyLifeTracker scores to clients. Each measurement feedback system process had a distinct group of predictors. Perceptions of MyLifeTracker's practicality was the only significant predictor of all three processes. Conclusion: Practically, organisations and supervisors can increase the use of measurement feedback systems through targeted supports.
Collapse
Affiliation(s)
- Benjamin Kwan
- Faculty of Health, University of Canberra, Bruce, ACT, Australia
| | - Debra J Rickwood
- Faculty of Health, University of Canberra, Bruce, ACT, Australia.,Headspace National Youth Mental Health Foundation National Office, Melbourne, VIC, Australia
| | - Patricia M Brown
- Faculty of Health, University of Canberra, Bruce, ACT, Australia
| |
Collapse
|
12
|
Caron EB, Dozier M. Effects of Fidelity-Focused Consultation on Clinicians' Implementation: An Exploratory Multiple Baseline Design. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 46:445-457. [PMID: 30783903 DOI: 10.1007/s10488-019-00924-3] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Identification of effective consultation models could inform implementation efforts. This study examined the effects of a fidelity-focused consultation model among community-based clinicians implementing Attachment and Biobehavioral Catch-up. Fidelity data from 1217 sessions from 7 clinicians were examined in a multiple baseline design. In fidelity-focused consultation, clinicians received feedback from consultants' fidelity coding, and also coded their own fidelity. Clinicians' fidelity increased after fidelity-focused consultation began, but did not increase during other training periods. Fidelity was sustained for 30 months after consultation ended. Findings suggest that consultation procedures involving fidelity coding feedback and self-monitoring of fidelity may promote implementation outcomes.
Collapse
Affiliation(s)
- E B Caron
- Department of Psychiatry, University of Connecticut Health Center, 65 Kane St., Room 2031, West Hartford, CT, 06119, USA.
| | - Mary Dozier
- Department of Psychological and Brain Sciences, University of Delaware, Newark, USA
| |
Collapse
|
13
|
Becker-Haimes EM, Tabachnick AR, Last BS, Stewart RE, Hasan-Granier A, Beidas RS. Evidence Base Update for Brief, Free, and Accessible Youth Mental Health Measures. JOURNAL OF CLINICAL CHILD AND ADOLESCENT PSYCHOLOGY : THE OFFICIAL JOURNAL FOR THE SOCIETY OF CLINICAL CHILD AND ADOLESCENT PSYCHOLOGY, AMERICAN PSYCHOLOGICAL ASSOCIATION, DIVISION 53 2020; 49:1-17. [PMID: 31825683 PMCID: PMC6962529 DOI: 10.1080/15374416.2019.1689824] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.
Collapse
Affiliation(s)
- Emily M. Becker-Haimes
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3 floor, Philadelphia, PA 19104, USA, 215-573-5614
- Hall Mercer Community Mental Health, Philadelphia, PA
| | | | - Briana S. Last
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3 floor, Philadelphia, PA 19104, USA, 215-573-5614
| | - Rebecca E. Stewart
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3 floor, Philadelphia, PA 19104, USA, 215-573-5614
| | - Anisa Hasan-Granier
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3 floor, Philadelphia, PA 19104, USA, 215-573-5614
| | - Rinad S. Beidas
- Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, 3535 Market Street, 3 floor, Philadelphia, PA 19104, USA, 215-573-5614
- Department of Medical Ethics and Health Policy, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA
- Penn Implementation Science Center at the Leonard Davis Institute of Health Economics (PISCE@LDI), University of Pennsylvania
| |
Collapse
|
14
|
Lyon AR, Whitaker K, Richardson LP, French WP, McCauley E. Collaborative Care to Improve Access and Quality in School-Based Behavioral Health. THE JOURNAL OF SCHOOL HEALTH 2019; 89:1013-1023. [PMID: 31612501 DOI: 10.1111/josh.12843] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Revised: 07/27/2018] [Accepted: 08/12/2018] [Indexed: 06/10/2023]
Abstract
BACKGROUND Collaborative care (CC) is a well-established approach for the delivery of accessible behavioral health services in integrated health care settings. Substantial evidence supports its effectiveness in improving the quality and outcomes of adult services, and growing research indicates utility with child and adolescent populations. METHODS To date, studies examining CC models for youth have focused exclusively on primary-care settings. Nevertheless, as the most common integrated service delivery setting for youth, the education sector is an equally important context for improving access to behavioral health services for children and adolescents. RESULTS We provide a narrative review of the literature on CC, describes the relevance of CC to schools, and details its alignment with contemporary movements in education and school-based behavioral health. CONCLUSIONS Potential adaptations of the CC model for use in schools are detailed to improve: (1) behavioral health service accessibility, (2) the capacity of schools to provide behavioral health services, and (3) school service effectiveness through use of evidence-based practices. Although little research has explored the applicability of CC in the education sector, the model holds potential promise to improve the quality and efficiency of school-based behavioral health services.
Collapse
Affiliation(s)
- Aaron R Lyon
- University of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115
| | - Kelly Whitaker
- University of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115
| | - Laura P Richardson
- University of Washington/Seattle Children's Research Institute, 2001 8th Avenue, Suite 400, M/S CW8-6, Seattle, WA, 98121
| | - William P French
- University of Washington, 4800 Sand Point Way NE, M/S OA.5.154, PO Box 5371, Seattle, WA, 98145
| | - Elizabeth McCauley
- University of Washington, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115
| |
Collapse
|
15
|
Multilevel Predictors of Case Managers' Assessment Administration Behavior in a Precursor to a Measurement Feedback System. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2019; 46:636-648. [PMID: 31123867 DOI: 10.1007/s10488-019-00941-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
This study examines factors associated with administration of a treatment monitoring assessment measure (the Ohio Scales) in the context of a precursor to a measurement feedback system in a youth public mental health setting. 82% of all state case managers (N = 46) completed interviews and administered at least one Ohio Scale over a 12-month period. A multi-level model accounting for variance between both case managers and their administrative offices indicated that case manager characteristics (lower self-reported burnout, more experience) and monthly caseload characteristics (fewer active cases, younger average age of youth, and increased time since initial administration) predicted increased monthly administration proportions.
Collapse
|
16
|
Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, Hoffman M, Scott K, Lyon A, Douglas S, Simon G, Kroenke K. Implementing Measurement-Based Care in Behavioral Health: A Review. JAMA Psychiatry 2018; 76:324-335. [PMID: 30566197 PMCID: PMC6584602 DOI: 10.1001/jamapsychiatry.2018.3329] [Citation(s) in RCA: 261] [Impact Index Per Article: 43.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
IMPORTANCE Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up. OBSERVATIONS Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives. CONCLUSIONS AND RELEVANCE This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.
Collapse
Affiliation(s)
- Cara C. Lewis
- Kaiser Permanente Washington Health Research Institute,
Seattle
| | - Meredith Boyd
- Department of Psychology, UCLA (University of California, Los
Angeles)
| | - Ajeng Puspitasari
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester,
Minnesota
| | - Elena Navarro
- Kaiser Permanente Washington Health Research Institute,
Seattle
| | - Jacqueline Howard
- Department of Psychological and Brain Sciences, Indiana University,
Bloomington
| | | | - Mira Hoffman
- Department of Psychology, West Virginia University,
Morgantown
| | - Kelli Scott
- School of Public Health, Brown University, Providence, Rhode
Island
| | - Aaron Lyon
- Department of Psychiatry and Behavioral Sciences, University of
Washington, Seattle
| | - Susan Douglas
- Department of Leadership, Policy and Organizations, Peabody
College, Vanderbilt University, Nashville, Tennessee
| | - Greg Simon
- Kaiser Permanente Washington Health Research Institute,
Seattle
| | | |
Collapse
|
17
|
Bruns EJ, Hook AN, Parker EM, Esposito I, Sather A, Parigoris RM, Lyon AR, Hyde KL. Impact of a Web-Based Electronic Health Record on Behavioral Health Service Delivery for Children and Adolescents: Randomized Controlled Trial. J Med Internet Res 2018; 20:e10197. [PMID: 29903701 PMCID: PMC6024107 DOI: 10.2196/10197] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2018] [Revised: 04/23/2018] [Accepted: 04/24/2018] [Indexed: 01/08/2023] Open
Abstract
Background Electronic health records (EHRs) have been widely proposed as a mechanism for improving health care quality. However, rigorous research on the impact of EHR systems on behavioral health service delivery is scant, especially for children and adolescents. Objective The current study evaluated the usability of an EHR developed to support the implementation of the Wraparound care coordination model for children and youth with complex behavioral health needs, and impact of the EHR on service processes, fidelity, and proximal outcomes. Methods Thirty-four Wraparound facilitators working in two programs in two states were randomized to either use the new EHR (19/34, 56%) or to continue to implement Wraparound services as usual (SAU) using paper-based documentation (15/34, 44%). Key functions of the EHR included standard fields such as youth and family information, diagnoses, assessment data, and progress notes. In addition, there was the maintenance of a coordinated plan of care, progress measurement on strategies and services, communication among team members, and reporting on services, expenditures, and outcomes. All children and youth referred to services for eight months (N=211) were eligible for the study. After excluding those who were ineligible (69/211, 33%) and who declined to participate (59/211, 28%), a total of 83/211 (39%) children and youth were enrolled in the study with 49/211 (23%) in the EHR condition and 34/211 (16%) in the SAU condition. Facilitators serving these youth and families and their supervisors completed measures of EHR usability and appropriateness, supervision processes and activities, work satisfaction, and use of and attitudes toward standardized assessments. Data from facilitators were collected by web survey and, where necessary, by phone interviews. Parents and caregivers completed measures via phone interviews. Related to fidelity and quality of behavioral health care, including Wraparound team climate, working alliance with providers, fidelity to the Wraparound model, and satisfaction with services. Results EHR-assigned facilitators from both sites demonstrated the robust use of the system. Facilitators in the EHR group reported spending significantly more time reviewing client progress (P=.03) in supervision, and less time overall sending reminders to youth/families (P=.04). A trend toward less time on administrative tasks (P=.098) in supervision was also found. Facilitators in both groups reported significantly increased use of measurement-based care strategies overall, which may reflect cross-group contamination (given that randomization of staff to the EHR occurred within agencies and supervisors supervised both types of staff). Although not significant at P<.05, there was a trend (P=.10) toward caregivers in the EHR group reporting poorer shared agreement on tasks on the measure of working alliance with providers. No other significant between-group differences were found. Conclusions Results support the proposal that use of EHR systems can promote the use of client progress data and promote efficiency; however, there was little evidence of any impact (positive or negative) on overall service quality, fidelity, or client satisfaction. The field of children’s behavioral health services would benefit from additional research on EHR systems using designs that include larger sample sizes and longer follow-up periods. Trial Registration ClinicalTrials.gov NCT02421874; https://clinicaltrials.gov/ct2/show/NCT02421874 (Archived by WebCite at http://www.webcitation.org/6yyGPJ3NA)
Collapse
Affiliation(s)
- Eric J Bruns
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | - Alyssa N Hook
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | - Elizabeth M Parker
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | - Isabella Esposito
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | - April Sather
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | - Ryan M Parigoris
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | - Aaron R Lyon
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA, United States
| | | |
Collapse
|
18
|
Lyon AR, Pullmann MD, Dorsey S, Martin P, Grigore AA, Becker EM, Jensen-Doss A. Reliability, Validity, and Factor Structure of the Current Assessment Practice Evaluation-Revised (CAPER) in a National Sample. J Behav Health Serv Res 2018; 46:43-63. [DOI: 10.1007/s11414-018-9621-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
19
|
Livet M, Yannayon M, Sheppard K, Kocher K, Upright J, McMillen J. Exploring Provider Use of a Digital Implementation Support System for School Mental Health: A Pilot Study. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2017; 45:362-380. [PMID: 28993929 DOI: 10.1007/s10488-017-0829-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
This pilot study explored provider use of an online system, Centervention, to support the delivery of empirically supported school-based mental health interventions (ESIs); and associations between components of this system [resources, training, technical assistance (TA), feedback loops], implementation indicators, and student outcomes. Multilevel modeling data were collected from 39 providers implementing ESIs with 758 students. Training, TA, and progress monitoring predicted ESI adherence, and perceived value of resources and TA influenced student responsiveness. Greater adherence was predictive of better socio-emotional outcomes. Interviews with 15 providers illuminated how they used these four Centervention support strategies. Implications for digital implementation support research are discussed.
Collapse
Affiliation(s)
- Melanie Livet
- 3C Institute, 4364 S Alston Ave, Durham, NC, 27713, USA.
| | - Mary Yannayon
- 3C Institute, 4364 S Alston Ave, Durham, NC, 27713, USA
| | - Kelly Sheppard
- University of North Carolina-Chapel Hill, Chapel Hill, NC, 27514, USA
| | - Kelly Kocher
- 3C Institute, 4364 S Alston Ave, Durham, NC, 27713, USA
| | - James Upright
- 3C Institute, 4364 S Alston Ave, Durham, NC, 27713, USA
| | | |
Collapse
|