1
|
Kim B, Petrakis BA, Griesemer I, Sliwinski SK, Midboe AM, Raciborski RA, Byrne TH, Gingell MB, Blue-Howells J, Clark SC, Tsai J, Harvey KLL, McInnes DK. Legal Services for Veterans (LSV): Protocol for evaluating the grant-based LSV initiative supporting community organizations' delivery of legal services to veterans. PLoS One 2024; 19:e0297424. [PMID: 38625878 PMCID: PMC11020365 DOI: 10.1371/journal.pone.0297424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Accepted: 01/05/2024] [Indexed: 04/18/2024] Open
Abstract
BACKGROUND 1.8 million Veterans are estimated to need legal services, such as for housing eviction prevention, discharge upgrades, and state and federal Veterans benefits. While having one's legal needs met is known to improve one's health and its social determinants, many Veterans' legal needs remain unmet. Public Law 116-315 enacted in 2021 authorizes VA to fund legal services for Veterans (LSV) by awarding grants to legal service providers including nonprofit organizations and law schools' legal assistance programs. This congressionally mandated LSV initiative will award grants to about 75 competitively selected entities providing legal services. This paper describes the protocol for evaluating the initiative. The evaluation will fulfill congressional reporting requirements, and inform continued implementation and sustainment of LSV over time. METHODS Our protocol calls for a prospective, mixed-methods observational study with a repeated measures design, aligning to the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) and Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) frameworks. In 2023, competitively selected legal services-providing organizations will be awarded grants to implement LSV. The primary outcome will be the number of Veterans served by LSV in the 12 months after the awarding of the grant. The evaluation has three Aims. Aim 1 will focus on measuring primary and secondary LSV implementation outcomes aligned to RE-AIM. Aim 2 will apply the mixed quantitative-qualitative Matrixed Multiple Case Study method to identify patterns in implementation barriers, enablers, and other i-PARIHS-aligned factors that relate to observed outcomes. Aim 3 involves a mixed-methods economic evaluation to understand the costs and benefits of LSV implementation. DISCUSSION The LSV initiative is a new program that VA is implementing to help Veterans who need legal assistance. To optimize ongoing and future implementation of this program, it is important to rigorously evaluate LSV's outcomes, barriers and enablers, and costs and benefits. We have outlined the protocol for such an evaluation, which will lead to recommending strategies and resource allocation for VA's LSV implementation.
Collapse
Affiliation(s)
- Bo Kim
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, Boston, Massachusetts, United States of America
- Harvard Medical School, Boston, Massachusetts, United States of America
| | - Beth Ann Petrakis
- Center for Healthcare Organization and Implementation Research, VA Bedford Healthcare System, Bedford, Massachusetts, United States of America
| | - Ida Griesemer
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Samantha K. Sliwinski
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - Amanda M. Midboe
- Center for Innovation to Implementation, VA Palo Alto Health Care System, Menlo Park, California, United States of America
- University of California at Davis School of Medicine, Sacramento, California, United States of America
| | - Rebecca A. Raciborski
- Center for Mental Healthcare and Outcomes Research, Central Arkansas Veterans Healthcare System, North Little Rock, Arkansas, United States of America
- Behavioral Health Quality Enhancement Research Initiative, Central Arkansas Veterans Healthcare System, North Little Rock, Arkansas, United States of America
| | - Thomas H. Byrne
- Center for Healthcare Organization and Implementation Research, VA Bedford Healthcare System, Bedford, Massachusetts, United States of America
- Boston University School of Social Work, Boston, Massachusetts, United States of America
| | - Madolyn B. Gingell
- Veterans Health Administration Homeless Programs Office, Washington, District of Columbia, United States of America
| | - Jessica Blue-Howells
- Veterans Health Administration Homeless Programs Office, Washington, District of Columbia, United States of America
| | - Sean C. Clark
- Veterans Health Administration Homeless Programs Office, Washington, District of Columbia, United States of America
| | - Jack Tsai
- Veterans Health Administration Homeless Programs Office, Washington, District of Columbia, United States of America
- University of Texas Health Science Center at Houston, Houston, Texas, United States of America
| | - Kim L. L. Harvey
- Center for Healthcare Organization and Implementation Research, VA Boston Healthcare System, Boston, Massachusetts, United States of America
| | - D. Keith McInnes
- Center for Healthcare Organization and Implementation Research, VA Bedford Healthcare System, Bedford, Massachusetts, United States of America
- Boston University School of Public Health, Boston, Massachusetts, United States of America
| |
Collapse
|
2
|
Painter JT, Raciborski RA, Matthieu MM, Oliver CM, Adkins DA, Garner KK. Engaging stakeholders to retrospectively discern implementation strategies to support program evaluation: Proposed method and case study. Eval Program Plann 2024; 103:102398. [PMID: 38183893 DOI: 10.1016/j.evalprogplan.2023.102398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 05/12/2023] [Accepted: 12/11/2023] [Indexed: 01/08/2024]
Abstract
BACKGROUND Availability of evidence-based practices (EBPs) is critical for improving health care outcomes, but diffusion can be challenging. Implementation activities increase the adoption of EBPs and support sustainability. However, when implementation activities are a part of quality improvement processes, evaluation of the time and cost associated with these activities is challenged by the need for a correct classification of these activities to a known taxonomy of implementation strategies by implementation actors. DESIGN Observational study of a four-stage, stakeholder-engaged process for identifying implementation activities and estimating the associated costs. RESULTS A national initiative in the Veterans Health Administration (VHA) to improve Advance Care Planning (ACP) via Group Visits (ACP-GV) for rural veterans identified 49 potential implementation activities. Evaluators translated and reduced these to 14 strategies used across three groups with the aid of implementation actors. Data were collected to determine the total implementation effort and applied cost estimates to estimate the budget impact of implementation for VHA. LIMITATIONS Recall bias may influence the identification of potential implementation activities. CONCLUSIONS This process improved understanding of the implementation effort and allowed estimation of ACP-GV 's budget impact. IMPLICATIONS A four-stage, stakeholder-engaged methodology can be applied to other initiatives when a pragmatic evaluation of implementation efforts is needed.
Collapse
Affiliation(s)
- Jacob T Painter
- US Department of Veterans Affairs Medical Center, Central Arkansas Veterans Healthcare System, HSR&D Center of Innovation: Center for Mental Healthcare & Outcomes Research, 2200 Fort Roots Drive, North Little Rock, AR 72114, USA; University of Arkansas for Medical Sciences, College of Pharmacy, Division of Pharmaceutical Evaluation & Policy, 4301 W Markham St., Little Rock, AR 72205, USA.
| | - Rebecca A Raciborski
- US Department of Veterans Affairs Medical Center, Central Arkansas Veterans Healthcare System, HSR&D Center of Innovation: Center for Mental Healthcare & Outcomes Research, 2200 Fort Roots Drive, North Little Rock, AR 72114, USA.
| | - Monica M Matthieu
- US Department of Veterans Affairs Medical Center, Central Arkansas Veterans Healthcare System, HSR&D Center of Innovation: Center for Mental Healthcare & Outcomes Research, 2200 Fort Roots Drive, North Little Rock, AR 72114, USA; Saint Louis University, School of Social Work, 3500 Lindell Blvd., Saint Louis, MO 63103, USA.
| | - Ciara M Oliver
- US Department of Veterans Affairs Medical Center, Central Arkansas Veterans Healthcare System, HSR&D Center of Innovation: Center for Mental Healthcare & Outcomes Research, 2200 Fort Roots Drive, North Little Rock, AR 72114, USA.
| | - David A Adkins
- US Department of Veterans Affairs Medical Center, Central Arkansas Veterans Healthcare System, HSR&D Center of Innovation: Center for Mental Healthcare & Outcomes Research, 2200 Fort Roots Drive, North Little Rock, AR 72114, USA.
| | - Kimberly K Garner
- US Department of Veterans Affairs Medical Center, Central Arkansas Veterans Healthcare System, Geriatric Research, Education and Clinical Center, 2200 Fort Roots Drive, North Little Rock, AR 72114, USA; University of Arkansas for Medical Sciences, College of Medicine, Department of Psychiatry, 4301 W Markham St., Little Rock, AR 72205, USA.
| |
Collapse
|
3
|
Raciborski RA, Hamerling-Potts KK, Mitchell EL, Sullivan SR, Kapil-Pair N, Landes SJ, Jager-Hyman S, Goodman M. Cost comparison of in-person and telehealth modalities for a suicide safety planning group intervention: interim results from the "Project Life Force" randomized clinical trial. Front Psychiatry 2023; 14:1215247. [PMID: 37915795 PMCID: PMC10617511 DOI: 10.3389/fpsyt.2023.1215247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 09/05/2023] [Indexed: 11/03/2023] Open
Abstract
Suicide prevention is a clinical priority for the US Veterans Health Administration. Evidence-based interventions, including developing a suicide safety plan, are recommended practices and are becoming more widespread. Adaptations to further augment safety planning include a manualized group intervention (Project Life Force, PLF) that combines safety planning with the teaching of skills to maximize use of the plan. A multi-year randomized controlled trial to test efficacy of PLF compared to treatment as usual is currently in progress. However, approximately a year into the study, in-person groups were converted to telehealth groups due to the COVID-19 pandemic. This study compares the per-veteran cost of PLF when delivered in-person versus by telehealth using preliminary trial data from the first 2.5 years of the trial. Cost to deliver PLF was obtained from the Veterans Health Administration's Managerial Cost Accounting data, which relies on activity-based costing. We found no significant differences in the average number of sessions or average group size between in-person and telehealth. However, the cost per group session was lower for the telehealth modality and this led to significant overall per-veteran savings. While efficacy data comparing from the two arms is still underway and we await the ongoing RCT results, our interim cost analysis highlights potential savings with the telehealth modality.
Collapse
Affiliation(s)
- Rebecca A. Raciborski
- VA Center for Mental Healthcare and Outcomes Research, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States
- Behavioral Health Quality Enhancement Research Initiative (QUERI), Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States
- Evidence, Policy, and Implementation Center, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States
| | - Kyra K. Hamerling-Potts
- VISN 2 Mental Illness, Research, Education, Clinical Center (MIRECC), James J. Peters Veteran Affairs Medical Center, Bronx, NY, United States
| | - Emily L. Mitchell
- VISN 2 Mental Illness, Research, Education, Clinical Center (MIRECC), James J. Peters Veteran Affairs Medical Center, Bronx, NY, United States
- Department of Psychology, The Catholic University of America, Washington, DC, United States
| | - Sarah R. Sullivan
- VISN 2 Mental Illness, Research, Education, Clinical Center (MIRECC), James J. Peters Veteran Affairs Medical Center, Bronx, NY, United States
| | - Nidhi Kapil-Pair
- VISN 2 Mental Illness, Research, Education, Clinical Center (MIRECC), James J. Peters Veteran Affairs Medical Center, Bronx, NY, United States
- Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University Medical Center, New York, NY, United States
| | - Sara J. Landes
- Behavioral Health Quality Enhancement Research Initiative (QUERI), Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States
- Evidence, Policy, and Implementation Center, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States
- Department of Psychiatry, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Shari Jager-Hyman
- Department of Psychiatry, University of Pennsylvania, Philadelphia, PA, United States
| | - Marianne Goodman
- VISN 2 Mental Illness, Research, Education, Clinical Center (MIRECC), James J. Peters Veteran Affairs Medical Center, Bronx, NY, United States
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| |
Collapse
|
4
|
Raciborski RA, Woodward EN, Painter JT. Economic analyses of behavioral health intervention implementation: Perspective on stakeholder engagement. Front Psychiatry 2022; 13:1031325. [PMID: 36620658 PMCID: PMC9815616 DOI: 10.3389/fpsyt.2022.1031325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 11/30/2022] [Indexed: 12/24/2022] Open
Abstract
To provide full potential benefits to patients, behavioral health interventions often require comprehensive and systematic implementation efforts. The costs of these efforts should therefore be included when organizations decide to fund or adopt a new intervention. However, existing guidelines for conducting economic analyses like cost-effectiveness analyses and budget impact analyses are not well-suited to the complexity of the behavioral healthcare pathway and its many stakeholders. Stakeholder engagement, when used effectively with recent innovations in economic analysis, advance more equitable access to interventions for individuals living with behavioral health conditions. But early and ongoing stakeholder engagement has not yet been incorporated into best-practice guidelines for economic evaluation. We discuss our perspective, as researchers and clinicians in a large integrated health system, on how the integration of stakeholder engagement with existing economic analysis methods could improve decision-making about implementation of behavioral health interventions.
Collapse
Affiliation(s)
- Rebecca A Raciborski
- VA Center for Mental Healthcare and Outcomes Research, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States.,Evidence, Policy, and Implementation Center, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States
| | - Eva N Woodward
- VA Center for Mental Healthcare and Outcomes Research, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States.,Department of Psychiatry, College of Medicine, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Jacob T Painter
- VA Center for Mental Healthcare and Outcomes Research, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States.,Evidence, Policy, and Implementation Center, Central Arkansas Veterans Healthcare System, North Little Rock, AR, United States.,Division of Pharmaceutical Evaluation and Policy, College of Pharmacy, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| |
Collapse
|