1
|
Wright B, González I, Chen M, Aarons GA, Hunter SB, Godley MD, Purtle J, Dopp AR. Multi-level alignment processes in the sustainment of a youth substance use treatment model following a federal implementation initiative: A mixed method study. JOURNAL OF SUBSTANCE USE AND ADDICTION TREATMENT 2024:209445. [PMID: 38960147 DOI: 10.1016/j.josat.2024.209445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 05/30/2024] [Accepted: 06/26/2024] [Indexed: 07/05/2024]
Abstract
INTRODUCTION Government agencies have identified evidence-based practice (EBP) dissemination as a pathway to high-quality behavioral health care for youth. However, gaps remain about how to best sustain EBPs in treatment organizations in the U.S., especially in resource-constrained settings like publicly-funded youth substance use services. One important, but understudied, determinant of EBP sustainment is alignment: the extent to which multi-level factors that influence sustainment processes and outcomes are congruent, consistent, and/or coordinated. This study examined the role of alignment in U.S. states' efforts to sustain the Adolescent Community Reinforcement Approach (A-CRA), an EBP for youth substance use disorders, during the COVID-19 pandemic. METHODS In this mixed methods study, the qualitative investigation preceded and informed the quantitative investigation. We interviewed state administrators and providers (i.e., supervisors and clinicians) from 15 states that had completed a federal A-CRA implementation grant; providers also completed surveys. The sample included 50 providers from 35 treatment organizations that reported sustaining A-CRA when the COVID-19 pandemic began, and 20 state administrators. In qualitative thematic analyses, we applied the EPIS (Exploration, Preparation, Implementation, Sustainment) framework to characterize alignment processes that interviewees described as influential on sustainment. We then used survey items to quantitatively explore the associations described in qualitative themes, using bivariate linear regressions. RESULTS At the time of interview, staff from 80 % of the treatment organizations (n = 28), reported sustaining A-CRA. Providers from both sustainer and non-sustainer organizations, as well as state administrators, described major sources of misalignment when state agencies ceased technical assistance post-grant, and because limited staff capacity conflicted with A-CRA's training model, which was perceived as time-intensive. Participants described the pandemic as exacerbating preexisting challenges, including capacity issues. Sustainer organizations reported seeking new funding to help sustain A-CRA. Quantitative associations between self-rated extent of sustainment and other survey items mostly followed the pattern predicted from the qualitative findings. CONCLUSIONS The COVID-19 pandemic amplified longstanding A-CRA sustainment challenges, but treatment organizations already successfully sustaining A-CRA pre-pandemic largely continued. There are missed opportunities for state-level actors to coordinate with providers on the shared goal of EBP sustainment. A greater focus on alignment processes in research and practice could help states and providers strengthen sustainability planning.
Collapse
Affiliation(s)
- Blanche Wright
- Department of Psychology, University of Oregon, Eugene, OR, United States of America; RAND, Santa Monica, CA, United States of America.
| | - Isabelle González
- Department of Psychology, Georgetown University, Washington, DC, United States of America
| | - Monica Chen
- RAND, Santa Monica, CA, United States of America; Department of Psychology, University of California Los Angeles, Los Angeles, CA, United States of America
| | - Gregory A Aarons
- Department of Psychiatry and Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center, University of California San Diego, La Jolla, CA, United States of America
| | | | - Mark D Godley
- Chestnut Health Systems, Normal, IL, United States of America
| | - Jonathan Purtle
- Department of Public Health Policy & Management and Global Center for Implementation Science, New York University School of Global Public Health, New York, NY, United States of America
| | - Alex R Dopp
- RAND, Santa Monica, CA, United States of America
| |
Collapse
|
2
|
Purtle J, Stadnick NA, Wynecoop M, Walker SC, Bruns EJ, Aarons GA. A Tale of Two Taxes: Implementation of Earmarked Taxes for Behavioral Health Services in California and Washington State. Psychiatr Serv 2024; 75:410-418. [PMID: 37933132 PMCID: PMC11139541 DOI: 10.1176/appi.ps.20230257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/08/2023]
Abstract
OBJECTIVE The authors sought to characterize perceptions of the impacts, attributes, and support for taxes earmarked for behavioral health services and to compare perceptions of the taxes among professionals in California and Washington, two states differing in earmarked tax designs. METHODS Surveys were completed by 155 public agency and community organization professionals involved in tax implementation in California (N=87) and Washington State (N=68) during 2022-2023 (29% response rate). Respondents indicated their perceptions of the taxes' impacts, attributes, and support. Responses were summed as aggregate scores and were also analyzed as individual items. Bivariate analyses were used to compare responses of professionals in California versus Washington State. RESULTS Earmarked taxes were generally regarded positively. Of the respondents, >80% strongly agreed that the taxes increased funding for services and were helpful, and only 10% strongly agreed that the taxes decreased behavioral health funding from other sources. Substantially more respondents in California than in Washington State strongly agreed that taxes' reporting requirements were complicated (45% vs. 5%, p<0.001) and that the taxes increased unjustified scrutiny of services or systems (33% vs. 2%, p<0.001). However, more respondents in California than in Washington State also strongly agreed that the taxes increased public awareness about behavioral health (56% vs. 15%, p<0.001) and decreased behavioral health stigma (47% vs. 14%, p<0.001). CONCLUSIONS Perceptions of the strengths and weaknesses of taxes earmarked for behavioral health services may vary by design features of the tax. Such features include stigma-reduction initiatives and tax spending and reporting requirements.
Collapse
Affiliation(s)
- Jonathan Purtle
- Global Center for Implementation Science, Department of Public Health Policy and Management, New York University School of Global Public Health, New York City (Purtle, Wynecoop); Dissemination and Implementation Science Center, Department of Psychiatry, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla (Stadnick, Aarons); Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle (Walker, Bruns)
| | - Nicole A Stadnick
- Global Center for Implementation Science, Department of Public Health Policy and Management, New York University School of Global Public Health, New York City (Purtle, Wynecoop); Dissemination and Implementation Science Center, Department of Psychiatry, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla (Stadnick, Aarons); Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle (Walker, Bruns)
| | - Megan Wynecoop
- Global Center for Implementation Science, Department of Public Health Policy and Management, New York University School of Global Public Health, New York City (Purtle, Wynecoop); Dissemination and Implementation Science Center, Department of Psychiatry, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla (Stadnick, Aarons); Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle (Walker, Bruns)
| | - Sarah C Walker
- Global Center for Implementation Science, Department of Public Health Policy and Management, New York University School of Global Public Health, New York City (Purtle, Wynecoop); Dissemination and Implementation Science Center, Department of Psychiatry, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla (Stadnick, Aarons); Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle (Walker, Bruns)
| | - Eric J Bruns
- Global Center for Implementation Science, Department of Public Health Policy and Management, New York University School of Global Public Health, New York City (Purtle, Wynecoop); Dissemination and Implementation Science Center, Department of Psychiatry, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla (Stadnick, Aarons); Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle (Walker, Bruns)
| | - Gregory A Aarons
- Global Center for Implementation Science, Department of Public Health Policy and Management, New York University School of Global Public Health, New York City (Purtle, Wynecoop); Dissemination and Implementation Science Center, Department of Psychiatry, Altman Clinical and Translational Research Institute, University of California, San Diego, La Jolla (Stadnick, Aarons); Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle (Walker, Bruns)
| |
Collapse
|
3
|
Dopp AR, North MN, Gilbert M, Ringel JS, Silovsky JF, Blythe M, Edwards D, Schmidt S, Funderburk B. Pilot evaluation of the Fiscal Mapping Process for sustainable financing of evidence-based youth mental health treatments: A comparative case study analysis. IMPLEMENTATION RESEARCH AND PRACTICE 2024; 5:26334895241249394. [PMID: 38737584 PMCID: PMC11084999 DOI: 10.1177/26334895241249394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2024] Open
Abstract
Background Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies. Supports are needed that can guide service agencies in accessing sustainable funding for EBTs. We conducted a pilot evaluation of the Fiscal Mapping Process, an Excel-based strategic planning tool that helps service agency leaders identify and coordinate financing strategies for their EBT programs. Method Pilot testing of the Fiscal Mapping Process was completed with 10 youth mental health service agencies over a 12-month period, using trauma-focused cognitive-behavioral therapy or parent-child interaction therapy programs. Service agency representatives received initial training and monthly coaching in using the tool. We used case study methods to synthesize all available data (surveys, focus groups, coaching notes, document review) and contrast agency experiences to identify key findings through explanation building. Results Key evaluation findings related to the process and outcomes of using the Fiscal Mapping Process, as well as contextual influences. Process evaluation findings helped clarify the primary use case for the tool and identified the importance-and challenges-of engaging external collaborators. Outcome evaluation findings documented the impacts of the Fiscal Mapping Process on agency-reported sustainment capacities (strategic planning, funding stability), which fully explained reported improvements in outcomes (extent and likelihood)-although these impacts were incremental. Findings on contextual factors documented the influence of environmental and organizational capacities on engagement with the tool and concerns about equitable impacts, but also the view that the process could usefully generalize to other EBTs. Conclusions Our pilot evaluation of the Fiscal Mapping Process was promising. In future work, we plan to integrate the tool into EBT implementation initiatives and test its impact on long-term sustainment outcomes across various EBTs, while increasing attention to equity considerations.
Collapse
Affiliation(s)
| | | | | | | | - Jane F. Silovsky
- Department of Pediatrics, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Mellicent Blythe
- North Carolina Child Treatment Program, Center for Child and Family Health, Durham, NC, USA
- School of Social Work, University North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | | | - Susan Schmidt
- Department of Pediatrics, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Beverly Funderburk
- Department of Pediatrics, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| |
Collapse
|
4
|
North MN, Dopp AR, Silovsky JF, Gilbert M, Ringel JS. Perspectives on Financing Strategies for Evidence-Based Treatment Implementation in Youth Mental Health Systems. THE JOURNAL OF MENTAL HEALTH POLICY AND ECONOMICS 2023; 26:115-190. [PMID: 37772508 PMCID: PMC10947519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 07/11/2023] [Indexed: 09/30/2023]
Abstract
BACKGROUND Evidence-based treatments (EBTs) are critical to effectively address mental health problems among children and adolescents, but costly for mental health service agencies to implement and sustain. Financing strategies help agencies overcome cost-related barriers by obtaining financial resources to support EBT implementation and/or sustainment. AIMS We sought to (i) understand how youth mental health system decision-makers involved with EBT implementation and sustainment view key features (e.g., relevance, feasibility) that inform financing strategy selection and (ii) compare service agency, funding agency, and intermediary representative perspectives. METHOD Two surveys were disseminated to 48 representatives across U.S. youth mental health service agencies, funding agencies, and intermediaries who were participating in a larger study of financing strategies. Quantitative and qualitative data were gathered on 23 financing strategies through quantitative ratings and open-ended responses. Data were analyzed using descriptive statistics and rapid content analysis. RESULTS The financing strategies rated as most relevant include braided funding streams, contracts for EBTs, credentialing/rostering providers, fee-for-service reimbursement (regular and increased), and grant funding. All other strategies were unfamiliar to 1/3 to 1/2 of participants. The six strategies were rated between somewhat and quite available, feasible, and effective for EBT sustainment. For sustaining different EBT components (e.g., delivery, materials), the mix of financing strategies was rated as somewhat adequate. Qualitative analysis revealed challenges with strategies being non-recurring or unavailable in representatives' regions. Ratings were largely similar across participant roles, though funding agency representatives were the most familiar with financing strategies. DISCUSSION Despite the breadth of innovative financing strategies, expert representatives within the youth mental health services ecosystem had limited knowledge of most options. Experts relied on strategies that were familiar but often did not adequately support EBT implementation or sustainment. These findings underscore more fundamental issues with under-resourced mental health systems in the U.S.; financing strategies can help agencies navigate EBT use but must be accompanied by larger-scale system reforms. Limitations include difficulties generalizing results due to using a small sample familiar with EBTs, high agreement as a potential function of snowball recruiting, and limited responses to the open-ended survey questions. IMPLICATIONS FOR HEALTH CARE PROVISION AND USE Although EBTs have been found to effectively address mental health problems in children and adolescents, available strategies for financing their implementation and sustainment in mental health systems are insufficient. This constraint prevents many children and adolescents from receiving high-quality services. IMPLICATIONS FOR HEALTH POLICIES Financing strategies alone cannot solve systematic issues that prevent youth mental health service agencies from providing EBTs. Policy changes may be required, such as increased financial investment from the U.S. government into mental health services to support basic infrastructure (e.g., facility operations, measuring outcomes). IMPLICATIONS FOR FURTHER RESEARCH Future work should examine expert perspectives on EBT financing strategies in different contexts (e.g., substance use services), gathering targeted feedback on financing strategies that are less well known, and exploring topics such as strategic planning, funding stability, and collaborative decision-making as they relate to EBT implementation and sustainment.
Collapse
Affiliation(s)
| | - Alex R Dopp
- RAND Corporation, 1776 Main Street, Santa Monica, CA, 90401, USA,
| | | | | | | |
Collapse
|
5
|
Purtle J, Stadnick NA, Wynecoop M, Bruns EJ, Crane ME, Aarons G. A policy implementation study of earmarked taxes for mental health services: study protocol. Implement Sci Commun 2023; 4:37. [PMID: 37004117 PMCID: PMC10067193 DOI: 10.1186/s43058-023-00408-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 03/05/2023] [Indexed: 04/03/2023] Open
Abstract
BACKGROUND Insufficient funding is frequently identified as a critical barrier to the implementation and sustainment of evidence-based practices (EBPs). Thus, increasing access to funding is recognized as an implementation strategy. Policies that create earmarked taxes-defined as taxes for which revenue can only be spent on specific activities-are an increasingly common mental health financing strategy that could improve the reach of EBPs. This project's specific aims are to (1) identify all jurisdictions in the USA that have implemented earmarked taxes for mental health and catalogue information about tax design; (2) characterize experiences implementing earmarked taxes among local (e.g., county, city) mental health agency leaders and other government and community organization officials and assess their perceptions of the acceptability and feasibility of different types of policy implementation strategies; and (3) develop a framework to guide effect earmarked tax designs, inform the selection of implementation strategies, and disseminate the framework to policy audiences. METHODS The project uses the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to inform data collection about the determinants and processes of tax implementation and Leeman's typology of implementation strategies to examine the acceptability and feasibility strategies which could support earmarked tax policy implementation. A legal mapping will be conducted to achieve aim 1. To achieve aim 2, a survey will be conducted of 300 local mental health agency leaders and other government and community organization officials involved with the implementation of earmarked taxes for mental health. The survey will be followed by approximately 50 interviews with these officials. To achieve aim 3, quantitative and qualitative data will be integrated through a systematic framework development and dissemination process. DISCUSSION This exploratory policy implementation process study will build the evidence base for outer-context implementation determinants and strategies by focusing on policies that earmarked taxes for mental health services.
Collapse
Affiliation(s)
- Jonathan Purtle
- Department of Public Health Policy & Management, Global Center for Implementation Science, New York University School of Global Public Health, 708, Broadway, New York, NY, 10003, USA.
| | - Nicole A Stadnick
- Department of Psychiatry, Dissemination and Implementation Science Center, Altman Clinical and Translational Research Institute, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA
| | - Megan Wynecoop
- Department of Public Health Policy & Management, Global Center for Implementation Science, New York University School of Global Public Health, 708, Broadway, New York, NY, 10003, USA
| | - Eric J Bruns
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, 6200 NE 74Th St, Building 29, Suite 110, Seattle, WA, 98115, USA
| | - Margaret E Crane
- Department of Psychology, Temple University, Weiss Hall, 1701 N 13Th St, Philadelphia, PA, 19122, USA
- Department of Psychiatry, New York Presbyterian-Weill Cornell Medicine, 425 E 61St St, New York, NY, 10065, USA
| | - Gregory Aarons
- Department of Psychiatry, Dissemination and Implementation Science Center, Altman Clinical and Translational Research Institute, University of California San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA
| |
Collapse
|
6
|
Dopp AR, Gilbert M, Silovsky J, Ringel JS, Schmidt S, Funderburk B, Jorgensen A, Powell BJ, Luke DA, Mandell D, Edwards D, Blythe M, Hagele D. Coordination of sustainable financing for evidence-based youth mental health treatments: protocol for development and evaluation of the fiscal mapping process. Implement Sci Commun 2022; 3:1. [PMID: 34983689 PMCID: PMC8724666 DOI: 10.1186/s43058-021-00234-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Accepted: 11/01/2021] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Sustained delivery of evidence-based treatments (EBTs) is essential to addressing the public health and economic impacts of youth mental health problems, but is complicated by the limited and fragmented funding available to youth mental health service agencies (hereafter, "service agencies"). Strategic planning tools are needed that can guide these service agencies in their coordination of sustainable funding for EBTs. This protocol describes a mixed-methods research project designed to (1) develop and (2) evaluate our novel fiscal mapping process that guides strategic planning efforts to finance the sustainment of EBTs in youth mental health services. METHOD Participants will be 48 expert stakeholder participants, including representatives from ten service agencies and their partners from funding agencies (various public and private sources) and intermediary organizations (which provide guidance and support on the delivery of specific EBTs). Aim 1 is to develop the fiscal mapping process: a multi-step, structured tool that guides service agencies in selecting the optimal combination of strategies for financing their EBT sustainment efforts. We will adapt the fiscal mapping process from an established intervention mapping process and will incorporate an existing compilation of 23 financing strategies. We will then engage participants in a modified Delphi exercise to achieve consensus on the fiscal mapping process steps and gather information that can inform the selection of strategies. Aim 2 is to evaluate preliminary impacts of the fiscal mapping process on service agencies' EBT sustainment capacities (i.e., structures and processes that support sustainment) and outcomes (e.g., intentions to sustain). The ten agencies will pilot test the fiscal mapping process. We will evaluate how the fiscal mapping process impacts EBT sustainment capacities and outcomes using a comparative case study approach, incorporating data from focus groups and document review. After pilot testing, the stakeholder participants will conceptualize the process and outcomes of fiscal mapping in a participatory modeling exercise to help inform future use and evaluation of the tool. DISCUSSION This project will generate the fiscal mapping process, which will facilitate the coordination of an array of financing strategies to sustain EBTs in community youth mental health services. This tool will promote the sustainment of youth-focused EBTs.
Collapse
Affiliation(s)
- Alex R Dopp
- Department of Behavioral and Policy Sciences, RAND Corporation, 1776 Main Street, Santa Monica, CA, 90401, USA.
| | - Marylou Gilbert
- Department of Behavioral and Policy Sciences, RAND Corporation, 1776 Main Street, Santa Monica, CA, 90401, USA
| | - Jane Silovsky
- Department of Pediatrics, Division of Developmental and Behavioral Pediatrics, University of Oklahoma Health Sciences Center, 940 NE 13th Street Suite 4900, Oklahoma City, OK, 73104, USA
| | - Jeanne S Ringel
- Department of Economics, Sociology, and Statistics, RAND Corporation, 1776 Main Street, Santa Monica, CA, 90401, USA
| | - Susan Schmidt
- Department of Pediatrics, Division of Developmental and Behavioral Pediatrics, University of Oklahoma Health Sciences Center, 940 NE 13th Street Suite 4900, Oklahoma City, OK, 73104, USA
| | - Beverly Funderburk
- Department of Pediatrics, Division of Developmental and Behavioral Pediatrics, University of Oklahoma Health Sciences Center, 940 NE 13th Street Suite 4900, Oklahoma City, OK, 73104, USA
| | - Ashley Jorgensen
- Department of Pediatrics, Division of Developmental and Behavioral Pediatrics, University of Oklahoma Health Sciences Center, 940 NE 13th Street Suite 4900, Oklahoma City, OK, 73104, USA
| | - Byron J Powell
- Center for Mental Health Services Research, Brown School and School of Medicine, Washington University, Campus Box 1196, One Brookings Drive, St. Louis, MO, 63130, USA
| | - Douglas A Luke
- Brown School, Washington University, Campus Box 1196, One Brookings Drive, St. Louis, MO, 63130, USA
| | - David Mandell
- Department of Psychiatry, University of Pennsylvania, 3535 Market Street, 3rd Fl., Philadelphia, PA, 19104, USA
| | - Daniel Edwards
- Evidence-Based Associates, 1311 Delaware Ave, Suite 637, Washington, DC, 20024, USA
| | - Mellicent Blythe
- NC Child Treatment Program c/o Center for Child and Family Health, 1121 W, Chapel Hill St. Ste. 100, Durham, NC, 27701, USA
| | - Dana Hagele
- NC Child Treatment Program c/o Center for Child and Family Health, 1121 W, Chapel Hill St. Ste. 100, Durham, NC, 27701, USA
| |
Collapse
|
7
|
Lui JHL, Brookman-Frazee L, Lind T, Le K, Roesch S, Aarons GA, Innes-Gomberg D, Pesanti K, Lau AS. Outer-context determinants in the sustainment phase of a reimbursement-driven implementation of evidence-based practices in children's mental health services. Implement Sci 2021; 16:82. [PMID: 34412666 PMCID: PMC8375074 DOI: 10.1186/s13012-021-01149-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 08/04/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Although there is increasing investment to implement evidence-based practices (EBPs) in public systems across the USA, continued or sustained use of EBPs after initial implementation remains a challenge. The low integration of EBPs in routine practice severely limits their public health impact, highlighting the need to understand factors that affect the return on costly investments in EBP implementation. This study aims to (1) characterize trajectories of EBP delivery volume through a reimbursement-driven implementation and (2) examine impacts of system-level policy regulatory activity and state-level mental health services funding on the implementation reimbursement strategy. METHODS This study involved secondary data analyses. Psychotherapy administrative claims and regulatory site visit data from the Los Angeles County Department of Mental Health and California state mental health expenditures were extracted from 2010 to 2017. Multilevel regression examined EBP claims volume over time with state expenditures and regulatory compliance as predictors. RESULTS EBP claims volume trajectories demonstrated a rapid initial increase, followed by a period of decrease, and a small increase in the final year. State mental health expenditures increased across time reflecting increased funding availability. State mental health expenditures and system regulatory compliance were inversely related to EBP claims volume. CONCLUSIONS The impact of reimbursement-driven EBP implementation strategy is sensitive to multiple outer-context determinants. At the system level, commitment to fidelity of implementation regulations resulted in reduced use of the reimbursement strategy. Alternative reimbursement streams not tied to EBPs coupled with an expanded array of reimbursable services also impacted the use of the reimbursement strategy to implement EBPs.
Collapse
Affiliation(s)
- Joyce H L Lui
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA.
- Department of Psychology, University of Maryland, College Park, College Park, MD, USA.
| | - Lauren Brookman-Frazee
- Department of Psychiatry, University of California, San Diego, San Diego, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | - Teresa Lind
- Department of Psychiatry, University of California, San Diego, San Diego, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | - Kenny Le
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| | - Scott Roesch
- Child and Adolescent Services Research Center, San Diego, CA, USA
- Department of Psychology, San Diego State University, San Diego, CA, USA
| | - Gregory A Aarons
- Department of Psychiatry, University of California, San Diego, San Diego, CA, USA
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | | | - Keri Pesanti
- Los Angeles County Department of Mental Health, Los Angeles, CA, USA
| | - Anna S Lau
- Department of Psychology, University of California, Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
8
|
Snell-Rood C, Jaramillo ET, Hamilton AB, Raskin SE, Nicosia FM, Willging C. Advancing health equity through a theoretically critical implementation science. Transl Behav Med 2021; 11:1617-1625. [PMID: 33904908 PMCID: PMC8367016 DOI: 10.1093/tbm/ibab008] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022] Open
Abstract
While implementation science is driven by theory, most implementation science theories, models, and frameworks (TMF) do not address issues of power, inequality, and reflexivity that are pivotal to achieving health equity. Theories used in anthropology address these issues effectively and could complement prevailing implementation science theories and constructs. We propose three broad areas of theory that complement and extend existing TMF in implementation science to advance health equity. First, theories of postcoloniality and reflexivity foreground attention to the role of power in knowledge production and to the ways that researchers and interventionists may perpetuate the inequalities shaping health. Second, theories of structural violence and intersectionality can help us to better understand the unequal burden of health disparities in the population, thereby encouraging researchers to think beyond single interventions to initiate partnerships that can impact overlapping health vulnerabilities and influence the upstream causes of vulnerability. Finally, theories of policy and governance encourage us to examine the social-political forces of the "outer context" crucial for implementation and sustainability. The incorporation of critical theories could enhance implementation science and foster necessary reflexivity among implementation scientists. We contend that a theoretically critical implementation science will promote better science and, more importantly, support progress toward health equity.
Collapse
Affiliation(s)
- Claire Snell-Rood
- School of Public Health, University of California Berkeley, Berkeley, CA, USA
| | - Elise Trott Jaramillo
- Behavioral Health Research Center of the Southwest, Pacific Institute for Research and Evaluation, UNM Science and Technology Park, Albuquerque, NM, USA
| | - Alison B Hamilton
- VA Center for the Study of Healthcare Innovation, Implementation and Policy, VA Greater Los Angeles Healthcare System, and Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA
| | - Sarah E Raskin
- L. Douglas Wilder School of Government and Public Affairs, Virginia Commonwealth University, Richmond, VA, USA
| | - Francesca M Nicosia
- Institute for Health & Aging, University of California, Integrative Health, San Francisco VA Health Care System, San Francisco, CA, USA
| | - Cathleen Willging
- Behavioral Health Research Center of the Southwest, Pacific Institute for Research and Evaluation, UNM Science and Technology Park, Albuquerque, NM, USA
| |
Collapse
|
9
|
Dopp AR, Kerns SEU, Panattoni L, Ringel JS, Eisenberg D, Powell BJ, Low R, Raghavan R. Translating economic evaluations into financing strategies for implementing evidence-based practices. Implement Sci 2021; 16:66. [PMID: 34187520 PMCID: PMC8240424 DOI: 10.1186/s13012-021-01137-9] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Accepted: 06/10/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Implementation researchers are increasingly using economic evaluation to explore the benefits produced by implementing evidence-based practices (EBPs) in healthcare settings. However, the findings of typical economic evaluations (e.g., based on clinical trials) are rarely sufficient to inform decisions about how health service organizations and policymakers should finance investments in EBPs. This paper describes how economic evaluations can be translated into policy and practice through complementary research on financing strategies that support EBP implementation and sustainment. MAIN BODY We provide an overview of EBP implementation financing, which outlines key financing and health service delivery system stakeholders and their points of decision-making. We then illustrate how economic evaluations have informed decisions about EBP implementation and sustainment with three case examples: (1) use of Pay-for-Success financing to implement multisystemic therapy in underserved areas of Colorado, USA, based in part on the strength of evidence from economic evaluations; (2) an alternative payment model to sustain evidence-based oncology care, developed by the US Centers for Medicare and Medicaid Services through simulations of economic impact; and (3) use of a recently developed fiscal mapping process to collaboratively match financing strategies and needs during a pragmatic clinical trial for a newly adapted family support intervention for opioid use disorder. CONCLUSIONS EBP financing strategies can help overcome cost-related barriers to implementing and sustaining EBPs by translating economic evaluation results into policy and practice. We present a research agenda to advance understanding of financing strategies in five key areas raised by our case examples: (1) maximize the relevance of economic evaluations for real-world EBP implementation; (2) study ongoing changes in financing systems as part of economic evaluations; (3) identify the conditions under which a given financing strategy is most beneficial; (4) explore the use and impacts of financing strategies across pre-implementation, active implementation, and sustainment phases; and (5) advance research efforts through strong partnerships with stakeholder groups while attending to issues of power imbalance and transparency. Attention to these research areas will develop a robust body of scholarship around EBP financing strategies and, ultimately, enable greater public health impacts of EBPs.
Collapse
Affiliation(s)
- Alex R Dopp
- Department of Behavioral and Policy Sciences, RAND Corporation, 1776 Main Street, Santa Monica, CA, 90401, USA.
| | - Suzanne E U Kerns
- Graduate School of Social Work, University of Denver, Craig Hall, 2148 South High St, Denver, 80208, CO, USA
- The Kempe Center for the Prevention and Treatment of Child Abuse and Neglect, University of Colorado, 13123 E 16th Ave, Aurora, CO, 80045, USA
| | - Laura Panattoni
- Hutchinson Institute for Cancer Outcomes Research, Fred Hutchinson Cancer Research Center, 1100 Fairview Ave N, Seattle, WA, 98109, USA
| | - Jeanne S Ringel
- Department of Economics, Sociology, and Statistics, RAND Corporation, 1776 Main Street, Santa Monica, CA, 90401, USA
| | - Daniel Eisenberg
- Fielding School of Public Health, University of California Los Angeles, 650 Charles E Young Dr S, Los Angeles, CA, 90095, USA
- Department of Psychiatry and Behavioral Sciences, University of California Los Angeles, 757 Westwood Plaza #4, Los Angeles, CA, 90095, USA
| | - Byron J Powell
- Brown School and School of Medicine, Washington University in St. Louis, Campus Box 1196, One Brookings Drive, St. Louis, MO, 63130, USA
| | - Roger Low
- America Forward, 1400 Eye St. NW, Suite 900, Washington, DC, 20005, USA
| | - Ramesh Raghavan
- Silver School of Social Work, New York University, 1 Washington Square North, Room 301, New York, NY, 10003, USA
| |
Collapse
|
10
|
Hatch MR, Carandang K, Moullin JC, Ehrhart MG, Aarons GA. Barriers to Implementing Motivational Interviewing in Addiction Treatment: A Nominal Group Technique Process Evaluation. IMPLEMENTATION RESEARCH AND PRACTICE 2021; 2. [PMID: 35211677 DOI: 10.1177/26334895211018400] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Background The successful implementation of evidence-based practices (EBPs) in real-world settings requires an adaptive approach and ongoing process evaluation and tailoring. Although conducting a needs assessment during the preparation phase of implementation is beneficial, it is challenging to predict all barriers to EBP implementation that may arise over the course of implementation and sustainment. This article describes a process evaluation that identified emergent and persistent barriers that impacted the implementation of an EBP across multiple behavioral health organizations and clinics. Methods This study was conducted during the first cohort of a cluster randomized controlled trial testing the effectiveness of the Leadership and Organizational Change for Implementation (LOCI) strategy to implement motivational interviewing (MI) in substance use disorder treatment agencies and clinics. We used a modified nominal group technique (NGT) in which clinic leaders identified barriers faced during the implementation process. Barriers were categorized, then ranked and rated according to leaders' perceptions of each barrier's influence on implementation. The barriers were then contextualized through individual qualitative interviews. Results Fifteen barriers were identified, grouped into staff-level barriers, management-level barriers, and implementation program barriers. Time and resistance to MI were rated as the most influential staff-level barriers. Among management-level barriers, time was also rated highest, followed by turnover and external contractual constraints. The most influential implementation barrier was client apprehension of recording for fidelity assessment and feedback. Individual interviews supported these findings and provided suggested adaptations for future implementation efforts. Conclusion EBP implementation is an ongoing process whereby implementation strategies must be proactively and strategically tailored to address emergent barriers. This research described a process evaluation that was used to identify 15 emergent and/or persistent barriers related to staff, management, and the implementation program. Using implementation strategies that can be tailored and/or adapted to such emergent barriers is critical to implementation effectiveness.
Collapse
Affiliation(s)
- Mellissa R Hatch
- Center for Alcohol and Addiction Studies, Brown University School of Public Health, Providence, RI, USA
| | | | - Joanna C Moullin
- Child and Adolescent Services Research Center, San Diego, CA, USA
| | - Mark G Ehrhart
- Department of Psychology, University of Central Florida, Orlando, FL, USA
| | - Gregory A Aarons
- Child and Adolescent Services Research Center, San Diego, CA, USA
| |
Collapse
|
11
|
Mundey P, Slemaker A, Dopp AR, Beasley LO, Silovsky JF. Sustaining Treatment for Youth with Problematic Sexual Behavior: Administrator and Stakeholder Perspectives Following Implementation. J Behav Health Serv Res 2020; 48:410-426. [PMID: 32893323 DOI: 10.1007/s11414-020-09726-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
This study examines administrator and stakeholder perspectives on factors influencing the sustainability of Problematic Sexual Behavior Cognitive Behavioral Therapy (PSB-CBT). After initial implementation of PSB-CBT, qualitative interviews (N = 42) on the sustainability of services were conducted with treatment program administrators (n = 10) and community stakeholders (n = 32) from six sites across the USA. Interviewees discussed key facilitators and barriers for sustainability and identified the following factors as impacting the sustainability of PSB-CBT: public relations, policy, inter-agency collaboration, funding, and workforce issues. Results were overall consistent with the EPIS (Exploration, Preparation, Implementation, Sustainment) model for implementation in public service sectors, but proposed modifications are also noted. Findings underscore the value of qualitative research in identifying best practices for sustaining valuable therapeutic interventions. The authors argue that future efforts to sustain evidence-based interventions, especially those dealing with sensitive topics around which misinformation and stigma are associated, should prioritize public relations (i.e., outreach, education) in addition to the intervention.
Collapse
Affiliation(s)
- Peter Mundey
- Department of Social & Behavioral Sciences, Savannah State University, 3219 College St, Savannah, GA, 31404, USA.
| | - Alexandra Slemaker
- Department of Sociology, Iowa State University, 510 Farm House Lane 103 East Hall, Ames, IA, USA
| | - Alex R Dopp
- RAND Corporation, 1776 Main Street, Santa Monica, CA, USA
| | - Lana O Beasley
- Department of Human Development and Family Science, Oklahoma State University, Stillwater, OK, 74078, USA
| | - Jane F Silovsky
- Department of Pediatrics, University of Oklahoma Health Sciences Center, Nicholson Tower, Suite 4900, Oklahoma City, OK, USA
| |
Collapse
|
12
|
Powell BJ, Patel SV, Haley AD, Haines ER, Knocke KE, Chandler S, Katz CC, Seifert HP, Ake G, Amaya-Jackson L, Aarons GA. Determinants of Implementing Evidence-Based Trauma-Focused Interventions for Children and Youth: A Systematic Review. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 47:705-719. [PMID: 31813066 PMCID: PMC7275881 DOI: 10.1007/s10488-019-01003-3] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
A systematic review was conducted to identify determinants (barriers and facilitators) of implementing evidence-based psychosocial interventions for children and youth who experience emotional or behavioral difficulties due to trauma exposure. Determinants were coded, abstracted, and synthesized using the Exploration, Preparation, Implementation, and Sustainment framework. Twenty-three articles were included, all of which examined implementation of Trauma-Focused Cognitive Behavioral Therapy or Cognitive-Behavioral Intervention for Trauma in Schools. This review identified multilevel and multiphase determinants that can be addressed by implementation strategies to improve implementation and clinical outcomes, and suggests how future studies might address gaps in the evidence base.
Collapse
Affiliation(s)
- Byron J Powell
- Brown School, Washington University in St. Louis, St. Louis, USA.
| | - Sheila V Patel
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
- RTI International, Durham, USA
| | - Amber D Haley
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
| | - Emily R Haines
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
- RTI International, Durham, USA
| | - Kathleen E Knocke
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
| | - Shira Chandler
- Department of Health Policy and Management, University of North Carolina at Chapel Hill Gillings School of Global Public Health, Chapel Hill, USA
| | - Colleen Cary Katz
- Silberman School of Social Work, Hunter College, City University of New York, New York, USA
| | | | - George Ake
- Duke University School of Medicine, Durham, USA
| | - Lisa Amaya-Jackson
- Center for Child and Family Health, Durham, USA
- Duke University School of Medicine, Durham, USA
| | - Gregory A Aarons
- Child and Adolescent Services Research Center, University of California at San Diego School of Medicine, San Diego, USA
| |
Collapse
|
13
|
Lengnick-Hall R, Willging C, Hurlburt M, Fenwick K, Aarons GA. Contracting as a bridging factor linking outer and inner contexts during EBP implementation and sustainment: a prospective study across multiple U.S. public sector service systems. Implement Sci 2020; 15:43. [PMID: 32527274 PMCID: PMC7288508 DOI: 10.1186/s13012-020-00999-9] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2019] [Accepted: 05/12/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Bridging factors are relational ties (e.g. partnerships), formal arrangements (e.g. contracts or polices) and processes (e.g. data sharing agreements) linking outer and inner contexts and are a recent evolution of the Exploration-Preparation-Implementation-Sustainment (EPIS) framework. Bridging factor research can elucidate ways that service systems may influence and/or be influenced by organizations providing health services. This study used the EPIS framework and open systems and resource dependence theoretical approaches to examine contracting arrangements in U.S. public sector systems. Contracting arrangements function as bridging factors through which systems communicate, interact, and exchange resources with the organizations operating within them. METHODS The sample included 17 community-based organizations in eight service systems. Longitudinal data is derived from 113 contract documents and 88 qualitative interviews and focus groups involving system and organizational stakeholders. Analyses consisted of a document review using content analysis and focused coding of transcripts from the interviews and focus groups. A multiple case study analysis was conducted to identify patterns across service systems and organizations. The dataset represented service systems that had sustained the same EBP for between 2 and 10 years, which allowed for observation of bridging factors and outer-inner context interactions over time. RESULTS Service systems and organizations influenced each other in a number of ways through contracting arrangements. Service systems influenced organizations when contracting arrangements resulted in changes to organizational functioning, required organizational responses to insufficient funding, and altered interorganizational network relationships. Organizations influenced service systems when contract arrangements prompted organization-driven contract negotiation/tailoring, changes to system-level processes, and interorganizational collaboration. Service systems and organizations were dependent on each other as implementation progressed. Resources beyond funding emerged, including adequate numbers of eligible clients, expertise in the evidence-based practice, and training and coaching capacity. CONCLUSION This study advances implementation science by expanding the range and definition of bridging factors and illustrating specific bi-directional influences between outer context service systems and inner context organizations. This study also identifies bi-directional dependencies over the course of implementation and sustainment. An analysis of influence, dependencies, and resources exchanged through bridging factors has direct implications for selecting and tailoring implementation strategies, especially those that require system-level coordination and change.
Collapse
Affiliation(s)
| | | | - Michael Hurlburt
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, CA USA
| | - Karissa Fenwick
- VA Greater Los Angeles Healthcare System, Los Angeles, CA USA
| | - Gregory A. Aarons
- Department of Psychiatry, University of California, San Diego, La Jolla, CA USA
- UC San Diego Dissemination and Implementation Science Center (UC San Diego-DISC), La Jolla, CA USA
| |
Collapse
|
14
|
What influences evidence-based treatment sustainment after implementation support ends? A mixed method study of the adolescent-community reinforcement approach. J Subst Abuse Treat 2020; 113:107999. [PMID: 32359672 DOI: 10.1016/j.jsat.2020.107999] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2019] [Revised: 03/02/2020] [Accepted: 03/06/2020] [Indexed: 11/21/2022]
Abstract
BACKGROUND Little is known about clinician perspectives regarding the factors that support or hinder the long-term delivery (i.e., sustainment) of evidence-based treatments in community-based treatment settings. METHODS Clinical staff from 82 community-based treatment organizations that received federal grant funding to support the delivery of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment for adolescent substance use, were asked to participate in interviews focused on understanding their perspectives about the sustainment of A-CRA. Qualitative themes were identified using inductive and deductive approaches. Then the themes were dichotomized (present/absent) so that quantitative comparisons could be made between staff from organizations that sustained and did not sustain delivery of A-CRA. Administrative data about each organization in relation to federal funding support and their primary focus was also examined to explore whether these characteristics were associated with A-CRA sustainment. RESULTS Staff (n = 134) representing 78 organizations participated in the interviews. Staff from organizations that had received multiple federal grants to support the delivery of A-CRA and whose primary focus was substance use rather than other conditions (mental health or primary care) were more likely to report sustaining A-CRA. Staff from sustaining organizations were more likely to report positive grant experiences and success with maintaining both organizational and external support in comparison to staff from non-sustaining organizations. Staff from non-sustaining organizations were more likely to report barriers to sustaining A-CRA, including more challenges with intervention delivery, and lack of internal support and external funding. CONCLUSIONS Our findings lend empirical support for implementation theories in that multiple factors appear to be associated with long-term delivery of an evidence-based treatment. Although A-CRA was generally perceived positively by staff from both organizations that sustained A-CRA and organizations that did not sustain A-CRA, inner setting factors (e.g., structural policies, leadership support and staff retention) along with outer setting factors (e.g., external funding support) were reported as key to A-CRA sustainment.
Collapse
|
15
|
Purtle J, Stadnick NA. Earmarked Taxes as a Policy Strategy to Increase Funding for Behavioral Health Services. Psychiatr Serv 2020; 71:100-104. [PMID: 31590621 PMCID: PMC6939131 DOI: 10.1176/appi.ps.201900332] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Earmarking taxes for behavioral health services is a policy strategy that many jurisdictions have implemented to increase funding for behavioral health systems. However, little has been written about these taxes, and limited guidance exists for policy makers who are pursing or implementing such taxes. This column summarizes approaches to designing earmarked behavioral health taxes, evidence of their impact, strategies to enhance implementation, and future directions for research. The column focuses on two jurisdictions: California, which imposes an additional 1% tax on all household income exceeding $1 million, and Washington State, which provides counties with the option of increasing sales tax by 0.1%.
Collapse
Affiliation(s)
- Jonathan Purtle
- Department of Health Management and Policy, Dornsife School of Public Health, Drexel University, Philadelphia (Purtle); Department of Psychiatry and Child and Adolescent Services Research Center, University of California, San Diego (Stadnick). Marvin S. Swartz, M.D., is editor of this column
| | - Nicole A Stadnick
- Department of Health Management and Policy, Dornsife School of Public Health, Drexel University, Philadelphia (Purtle); Department of Psychiatry and Child and Adolescent Services Research Center, University of California, San Diego (Stadnick). Marvin S. Swartz, M.D., is editor of this column
| |
Collapse
|