Four very basic ways to think about policy in implementation science

Operational and organizational variation in determinants of policy implementation success: the case of policies that earmark taxes for behavioral health services

BACKGROUND

Research on determinants of health policy implementation is limited, and conceptualizations of evidence and implementation success are evolving in the field. This study aimed to identify determinants of perceived policy implementation success and assess whether these determinants vary according to: (1) how policy implementation success is operationally defined [i.e., broadly vs. narrowly related to evidence-based practice (EBP) reach] and (2) the role of a person's organization in policy implementation. The study focuses on policies that earmark taxes for behavioral health services.

METHODS

Web-based surveys of professionals involved with earmarked tax policy implementation were conducted between 2022 and 2023 (N = 272). The primary dependent variable was a 9-item score that broadly assessed perceptions of the tax policy positively impacting multiple dimensions of outcomes. The secondary dependent variable was a single item that narrowly assessed perceptions of the tax policy increasing EBP reach. Independent variables were scores mapped to determinants in the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Multiple linear regression estimated associations between measures of determinants and policy implementation success.

RESULTS

Perceptions of tax attributes (innovation determinant), tax EBP implementation climate (inner-context determinant), and inter-agency collaboration in tax policy implementation (outer-context and bridging factor determinant) were significantly associated with perceptions of policy implementation success. However, the magnitude of associations varied according to how success was operationalized and by respondent organization type. For example, the magnitude of the association between tax attributes and implementation success was 42% smaller among respondents at direct service organizations than non-direct service organizations when implementation success was operationalized broadly in terms of generating positive impacts (β = 0.37 vs. β = 0.64), and 61% smaller when success was operationalized narrowly in terms of EBP reach (β = 0.23 vs. β = 0.59). Conversely, when success was operationalized narrowly as EBP reach, the magnitude of the association between EBP implementation climate and implementation success was large and significant among respondents at direct service organizations while it was not significant among respondents from non-direct service organizations (β = 0.48 vs. β=-0.06).

CONCLUSION

Determinants of perceived policy implementation success may vary according to how policy implementation success is defined and the role of a person's organization in policy implementation. This has implications for implementation science and selecting policy implementation strategies.

A research agenda to advance the study of implementation mechanisms

BACKGROUND

Implementation science scholars have made significant progress identifying factors that enable or obstruct the implementation of evidence-based interventions, and testing strategies that may modify those factors. However, little research sheds light on how or why strategies work, in what contexts, and for whom. Studying implementation mechanisms-the processes responsible for change-is crucial for advancing the field of implementation science and enhancing its value in facilitating equitable policy and practice change. The Agency for Healthcare Research and Quality funded a conference series to achieve two aims: (1) develop a research agenda on implementation mechanisms, and (2) actively disseminate the research agenda to research, policy, and practice audiences. This article presents the resulting research agenda, including priorities and actions to encourage its execution.

METHOD

Building on prior concept mapping work, in a semi-structured, 3-day, in-person working meeting, 23 US-based researchers used a modified nominal group process to generate priorities and actions for addressing challenges to studying implementation mechanisms. During each of the three 120-min sessions, small groups responded to the prompt: "What actions need to be taken to move this research forward?" The groups brainstormed actions, which were then shared with the full group and discussed with the support of facilitators trained in structured group processes. Facilitators grouped critical and novel ideas into themes. Attendees voted on six themes they prioritized to discuss in a fourth, 120-min session, during which small groups operationalized prioritized actions. Subsequently, all ideas were collated, combined, and revised for clarity by a subset of the authorship team.

RESULTS

From this multistep process, 150 actions emerged across 10 priority areas, which together constitute the research agenda. Actions included discrete activities, projects, or products, and ways to shift how research is conducted to strengthen the study of implementation mechanisms.

CONCLUSIONS

This research agenda elevates actions to guide the selection, design, and evaluation of implementation mechanisms. By delineating recommended actions to address the challenges of studying implementation mechanisms, this research agenda facilitates expanding the field of implementation science, beyond studying what works to how and why strategies work, in what contexts, for whom, and with which interventions.

A Mixed-Methods Exploration of the Implementation of Policies That Earmarked Taxes for Behavioral Health

Policy Points Earmarked tax policies for behavioral health are perceived as having positive impacts related to increasing flexible funding, suggesting benefits to expand this financing approach. Implementation challenges related to these earmarked taxes included tax base volatility that impedes long-term service delivery planning and inequities in the distribution of tax revenue. Recommendations for designing or revising earmarked tax policies include developing clear guidelines and support systems to manage the administrative aspects of earmarked tax programs, cocreating reporting and oversight structures with system and service delivery agents, and selecting revenue streams that are relatively stable across years.

CONTEXT

Over 200 cities and counties in the United States have implemented policies earmarking tax revenue for behavioral health services. This mixed-methods study was conducted with the aim of characterizing perceptions of the impacts of these earmarked tax policies, strengths and weaknesses of tax policy designs, and factors that influence decision making about how tax revenue is allocated for services.

METHODS

Study data came from surveys completed by 274 officials involved in behavioral health earmarked tax policy implementation and 37 interviews with officials in a sample of jurisdictions with these taxes-California (n = 16), Washington (n = 12), Colorado (n = 6), and Iowa (n = 3). Interviews primarily explored perceptions of the advantages and drawbacks of the earmarked tax, perceptions of tax policy design, and factors influencing decisions about revenue allocation.

FINDINGS

A total of 83% of respondents strongly agreed that it was better to have the tax than not, 73.2% strongly agreed that the tax increased flexibility to address complex behavioral health needs, and 65.1% strongly agreed that the tax increased the number of people served by evidence-based practices. Only 43.3%, however, strongly agreed that it was easy to satisfy tax-reporting requirements. Interviews revealed that the taxes enabled funding for services and implementation supports, such as training in the delivery of evidence-based practices, and supplemented mainstream funding sources (e.g., Medicaid). However, some interviewees also reported challenges related to volatility of funding, inequities in the distribution of tax revenue, and, in some cases, administratively burdensome tax reporting. Decisions about tax revenue allocation were influenced by goals such as reducing behavioral health care inequities, being responsive to community needs, addressing constraints of mainstream funding sources, and, to a lesser degree, supporting services considered to be evidence based.

CONCLUSIONS

Earmarked taxes are a promising financing strategy to improve access to, and quality of, behavioral health services by supplementing mainstream state and federal financing.

Assessing the implementation of healthy eating and physical activity policies and practices in Early Childhood Education and Care in New South Wales, Australia: A cross-sectional study

ISSUE ADDRESSED

Australian children are not meeting the recommended physical activity (PA) and healthy eating (HE) guidelines. Health behaviour practices implemented in community settings such as early education services can improve child's health outcomes and are therefore key to help meet guidelines. This study aimed to measure the implementation of HE and PA policies and practices in Early Childhood Education and Care (ECEC) services in New South Wales (NSW), Australia, and to examine their association with service characteristics.

METHODS

A random sample of 1122 centre-based ECEC services were invited to a cross-sectional survey measuring HE and PA policy and practice implementation. Regression analyses were conducted to assess the relationship between the service characteristics and implementation of policies/practices.

RESULTS

In total, 565 ECEC services completed the survey. Results show that while some practices are implemented, the implementation of practices promoting HE and PA education is low. Practices related to educator training for HE (18%) and PA (13%) were poorly implemented. The implementation of practices such as 'providing educator training around child PA', 'engaging families in activities to increase child PA' and 'encouraging supportive feeding practices' were significantly higher in services located in major cities than regional/remote services. 'Having a PA policy' and the practice of 'limiting the use of screen time' was significantly higher in long day care services than in preschools. The implementation of 'providing educator-led PA', 'providing free play opportunities' and 'having a PA policy' was significantly lower in private not-for-profit community managed services than in private for-profit services.

CONCLUSIONS

Implementation of various HE and PA policies and practices in regional/remote services, private not-for-profit services and preschools across NSW could be improved. SO WHAT?: Future research should be prioritised towards identifying factors influencing the implementation of these policies and practices to best tailor implementation support efforts for those who need it the most.

A Black American Nutrition Scholar and Advocate: My Journey

I started my journey as a nutrition scholar in 1974 when I began PhD studies at Cornell University. My journey has been rich with opportunity. I engaged in research on diet-related risks for cardiovascular diseases, diabetes, and cancer, partly motivated by my strong commitment to addressing health disparities affecting Black Americans. Obesity became my major focus and would eventually involve both US and global lenses. This focus was also linked to other dietary intake issues and health disparities and drew on knowledge I had gained in my prior study and practice of social work. I positioned myself as a bridge builder across nutrition, epidemiology, and public health, advocating for certain new ways of thinking and acting in these spheres and in the academy itself. Life skills honed during my formative years living within racially segregated contexts have been critical to any successes I have achieved.

Design considerations for developing measures of policy implementation in quantitative evaluations of public health policy

Typical quantitative evaluations of public policies treat policies as a binary condition, without further attention to how policies are implemented. However, policy implementation plays an important role in how the policy impacts behavioral and health outcomes. The field of policy-focused implementation science is beginning to consider how policy implementation may be conceptualized in quantitative analyses (e.g., as a mediator or moderator), but less work has considered how to measure policy implementation for inclusion in quantitative work. To help address this gap, we discuss four design considerations for researchers interested in developing or identifying measures of policy implementation using three independent NIH-funded research projects studying e-cigarette, food, and mental health policies. Mini case studies of these considerations were developed via group discussions; we used the implementation research logic model to structure our discussions. Design considerations include (1) clearly specifying the implementation logic of the policy under study, (2) developing an interdisciplinary team consisting of policy practitioners and researchers with expertise in quantitative methods, public policy and law, implementation science, and subject matter knowledge, (3) using mixed methods to identify, measure, and analyze relevant policy implementation determinants and processes, and (4) building flexibility into project timelines to manage delays and challenges due to the real-world nature of policy. By applying these considerations in their own work, researchers can better identify or develop measures of policy implementation that fit their needs. The experiences of the three projects highlighted in this paper reinforce the need for high-quality and transferrable measures of policy implementation, an area where collaboration between implementation scientists and policy experts could be particularly fruitful. These measurement practices provide a foundation for the field to build on as attention to incorporating measures of policy implementation into quantitative evaluations grows and will help ensure that researchers are developing a more complete understanding of how policies impact health outcomes.

Communicating the science of suicide prevention: A call to action for psychologists

INTRODUCTION

Suicide is a major public health concern within the United States, and prevention efforts are essential for decreasing the suicide rate. Researchers and clinicians have knowledge and effective treatments for preventing suicide; however, their impact is limited to those with access to services. Science Communication (SciComm) is an effective tool that can be integrated into the field of suicide prevention and can bridge the gap between scientific findings and the general population. SciComm can help disseminate evidence-based strategies for suicide prevention, dispel misinformation on suicide, and normalize help-seeking.

PURPOSE

In this article, we propose specific, tangible ways that SciComm can be integrated into graduate school programs, mentorship, career advancement requirements and can help enact systemic change within the field of suicide prevention. Additionally, we discuss why it is important that the field of suicide prevention, specifically, adopts a SciComm framework. Embracing SciComm can help the field of suicide prevention to have a broader impact and can help to reduce rates of suicide.

Prescribing antibiotics prudently-A survey of policy implementation drivers among physicians and veterinarians

Background

As the antimicrobial resistance (AMR) problem accelerates, humans and animals are suffering from the consequences of infections with diminishing antimicrobial treatment options. Within the One Medicine and One Health mandate, which denotes a collaborative, multisectoral, and transdisciplinary approach to improve medicine and health across human and animal sectors, we investigate how human and veterinary medical practitioners apply their medical and policy knowledge in prescribing antimicrobials. Different regions and locations establish different intermediary policies and programs to support clinicians in that pursuit. In Hong Kong, there are locally adapted programs at governance and clinical levels in the human medical field. However, there is no locally adapted veterinary antibiotic prescription guideline or stewardship program, and veterinarians adopt overseas or international professions' antimicrobial use guidelines. Such a policy environment creates a natural experiment to compare local policy implementation conditions and clinicians' knowledge, perception, and practice.

Method

We construct the investigative survey tool by adaptation of Knowledge, Attitude, and Practice (KAP) and Capacity, Opportunity, and Motivation-Behavior (COM-B) models. We identify, compare and contrast factors that influence clinicians' antimicrobial prescription behavior. The factors are considered both intrinsically, such as personal attributes, and extrinsically, such as societal and professional norms.

Findings

The absence of locally adopted antimicrobial guidelines influences AMR stewardship program implementation in local Hong Kong veterinary community. As medical allies, physicians and veterinarians share similar demographic influence, organization considerations and perception of public awareness. Both cohorts prescribe more prudently with more years-in-practice, time available to communicate with patients or caretakers, and public awareness and support.

Using policy codesign to achieve multi-sector alignment in adolescent behavioral health: a study protocol

BACKGROUND

Policymaking is quickly gaining focus in the field of implementation science as a potential opportunity for aligning cross-sector systems and introducing incentives to promote population health, including substance use disorders (SUD) and their prevention in adolescents. Policymakers are seen as holding the necessary levers for realigning service infrastructure to more rapidly and effectively address adolescent behavioral health across the continuum of need (prevention through crisis care, mental health, and SUD) and in multiple locations (schools, primary care, community settings). The difficulty of aligning policy intent, policy design, and successful policy implementation is a well-known challenge in the broader public policy and public administration literature that also affects local behavioral health policymaking. This study will examine a blended approach of coproduction and codesign (i.e., Policy Codesign), iteratively developed over multiple years to address problems in policy formation that often lead to poor implementation outcomes. The current study evaluates this scalable approach using reproducible measures to grow the knowledge base in this field of study.

METHODS

This is a single-arm, longitudinal, staggered implementation study to examine the acceptability and short-term impacts of Policy Codesign in resolving critical challenges in behavioral health policy formation. The aims are to (1) examine the acceptability, feasibility, and reach of Policy Codesign within two geographically distinct counties in Washington state, USA; (2) examine the impact of Policy Codesign on multisector policy development within these counties using social network analysis; and (3) assess the perceived replicability of Policy Codesign among leaders and other staff of policy-oriented state behavioral health intermediary organizations across the USA.

DISCUSSION

This study will assess the feasibility of a specific approach to collaborative policy development, Policy Codesign, in two diverse regions. Results will inform a subsequent multi-state study measuring the impact and effectiveness of this approach for achieving multi-sector and evidence informed policy development in adolescent SUD prevention and treatment.

PERSPECTIVE: A Path to Value-Based Insurance Design for Mental Health Services

BACKGROUND

Aligning cost of mental health care with expected clinical and functional benefits of that care would incentivize the delivery of high value treatments and services. In turn, ineffective or untested care could still be offered but at costs high enough to offset the delivery of high value care.

AIMS

The authors comment on Benson and Fendrick's paper on Value-Based Insurance Design (VBID) for mental health in the September 2023 special issue of this journal. The authors also present a preliminary framework of key ingredients needed to consider VBID for mental health treatments and services.

METHODS

The authors briefly review current and past efforts to contain costs and improve quality of mental health care, which include (for example) use of carve-out and carve-in programs, evaluation of cost sharing models, impact of accountable care organizations, and studying other benefit designs and impact of federal and state policies.

RESULTS

Using PTSD as an example, key ingredients of VBID for mental health services were identified and include the following: tools for case identification and monitoring progress over time at the population level; specific treatments and services with evidence of clinical effectiveness, cost-effectiveness, and health equity; and an approach to document the specific treatment or service was delivered (versus another treatment or service that may lack evidence).

DISCUSSION

The inability to afford mental health care is a top barrier to treatment seeking. People who do elect to spend time and money on mental health care are further disadvantaged by accessing care that is not well regulated and the quality at best is questionable. VBID could be an important lever for increasing access to and use of high value mental health care. Partnerships among the research, practice, and policy communities can help ensure research solutions meet needs of these two communities.

IMPLICATIONS FOR HEALTH CARE

VBID holds promise to make high value mental health care more affordable while discouraging low value treatments and services.

IMPLICATIONS FOR HEALTH POLICIES

While evidence gaps remain, these gaps can be filled concurrently with pursuit of VBID for mental health services.

IMPLICATIONS FOR FUTURE RESEARCH

This paper identifies important research opportunities to help make VBID a reality for mental health care.

The role of local health officers in advancing public health and primary care integration: lessons from the ongoing Universal Health Coverage reforms in the Philippines

The COVID-19 pandemic has highlighted the persistent fragmentation of health systems and has amplified the necessity for integration. This issue is particularly pronounced in decentralise settings, where fragmentation is evident with poor coordination that impedes timely information sharing, efficient resource allocation and effective response to health threats. It is within this context that the Philippine Universal Health Care law introduced reforms focusing on equitable access and resilient health systems through intermunicipal cooperation, enhancing primary care networks and harnessing digital health technologies-efforts that underline the demand for a comprehensively integrated healthcare system. The WHO and the global community have long called for integration as a strategy to optimise healthcare delivery. The authors contend that at the core of health system integration lies the need to synchronise public health and primary care interventions to enhance individual and population health. Drawing lessons from the implementation of a pilot project in the Philippines which demonstrates an integrated approach to delivering COVID-19 vaccination, family planning and primary care services, this paper examines the crucial role of local health officers in the process, offering insights and practical lessons for engaging these key actors to advance health system integration. These lessons may hold relevance for other low-ncome and middle-income economies pursuing similar reforms, providing a path forward towards achieving universal health coverage.

Revisiting the policy ecology framework for implementation of evidence-based practices in mental health settings

BACKGROUND

Over the past three decades, policy actors and actions have been highly influential in supporting the implementation of evidence-based practices (EBPs) in mental health settings. An early examination of these actions resulted in the Policy Ecology Framework (PEF), which was originally developed as a tactical primer for state and local mental health regulators in the field of child mental health. However, the policy landscape for implementation has evolved significantly since the original PEF was published. An interrogation of the strategies originally proposed in the PEF is necessary to provide an updated menu of strategies to improve our understanding of the mechanisms of policy action and promote system improvement.

OBJECTIVES

This paper builds upon the original PEF to address changes in the policy landscape for the implementation of mental health EBPs between 2009 and 2022. We review the current state of policy strategies that support the implementation of EBPs in mental health care and outline key areas for policy-oriented implementation research. Our review identifies policy strategies at federal, state, agency, and organizational levels, and highlights developments in the social context in which EBPs are implemented. Furthermore, our review is organized around some key changes that occurred across each PEF domain that span organizational, agency, political, and social contexts along with subdomains within each area.

DISCUSSION

We present an updated menu of policy strategies to support the implementation of EBPs in mental health settings. This updated menu of strategies considers the broad range of conceptual developments and changes in the policy landscape. These developments have occurred across the organizational, agency, political, and social contexts and are important for policymakers to consider in the context of supporting the implementation of EBPs. The updated PEF expands and enhances the specification of policy levers currently available, and identifies policy targets that are underdeveloped (e.g., de-implementation and sustainment) but are becoming visible opportunities for policy to support system improvement. The updated PEF clarifies current policy efforts within the field of implementation science in health to conceptualize and better operationalize the role of policy in the implementation of EBPs.