Policy Implementation Science - An Unexplored Strategy to Address Social Determinants of Health

Using concept mapping to co-create implementation strategies to address maternal-child food insecurity during the first 1000 days of life

Food insecurity (FI) has short- and long-term effects on maternal and child health, with persistent inequities within under-resourced communities of colour (e.g., Hispanic and Non-Hispanic Black). Interventions to mitigate maternal-child FI must engage the voices of under-resourced communities of colour to improve implementation and tackle socio-ecological drivers of inequities, leading to positive maternal-child outcomes. This exploratory sequential mixed-methods study aimed to co-create implementation strategies to tailor a culturally sensitive intervention to address FI during the first 1000 days of life in under-resourced communities of colour in Las Vegas. A Community Advisory Board (CAB) engaged in a two-step participatory process. First, through the concept mapping, hierarchical cluster analysis organized 125 strategies into seven thematic areas: policy and advocacy, access to food and resources, built environment, education across systems, social and peer support, cultural congruency and trust, and wellness and mental health. Second, through consensus-building, strategies were combined by similarity (n = 94) and excluded if unrelated to health and nutrition (n = 9). The CAB reached a consensus on 22 strategies classified across three socio-ecological levels. Examples of strategies at the community level (n = 16) included increasing utilization of federal nutrition assistance programmes; at the service level (n = 4), integrating FI screenings and referral coordination systems across services; and at the individual level (n = 2), providing mentorship, education, and support for families and moms. The co-creation of a culturally sensitive intervention to reduce inequities in maternal-child FI during the first 1000 days of life requires multi-level strategies across three socio-ecological levels in under-resourced communities of colour in Las Vegas.

Bridging the Gap in Policy Implementation through a Health Equity Lens: Insights from a 2-Year Study on Measurement Development

Background: Policy implementation measurement lacks an equity focus, which limits understanding of how policies addressing health inequities, such as Universal School Meals (USM) can elicit intended outcomes. We report findings from an equity-focused measurement development study, which had two aims: (1) identify key constructs related to the equitable implementation of school health policies and (2) establish face and content validity of measures assessing key implementation determinants, processes, and outcomes. Methods: To address Aim 1, study participants (i.e., school health policy experts) completed a survey to rate the importance of constructs identified from implementation science and health equity by the research team. To accomplish Aim 2, the research team developed survey instruments to assess the key constructs identified from Aim 1 and conducted cognitive testing of these survey instruments among multiple user groups. The research team iteratively analyzed the data; feedback was categorized into "easy" or "moderate/difficult" to facilitate decision-making. Results: The Aim 1 survey had 122 responses from school health policy experts, including school staff (n = 76), researchers (n = 22), trainees (n = 3), leaders of non-profit organizations (n = 6), and others (n = 15). For Aim 2, cognitive testing feedback from 23 participants was predominantly classified as "easy" revisions (69%) versus "moderate/difficult" revisions (31%). Primary feedback themes comprised (1) comprehension and wording, (2) perceived lack of control over implementation, and (3) unclear descriptions of equity in questions. Conclusions: Through adaptation and careful dissemination, these tools can be shared with implementation researchers and practitioners so they may equitably assess policy implementation in their respective settings.

Gun violence revictimization in New York State: What increases the risk of being shot again?

BACKGROUND

While gun injuries are more likely to occur in urban settings and affect people of color, factors associated with gun violence revictimization-suffering multiple incidents of gun violence-are unknown. We examined victim demographics and environmental factors associated with gun violence revictimization in New York State (NYS).

METHODS

The 2005 to 2020 NYS hospital discharge database was queried for patients aged 12 years to 65 years with firearm-related hospital encounters. Patient and environmental variables were extracted. Patient home zip code was used to determine the Social Deprivation Index (SDI) for each patient's area of residence. We conducted bivariate and multivariate analyses among patients who suffered a single incident of gun violence or gun violence revictimization.

RESULTS

We identified 38,974 gun violence victims among whom 2,243 (5.8%) suffered revictimization. The proportion of revictimization rose from 4% in 2008 to 8% in 2020 ( p < 0.01). The median [interquartile range] time from first to second incident among those who suffered revictimization was 359 days [81-1,167 days]. Revictimization was more common among Blacks (75.0% vs. 65.1%, p < 0.01), patients with Medicaid (54.9% vs. 43.2%, p < 0.01), and in areas of higher deprivation (84.8 percentile vs. 82.1 percentile, p < 0.01).

CONCLUSION

Gun violence revictimization is on the rise. People of color and those residing in areas with high social deprivation are more likely to be re-injured. Our findings emphasize the importance of community-level over individual-level interventions for prevention of gun violence revictimization.

LEVEL OF EVIDENCE

Prognostic and Epidemiological; Level IV.

Leveraging the health equity implementation framework to foster an equity focus in medical education

Teaching equitable clinical practice is of critical importance, yet how best to do so remains unknown. Educators utilize implementation science frameworks to disseminate clinical evidence-based practices (EBP). The Health Equity Implementation Framework (HEIF) is one of these frameworks, and it delineates how health equity may be concomitantly assessed and addressed in planning the implementation of an EBP. The HEIF therefore lays a strong foundation to understand and explain barriers and facilitators to implementation through an equity lens, making it well-suited for use by medical educators. Three equity-focused frames of reference within the model include (1) the clinical encounter, (2) societal context, and (3) culturally relevant factors, herein referred to as domains. The HEIF provides a structure for prospective and retrospective assessment of how EBP are taught and ultimately incorporated into clinical practice by trainees, with specific attention to delivering equitable care. We present three examples of common topics in internal medicine, contextualized by the three equity domains of the HEIF. We additionally acknowledge the limitations of this framework as a research tool with complex features that may not be suitable for brief teaching in the clinical environment. We propose a 360-degree learner assessment to ensure implementation of this framework is successful. By encouraging trainees to explore the narrative experiences of their patients and examine their own implicit biases, the HEIF provides a structure to address gaps in knowledge about delivering equitable care.

Co-design knowledge mobilization tools for universal accessibility in municipalities

Introduction

Modern research teams are re-evaluating conventional methods with the aim of improving the usefulness of knowledge for users, focusing on the role of knowledge users in shaping innovation. In disability field, encouraging participatory research inherently involves diverse perspectives and inclusion, which aligns with the principles of universal accessibility. By actively involving individuals with various backgrounds, abilities, and needs in the research process, we can better understand and address the challenges faced in adopting universal accessibility. This approach ensures that solutions are more comprehensive, inclusive, and effectively cater to the needs of all individuals, fostering a more equitable and accessible environment for everyone. Despite municipal organizations mandating universal accessibility action plans, they lack tools for efficient implementation. The aim of this study was to develop knowledge mobilization tools tailored to a specific municipal context in Quebec, Canada, to facilitate the implementation of universal accessibility measures by municipal employees.

Methods

The co-design process employed in this study was organized into four distinct stages, following the Morales model: (1) Exploration (2) Co-Design (3) Validation (4) Development.

Results

Stages one and two highlighted the employees' lack of awareness about universal accessibility issues and their need to have more information and resources about how universal accessibility is encountered in their work. A steering committee co-designed three video vignettes about universal accessibility, the city's action plan and measures included in it.

Discussion

The co-design approach used in this study allowed us to observe the non-linear nature of partnership research with an organization as complex as a municipality. Our study shows significant advantages of collaboration between the municipal sector and research.

Using policy codesign to achieve multi-sector alignment in adolescent behavioral health: a study protocol

BACKGROUND

Policymaking is quickly gaining focus in the field of implementation science as a potential opportunity for aligning cross-sector systems and introducing incentives to promote population health, including substance use disorders (SUD) and their prevention in adolescents. Policymakers are seen as holding the necessary levers for realigning service infrastructure to more rapidly and effectively address adolescent behavioral health across the continuum of need (prevention through crisis care, mental health, and SUD) and in multiple locations (schools, primary care, community settings). The difficulty of aligning policy intent, policy design, and successful policy implementation is a well-known challenge in the broader public policy and public administration literature that also affects local behavioral health policymaking. This study will examine a blended approach of coproduction and codesign (i.e., Policy Codesign), iteratively developed over multiple years to address problems in policy formation that often lead to poor implementation outcomes. The current study evaluates this scalable approach using reproducible measures to grow the knowledge base in this field of study.

METHODS

This is a single-arm, longitudinal, staggered implementation study to examine the acceptability and short-term impacts of Policy Codesign in resolving critical challenges in behavioral health policy formation. The aims are to (1) examine the acceptability, feasibility, and reach of Policy Codesign within two geographically distinct counties in Washington state, USA; (2) examine the impact of Policy Codesign on multisector policy development within these counties using social network analysis; and (3) assess the perceived replicability of Policy Codesign among leaders and other staff of policy-oriented state behavioral health intermediary organizations across the USA.

DISCUSSION

This study will assess the feasibility of a specific approach to collaborative policy development, Policy Codesign, in two diverse regions. Results will inform a subsequent multi-state study measuring the impact and effectiveness of this approach for achieving multi-sector and evidence informed policy development in adolescent SUD prevention and treatment.

Acceptability and feasibility of policy implementation strategies for taxes earmarked for behavioral health services

Background

This study's aims are to: (1) Compare the acceptability and feasibility of five types of implementation strategies that could be deployed to increase the reach of evidence-based practices (EBPs) with revenue from policies that earmark taxes for behavioral health services, and (2) Illustrate how definitions of implementation strategies and measures of acceptability and feasibility can be used in policy-focused implementation science research.

Methods

Web-based surveys of public agency and community organization professionals involved with earmarked tax policy implementation were completed in 2022-2023 (N = 211, response rate = 24.9%). Respondents rated the acceptability and feasibility of five types of implementation strategies (dissemination, implementation process, integration, capacity-building, and scale-up). Aggregate acceptability and feasibility scores were calculated for each type of strategy (scoring range 4-20). Analyses of variance compared scores across strategies and between organizational actor types.

Findings

For acceptability, capacity-building strategies had the highest rating (M = 16.3, SD = 3.0), significantly higher than each of the four other strategies, p ≤ . 004), and scale-up strategies had the lowest rating (M = 15.6). For feasibility, dissemination strategies had the highest rating (M = 15.3, significantly higher than three of the other strategies, p ≤ .002) and scale-up strategies had the lowest rating (M = 14.4).

Conclusions

Capacity-building and dissemination strategies may be well-received and readily deployed by policy implementers to support EBPs implementation with revenue from taxes earmarked for behavioral health services. Adapting definitions of implementation strategies for policy-focused topics, and applying established measures of acceptability and feasibility to these strategies, demonstrates utility as an approach to advance research on policy-focused implementation strategies.

Scaling Interventions to Manage Chronic Disease: Innovative Methods at the Intersection of Health Policy Research and Implementation Science

Policy implementation is a key component of scaling effective chronic disease prevention and management interventions. Policy can support scale-up by mandating or incentivizing intervention adoption, but enacting a policy is only the first step. Fully implementing a policy designed to facilitate implementation of health interventions often requires a range of accompanying implementation structures, like health IT systems, and implementation strategies, like training. Decision makers need to know what policies can support intervention adoption and how to implement those policies, but to date research on policy implementation is limited and innovative methodological approaches are needed. In December 2021, the Johns Hopkins ALACRITY Center for Health and Longevity in Mental Illness and the Johns Hopkins Center for Mental Health and Addiction Policy convened a forum of research experts to discuss approaches for studying policy implementation. In this report, we summarize the ideas that came out of the forum. First, we describe a motivating example focused on an Affordable Care Act Medicaid health home waiver policy used by some US states to support scale-up of an evidence-based integrated care model shown in clinical trials to improve cardiovascular care for people with serious mental illness. Second, we define key policy implementation components including structures, strategies, and outcomes. Third, we provide an overview of descriptive, predictive and associational, and causal approaches that can be used to study policy implementation. We conclude with discussion of priorities for methodological innovations in policy implementation research, with three key areas identified by forum experts: effect modification methods for making causal inferences about how policies' effects on outcomes vary based on implementation structures/strategies; causal mediation approaches for studying policy implementation mechanisms; and characterizing uncertainty in systems science models. We conclude with discussion of overarching methods considerations for studying policy implementation, including measurement of policy implementation, strategies for studying the role of context in policy implementation, and the importance of considering when establishing causality is the goal of policy implementation research.

Policy implementation and outcome evaluation: establishing a framework and expanding capacity for advocacy organizations to assess the impact of their work in public policy

Advocacy organizations can play a crucial role in evaluating whether legislation or regulation has had its intended effect by supporting robust public policy implementation and outcome evaluation. The American Heart Association, working with expert advisors, has developed a framework for effective evaluation that can be used by advocacy organizations, in partnership with researchers, public health agencies, funders, and policy makers to assess the health and equity impact of legislation and regulation over time. Advocacy organizations can use parts of this framework to evaluate the impact of policies relevant to their own advocacy and public policy efforts and inform policy development and guide their organizational resource allocation. Ultimately, working in partnership, advocacy organizations can help bring capacity, commitment and funding to this important implementation and outcome evaluation work that informs impactful public policy for equitable population health and well-being.

Reflection on the application of the Consolidated Framework for Implementation Research to a national policy to improve inclusion of people with disabilities

People with disabilities face many barriers in the built environment impacting their mobility, health, and social participation. In the US, under the Americans with Disabilities Act (ADA), municipalities were required to develop and implement barrier-removal plans for pedestrian infrastructure, called ADA transition plans, but very few have done so. Many communities know they need a plan but do not know how to get it done because of a lack of understanding of the many different implementation considerations. Implementation science offers a useful approach for understanding complex policy implementation such as ADA plans. This paper provides a reflection on the adaptation of the Consolidated Framework for Implementation Research (CFIR) to evaluate the implementation of ADA transition planning. To apply the CFIR, we tailored the construct definitions and modified them to fit the specific context of the ADA transition planning process. We documented the constructs that were more challenging to apply, those that were not relevant, and those that were particularly useful. This paper can serve as a valuable example that other researchers can use when considering adapting the CFIR or other implementation frameworks for the evaluation of complex social policy beyond the ADA.

The intersection of health and housing: Analysis of the research portfolios of the National Institutes of Health, Centers for Disease Control and Prevention, and U.S. Department of Housing and Urban Development

BACKGROUND

Housing is a major social determinant of health that affects health status and outcomes across the lifespan.

OBJECTIVES

An interagency portfolio analysis assessed the level of funding invested in "health and housing research" from fiscal years (FY) 2016-2020 across the National Institutes of Health (NIH), the United States Department of Housing and Urban Development (HUD), and the Centers for Disease Control and Prevention (CDC) to characterize the existing health and housing portfolio and identify potential areas for additional research and collaboration.

METHODS/RESULTS

We identified NIH, HUD, and CDC research projects that were relevant to both health and housing and characterized them by housing theme, health topic, population, and study design. We organized the assessment of the individual housing themes by four overarching housing-to-health pathways. From FY 2016-2020, NIH, HUD, and CDC funded 565 health and housing projects combined. The Neighborhood pathway was most common, followed by studies of the Safety and Quality pathway. Studies of the Affordability and Stability pathways were least common. Health topics such as substance use, mental health, and cardiovascular disease were most often studied. Most studies were observational (66%); only a little over one fourth (27%) were intervention studies.

DISCUSSION

This review of the research grant portfolios of three major federal funders of health and housing research in the United States describes the diversity and substantial investment in research at the intersection between housing and health. Analysis of the combined portfolio points to gaps in studies on causal pathways linking housing to health outcomes. The findings highlight the need for research to better understand the causal pathways from housing to health and prevention intervention research, including rigorous evaluation of housing interventions and policies to improve health and well-being.

Advancing healthcare equity through dissemination and implementation science

OBJECTIVE

To provide guiding principles and recommendations for how approaches from the field of dissemination and implementation (D&I) science can advance healthcare equity.

DATA SOURCES AND STUDY SETTING

This article, part of a special issue sponsored by the Agency for Healthcare Research and Quality (AHRQ), is based on an outline drafted to support proceedings of the 2022 AHRQ Health Equity Summit and further revised to reflect input from Summit attendees.

STUDY DESIGN

This is a narrative review of the current and potential applications of D&I approaches for understanding and advancing healthcare equity, followed by discussion and feedback with Summit attendees.

DATA COLLECTION/EXTRACTION METHODS

We identified major themes in narrative and systematic reviews related to D&I science, healthcare equity, and their intersections. Based on our expertise, and supported by synthesis of published studies, we propose recommendations for how D&I science is relevant for advancing healthcare equity. We used iterative discussions internally and at the Summit to refine preliminary findings and recommendations.

PRINCIPAL FINDINGS

We identified four guiding principles and three D&I science domains with strong promise for accelerating progress toward healthcare equity. We present eight recommendations and more than 60 opportunities for action by practitioners, healthcare leaders, policy makers, and researchers.

CONCLUSIONS

Promising areas for D&I science to impact healthcare equity include the following: attention to equity in the development and delivery of evidence-based interventions; the science of adaptation; de-implementation of low-value care; monitoring equity markers; organizational policies for healthcare equity; improving the economic evaluation of implementation; policy and dissemination research; and capacity building.

Implementation costs of sugary drink policies in the United States

To support implementation of important public health policies, policymakers need information about implementation costs over time and across stakeholder groups. We assessed implementation costs of two federal sugar-sweetened beverage (SSB) policies of current policy interest and with evidence to support their effects: excise taxes and health warning labels. Our analysis encompassed the entire policy life cycle using the Exploration, Preparation, Implementation, and Sustainment framework. We identified implementation actions using key informant interviews and developed quantitative estimates of implementation costs using published literature and government documents. Results show that implementation costs vary over time and among stakeholders. Explicitly integrating implementation science theory and using mixed methods improved the comprehensiveness of our results. Although this work is specific to federal SSB policies, the process can inform how we understand the costs of many public health policies, providing crucial information for public health policy making.

Cardiovascular-Kidney-Metabolic Health: A Presidential Advisory From the American Heart Association

Cardiovascular-kidney-metabolic health reflects the interplay among metabolic risk factors, chronic kidney disease, and the cardiovascular system and has profound impacts on morbidity and mortality. There are multisystem consequences of poor cardiovascular-kidney-metabolic health, with the most significant clinical impact being the high associated incidence of cardiovascular disease events and cardiovascular mortality. There is a high prevalence of poor cardiovascular-kidney-metabolic health in the population, with a disproportionate burden seen among those with adverse social determinants of health. However, there is also a growing number of therapeutic options that favorably affect metabolic risk factors, kidney function, or both that also have cardioprotective effects. To improve cardiovascular-kidney-metabolic health and related outcomes in the population, there is a critical need for (1) more clarity on the definition of cardiovascular-kidney-metabolic syndrome; (2) an approach to cardiovascular-kidney-metabolic staging that promotes prevention across the life course; (3) prediction algorithms that include the exposures and outcomes most relevant to cardiovascular-kidney-metabolic health; and (4) strategies for the prevention and management of cardiovascular disease in relation to cardiovascular-kidney-metabolic health that reflect harmonization across major subspecialty guidelines and emerging scientific evidence. It is also critical to incorporate considerations of social determinants of health into care models for cardiovascular-kidney-metabolic syndrome and to reduce care fragmentation by facilitating approaches for patient-centered interdisciplinary care. This presidential advisory provides guidance on the definition, staging, prediction paradigms, and holistic approaches to care for patients with cardiovascular-kidney-metabolic syndrome and details a multicomponent vision for effectively and equitably enhancing cardiovascular-kidney-metabolic health in the population.

Advancing the science of policy implementation: a call to action for the implementation science field

Public policies have been essential in addressing many of the most pressing public health problems in the USA and around the world. A large and convincing body of multidisciplinary research has established the impacts or effectiveness of public policies, such as smoke-free air laws and nutrition standards, on improving health outcomes and behaviors. Most of this research assumes that because an evidence-based policy is adopted or takes effect, it is implemented as intended. This assumption, however, is often incorrect. Like with clinical guidelines and other interventions, implementation science has an important role to play in promoting the uptake and implementation of evidence-based public policies that promote public health. To realize this potential, there remains a critical need to first establish a common understanding of what public policy is, the role of specific policies in the context of implementation (i.e., is it the evidence-based intervention or the implementation strategy?), and to establish an appropriate methodological foundation for the field of policy implementation science. We recommend that the field must evolve to (i) include policy experts and actors on policy implementation science study teams; (ii) identify theories, models, and frameworks that are suitable for policy implementation science; (iii) identify policy implementation strategies; (iv) adapt and/or identify study designs best suited for policy implementation science research; and (v) identify appropriate policy implementation outcome measures.

Advocacy efforts of the Society of Behavioral Medicine: a 6-year update

Six years ago, we published a paper describing the Society of Behavioral Medicine's (SBM) health policy organizational leadership structure and policy initiatives. The purpose of the current paper is to provide an update on changes in the infrastructure and new policy initiatives that have been developed since 2017. We review each of the policy leadership arms of SBM including details of the work of each and goals for the future. The SBM engages in several health policy advocacy efforts through their Advocacy Council and Position Statements Committee. The Advocacy Council launched the Health Policy Ambassador Program in 2020. The Ambassador Program serves to train members to develop longer-term relationships with legislative staff around key policy priority areas. The Position Statements Committee is responsible for overseeing the development and dissemination of health policy position statements. Both groups work together and with partner organizations to increase the impact of our science. Over the last 6 years, developing a stronger infrastructure and implementing metrics for progress such as tracking social media engagement has helped to move SBM's policy agenda forward. The work of the policy-related leadership teams can serve as a model for other organizations who are interested in further developing their policy advocacy efforts.

Making the connection between health equity and sustainability

Sustainability and health inequities are key challenges in public health and healthcare. Research suggests that only about half of evidence-based interventions (EBIs) are sustained over time, and settings and populations experiencing systemic and structural barriers to health (e.g., poverty, racism, stigma, and discrimination) experience even greater challenges to sustainability. In this article, we argue that an enhanced focus on sustainability in the field of implementation science is critical in order to maximize the long-term health benefits and broader societal impacts of EBIs for all populations and settings. From an equity perspective, a focus on sustainability is particularly critical to prioritize among population sub-groups that have not historically received the benefits of health-related EBIs. We discuss how a health equity framing is essential to sustaining EBIs in under-resourced communities, and requires moving away from a deficit mindset that focuses on why EBIs are challenging to sustain, to one that focuses more on identifying and nurturing existing assets within individuals and communities to increase the likelihood that EBIs are sustained. We conclude with a discussion of future directions as well as recommendations and resources (e.g., frameworks, tools) to advance and make progress toward sustainability from a health equity mindset, including: (1) Actively planning early for sustainability alongside key partners; (2) Tracking progress toward enhancing sustainability and being accountable in doing so equitably for all settings and populations; and (3) Focusing on both equity and engagement early and often throughout the research process and all implementation phases.

Who's "in the room where it happens"? A taxonomy and five-step methodology for identifying and characterizing policy actors

BACKGROUND

Engaging policy actors in research design and execution is critical to increasing the practical relevance and real-world impact of policy-focused dissemination and implementation science. Identifying and selecting which policy actors to engage, particularly actors involved in "Big P" public policies such as laws, is distinct from traditional engaged research methods. This current study aimed to develop a transparent, structured method for iteratively identifying policy actors involved in key policy decisions-such as adopting evidence-based interventions at systems-scale-and to guide implementation study sampling and engagement approaches. A flexible policy actor taxonomy was developed to supplement existing methods and help identify policy developers, disseminators, implementers, enforcers, and influencers.

METHODS

A five-step methodology for identifying policy actors to potentially engage in policy dissemination and implementation research was developed. Leveraging a recent federal policy as a case study-The Family First Prevention Services Act (FFPSA)-publicly available documentation (e.g., websites, reports) were searched, retrieved, and coded using content analysis to characterize the organizations and individual policy actors in the "room" during policy decisions.

RESULTS

The five steps are as follows: (1) clarify the policy implementation phase(s) of interest, (2) identify relevant proverbial or actual policymaking "rooms," (3) identify and characterize organizations in the room, (4) identify and characterize policy actors in the "room," and (5) quantify (e.g., count actors across groups), summarize, and compare "rooms" to develop or select engagement approaches aligned with the "room" and actors. The use and outcomes of each step are exemplified through the FFPSA case study.

CONCLUSIONS

The pragmatic and transparent policy actor identification steps presented here can guide researchers' methods for continuous sampling and successful policy actor engagement. Future work should explore the utility of the proposed methods for guiding selection and tailoring of engagement and implementation strategies (e.g., research-policy actor partnerships) to improve both "Big P" and "little p" (administrative guidelines, procedures) policymaking and implementation in global contexts.

Four very basic ways to think about policy in implementation science

BACKGROUND

Policy is receiving increasing attention in the field of implementation science. However, there remains a lack of clear, concise guidance about how policy can be conceptualized in implementation science research. Building on Curran's article "Implementation science made too simple"-which defines "the thing" as the intervention, practice, or innovation in need of implementation support-we offer a typology of four very basic ways to conceptualize policy in implementation science research. We provide examples of studies that have conceptualized policy in these different ways and connect aspects of the typology to established frameworks in the field. The typology simplifies and refines related typologies in the field. Four very basic ways to think about policy in implementation science research. 1) Policy as something to adopt: an evidence-supported policy proposal is conceptualized as "the thing" and the goal of research is to understand how policymaking processes can be modified to increase adoption, and thus reach, of the evidence-supported policy. Policy-focused dissemination research is well-suited to achieve this goal. 2) Policy as something to implement: a policy, evidence-supported or not, is conceptualized as "the thing" and the goal of research is to generate knowledge about how policy rollout (or policy de-implementation) can be optimized to maximize benefits for population health and health equity. Policy-focused implementation research is well-suited to achieve this goal. 3) Policy as context to understand: an evidence-supported intervention is "the thing" and policies are conceptualized as a fixed determinant of implementation outcomes. The goal of research is to understand the mechanisms through which policies affect implementation of the evidence-supported intervention. 4) Policy as strategy to use: an evidence-supported intervention is "the thing" and policy is conceptualized as a strategy to affect implementation outcomes. The goal of research is to understand, and ideally test, how policy strategies affect implementation outcomes related to the evidence-supported intervention.

CONCLUSION

Policy can be conceptualized in multiple, non-mutually exclusive ways in implementation science. Clear conceptualizations of these distinctions are important to advancing the field of policy-focused implementation science and promoting the integration of policy into the field more broadly.

Applying hybrid effectiveness-implementation studies in equity-centered policy implementation science

Policy implementation science (IS) is complex, dynamic, and fraught with unique study challenges that set it apart from biomedical or clinical research. One important consideration is the ways in which policy interacts with local contexts, such as power and social disadvantage (e.g., based on ability, race, class, sexual identity, geography). The complex nature of policy IS and the need for more intentional integration of equity principles into study approaches calls for creative adaptations to existing implementation science knowledge and guidance. Effectiveness-implementation hybrid studies were developed to enhance translation of clinical research by addressing research questions around the effectiveness of an intervention and its implementation in the same study. The original work on hybrid designs mainly focused on clinical experimental trials; however, over the last decade, researchers have applied it to a wide range of initiatives and contexts, including more widespread application in community-based studies. This perspectives article demonstrates how effectiveness-implementation hybrid studies can be adapted for and applied to equity-centered policy IS research. We draw upon principles of targeted universalism and Equity in Implementation Research frameworks to guide adaptations to hybrid study typologies, and suggest research and engagement activities to enhance equity considerations; for example, in the design and testing of implementing strategies. We also provide examples of equity-centered policy IS studies. As the field of policy IS rapidly evolves, these adapted hybrid type studies are offered to researchers as a starting guide.

Understanding Associations of Personal Values With Support for Tobacco and Alcohol Control Policies

INTRODUCTION

This cross-sectional analysis of the 2020 Health Information National Trends Survey (N=3,604) examines the associations of personal values with tobacco and alcohol control policy support, which may inform policy-related communication efforts.

METHODS

Respondents selected which of 7 value options they considered most important in their daily life and rated their support for 8 proposed tobacco and alcohol control policies (1=strongly oppose, 5=strongly support). Weighted proportions for each value were described across sociodemographic characteristics, smoking status, and alcohol use. Weighted bivariate and multivariable regressions tested the associations of values with mean policy support (alpha=0.89). Analyses occurred from 2021 to 2022.

RESULTS

The most frequently selected values were assuring my family is safe and secure (30.2%), being happy (21.1%), and making my own decisions (13.6%). Selected values varied across sociodemographic and behavioral characteristics. For example, people with lower education and incomes were overrepresented among those selecting making my own decisions and keeping myself in good health. After adjusting for sociodemographics, smoking, and alcohol use, people selecting family safety (β=0.20, 95% CI=0.06, 0.33) or religious connection (β=0.34, 95% CI=0.14, 0.54) as most important reported higher policy support than those selecting making their own decisions, the value associated with the lowest mean policy support. Mean policy support did not significantly differ across any other value comparisons.

CONCLUSIONS

Personal values are associated with support for alcohol and tobacco control policies, with making my own decisions associated with the lowest policy support. Future research and communication efforts may consider aligning tobacco and alcohol control policies with the idea of supporting autonomy.

County- and state-level immigration policies are associated with Supplemental Nutrition Assistance Program (SNAP) participation among Latino households

The purpose of this study was to investigate the association between county- and state-level immigrant criminalizing and integrating policies and Latino household participation in the largest safety net program against food insecurity in the U.S., the Supplemental Nutrition Assistance Program (SNAP). Our outcome, county-level proportion of SNAP-participating Latino households, and county-level covariates were obtained from the American Community Survey 1-year county files (N = 675 counties) for 13 years (2007-2019). Our exposures were county-level presence of sanctuary policies and a state-level immigrant friendliness score, created based on 19 immigrant criminalizing and integrating state-level policies obtained from the Urban Institute's State Immigration Policies Resource. We classified every county in the sample as 1) sanctuary policy + immigrant friendly state, 2) sanctuary policy + immigrant unfriendly state, 3) no sanctuary policy + immigrant friendly state, and 4) no sanctuary policy + immigrant unfriendly state. Using multivariable generalized linear models that adjusted for poverty levels and other social composition characteristics of counties, we found that county-level SNAP participation among Latino households was 1.1 percentage-point higher in counties with sanctuary policies (B = 1.12, 95%CI = 0.26-1.98), compared to counties with no sanctuary policies, and 1.6 percentage-point higher in counties with sanctuary policies in immigrant friendly states (B = 1.59, 95%CI = 0.33-2.84), compared to counties with no sanctuary policy in immigrant unfriendly states. Local and state immigration policy, even when unrelated to SNAP eligibility, may influence SNAP participation among Latino households. Jurisdictions which lack sanctuary policies or have more criminalizing and less integrating policies should consider adopting targeted outreach strategies to increase SNAP enrollment among Latino households.

Community and partner engagement in dissemination and implementation research at the National Institutes of Health: an analysis of recently funded studies and opportunities to advance the field

BACKGROUND

As the focus has grown in recent years on both engaged research and dissemination and implementation (D&I) research, so too has federal funding to support these areas. The purpose of this analysis is to provide an overall perspective about the range of practices and approaches being used to engage partners in D&I research, with special attention to disparities-relevant research, and to identify gaps and opportunities in research funded by the US National Institutes of Health (NIH) in this space.

METHODS

This analysis examined a portfolio of active D&I research grants funded in fiscal years 2020 and 2021 across the NIH. Grant applications were deductively coded and summary statistics were calculated. Cross-tabulations were used to identify trends by engagement and disparities foci.

RESULTS

There were 103 grants included in the portfolio, of which 87% contained some form of community or partner engagement, and 50% of engaged grants were relevant to health disparities. Engagement was planned across the research continuum with each study engaging on average 2.5 different partner types. Consultation was the most common level of engagement (56%) while partnership was the least common (3%). On average, each study used 2.2 engagement strategies. Only 16% of grants indicated formally measuring engagement. Compared to non-disparities studies, disparities-relevant studies were about twice as likely to engage partners at the higher levels of partnership or collaboration (19% vs. 11%) and were also more likely to be conducted in community settings (26% vs. 5%).

CONCLUSIONS

Based on this portfolio analysis, D&I research appears to regularly integrate engagement approaches and strategies, though opportunities to deepen engagement and diversify who is engaged remain. This manuscript outlines several gaps in the portfolio and describes opportunities for increasing engagement to improve the quality of D&I research and application to advancing health equity. In addition, opportunities for leveraging the consistent and systematic application of engagement approaches and strategies to advance the science of engagement are discussed.

A landscape assessment of the activities and capacities of evidence-to-policy intermediaries (EPI) in behavioral health

BACKGROUND

A significant gap exists between the production of research evidence and its use in behavioral health policymaking. Organizations providing consulting and support activities for improving policy represent a promising source for strengthening the infrastructure to address this gap. Understanding the characteristics and activities of these evidence-to-policy intermediary (EPI) organizations can inform the development of capacity-building activities, leading to strengthened evidence-to-policy infrastructure and more widespread evidence-based policymaking.

METHODS

Online surveys were sent to 51 organizations from English-speaking countries involved in evidence-to-policy activities in behavioral health. The survey was grounded in a rapid evidence review of the academic literature regarding strategies used to influence research use in policymaking. The review identified 17 strategies, which were classified into four activity categories. We administered the surveys via Qualtrics and calculated the descriptive statistics, scales, and internal consistency statistics using R.

RESULTS

A total of 31 individuals completed the surveys from 27 organizations (53% response rate) in four English-speaking countries. EPIs were evenly split between university (49%) and non-university (51%) settings. Nearly all EPIs conducted direct program support (mean = 4.19/5 [sd = 1.25]) and knowledge-building (4.03 [1.17]) activities. However, engagement with traditionally marginalized and non-traditional partners (2.84 [1.39]) and development of evidence reviews using formal critical appraisal methods (2.81 [1.70]) were uncommon. EPIs tend to be specialized, focusing on a group of highly related strategies rather than incorporating multiple evidence-to-policy strategies in their portfolios. Inter-item consistency was moderate to high, with scale α's ranging from 0.67 to 0.85. Ratings of respondents' willingness to pay for training in one of three evidence dissemination strategies revealed high interest in program and policy design.

CONCLUSIONS

Our results suggest that evidence-to-policy strategies are frequently used by existing EPIs; however, organizations tend to specialize rather than engage in a breadth of strategies. Furthermore, few organizations reported consistently engaging with non-traditional or community partners. Focusing on building capacity for a network of new and existing EPIs could be a promising strategy for growing the infrastructure needed for evidence-informed behavioral health policymaking.

Protocol for a scoping review of health equity frameworks and models applied in empirical studies of chronic disease prevention and control

BACKGROUND

Chronic diseases, such as cancers and cardiovascular diseases, present the greatest burden of morbidity and mortality worldwide. This burden disproportionately affects historically marginalized populations. Health equity is rapidly gaining increased attention in public health, health services, and implementation research, though many health inequities persist. Health equity frameworks and models (FM) have been called upon to guide equity-focused chronic disease and implementation research. However, there is no clear synthesis of the health equity FM used in chronic disease research or how these are applied in empirical studies. This scoping review seeks to fill this gap by identifying and characterizing health equity FM applied in empirical studies along the chronic disease prevention and control continuum, describing how these FM are used, and exploring potential applications to the field of implementation science.

METHODS

We follow established guidance for conducting scoping reviews, which includes six stages: (1) identify the research question; (2) identify relevant studies; (3) select studies for inclusion; (4) data extraction; (5) collating, summarizing, and reporting the results; and (6) consultation. This protocol presents the iterative, collaborative approach taken to conceptualize this study and develop the search strategy. We describe the criteria for inclusion in this review, methods for conducting two phases of screening (title and abstract, full text), data extraction procedures, and quality assurance approaches taken throughout the project.

DISCUSSION

The findings from this review will inform health-equity focused chronic disease prevention and control research. FM identified through this review will be added to an existing website summarizing dissemination and implementation science frameworks, and we will offer case examples and recommendations for utilizing a health equity FM in empirical studies. Our search strategy and review methodology may serve as an example for scholars seeking to conduct reviews of health equity FM in other health disciplines.

SYSTEMATIC REVIEW REGISTRATION

Open Science Framework Registration https://doi.org/10.17605/OSF.IO/SFVE6.

A policy implementation study of earmarked taxes for mental health services: study protocol

BACKGROUND

Insufficient funding is frequently identified as a critical barrier to the implementation and sustainment of evidence-based practices (EBPs). Thus, increasing access to funding is recognized as an implementation strategy. Policies that create earmarked taxes-defined as taxes for which revenue can only be spent on specific activities-are an increasingly common mental health financing strategy that could improve the reach of EBPs. This project's specific aims are to (1) identify all jurisdictions in the USA that have implemented earmarked taxes for mental health and catalogue information about tax design; (2) characterize experiences implementing earmarked taxes among local (e.g., county, city) mental health agency leaders and other government and community organization officials and assess their perceptions of the acceptability and feasibility of different types of policy implementation strategies; and (3) develop a framework to guide effect earmarked tax designs, inform the selection of implementation strategies, and disseminate the framework to policy audiences.

METHODS

The project uses the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to inform data collection about the determinants and processes of tax implementation and Leeman's typology of implementation strategies to examine the acceptability and feasibility strategies which could support earmarked tax policy implementation. A legal mapping will be conducted to achieve aim 1. To achieve aim 2, a survey will be conducted of 300 local mental health agency leaders and other government and community organization officials involved with the implementation of earmarked taxes for mental health. The survey will be followed by approximately 50 interviews with these officials. To achieve aim 3, quantitative and qualitative data will be integrated through a systematic framework development and dissemination process.

DISCUSSION

This exploratory policy implementation process study will build the evidence base for outer-context implementation determinants and strategies by focusing on policies that earmarked taxes for mental health services.

Opportunities to advance implementation science and nutrition research: a commentary on the Strategic Plan for NIH Nutrition Research

Despite population-wide recommendations by the U.S. Dietary Guidelines for Americans and others to encourage health-promoting dietary patterns, the proportion of Americans following dietary recommendations remains low. The gaps in the adoption and integration of evidence-based dietary interventions, practices, programs, and policies (EBIs) into community and clinical settings signal the need to strengthen efforts in implementation science (IS) in nutrition research to understand and alleviate barriers to adopting and sustaining healthy dietary behaviors and practices. Equally important is the translation of this research into practice in a variety of settings and across the diversity of populations. Recognizing this need, the U.S. National Institutes of Health (NIH) 2020-2030 Strategic Plan for NIH Nutrition Research calls for the expansion of IS as a key opportunity to advancing nutrition research. This commentary highlights three scientific opportunities to stimulate IS in nutrition research and provides examples for each opportunity. These include: (a) Advance consideration of implementation and dissemination early in the design of interventions to facilitate opportunities for equitable scale-up and sustainability of EBIs, (b) Develop and test strategies for equitable implementation of nutrition and diet EBIs in health care and community settings, and (c) Build and strengthen the infrastructure, capacity, and expertise needed to increase use of IS in clinical and community nutrition research to swiftly move the research into practice. By advancing the three opportunities identified in this commentary, the scientific community has the potential to advance the field of nutrition research and IS with the ultimate goal of improving public health.

Country and policy factors influencing the implementation of primary care-based alcohol screening: A comparison of Colombia, Mexico and Peru

Researchers and practitioners recognise the importance of context when implementing healthcare interventions, but the influence of wider environment is rarely mapped. This paper identifies the country and policy-related factors potentially explaining the country differences in outcomes of an intervention focused on improving detection and management of heavy alcohol use in primary care in Colombia, Mexico and Peru. Qualitative data obtained through interviews, logbooks and document analysis are used to explain quantitative data on number of alcohol screenings and screening providers in each of the countries. Existing alcohol screening standards in Mexico, and policy prioritisation of primary care and consideration of alcohol as a public health issue in Colombia and Mexico positively contributed to the outcome, while the COVID-19 pandemic had a negative impact. In Peru, the context was unsupportive due to a combination of: political instability amongst regional health authorities; lack of focus on strengthening primary care due to the expansion of community mental health centres; alcohol considered as an addiction rather than a public health issue; and the impact of COVID-19 on healthcare. We found that wider environment-related factors interacted with the intervention implemented and can help explain country differences in outcomes.

Medication for opioid use disorder treatment continuity post-release from jail: A qualitative study with community-based treatment providers

BACKGROUND

People released from jail are at elevated opioid overdose risk. Medications for opioid use disorder (MOUD) are effective in reducing overdoses. MOUD treatment was recently mandated in seven Massachusetts jails, but little is known about barriers and facilitators to treatment continuity post-release. We aimed to assess MOUD provider perspectives on treatment continuity among people released from jail.

METHODS

We conducted qualitative interviews with 36 medical, supervisory, and administrative staff at MOUD programs that serve jail-referred patients. We used the Exploration, Preparation, Implementation, and Sustainment (EPIS) implementation science framework to guide development of instruments, codes, and analyses. We employed deductive and inductive coding, and a grounded theory analytical approach to identify salient themes.

RESULTS

Inner context findings highlighted necessary adjustments among jail staff to approve MOUD treatment, especially with agonist medications that were previously considered contraband. Participants perceived that some staff within jails favored abstinence-based recovery, viewing agonists as a crutch. Bridging results highlighted the importance of inter-agency communication and coordination to ensure information transfer for seamless treatment continuity in the community post-release. Pre-release planning, release on pre-scheduled dates, medication provision to cover gaps between jail release and intake at community MOUD sites, and exchange of treatment information across agencies were viewed as paramount to success. Unexpected early releases and releases from court were viewed as barriers to treatment coordination. Outer context domains were largely tied to social determinants of health. Substantial barriers to treatment continuity included shelter, food security, employment, transportation, and insurance reactivation.

CONCLUSION

Through qualitative interviews with community-based MOUD staff, we identified salient barriers and facilitators to treatment continuity post-release from jails. Findings point to needed investments in care coordination, staffing, and funding to strengthen jail-to-community-based MOUD treatment, removing barriers to continuity, and decreasing opioid overdose deaths during this high-risk transition.

Investigating implementation of school health policies through a health equity lens: A measures development study protocol

Background

School-based policies that ensure provision of nutrition, physical activity, and other health-promoting resources and opportunities are essential in mitigating health disparities among underserved populations. Measuring the implementation of such policies is imperative to bridge the gap between policy and practice. Unfortunately, limited practical, psychometrically strong measures of school policy implementation exist. Few available explicitly focus on the issues of equity and social justice as a key component of implementation, which may result in underassessment of the equity implications of policy implementation. The purpose of this study is to develop equity-focused measures in collaboration with practitioners, researchers, and other key implementation partners that will facilitate evaluation of policy implementation determinants (i.e., barriers and facilitators), processes, and outcomes.

Methods

We will actively seek engagement from practitioners, researchers, and advocacy partners (i.e., stakeholders) who have expertise in school health policy throughout each phase of this project. We propose a multi-phase, 1-year project comprising the following steps: (1) selection of relevant constructs from guiding frameworks related to health equity and implementation science; (2) initial measure development, including expert feedback on draft items; (3) pilot cognitive testing with representatives from key target populations (i.e., school administrators, teachers, food service staff, and students and parents/guardians); and (4) measure refinement based on testing and assessment of pragmatic properties. These steps will allow us to establish initial face and content validity of a set of instruments that can undergo psychometric testing in future studies to assess their reliability and validity.

Discussion

Completion of this project will result in several school policy implementation measurement tools which can be readily used by practitioners and researchers to evaluate policy implementation through a health equity lens. This will provide opportunities for better assessment and accountability of policies that aim to advance health equity among school-aged children and their families.

Trial registration

Open Science Framework Registration doi: 10.17605/OSF.IO/736ZU.

Key determinants to school breakfast program implementation in Philadelphia public schools: Implications for the role of SNAP-Ed

Background

Policies addressing food insecurity are only effective if they are implemented successfully, serving those most at risk. Universal school meals provide a key intervention to schools that serve predominantly low-income families by providing free school breakfast and lunch to all. Unfortunately, low uptake of such provisions among students is concerning especially regarding school breakfast, warranting key implementation support for schools to ensure student nutrition needs are met. Thus, the purpose of this study was to evaluate the determinants of implementing two different school breakfast programs and pragmatic strategies for serving breakfast in ways that maximize student participation.

Methods

A qualitative study was conducted between 2018 and 2020 within the School District of Philadelphia (SDP) comprising surveys, interviews, and observations to assess contextual determinants of two distinctive breakfast models: Breakfast in the Classroom (BIC) and Cafeteria after the Bell (CAB). Principals and lead kitchen staff completed surveys to assess determinants of breakfast model adoption. Principals, lead kitchen staff, classroom teachers, climate (i.e., social emotional wellbeing), and facilities staff subsequently participated in interviews to discuss implementation determinants (i.e., facilitators and challenges) and strategies for maximizing student participation. Observations provided rich data to triangulate interviews and survey data. Survey data were analyzed using frequency analysis, and observation and interview data were analyzed through thematic analysis. Presentation of themes was framed by the Consolidated Framework for Implementation Research.

Results

Results highlighted several positive determinants to participation including addressing student and family needs, making data-informed decisions, and providing hot meals and fruit based on student tastes. Negative determinants to implementation comprised challenges to SNAP-Ed-funded policy changes to promote student breakfast participation, lack of communication between administration, and staff and turnover among food service staff. Strategies included modifying school entrance procedures and combining breakfast with other education-related tasks to minimize instructional time lost through breakfast after the bell schedules.

Discussion

Data highlight the need to include implementation partner expertise when designing interventions for increasing reach and effectiveness of school meal programs. Future research that directly tests implementation strategies and key outcomes of reach/participation, among others, is critical to bridging the policy to practice gap in school nutrition programs.

Interventions to promote health equity: implications for implementation science in behavioral medicine

Disparities in health persist despite the development of innovative and effective behavioral interventions. Both behavioral medicine and implementation science are vital to improving health care and health outcomes, and both can play a critical role in advancing health equity. However, to eliminate health disparities, more research in these areas is needed to ensure disparity-reducing behavioral interventions are continually developed and implemented. This special issue on interventions to promote health equity presents a diverse set of articles focused on implementing behavioral interventions to reduce health disparities. The current article summarizes the special issue and identifies key themes and future considerations. Articles in this special issue report on behavioral medicine intervention studies (including those examining aspects of implementation) as well as implementation science studies with implications for behavioral medicine. Articles discuss community-, provider-, and system-level interventions; implementation processes; and barriers and facilitators to implementation. Also included are commentaries calling for greater prioritization of behavioral medicine and implementation research. As evidenced in this special issue, behavioral medicine is primed to lead the implementation of behavioral interventions in historically marginalized and minoritized populations to advance health equity and improve overall population health.

Cross-Sectional Association of State Recess Laws With District-Level Policy and School Recess Provision in the United States

BACKGROUND

State recess laws are recommended to encourage adequate and equitable access to recess and its benefits, but the downstream effects of state recess laws are unknown. We examined the association of state recess laws with district-level policy and school recess provision.

METHODS

This is cross-sectional analysis of the School Health Policies and Practices Survey, a US nationally representative sample of school districts (2016) and schools (2014). State-level recess laws were coded as none, recommend, or require recess. Logistic and linear regression were used to examine the association between state law with district policies and school recess provision, respectively. Data from 2000 are presented to highlight changes in recess policy and provision over time.

RESULTS

The odds of a district policy requiring recess were 2.22 and 2.34 times greater when state recess law recommended or required recess, respectively, compared to states with no recess policy. There were no significant differences in school-level recess provision by state recess law but point estimates from 2000 indicated states without a law had the largest declines in recess provision over time.

CONCLUSIONS

State recess laws are positively associated with district-level policy. Effects at the school level are unclear and continued surveillance is needed.

Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem

BACKGROUND

Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers.

MAIN BODY

Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches.

CONCLUSION

We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

Using Microsimulation Modeling to Inform EHE Implementation Strategies in Los Angeles County

BACKGROUND

Pre-exposure prophylaxis (PrEP) is essential to ending HIV. Yet, uptake remains uneven across racial and ethnic groups. We aimed to estimate the impacts of alternative PrEP implementation strategies in Los Angeles County.

SETTING

Men who have sex with men, residing in Los Angeles County.

METHODS

We developed a microsimulation model of HIV transmission, with inputs from key local stakeholders. With this model, we estimated the 15-year (2021-2035) health and racial and ethnic equity impacts of 3 PrEP implementation strategies involving coverage with 9000 additional PrEP units annually, above the Status-quo coverage level. Strategies included PrEP allocation equally (strategy 1), proportionally to HIV prevalence (strategy 2), and proportionally to HIV diagnosis rates (strategy 3), across racial and ethnic groups. We measured the degree of relative equalities in the distribution of the health impacts using the Gini index (G) which ranges from 0 (perfect equality, with all individuals across all groups receiving equal health benefits) to 1 (total inequality).

RESULTS

HIV prevalence was 21.3% in 2021 [Black (BMSM), 31.1%; Latino (LMSM), 18.3%, and White (WMSM), 20.7%] with relatively equal to reasonable distribution across groups (G, 0.28; 95% confidence interval [CI], 0.26 to 0.34). During 2021-2035, cumulative incident infections were highest under Status-quo (n = 24,584) and lowest under strategy 3 (n = 22,080). Status-quo infection risk declined over time among all groups but remained higher in 2035 for BMSM (incidence rate ratio, 4.76; 95% CI: 4.58 to 4.95), and LMSM (incidence rate ratio, 1.74; 95% CI: 1.69 to 1.80), with the health benefits equally to reasonably distributed across groups (G, 0.32; 95% CI: 0.28 to 0.35). Relative to Status-quo, all other strategies reduced BMSM-WMSM and BMSM-LMSM disparities, but none reduced LMSM-WMSM disparities by 2035. Compared to Status-quo, strategy 3 reduced the most both incident infections (% infections averted: overall, 10.2%; BMSM, 32.4%; LMSM, 3.8%; WMSM, 3.5%) and HIV racial inequalities (G reduction, 0.08; 95% CI: 0.02 to 0.14).

CONCLUSIONS

Microsimulation models developed with early, continuous stakeholder engagement and inputs yield powerful tools to guide policy implementation.

Partisan differences in the effects of economic evidence and local data on legislator engagement with dissemination materials about behavioral health: a dissemination trial

BACKGROUND

State legislators make policy decisions that influence children's exposure to adverse childhood experiences (ACEs), such as child maltreatment, and their effects on behavioral health. Effective dissemination of scientific research can increase the likelihood that legislators' decisions are aligned with evidence to prevent ACEs and their consequences, and effective dissemination requires legislators to engage with dissemination materials. Informed by the elaboration likelihood model of persuasive communication and Brownson's Model of Dissemination Research, we tested the hypothesis that inclusion of economic evidence and local data would increase legislator engagement with dissemination materials about evidence-supported policies related to ACEs and behavioral health.

METHODS

A three-arm randomized dissemination trial was conducted. A university researcher e-mailed dissemination materials which contained evidence about ACEs and behavioral health problems to state legislators (two e-mails sent 2 weeks apart, 12,662 e-mails delivered to 6509 legislators). The e-mail subject lines, text, and policy brief content were manipulated across the study arms. The intervention condition received state-tailored data about rates of ACEs and state-tailored economic evidence about the costs of ACEs for public systems, the enhanced control condition received state-tailored data and not economic evidence, and the control condition received national data and not economic evidence. Outcomes were rates of e-mail views, policy brief link clicks, requests for researcher consultation, and mentions of child maltreatment terms in legislators' social media posts.

RESULTS

For the first e-mail, the e-mail view rate was 42.6% higher in the intervention than in the enhanced control condition (22.8% vs. 14.8%) and 20.8% higher than in the control condition (22.8% vs. 18.5%) (both p < .0001). Similar results were observed for the second e-mail. These differences remained significant after adjustment for demographic differences across study conditions in individual-level models, but not multilevel models. There was a significant interaction between the experimental condition and political party (p < .0001) in which the intervention increased e-mail view rates among Democrats but not Republicans. The intervention had no effect on policy brief link clicks or requests for consultation and a mixed effect on social media posts.

CONCLUSIONS

Inclusion of state-tailored economic evidence in dissemination materials can increase engagement with research evidence among Democrat, but not Republican, legislators. Dissemination strategies tailored for legislators' political party affiliation may be needed.

Dissemination and Implementation Science to Advance Health Equity: An Imperative for Systemic Change

Innovations in public health research and evidence-based interventions targeting chronic and infectious diseases are only effective if they reach their target populations. Individuals from low socioeconomic background, racial and ethnic minorities, and sexual/gender minority communities are most susceptible to chronic diseases such as obesity and cancer, and infectious diseases such as HIV and COVID-19. These disparities are driven by social and structural conditions including stigma and discrimination, housing instability and food insecurity, among others. Accordingly, interventions that aim to improve population health must be targeted toward marginalized communities who are often systematically excluded from decision making processes. This article introduces dissemination and implementation science as a key opportunity to advance health equity through integrating measures and metrics that evaluate if an intervention is successful at improving health outcomes in marginalized populations. Implementation science also provides frameworks to help evaluate the key determinants to implementation success which can inform subsequent health outcomes. Examples of how researchers have engaged with community stakeholders are provided, along with strategies in which dissemination has gone beyond traditional practices. Finally, ways in which universities can build capacity for implementation science as a means to address health disparities are provided with the goal of improving the translation of research to practice.

Revisiting concepts of evidence in implementation science

BACKGROUND

Evidence, in multiple forms, is a foundation of implementation science. For public health and clinical practice, evidence includes the following: type 1 evidence on etiology and burden; type 2 evidence on effectiveness of interventions; and type 3: evidence on dissemination and implementation (D&I) within context. To support a vision for development and use of evidence in D&I science that is more comprehensive and equitable (particularly for type 3 evidence), this article aims to clarify concepts of evidence, summarize ongoing debates about evidence, and provide a set of recommendations and tools/resources for addressing the "how-to" in filling evidence gaps most critical to advancing implementation science.

MAIN TEXT

Because current conceptualizations of evidence have been relatively narrow and insufficiently characterized in our opinion, we identify and discuss challenges and debates about the uses, usefulness, and gaps in evidence for implementation science. A set of questions is proposed to assist in determining when evidence is sufficient for dissemination and implementation. Intersecting gaps include the need to (1) reconsider how the evidence base is determined, (2) improve understanding of contextual effects on implementation, (3) sharpen the focus on health equity in how we approach and build the evidence-base, (4) conduct more policy implementation research and evaluation, and (5) learn from audience and stakeholder perspectives. We offer 15 recommendations to assist in filling these gaps and describe a set of tools for enhancing the evidence most needed in implementation science.

CONCLUSIONS

To address our recommendations, we see capacity as a necessary ingredient to shift the field's approach to evidence. Capacity includes the "push" for implementation science where researchers are trained to develop and evaluate evidence which should be useful and feasible for implementers and reflect community or stakeholder priorities. Equally important, there has been inadequate training and too little emphasis on the "pull" for implementation science (e.g., training implementers, practice-based research). We suggest that funders and reviewers of research should adopt and support a more robust definition of evidence. By critically examining the evolving nature of evidence, implementation science can better fulfill its vision of facilitating widespread and equitable adoption, delivery, and sustainment of scientific advances.

Advancing gender equity in the academy

Implementation science offers a rigorous set of tools to help mitigate long-standing and worsening gender disparities in academia.

Assessing Smoke-Free Housing Implementation Approaches to Inform Best Practices: A National Survey of Early-Adopting Public Housing Authorities

Secondhand smoke (SHS) exposure causes chronic illness and occurs at a higher prevalence in low-income communities than the general public. In 2018, the U.S. Department of Housing and Urban Development (HUD) instituted a smoke-free housing rule for Public Housing Authorities (PHAs) to address persistent health inequities. However, the success of smoke-free housing requires evidence to inform effective implementation approaches. A mixed-methods, cross-sectional survey was conducted in a national sample of PHAs. Questions focused on housing officials' use of specific implementation strategies. Adjusted odds ratios were used to assess associations between implementation approaches and variations among PHAs (i.e., region, size, or recency of policy adoption). Qualitative analyses were conducted to assess the perceived effectiveness of implementation strategies. Resident engagement, staff training, and smoking cessation support were the most frequently used implementation strategies. Engagement with local stakeholders was cited less frequently. Enforcement actions were limited with no violations referred to housing court. Support for policy adherence was identified as a sixth implementation strategy. While most PHAs used at least some evidence-informed implementation strategies, a lack of a systematic approach may limit overall effectiveness. Further research is required to resolve implementation barriers experienced disproportionately by a subset of PHAs, and to inform a best practice implementation framework that meets the needs of a heterogeneous population.

Moving toward equity: fostering transdisciplinary research between the social and behavioral sciences and implementation science to end the HIV epidemic

PURPOSE OF REVIEW

Since the beginning of the HIV epidemic, social and behavioral scientists have developed interventions to stem the spread of the virus. The dissemination of these interventions has traditionally been a lengthy process; however, implementation science (IS) offers a route toward hastening delivery of effective interventions. A transdisciplinary approach, wherein IS informs and is informed by social and behavioral sciences (SBS) as well as community participation, offers a strategy for more efficiently moving toward health equity and ending the HIV epidemic.

RECENT FINDINGS

There has been considerable growth in HIV research utilizing IS theories, methods and frameworks. Many of these studies have been multi or interdisciplinary in nature, demonstrating the ways that IS and SBS can strengthen one another. We also find areas for continued progress toward transdisciplinarity.

SUMMARY

We review literature from 2020 to 2021, exploring the ways IS and SBS have been used in tandem to develop, evaluate and disseminate HIV interventions. We highlight the interplay between disciplines and make a case for moving toward transdisciplinarity, which would yield new, integrated frameworks that can improve prevention and treatment efforts, moving us closer to achieving health equity.

Operationalizing Implementation Science in Nutrition: The Implementation Science Initiative in Kenya and Uganda

BACKGROUND

Implementation science (IS) has the potential to improve the implementation and impact of policies, programs, and interventions. Most of the training, guidance, and experience has focused on implementation research, which is only 1 part of the broader field of IS. In 2018, the Society for Implementation Science in Nutrition borrowed concepts from IS in health to develop a broader and more integrated conceptual framework, adapted to the particular case of nutrition and with language and concepts more familiar to the nutrition community: it is called the IS in Nutrition (ISN) framework.

OBJECTIVE

The purpose of this research was to generate knowledge concerning challenges and strategies in operationalizing the ISN framework in low- and middle-income country (LMIC) settings.

METHODS

The ISN framework was operationalized in partnership with country teams in Kenya and Uganda over a 3-y period as part of the Implementation Science Initiative. An action research methodology (developmental evaluation) was used to provide timely feedback to the country teams, facilitate adaptations and adjustments, and generate the data presented in this article concerning challenges and strategies.

RESULTS

Operationalization of the ISN framework proceeded by first articulating a set of guiding principles as touchstones for the country teams and further articulating 6 components of an IS system to facilitate development of work streams. Challenges and strategies in implementing these 6 components were then documented. The knowledge gained through this experience led to the development of an IS system operational model to assist the application of IS in other LMIC settings.

CONCLUSIONS

Future investments in IS should prioritize a system- and capacity-building approach in order to realize its full potential and become institutionalized at country level. The operational model can guide others to improve the implementation of IS within a broad range of programs.

Strategies for implementing music-based interventions for people with dementia in long-term care facilities: A systematic review

OBJECTIVES

Research has found that music-based interventions can decrease behavioral and psychological symptoms of dementia or behaviors that challenge (BPSD/BtC). However, how to effectively implement these interventions is unclear. This study synthesizes available evidence regarding implementation strategies and outcomes of music-based interventions for people with dementia at residential long-term care facilities.

METHODS

Study registered with PROSPERO (registration number: CRD42020194354). We searched the following databases: PsychInfo, PubMed, MEDLINE, CINAHL, and The Cochrane Library. Inclusion criteria included articles targeting music-based interventions conducted for people with dementia, studies conducted in residential long-term care facilities, and articles that reported implementation strategies and outcomes of the intervention.

RESULTS

Of the included eight studies, half were studies of music therapy and the other half were on individualized music. 49 implementation strategies were reported. The most frequently reported category of strategies was planning (34.7%), followed by education (24.5%), quality management (24.5%), restructuring (12.2%), and finance (4.1%). No strategies under the category of attending to the policy context were reported. The most frequently reported implementation outcomes were appropriateness (27.3%), followed by adoption (22.7%), fidelity (22.7%), acceptability (9.1%), sustainability (9.1%), and cost (9.1%). No studies measured feasibility or penetration.

CONCLUSIONS

Although various effective implementation strategies were identified, we were unable to examine the effectiveness of individual implementation strategies due to the designs of the selected studies. Less attention has been paid to strategies that aim at structural changes of intervention delivery systems. Future studies should investigate facilitators and barriers of implementing music-based interventions especially focusing on structural aspects.

Quantitative measures used in empirical evaluations of mental health policy implementation: A systematic review

Background

Mental health is a critical component of wellness. Public policies present an opportunity for large-scale mental health impact, but policy implementation is complex and can vary significantly across contexts, making it crucial to evaluate implementation. The objective of this study was to (1) identify quantitative measurement tools used to evaluate the implementation of public mental health policies; (2) describe implementation determinants and outcomes assessed in the measures; and (3) assess the pragmatic and psychometric quality of identified measures.

Method

Guided by the Consolidated Framework for Implementation Research, Policy Implementation Determinants Framework, and Implementation Outcomes Framework, we conducted a systematic review of peer-reviewed journal articles published in 1995-2020. Data extracted included study characteristics, measure development and testing, implementation determinants and outcomes, and measure quality using the Psychometric and Pragmatic Evidence Rating Scale.

Results

We identified 34 tools from 25 articles, which were designed for mental health policies or used to evaluate constructs that impact implementation. Many measures lacked information regarding measurement development and testing. The most assessed implementation determinants were readiness for implementation, which encompassed training (n  =  20, 57%) and other resources (n  =  12, 34%), actor relationships/networks (n  =  15, 43%), and organizational culture and climate (n  =  11, 31%). Fidelity was the most prevalent implementation outcome (n  =  9, 26%), followed by penetration (n  =  8, 23%) and acceptability (n  =  7, 20%). Apart from internal consistency and sample norms, psychometric properties were frequently unreported. Most measures were accessible and brief, though minimal information was provided regarding interpreting scores, handling missing data, or training needed to administer tools.

Conclusions

This work contributes to the nascent field of policy-focused implementation science by providing an overview of existing measurement tools used to evaluate mental health policy implementation and recommendations for measure development and refinement. To advance this field, more valid, reliable, and pragmatic measures are needed to evaluate policy implementation and close the policy-to-practice gap.

Plain Language Summary

Mental health is a critical component of wellness, and public policies present an opportunity to improve mental health on a large scale. Policy implementation is complex because it involves action by multiple entities at several levels of society. Policy implementation is also challenging because it can be impacted by many factors, such as political will, stakeholder relationships, and resources available for implementation. Because of these factors, implementation can vary between locations, such as states or countries. It is crucial to evaluate policy implementation, thus we conducted a systematic review to identify and evaluate the quality of measurement tools used in mental health policy implementation studies. Our search and screening procedures resulted in 34 measurement tools. We rated their quality to determine if these tools were practical to use and would yield consistent (i.e., reliable) and accurate (i.e., valid) data. These tools most frequently assessed whether implementing organizations complied with policy mandates and whether organizations had the training and other resources required to implement a policy. Though many were relatively brief and available at little-to-no cost, these findings highlight that more reliable, valid, and practical measurement tools are needed to assess and inform mental health policy implementation. Findings from this review can guide future efforts to select or develop policy implementation measures.

The 2019 Conference on Health and Active Transportation: Research Needs and Opportunities

Active transportation (AT) is widely viewed as an important target for increasing participation in aerobic physical activity and improving health, while simultaneously addressing pollution and climate change through reductions in motor vehicular emissions. In recent years, progress in increasing AT has stalled in some countries and, furthermore, the coronavirus (COVID-19) pandemic has created new AT opportunities while also exposing the barriers and health inequities related to AT for some populations. This paper describes the results of the December 2019 Conference on Health and Active Transportation (CHAT) which brought together leaders from the transportation and health disciplines. Attendees charted a course for the future around three themes: Reflecting on Innovative Practices, Building Strategic Institutional Relationships, and Identifying Research Needs and Opportunities. This paper focuses on conclusions of the Research Needs and Opportunities theme. We present a conceptual model derived from the conference sessions that considers how economic and systems analysis, evaluation of emerging technologies and policies, efforts to address inclusivity, disparities and equity along with renewed attention to messaging and communication could contribute to overcoming barriers to development and use of AT infrastructure. Specific research gaps concerning these themes are presented. We further discuss the relevance of these themes considering the pandemic. Renewed efforts at research, dissemination and implementation are needed to achieve the potential health and environmental benefits of AT and to preserve positive changes associated with the pandemic while mitigating negative ones.

A systematic review of school health policy measurement tools: implementation determinants and outcomes

BACKGROUND

Governments in some countries or states/provinces mandate school-based policies intended to improve the health and well-being of primary and secondary students and in some cases the health of school staff. Examples include mandating a minimum time spent per week in programmed physical activity, mandating provision of healthy foods and limiting fat content of school meals, and banning tobacco products or use on school campuses. Although school health researchers have studied whether schools, districts, or states/provinces are meeting requirements, it is unclear to what extent implementation processes and determinants are assessed. The purposes of the present systematic review of quantitative measures of school policy implementation were to (1) identify quantitative school health policy measurement tools developed to measure implementation at the school, district, or state/provincial levels; (2) describe the policy implementation outcomes and determinants assessed and identify the trends in measurement; and (3) assess pragmatic and psychometric properties of identified implementation measures to understand their quality and suitability for broader application.

METHODS

Peer-reviewed journal articles published 1995-2020 were included if they (1) had multiple-item quantitative measures of school policy implementation and (2) addressed overall wellness, tobacco, physical activity, nutrition, obesity prevention, or mental health/bullying/social-emotional learning. The final sample comprised 86 measurement tools from 67 peer-review articles. We extracted study characteristics, such as psychometric and pragmatic measure properties, from included articles based on three frameworks: (1) Implementation Outcomes Framework, (2) Consolidated Framework for Implementation Research, and (3) Policy Implementation Determinants Framework.

RESULTS

Most implementation tools were developed to measure overall wellness policies which combined multiple policy topics (n = 35, 40%) and were in survey form (n = 75, 87%). Fidelity was the most frequently prevalent implementation outcome (n = 70, 81%), followed by adoption (n = 32, 81%). The implementation determinants most assessed were readiness for implementation, including resources (n = 43, 50%), leadership (n = 42, 49%), and policy communication (n = 41, 48%). Overall, measures were low-cost and had easy readability. However, lengthy tools and lack of reported validity/reliability data indicate low transferability.

CONCLUSIONS

Implementation science can contribute to more complete and rigorous assessment of school health policy implementation processes, which can improve implementation strategies and ultimately the intended health benefits. Several high-quality measures of implementation determinants and implementation outcomes can be applied to school health policy implementation assessment. Dissemination and implementation science researchers can also benefit from measurement experiences of school health researchers.