How was research engaged with and used in the development of 131 policy documents? Findings and measurement implications from a mixed methods study

Perspectives of California Legislators on Institutional Barriers and Facilitators to Non-Partisan Research Evidence Use in State Health Policymaking

BACKGROUND

Bridging the translational gap between research evidence and health policy in state legislatures requires understanding the institutional barriers and facilitators to non-partisan research evidence use. Previous studies have identified individual-level barriers and facilitators to research evidence use, but limited perspectives exist on institutional factors within legislatures that influence non-partisan research evidence use in health policymaking.

OBJECTIVE

We describe the perspectives of California state legislators and legislative staff on institutional barriers and facilitators of non-partisan research evidence use in health policymaking and explore potential solutions for enhancing use.

DESIGN

Case study design involving qualitative interviews.

PARTICIPANTS

We interviewed 24 California state legislators, legislative office staff, and legislative research staff.

APPROACH

Semi-structured recorded interviews were conducted in person or by phone to identify opportunities for enhancing non-partisan research evidence use within state legislatures. We conducted thematic analyses of interview transcripts to identify (1) when research evidence is used during the policymaking process, (2) barriers and facilitators operating at the institutional level, and (3) potential solutions for enhancing evidence use.

RESULTS

Institutional barriers to non-partisan research evidence use in health policymaking were grouped into three themes: institutional policies, practices, and priorities. Interviews also revealed institutional-level facilitators of research evidence use, including (1) access and capacity to engage with research evidence, and (2) perceived credibility of research evidence. The most widely supported institutional-level solution for enhancing evidence-based health policymaking in state legislatures involved establishing independent, impartial research entities to provide legislators with trusted evidence to inform decision-making.

CONCLUSIONS

Potential institutional-level changes within state legislatures may enhance evidence use in health policymaking, leading to improved health outcomes and lower healthcare costs for states.

Person-centered care for diverse women: Narrative review of foundational research

Despite advocacy and recommendations to improve health care and health for persons who identify as women, women continue to face inequities in access to and quality of care. Person-centered care for women is one approach that could reduce gendered inequities. We conducted a series of studies to understand what constitutes person-centered care for women and how to achieve it. The overall aim of this article is to highlight the key findings of those studies that can inform policy, practice, and ongoing research. We conducted a narrative review of all studies related to person-centered care for women conducted in our group starting in 2018 over a 5-year period, which was general at the outset, and increasingly focused on racialized immigrant women who constitute a large proportion of the Canadian population. We organized study summaries by research phase: synthesis of person-centered care for women research, exploration of existing person-centered care for women guidance, consultation with key informants, consensus survey of key informants to prioritize strategies to achieve person-centered care for women, and consensus meeting with key informants to prioritize future research. We conducted the reported research in collaboration with an advisory group of diverse women and managers of community agencies. Our research revealed that little prior research had fully established what constitutes person-centered care for women, and in particular, how to achieve it. We also found little acknowledgment of person-centered care for women or strategies to support it in medical curriculum, clinical guidelines, or healthcare policies. We subsequently consulted women who differed by age, ethno-cultural group, health issue, education and geography, and clinicians of different specialties, who offered considerable insight on strategies to support person-centered care for women. Other diverse women, clinicians, healthcare managers, and researchers prioritized issues that warrant future research. We hope that by compiling a summary of our completed research, we draw attention to the need for person-centered care for women and motivate others to pursue it through policy, practice, and research.

Inter-agency collaboration is associated with increased frequency of research use in children's mental health policy making

OBJECTIVE

To determine whether the self-report frequency of inter-agency collaboration about children's mental health issues is associated with the self-report frequency of using research evidence in children's mental health policy and program decision making in mental health agencies (MHAs).

DATA SOURCES

Primary data were collected through web-based surveys of state (N = 221) and county (N = 117) MHA officials.

DESIGN

The primary independent variable was a composite score quantifying the frequency of collaboration about children's mental health issues between officials in MHAs and six other state agencies. The dependent variables were composite scores quantifying the frequency of research use in children's mental health policy and program decision making in general and for specific purposes (i.e., conceptual, instrumental, tactical, imposed). Covariates were composite scores quantifying well-established determinants of research use (e.g., agency leadership, research use skills) in agency policy and program decision making.

DATA METHODS

Separate multiple linear regression models estimated associations between frequency of inter-agency collaboration and research use scores, adjusting for other determinants of research use, respondent state, and other covariates. Data from state and county officials were analyzed separately.

PRINCIPAL FINDINGS

The frequency of inter-agency collaboration was positively and independently associated with the frequency of research use in children's mental health policy making among state (β = 0.22, p = 0.004) and county (β = 0.39, p < 0.0001) MHA officials. Inter-agency collaboration was also the only variable significantly associated with the frequency of research use for all four specific purposes among state MHA officials, and similar findings we observed among county MHA officials. The magnitudes of associations between inter-agency collaboration and frequency of research use were generally stronger than for more well-established determinants of research use in policy making.

CONCLUSIONS

Strategies that promote collaboration between MHA officials and external agencies could increase the use of research evidence in children's mental health policy and program decision making in MHAs.

How successful was the use of a community of practice for the implementation of evidence-based practices for heart failure within the United States Department of Veterans Affairs: Insights from a formative evaluation

Background

Communities of Practice (CoPs) are a promising approach to facilitate the implementation of evidence-based practices (EBPs) to improve care for chronic conditions like heart failure (HF). CoPs involve a complex process of acquiring and converting both explicit and tacit knowledge into clinical activities. This study describes the conceptualization, creation, capacity-building and dissemination of a CoP sustained over 9 years, and evaluates its value and impact on EBP.

Methods

In July 2006, a CoP called the Heart Failure Provider Network (HF Network) was established within the United States Department of Veterans Affairs (VA) with the overarching goal of improving the quality of care for HF patients. We assessed (formative) the HF Network in terms of its various activities (inputs) and proximal impacts (mediators) at the individual level, and its distal impacts (outcomes) at the site level including implementation of new/improved EBPs at the systemwide level.

Results

The HF Network membership grew steadily over the 9 years. The CoP has involved a total of 1341 multidisciplinary and multilevel members at all 144 VA Health Care Systems (sites). Most members were practising clinicians (n = 891, 66.4%), followed by administrators (n = 342, 25.5%), researchers (n = 70, 5.2%) and others (n = 38, 2.8%). Participation was assessed to be “active” for 70.6% versus “passive” for 29.4% of members. The distribution of active members (clinicians 64.7%, administrators 21.6%) was similar to the distribution of overall membership.

Conclusions

Survey respondents perceived the HF Network as useful in terms of its varied activities and resources relevant for patient care. Strong evidence shows that these members, particularly those who considered themselves influential in improving quality of care, noted multiple benefits of membership, which included confirmation of their own clinical practices, evidence-based changes to their practice and help in understanding facilitators and barriers in setting up or running HF clinics and other programmes. Such CoPs have strong impacts on the quality of care being delivered for both mandated and non-mandated initiatives.

Policymakers' Research Capacities, Engagement, and Use of Research in Public Health Policymaking

The use of research in public health policymaking is one of the prerequisites for successfully implemented health policies which have better population health as an outcome. This policy process is influenced by the actors involved under the policy umbrella, with inter-related contextual factors and specific structural and institutional circumstances. Our study investigates how policymakers’ research capacities influence the use of research in the health policy process and identify areas where capacity-building interventions give the most meaning and impact. Furthermore, we investigate policymakers’ research engagement and use this to inform public health policy in the public sector in Denmark. We collect and report data using Seeking, Engaging with, and Evaluation Research (SEER) methodology. Policymakers are reported to have research capacity, but it is questionable how those competences have actually been used in policymaking. Decision-makers were often not aware or did not know about the existing organizational tools and systems for research engagement and use and two third of respondents had not been part of any research activities or had any collaboration with researchers. Overall, research use in public health policymaking and evaluation was limited. As a conclusion, we propose that capacity-building interventions for increasing research use and collaboration in EIPM should be context-oriented, measurable, and sustainable in developing individual and organizational competences.

Determinants of using children's mental health research in policymaking: variation by type of research use and phase of policy process

Background

Research use in policymaking is multi-faceted and has been the focus of extensive study. However, virtually no quantitative studies have examined whether the determinants of research use vary according to the type of research use or phase of policy process. Understanding such variation is important for selecting the targets of implementation strategies that aim to increase the frequency of research use in policymaking.

Methods

A web-based survey of US state agency officials involved with children’s mental health policymaking was conducted between December 2019 and February 2020 (n = 224, response rate = 33.7%, 49 states responding (98%), median respondents per state = 4). The dependent variables were composite scores of the frequency of using children’s mental health research in general, specific types of research use (i.e., conceptual, instrumental, tactical, imposed), and during different phases of the policy process (i.e., agenda setting, policy development, policy implementation). The independent variables were four composite scores of determinants of research use: agency leadership for research use, agency barriers to research use, research use skills, and dissemination barriers (e.g., lack of actionable messages/recommendations in research summaries, lack of interaction/collaboration with researchers). Separate multiple linear regression models estimated associations between determinant and frequency of research use scores.

Results

Determinants of research use varied significantly by type of research use and phase of policy process. For example, agency leadership for research use was the only determinant significantly associated with imposed research use (β = 0.31, p < 0.001). Skills for research use were the only determinant associated with tactical research use (β = 0.17, p = 0.03) and were only associated with research use in the agenda-setting phase (β = 0.16, p = 0.04). Dissemination barriers were the most universal determinants of research use, as they were significantly and inversely associated with frequency of conceptual (β = −0.21, p = 0.01) and instrumental (β = −0.22, p = 0.01) research use and during all three phases of policy process.

Conclusions

Decisions about the determinants to target with policy-focused implementation strategies—and the strategies that are selected to affect these targets—should reflect the specific types of research use that these strategies aim to influence.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01081-8.

Perspectives and Experiences of Policy Makers, Researchers, Health Information Technology Professionals, and the Public on Evidence-Based Health Policies: Protocol for a Qualitative Study

Background

Evidence-based health policy (EBHP) development is critical to the judicious use of public funds. EBHPs increase transparency, accountability, effectiveness, and efficiency of policies. Encouraging collaboration between researchers or knowledge producers and policy makers is important because both communities have distinct professional cultures, resulting in them working separately without understanding each other. Knowledge sharing is a complex process that requires understanding of cultural aspects that may reduce cultural differences and increase the use of common language. Health information technology (HIT) is a useful tool to increase knowledge translation, which may result in the transparent use of evidence and networking in developing EBHPs. Our vision is to leverage HIT tools for a better health system that includes digitalized, open source, evidence-based, and transparent ways for collaboration and development of robust mechanisms and for sharing of synthesized evidence with knowledge user–friendly forms.

Objective

The aim of this study is to develop a conceptual framework on Knowledge translation and health Information Technology for Transparency (KhITT) in policy making and EBHPs (ie, the KhITT framework). The framework will be informed by the views of four key stakeholder groups (ie, policy makers, knowledge producers, HIT professionals, and the public) toward EBHP. The informants may also describe practices that demonstrate the EBHP development process and suggest technology platforms to enable this process.

Methods

We propose an exploratory, descriptive qualitative study to take place in British Columbia, Canada, using in-depth semistructured interviews. To ensure data saturation and trustworthiness, we will use a nonprobability, purposive snowball sample of up to 15 eligible participants in each of the four stakeholder groups. We will analyze the data using content analysis.

Results

The KhITT framework focuses on various stakeholders’ perspectives to better understand their perceived needs and priorities in identifying issues with EBHP, in order to make informed recommendations. Ethics approval has been obtained by the harmonized Behavioural Research Ethics Board at the University of British Columbia. We anticipate that we will complete data collection and analysis by December 2020. Preliminary results will be published in summer 2021.

Conclusions

Our ultimate goal of this study is to develop a conceptual framework and describe the technology platforms that would enable the EBHP process. We anticipate that our rigorous content analysis will be able to produce insights and themes that are able to address our objectives, contribute to an in-depth understanding of the EBHP process within British Columbia, highlight all influential factors, explicitly disseminate and communicate the study results, identify issues with EBHP and provide informed recommendations to address them, and enhance efforts toward transparent EBHPs.

International Registered Report Identifier (IRRID)

PRR1-10.2196/16268

Is patient-centred care for women a priority for policy-makers? Content analysis of government policies

BACKGROUND

Considerable research shows that women experience gendered disparities in healthcare access and quality. Patient-centred care (PCC) could reduce inequities by addressing the patient's clinical and personal needs. Healthcare policies can influence service delivery to optimise patient outcomes. This study assessed whether and how government policies recognise and promote PCC for women (PCCW).

METHODS

We analysed the content of English-language policies published in Canada from 2010 to 2018 on depression and cardiac rehabilitation - conditions featuring known gendered inequities - that were identified on government websites. We extracted data and used summary statistics to enumerate mentions of PCC and women's health.

RESULTS

We included 30 policies (20 depression, 10 cardiac rehabilitation). Of those, 20 (66.7%) included any content related to PCC (median 1.0, range 0.0 to 5.0), most often exchanging information (14, 46.7%) and making decisions (13, 43.3%). Less frequent domains were enabling self-management (8, 26.7%), addressing emotions (6, 20.0%) and fostering the relationship (4, 13.3%). No policies included content for the domain of managing uncertainty. A higher proportion of cardiac rehabilitation guidelines included PCC content. Among the 30 policies, 7 (23.3%) included content related to at least one women's health domain (median 0.0, range 0.0 to 3.0). Most frequently included were social determinants of health (4, 13.3%). Fewer policies mentioned any issues to consider for women (2, 28.6%), issues specific to subgroups of women (2, 28.6%) or distinguished care for women from men (2, 28.6%). No policies included mention of abuse or violence, or discrimination or stigma. The policies largely pertained to depression. Despite mention of PCC or women's health, policies offered brief, vague guidance on how to achieve PCCW; for example, "Patients value being involved in decision-making" and "Women want care that is collaborative, woman- and family-centered, and culturally sensitive."

CONCLUSIONS

Despite considerable evidence of need and international recommendations, most policies failed to recognise gendered disparities or promote PCC as a mitigating strategy. These identified gaps represent opportunities by which government policies could be developed or strengthened to support PCCW. Future research should investigate complementary strategies such as equipping policy-makers with the evidence and tools required to develop PCCW-informed policies.